UNIVERSITY OF JYVÄSKYLÄ Distributed computing in peer-to-peer environment InBCT 3.2 Peer-to-Peer communication Cheese Factory -project http://tisu.it.jyu.fi/cheesefactory Research Assistant Niko Kotilainen University of Jyväskylä Agora Center [email protected]
UNIVERSITY OF JYVÄSKYLÄ Distributed computing in peer-to-peer environment InBCT 3.2 Peer-to-Peer communication Cheese Factory -project .
Dec 20, 2015
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
UNIVERSITY OF JYVÄSKYLÄ
Distributed computing in peer-to-peer environmentInBCT 3.2 Peer-to-Peer communicationCheese Factory -projecthttp://tisu.it.jyu.fi/cheesefactory
Research AssistantNiko Kotilainen
University of Jyväskylä
Agora [email protected]
2003
UNIVERSITY OF JYVÄSKYLÄ
Problem
• Evolving neural networks needs a lot of computing power
• One computer is not enough for many research cases
2003
UNIVERSITY OF JYVÄSKYLÄ
Solution
• Distribute computation across desktop computers all over Agora
• It has to be as invisible as possible to the user of the network simulator
• The simulator should not interfere with the desktop use of the distributed computers
2003
UNIVERSITY OF JYVÄSKYLÄ
Architecture
Chedarnode
Chedarnode
Chedarnode Chedar
node
Chedarnode
Master
2003
UNIVERSITY OF JYVÄSKYLÄ
Architecture
Chedarnode
Chedarnode
Chedarnode Chedar
node
Chedarnode
Master
2003
UNIVERSITY OF JYVÄSKYLÄ
Architecture
Chedarnode
Chedarnode
Chedarnode Chedar
node
Chedarnode
Master
Query
Query
Query: who has the resource ”NetSimulator” available?
2003
UNIVERSITY OF JYVÄSKYLÄ
Architecture
Chedarnode
Chedarnode
Chedarnode Chedar
node
Chedarnode
Master
Reply
Reply
Reply: I do!
Reply
2003
UNIVERSITY OF JYVÄSKYLÄ
Architecture
Chedarnode
Chedarnode
Chedarnode Chedar
node
Chedarnode
Master
Task
Task
Task
2003
UNIVERSITY OF JYVÄSKYLÄ
Architecture
Chedarnode
Chedarnode
Chedarnode Chedar
node
Chedarnode
Master
Computation…
2003
UNIVERSITY OF JYVÄSKYLÄ
Architecture
Chedarnode
Chedarnode
Chedarnode Chedar
node
Chedarnode
Master
Result
Result
Results are sent back to the master node.Calculation ends and everybody is happy.
Result
2003
UNIVERSITY OF JYVÄSKYLÄ
What happens inside a Chedar node
Task
Chedar-node starts the distributed program, hijackingits file operations.
Chedar
Distributed program
Result
Any Java program that uses files to read input and store output can be distributed
2003
UNIVERSITY OF JYVÄSKYLÄ
Advantages over ordinary clusters
• Minimal costs– No need for new hardware
• More dynamic, better fault-tolerance– Computers can join or leave the network at any
time
• More scalable– Network size can be huge
2003
UNIVERSITY OF JYVÄSKYLÄ
Future of the system
• At this time just a tool for the project to speed up computations
• Larger deployment• Possible improvements
– Master can leave the network and gather results afterwards
– Load balancing between peer nodes
Related Documents
