• Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
263
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
3
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Volunteer Computing P2P-Tuple Architecture Evaluation Future. . P2P-Tuple: Towards a Robust Volunteer Computing Platform... . . Emmanouil Dimogerontakis FIB UPC March 13, 2012 . . . . . . 1 / 27
  • 2. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future .. . Volunteer Computing 1 Importance of VC VC Infrastructures .. . P2P-Tuple Architecture 2 Overview Peer Design .. . Evaluation 3 Simulation Results .. . Future 4 . . . . . . 2 / 27
  • 3. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future. Grid-y for Science . . . . . . 3 / 27
  • 4. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future. BOINC . . . . . . 4 / 27
  • 5. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future. P2P-Tuple Contribution . . . . . . 5 / 27
  • 6. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future .. . Volunteer Computing 1 Importance of VC VC Infrastructures .. . P2P-Tuple Architecture 2 Overview Peer Design .. . Evaluation 3 Simulation Results .. . Future 4 . . . . . . 6 / 27
  • 7. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Base technologies . . . . . . 7 / 27
  • 8. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Base technologies . . . . . . 8 / 27
  • 9. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Base technologies . . . . . . 9 / 27
  • 10. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Overall Operation Step 1: Peers join the overlay and a SCRIBE group. Step 2: Group owners submit their task to the Tuple Space using a client program. (Tasks can also be pipelined) Step 3: Peers periodically broadcasts task notification message. Step 4: Peers in the same group start pulling jobs related to that task. Step 5: Notified peers spread the word. Step 6: Once the job is finished the result is put encoded back on the Tuple Space. . . . . . . 10 / 27
  • 11. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Peer Design . . . . . . 11 / 27
  • 12. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Peer Daemon . . . . . . 12 / 27
  • 13. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Job Executor Daemon . . . . . . 13 / 27
  • 14. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. . . . . . . 14 / 27
  • 15. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. Measure: Loss of data from high churn rate Effect: Communicating Mirrored Replicas of stored objects. . . . . . . 15 / 27
  • 16. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. Measure: Loss of data from high churn rate Effect: Communicating Mirrored Replicas of stored objects. Measure: Untrusted peers, possible low job completion probability. Effect: Job Duplication using a randomized job scheduling scheme. . . . . . . 16 / 27
  • 17. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future. Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. Measure: Loss of data from high churn rate Effect: Communicating Mirrored Replicas of stored objects. Measure: Untrusted peers, possible low job completion probability. Effect: Job Duplication using a randomized job scheduling scheme. Measure: Disconnecting Client Application. Effect: Checkpoints. . . . . . . 17 / 27
  • 18. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future .. . Volunteer Computing 1 Importance of VC VC Infrastructures .. . P2P-Tuple Architecture 2 Overview Peer Design .. . Evaluation 3 Simulation Results .. . Future 4 . . . . . . 18 / 27
  • 19. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future. Impact of mirrors . Result . .. Using 1 or 2 mirrors extends the duration of the data availability. . .. . . . . . . . . 19 / 27
  • 20. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future. Impact of Redundancy Level . Result . .. The increase of the duration of data availability is proportionate to the increase of Redundancy level. . .. . . . . . . . . 20 / 27
  • 21. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future. Behavior in high churn environment . Result . .. In a high churn rate environment the availability decreases easily. . .. . . . . . . . . 21 / 27
  • 22. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future. Results A Volunteer Computing infrastructure: Decentralized Fault Tolerant . . . . . . 22 / 27
  • 23. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future. Results A Volunteer Computing infrastructure: Decentralized Fault Tolerant that provides: High Availability Reliability . . . . . . 23 / 27
  • 24. Volunteer Computing P2P-Tuple Architecture Evaluation Future .. . Volunteer Computing 1 Importance of VC VC Infrastructures .. . P2P-Tuple Architecture 2 Overview Peer Design .. . Evaluation 3 Simulation Results .. . Future 4 . . . . . . 24 / 27
  • 25. Volunteer Computing P2P-Tuple Architecture Evaluation Future. Future Optimizing current infrastructures and ensure system stability ”MPI-like” support ”MapReduce-like” support . . . . . . 25 / 27
  • 26. Volunteer ComputingP2P-Tuple Architecture Evaluation Future . . . . . . 26 / 27
  • 27. Volunteer Computing P2P-Tuple Architecture Evaluation Future. Bibliography & Useful Links Lei Ni, Aaron Harwood, P2P-Tuple: Towards a Robust Volunteer Computing Platform. International Conference on Parallel and Distributed Computing, Applications and Technologies, 2009. Hao Ning, Robust Overlay networks for Volunteer Computing. Master thesis on Chalmers University of Technology, 2010. http://ww2.cs.mu.oz.au/~lni/p2ptuple/. http://www.freepastry.org . . . . . . 27 / 27