SIYAPATHP2P, Gossip Based Volunteer Computing Framework
RISING DEMAND FORHIGH COMPUTATIONAL POWER Simulations Analysis of large data from optical telescopes Gene sequencers G...
HOW TO ADDRESS? Supercomputing Distributed Computing     Cluster Computing     Grid/Desktop-Grid Computing     Volunt...
EXISTING VOLUNTEERCOMPUTING FRAMEWORKS Client Server Architecture     Server bottleneck     Single point of failure Co...
INTRODUCING SIYAPATH P2P Architecture     Absence of server bottleneck     Absence of single point of failure Gossip P...
FEATURES Job Submission Job Scheduling      User                       Job Processor Task Distribution Task Processing...
DEMONSTRATION7            National Best Quality Software Awards, Sri Lanka - 2012
PERFORMANCE TESTINGTest                                                     1            2                                ...
BEST PRACTICES Version control system Build Automation Unit / Integrated testing Logging Continuous Integration User...
OPEN SOURCE COMPONENTS  Services Framework - Apache Thrift    Communication via a service interface    Addresses implem...
DOCUMENTATION  User manuals for the framework  User API Docs  Research publications  Project Website11                ...
TEAM  Members:      Amila Manoj Silva      Nadeeshani Hewage      Mohamed Nufail      Malith Dhanushka  Supervisors:...
Questions?     Thank You!13            National Best Quality Software Awards, Sri Lanka - 2012
Upcoming SlideShare
Loading in...5
×

Siyapath - A P2P, Gossip Based Volunteer Computing Framework

104

Published on

Slide deck presented at NBQSA, Sri Lanka - 2012
This project was awarded Gold at this competition

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
104
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Computational modeling - generate accurate models of the structures of crystalline and amorphous solidsClimate simulations model the past and future global climate with input from observational data and mathematical models. Advanced computational techniques and computer capabilities allow researchers to increase the resolution and refine the grids for climate simulations that enable better regional and global predictions.Bio-inspired algorithms such as genetic and evolutionary algorithms, ant colonies, and immune systems are routinely applied to hard and large problems in a variety of areas. Some examples are optimization through genetic algorithms, new ideas for developing routing algorithms in wireless networks inspired by honey bee behaviour, resource discovery and data mining computations in Grid and P2P frameworks achieved by ant-inspired algorithms, and so on.
  • Computational power volunteered by general publicLarge resource poolself-financing / self-maintainingVolunteer Computing FrameworksExisting frameworksBOINCBayanihanJADIF
  • Task scheduling/distribution > interface – priority, securityTask processing > iface – any kind of task, different tasks
  • Siyapath - A P2P, Gossip Based Volunteer Computing Framework

    1. 1. SIYAPATHP2P, Gossip Based Volunteer Computing Framework
    2. 2. RISING DEMAND FORHIGH COMPUTATIONAL POWER Simulations Analysis of large data from optical telescopes Gene sequencers Gravitational wave detectors Edge-detection for high resolution medical image sequences Biology-inspired algorithms2 National Best Quality Software Awards, Sri Lanka - 2012
    3. 3. HOW TO ADDRESS? Supercomputing Distributed Computing  Cluster Computing  Grid/Desktop-Grid Computing  Volunteer Computing3 National Best Quality Software Awards, Sri Lanka - 2012
    4. 4. EXISTING VOLUNTEERCOMPUTING FRAMEWORKS Client Server Architecture  Server bottleneck  Single point of failure Complexity of Configuring4 National Best Quality Software Awards, Sri Lanka - 2012
    5. 5. INTRODUCING SIYAPATH P2P Architecture  Absence of server bottleneck  Absence of single point of failure Gossip Protocols  Scalability  Robustness  Reliability Simplicity in Configuring5 National Best Quality Software Awards, Sri Lanka - 2012
    6. 6. FEATURES Job Submission Job Scheduling User Job Processor Task Distribution Task Processing Result Validation Result Delivery Task Task Task Fault Tolerance Processor Processor Processor Security6 National Best Quality Software Awards, Sri Lanka - 2012
    7. 7. DEMONSTRATION7 National Best Quality Software Awards, Sri Lanka - 2012
    8. 8. PERFORMANCE TESTINGTest 1 2 3 4 5Users 5 10 15 20 25Volunteers 30 30 30 30 30Avg. Response Time (s) 52.16 89.63 136.29 211.02 249.25Avg. Throughput (Tasks per 126.76 136.45 130.03 109.49 125.96minute) Average Response Time Average Throughput 300 160 250 140 120 Tasks per minute Time (seconds) 200 100 150 80 100 60 40 50 20 0 0 1 2 3 4 5 1 2 3 4 58 Test National Best Quality Software Awards, Sri Lanka - 2012 Test
    9. 9. BEST PRACTICES Version control system Build Automation Unit / Integrated testing Logging Continuous Integration User friendly Website9 National Best Quality Software Awards, Sri Lanka - 2012
    10. 10. OPEN SOURCE COMPONENTS  Services Framework - Apache Thrift  Communication via a service interface  Addresses implementation details of the network  P2P nature using thrift client/server  System Monitoring – SIGAR  Apache Maven  Apache Log4j10 National Best Quality Software Awards, Sri Lanka - 2012
    11. 11. DOCUMENTATION  User manuals for the framework  User API Docs  Research publications  Project Website11 National Best Quality Software Awards, Sri Lanka - 2012
    12. 12. TEAM  Members:  Amila Manoj Silva  Nadeeshani Hewage  Mohamed Nufail  Malith Dhanushka  Supervisors:  Dr. Srinath Perera  Mrs. Vishakha Nanayakkara12 National Best Quality Software Awards, Sri Lanka - 2012
    13. 13. Questions? Thank You!13 National Best Quality Software Awards, Sri Lanka - 2012
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×