SlideShare a Scribd company logo
Volunteer Computing
            P2P-Tuple Architecture
                        Evaluation
                            Future




.
                                                                 .
     P2P-Tuple: Towards a Robust Volunteer
              Computing Platform
.
..                                                           .




                                                                 .
               Emmanouil Dimogerontakis

                               FIB UPC


                        March 13, 2012



                                         .   .   .   .   .           .

                                                                         1 / 27
Volunteer Computing
                   P2P-Tuple Architecture   Importance of VC
                               Evaluation   VC Infrastructures
                                   Future




   .
. . Volunteer Computing
  1
      Importance of VC
      VC Infrastructures

   .
. . P2P-Tuple Architecture
  2
      Overview
      Peer Design

   .
. . Evaluation
  3
      Simulation
      Results

   .
. . Future
  4



                                                           .     .   .   .   .   .

                                                                                     2 / 27
Volunteer Computing
                 P2P-Tuple Architecture   Importance of VC
                             Evaluation   VC Infrastructures
                                 Future


. Grid-y for Science




                                                         .     .   .   .   .   .

                                                                                   3 / 27
Volunteer Computing
          P2P-Tuple Architecture   Importance of VC
                      Evaluation   VC Infrastructures
                          Future


. BOINC




                                                  .     .   .   .   .   .

                                                                            4 / 27
Volunteer Computing
                P2P-Tuple Architecture   Importance of VC
                            Evaluation   VC Infrastructures
                                Future


. P2P-Tuple Contribution




                                                        .     .   .   .   .   .

                                                                                  5 / 27
Volunteer Computing
                   P2P-Tuple Architecture   Overview
                               Evaluation   Peer Design
                                   Future




   .
. . Volunteer Computing
  1
      Importance of VC
      VC Infrastructures

   .
. . P2P-Tuple Architecture
  2
      Overview
      Peer Design

   .
. . Evaluation
  3
      Simulation
      Results

   .
. . Future
  4



                                                          .   .   .   .   .   .

                                                                                  6 / 27
Volunteer Computing
                 P2P-Tuple Architecture   Overview
                             Evaluation   Peer Design
                                 Future


. Base technologies




                                                        .   .   .   .   .   .

                                                                                7 / 27
Volunteer Computing
                 P2P-Tuple Architecture   Overview
                             Evaluation   Peer Design
                                 Future


. Base technologies




                                                        .   .   .   .   .   .

                                                                                8 / 27
Volunteer Computing
                 P2P-Tuple Architecture   Overview
                             Evaluation   Peer Design
                                 Future


. Base technologies




                                                        .   .   .   .   .   .

                                                                                9 / 27
Volunteer Computing
                     P2P-Tuple Architecture   Overview
                                 Evaluation   Peer Design
                                     Future


. Overall Operation

    Step 1: Peers join the overlay and a SCRIBE group.
    Step 2: Group owners submit their task to the Tuple Space using a
    client program.
    (Tasks can also be pipelined)
    Step 3: Peers periodically broadcasts task notification
    message.
    Step 4: Peers in the same group start pulling jobs related to that
    task.
    Step 5: Notified peers spread the word.
    Step 6: Once the job is finished the result is put encoded back on
    the Tuple Space.


                                                            .   .   .   .   .   .

                                                                                10 / 27
Volunteer Computing
                P2P-Tuple Architecture   Overview
                            Evaluation   Peer Design
                                Future


. Peer Design




                                                       .   .   .   .   .   .

                                                                           11 / 27
Volunteer Computing
                P2P-Tuple Architecture   Overview
                            Evaluation   Peer Design
                                Future


. Peer Daemon




                                                       .   .   .   .   .   .

                                                                           12 / 27
Volunteer Computing
               P2P-Tuple Architecture   Overview
                           Evaluation   Peer Design
                               Future


. Job Executor Daemon




                                                      .   .   .   .   .   .

                                                                          13 / 27
Volunteer Computing
                     P2P-Tuple Architecture   Overview
                                 Evaluation   Peer Design
                                     Future


. Measures to Achieve Fault Tolerance


    Measure: Provide high availability, face high churn rate, remain
    reliable.
    Effect: Redundancy of data, Replication, use of Erasure Code.




                                                            .   .   .   .   .   .

                                                                                14 / 27
Volunteer Computing
                     P2P-Tuple Architecture   Overview
                                 Evaluation   Peer Design
                                     Future


. Measures to Achieve Fault Tolerance


    Measure: Provide high availability, face high churn rate, remain
    reliable.
    Effect: Redundancy of data, Replication, use of Erasure Code.
    Measure: Loss of data from high churn rate
    Effect: Communicating Mirrored Replicas of stored objects.




                                                            .   .   .   .   .   .

                                                                                15 / 27
Volunteer Computing
                     P2P-Tuple Architecture   Overview
                                 Evaluation   Peer Design
                                     Future


. Measures to Achieve Fault Tolerance


    Measure: Provide high availability, face high churn rate, remain
    reliable.
    Effect: Redundancy of data, Replication, use of Erasure Code.
    Measure: Loss of data from high churn rate
    Effect: Communicating Mirrored Replicas of stored objects.
    Measure: Untrusted peers, possible low job completion probability.
    Effect: Job Duplication using a randomized job scheduling scheme.




                                                            .   .   .   .   .   .

                                                                                16 / 27
Volunteer Computing
                     P2P-Tuple Architecture   Overview
                                 Evaluation   Peer Design
                                     Future


. Measures to Achieve Fault Tolerance


    Measure: Provide high availability, face high churn rate, remain
    reliable.
    Effect: Redundancy of data, Replication, use of Erasure Code.
    Measure: Loss of data from high churn rate
    Effect: Communicating Mirrored Replicas of stored objects.
    Measure: Untrusted peers, possible low job completion probability.
    Effect: Job Duplication using a randomized job scheduling scheme.
    Measure: Disconnecting Client Application.
    Effect: Checkpoints.



                                                            .   .   .   .   .   .

                                                                                17 / 27
Volunteer Computing
                   P2P-Tuple Architecture   Simulation
                               Evaluation   Results
                                   Future




   .
. . Volunteer Computing
  1
      Importance of VC
      VC Infrastructures

   .
. . P2P-Tuple Architecture
  2
      Overview
      Peer Design

   .
. . Evaluation
  3
      Simulation
      Results

   .
. . Future
  4



                                                         .   .   .   .   .   .

                                                                             18 / 27
Volunteer Computing
                      P2P-Tuple Architecture   Simulation
                                  Evaluation   Results
                                      Future


. Impact of mirrors




    .
    Result                                                                .
   ..
    Using 1 or 2 mirrors extends the duration of the data availability.
    .
    ..                                                                  .




                                                                                .
                                                            .   .   .   .   .   .

                                                                                19 / 27
Volunteer Computing
                      P2P-Tuple Architecture   Simulation
                                  Evaluation   Results
                                      Future


. Impact of Redundancy Level




    .
    Result                                                                .
   ..
    The increase of the duration of data availability is proportionate to
    the increase of Redundancy level.
    .
    ..                                                                  .




                                                                                .
                                                            .   .   .   .   .   .

                                                                                20 / 27
Volunteer Computing
                      P2P-Tuple Architecture   Simulation
                                  Evaluation   Results
                                      Future


. Behavior in high churn environment




    .
    Result                                                                .
   ..
    In a high churn rate environment the availability decreases easily.
    .
    ..                                                                  .




                                                                                .
                                                            .   .   .   .   .   .

                                                                                21 / 27
Volunteer Computing
                    P2P-Tuple Architecture   Simulation
                                Evaluation   Results
                                    Future


. Results



    A Volunteer Computing infrastructure:
        Decentralized
        Fault Tolerant




                                                          .   .   .   .   .   .

                                                                              22 / 27
Volunteer Computing
                      P2P-Tuple Architecture   Simulation
                                  Evaluation   Results
                                      Future


. Results



    A Volunteer Computing infrastructure:
        Decentralized
        Fault Tolerant
    that provides:
        High Availability
        Reliability




                                                            .   .   .   .   .   .

                                                                                23 / 27
Volunteer Computing
                   P2P-Tuple Architecture
                               Evaluation
                                   Future




   .
. . Volunteer Computing
  1
      Importance of VC
      VC Infrastructures

   .
. . P2P-Tuple Architecture
  2
      Overview
      Peer Design

   .
. . Evaluation
  3
      Simulation
      Results

   .
. . Future
  4



                                            .   .   .   .   .   .

                                                                24 / 27
Volunteer Computing
                   P2P-Tuple Architecture
                               Evaluation
                                   Future


. Future




       Optimizing current infrastructures and ensure system stability
       ”MPI-like” support
       ”MapReduce-like” support




                                               .    .   .    .    .     .

                                                                        25 / 27
Volunteer Computing
P2P-Tuple Architecture
            Evaluation
                Future




                         .   .   .   .   .   .

                                             26 / 27
Volunteer Computing
                   P2P-Tuple Architecture
                               Evaluation
                                   Future


. Bibliography & Useful Links


       Lei Ni, Aaron Harwood, P2P-Tuple: Towards a Robust
       Volunteer Computing Platform. International Conference on
       Parallel and Distributed Computing, Applications and
       Technologies, 2009.
       Hao Ning, Robust Overlay networks for Volunteer Computing.
       Master thesis on Chalmers University of Technology, 2010.
       http://ww2.cs.mu.oz.au/~lni/p2ptuple/.
       http://www.freepastry.org



                                             .    .   .    .   .    .

                                                                    27 / 27

More Related Content

Similar to P2P-Tuple: Towards a Robust Volunteer Computing Platform

Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...
Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...
Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...Pieter Pauwels
 
A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...
A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...
A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...
Toshihiko Yamakami
 
Platform 3 kickoff april 4 2013 my thoughts mark skilton v2
Platform 3 kickoff april 4 2013 my thoughts  mark skilton v2Platform 3 kickoff april 4 2013 my thoughts  mark skilton v2
Platform 3 kickoff april 4 2013 my thoughts mark skilton v2
Mark Skilton
 
Embedded system
Embedded systemEmbedded system
Embedded systemzdyhit
 
Varkon Semiconductor
Varkon Semiconductor Varkon Semiconductor
Varkon Semiconductor Rajiv Parmar
 
BIM: an overview
BIM: an overviewBIM: an overview
BIM: an overview
pwcom.co.uk Ltd
 
From email to BIM: 20 years of construction collaboration technologies
From email to BIM: 20 years of construction collaboration technologiesFrom email to BIM: 20 years of construction collaboration technologies
From email to BIM: 20 years of construction collaboration technologies
pwcom.co.uk Ltd
 
Advanced view of projects raspberry pi list raspberry pi projects
Advanced view of projects raspberry pi list   raspberry pi projectsAdvanced view of projects raspberry pi list   raspberry pi projects
Advanced view of projects raspberry pi list raspberry pi projects
WiseNaeem
 
A Gap Analysis Framework of IoT-empowered City Platform as a Service
A Gap Analysis Framework of IoT-empowered City Platform as a ServiceA Gap Analysis Framework of IoT-empowered City Platform as a Service
A Gap Analysis Framework of IoT-empowered City Platform as a Service
Toshihiko Yamakami
 
Collaborative Construction of Telecommunications Services
Collaborative Construction of Telecommunications ServicesCollaborative Construction of Telecommunications Services
Collaborative Construction of Telecommunications Services
Vanea Chiprianov
 
Introduction of k8s-cluster-simulator
Introduction of k8s-cluster-simulatorIntroduction of k8s-cluster-simulator
Introduction of k8s-cluster-simulator
Daisuke Taniwaki
 
Kamaelia Europython Tutorial
Kamaelia Europython TutorialKamaelia Europython Tutorial
Kamaelia Europython Tutorial
kamaelian
 

Similar to P2P-Tuple: Towards a Robust Volunteer Computing Platform (15)

Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...
Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...
Workshop Ontology Modelling 2011, Session 8 - Reasoning with data: building p...
 
A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...
A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...
A Migration-oriented Partial Adaptation Architecture for IoT-empowered City P...
 
Platform 3 kickoff april 4 2013 my thoughts mark skilton v2
Platform 3 kickoff april 4 2013 my thoughts  mark skilton v2Platform 3 kickoff april 4 2013 my thoughts  mark skilton v2
Platform 3 kickoff april 4 2013 my thoughts mark skilton v2
 
Embedded system
Embedded systemEmbedded system
Embedded system
 
BIM Interoperability - Andrew Bellerby
BIM Interoperability - Andrew BellerbyBIM Interoperability - Andrew Bellerby
BIM Interoperability - Andrew Bellerby
 
Varkon Semiconductor
Varkon Semiconductor Varkon Semiconductor
Varkon Semiconductor
 
BIM: an overview
BIM: an overviewBIM: an overview
BIM: an overview
 
From email to BIM: 20 years of construction collaboration technologies
From email to BIM: 20 years of construction collaboration technologiesFrom email to BIM: 20 years of construction collaboration technologies
From email to BIM: 20 years of construction collaboration technologies
 
Advanced view of projects raspberry pi list raspberry pi projects
Advanced view of projects raspberry pi list   raspberry pi projectsAdvanced view of projects raspberry pi list   raspberry pi projects
Advanced view of projects raspberry pi list raspberry pi projects
 
Work Package 3 - Month 6 by Christian Morbidoni
Work Package 3 - Month 6 by Christian MorbidoniWork Package 3 - Month 6 by Christian Morbidoni
Work Package 3 - Month 6 by Christian Morbidoni
 
A Gap Analysis Framework of IoT-empowered City Platform as a Service
A Gap Analysis Framework of IoT-empowered City Platform as a ServiceA Gap Analysis Framework of IoT-empowered City Platform as a Service
A Gap Analysis Framework of IoT-empowered City Platform as a Service
 
Bim Newsletter January2012
Bim Newsletter January2012Bim Newsletter January2012
Bim Newsletter January2012
 
Collaborative Construction of Telecommunications Services
Collaborative Construction of Telecommunications ServicesCollaborative Construction of Telecommunications Services
Collaborative Construction of Telecommunications Services
 
Introduction of k8s-cluster-simulator
Introduction of k8s-cluster-simulatorIntroduction of k8s-cluster-simulator
Introduction of k8s-cluster-simulator
 
Kamaelia Europython Tutorial
Kamaelia Europython TutorialKamaelia Europython Tutorial
Kamaelia Europython Tutorial
 

More from Save Manos

NaaS
NaaSNaaS
A boring presentation about social mobile communication patterns and opportun...
A boring presentation about social mobile communication patterns and opportun...A boring presentation about social mobile communication patterns and opportun...
A boring presentation about social mobile communication patterns and opportun...Save Manos
 
Man In The Browser
Man In The BrowserMan In The Browser
Man In The BrowserSave Manos
 
A survey on modifications for unstructured P2P in WMNs .
A survey on modifications for unstructured P2P in WMNs . A survey on modifications for unstructured P2P in WMNs .
A survey on modifications for unstructured P2P in WMNs . Save Manos
 
Network as a Service
Network as  a ServiceNetwork as  a Service
Network as a Service
Save Manos
 
RESTful Web Services
RESTful Web ServicesRESTful Web Services
RESTful Web Services
Save Manos
 
Distributed systems
Distributed systemsDistributed systems
Distributed systems
Save Manos
 

More from Save Manos (9)

NaaS
NaaSNaaS
NaaS
 
A boring presentation about social mobile communication patterns and opportun...
A boring presentation about social mobile communication patterns and opportun...A boring presentation about social mobile communication patterns and opportun...
A boring presentation about social mobile communication patterns and opportun...
 
Man In The Browser
Man In The BrowserMan In The Browser
Man In The Browser
 
Apache Mahout
Apache MahoutApache Mahout
Apache Mahout
 
A survey on modifications for unstructured P2P in WMNs .
A survey on modifications for unstructured P2P in WMNs . A survey on modifications for unstructured P2P in WMNs .
A survey on modifications for unstructured P2P in WMNs .
 
Network as a Service
Network as  a ServiceNetwork as  a Service
Network as a Service
 
Openflow
OpenflowOpenflow
Openflow
 
RESTful Web Services
RESTful Web ServicesRESTful Web Services
RESTful Web Services
 
Distributed systems
Distributed systemsDistributed systems
Distributed systems
 

Recently uploaded

The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 

Recently uploaded (20)

The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 

P2P-Tuple: Towards a Robust Volunteer Computing Platform

  • 1. Volunteer Computing P2P-Tuple Architecture Evaluation Future . . P2P-Tuple: Towards a Robust Volunteer Computing Platform . .. . . Emmanouil Dimogerontakis FIB UPC March 13, 2012 . . . . . . 1 / 27
  • 2. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future . . . Volunteer Computing 1 Importance of VC VC Infrastructures . . . P2P-Tuple Architecture 2 Overview Peer Design . . . Evaluation 3 Simulation Results . . . Future 4 . . . . . . 2 / 27
  • 3. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future . Grid-y for Science . . . . . . 3 / 27
  • 4. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future . BOINC . . . . . . 4 / 27
  • 5. Volunteer Computing P2P-Tuple Architecture Importance of VC Evaluation VC Infrastructures Future . P2P-Tuple Contribution . . . . . . 5 / 27
  • 6. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . . . Volunteer Computing 1 Importance of VC VC Infrastructures . . . P2P-Tuple Architecture 2 Overview Peer Design . . . Evaluation 3 Simulation Results . . . Future 4 . . . . . . 6 / 27
  • 7. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Base technologies . . . . . . 7 / 27
  • 8. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Base technologies . . . . . . 8 / 27
  • 9. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Base technologies . . . . . . 9 / 27
  • 10. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Overall Operation Step 1: Peers join the overlay and a SCRIBE group. Step 2: Group owners submit their task to the Tuple Space using a client program. (Tasks can also be pipelined) Step 3: Peers periodically broadcasts task notification message. Step 4: Peers in the same group start pulling jobs related to that task. Step 5: Notified peers spread the word. Step 6: Once the job is finished the result is put encoded back on the Tuple Space. . . . . . . 10 / 27
  • 11. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Peer Design . . . . . . 11 / 27
  • 12. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Peer Daemon . . . . . . 12 / 27
  • 13. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Job Executor Daemon . . . . . . 13 / 27
  • 14. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. . . . . . . 14 / 27
  • 15. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. Measure: Loss of data from high churn rate Effect: Communicating Mirrored Replicas of stored objects. . . . . . . 15 / 27
  • 16. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. Measure: Loss of data from high churn rate Effect: Communicating Mirrored Replicas of stored objects. Measure: Untrusted peers, possible low job completion probability. Effect: Job Duplication using a randomized job scheduling scheme. . . . . . . 16 / 27
  • 17. Volunteer Computing P2P-Tuple Architecture Overview Evaluation Peer Design Future . Measures to Achieve Fault Tolerance Measure: Provide high availability, face high churn rate, remain reliable. Effect: Redundancy of data, Replication, use of Erasure Code. Measure: Loss of data from high churn rate Effect: Communicating Mirrored Replicas of stored objects. Measure: Untrusted peers, possible low job completion probability. Effect: Job Duplication using a randomized job scheduling scheme. Measure: Disconnecting Client Application. Effect: Checkpoints. . . . . . . 17 / 27
  • 18. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future . . . Volunteer Computing 1 Importance of VC VC Infrastructures . . . P2P-Tuple Architecture 2 Overview Peer Design . . . Evaluation 3 Simulation Results . . . Future 4 . . . . . . 18 / 27
  • 19. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future . Impact of mirrors . Result . .. Using 1 or 2 mirrors extends the duration of the data availability. . .. . . . . . . . . 19 / 27
  • 20. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future . Impact of Redundancy Level . Result . .. The increase of the duration of data availability is proportionate to the increase of Redundancy level. . .. . . . . . . . . 20 / 27
  • 21. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future . Behavior in high churn environment . Result . .. In a high churn rate environment the availability decreases easily. . .. . . . . . . . . 21 / 27
  • 22. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future . Results A Volunteer Computing infrastructure: Decentralized Fault Tolerant . . . . . . 22 / 27
  • 23. Volunteer Computing P2P-Tuple Architecture Simulation Evaluation Results Future . Results A Volunteer Computing infrastructure: Decentralized Fault Tolerant that provides: High Availability Reliability . . . . . . 23 / 27
  • 24. Volunteer Computing P2P-Tuple Architecture Evaluation Future . . . Volunteer Computing 1 Importance of VC VC Infrastructures . . . P2P-Tuple Architecture 2 Overview Peer Design . . . Evaluation 3 Simulation Results . . . Future 4 . . . . . . 24 / 27
  • 25. Volunteer Computing P2P-Tuple Architecture Evaluation Future . Future Optimizing current infrastructures and ensure system stability ”MPI-like” support ”MapReduce-like” support . . . . . . 25 / 27
  • 26. Volunteer Computing P2P-Tuple Architecture Evaluation Future . . . . . . 26 / 27
  • 27. Volunteer Computing P2P-Tuple Architecture Evaluation Future . Bibliography & Useful Links Lei Ni, Aaron Harwood, P2P-Tuple: Towards a Robust Volunteer Computing Platform. International Conference on Parallel and Distributed Computing, Applications and Technologies, 2009. Hao Ning, Robust Overlay networks for Volunteer Computing. Master thesis on Chalmers University of Technology, 2010. http://ww2.cs.mu.oz.au/~lni/p2ptuple/. http://www.freepastry.org . . . . . . 27 / 27