• Like
  • Save
Large Scale Distributed Storage Systems in Volunteer Computing - Slide
Upcoming SlideShare
Loading in...5
×
 

Large Scale Distributed Storage Systems in Volunteer Computing - Slide

on

  • 745 views

Final slide for Large Scale Decentralized Storage Systems for Volunteer Computing surveys assignment

Final slide for Large Scale Decentralized Storage Systems for Volunteer Computing surveys assignment

Statistics

Views

Total Views
745
Views on SlideShare
663
Embed Views
82

Actions

Likes
0
Downloads
8
Comments
0

1 Embed 82

http://www.otnira.com 82

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Large Scale Distributed Storage Systems in Volunteer Computing - Slide Large Scale Distributed Storage Systems in Volunteer Computing - Slide Presentation Transcript

    • Large-Scale DecentralizedStorage Systems used byVolunteer ComputingFinal Presentation G7: Arinto, Diego, Enkhjin, Iuliia
    • Outline● Problem Definition● Volunteer Computing (VC)● Decentralized Storage Systems (DSS)● Systems Review● State-of-the-Art DSS used by VC● Conclusions
    • Problem Definition● Decentralized Storage Systems● Volunteer Computing● DSS + VC = ?
    • Problem Definition
    • Problem Definition
    • Volunteer Computing● Group of computing resources● Voluntary share the resource● Incentive volunteers!!● Trust between peers● Example: ○ SETI@home ○ Storage@home ○ Folding@home● However, data is centrally stored
    • Volunteer ComputingBOINCexample
    • Decentralized StorageSystems
    • Decentralized StorageSystems ReviewFocus Criteria: AV = availability SC = scalability ECO = eventual consistency P = performance SE = security
    • Decentralized Storage Systems ReviewSystem Description Focus Large scale persistent P2P storage system SEFarsite P2P storage system based on Dhash table ECO, AVIvy logs P2P DHT-based storage system that used ECOOverNet XOR-based metrics for routing Large scale persistent P2P storage system SC, SE, AVPAST Highly scalable P2P storage system based on SC, ECOPastis trust Big, distributed, fault tolerant hashtable AVVoldemort Globally persistent DSS for any-file-anywhere SC, SEOceanStore
    • Decentralized Storage Systems ReviewSystem Description Focus SC, AV, PGlacier Highly durable DSS for archiving, no remote write P2P storage system. Automatically manage its AV, SCTotal Recall availability in dynamic changing environment DSS with no point of failure to store structured SC, AV, ECOCassandra data SC, AVRiak Dynamo-inspired NOSQL storage system. P, AV, ECODynamo Large scale DSS developed by Amazon Secure DSS and BitTorrent-like file swarming SE, AVAttic techniques to serve data and manage load. P, ECOSquirrel Decentralized Web Cache
    • State-of-The-Art DSS-Characteristics● Read and Write Access● Fault Tolerance and Replication Techniques● Availability and Symmetry● Incentives● Video/Images
    • State-of-The-Art DSS-Characteristics
    • State-of-The-Art DSS-Suggestions for IncentivesIncentives based on amount of storagededicated, computing resources volunteered:● Credit based system● Printable Certificates● Government tax break, possible in countries with significant amount of nodes
    • State-of-The-Art DSS-Challenges● Providing the right Incentive● Security● Integration into current VC environment
    • Conclusions● VC data storage/distribution issues.● Survey on DSS ○ Classification● Integration VC systems - DSS ○ Identify characteristics ○ Valid and Useful / Define state-art ○ Challenges● Tradeoffs ○ functionality and complexity
    • Work EffortArinto Murdopo = 100%Diego Montero = 100%Enkhjin Bayarsaikhan = 100%Iuliia Proskurnia = 100%
    • Questions...???
    • Decentralized StorageSystems● Decentralization ● Consistent Hashing ● Active/Passive● Availability ○ Fault-Tolerance Replication ● Failure-handling● Consistency ○ Eventual consistency (gossip-based) ● Logging● Scalability ● Ring locality