Future of Data Storage in the Cloud

6,458 views

Published on

Presentation slides for a session at Cloud Computing Expo West 2010 on the growth of data and our need to store it more efficiently.

Published in: Technology, Business
1 Comment
9 Likes
Statistics
Notes
  • I love these slides! Did you know we’re running a competition on SlideShare to win a 3M PocketProjector MP180? To enter, simply tag your presentation with ‘3MInform’. Head over to our page for more details... and don’t forget to follow us to find out if you get shortlisted!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
6,458
On SlideShare
0
From Embeds
0
Number of Embeds
14
Actions
Shares
0
Downloads
456
Comments
1
Likes
9
Embeds 0
No embeds

No notes for slide
  • Enough audio to listen to 2 hours of music every day for more than a decade
  • Enough video to watch 40 hours per week for 30 years
  • Another way to show an EB is 50 billion 15 mega-pixel pictures which may actually what we’re sending on the global wireless network
  • We’d need ~200M servers at today’s density (180TB raw) to store all of the data in 2020
  • Future of Data Storage in the Cloud

    1. 1. Community Stacker Bret Piatt Future of Data Storage in the Cloud Cloud Computing Expo West 2010 Twitter: @bpiatt
    2. 2. OBLIGATORY “WHAT IS THE CLOUD?”
    3. 3. GLOBAL
    4. 4. ON DEMAND
    5. 5. INFRASTRUCTURE
    6. 6. 70’s – 80’s Mainframe Era 90’s-2000’s Client Server Era 2010-beyond Cloud Era [Based on a Gartner Study] 2010 IT budgets aren’t getting cut.. ..but CIOs expect their spend to go further. • #1 Priority is Virtualization • #2 is Cloud Computing A NEW ERA OF COMPUTING
    7. 7. HOW ABOUT NOW.. “..YOU TALK ABOUT SOMETHING REAL?”
    8. 8. HOW BIG IS A..
    9. 9. GIGABYTE 500,000 pages of text 15 minutes of HD Video
    10. 10. TERABYTE 10,000 hours of high quality audio 35 Blu-ray discs
    11. 11. PETABYTE All of the data for World of Warcraft™ 62,400 hours of HD video
    12. 12. EXABYTE The amount of data sent on the global wireless networks per month
    13. 13. ZETTABTYE All of the data on Earth today 150GB of data per person
    14. 14. ZETTABTYE 2% of the data on Earth in 2020
    15. 15. HOW DO WE STORE IT TODAY? NOT THIS EFFICIENTLY STATE OF THE ART DENSITY 3TB DRIVES AT 15 PER RU 529,101 42U CABINETS FOR A ZETTABYTE
    16. 16. DATA IS OUTGROWING NETWORK 1 PETABTYE OF DATA TAKES OVER 10 DAYS TO MOVE.. NOT ..ON A 10 GIGABIT NETWORK!
    17. 17. With the cost to store data approaching zero... ...we're ending up with digital Hoarders™. JUST BECAUSE YOU CAN DOESN’T MEAN YOU SHOULD
    18. 18. If we stored all of the global data as “an average” enterprise.. ..it would take.. ..38.5% of the World GDP! EFFICIENT STORAGE IS KEY ITEM MONTHLY FIGURES ENTERPRISE AVGERAGE STORAGE COST $1.98 PER GIGABYTE WORLD GDP $5.13 TRILLION COST TO STORE A ZETTABYTE $1.98 TRILLION
    19. 19. THE OPPORTUNITY MOST DATA IS AT REST STORAGE I/O IS EXPENSIVE ADVANCED FEATURES ARE EXPENSIVE USE HYBRID DATA STORAGE MAXIMIZE BENEFITS
    20. 20. OBJECT STORAGE Distributed, REST-based API, No central database Hardware agnostic - commodity hardware, RAID not required Account/Container/Object structure (not file system, no nesting) Replication (N copies of accounts, containers, objects) Data distributed evenly throughout system Scalable to multiple petabytes, billions of objects
    21. 21. EVOLUTION OF OBJECT STORAGE
    22. 22. SMALL SCALE DEPLOYMENT 5 Storage Nodes, $0.13 per GB (monthly) 490TB of disk, 160TB usable 18.5kVA, 35 RU, 5 “half cabinets” $0.114 per GB OPEX (monthly) $0.014 per GB CAPEX ($200k, 36 month refresh) $0.38/GB (with 3 copies), < 20% of “average”
    23. 23. LARGE SCALE DEPLOYMENT
    24. 24. QUESTION & ANSWERS Bret Piatt Twitter: @bpiatt Email: bret@openstack.org THANK YOU

    ×