The State Of Cloud Storage


Published on

These are the slides recently presented at a Skillsmatter session in the UK which look at the current state of public Cloud Storage and ask some questions as to the future.

Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

The State Of Cloud Storage

  1. 1. Data in the Cloud A look at Public Cloud Storage
  2. 2. Communication has changed <ul><li>Speed of communication has changed </li></ul><ul><li>Geography of communication has changed </li></ul><ul><li>H o w we communicate has changed </li></ul><ul><li>Complexity is giving way to simplicity </li></ul>
  3. 3. Need for content access has changed <ul><li>Where it is stored has changed </li></ul><ul><li>Scale of Storage has changed </li></ul><ul><ul><li>Lots is good, lots more is better </li></ul></ul><ul><li>Access has changed </li></ul><ul><ul><li>Anytime, anywhere, anyhow </li></ul></ul>
  4. 4. Many Public Storage Clouds
  5. 5. Many Social Storage Clouds
  6. 6. Storage Cloud Types <ul><li>Consumer Storage Clouds </li></ul><ul><ul><li>i.e. MobileMe,, SkyDrive etc </li></ul></ul><ul><li>IaaS </li></ul><ul><ul><li>Amazon S3 / EBS, Microsoft Azure, RackSpace CloudFiles etc </li></ul></ul><ul><li>Private </li></ul><ul><ul><li>SAN, NAS, WebDav, CIFS etc </li></ul></ul>
  7. 7. A look at S3 and EBS <ul><li>Amazon S3 </li></ul><ul><ul><li>An enabler for highly scalable, reliable, fast, inexpensive data storage </li></ul></ul><ul><ul><li>Individual accounts get 100 buckets, unlimited files, maximum file size 5 GB </li></ul></ul><ul><ul><ul><li>For buckets read “Containers” for RackSpace CloudFiles, and “Blob” for MS Azure </li></ul></ul></ul><ul><ul><li>Subject to eventual consistency </li></ul></ul><ul><ul><li>6 copies of data for HA </li></ul></ul><ul><ul><li>Write latency higher than read latency </li></ul></ul><ul><ul><li>Not File based, file listing slow </li></ul></ul>
  8. 8. A look at S3 and EBS <ul><li>EBS </li></ul><ul><ul><li>Designed for Amazon EC2 instances </li></ul></ul><ul><ul><li>Access to raw drive, unformatted, which can be mounted </li></ul></ul><ul><ul><ul><li>Fast directory list and searching </li></ul></ul></ul><ul><ul><li>Failure rate of from 1 in 200 to 1 in 1000 </li></ul></ul><ul><ul><ul><li>Need to snapshot data to S3 </li></ul></ul></ul><ul><ul><li>Limited to 20 volumes </li></ul></ul><ul><ul><li>Accessible from same availability zone zone unlike S3 snapshots </li></ul></ul><ul><ul><li>No consistency delays </li></ul></ul>
  9. 9. A word about NoSQL <ul><li>Emerging storage model for storage of data in cloud </li></ul><ul><ul><li>Not based on SQL </li></ul></ul><ul><ul><li>OpenSource Examples are GoogleBigTable, H B ase, MongoDB, CouchDB, Redis etc </li></ul></ul><ul><ul><li>Commercial examples, GigaSpaces, Coherence etc </li></ul></ul><ul><ul><li>Based on key value store </li></ul></ul><ul><ul><ul><li>Get, Put, Delete </li></ul></ul></ul><ul><ul><li>Runs against large number of commodity hardware </li></ul></ul><ul><ul><li>Data partitioned </li></ul></ul><ul><ul><ul><li>Map/Reduce </li></ul></ul></ul>
  10. 10. Public Storage Challenges <ul><li>No standard access API </li></ul><ul><li>Authentication mechanisms </li></ul><ul><li>Security of data </li></ul><ul><li>Cost of data transfer </li></ul><ul><li>Lock-In </li></ul><ul><li>Legal Implications of data storage </li></ul><ul><li>Lack of file system type API’s </li></ul>
  11. 11. What sort of things would be useful to do with Cloud Storage? <ul><li>Importing and Exporting Data from Different Clouds </li></ul><ul><li>Ability to move clouds </li></ul><ul><ul><li>Price, dissatisfaction etc </li></ul></ul><ul><li>Syncing Clouds Automatically </li></ul><ul><li>Having Cloud Fail-over </li></ul><ul><ul><li>Primary & backup Clouds for HA of data </li></ul></ul><ul><li>Provide a Single View of data on different clouds </li></ul>
  12. 12. A thought about Data <ul><li>For many organisations their data is the most important thing they own </li></ul><ul><li>How much is “lost” on IM, Skype, public email, Social Networks + variety of other ways of communications ? </li></ul><ul><li>How to capture this data and bring it back to into the Organisation ? </li></ul>
  13. 13. SMEStorage API <ul><li>Is available from Google Code - </li></ul><ul><li>API operates above all supported cloud </li></ul><ul><li>Has value added services such as email backup, import/ export, Cloud Sync, and much more </li></ul><ul><li>Reliable proven API. Our Firefox Plug-In, Windows Tooling and Iphone application all use it. </li></ul>
  14. 14. <ul><li>Demo </li></ul>
  15. 15. <ul><li>THANK YOU </li></ul><ul><li> </li></ul>
  16. 16. <ul><li>Backup Slides </li></ul>
  17. 17. Public Storage Challenges <ul><li>API </li></ul><ul><ul><li>Not all API’s created equal. Some easier to add than others. Some have no API at all. </li></ul></ul><ul><li>Security </li></ul><ul><ul><li>Amazon S3 / Mosso have concept of Public Key /secret key which enables access to service but not access to account details </li></ul></ul><ul><ul><li>No standard security model for Cloud Storage / Social Providers </li></ul></ul><ul><ul><ul><li>OAuth ? OpenID ? </li></ul></ul></ul>
  18. 18. <ul><li>Multi-Cloud API’s </li></ul>
  19. 19. Zcloud API <ul><li>Sponsored by Zmanda, available at </li></ul><ul><li>The zcloud library provides a generic C API for cloud operations </li></ul><ul><li>Extendable via plug-ins </li></ul>
  20. 20. JClouds <ul><li>Is available from Google Code - </li></ul><ul><li>Java API to help you use cloud infrastructure (not just for storage) </li></ul><ul><li>Currently Amazon S3 & Google App Engine is supported with more coming via plug-in architecture </li></ul>
  21. 21. CloudLoop <ul><li>CloudLoop is a universal, open-source Java API and command-line tool for cloud storage ( ) </li></ul><ul><li>It lets you store, manage, and sync your data </li></ul><ul><li>Currently supports Amazon S3, Eucalyptus, Nirvanix, RackSpace Cloud Files, Sun Cloud </li></ul>
  22. 22. SimpleCloud <ul><li>Is available at </li></ul><ul><li>Promoted by Zend, the API’s aim is to bring cloud technologies to PHP </li></ul><ul><li>Encompasses file storage, doc storage and simple queues </li></ul><ul><li>See Amazon S3 example at </li></ul>
  23. 23. SMEStorage Multi-Cloud API <ul><li>Is available from Google Code - </li></ul><ul><li>API provides a unified REST API for Clouds (S3, CloudFiles,, MobileMe, Gmail, Email, FTP, WebDav,, Google Docs, Evernote) </li></ul><ul><li>Can be used as a Service Provider Interface (SPI) to Cloud Storage </li></ul><ul><li>Has value added services such as file system features, email backup, import/ export, Cloud Sync, and much more </li></ul>