Interoperable Cloud Storage with the          CDMI Standard    Storage and Data Management in a post-Filesystem World   Ro...
SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise noted. Member compan...
Abstract  SNIA Tutorial: Interoperable Cloud Storage  with the CDMI Standard    The Cloud Data Management Interface (CDMI)...
Data Storage Interface Evolution  Born Digital data is being generated by an ever  diversifying set of devices  75% of dat...
Where are your users puttingtheir data?With corporate users                                          Source: Amazonbringin...
Build Your Own Cloud Corporations already offer their own email (instant messaging, etc.) services to their employees Clou...
Post-Filesystem Data Storage  The SNIA has produced the Cloud Data Management  Interface (CDMI) standard for post-Filesyst...
How do you find data?  Most popular data access application today?    Email! Data is saved chronologically, searchable via...
Where is it being used?  Commercial Cloud Storage vendors started announcing  implementations in April 2011  Increasing Ad...
CDMI Overview Data Portability Standard   Move Data (and most importantly – Metadata) from   cloud to cloud Advanced Cloud...
What Is Cloud Storage Used For?  Elastic demand for web based media (video,  eBooks, audio)  Backup to the cloud    Restor...
Cloud Data Management Interface Applicable to three deployment models of Cloud Storage:     Cloud Storage for Cloud Comput...
Leveraging the Storage IndustryResource Domain ModelAll of these interfaces support some or all of this model. The key to ...
Why not just adopt one of theexisting interfaces?  Despite the “open” licensing of several existing cloud  storage interfa...
For More informationOne Web Site to Remember:http://snia.org/cloudLarge Cloud Storage Community  http://groups.google.com/...
Attribution & FeedbackThe SNIA Education Committee would like to thank thefollowing individuals for their contributions to...
Upcoming SlideShare
Loading in...5
×

Interoperable cloud storage with the cdmi standard

649

Published on

The Cloud Data Management Interface (CDMI) is an ISO standard for cloud storage. There is an open source reference implementation available from SNIA as well. Storage vendors and Cloud providers have started announcing their implementations of the CDMI standard, demonstrating the reality of interoperable cloud storage. This talk will help you understand how to keep from getting locked into any given vendor by using the standard. Real world examples will help you understand how to apply this to your own situation

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
649
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Interoperable cloud storage with the cdmi standard

  1. 1. Interoperable Cloud Storage with the CDMI Standard Storage and Data Management in a post-Filesystem World Roberto Salucci – Italian Country Committee – SNIA Europe Walter Moriconi – Director – SNIA Europe
  2. 2. SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise noted. Member companies and individual members may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced in their entirety without modification The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. The information presented herein represents the authors personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 2 2 All Rights Reserved.
  3. 3. Abstract SNIA Tutorial: Interoperable Cloud Storage with the CDMI Standard The Cloud Data Management Interface (CDMI) is an ISO standard for cloud storage. There is an open source reference implementation available from SNIA as well. Storage vendors and Cloud providers have started announcing their implementations of the CDMI standard, demonstrating the reality of interoperable cloud storage. This talk will help you understand how to keep from getting locked into any given vendor by using the standard. Real world examples will help you understand how to apply this to your own situation. Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 3 All Rights Reserved.
  4. 4. Data Storage Interface Evolution Born Digital data is being generated by an ever diversifying set of devices 75% of data being generated by individuals (IDC) Amount of Data doubling every two years 5 Billion Mobile Phones Tablets on the rise Storage space on devices will always be limited (although continues to grow exponentially) Device Apps are accessing content/storage via the Internet Cloud Storage largely driven by device based use cases Traditional data storage interfaces (filesystems) are not up to this task! Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 4 All Rights Reserved.
  5. 5. Where are your users puttingtheir data?With corporate users Source: Amazonbringing their owndevices (BYOD), whereare they putting files?Devices have limitedstorage capacityThey are saving them in Source: Oxygen Cloudthe storage cloud!Corporate data is alreadyin the public cloud andunmanaged/protected Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 5 All Rights Reserved.
  6. 6. Build Your Own Cloud Corporations already offer their own email (instant messaging, etc.) services to their employees Cloud Storage is the next type of service offering for employee devices Enterprise “Dropbox” implementations Essentially a “private” cloud with access over the Internet from corporate and other “Apps” Data is retained “in house”, protected, available, secured and compliant Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 7 All Rights Reserved.
  7. 7. Post-Filesystem Data Storage The SNIA has produced the Cloud Data Management Interface (CDMI) standard for post-Filesystem Data Storage i.e. Public and Private/Hybrid Storage Clouds Specifically designed to meet the requirements (for the foreseeable future) of contemporary data usage and management Superset of features currently being offered, but “shrink to fit” Innovative use of Metadata to express “Data Requirements” Requirements are then met by the implemented Data Services CDMI can be (and is being) extended compatibly To accommodate new types of data requirements, use cases Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 8 All Rights Reserved.
  8. 8. How do you find data? Most popular data access application today? Email! Data is saved chronologically, searchable via metadata Email attachments come with rich metadata Subject, Sender, Recipient, Date, Thread, Priority Future Data Storage Interfaces will leverage this concept for general file/object storage Not only for locating data, but for managing it as well CDMI provides a standard Data Storage Interface with rich metadata query and global namespace Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 9 All Rights Reserved.
  9. 9. Where is it being used? Commercial Cloud Storage vendors started announcing implementations in April 2011 Increasing Adoption by eScience and Academic community Especially in Europe (OpenNebula open source cloud, others) Quarterly Plugfests with growing participation > September plugfest in Europe and North America CDMI 1.0.2 is now an International Standard ISO/IEC 17826:2012 CDMI has a reference implementation (Java™ under BSD) Downloaded by hundreds of developers worldwide Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 10 All Rights Reserved.
  10. 10. CDMI Overview Data Portability Standard Move Data (and most importantly – Metadata) from cloud to cloud Advanced Cloud Services Data System Metadata allows cloud vendors to up- sell! Specialized storage clouds for specific use cases Logging, Security, Audit Trails Extensible to accommodate rapid innovation in cloud market Proposed Extensions: CIMI/OVF, Versioning, Jobs Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 11 All Rights Reserved.
  11. 11. What Is Cloud Storage Used For? Elastic demand for web based media (video, eBooks, audio) Backup to the cloud Restore, Recovery, “Seed” the backup with hard drive Sync of files to the cloud and multiple devices Internet “Drive” secondary storage Archive/Preservation in the cloud Including Compliance, Retention and eDiscovery Storage for Cloud Computing Support for legacy storage interfaces key Self Service Storage Administration Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 12 All Rights Reserved.
  12. 12. Cloud Data Management Interface Applicable to three deployment models of Cloud Storage: Cloud Storage for Cloud Computing Whitepaper at snia.org/cloud – the management interface for the lifecycle of storage in a compute cloud Public Storage Cloud Whitepaper at snia.org/cloud – both a Data Path for the Cloud and a Management Path for the Cloud Data Private Cloud Storage As well as hybrid clouds An API for Storage Vendors selling into Cloud based solutions Semantics Simple Containers and Data Objects with tagged Metadata Data System Metadata expresses the data requirements Protocol RESTful HTTP as “core” interface style JSON (JavaScript Object Notation)– format of the representations are extensible Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 14 All Rights Reserved.
  13. 13. Leveraging the Storage IndustryResource Domain ModelAll of these interfaces support some or all of this model. The key to retainingthe simplicity of the cloud, however, is in the use of metadata to drive theunderlying services so that users need not manage the services themselves. Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 15 All Rights Reserved.
  14. 14. Why not just adopt one of theexisting interfaces? Despite the “open” licensing of several existing cloud storage interfaces, they all remain under the change control of a single vendor No cloud vendor wants to have a competitor have change control over their interface Thus they release their own interface which they do have change control over This leads to the propagation of multiple interfaces, each essentially locking developers/customers into that service CDMI is under change control of a standards body, accommodates requirements from multiple vendors and can be extended for proprietary functions Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 16 All Rights Reserved.
  15. 15. For More informationOne Web Site to Remember:http://snia.org/cloudLarge Cloud Storage Community http://groups.google.com/group/snia-cloud http://twitter.com/SNIAcloud (@SNIAcloud)SNIA Cloud Blog Site: http://sniacloud.com Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 19 All Rights Reserved.
  16. 16. Attribution & FeedbackThe SNIA Education Committee would like to thank thefollowing individuals for their contributions to this Tutorial. Authorship History Additional Contributors Name/Date of Original Author here: Scott Baker Updates: David Slik Mark Carlson 2012 Rich Ramos Members of the SNIA Cloud Storage TWG Please send any questions or comments regarding this SNIA Tutorial to tracktutorials@snia.org Interoperable Cloud Storage with CDMI © 2012 Mark Carlson and the Storage Networking Industry Association. 20 20 All Rights Reserved.

×