The State Of Cloud Storage

Data in the Cloud A look at Public Cloud Storage

Communication has changed
Speed of communication has changed
Geography of communication has changed
H o w we communicate has changed
Complexity is giving way to simplicity

Need for content access has changed
Where it is stored has changed
Scale of Storage has changed
Lots is good, lots more is better
Access has changed
Anytime, anywhere, anyhow

Many Public Storage Clouds

Many Social Storage Clouds

Storage Cloud Types
Consumer Storage Clouds
i.e. MobileMe, Box.net, SkyDrive etc
IaaS
Amazon S3 / EBS, Microsoft Azure, RackSpace CloudFiles etc
Private
SAN, NAS, WebDav, CIFS etc

A look at S3 and EBS
Amazon S3
An enabler for highly scalable, reliable, fast, inexpensive data storage
Individual accounts get 100 buckets, unlimited files, maximum file size 5 GB
For buckets read “Containers” for RackSpace CloudFiles, and “Blob” for MS Azure
Subject to eventual consistency
6 copies of data for HA
Write latency higher than read latency
Not File based, file listing slow

A look at S3 and EBS
EBS
Designed for Amazon EC2 instances
Access to raw drive, unformatted, which can be mounted
Fast directory list and searching
Failure rate of from 1 in 200 to 1 in 1000
Need to snapshot data to S3
Limited to 20 volumes
Accessible from same availability zone zone unlike S3 snapshots
No consistency delays

A word about NoSQL
Emerging storage model for storage of data in cloud
Not based on SQL
OpenSource Examples are GoogleBigTable, H B ase, MongoDB, CouchDB, Redis etc
Commercial examples, GigaSpaces, Coherence etc
Based on key value store
Get, Put, Delete
Runs against large number of commodity hardware
Data partitioned
Map/Reduce

Public Storage Challenges
No standard access API
Authentication mechanisms
Security of data
Cost of data transfer
Lock-In
Legal Implications of data storage
Lack of file system type API’s

What sort of things would be useful to do with Cloud Storage?
Importing and Exporting Data from Different Clouds
Ability to move clouds
Price, dissatisfaction etc
Syncing Clouds Automatically
Having Cloud Fail-over
Primary & backup Clouds for HA of data
Provide a Single View of data on different clouds

A thought about Data
For many organisations their data is the most important thing they own
How much is “lost” on IM, Skype, public email, Social Networks + variety of other ways of communications ?
How to capture this data and bring it back to into the Organisation ?

SMEStorage API
Is available from Google Code - http://code.google.com/p/smestorage/
API operates above all supported cloud
Has value added services such as email backup, import/ export, Cloud Sync, and much more
Reliable proven API. Our Firefox Plug-In, Windows Tooling and Iphone application all use it.

THANK YOU
http://www.smestorage.com

Backup Slides

Public Storage Challenges
API
Not all API’s created equal. Some easier to add than others. Some have no API at all.
Security
Amazon S3 / Mosso have concept of Public Key /secret key which enables access to service but not access to account details
No standard security model for Cloud Storage / Social Providers
OAuth ? OpenID ?

Multi-Cloud API’s

Zcloud API
Sponsored by Zmanda, available at http://zmanda.github.com/libzcloud/
The zcloud library provides a generic C API for cloud operations
Extendable via plug-ins

JClouds
Is available from Google Code - http://code.google.com/p/jclouds/
Java API to help you use cloud infrastructure (not just for storage)
Currently Amazon S3 & Google App Engine is supported with more coming via plug-in architecture

CloudLoop
CloudLoop is a universal, open-source Java API and command-line tool for cloud storage ( http://www.cloudloop.com/ )
It lets you store, manage, and sync your data
Currently supports Amazon S3, Eucalyptus, Nirvanix, RackSpace Cloud Files, Sun Cloud

SimpleCloud
Is available at http://www.simplecloud.org/
Promoted by Zend, the API’s aim is to bring cloud technologies to PHP
Encompasses file storage, doc storage and simple queues
See Amazon S3 example at http://bit.ly/KJoup

SMEStorage Multi-Cloud API
Is available from Google Code - http://code.google.com/p/smestorage/
API provides a unified REST API for Clouds (S3, CloudFiles, Box.net, MobileMe, Gmail, Email, FTP, WebDav, Box.net, Google Docs, Evernote)
Can be used as a Service Provider Interface (SPI) to Cloud Storage
Has value added services such as file system features, email backup, import/ export, Cloud Sync, and much more

http://www.thesmespace.com	71
http://www.slideshare.net	28
http://blog.storagemadeeasy.com	8
http://smestorage.com	5

The State Of Cloud Storage

by Storage Made Easy on Dec 04, 2009

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 112

Statistics

The State Of Cloud Storage Presentation Transcript