Beyond EBS Stroage Alternatives in the Cloud
Upcoming SlideShare
Loading in...5

Beyond EBS Stroage Alternatives in the Cloud



Presentation given by Dave Wright at Cloud Expo Europe.

Presentation given by Dave Wright at Cloud Expo Europe.



Total Views
Views on SlideShare
Embed Views



2 Embeds 5 3 2



Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment
  • Test & throw away volumes

Beyond EBS Stroage Alternatives in the Cloud Beyond EBS Stroage Alternatives in the Cloud Presentation Transcript

  • Advancing the waythe world uses the cloudBeyond EBS – Storage Alternatives in the CloudDave Wright – Founder & CEOSlides @
  • Cloud OpportunityWhy is blockstorage so $$$ Performance Sensitive Apps Oracle / SAP / SQL Highimportant? Hadoop / NoSQL Complex Web apps IaaS Cloud Today Applications Margin IOPS $$ Med Test / Development Backup / Archive Basic Web $ Low Key to bridging the gap: • Better block storage Phase 1 Cloud Evolution Phase 2
  • Better block storage offerings criticalto migrating high-margin apps fromon-premises, managed, anddedicated environments to the cloud
  • A Brief History of Amazon EC2 & EBS
  • 2006 • Storage options limited to S3 (object storage) and local instance storageEC2 • “Ephemeral” – no persistenceLaunched • Limited performance – “SATA-like” IOPS and bandwidth – Shared resource (on smaller instances) • No HA – lose an instance, lose your data • Fixed capacity – tied to instance size • Only suitable for custom apps and basic web serving
  • 2008 • Network attached, persistent storageEBS • Easily move between instances (in an Availability Zone)Launched • More flexible capacity – 1GB  1TB • Poor performance – ~100 IOPS, Highly variable latency • Only for extra data volumes – boot volume still ephemeral • Failure rate of 0.1-1% (annual) (2 nines) • Snapshot backup/restore to S3
  • 2009 • Added ability to store boot volumes on EBSBoot from • Finally allows EC2 instances to beEBS provisioned and used like a “persistent” resource • Suitable for deploying some persistent, enterprise applications – If limited performance, durability, and capacity are acceptable
  • 2012 • Added ability to set performance for an individual volumeProvisioned • Individual volume performance of 100 –IOPS 1000 IOPS (fixed at creation time) • (Likely) SSD based • Designed for 99.9% performance delivery (but no SLA) • Suitable for a wider range of performance-sensitive databases and applications
  • Evolution of EBSEphemeral volumes EBSDeveloper-oriented Boot from EBS Basic persistentNo enterprise storage Provisioned IOPSapps Fully persistent Dev/test and virtual machinesCompute centric limited Controlled production apps Basic enterprise Performance apps Low IO Wider range of DBs/apps performance sensitive apps
  • Where is the rest of the cloud industry? Object Instance Network Storage Storage Storage Atmos, Nirvanix, EMC, 3par, Local shared disk Scality, Swift Netapp, Dell Backup, archival, Typically persistent Persistent, HA content repository Variable No HA, limited Cheap and deep performance, No performance SLAs, limited scale
  • The rest of the industry is 3-5 yearsbehind Amazon EBS, working withinferior technology designed for theEnterprise
  • PerformanceTraditional • Unable to manage performance independent ofEnterprise capacity • Can not guarantee storage performanceStoragedoesn’t work Efficiency • Low and inefficient utilization ratesin the cloud • Lack of high performance in-line data reduction Management • Complex manual management that lacks automation • Limited or Complex DR configuration Scale • Limited scalability of both capacity and performance • Manage multiple islands of storage
  • Catching up • More control over performance(and passing) • Higher durability & availabilityEBS • Greater efficiency (profit ↑, prices ↓) • Complete storage automation • Cloud scalability
  • Control over performance• Manage volume performance and capacity independently• Guaranteed QoS / sustained performance to every volume• Dynamic adjustment of provisioned IOPS• Create and bill against multiple tiers of performance• Isolate noisy neighbors• Individual volumes delivering 10k IOPS or more
  • Higher durability & availability• 4 - 5 9’s required for enterprise apps A H C E F• Remote site replication for DR• Snapshot & backup support A B C D G F• Basic RAID insufficient – Long rebuild times B C G H – Significant performance penalty – Single points of failure B C D H B G D E H
  • High efficiency• High capacity utilization - 85%• Data Reduction in-line – De-duplication – Compression – Thin Provisioning• Executed without performance impact• Drastic reduction in power, cooling, and floor space
  • Complete management automation• Simple REST-based APIs for storage• Multi-tenant provisioning, reporting, and performance isolation• Full feature set – backup, DR, snapshots, etc.• Comprehensive reporting support & billing integration• Cloud platform integration
  • Cloud Scale• Scale-out rather than scale- up architectures• Easy to add both capacity and performance• Support for petabytes of capacity, millions of IOPS, and tens of thousands of volumes• Avoid islands of storage and manual data management
  • What role can Flash (SSD) play inimproving block storage in the cloud?
  • Flash Benefits • Performance – Restore balance between IOPS and Capacityfor Block – Better performance with varied workloadsStorage • Efficiency – Remove performance as a limiter on utilization – Reduce storage space, power, and cooling • Management – Better reliability – Easier to isolate workloads on shared media
  • What’s the • Cost – Partially a perception issuedownside? – Can’t be ignored – cloud all about value • Existing Storage Architectures – Ability to get full performance from flash – Write amplification & endurance issues – Inconsistent performance in tiered storage
  • All-SSD storage solution designedspecifically for cloud service providers• Clustered Scale-Out Architecture• Industry-Standard: Hardware and 10 GigE iSCSI• Massive scale: 100 nodes, 2PB, 5M IOPS• Cost Effective: Usable $/GB similar to traditional SANs
  • Questions?1620 Pearl Street,Boulder, Colorado 80302Phone: 720.523.3278Email: