Extreme Tiered Storage Flash, Disk, And Cloud


Published on

Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Extreme Tiered Storage Flash, Disk, And Cloud

  1. 1. Extreme Tiered Storage:Flash, Disk, and Cloud<br />Stephen Foskett<br />Storage Expo NL, November 2009<br />
  2. 2. Abstract<br />The explosion of digital media and unstructured data is flooding modern storage systems. Although per-GB cost has dropped, enterprise storage costs remain high. Tiered storage has not reduced the costs fast enough, but a new concept holds promise. By leveraging the extreme performance of flash, the low cost of cloud, and advanced data movement technologies, extreme tiered storage can deliver the reduction in storage costs demanded by business. This session presents the business and technical issues and an architecture to address them.<br />
  3. 3. You Have an Impossible Mission!<br />Reduce budgets<br />Improve performance<br />Meet business demands<br />3<br />
  4. 4. Storage Is Supposed To Be Getting Cheaper!<br />Disk cost is dropping rapidly<br />$250 buys:<br />1994: 2 GB<br />1999: 20 GB<br />2004: 200 GB<br />2009: 2000 GB<br />But enterprise storage costs keep rising!<br />4<br />
  5. 5. Tiered Storage to the Rescue!<br />Storage capacity just keeps expanding…<br />Larger files + More files = Growing volume of data<br />IT responded by…<br />Consolidating on networked storage (SAN and NAS)<br />Experimenting with HSM and ILM<br />Tiered storage<br />But…<br />Storage systems getting more complex and expensive<br />Management effort keeps growing<br />Cost savings aren’t materializing<br />5<br />
  6. 6. Where Is The Cost?<br />Hardware and software make up a small percentage of total enterprise storage spending…<br />…and hard disk drive capacity makes up a small percentage of that!<br />Data center/environmental, administrative personnel, maintenance, and data protection are much bigger<br />The biggest opportunity is inefficiency, but this has always been hard to tackle<br />6<br />
  7. 7. What If Disk Capacity Was Free?<br />A thought experiment: What if disk space was free?<br />The cost of hard disk drives drops to zero tomorrow - How will your usage patterns change?<br />Will you use more or less?<br />Will you manage capacity better or worse?<br />Will your storage budget shrink or grow?<br />Surprise!<br />The cost of disk capacity is almost irrelevant to enterprise storage budgets!<br />Even free disk capacity would not help save money, and it might even make things worse<br />Massive capacity growth is making free disk capacity a reality!<br />7<br />
  8. 8. Let’s Get Real!<br />We need to tackle the real issues in storage:<br />Focus scarce management resources<br />Reduce budgets by tackling capacity utilization (finally!)<br />Improve data protection<br />What’s stopping us?<br />Data just keeps growing<br />Mainstream technology hasn’t changed<br />Performance bottlenecks limit effectiveness<br />Always firefighting, never rebuilding<br />8<br />
  9. 9. Fulfilling The Promise of Tiered Storage<br />Tiered disk storage has not yet lived up to its promise<br />Small cost and performance differential between FC and SATA disk<br />TCO is very close<br />SSD gives extreme performance at high cost<br />Cloud storage gives massive capacity at low cost<br />Tiered Storage<br />Performance and Cost<br />Capacity<br />9<br />Tiered Storage<br />SSD<br />FC<br />Disk<br />SATA<br />Cloud<br />
  10. 10. Flash!<br />The new (old) buzz<br />RAM vs. NAND flash vs. disk<br />EMC was first with “tier-0”<br />Sun, HP, NetApp adding flash to as a cache<br />Gear6 caches NAS with RAM<br />“Flash will replace high-speed disk”<br />But…<br />Are they reliable?<br />Do they really perform that well?<br />Will you be able to use them?<br />Is the 10x-30x cost justified?<br />Do they really save power?<br />
  11. 11. Is Flash Reliable Enough?<br />Notes: 1 – No one writes this fast 24x7<br /> 2 – Manufacturers claim 2x to 10x better endurance<br />
  12. 12. Does Flash Perform?<br />Flash offers unique performance characteristics<br />Pro:<br />Very fast random read with low latency and high consistency<br />Low power consumption and heat, low weight, compact size<br />High mechanical reliability<br />Con:<br />Slower write performance, especially random<br />Write performance declines with use and capacity<br />12<br />
  13. 13. Flash Is Not A Disk<br />Flash must be carefully engineered and integrated<br />Cache and intelligence to offset write penalty<br />Automatic block-level data placement to maximize ROI<br />IF a system can do this, everything else improves<br />Overall system performance<br />Utilization of disk capacity<br />Space and power efficiency<br />Even system cost can improve!<br />13<br />
  14. 14. Then There’s Cloud Storage<br />Like flash, cloud is currently over-hyped but also rapidly being adopted in the enterprise<br />Like flash, cloud has unique performance characteristics and economics<br />Managed service versus purchased system<br />High-latency internet/HTTP access<br />Object store versus conventional NAS<br />Like flash, cloud can make tiered storage a success<br />Powerful economics from fully-managed service and pay-for-used pricing<br />14<br />
  15. 15. Public Cloud Storage Economics<br />Just-in-Time Provisioning<br />Plan/buy for usage and not for peak capacity<br />Fully Managed Storage<br />Managed GB = Power, space, cabling, racks, monitoring, software, hardware, migration to new media… all included<br />Enterprise Purchasing and Pricing Model<br />Flat, bundled price starts at $0.25/GB/month, $3K/TB/year<br />Enterprise sales, engineering, and support staff<br />Consulting and strategy available<br />15<br />
  16. 16. Data Types Suitable for Cloud Storage<br />16<br />
  17. 17. Paths to the Cloud<br />
  18. 18. Bringing Flash and Cloud to Disk<br />Combining flash, cloud, and disk is radical but yields massive benefits<br />Each helps offset the shortcomings of the other and magnify the overall result<br />Integrated products are starting to appear but none are yet complete<br />Major disk vendors adding solid state disks and automating volume-level tiering<br />Smaller companies are introducing integrated flash caching and block-level tiering<br />Data movement vendors are adding cloud as a tier<br />18<br />
  19. 19. What’s Next?<br />Flash and disk tiering will be fully integrated<br />Wide striping, thin provisioning, multi-parity, etc will kill conventional RAID<br />High-performance hard disk drives will disappear<br />VMware-specific storage systems will be on the cutting edge of flash/disk integration<br />Higher-level applications (archiving, content management) will get integrated cloud storage first<br />Fully-realized extreme tiered storage will be available within three years<br />19<br />
  20. 20. Thank You!<br />Stephen Foskett<br />stephen@fosketts.net<br />twitter.com/sfoskett<br />+1(508)451-9532<br />blog.fosketts.net<br />GestaltIT.com<br />bit.ly/ESSBlog<br />20<br />