Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

881 views
826 views

Published on

Published in: Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
881
On SlideShare
0
From Embeds
0
Number of Embeds
34
Actions
Shares
0
Downloads
46
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

  1. 1. Copyright © 2010 Hitachi Data Systems. All rights reserved. November 2010 Storage Trends and Directions Hubert Yoshida Vice President and Chief Technology Officer Hitachi Data Systems
  2. 2. Agenda  Signs of a Coming train wreck  Major new trends that impact the Data Center  Requirement for scale up and scale out storage  Dynamic Tiering  Media trends  Summary
  3. 3. Gartner – Signs of A Coming IT Train wreck  Aging IT systems and infrastructures – Creating an increasing burden to maintain – Switching to new systems and infrastructure becomes more disruptive and resource intensive.  Information becomes increasingly difficult to access and analyze – Business is forced to work without the information it needs to make decisions.“  New interfaces drive up transaction loads and require legacy storage systems to scale up – Storage systems are long term investments and changes are increasingly painful and expensive  Compliance and regulatory pressures puts businesses with legacy systems at risk  Power, cooling, and floor space limitations demand change
  4. 4. $0 $50 $100 $150 $200 $250 $300 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 Installed Base (M Units) Spending (US$B) New Hardware spending Hardware spending has remained flat while overall costs continue to increase HW mgmt. and admin costs x4 Power and cooling costs x8 0 5 10 15 20 25 30 35 40 45 50 Better Utilization: Reduces Capital Costs Better Management: Reduces Operational Costs Trend Number 1: IT Spend Is Changing
  5. 5. $0 $50 $100 $150 $200 $250 $300 Spending (US$B) New Hardware spending HW mgmt. and admin costs Power and cooling costs 0 5 10 15 20 25 30 35 40 45 50 Capital Costs Operational costs A Sustainable Future Requires Virtualization Sustainable IT Requires Continuous Reduction in Operational costs Costs Technologies that address operational costs: Virtualization, dynamic or thin provisioning, archive
  6. 6. Trend Number 2: Exploding Data Growth Compounded Annual Growth Rate of 66% 32.3% 63.7% (Exabytes) 121.1% 43.9% Source: IDC 2008 Understanding the types of data will help to address costs
  7. 7. Trend Number 2: Exploding Data Growth Compounded Annual Growth Rate of 66% 32.3% Structured (Exabytes) 121.1% Content 43.9% Replicas Source: IDC 2008 Understanding the types of data will help to address costs 63.7% Unstructured
  8. 8. Application Growth is Exploding  Applications will need to offload more work to storage systems  They will be motivated by the need to scale – Millions of users and exabytes of data – Must provision new applications immediately  Examples of Application offloads – Content Management systems offloading data to storage systems for ingestion and preservation – Exchange 2010 eliminates backup by duplicating data bases and archiving – Symantec provides information to storage to recover deleted files. – VMware provides VAAI to format VMDK, Clone vMotion VMDK, and eliminate SCSI Reserve Bottleneck Mobile Cloud Applications
  9. 9. Storage Can Relieve Application Bottlenecks  VMware must issue a SCSI Reserve when one VM does an update to VMFS. – All other VM’s are locked out – Affect s New VM Creation, vMotion, Snapshots, Thin Provisioning., Powering on VM  VAAI Atomic Test and Set enables Storage to lock at Logical Block Number – Frees up other VMs to access VMFS – Can increase consolidation of VM by 25% to 35%
  10. 10. Trend Number 3: A Perfect Storm In Compute  Processor technology is scaling up – New Intel Architecture • Multi-core – Dual, Quad,16 way • SMT – Simultaneous Multi Thread • L1, L2, L3 cache  Virtual Servers and hypervisors – Multiple Virtual Machines per physical server – Multiple VM I/O streams per physical server • Increasing I/O load • Increasing randomness of I/O  Network bandwidth is increasing – FC 4Gbs going to 8Gbs to 16 Gbs – FCoE 10Gbs to 40Gbs to 100Gbs • Scale-up Storage is required to support virtual servers and networks
  11. 11. Loosely Coupling of Storage is Not the Answer! Switch Port Port Cache Port Port Cache Port Port Cache Port Port Cache This approach requires a rip and replace of existing infrastructure
  12. 12. Transition To Virtual Servers for Production Customer Requirement Integrated Storage Virtualization Integrated Management Courtesy of 451 Group
  13. 13. Scale up to meet increasing server demands Port Port RAID RAID Cache Port Port RAID RAID Cache Port Port RAID RAID Cache Port Port RAID RAID Cache 3D Scaling: Scale Up with Tight Coupling Cache Cache Cache
  14. 14. 3D Scaling: Scale Out with Safe Multi-tenancy Port RAID RAID Cache Port Port RAID RAID Cache Port Cache Port RAID RAID Cache Port Cache Port RAID RAID Cache Port Scale out to meet distributed server demand with load balancing and safe multi-tenancy
  15. 15. 3D Scaling: Scale Deep with External Virtualization Servers are connected to storage silos Storage resources can not be shared
  16. 16. 3D Scaling: Scale Deep with External Virtualization A virtualization storage controller can create a common Pool of shared storage resources
  17. 17. 3D Scaling: Scale Deep with External Virtualization Virtualize external storage for data mobility and storage migration
  18. 18. Virtualized vs Non-Virtualized Storage Services Virtualized Storage Services Non-Virtualized Storage services NAS CAS VTL Virtual Servers Physical Servers NAS CAS VTL Enterprise Midrange Cloud
  19. 19.  Virtualize Devices into a pool of capacity and allocate by pages  Dynamically provision new servers in seconds  Eliminate allocated but unused waste by allocating only the pages that are used  Extend Dynamic Provisioning to external virtualized storage  Convert Fat volumes into thin volumes by moving then into the pool  Optimize Storage performance by spreading the I/O across more arms LDEVLDEVLDEVLDEVLDEVLDEVLDEVLDEV HDP Pool HDP Volume (Virtual LUN) LDEVs Dynamic Provisioning
  20. 20. Today: Automated Tiering of Storage Volumes Tier 0 Tier 1 Tier 2  Multiple storage tiers in separate pools  SSD, SAS, SATA  We assign volume to tiers of storage based on data classification  Use virtualization to move volumes without disruption  Automated with policy based management  But moving large volumes is a heavy task
  21. 21. SAS SATA EFD/Flash Introducing Dynamic Tiering at the Page Level TIER 1 TIER 2 TIER 0 POOL A Last Referenced Last Referenced  One pool of 42 MB pages now spans multiple tiers of storage  Volume Data is written to the highest performance tier first  Less active volume pages migrate to lower tiers  Pages can be promoted  Volumes no longer have to be moved to optimize performance  Volumes will be able to span across tiers on external storage
  22. 22. Cost Comparison of 36 TB Single Tier Vs Multi-Tier Drive Type Qty Total Cost % Capacity Rack cost HDT Cost Total cost IOPs 300 GB HDD 120 $145,000 100% $75,000 0 $220,000 36,000 Drive Type Qty Total Cost % Capacity Rack cost HDT Cost Total cost IOPs 200 GB SSD/SAS 4 $40,000 2% $28,000 $75,000 $183,000 158.000 300 GB HDD/SAS 10 $12,000 8% 1 TB HDD SATA 32 $28,000 90% Single Tier HDD Multi-Tier SSD/SAS/SATA
  23. 23. Comparison Between FC Loops and SAS – 4 FC Loops per controller • Half duplex arbitrated loops • 8 FC Loops @ 2 Gb/s – Drawers are added to the loop • FC and SATA drawers are separate – 4 SAS wide cables per Controller • 4 full duplex links per cable • 32 SAS Links @ 3 Gb/s – Drawers are connected point-point • SAS and SATA can be intermixed SATA Loop FC Loop
  24. 24. Technology Transition Roadmap Time ArealDensity Longitudinal Recording 100-130 500-800 1,000-3,000 2,000-15,000 Perpendicular Recording Patterned Media (PM) Thermally Assisted Recording (TAR) 2006 2010 2014 50 Years >50 Million increase in areal density 10,000 Gb/in2 = 10 Tb/in2 50 TB 3.5-inch drive 12 TB 2.5-inch drive 1 TB 1-inch drive New Technologies will increase Densities Will Prices decline at the same rate?
  25. 25. Denser Packaging 13U  Standard 19” rack • Front to back cooling • Up to 6 racks  Dense packaging • 13u x 19 inch • 80 x 3.5in drives • 128 x 2.5in drives • SSD, SAS and SATA  Power and cooling • 40% less power than equivalent capacity Universal Storage Platform® V
  26. 26. Data Centres Will Need to Provide More Scale While Also Addressing: Capital Costs Administrative Burdens Availability Power & Cooling Courtesy of IDC 2010
  27. 27. Technologies That Can Help II: Intelligent Storage Tiers Automated data movement between tiers of storage III: Outsourcing Cloud SaaS IV: Resource Pooling I: Storage Optimization Dynamic Provisioning Thin Provisioning Wide Striping Storage Virtualization Scale up, out, and deep D.C. DensityCourtesy of IDC 2010
  28. 28. • Sustainable IT costs requires virtualization to contain operational cost • Sustainable IT costs can be achieved through – Server Virtualization for server consolidation – Storage and File Virtualization for data mobility, consolidation, migration, tiered storage – Capacity virtualization for dynamic provisioning, automated performance, and increased utilization Summary $0 $50 $100 $150 $200 $250 $300 $0 $50 $100 $150 $200 $250 $300 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 20101996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 Installed Base (M Units) New Hardware spendingNew Hardware spending Worldwide IT Spending on Hardware, Power and Cooling, and Management/Administration HW mgmt. and admin costsHW mgmt. and admin costsHW mgmt. and admin costs Power and cooling costsPower and cooling costsPower and cooling costsPower and cooling costs 0 5 10 15 20 25 30 35 40 45 50 IDC 2008 Vernon Turner

×