Simplification of storage - The Hot and the Cold of It


Published on

Enterprises face many challenges when it comes to storage. Data volumes are exploding, increasing the cost of storage and the headaches of storage management. The rise of Big Data means more data is being collected and mined than ever before – 90% of the world’s data has been created in the last two years. Enterprise data is expanding at 20% per year or more. It’s not surprising that IT leaders are looking for new storage architectures to help them solve their scalability problems and reduce their costs.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Simplification of storage - The Hot and the Cold of It

  1. 1. Simon  Robinson   Research  Vice  President,  Storage   @simonrob451     1   Paul  Turner   Chief  MarkeAng  Officer,  Cloudian   hEp://       SimplificaAon  of  Storage  –   The  Hot  and  Cold  of  It     May  22,  2014     (9am  Pacific;  Noon  Eastern)  
  2. 2. Agenda   2   q  Introductions q  The changing IT Landscape q  The biggest disruption ever is happening in Storage q  Storage simplified – Hot Flash and Cold Capacity Storage q  New architectures for Capacity Storage q  Ecosystem Applications adopt Capacity Storage – OpenStack, CloudStack, Amazon AWS, Hadoop
  3. 3. Our  Speakers   3   Paul Turner leads marketing, product planning and strategy at Cloudian. A storage industry expert, he joined Cloudian from NetApp where he ran the Product Strategy Office , guiding their investments into FlashRay,Iongrid and CacheIQ. Prior to that role, he was the General Manager of the OnCommand Insight Business (which included Onaro and Akorri). Paul has more than 23 years of development and management leadership, including 15 years at Oracle. Simon Robinson runs the Storage and Information Management practice at 451 Research. He manages a team of analysts that help 451 clients understand the impact of information growth and management on organizations. Based in London, Simon joined 451 Research in 2000, and helped develop the firm's storage industry practice. Prior to joining 451 Research, Simon was a senior reporter and editor at UK tech publications house VNU, and also worked on the City Desk at the UK's Press Association.
  4. 4. The  451  Group  Company  Overview     §  270+  Staff   §  One  company  with  3  Go  to  Market   Brands   §  Syndicated  research,  cerAficaAon,   accreditaAon,  and  advisory  services   §  Global  Events   §  1,500+  client  organizaAons:   enterprises,  vendors,  service   providers,  and  investment  firms   §  Organic  and  growth  through   acquisiAon   4  
  5. 5. About Cloudian •  Hybrid cloud storage startup in Silicon Valley –  Strong venture backing: Goldman Sachs, Intel Capital –  Solid management team with storage, big data, enterprise software and telco expertise –  50 employees, offices in Foster City, Japan and China •  Production hardened product •  Target market: mid- to large-enterprises & regional service providers •  GTM: traditional storage distribution/VARs 55/22/14 CLOUDIAN PARTNERS
  6. 6. 6   We  are  living  through  an  era  of  disrupAon…   1.  Enormous  pressure  to  do  ‘more  with  less’   2.  Movement  to  IT-­‐as-­‐a-­‐Service   3.  Major  shigs  in  end-­‐user  compuAng   4.  Secular  changes  in  IT  supplier  market  
  7. 7. Meanwhile:  in  the  storage  trench…  99  Problems   7   “  We  have  ever-­‐increasing  demand  without  an  ever-­‐increasing  budget.”   “  The  part  that  pains  me  the  most  is  storage  migraAons.     It  takes  outages  to  move  data.”   “We’re  constantly  fighAng  to  size  storage  appropriately  for  the  term,     the  life,  we  lease…  not  having  to  purchase  more  storage  or     make  huge  changes  halfway  through  the  lease.”   “  Data  sprawl  –  it’s  growing  and  growing.  We've  been  handing     out  terabytes  like  candy.”   “  TroubleshooAng  –  every  Ame  an  app  has  a  performance  issue,     the  ‘SAN’  is  blamed.”   “  Backup  is  a  perennial  problem.  Never  enough  Ame.”   “  We  do  a  terrible  job  of  archiving  data  –  we  keep  everything.”   “  Performance  is  a  whack-­‐a-­‐mole  problem  –  we  have  to  choose     where  the  boEleneck  is.”   “Managing  the  various  storage  ‘islands’  is  a  challenge.”   “We  are  always  just  trying  to  keep  what  we  have  up  and  running.”  
  8. 8. Poll  QuesAon   8  
  9. 9.   Dealing  with  data  growth  sAll  the  #1  pain  point  in  storage   What  are  your  top  storage-­‐related  pain  points?*   1H  ’12,  n=249;  1H  ’13,  n=260.  *Note  that  due  to  mul;ple  responses  per  interview,  totals  may  exceed  100%.   Source:  Storage  –  Wave  17   6%   6%   11%   11%   14%   15%   19%   20%   21%   45%   3%   6%   8%   8%   16%   12%   26%   13%   27%   56%   Lack  of  Skilled  Staff   SupporAng  Server  VirtualizaAon   Data  Hoarding   Storage  Provisioning  and  Management   Backup  Management   MigraAons  and  Technology  Refreshes   Storage  ForecasAng  and  ReporAng   Delivering  Storage  Performance   High  Cost  of  Storage   Rapid  Capacity  Growth   1H  '12   1H  '13  
  10. 10. Not  only  more  data,  but…     …more  devices,  and  ‘things’   …more  unstructured  data   …more  data  copies   …in  more  places   …more  lawsuits  and  regulaAon   …and  keep  everything  forever!      
  11. 11. Storage  Infrastructure  reaches  breaking  point   §  EssenAally  unchanged  over  the  last  15  years   §  An  ‘Accidental  Architecture’  has  emerged;  fragmented,  complex   §  Cost  of  management  is  spiraling  out  of  control   §  Dealing  with  data  growth  is  a  constant  number  1  pain  point   §  VirtualizaAon  ‘breaks’  tradiAonal  storage   §  New  breed  of  cloud/mobile  apps  placing  fresh  demands     on  storage   §  Budgets  flat  to  down  (do  more  with  less)     11   TIME  FOR  A  DIFFERENT  APPROACH!  
  12. 12. Emergence  of  a  two-­‐Aer  enterprise  storage  architecture   12   Bigger   §  For  cool/cold  data   §  Object-­‐based   §  Scale-­‐out  (mulA-­‐PB)   §  Sogware-­‐centric   §  Cloud-­‐compaAble   Faster   §  For  ‘hot’  data   §  Flash-­‐opAmized     §  IOPS-­‐centric   §  VM/VDI  opAmized   §  Variety  of  approaches  
  13. 13. Impact  on  Storage  –  so  how  is  it  changing?   Flash  will  be  everywhere:   §  Host-­‐based   §  As  a  Aer  in  hybrid  arrays   §  All-­‐Flash  Arrays     13   Flash  –  Saviour  of  the  (storage)  Universe!   But  this  is  just  star@ng  point:   §  Emergence  of  new  ‘ground  up’   architectures  that  aim  to  enable  scale,   reduce  complexity,  increase  efficiency  etc.   §  The  era  of  VM-­‐centric,  cloud-­‐integrated   storage  is  dawning   §  Flash  adopAon  will  have  knock-­‐on  effects   elsewhere  in  the  storage  infrastructure…    
  14. 14. Object  Storage:  A  plaxorm  for  the  petabyte  era   Scale-­‐out  Storage   §  Aimed  at  mainstream     enterprise   §  MulA-­‐protocol  storage   §  Higher  performance   §  Sogware-­‐only   §  Open  source  emerging   14   Cloud   Storage   Big   Content   Scale-­‐out   Storage   Big  Content   §  Aimed  at  digital  content   industries   §  Dig  Archive/repository   §  Object-­‐only   §  Geo-­‐dispersal/EC   §  Lowest  $/GB   §  Delivered  as  hw  appliance   §  ‘Big  Game’  market  –     large  ASPs   Cloud  Storage   §  Aimed  at  xSPs   §  Storage-­‐as-­‐as-­‐service   §  SWIFT/S3  API  compaAbility   §  Sogware-­‐only   §  Open  source  dominates   today  
  15. 15. Poll  QuesAon   15  
  16. 16. EvoluAon  to  a  two-­‐Aer  storage  architecture   Many  cloud  plaIorms  already  built  on  such  a  design  point   §  Eg  Amazon  Web  Services  –  EBS  and  S3/Glacier   §  Eg  OpenStack  –  Cinder  and  Swig   §  Simplify  automaAon,  enable  hardware  standardizaAon,  reduce  cost   §  Span  on-­‐prem  and  third  party  faciliAes  (hybrid  cloud)   Which  data/applica@ons  suit  this  model?   §  Gradual  drip-­‐feed  of  data/applicaAons  vs  wholesale  migraAon   §  Web,  cloud,  and  mobile  apps  developed  for  ‘cloud  first’   §  Backup  and  archive  data  (incl.  tape  replacement)   §  File  synch/share  and  collaboraAon   §  ‘Aer  2’  NAS   §  Plaxorm  as  a  Service  (OpenStack,  CloudStack)   16  
  17. 17. ImplemenAng  Capacity  Storage   Flexibility   Mobility   Scale   Reliability   Object  Storage   Cloud   AND   Cloudian  Hybrid  Cloud  Storage  
  18. 18. Poll  QuesAon   18  
  19. 19. 19   Scale-­‐out  Distributed  Ring 5-14 Logical  ring Data  is   automa@cally   replicated  to   mul@ple  nodes. Loca@on  of  data  can  be   designated,  for  instance,  to   mul@ple  datacenters  and  per   rack. DC1 DC2 In  theory,  #  of  nodes  in  a   logical  ring  can  be  up  to  2127   (almost  infinite). Data  load  can  be  rebalanced  when  a   node  is  added  or  removed. NOSQL  database  distributes   and  replicates  data
  20. 20. 20   OpAmized  for  Any  Data  Type/Workload   •  Policies  tailored  for  different   object  types   •  OpAmized  for  all  data   •  Chunking  for  beEer   performance   •  Erasure  Coding  for  deep   archive  efficiency   •  Reliable  Storage  across  mulA-­‐ node  failures   •  Seamless  Public  Cloud   Integrated     HyperStore Patent  Pending Small   objects Large  Objects Active  Content File  System NOSQL  DB Erasure  Coding Deep Archives S3   NFS   S3  Tier
  21. 21. 21   ApplicaAon  Eco-­‐system  re-­‐writes  to  the  new  2Tier  Storage   21   Bigger   §  For  cool/cold  data   §  Object-­‐based   §  Scale-­‐out  (mulA-­‐PB)   §  Sogware-­‐centric   §  Cloud-­‐compaAble   Faster   §  For  ‘hot’  data   §  Flash-­‐opAmized     §  IOPS-­‐centric   §  VM/VDI  opAmized   §  Variety  of  approaches  
  22. 22. What  to  look  for  in  your  Capacity  Storage  OpAons   q  Storage  for  any  Workload  (Erasure  Coding,  Replicas)   q  OpAmized  for  Small  and  Large  Files   q  MulA  Data  Center,  MulA  Site  Deployment     q  Regional  Awareness  and  Locality     q  MulA-­‐Tenancy  and  Chargeback   q  Secure  EncrypAon  of  your  data   q  Public  Cloud  Integrated   q  Supports  Many  ApplicaAons  (S3)   22  
  23. 23. What  to  look  for  in  your  Capacity  Storage  OpAons   ü  Storage  for  any  Workload  (Erasure  Coding,  Replicas)   ü  OpAmized  for  Small  and  Large  Files   ü  MulA  Data  Center,  MulA  Site  Deployment     ü  Regional  Awareness  and  Locality     ü  MulA-­‐Tenancy  and  Chargeback   ü  Secure  EncrypAon  of  your  data   ü  Public  Cloud  Integrated   ü  Supports  Many  ApplicaAons  (S3)   23  
  24. 24. 24   Conclusion   •  Storage  is  changing  –  Object  Storage  and  Flash  will  dominate   •  This  Simplified  2Tier  storage  architecture  helps  overall  IT  agility   •  Object  Storage  and  Cloud  provides  the  scale-­‐out  capacity  layer     Next  Steps   •  IdenAfy  ApplicaAons  which  can  take  advantage  of  Capacity  Storage   •  Data  Intensive  :  Backup,  Archiving,  Mobile  File  Sharing,  Distributed  Shares   •  New  ApplicaAons  :  OpenStack,  CloudStack,  Hadoop     •  Try  it  out   •  HyperStore  Free  hEp://­‐ediAon.php   •  Ask  us  for  Trial      
  25. 25. QuesAons?   Simon  Robinson   Research  Vice  President,  Storage   @simonrob451     25   Paul  Turner   Chief  MarkeAng  Officer,  Cloudian   hEp://