Challenges Embracing Cloud Storage

  • 6,390 views
Uploaded on

Challenges in embracing cloud storage for customers and vendors alike.

Challenges in embracing cloud storage for customers and vendors alike.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
No Downloads

Views

Total Views
6,390
On Slideshare
0
From Embeds
0
Number of Embeds
3

Actions

Shares
Downloads
501
Comments
2
Likes
13

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Challenges in embracing cloud storage Author: Randy Bias (VP Technology Strategy of GoGrid/ServePath) January 2009 © 2009 GoGrid / ServePath
  • 2. INTRODUCTION © 2009 GoGrid / ServePath January 2009 - 2 -
  • 3. Backgrounds   Randy Bias, VP Technology Strategy, GoGrid –  Specializing in IT infrastructure since 1990 –  3 ISPs, 3 Internet Datacenters, 2 MSSPs, 2 Cloud providers –  Pioneered world’s 1st multi-platform, multi-cloud management system (CloudScale Networks, Inc)   GoGrid –  Division of ServePath, LLC, an established hosting provider –  Pioneer in cloud computing –  First ‘cloudcenter’ type Infrastructure-as-a-Service cloud in U.S. © 2009 GoGrid / ServePath January 2009 - 3 -
  • 4. Today’s Agenda   Cloud Computing Overview   Why Storage in the Cloud?   Storage Today   Management Challenges   Future / Vision © 2009 GoGrid / ServePath January 2009 - 4 -
  • 5. What is cloud computing? CLOUD COMPUTING © 2009 GoGrid / ServePath January 2009 - 5 -
  • 6. Forrester Research “A pool of abstracted, highly scalable, and managed compute infrastructure capable of hosting end-customer applications and billed by consumption1” 1- “Is Cloud Computing Ready for The Enterprise?” Forrester Research, Inc. © 2009 GoGrid / ServePath January 2009 - 6 -
  • 7. Other Definitions “Cloud computing is an emerging approach to shared infrastructure in which large pools of systems are linked together to provide IT services.” – IBM press release on “Blue Cloud” “…a hosted infrastructure model that delivers abstracted IT resources over the Internet” – Thomas Weisel Partners LLC from “Into the Clouds: Leveraging Data Centers and the Road to Cloud Computing” “Cloud computing describes a systems architecture. Period. This particular architecture assumes nothing about the physical location, internal composition or ownership of its component parts.” – James Urquhart, Wisdom of the Clouds blog © 2009 GoGrid / ServePath January 2009 - 7 -
  • 8. Cloud Computing is… Self-service Internet infrastructure where you pay for what you use, use only what you need, and managed using a web browser or API. © 2009 GoGrid / ServePath January 2009 - 8 -
  • 9. The “Cloud Pyramid”   Cloud Services economy is a pyramid   Layers equate structure   Building blocks: –  Infrastructure-as-a-Service (IaaS) –  Platform-as-a-Service (PaaS) –  Software-as-a-Service (SaaS)   Breadth vs. Niche © 2009 GoGrid / ServePath January 2009 - 9 -
  • 10. Cloud Service Economy   IaaS (Infrastructure) –  AWS, GoGrid, RackSpace/Mosso   PaaS (Platform) –  Google App Engine –  RightScale –  Force.com (Salesforce)   SaaS (Application) –  Salesforce (CRM) –  Gmail (Mail) © 2009 GoGrid / ServePath January 2009 - 10 -
  • 11. SaaS Tenancy Model © 2009 GoGrid / ServePath January 2009 - 11 -
  • 12. PaaS Tenancy Model © 2009 GoGrid / ServePath January 2009 - 12 -
  • 13. IaaS Tenancy Model © 2009 GoGrid / ServePath January 2009 - 13 -
  • 14. Two Faces of IaaS   Infrastructure Web Services –  AWS is canonical example –  Web service model –  Pick and choose ‘a la carte’ web services –  Proprietary interfaces   Cloudcenters –  GoGrid is canonical example –  Very common: FlexiScale, RackSpace/Mosso, & AppNexus –  Datacenter model ‘in-the-sky’ –  Standards-based datacenter-like infrastructure © 2009 GoGrid / ServePath January 2009 - 14 -
  • 15. Infrastructure Web Service © 2009 GoGrid / ServePath January 2009 - 15 -
  • 16. Cloudcenters © 2009 GoGrid / ServePath January 2009 - 16 -
  • 17. WHY STORAGE IN THE CLOUD? © 2009 GoGrid / ServePath January 2009 - 17 -
  • 18. Many Drivers   Abstraction (hardware & network)   Cost efficiencies (at smaller scale only?)   Use cases demand it (DR, offsite backup, etc)   Not an either/or proposition   Data proximity (to compute) –  Storage without compute? –  Compute without storage? © 2009 GoGrid / ServePath January 2009 - 18 -
  • 19. STORAGE TODAY © 2009 GoGrid / ServePath January 2009 - 19 -
  • 20. Traditional Datacenters   You choose: NAS, SAN, DAS, or some of each   High performance   High degree of control © 2009 GoGrid / ServePath January 2009 - 20 -
  • 21. Amazon’s S3   ‘Object-store’ –  URL PUT and GET –  Simple usage   Proprietary & unique –  Coding required   Variable performance   Infinitely scalable   Best for archives/SoR © 2009 GoGrid / ServePath January 2009 - 21 -
  • 22. Amazon’s Elastic Block Storage (EBS)   DAS (iSCSI?)   S3 integration   Performance is OK   Manage disks & servers   Overbuy problem © 2009 GoGrid / ServePath January 2009 - 22 -
  • 23. GoGrid’s Cloud Storage (NAS in the Sky)   NAS   Performance == EBS   Infinitely scalable multi-tenant NetApp   Just works; pay-as- you-go © 2009 GoGrid / ServePath January 2009 - 23 -
  • 24. GoGrid’s CloudConnect (DAS on-demand)   DAS + Servers   Physical server cloud –  v1: manual –  v2: fully automated   High speed spindles   High Performance –  Fileservers or databases © 2009 GoGrid / ServePath January 2009 - 24 -
  • 25. Storage Type Comparison Matrix S3 EBS GG Cloud GG Cloud Storage Connect Standards- No Yes Yes Yes based Managed Yes No Yes No Performance Low Med Med Very High Scalable High Med High Low Capacity Overbuy No Yes No Yes © 2009 GoGrid / ServePath January 2009 - 25 -
  • 26. MANAGEMENT CHALLENGES © 2009 GoGrid / ServePath January 2009 - 26 -
  • 27. Traditional Datacenter Challenges   Over or under buying –  Either ahead or behind your data growth curve   Tends towards vendor/hardware lock-in   Data replication costs   Data backups, retention, and offsite storage   Significant staffing requirements –  Storage experts –  Networking experts © 2009 GoGrid / ServePath January 2009 - 27 -
  • 28. IaaS Challenges   Security & data integrity   Data movement   Performance   Multi-tenancy impacts   Vendor scalability unknown   More expensive ‘at scale’?   Vendor lock-in © 2009 GoGrid / ServePath January 2009 - 28 -
  • 29. IaaS Challenges: Security   How is your data handled?   Auditability: Who stored what where?   Data destruction guarantees   Compliance and privacy measures? © 2009 GoGrid / ServePath January 2009 - 29 -
  • 30. IaaS Challenges: Data Movement   Migration & Synchronization   B/W is constrained   Standards? –  rsync –  Block-level replication –  Snapshot replication •  NetApp <-> GGCS ? •  EMC < -> EBS ? © 2009 GoGrid / ServePath January 2009 - 30 -
  • 31. IaaS Challenges: Performance   S3: highly variant –  10x swings –  Archives only?   EBS/GGCS –  Good perf –  Multi-tenancy impacts –  EBS needs admin?   CloudConnect –  Premium cost –  Storage admin required? © 2009 GoGrid / ServePath January 2009 - 31 -
  • 32. IaaS Challenges: Multi-tenancy   Rogue applications or customers consume too many resources   Traditional datacenter similar, but lower scale   10^2 more tenants == more impacts   Performance guarantees? © 2009 GoGrid / ServePath January 2009 - 32 -
  • 33. IaaS Challenges: Vendor Scalability   Unproven scale from vendors   AWS most proven, but still: –  S3 performance issues gave rise to EBS –  EBS itself limited •  1TB per volume (aka LUN) •  20 volumes max (default) •  ~15 volumes mountable per EC2 instance   Only time will tell © 2009 GoGrid / ServePath January 2009 - 33 -
  • 34. IaaS Challenges: Expensive at Scale   Cloud isn’t always cheaper   Sufficient scale == sufficient sunk cost in: –  Storage systems –  People –  Network   Where’s the line? –  20TB? 200TB? 1PB? More? Less? –  Business case dependent –  SmugMug 300+TB, 500M images   Probably need both Cloud and DC long term anyway © 2009 GoGrid / ServePath January 2009 - 34 -
  • 35. IaaS Challenges: Vendor Lock-in   High level of ‘stickiness’ once significant storage in place –  Cost of moving high –  Need to keep data near my compute   S3 and similar are proprietary standards –  Custom solutions not portable to other clouds   New value added features create new lock-in?   Need standards that make sense © 2009 GoGrid / ServePath January 2009 - 35 -
  • 36. Standards   Need to bridge DC data to cloud data   Smart synchronization & replication   Some standards exist we should reuse: –  Filesystems: CIFS / NFS / ZFS? –  Replication: NDMP / RSYNC –  Network LUNs: iSCSI / FCoE   Need more: –  Snapshots, incremental snapshots –  Safe data encryption & destruction –  Auditability: who put what where and when? © 2009 GoGrid / ServePath January 2009 - 36 -
  • 37. Vision Your data, safe and secure, available anywhere at any time and performing to your applications’ needs © 2009 GoGrid / ServePath January 2009 - 37 -
  • 38. Future   Current hardware lock-in replaced by open software –  ZFS –  NetApp functionality in open software   ZFS the great equalizer? –  Nexenta, Solaris, Linux (via FUSE), and FreeBSD   Cross-cloud interoperability via open standards   Data-centric storage management tools –  Not vendor-centric; storage-centric   Next generation of DR & offsite solutions –  Block replication of virtual machines © 2009 GoGrid / ServePath January 2009 - 38 -
  • 39. Q&A EMAIL randyb@gogrid.com GOGRID INFO http://www.gogrid.com BLOG http://neotactics.com/blog WORK BLOG http://blog.gogrid.com TWITTER http://twitter.com/randybias GOGRID PROMO CODE GGRB ($100 credit) © 2009 GoGrid / ServePath January 2009 - 39 -