Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Data Management Strategies In A Virtualized Environment<br />Randy Weis, Sr. Solutions Architect, Data Management <br />Ja...
Agenda<br /><ul><li>What is Data Management?
Storage Design Impacts
Reliability
Availability
Scalability
vStorage, VADP and VAAI
VMware Backup Challenges
Storage Virtualization
Snapshots
Replication
Thin provisioning
File System Virtualization
Capacity Management
Deduplication</li></li></ul><li>What is Data Management?<br /><ul><li>What is Data management?
Upcoming SlideShare
Loading in …5
×

Storage Virtualization Challenges

3,311 views

Published on

Challenges and best practices for storage in a virtual infrastructure

  • Be the first to comment

Storage Virtualization Challenges

  1. 1. Data Management Strategies In A Virtualized Environment<br />Randy Weis, Sr. Solutions Architect, Data Management <br />January 20, 2011<br />
  2. 2. Agenda<br /><ul><li>What is Data Management?
  3. 3. Storage Design Impacts
  4. 4. Reliability
  5. 5. Availability
  6. 6. Scalability
  7. 7. vStorage, VADP and VAAI
  8. 8. VMware Backup Challenges
  9. 9. Storage Virtualization
  10. 10. Snapshots
  11. 11. Replication
  12. 12. Thin provisioning
  13. 13. File System Virtualization
  14. 14. Capacity Management
  15. 15. Deduplication</li></li></ul><li>What is Data Management?<br /><ul><li>What is Data management?
  16. 16. A critical business strategy for data growth, storage costs, data protection and long-term data.
  17. 17. Datacenter virtualization challenges
  18. 18. Increasingly consolidated and complex infrastructure
  19. 19. Impact of virtualized computing on storage design
  20. 20. The right data protection strategy
  21. 21. Backup
  22. 22. High availability
  23. 23. Fundamental design principles for shared storage
  24. 24. Reliability, Availability, and Scalability</li></li></ul><li>Storage Design Impacts<br /><ul><li>Reliability
  25. 25. Availability
  26. 26. Scalability</li></li></ul><li>Phases of Cloud Adoption<br />Phase III<br />Phase II<br />Phase IV<br />Phase I<br />Private<br />Cloud<br />Public<br />Cloud<br />Hybrid<br />
  27. 27. What’s New in vSphere: vStorage API<br />vStorage API for Data Protection<br />vStorage APIs for Site Recovery Manager<br />vStorage APIs for Array Integration (VAAI).<br />vStorage APIs for Multipathing (Pluggable Storage Architecture)<br />
  28. 28. VADP<br /><ul><li>vStorage API for Data Protection: a set of APIs focused on local backup/recovery use cases.
  29. 29. No Proxy Host
  30. 30. Veaam
  31. 31. vRanger
  32. 32. NBU 7
  33. 33. BUE 2010
  34. 34. CommVault 9*</li></li></ul><li>VAAI<br /><ul><li>vStorage API for Array Integration:
  35. 35. a set of APIs allow array vendors to “offload” various tasks from the ESX host
  36. 36. Copy offload (think VDI cloning)
  37. 37. “I/O Dedupe”, or Block Zeroing
  38. 38. Scalable Lock Management = "Hardware Assisted Locking“
  39. 39. http://www.youtube.com/watch?v=1sUS-LcEtBY
  40. 40. The missing fourth primitive: Thin Provisioning Stun</li></li></ul><li>ESX server<br />Hardware<br />VMware Backup Challenges<br />Virtualization changes server, application, and information paradigm… <br />Backup must evolve to deliver even greater consolidation and value<br />Old Paradigm<br />Physical environment: Low overall server utilization and plenty of bandwidth for backup<br />New Paradigm<br />Virtual environment: High overall server utilization and littlebandwidth for backup<br />100%<br />100%<br />80%<br />80%<br />60%<br />60%<br />CPU Utilization<br />CPU Utilization<br />40%<br />40%<br />Shared physical resources<br />20%<br />20%<br />0%<br />0%<br />Virtual<br />Server A<br />Virtual Server B<br />Virtual Server C<br />Server A<br />Server B<br />Server C<br />20% resource utilization<br />80% resource utilization<br />
  41. 41. vStorage APIs for Data Protection<br />Backup Partner Solutions<br />VMware enables scalable, non-disruptive backup and simple, reliable restore to any hardware<br />APP<br />APP<br />BACKUP APP<br />APP<br />Traditional backup<br /><ul><li>Disruptive to applications and users
  42. 42. Slow, complex process for full restore
  43. 43. Hardware dependencies complicate restore</li></ul>Backup with VMware vSphere<br /><ul><li>Non-disruptive to applications & users
  44. 44. Enables off-host, off-LAN backup with standard backup software via vStorage APIs for Data Protection
  45. 45. Enables image and file-level backup of virtual machines
  46. 46. VSS quiescing for app consistency (OS level consistency in Windows 2008)</li></ul>ArcServe<br />OS<br />OS<br />OS<br />OS<br />NetBackup & Backup Exec<br />ESX<br />Backup Job<br />vRanger<br />Tivoli Storage Manager<br />Simpana<br />Avamar<br />Tape or disk<br />VM Snapshot<br />
  47. 47. VMware Backup Methods<br /><ul><li>Two backup methods for VMware</li></ul>VCB (VMware Consolidated Backup –VI3) - proxy<br />VADP (vStorage API for Data Protection-vSphere) – no agents or proxy<br />
  48. 48. Second Friday Full Backup<br />B<br />C<br />D<br />E<br />F<br />L<br />G<br />H<br />Data Deduplication: Technology Overview<br />Thurs Incremental<br />A<br />C<br />K<br />Friday Full Backup<br />Mon Incremental<br />A<br />B<br />H<br />A<br />B<br />C<br />D<br />A<br />E<br />F<br />G<br />Tues Incremental<br />Weds Incremental<br />C<br />B<br />I<br />E<br />G<br />J<br />A<br />B<br />C<br />D<br />E<br />F<br />G<br /> Backup Estimated <br /> Data Logical Reduction Physical<br />FRIDAY FULL 1 TB 2–4x 250 GB<br />Monday Incremental 100 GB 7–10x 10 GB<br />Tuesday Incremental 100 GB 7–10x 10 GB<br />Wednesday Incremental 100 GB 7–10x 10 GB<br />Thursday Incremental 100 GB 7–10x 10 GB<br />Second FRIDAY FULL 1 TB 50–60x 18 GB<br />TOTAL 2.4 TB 7.8x 308 GB<br />H<br />I<br />J<br />K<br />L<br />
  49. 49. Retain: Store More for Longer with Less<br />Over one year of retention in 3U of Data Domain deduplication storage<br />Backup Cumulative Estimated Physical<br />Data Logical Reduction<br />First Full 1 TB 4x 250 GB<br />Week 1<br />April 7 2.4 TB 8x 308 GB<br />Week 2<br />April 14 3.8 TB 10x 366 GB<br />Week 3<br />April 21 5.2 TB 12x 424 GB<br />Month 1<br />April 28 6.6 TB 14x 482 GB<br />Month 2<br />May 31 12.2 TB 17x 714 GB<br />Month 3<br />June 30 17.8 TB 19x 946 GB<br />Month 4<br />July 31 23.4 TB 20x 1,178 GB<br />TOTAL 23.4 TB 20x 1,178 GB<br />
  50. 50. Shift to Virtual<br />The Data Protection Challenge<br />RTO/RPO <br />Data Protection Results<br />Event<br />Time Loss<br />RPO<br />Data Loss<br />RTO<br />30% DR testing success rate within SLAs<br />76% back up success rate with no formal tools to monitor jobs<br /> 40% cite difficulty in validating back up / recovery process <br />Multi-Protection Silos<br />
  51. 51. Resources and Links<br />Brocade<br /><ul><li>Brocade_VMwareESX4_Overview_GA-TB-208-00
  52. 52. Deploying_VMware_VI3_and_vSphere4
  53. 53. Zoning Implementation Strategies for Brocade SAN Fabrics</li></ul>VMware<br /><ul><li>Fibre Channel SAN Configuration Guide (v3.5 and v4.0)
  54. 54. Configuration Maximums, VI 3
  55. 55. SAN System Design and Deployment Guide
  56. 56. ESX Server 3 Configuration Guide
  57. 57. VMFS Best Practices
  58. 58. http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1021976
  59. 59. What Is New in VMware vSphere™ 4: Storage</li></ul>Great Demo<br />http://www.commvault.com/virtually-perfect-protection/demo.asp<br />

×