Data management is a critical business strategy that tackles data growth, storage costs, data protection and long-term data. Datacenter virtualization presents new challenges to manage business data, in the consolidated and increasingly complex infrastructure resulting from server and storage virtualization. How should an organization design and implement the right data protection strategy for the increasingly consolidated and virtualized datacenter, recognizing that virtualization has completely changed the rules for backup and high availability? What is the impact of virtualized computing on storage design?This presentation will review how the fundamental design principles for shared storage (Reliability, Availability, and Scalability) are applied to virtualized computing infrastructure, and then dive into the ramifications of server virtualiztion on data protection and high availability solutions.
Our say to do ratio is high. We execute technically. We allocate time out for training. You don’t have to pay us to learn. We’ve already done this and can apply to real life situations.No one else has the cross-trained expertise across all technology silos.
VMDirectPath I/O for Storage: http://www.youtube.com/watch?v=jmQ5Ej8r-aAParavirtualized SCSIPluggable Storage Architecture (PSA)In vSphere, leveraging third party storage vendor multi-path software capabilities has been introduced through a modularstorage architecture that allows storage partners to write a plug-in for their specific capabilities. These modules cancommunicate with the intelligence running in the storage array to determine the best path selection, as well as leveragingparallel paths to increase performance and reliability of the I/O from the ESX to the storage array. By default, the nativemultipath driver (NMP) supplied by VMware will be used. It can be configured to support round-robin multipath as well.However, if storVMware has used SCSI Reservation Locks with its Virtual Machine File System (VMFS) to allow multiple ESX hosts access to the same datastore. These locks allow for multiple access of many ESX hosts to the same datastore and are critical for preventing corruption, such as if two VMware admins both tried to create the same VM at the same time on the same volume. When a VM is powered-on its files become locked, much the same way as a document opened in Word becomes locked. This prevents silly administrative accidents by making it impossible to delete a VM (or document) while it is powered on (or in use).
a set of APIs focused on local backup/recovery use casesBackup vSphere virtual machines from a central backup server or virtual machine without requiring backup agents or requiring backup processing to be done inside each guest virtual machine on the ESX host
Storage Virtualization Challenges
Data Management Strategies In A Virtualized Environment<br />Randy Weis, Sr. Solutions Architect, Data Management <br />January 20, 2011<br />
What’s New in vSphere: vStorage API<br />vStorage API for Data Protection<br />vStorage APIs for Site Recovery Manager<br />vStorage APIs for Array Integration (VAAI).<br />vStorage APIs for Multipathing (Pluggable Storage Architecture)<br />
VADP<br /><ul><li>vStorage API for Data Protection: a set of APIs focused on local backup/recovery use cases.
The missing fourth primitive: Thin Provisioning Stun</li></li></ul><li>ESX server<br />Hardware<br />VMware Backup Challenges<br />Virtualization changes server, application, and information paradigm… <br />Backup must evolve to deliver even greater consolidation and value<br />Old Paradigm<br />Physical environment: Low overall server utilization and plenty of bandwidth for backup<br />New Paradigm<br />Virtual environment: High overall server utilization and littlebandwidth for backup<br />100%<br />100%<br />80%<br />80%<br />60%<br />60%<br />CPU Utilization<br />CPU Utilization<br />40%<br />40%<br />Shared physical resources<br />20%<br />20%<br />0%<br />0%<br />Virtual<br />Server A<br />Virtual Server B<br />Virtual Server C<br />Server A<br />Server B<br />Server C<br />20% resource utilization<br />80% resource utilization<br />
vStorage APIs for Data Protection<br />Backup Partner Solutions<br />VMware enables scalable, non-disruptive backup and simple, reliable restore to any hardware<br />APP<br />APP<br />BACKUP APP<br />APP<br />Traditional backup<br /><ul><li>Disruptive to applications and users
Hardware dependencies complicate restore</li></ul>Backup with VMware vSphere<br /><ul><li>Non-disruptive to applications & users
Enables off-host, off-LAN backup with standard backup software via vStorage APIs for Data Protection
Enables image and file-level backup of virtual machines
VSS quiescing for app consistency (OS level consistency in Windows 2008)</li></ul>ArcServe<br />OS<br />OS<br />OS<br />OS<br />NetBackup & Backup Exec<br />ESX<br />Backup Job<br />vRanger<br />Tivoli Storage Manager<br />Simpana<br />Avamar<br />Tape or disk<br />VM Snapshot<br />
VMware Backup Methods<br /><ul><li>Two backup methods for VMware</li></ul>VCB (VMware Consolidated Backup –VI3) - proxy<br />VADP (vStorage API for Data Protection-vSphere) – no agents or proxy<br />
Retain: Store More for Longer with Less<br />Over one year of retention in 3U of Data Domain deduplication storage<br />Backup Cumulative Estimated Physical<br />Data Logical Reduction<br />First Full 1 TB 4x 250 GB<br />Week 1<br />April 7 2.4 TB 8x 308 GB<br />Week 2<br />April 14 3.8 TB 10x 366 GB<br />Week 3<br />April 21 5.2 TB 12x 424 GB<br />Month 1<br />April 28 6.6 TB 14x 482 GB<br />Month 2<br />May 31 12.2 TB 17x 714 GB<br />Month 3<br />June 30 17.8 TB 19x 946 GB<br />Month 4<br />July 31 23.4 TB 20x 1,178 GB<br />TOTAL 23.4 TB 20x 1,178 GB<br />
Shift to Virtual<br />The Data Protection Challenge<br />RTO/RPO <br />Data Protection Results<br />Event<br />Time Loss<br />RPO<br />Data Loss<br />RTO<br />30% DR testing success rate within SLAs<br />76% back up success rate with no formal tools to monitor jobs<br /> 40% cite difficulty in validating back up / recovery process <br />Multi-Protection Silos<br />
Resources and Links<br />Brocade<br /><ul><li>Brocade_VMwareESX4_Overview_GA-TB-208-00