Private Cloud Academy: Backup and DPM 2010


Published on

The session I ran on how to design CSV for Hyper-V backups, and how to use DPM 2010, at the Microsoft/System Dynamics Private Cloud Academy in Dublin, Ireland.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Private Cloud Academy: Backup and DPM 2010

  1. 1. Private Cloud Academy<br />Aidan Finn<br /><br />Paul Hall<br /><br />
  2. 2. 3/25/2011<br />2<br />System Dynamics - Overview<br /><ul><li>Established 1968
  3. 3. Acquired 1997 from UK parent by current management
  4. 4. Ireland’s largest indigenous IT Business </li></ul> Solutions Company<br /><ul><li>Winner of Deloitte Best Managed Companies Awards 2009, 2010 and 2011
  5. 5. Hyper-V and System Centre
  6. 6. SharePoint
  7. 7. ASP.NET, SQL, InfoPath</li></li></ul><li>Private Cloud Academy <br />One of four modules<br />Module I: Hyper-V and Private Cloud Computing <br />Module II: Managing Hyper-V (14 January 2011) <br />Module III: Hyper-V and Data Protection Manager (Today) <br />Module IV: Windows Server 2008 R2 Service Pack 1 (20 May 2011) <br />Very important that we learn from today so please fill out your feedback forms.<br />
  8. 8. About Aidan Finn<br />Infrastructure Team Lead at System Dynamics<br /><br />Working in IT since 1996<br />MCSE & MVP (Virtual Machine)<br />Experienced with Windows Server/Desktop, System Center, virtualisation, and IT infrastructure.<br />Blog:<br />
  9. 9. Mastering Hyper-V Deployment<br />600 pages of how to do a Hyper-V project A-Z<br />
  10. 10. Also<br />Mastering Windows Server 2008 R2 (Sybex, 2009) - 4 chapters<br />Mastering Windows 7 Deployment (Sybex, 2011)<br />10215A: Implementing and Managing Microsoft Server 2008 R2 Virtualization – Technical reviewer<br />
  11. 11. Agenda<br />Breaking news from MMS 2011 (Level 100)<br />Hyper-V cluster design & backup (Level 400)<br />Introducing DPM 2010 (Level 100)<br />Protecting Hyper-V and workloads (Level 300)<br />Site-to-site replication for DR (Level 300)<br />
  12. 12. Breaking News From MMS 2011<br />
  13. 13. SCVMM 2012 Beta<br />System Center Virtual Machine Manager 2012 Beta<br />A big leap forward!<br />
  14. 14. Fabric Management<br />Hyper-V and cluster lifecycle management – deploy hosts from bare metal and create clusters<br />Third Party Virtualization Platforms - Citrix XenServer and VMware ESX Hosts and Clusters<br />Network Management – Manage IP Address Pools, MAC Address Pools and Load Balancers<br />Storage Management (SMI-S) – Classify storage, Manage Storage Pools and LUNs <br />
  15. 15. Resource Management<br />Dynamic Optimization – proactively balance the load of VMs across a cluster <br />Power Optimization – schedule power savings to use the right number of hosts to run your workloads – power the rest off until they are needed.<br />PRO – integrate with System Center Operations Manager to respond to application-level performance monitors.<br />
  16. 16. Cloud Management<br />Abstract server, network and storage resources into private clouds <br />Delegate access to private clouds with control of capacity, capabilities and user quotas<br />Enable self-service usage for application administrator to author, deploy, manage and decommission applications in the private cloud<br />
  17. 17. Service Management<br />Define service templates<br />Compose operating system images and applications during service deployment <br />Scale out the number of virtual machines in a service <br />Service performance and health monitoring integrated with Ops Mgr<br />Decouple OS image and application updates through image-based servicing. <br />Server application virtualization technologies such as Server App-V<br />
  18. 18. Project Concero<br />Portal application<br />Integrated public (Azure) and private (SCVMM) cloud management<br />Still early days<br />
  19. 19. DPM 2012<br />Some details revealed<br />New approach to VSS<br />Item level recovery from VHD, even when DPM in a VM<br />Manage many DPM servers from OpsMgr<br />Role-based administration<br />Can upgrade DPM 2010<br />
  20. 20. Hyper-V Cluster Design & Backup<br />
  21. 21. Why Are We Talking About This?<br />Let’s do some recap<br />And discuss some concepts<br />
  22. 22. Backup Strategies<br />There are 3 types of VM backup you can do with Hyper-V (mix ‘n’ match):<br />Treat the VM as a physical machine<br />Backup everything<br />Limited usefulness in Hyper-V world<br />Backup just the changing data<br />Limited backup traffic and more frequent<br />Backup the VM at the physical storage level<br />Replace the “bare metal recovery”<br />
  23. 23. Backup Like a Physical Machine<br />Backup<br />DPM Agent<br />
  24. 24. Backup Just The Changing Data<br />Backup<br />DPM Agent<br />
  25. 25. Storage Level Backup<br />
  26. 26. Backup<br />VSS Provider<br />Backup, e.g. DPM 2010<br />CSV LUN<br />
  27. 27. Volume Shadow Copy Service (VSS)<br />VSS is used in storage level backup<br />By default the system (software/Windows) VSS provider is used<br />Slow<br />VM backup must be “serialized”<br />
  28. 28. Serialization<br />Groups VMs<br />DPM can only backup 1 group at a time<br />Recommended strongly by MS when using system VSS provider for storage level backup<br />“Recovery Point Creation Failed”<br /><br />Set registry key value<br />Run DSConfig.ps1 on a protected cluster host<br />Store DataSourceGroups.xml at %PROGRAMFILES%Microsoft DPMDPMConfig on DPM server<br />
  29. 29. Hardware VSS Provider<br />Try to choose hardware SAN with hardware VSS provider<br />Faster<br />No need to serialize<br />Must have VSS support for CSV<br />
  30. 30. Linux & VSS<br />VSS is a feature of Windows<br />No Linux support for VSS<br />Compatible Windows VMs suffer no downtime<br />Two options<br />Stop VM, backup, start VM (requires scripting)<br />Treat the Linux VM as a “physical” server<br />Don’t backup at storage level<br />
  31. 31. Reminder: Redirected I/O<br />Exclusive access required to all files for file system operations, such as VSS snapshot.<br />How is that done?<br />CSV coordinator takes over all files.<br />Other host I/O redirected via CSV Coordinator.<br />Also provides storage path fault tolerance.<br />
  32. 32. Redirected I/O Illustrated<br />
  33. 33. So What?!?!?<br />Backup of 1 VM on CSV causes Redirected I/O for all<br />Need to consider bandwidth and latency for Redirected I/O<br />The storage performance of every VM on a CSV will be impacted<br />What about active/active multi-site clusters?<br />And we haven’t talked about:<br />Performance (IOPS)<br />Storage level replication policies<br />Storage fault tolerance<br />
  34. 34. Host Design for CSV<br />All identical OS builds & configurations<br />Almost identical hardware<br />Identical drive letter (C:) for %systemdrive%<br />NTLM (NT LAN Manager) must be enabled<br />SMB enabled on each network that may be involved in CSV:<br />Client for Microsoft Networks<br />File and Printer Sharing for Microsoft Networks<br />
  35. 35. Host Networking<br />Microsoft recommends host as follows:<br />NIC1: Parent partition<br />NIC2: Virtual machine networking<br />NIC3: Live Migration (private network)<br />NIC4: Cluster Shared Volume (private network)<br />NIC5 & NIC6: iSCSI (for iSCSI SAN only)<br />Some variations<br />HP Flex10 for blades<br />Backup network NIC<br />CSV NIC used for Redirected I/O<br />Label NICs identically on all hosts<br />
  36. 36. Specifying CSV NIC<br />CSV will automatically use the private (not routed) network with lowest metric<br />You can force CSV to use a network using PowerShell:<br />CSV NIC labeled as “CSV Network”<br />$n = Get-ClusterNetwork “CSV Network”;$n.Metric = 1033<br />You can reset to automatic metric with:<br />$n = Get-ClusterNetwork “CSV Network”;$.AutoMetric = $true<br />
  37. 37. How Many CSVs And How Big?<br />No right answer<br />Use assessment or performance monitoring data to figure out how many VMs in CSV<br />Use IOPS from assessment VS IOPS capabilities of storage from manufacturer<br />Consider VM placement<br />Clustered or load balanced VMs should be on different storage<br />“All your eggs in one basket”<br />
  38. 38. Backup Impact on CSV Design<br />Define backup requirements for VMs<br />Storage level backup once per night/week/month?<br />Data backup?<br />DR replication<br />Maybe start the on-paper design with one CSV<br />Divide into smaller CSVs to limit impact of redirected I/O<br />Backup policy<br />Affinity/fault tolerance<br />Storage level replication<br />Don’t forget IOPS<br />
  39. 39. Private Cloud Tough To Design<br />No assessment data<br />Nothing to P2V<br />Nothing to assess<br />You have no empirical data to size from<br />Private cloud is like a Kevin Costner movie<br />“If you build it, they will come”<br />My tip:<br />Build a pilot environment<br />Deploy VMs onto different sized VMs<br />Backup each CSV<br />Measure performance and size accordingly<br />
  40. 40. Some Common Approaches to CSV<br />One CSV per host<br />One CSV coordinator role assigned per host<br />Start with one or two CSVs<br />Monitor storage performance with OpsMgr<br />Grow CSVs as required<br />Add CSV before performance degrades<br />Some do scripting to control Redirected I/O:<br />Live migrated CSV VMs to CSV coordinator host<br />Perform CSV backup<br />
  41. 41. RAID and VM/VHD Placement<br />RAID 5 gives the most capacity<br />RAID 5 loses maybe 75% of write speed<br />Rule of thumb:<br />If you would deploy RAID 10/5 for a physical box for performance, then place the VM/VHD on RAID 10/5 CSV<br />Complicated by disk group/virtual disk in modern SAN<br />Consult your storage vendor on best performance VS capacity<br />
  42. 42. Fast Track Reference Architecture<br />
  43. 43. Cluster/CSV Summary<br />Understand requirements for:<br />Backup<br />DR replication<br />Design cluster networking according to best practices<br />Design CSV according to requirements for:<br />Backup policy<br />Performance (IOPS & Redirected I/O)<br />DR storage level replication<br />Fault tolerance<br />
  44. 44. Backup Software<br />For storage level backup<br />You can use any backup product certified for Windows Server 2008 R2 Hyper-V<br />Test before you buy/use<br />Cluster VM location awareness<br />CSV support <br />For VM level backup<br />Any backup product should work – check with vendor for support of agent in VM<br />
  45. 45. Introducing DPM 2010<br />
  46. 46. System Center Data Protection Manager 2010<br />Microsoft’s backup solution<br />Private cloud and Dynamic Datacenter<br />Best of breed for protecting Microsoft products<br />SQL Server, Windows Server, Windows client, Sharepoint, Exchange, Dynamics, and so on<br />License as:<br />Server & agent (Client, Std or Ent)<br />System Center Management Suite<br />Enrolment for Core Infrastructure<br />SCE + DPM + agent<br />
  47. 47. Additional DPM 2010 Features<br />Improved storage: auto grow and self healing<br />SharePoint 2010 infrastructure awareness<br />Automatic protection of new SP/SQL resources<br />Self-service<br />Hyper-V CSV support<br />VM, workload, or bare metal backup and restore<br />D2D, D2T, and D2D2T backup<br />PowerShell cmdlets<br />Site-to-site replication AKA DPM2DPM4DR<br />
  48. 48. Scalability<br />100 Servers, 1000 Laptops, up to 2000 Database per Server<br />Up to 80 TB per DPM server<br />
  49. 49. DPM Backup Is A Little Different<br />Deploy disk storage/tape library<br />Disk shared by many backup policies<br />Deploy a single all-purpose agent to protected machine<br />Create a protection group (backup policy)<br />Defines what you backup/when/retention policy<br />Agent synchronises with DPM server<br />Block level changes since last backup are replicated, maybe every 15 minutes, via VSS<br />Recovery points are created<br />Maybe 3 times/day. You restore from these.<br />
  50. 50. DPM Requirements<br />Check TechNet<br />Too many variations to include here<br />Depends on OS and software<br />Please install required patches<br />D2D storage pools<br />Use “cheap” SATA disk<br />Rule of thumb sizing: 2.5 – 3 times protected disk space<br />Storage calculators available for free download<br />
  51. 51. Protecting Hyper-V And Workloads<br />
  52. 52. Reminder …<br />We have 3 ways we can backup:<br />Storage/host<br />Treat the VM like a physical machine<br />Backup the changing data<br />We need to associate backup policy with virtual machine CSV placement<br />To control Redirected I/O<br />
  53. 53. Scenario 1: Problem<br />Protect 2 VMs<br />File1 (File Server):<br />Backup entire VM once/week<br />Backup file shares 1 time/day<br />SD-SQL1 (SQL Server):<br />Backup entire VM once/day<br />Backup databases 3 times/day<br />Minimise impact on network for backup activity<br />
  54. 54. Scenario 1: Solution – Part 1<br />Place File1 on CSV1<br />Create protection group for all VMs on CSV1<br />Backup once per week<br />Install agent on File1<br />Create protection group: select file shares<br />Synchronise every 15 minutes<br />Restoration point 1 time per day<br />
  55. 55. Scenario 1: Solution – Part 2<br />Place SD-SQL1 on CSV2<br />Create protection group for all VMs on CSV2<br />Backup once per day<br />Install agent on SD-SQL1<br />Create protection group: select all databases<br />Synchronise every 15 minutes<br />Restoration point 3 times per day<br />
  56. 56. Site-to-site replication for DR<br />
  57. 57. Disaster Recovery Problem<br />A legal or desired requirement for many organisations<br />Many solutions, including:<br />Point solution replication: complicated and sometimes delicate<br />Storage replication: expensive hardware/licensing/networking and the domain of big corporations<br />
  58. 58. Site-to-Site Replication<br />
  59. 59. Site A Hosts<br />Site B Hosts<br />DPM 2010<br />DPM 2010<br />Storage Pools<br />Storage Pools<br />
  60. 60. Disaster Recovery Solution<br />What is a virtual machine, really?<br />Just a few files<br />Files are easy to backup and replicate<br />DPM 2010 backs up Hyper-V VMs<br />DPM server in Site A can replicate storage pools to other DPM server in Site B<br />Scheduling and bandwidth throttling<br />Can restore VMs to alternative hosts/clusters in Site B<br />Admin console or by (scheduled) script<br />
  61. 61. Scenario 2: Problem<br />Be able to restore File1 and SD-SQL1 to DR site (from Site A to Site B)<br />Recover entire VM and business data to within a few hours<br />Consolidate vendors<br />Minimise costs<br />Hardware, software, and network<br />Minimise complexity<br />
  62. 62. Scenario 2: Solution<br />Deploy Hyper-V hosts in Site B<br />Deploy replica DPM server in Site B<br />Configure protection group:<br />Site A DPM database<br />File1 and SD-SQL1 VMs<br />File1 shared folders & SD-SQL1 databases<br />Invocation plan:<br />Recover File1 and SD-SQL1 on Site B hosts<br />Recover File1 shares and SD-SQL1 databases<br />
  63. 63. Protecting Non-Microsoft Products<br />
  64. 64. Cross-Platform Protection<br />DPM 2010 protects only Microsoft products<br />i365 have created a DPM-based appliance with addition protected products<br />Physical and virtual appliance<br />Protected products include:<br />VMware<br />RedHat and SUSE Linux<br />Solaris, HP-UX, AIX, IBM i, NetWare<br />Oracle databases<br />
  65. 65. Action<br />Contact us for virtualisation assessment<br />1 free day of consulting for today’s attendees (per organization)<br />Help you determine the right strategy for you<br /><br />01 4830355<br />
  66. 66. Private Cloud Academy <br />One of four modules<br />Module I: Hyper-V and Private Cloud Computing <br />Module II: Managing Hyper-V (14 January 2011) <br />Module III: Hyper-V and Data Protection Manager (Today) <br />Module IV: Windows Server 2008 R2 Service Pack 1 (20 May 2011) <br />Very important that we learn from today so please fill out your feedback forms.<br />
  67. 67. Did I Stay On Schedule?<br />Sales<br /><br /><br />Aidan Finn<br /><br />@joe_elway<br /><br />