Your SlideShare is downloading. ×
Intelligent storage management solution using VMware vSphere 5.0 Storage DRS: A technical report of the storage management solution using SDRS on the IBM SONAS storage system
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Intelligent storage management solution using VMware vSphere 5.0 Storage DRS: A technical report of the storage management solution using SDRS on the IBM SONAS storage system

960
views

Published on

This technical paper provides the essential technical information about the advanced storage management solution for VMware virtual infrastructure using the VMware vSphere 5.0 Storage DRS feature with …

This technical paper provides the essential technical information about the advanced storage management solution for VMware virtual infrastructure using the VMware vSphere 5.0 Storage DRS feature with the IBM SONAS storage system. To know more about the VMware vSphere, visit http://ibm.co/Lx6hfc.


0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
960
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Intelligent storage management solutionusing VMware vSphere 5.0 Storage DRS A technical report of the storage management solution using SDRS on the IBM SONAS storage system Udayasuryan Kodoly IBM Systems and Technology Group ISV Enablement June 2012 © Copyright IBM Corporation, 2012
  • 2. Table of contentsAbstract .................................................................................................................................... 3Executive summary.................................................................................................................. 3 Intended audience ....................................................................................................................................4 Scope .......................................................................................................................................................4Prerequisites ............................................................................................................................ 4Solution components............................................................................................................... 4 VMware vSphere ......................................................................................................................................4 IBM SONAS overview ..............................................................................................................................5Solution architecture ............................................................................................................... 6 Material list for solution setup in the lab ...................................................................................................7 Basic configuration requirement for the solution ......................................................................................8 NFS data store configuration ............................................................................................................8 Create file set on a specific file system for the NFS data store ........................................................8 Creating NFS share (export) with the newly created file set ......................................................... 10 Data store clusters ................................................................................................................................ 12 Data store cluster constraints ........................................................................................................ 13 Best practices before creating the data store clusters .................................................................. 13 Steps to create a data store cluster ............................................................................................... 14 Profile-Driven Storage ........................................................................................................................... 21 Create user-defined storage capabilities ....................................................................................... 22 Create a VM storage profile........................................................................................................... 25 Assign the user-defined VM storage profiles to the data stores .................................................... 28 Using the VM Storage Profile ........................................................................................................ 31 Checking compatibility ................................................................................................................... 32 Guiding Storage DRS recommendations for the solution ..................................................................... 34 Affinity and anti-affinity rules.......................................................................................................... 35 Intra-VM VMDK affinity rule ........................................................................................................... 35 Intra-VM VMDK anti-affinity rule .................................................................................................... 37 Inter-VM anti-affinity rule ............................................................................................................... 38 Different VMFS block sizes ........................................................................................................... 39 SDRS data store maintenance mode ............................................................................................ 40Summary................................................................................................................................. 42Appendix A: Glossary ............................................................................................................ 43Appendix B: Materials used in the lab setup........................................................................ 44Appendix C: Resources ......................................................................................................... 45About the author .................................................................................................................... 47Trademarks and special notices ........................................................................................... 48 Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 2
  • 3. Abstract This technical paper provides the essential technical information about the advanced storage management solution for VMware virtual infrastructure using the VMware vSphere 5.0 Storage Distributed Resource Scheduler (Storage DRS) feature with the IBM Scale Out Network Attached Storage (SONAS) storage system. Storage DRS (SDRS) is a new vSphere 5.0 feature that provides intelligent virtual machine (VM) placement across storage by making load-balancing decisions based on the current I/O latency and space usage and moving virtual machine disks (VMDKs) in a non-disruptive manner between the data stores in the data store cluster. Storage DRS selects the best data store to place the virtual machine or VMDKs in the selected data store cluster of the SONAS file systems.Executive summaryIBM® SONAS is a scalable storage offering designed to manage vast repositories of informationin enterprise environments requiring very large capacities, high levels of performance, and highavailability. IBM SONAS provides a clustered network-attached storage (NAS) system with asingle name space for Common Internet File System (CIFS), Network File System (NFS),Hypertext Transfer Protocol Secure (HTTPS), Secure Copy Protocol (SCP), and File TransferProtocol (FTP) services. The system consists of: • Two to thirty-two interface nodes (2851-SI2) • One to thirty storage pods consisting of storage node (2851-SS2), storage • Controller (2851-DR1) and attached disks • Disk storage expansion units (2851-DE1) • Ethernet and InfiniBand® switches and racksIBM SONAS can scale up to a maximum configuration that provides up to a massive 21.6petabytes (PB) of storage capacity in a single cluster, highly redundant system. The storage usedin the SONAS system can be high-performance 15 K/10 K rpm serial-attached SCSI (SAS) harddisk drives (HDDs) or high-capacity 7.2 K rpm nearline SAS HDDs, allowing configurationaccording to the needs.The VMware vSphere 5.0 Storage DRS feature aggregates storage resources of several storagevolumes and file systems of the IBM SONAS storage system in to a single pool and simplifiesstorage management at scale. The feature intelligently places workloads on storage volumes andfile systems during provisioning based on the available storage resources. It performs ongoingload balancing between storage volumes and file systems to ensure space and avoids I/Obottlenecks as per predefined rules that reflect business needs and changing priorities withvSphere Storage DRS. The important benefits of Storage DRS on a vSphere 5.0 virtualinfrastructure are as follows. • Reduce IT costs and improve agility with rapid and simpler VM provisioning. • Increase manageability at scale by automated monitoring and remediation. • Improve application performance by avoiding storage resource bottlenecks. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 3
  • 4. • Meet application service level agreements (SLAs) during unavoidable congestion by using storage I/O control.Intended audienceThis technical report is intended for: • Customers and prospects looking to implement advanced storage management solution for the VMware virtual infrastructure using Storage DRS with the IBM SONAS storage system. • Users and management seeking information to implement advanced storage management solution for the VMware virtual infrastructure using Storage DRS with the IBM SONAS storage system.ScopeThis technical report provides: • Detailed and advanced storage management solution implementation for the VMware virtual infrastructure using Storage DRS with IBM SONAS. • Detailed design and implementation guide; configuration best practices. • Reproducible test results that simulate common failure scenarios resulting from operational problems and unplanned outages.This technical report does not: • Discuss any performance impact and analysis from a user perspective. • Replace any official manuals and documents from IBM and VMware on the products used in the solution.PrerequisitesThis technical paper assumes familiarity with the following prerequisites: • Basic knowledge of VMware virtualization technologies and products: − VMware vCenter Server 5.0 − VMware vSphere ESXi 5.0 • Basic knowledge of the IBM SONAS storage systemSolution componentsThis section briefly describes the essential components used in this solution.VMware vSphereIn order for Storage DRS to function correctly, the environment must meet the following VMwarevSphere basic product requirements. • VMware vCenter Server 5.0 • VMware vSphere ESXi 5.0 • VMware vCenter Cluster (recommended) • VMware vSphere Enterprise Plus License Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 4
  • 5. • Shared Virtual Machine File System (VMFS) or NFS data store volumes − Shared data store volumes accessible by at least one ESXi host inside the cluster − Data stores must be visible in only one data center • All hosts associated with the data store cluster must run ESXi 5.0 or higher versions.IBM SONAS overviewIBM SONAS is an enterprise-class, modular, scalable, NAS solution designed to meet rapidlygrowing storage needs. Delivering seamless scalability for the high performance and massivecapacity that healthcare providers require, it builds on a distributed architecture to reducemanagement complexity and eliminate any single point of failure that might impede dataavailability.SONAS scales to capacities over 21 PB to store large and small files generated by businessestoday and to meet the storage needs anticipated for the future. To keep these huge volumes ofdata safe and to remove interruptions from business operations, SONAS provides built-in highavailability and fault tolerance for dependability, resiliency, and flexibility.IBM SONAS provides a globally clustered NAS file system built upon IBM General Parallel FileSystem (IBM GPFS™). The global namespace is maintained across the cluster of multiplestorage pods and multiple interface nodes. This capability permits all interface nodes and allstorage nodes share equally in the cluster to balance workloads dynamically and provide parallelperformance to all users and storage, which also ensures high availability (HA) and automatedfailover.The IBM SONAS storage system offers the following features: • IBM SONAS provides extreme scalability to accommodate capacity growth for up to 21 PB • Manages multiple petabytes of storage and billions of files in a single file system • Excellent performance within a single file system • Enables ubiquitous access to files from across the globe quickly and cost effectively with IBM Active Cloud Engine™ • Operational efficiency with automated, policy-driven tiered storage • Automated lifecycle management and migration to tape • Satisfies bandwidth hungry applications with scale-out performance • Supports varied workloads including random access and streaming • Disaster recovery and business continuity with asynchronous replication • Fileset snapshots and file cloning for increased availability • Simple to use and manage with an intuitive GUI Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 5
  • 6. Solution architectureFigure 1: Intelligent storage management solution architecture for IBM SONASFigure 1 illustrates the architecture of the intelligent storage management solution for the VMwarevSphere 5.0 virtual cloud infrastructure, constructed on the IBM SONAS storage system forenterprise cloud virtual environment. This solution is made up of VMware vSphere ESXi 5.0hosts, VMware vSphere vCenter 5.0 servers, and IBM SONAS storage system.There are two separate VMware vSphere 5.0 High Availability (HA) clusters configured for thissolution in the lab validation environment. Each VMware vSphere 5.0 HA cluster is active withVMware vSphere ESXi 5.0 hosts running Microsoft® Windows® and Linux® VMs. VMs of eachcluster, resides on the NFS (NAS) data store cluster provisioned on the IBM SONAS storagesystem.NFS (NAS) data store cluster: The NFS (NAS) data stores consists of file-based data storescreated using the NFS protocol.In the lab solution setup, the VMware vSphere ESXi 5.0 hosts in each cluster setup can accessthe NFS (NAS) data store cluster to host several VMs. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 6
  • 7. Material list for solution setup in the labTable 1 lists the hardware and software used in this solution architecture.Infrastructure Vendor Quantity Detailscomponents For more information, refer to the VMware compatibility guide at:Servers running VMware IBM 4 http://www.vmware.com/resources/compatibvSphere ESXi 5.0 (IBM System x® ility/search.php 3650 M3) Example: ibm.com/systems/x/hardware/rack/x3650m 3/specs.html IBM SONASStorage system IBM 1 ibm.com/systems/storage/network/sonas/Network (Ethernet) Cisco Catalyst 1Switch 6509Network adapter Two 10 Gbps(Per ESXi host and IBMSONAS interface nodes) Four 1 Gbps IBM IBM SONAS Version 1.3 VMware VMware vSphere ESXi 5.0 or higherSoftware VMware VMware vCenter Server 5.0 or higherTable 1: List of hardware and software material used in the lab to set up the solution Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 7
  • 8. Basic configuration requirement for the solutionAfter correctly configuring the new virtual cloud infrastructure using the VMware vSphere ESXi5.0 hosts, and vSphere vCenter server 5.0, the solution requires at least one NFS data storeconfigured on each vSphere ESXi 5.0 host on the configured vSphere 5.0 HA cluster. These datastores must be provisioned on the IBM SONAS storage system.In the lab solution setup, the NFS data stores configured on all the vSphere ESXi 5.0 hosts areconfigured on both the clusters. NFS data store configuration This section describes the steps to configure the NFS data store. Create a file set on a specific file system for the NFS data store The first step is to create an appropriate file set on a specific file system for the NFS data store configuration. You can find more information about that file set at: http://pic.dhe.ibm.com/infocenter/sonasic/sonas1ic/index.jsp?topic=%2Fcom.ibm.sonas.doc% 2Fmng_t_filesys_create.html Perform the following steps to create a file set. 1. Click the Files icon and then click the File Sets option from the pop-up menu from the GUI, as shown in the Figure 2.Figure 2: Selecting the File Sets option Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 8
  • 9. 2. Click New File Set.Figure 3: Option to create a new file set 3. Provide the appropriate parameters to create the new file set and click OK.Figure 4: New file set parameters Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 9
  • 10. 4. Validate the file set creation status and click Close.Figure 5: File set creation status information Creating NFS share (export) with the newly created file set Perform the following steps to define an NFS share export on the newly created file set. 1. Click shares on the pop-up menu.Figure 6: Shares option to initiate NFS share creation Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 10
  • 11. 2. Click New Share.Figure 7: Clicking the New Share option 3. Select NFS share and provide the appropriate parameters for the new NFS share. In this example, the newly created file set path, NFS share name, and appropriate NFS client option are updated. Click OK.Figure 8: NFS share configuration with parameters Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 11
  • 12. After the appropriate NFS share has been created for the newly created file set, it is time to create and configure the NFS data store in the ESXi host using vCenter as show in the lab setup in Figure 9.Figure 9: NFS data store configured in the lab setupData store clustersThe data store clusters form the basis of vSphere 5.0 Storage DRS and it can be described as acollection of data stores aggregated into a single unit of consumption from an administratorperspective. An administrator no longer needs to be concerned about individual data stores. Datastore clusters are managed rather than individual data stores.Administrators can use data store cluster, during the provisioning process or during a manual VMmigration to the storage destination.Note:The provisioning process not only refers to the creation of a virtual machine, but also to adding adisk to an existing virtual machine, cloning a virtual machine, or performing a Storage vMotionoperation. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 12
  • 13. Data store cluster constraintsA data store cluster has the following constraints: • Must be NFS-based data stores on the same data store cluster for IBM SONAS storage system • Maximum of 32 data stores per data store cluster • Maximum of 256 data store clusters per vSphere vCenter Server 5.0 • Maximum of 9000 VMDKs per data store clusterBest practices before creating the data store clustersThe following best practices need to be followed before creating the data store clusters. • Set Storage DRS to manual and review the recommendation before accepting them. • All data stores in the cluster must use the same type of disk (SAS, SATA, or nearline SAS) • All data stores in the cluster must group with disks with similar characteristics (RAID 5 with RAID 5, mirror or replicated with mirror or replicated, 15 K rpm with 15 K rpm and so on). • All data stores in an SDRS cluster must be NFS data stores for IBM SONAS storage systems. • Data stores cannot be shared between different sites. • All data store hosts within a data store cluster must be ESXi 5 hosts. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 13
  • 14. Steps to create a data store cluster This section illustrates the steps for creating the data store cluster. The example shows the the lab test creation of the data store cluster, Class1_DatastoreCluster (Gold). 1. Go to the vSphere vCenter Server 5.0 home page. 2. Click Datastores and Datastores Clusters.Figure 10: Datastores and Datastore Clusters option Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 14
  • 15. 3. Right-click the cluster and then click New Datastore Cluster.Figure 11: New Datastore Cluster option to create the data store cluster Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 15
  • 16. 4. Enter an appropriate name for the data store cluster and select the Turn on Storage DRS check box, and click Next.Figure 12: General data store cluster creation page Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 16
  • 17. 5. Select the No Automation (Manual Mode) option and click Next.Figure 13: SDRS automation page Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 17
  • 18. 6. Accept the default settings (as shown in the Figure 14) and click Next.Figure 14: SDRS Runtime Rules page Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 18
  • 19. 7. Select the hosts and the clusters in the solution to add to the new data store cluster (as shown in Figure 15) and click Next.Figure 15: Selecting the hosts and clusters Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 19
  • 20. 8. From the Show Datastores list, select Connected to some hosts to view all the configured data stores and select the appropriate data stores to form the new data store cluster (as shown in the Figure 16) and click Next.Figure 16: The Select Datastores page Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 20
  • 21. 9. Validate the selected configuration and click Finish.Figure 17: Ready to Complete pageIn the lab test environment, the test team created the following data store clusters. • NFS based Tier1_DatastoreCluster (Gold) • NFS based Tier2_DatastoreCluster (Silver)Profile-Driven StoragevSphere 5.0 introduces Profile-Driven Storage which allows rapid and intelligent placement ofvirtual machine based on predefined storage profiles. This feature automates matching the SLArequirements of virtual machines with appropriate data stores or data store clusters. Thepredefined storage profiles usually represent a storage tier and are created through a vCenterfeature called VM Storage Profiles.In the lab solution setup, characteristics such as RAID level and performance are considered todefine different tires. The following list of storage tiers are used in the lab solution setup. • Tier1_Gold, RAID-6, SAS drive 15000 rpm, NFS data stores, NDMP backup enabled, Active Cloud Engine enabled Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 21
  • 22. • Tier2_Silver, RAID-6, nearline SAS 7200 rpm, NFS data store, NDMP backup enabled, Active Cloud Engine enabledIn the lab solution setup, these VM storage profiles are user-defined and are manuallyassociated. Create user-defined storage capabilities You need to perform the following steps to create user-defined storage capabilities. 1. On the vSphere vCenter 5.0 window, click the VM Storage Profiles icon.Figure 18: vSphere vCenter 5.0 VM storage profiles 2. Click Manage Storage Capabilities to add user-defined storage capabilities (or business tags), as shown in Figure 19. Here is how the user-defined storage capability Tier1-Gold is created in the lab solution setup. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 22
  • 23. Figure 19: Adding storage capability Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 23
  • 24. In the lab solution setup, the test team created storage capabilities as Tier1-Gold and Tier2- Silver, as shown in Figure 20.Figure 20: Solution lab setup showing user-defined storage capabilities Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 24
  • 25. Create a VM storage profile This section illustrates the steps to create a VM storage profile. 1. Click Create VM Storage Profile in the VM Storage Profiles view. Enter a name and description, as shown in Figure 21.Figure 21: Creating a new VM storage profile Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 25
  • 26. 2. Select the storage capabilities for the newly created profile, as shown in Figure 22.Figure 22: Manually assigning storage capabilities with VM storage profile Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 26
  • 27. In the lab solution setup, two VM storage profiles are created for each tier of storage, as shown in Figure 23.Figure 23: Lab solution setup of VM storage profiles Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 27
  • 28. Assign the user-defined VM storage profiles to the data stores This section illustrates the steps to manually assign the newly created VM storage profiles to the data stores within the data store clusters. 1. Right-click the data store within the data store cluster and click Assign User-Defined Storage Capability.Figure 24: Manually assigning the user-defined storage capability Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 28
  • 29. 2. Select the predefined storage tier capability for the selected data store within the data store cluster (as shown in Figure 25) and click OK. Note: Make sure to manually assign the same storage capability to all individual data stores within the data store cluster. A data store cluster must not have data stores with different types of storage capabilities.Figure 25: Selecting the appropriate user-defined storage capability from the list Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 29
  • 30. 3. In the Summary tab of the data store, a new section named, Storage Capabilities now displays both the options: System Storage Capability (VASA) and User-defined Storage Capability. Click the bubble icon next to the capability to view additional details, as shown in Figure 26.Figure 26: Storage capability summary tab Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 30
  • 31. Using the VM Storage Profile At this point, the VM profile is created and the user-defined capabilities are added to the data store. Use the profile to select the correct storage for the VM, as shown in Figure 27.Figure 27: Applying the VM storage profileThe profile is automatically attached to the VM during the deployment phase. Validate if the datastore on which the VM is placed has the same capabilities as the profile. If it does, then the VM issaid to be compliant. If not, the VM is said to be non-compliant, as shown in Figure 28.Figure 28: Storage selection with appropriate VM storage profile Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 31
  • 32. Notice the way that the data stores are now split into (Compatible and Incompatible) in the labsolution test environment. Compatible data stores are those which have the same storagecapabilities as those defined in the Gold profile.Note: It is also possible to deploy the Gold VM on to one of the incompatible data stores. Checking compatibility To check individual VMs, go to the Summary tab of the VM and validate the new VM Storage Profiles window. This indicates whether the VM is compliant or not, as shown in Figure 29.Figure 29: VM Storage Profiles window Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 32
  • 33. Also check the VM storage profile view to validate the storage compliance all the VMs, as shown in Figure 30.Figure 30: VM Storage Profiles view Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 33
  • 34. Guiding Storage DRS recommendations for the solutionFundamentally, when creating a virtual machine, it is required to select the destination storage forthe virtual machine.In the lab solution test environment, both the vSphere 5.0 HA clusters are connected to at leastone data store cluster, as shown in Figure 31.Figure 31: VM destination storage selection page Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 34
  • 35. After selecting the data store cluster, vCenter displays initial placement recommendations forSDRS, which need to be applied by the administrator (as shown in Figure 32).Figure 32: VM initial placement recommendations page Affinity and anti-affinity rules By default, SDRS applies an intra-VM affinity rule (VMDK affinity), storing all files that belong to a virtual machine to one data store. The SDRS supports three kinds of rules that are enforced during the initial placement and during ongoing migrations for load balancing. • Intra-VM VMDK affinity rule is used to keep a VM’s VMDKs together on the same data store. • Intra-VM VMDK anti-affinity rule is used to keep a VM’s VMDKs on a different data store. • Inter-VM VM anti-affinity rule is used to keep VMs on different data stores. Intra-VM VMDK affinity rule SDRS applies a VMDK affinity rule to each virtual machine by default. This default rule is commonly referred to as the intra-VM affinity rule, as shown in Figure 33. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 35
  • 36. Figure 33: Intra-VM VMDK affinity The user can change the data store cluster settings so that VMs in the cluster do not have an intra-VM VMDK affinity rule set by default (as shown in Figure 34).Figure 34: Overriding the intra-VMDK affinity rule Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 36
  • 37. If an existing virtual machine is moved into a data store cluster, the application of an intra-VM affinity rule depends on the disk layout configuration of the virtual machine and the method of introduction. Note: A virtual machine can be moved into a data store cluster by either Storage vMotion or by adding the data stores containing its disk to a data store cluster. Table 2 shows the application of the default SDRS intra-VM affinity rule. Be aware of the result of these actions when migrating to a data store cluster.Disk layout source Method Rule activate Disk layout destinationAll VMDKs on a single Storage vMotion Yes All VMDKs on a singledata store data storeVMDKs on multiple Storage vMotion Yes All VMDKs on a singledata stores data storeAll VMDKs on a single Add storage Yes All VMDKs on a singledata store data storeVMDKs on multiple Add storage No VMDKs on multipledata stores data storesTable 2: Applying the default intra-VM affinity rule Intra-VM VMDK anti-affinity rule The intra-VM VMDK anti-affinity rule keeps the specified VMDKs belonging to a virtual machine on separate data stores, as shown in the Error! Reference source not found.. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 37
  • 38. Figure 35: VMDK anti-affinity rule This rule can be useful for separating log and data disks of database VMs. Recommendation: It is recommended to apply this rule sparingly as it might affect the opportunities available for SDRS to find appropriate locations to place the virtual machine and still be able to load balance workloads inside the data store cluster. Inter-VM anti-affinity rule The inter-VM anti-affinity rule keeps the specified virtual machines on different data stores, as shown in Figure 36. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 38
  • 39. Figure 36: VM anti-affinity The benefit of this rule is to help maximize the availability of a collection of related virtual machines. In this rule, the availability of a set of critical virtual machines is increased by not allowing SDRS to place the critical virtual machines on the same data store (for example, VMs running web servers in a load-balance cluster or VMs running domain controllers). Recommendation: Similar to the intra-VM anti-affinity rules, apply VM anti-affinity rules sparingly. Anti-affinity rules place limitations on SDRS and reduce the possibilities that it has to reach a steady and balanced state. Different VMFS block sizes Recommendation: Avoid mixing data stores with different block sizes. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 39
  • 40. SDRS data store maintenance mode Storage DRS offers data store maintenance mode, which automatically evacuates all virtual machines and virtual disk drives from the selected data store to the remaining data store in the data store cluster, as shown in Figure 37.Figure 37: Enter SDRS data store maintenance mode Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 40
  • 41. You can click Apply Recommendation to formally take the data store to the maintenance mode, as shown in Figure 38.Figure 38: SDRS Maintenance Mode Migration Recommendations page Caution: SDRS cannot migrate the VMware Fault Tolerance (FT) enabled virtual machines. The workaround is to temporarily turn off FT for the FT virtual machine, perform migration, then re-enable FT. Similarly, virtual machine templates cannot perform Storage vMotion and they introduce problems for placing data stores in the maintenance mode. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 41
  • 42. SummaryvSphere Storage DRS continuously monitors storage space and I/O utilization across the SONASstorage system resources (file systems) and intelligently aligns storage resources to meetbusiness objectives including: • Ability to specify how storage resources of the SONAS storage system will be allocated to virtual machines with rules and policies • Providing IT autonomy to business organizations by assigning dedicated SONAS storage infrastructure to business units while still achieving higher storage utilization through pools of storage volumes • Empowering business units to build and manage virtual machines within their SONAS storage while giving central IT control over the SONAS storage resources.VMware Storage DRS continuously balances SONAS storage resources and storage I/O loadand avoids resource bottlenecks to meet application service levels, and increases manageabilityof storage at scale.To help you make the most of your IT investments, IBM together with VMware can deliver acomplete virtualization platform that can be tailored to meet an organization’s needs andenvironment. In partnership with VMware, IBM commits resources and establishes programs forongoing testing, validation, and interoperability. Together, IBM and VMware can offer: • The broadest platform of proven virtualization solutions, giving organizations the flexibility and choice • Deep integration between products for enhanced usability and advanced features • Comprehensive service and support to protect your virtualization investments over the long termAs established leaders in the virtualization space, IBM and VMware are uniquely positioned tohelp organizations achieve their virtualization goals, while minimizing business risk. This uniquecombination of hardware and software solutions enables organizations to dramatically reduce thecomplexity of IT, significantly lower IT costs, and increase IT flexibility for improved businessagility.Note: This paper is not intended to be a definitive implementation or solutions guide for VMwarevSphere 5.0 virtual infrastructure solutions using the Storage DRS feature with the SONASstorage system. Many factors related to specific customer environments are not addressed in thispaper. You can contact IBM for support from one of the IBM virtualization solutions experts forany deployment requirement. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 42
  • 43. Appendix A: Glossary • IBM Scale Out Network Attached Storage (SONAS) - Build on IBM high-performance computing experience, and based upon IBM General Parallel File System (IBM GPFS™), the scale out network-attached storage (NAS) solution provides the performance, clustered scalability, high availability, and functionality that are essential to meet strategic Petabyte Age and cloud-storage requirements. • VMware vSphere – Is one of the industry-leading virtualization platforms for building cloud infrastructures. vSphere accelerates the shift to cloud computing for existing data centers, while also underpinning compatible public cloud offerings, paving the way for the only hybrid cloud model. • VMware ESXi – Are bare-metal embedded hypervisors. They are enterprise software hypervisors from VMware for servers that run directly on server hardware without requiring an additional underlying operating system. • VMware vCenter Server – Delivers centralized management, operational automation, resource optimization, and high availability to IT environments. • Storage Distributed Resource Scheduler (SDRS) – Is an aggregate of storage resources of several storage volumes in to a single pool and simplifies storage management at scale. It intelligently places workloads on storage volumes during provisioning based on the available storage resources. • VMware High Availability (HA) – Provides easy to use, cost-effective high availability for applications running in virtual machines. • VMware Fault Tolerance (FT) – Provides continuous availability for applications in the event of server failures by creating a live shadow instance of a virtual machine that is in virtual lockstep with the primary instance. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 43
  • 44. Appendix B: Materials used in the lab setupThe following table lists the materials used in the lab setup.Infrastructure Vendor Quantity Detailscomponents IBM System x3650 M3Servers IBM 4 (IBM System Intel® Xeon® processor (Intel VT) E5506 x3650 M3) 2.13 GHz Memory: 128 GB in the cluster IBM SONASStorage system IBM 1 ibm.com/systems/storage/network/sonas/Network (Ethernet) Cisco Catalyst 1Switch 6509Network adapter Two 10 Gbps(Per-ESXi host and IBMSONAS Interface nodes) Four 1 Gbps IBM IBM SONAS 1.3 VMware VMware vSphere ESXi 5.0Software VMware VMware vCenter Server 5.0Table 3: Materials used in the lab setup Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 44
  • 45. Appendix C: ResourcesThe following websites provide useful references to supplement the information contained in thispaper: • IBM Systems on IBM PartnerWorld® ibm.com/partnerworld/systems • IBM Redbooks® ibm.com/redbooks • IBM Publications Center www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi?CTY=US • IBM SONAS on IBM PartnerWorld ibm.com/partnerworld/systems/sonasIBM SONAS documentation • IBM Scale Out Network Attached Storage Concepts ibm.com/redbooks/redpieces/abstracts/sg247874.html?Open • IBM SONAS Introduction and Planning Guide (GA32-0716): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sona s_ipg.pdf • IBM SONAS administration and user documentation: http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/index.jsp • IBM Scale Out Network Attached Storage Administrators Guide (GA32-0713): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sona s_admin_guide.pdf • IBM SONAS Users Guide (GA32-0714): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sona s_user_guide.pdf • IBM SONAS Software Configuration Guide (GA32-0718): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/confi guration_guide.pdf Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 45
  • 46. • IBM SONAS Troubleshooting Guide (GA32-0717): http://publib.boulder.ibm.com/infocenter/sonasic/sonas1ic/topic/com.ibm.sonas.doc/sona s_pd_guide.pdfVMware documentation • VMware vSphere Basics http://pubs.vmware.com/vsphere-50/topic/com.vmware.ICbase/PDF/vsphere-esxi- vcenter-server-50-basics-guide.pdf • vCenter Server and Host Management Guide http://pubs.vmware.com/vsphere-50/topic/com.vmware.ICbase/PDF/vsphere-esxi- vcenter-server-501-host-management-guide.pdf • vSphere Storage Guide http://pubs.vmware.com/vsphere-50/topic/com.vmware.ICbase/PDF/vsphere-esxi- vcenter-server-501-storage-guide.pdf Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 46
  • 47. About the authorUdayasuryan Kodoly is a Storage Technology Specialist in IBM Systems and TechnologyGroup (ISV Enablement) Organization. Uday has several years of experience on designing,architecting storage solutions, and developing solution best practices on various NAS and SANappliance data protection (backup) solutions. Uday is an expert on virtualization technologies andvirtual machine data protection strategies. Presently, Uday is working on enabling various ISVbackup, disaster recovery, and virtualization solutions for IBM SONAS and IBM Storwize® V7000Unified systems.You can reach Uday at uakodoly@us.ibm.com. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 47
  • 48. Trademarks and special notices© Copyright IBM Corporation 2012.References in this document to IBM products or services do not imply that IBM intends to makethem available in every country.IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of InternationalBusiness Machines Corporation in the United States, other countries, or both. If these and otherIBM trademarked terms are marked on their first occurrence in this information with a trademarksymbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned byIBM at the time this information was published. Such trademarks may also be registered orcommon law trademarks in other countries. A current list of IBM trademarks is available on theWeb at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracleand/or its affiliates.Microsoft, Windows, Windows NT, and the Windows logo are trademarks of MicrosoftCorporation in the United States, other countries, or both.Intel, Intel Inside (logos), MMX, and Pentium are trademarks of Intel Corporation in the UnitedStates, other countries, or both.UNIX is a registered trademark of The Open Group in the United States and other countries.Linux is a trademark of Linus Torvalds in the United States, other countries, or both.INFINIBAND, InfiniBand Trade Association and the INFINIBAND design marks are trademarksand/or service marks of the INFINIBAND Trade Association.Other company, product, or service names may be trademarks or service marks of others.Information is provided "AS IS" without warranty of any kind.All customer examples described are presented as illustrations of how those customers haveused IBM products and the results they may have achieved. Actual environmental costs andperformance characteristics may vary by customer.Information concerning non-IBM products was obtained from a supplier of these products,published announcement material, or other publicly available sources and does not constitute anendorsement of such products by IBM. Sources for non-IBM list prices and performance numbersare taken from publicly available information, including vendor announcements and vendorworldwide homepages. IBM has not tested these products and cannot confirm the accuracy ofperformance, capability, or any other claims related to non-IBM products. Questions on thecapability of non-IBM products should be addressed to the supplier of those products.All statements regarding IBM future direction and intent are subject to change or withdrawalwithout notice, and represent goals and objectives only. Contact your local IBM office or IBMauthorized reseller for the full text of the specific Statement of Direction.Some information addresses anticipated future capabilities. Such information is not intended as adefinitive statement of a commitment to specific levels of performance, function or deliveryschedules with respect to any future products. Such commitments are only made in IBM product Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 48
  • 49. announcements. The information is presented here to communicate IBMs current investment anddevelopment activities as a good faith effort to help with our customers future planning.Performance is based on measurements and projections using standard IBM benchmarks in acontrolled environment. The actual throughput or performance that any user will experience willvary depending upon considerations such as the amount of multiprogramming in the users jobstream, the I/O configuration, the storage configuration, and the workload processed. Therefore,no assurance can be given that an individual user will achieve throughput or performanceimprovements equivalent to the ratios stated here.Photographs shown are of engineering prototypes. Changes may be incorporated in productionmodels.Any references in this information to non-IBM websites are provided for convenience only and donot in any manner serve as an endorsement of those websites. The materials at those websitesare not part of the materials for this IBM product and use of those websites is at your own risk. Intelligent storage management solution using VMware vSphere 5.0 Storage DRS 49