Cisco NetApp VMware - Long Distance VMotion

Application Mobility Across Data Centers BRKGENPNL-2104 Joel T. McKelvey - Technical Alliance Manager, NetApp Ravi Neelakant - Technical Alliance Manager, VMware Thomas Scheibe - Director, DC Systems Marketing, Cisco

Agenda
Application Mobility For Business Continuance
Disaster Avoidance (Planned)
Disaster Recovery (Unplanned)
VMware, Cisco, NetApp Joint Validation Overview
Infrastructure Requirements
Joint Validation Results
Feature Compatibility
Future Directions
Q&A

Aspects of Business Continuance
Business Continuance Plan
Procedures and processes needed to successfully keep business applications operational while meeting agreed upon service levels
Personnel and space considerations
Staffing and facilities needed at both points of application workload (both data centers)
Data Center Infrastructure for Business Continuance
Virtual/Physical server
Network Connectivity
Storage capabilities

Application Mobility for Business Continuance
Workload balancing across data centers and clouds
Disaster avoidance
Proactive response to disruptions – mitigates risks of:
Approaching disasters, viz. hurricanes, floods, etc.
Power grid maintenance
Data center maintenance and migrations
Planned events scheduled over a period of time
Achieved with
Cisco Data Center Interconnect (DCI) Solution
NetApp’s FlexCache-enabled Intelligent Storage Arrays
VMware vSphere & VMotion Technologies

What is VMware's VMotion? VMotion TM is a feature of VMware’s ESX servers where a Virtual Machine can be migrated from one ESX Server to another one with no application downtime

Business Continuance with VMotion VMware vCenter Data Center 1 Data Center 2 Data Center Interconnect vSphere Nexus 1000V vSphere Nexus 1000V

Long Distance VMotion
Defined as a VMotion (movement of VM between hosts) over long distance
Requires specialized infrastructure/environment
Can be used to provide Application Mobility for Business Continuance

Disaster Recovery
After the fact reactive response to disasters
Earthquakes, flood
Power grid failures
Catastrophic hardware failures
Adhere to Recovery Time and Point objectives
Achieved with
VMware SRM Technology
NetApp’s SnapMirror
Cisco’s DCI Network

Disaster Recovery with VMware Site Recovery Manager (SRM) Protected Site Recovery Site VirtualCenter Site Recovery Manager VirtualCenter Site Recovery Manager Datastore Groups Datastore Groups Intelligent, Efficient Array Replication

Disaster Recovery with VMware Site Recovery Manager (SRM) Protected Site Recovery Site VirtualCenter Site Recovery Manager VirtualCenter Site Recovery Manager Datastore Groups Datastore Groups X Intelligent, Efficient Array Replication

Agenda
Application Mobility for Business Continuance Overview
Future Directions
Q&A

General Requirements VMotion L2 Domain Elasticity Cisco Catalyst 6500 Series Cisco Nexus 7000 Series Cisco Nexus 7000 Series Storage Attributes and Elasticity IP Routing and IP Service Considerations
Networking
IP Routing & Services
LAN Extension
Storage
Availability across data centers

VMware, Cisco, NetApp Joint Validation
Use Networking (LAN/SAN) technology to simulate a “single DC” environment across data centers so that existing VMotion will continue to work independent of location of source and destination ESX servers
No changes needed to vSphere 4.0 environment
Provide guidance for extending VMotion across data centers including distance and bandwidth requirements
Consider various storage options - from generic to best-of-breed. Focus on mitigation of performance issues between data centers

Agenda
Future Directions
Q&A

VMware VMotion Requirements Network Requirements Storage Requirements ≥ 622 Mbps of bandwidth and ≤ 5 msec latency between ESX Servers The virtual disks of all the VMs are on VMFS/NFS data stores VMs have access to the same IP subnet and broadcast domain on source and destination ESX Servers The VMFS/NFS data store read/write for source and destination

Network Requirements
Extend L2 domain across datacenters – Flat network with single subnet with single broadcast domain, having the following attributes
High Availability – No single point of failure
Load Balancing – Fully utilizing WAN bandwidth between data centers
Spanning Tree Isolation, Network Loop Prevention and Broadcast Storm Avoidance across data centers
Scalability – Ability to move multiple applications and virtual machines
Routing Optimization for VMotion’ed applications – Routing optimizations to reach IP prefixes that have moved
Visibility and Granularity at VM Level – Provide end-to-end consistency from a QoS, security, provisioning and traffic visibility perspective
Optional Services
Encryption – link or packet encryption due to compliance reasons
Hierarchical QoS – for WAN links or for end-end QoS

Network - Cisco’s LAN Extensions Options
Any location / any transport / on demand
Dark Fiber/DWDM
Catalyst 6500 VSS
Nexus 7000 vPC
ONS Crossponder
OTV with Nexus 7000
MPLS
EoMPLS and VPLS (Catalyst 6500/ASR 1000)
OTV with Nexus 7000
IP
Any Transport over GRE (Catalyst 6500/ASR 1000)
OTV with Nexus 7000
L2 L3 IP DC-1 DC-2 Elastic LAN Extensions

Network – LAN Extension with OTV
Built-in loop prevention (no STP)
Failure boundary is preserved
Floods/broadcasts can be suppressed
Seamless adds/removes & multi-homing
Full cross-sectional BW
Equal Cost Multi-Pathing
All-active Multi-homing
Multi-point connectivity
Minimal State
No PW state preserved
Optimal m-cast replication
Point-to-cloud model for improved manageability
IP based Ethernet (L2) VPN solution
MAC routing = control plane MAC learning + packet switching
Core and Site Transparency
Available on Nexus 7000 in 1HCY10
L2 L3

Network - Routing Optimization for Application Mobility
VMotion moves VM between data centers while retaining the same IP and MAC address
Ingress traffic should be routed to new VM location
Egress traffic must be symmetrical to maintain stateful services (firewall)
Options Ingress Traffic Egress Traffic DNS
DNS based solution using GSS/ACE
HSRP Localization/Filtering
ACE L3-One Arm mode, source-NAT
Routing
Detect VM and announce a route
HSRP Localization/Filtering

Network - Routing Optimization with GSS/ACE WAN Data Center 1 Data Center 2 Virtual Machine sql-server.jsmp.cisco.com Access Agg Access Agg Cisco GSS Cluster ACE1 ACE2 Virtual Machine sql-server.jsmp.cisco.com Workflow Integration between vCenter & GSS/ACE notifies GSS/ACE of VM move ESX ESX HSRP Active HSRP Standby HSRP Active HSRP Standby GSS DNS Lookup sql-server.jsmp.cisco.com => ACE 1 IP Address => ACE 2 IP Address GSS DNS Lookup sql-server.jsmp.cisco.com => ACE 2 IP Address => ACE 1 IP Address VMware vCenter

Distributed Virtual Switch – Cisco Nexus 1000V Nexus 1000V VSM vCenter
Cisco Nexus 1000V
Provides existing switching features (QoS, Multicast, ERSPAN, PVLAN)
Provides VM level visibility for provisioning, security, traffic visibility and management
Consistent services
Coordinated, coherent management
vSphere vSphere vSphere Nexus 1000V VM VM VM VM VM VM VM VM VM VM VM VM

Storage Requirements
Core Requirements
Both vSphere hosts need R/W access to same data set
Must maintain data performance at source and destination
Must maintain data availability at the source and destination
Must be VM granular to correspond to Cisco VM granular network
Must be transparent to VMware layer (VM)
Failover must always be within timeout windows
Must handle broad range of split-brain conditions
Must handle sustained loss and resumption of connectivity
Additional Services:
Support the destination location at all times
Disaster Recovery
High efficiency despite multiple locations

Storage Architecture Options

Option 1a – Shared Storage
FibreChannel
FCIP
iSCSI
NFS (NAS)
Cisco MDS 9513 ESX ESX ESX ESX Cisco MDS 9134 Stretched Network <200KM

Option 1b – Storage VMotion & VMotion Cisco MDS 9513 Stretched Network <200KM ESX ESX ESX ESX ESX ESX ESX ESX Cisco MDS 9134 Stretched Network <200KM
FibreChannel
FCIP
iSCSI
NFS (NAS)

Option 2 – Intelligent Data Management VMFS-Site A NFS-Site A VMFS-Site B NFS – Site B Stretched Network <200KM Stretched Network <200KM DCI & NFS ESX ESX ESX ESX ESX ESX ESX ESX

Option 3 – Stretched or Clustered VMFS-Active-Active Stretched Network <200KM Single Logical Array ESX ESX ESX ESX ESX ESX ESX ESX

Storage Architecture Comparison Storage Architectures Shared Storage VMotion Storage VMotion and VMotion Intelligent Data Management for LDVM Stretched or Clustered Storage for LDVM Description Single array visible to both sites using extended SAN or other extended storage network. Storage VMotion to move storage between datastores at different sites. VMotion immediately follows. At each site arrays present identical storage to hosts. Single canonical copy of data at origin. Data cached on non-origin arrays. VM granular. Arrays appear as single logical entity. Data moves and copies coordinated via management plane. Currently not VM granular. Performance over Distance Long distances result in high latency and poor performance. Works over long distances with performance issues during transfer. Supports extremely long distances Very Short (current implementations under 10KM) Storage Requirements Low. Single array. FC, iSCSI, NFS. No specialized storage required. Moderate. Multiple arrays. Storage systems must be present at all sites. Moderate. Multiple arrays. Storage systems must be present at all sites. Caching configured at all sites (zero size until filled). High. Storage systems must be present at all sites. Clustering may add complexity. Coherency and split-brain concerns. Granularity and full migration issues.

Agenda
Future Directions
Q&A

VMotion with Intelligent Data Management Core Data Center 1 OTV VDC SQL Server SQL Server Cisco GSS Cluster Cisco ACE/WAAS Cisco 4900-M Cisco Nexus 5k Cisco 6500 with VSS Cisco Nexus 7K Cisco Nexus N7k Cisco ACE/WAAS Access Aggregation OTV VDC OTV VDC OTV VDC Cisco Nexus 5k Data Center 2 SQL Server WAN SQL Client ~ 200 kms Cisco 6500 with VSS Cisco 6500 with VSS ESX ESX NetApp Storage Volume & FlexCache NetApp Storage Volume & FlexCache VMware vCenter ESX

Joint Validation Test Server and Applications Application Server Configuration Stress Generation Tool Application Performance Metrics Microsoft SQL Server 2005 (64-bit) on vSphere 4.0 CPU : 4 virtual CPUs (vCPUs) Memory : 8 GB Storage : Approximately 300 GB ( NetApp FAS3100 ) OS : Microsoft 2008 64-bit server Dell DVD Store open source benchmark Orders per minute (OPM)

VM Migration Time Across Data Centers Application: Microsoft SQL with more than 11,800 orders per minute

VM Application Performance Less than 3% application performance degradation

Summary of Joint Validation
VMotion up to 200 km distance
Validated Solution Components
VMware vSphere 4
Cisco Nexus 1000 Distributed Virtual Switch
Cisco LAN Extension solution with OTV and Nexus 7000
Cisco ACE/GSS for Routing Optimization and IP Services
NetApp Active-Cached FlexCache Storage

Agenda
Future Directions
Q&A

VMware Long Distance VMotion Feature Compatibility Feature Description VMotion across datacenters Officially Supported as of Sept 2009
ESX Server Support
vSphere 4 or later
Virtual Center
Single Virtual Center Across DCs
Spanned VMware Clusters
Not Supported (use separate on each side) Distance between DC <200 km (5 ms RTT latency) Min Bandwidth between ESX OC12 (622 Mbps) LAN extension Cisco DCI technologies (eg. Catalyst 6500 VSS, Nexus 7000 vPC, OTV on Nexus 7000)
IP Addressing on VM
IP address needs to remain the same across DC (use LAN extension)
Storage extension Stretched SAN/ NFS (eg. WDM /FCIP Cisco technology optionally with Cisco IO Acceleration)
Storage
FlexCache and related technologies fully supported and available today

Best Practice Recommendations
Always have ESX clusters at each site, not spanning sites
Configure a single vCenter managing both sites
Configure HA/DRS clusters on each site – avoid “across sites”
Configure one (or more) vDS across sites
Ensure local storage availability before embarking on stretched use cases
Planned VMotion between sites
If using Option 1b: do Storage VMotion first, compute VMotion next
Network routing and polices needs to be synchronized or adjusted accordingly

Agenda
Future Directions
Q&A

Long Distance VMotion Future Directions
Feature Integration
Make VMware DRS and VMware HA aware of WAN link and “sidedness”
Integrated pre-flight checks
Enhanced Network Support
Elastic LAN extensions with WAN acceleration and support disparate IP networks across very long distances
Enhanced Storage Support
Active/Active storage – with “access anywhere”
Validating stretched single array configurations
Longer Distances
Support > 200km

Application Mobility - Today VMware vCenter Data Center 1 Data Center 2 Data Center Interconnect vSphere Nexus 1000V vSphere Nexus 1000V

Application Mobility - Future Customer Data Center 1 Customer Data Center 2

For More Information
VMware Networking Blog: http://blogs.vmware.com/networking
Virtual Geek Blog: http://virtualgeek.typepad.com
VMware VMotion: http://www.vmware.com/products/vi/vc/vmotion.html
Data Center Interconnect (DCI): http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/white_paper_c11_493718.html
Cisco Nexus 7000 Series Switches: http://www.cisco.com/go/nexus7000
Cisco Nexus 1000V Series Switches: http://www.cisco.com/en/US/products/ps9902/index.html
Cisco ACE, GSS Products:
http://www.cisco.com/en/US/products/hw/contnetw/ps4162/index.html
http://www.cisco.com/en/US/products/ps8361/index.html
http://www.cisco.com/en/US/products/ps6906/index.html
NetApp FlexCache Technology
http://www.netapp.com/us/products/platform-os/flexcache/
FlexCache Architecture Technical Report
http://media.netapp.com/documents/tr-3669.pdf
NetApp Virtualization Blogs
http://blogs.netapp.com/virtualstorageguy/ -- Virtual Storage
http://blogs.netapp.com/virtualization/ -- Virtualization Effect

http://blogs.netapp.com	404
http://www.slideshare.net	103
http://communities.netapp.com	96
http://beta.pantip.com	71
http://netapptips.com	42
http://samgee.pantip.com	24
http://www.techgig.com	7
http://static.slidesharecdn.com	3
http://www.cisco-club.com.cn	2
http://ig.gmodules.com	1
http://translate.googleusercontent.com	1
http://feeds2.feedburner.com	1
https://communities.netapp.com	1

Cisco NetApp VMware - Long Distance VMotion

by NetApp Virtualization Team

Accessibility

Categories

Upload Details

Usage Rights

13 Embeds 756

Statistics

Cisco NetApp VMware - Long Distance VMotion Presentation Transcript