• Like
Virtualization Technology and Directions ( EMC World 2010 )
 

Virtualization Technology and Directions ( EMC World 2010 )

on

  • 792 views

Virtualization Technology and Directions ( EMC World 2010 )

Virtualization Technology and Directions ( EMC World 2010 )

Statistics

Views

Total Views
792
Views on SlideShare
792
Embed Views
0

Actions

Likes
2
Downloads
27
Comments
0

0 Embeds 0

No embeds

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Virtualization Technology and Directions ( EMC World 2010 ) Virtualization Technology and Directions ( EMC World 2010 ) Presentation Transcript

    • Virtualization Technology and Directions David L. Black, Ph.D. Distinguished Engineer© Copyright 2010 EMC Corporation. All rights reserved. 1
    • Roadmap Information Disclaimer EMC makes no representation and undertakes no obligations with regard to product planning information, anticipated product characteristics, performance specifications, or anticipated release dates (collectively, “Roadmap Information”). Roadmap Information is provided by EMC as an accommodation to the recipient solely for purposes of discussion and without intending to be bound thereby. Roadmap information is EMC Restricted Confidential and is provided under the terms, conditions and restrictions defined in the EMC Non- Disclosure Agreement in place with your organization.© Copyright 2010 EMC Corporation. All rights reserved. 2
    • Business Challenges Data growing at 62% annually to 800,000 Petabytes Mandates to reduce OPEX and CAPEX Hardware underutilized or overutilized Reduce power consumption and footprint Faster response to business changes In addition – deal with all of this across multiple data centers Virtualization is not an option, it is a requirement© Copyright 2010 EMC Corporation. All rights reserved. 3
    • Defining Virtualization Virtualization provides logical views of physical resources while preserving the usage interfaces for those resources. Virtualization removes physical resource limits and improves resource utilization.© Copyright 2010 EMC Corporation. All rights reserved. 4
    • Virtualization Comes in Many Forms Virtual Virtual Virtual Memory Servers Servers Each application sees its own Each application sees its own logical logical memory, independent of server, independent of physical physical memory servers Virtual VirtualNetworks Storage Each application sees its own logical Each application sees its own logical network, independent of physical storage, independent of physical network storage© Copyright 2010 EMC Corporation. All rights reserved. 5
    • Virtualization Comes in Many Forms Virtual Memory Physical Memory Each application sees its own logical memory, independent of App physical memory App App Benefits of Virtual Memory Swap Space Remove physical memory limits Run multiple applications at once© Copyright 2010 EMC Corporation. All rights reserved. 6
    • Virtualization Comes in Many Forms Virtual Virtual Virtual Memory Servers Each application sees its own Each application sees its own logical logical memory, independent of server, independent of physical physical memory servers Virtual VirtualNetworks Storage Each application sees its own logical Each application sees its own logical network, independent of physical storage, independent of physical network storage disks© Copyright 2010 EMC Corporation. All rights reserved. 7
    • Virtualization Comes in Many Forms Benefits of Virtual Networks Common network links with access VLAN A VLAN B VLAN C control properties of separate links. Manage logical networks instead of physical networks. Virtual SANs provide similar benefits for storage area networks. VLAN Trunk Virtual Switch SwitchNetworks Each application sees its own logical network, independent of physical network© Copyright 2010 EMC Corporation. All rights reserved. 8
    • Virtual Networks Unify Network Traffic VLANs: different classes of traffic share network – iSCSI, FCoE, NFS, CIFS, web, etc. Ethernet LAN – Unification: Reduce cables, interfaces, etc. Limited interaction among traffic classes – Controls (access and QoS) for each traffic class FCoE switches iSCSI/FCoE Storage Switch A Switch B FC SAN Ethernet Servers FC© Copyright 2010 EMC Corporation. All rights reserved. 9
    • Distributed Virtual Networks: Virtualization across Locations OTV [Overlay Transport Virtualization] (Cisco) Overlay network extends VLANs over arbitrary network connectivity – Works over any WAN type – dark fiber, MPLS, IP – No network architecture change in datacenter – just add OTV edge devices Seamless add/ drop of edge nodes w/o reconfiguring other edge notes Distributed network virtualization – VLANs based on physical network resources across multiple locations Core IP A IP B West East IP C South© Copyright 2010 EMC Corporation. All rights reserved. 10
    • Defining Distributed Virtualization Distributed Virtualization provides logical views of distributed physical resources while preserving the usage interfaces for those resources. Distributed Virtualization removes location barriers and physical resource limits, improving resource utilization.© Copyright 2010 EMC Corporation. All rights reserved. 11
    • OTV Use Case Data Center Growth ConstraintsProblem: Primary data center maxed out (space, cooling and power)Requirement: Seamlessly extend clusters & workload across datacentersChallenge: Rapidly establish network interconnect between data centers Deploy over  One Logical Data Center existing network  4  configuration   commands per site Ethernet Overlay No Re‐design  Automatic Fault  Required Isolation Solution: OTV! • No new transport provisioning required (Dark fiber, MPLS, etc) • Eliminate months of re-design effort • Significant operations and provisioning cost savings© Copyright 2010 EMC Corporation. All rights reserved. 12
    • Flexible Infrastructure Virtual Virtual Virtual Servers Memory Servers Server Virtualization Each application sees its own Each application sees its own logical App logical App App independent of App memory, App App server, independent of physical physical memory OS servers OS OS OS OS OS Virtual Benefits of Virtual Machines VirtualNetworks Storage OS OS Run multiple apps on a single server. OS Increase server utilization. Each application sees its own logical Move applications nondisruptively. Each application sees its own logical network, independent of physical storage, independent of physical . network network. storage.© Copyright 2010 EMC Corporation. All rights reserved. 13
    • Anatomy of a Virtual MachineA complete system encapsulated in a set of software files Unmodified Virtual Machines / Guests Application Server OS Hypervisor (X86) Physical Server Virtual Hardware Virtual Appliance: Virtual Machine stored in one file – Can be used anywhere© Copyright 2010 EMC Corporation. All rights reserved. 14
    • Comparison of Virtual Machine Approaches Multiple virtual machine abstraction layer locations Application Application Virtualization Layer High-Level Operating System Hardware Level Language Level© Copyright 2010 EMC Corporation. All rights reserved. 15
    • Hypervisor Architecture Comparison VMware vSphere Architecture Microsoft Hyper-V / Xen Architecture Thin hypervisor, no general-purpose OS Hypervisor extends general purpose OS I/O subsystem is in hypervisor OS I/O subsystem shared with hypervisor Hypervisor owns resources Resources shared with primary OS Support functions: hypervisor processes OS support functions extended to hypervisor© Copyright 2010 EMC Corporation. All rights reserved. 16
    • Provided by: OS Hyper-V Architecture ISV / IHV / OEM Microsoft Hyper-V Microsoft / XenSource Parent Worker Process Partition = VM “proxy” Child Partitions (management) VM Worker Processes Applications Applications Applications Applications WMI Provider WMI Provider User VM Service VM Service Mode Windows Windows Server Non- Xen-Enabled Server 2008 2003, 2008 Hypervisor Linux Kernel Aware OS Linux Windows Windows Linux Kernel VSP VSP VSC VSC Kernel VSC Device Drivers VMBus Kernel VMBus VMBus Emulation Emulation Hypercall Adapter Hypercall Adapter Mode Windows hypervisor Ring -1 I/O Virtualization and Optimization Server Hardware© Copyright 2010 EMC Corporation. All rights reserved. 17
    • vSphere ESX Server: I/O Virtualization Each Virtual Machine has its own virtual I/O interfaces Network: Virtual NIC with its own MAC address – ESX contains Ethernet switches implemented in software – Actual hardware Ethernet port behaves like a switch port Network operates transparently Storage: Virtual disk controller – ESX maps OS volumes (LUNs) to storage resources – ESX contains a volume manager and a cluster file system (VMFS) Can use storage from many places • SAN, iSCSI, internal storage • NAS - Can store volume as a file Storage operates transparently© Copyright 2010 EMC Corporation. All rights reserved. 18
    • Pooling of Servers, Storage, and NetworkingAggregate and share resources across servers Enterprise Virtualization Benefits Virtual Virtual Machines / Guests Machines • Partition CPU and memory across multiple Virtual ESX Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor Hypervisor Machines Server • Aggregate hardware Server Server Farm resources into unified logical resource pools • Utilize local or Network shared storage Storage© Copyright 2010 EMC Corporation. All rights reserved. 19
    • VMware vNetwork Distributed Switch • Aggregated datacenter level virtual networkingAPP APP APP APP APP APP APP APP APP OS OS OS OS OS OS OS OS OS • Simplified setup and change vSwitch vSwitch vSwitch vNetwork Distributed Switch Cisco Nexus 1000V • Easy troubleshooting, VMware vSphere™ monitoring and debugging • Enables transparent third party management of virtual environments© Copyright 2010 EMC Corporation. All rights reserved. 20
    • VMotionMove Virtual Machines across physical servers – while running Preserve transactional integrity during movement Eliminate downtime and provide continuous service Shift underlying hardware resources dynamically Balance workloads to optimize computing resources© Copyright 2010 EMC Corporation. All rights reserved. 21
    • Storage VMotion • Live migration of virtual machine disk files across storage arrays – Relocate virtual machine disk files across shared storage live using Storage vMotion – Complete transaction integrity – Full GUI administration – Supports NFS, FC and iSCSI • Benefits – Zero-downtime migration – Eases array maintenance – Refresh to new arrays – Migrate to different class of storage Zero-downtime migration – Upgrades, space mgmt – VM granularity, LUN Independent© Copyright 2010 EMC Corporation. All rights reserved. 22
    • Evolution of Server Virtualization Separate Consolidate Aggregate Automate Liberate Test and Server Capacity Self-Managing Computing Clouds On Development Consolidation On Demand Datacenter and Off Premise© Copyright 2010 EMC Corporation. All rights reserved. 23
    • Evolution of Server Virtualization Separate Consolidate Aggregate Automate Liberate Virtual Infrastructure Management Hypervisor Test and Server Capacity Self-Managing Computing Clouds On Development Consolidation On Demand Datacenter and Off Premise© Copyright 2010 EMC Corporation. All rights reserved. 24
    • Capacity on Demand: Rapid ProvisioningWithout VMware Virtualization Locate or Determine purchase Rack and Install/ config Install/ config Boot server spec system(s) cable system OS application system Timeline With VMware Virtualization Determine Choose Choose Boot server spec host template VM Time for other productive tasks system "We can deploy servers in a pinch. With VirtualCenter, it takes 10 minutes. Its absolutely fantastic to be able to deliver a server and have the applications up, have them tested and then put them in production in a matter of four or five hours." -- Robert Buchwald, Technical Lead, Systems Assurance Team, Moen © Copyright 2010 EMC Corporation. All rights reserved. 25
    • Evolution of Server Virtualization Separate Consolidate Aggregate Automate Liberate Automation Virtual Infrastructure Management Hypervisor Test and Server Capacity Self-Managing Computing Clouds On Development Consolidation On Demand Datacenter and Off Premise© Copyright 2010 EMC Corporation. All rights reserved. 26
    • Resource Optimization: DRS & DPM Dynamic and intelligent allocation of hardware resources Distributed Resource Scheduler – Dynamic balancing of computing resources Business Demand across resource pools – Intelligent resource allocation based on predefined rules Distributed Power Management – Dynamic optimization of computing resources – Place unneeded servers into standby mode – Common framework, different set of rules DRS and DPM Customer Impact – Align IT resources with business priorities – Operational simplicity; dramatically increase Resource Pool administrator productivity – Add hardware dynamically to avoid over- provisioning to peak load – Reduce power consumption without reducing service levels© Copyright 2010 EMC Corporation. All rights reserved. 27
    • Evolution of Server Virtualization Separate Consolidate Aggregate Automate Liberate Test and Server Capacity Self-Managing Computing Clouds On Development Consolidation On Demand Datacenter and Off Premise© Copyright 2010 EMC Corporation. All rights reserved. 28
    • Flexible Infrastructure Storage Virtualization: Virtual Virtual Virtual Memory Block Level Servers Benefits of Virtual Storage Nondisruptive data migrations, Each application sees its own Each application sees its own logical logical memory, independent of simplify storage management, and server, independent of physical physical memory increase storage utilization servers Storage IP Network Network Virtual VirtualNetworks Storage Each application sees its own logical Each application sees its own logical network, independent of physical storage, independent of physical network storage© Copyright 2010 EMC Corporation. All rights reserved. 29
    • Storage Virtualization: Centralized Aggregation Inband storage system pools storage resources – Underlying storage systems hidden from servers – Extends useful life of storage assets by creating virtualized storage pools Streamlines storage refreshes, consolidations and migrations within the Storage Pool Data Center Simplifies multi-array storage allocation, provisioning, and tiering via common management Multi-Array Data Center© Copyright 2010 EMC Corporation. All rights reserved. 30
    • Distributed Federation: Distributed Storage VirtualizationEMC VPLEX Technology Federated Information Access: VPLEX Metro “AccessAnywhere” enables geographic data distribution Scale Out Cluster Architecture: Start small and grow big with Access anywhere predictable service levels Distributed Cache Coherency: Load balancing and transparent failover of storage domains within and across Data Centers EMC and non-EMC EMC and non-EMC arrays arrays© Copyright 2010 EMC Corporation. All rights reserved. 31
    • VPLEX System Architecture Site A Site A Site B Site B Distributed Mirroring Active-Active Access A A Aggregation of Storage devices Volume management VPLEX Metro VPLEX Cluster VPLEX Cluster FC Remote Access A A Diskless access to non-local storage Array Failure Protection Local mirroring Heterogeneous Geographically  Distributed Storage Non Disruptive Data Mobility Inter-array migrations© Copyright 2010 EMC Corporation. All rights reserved. 32
    • VPLEX I/O Virtualization Stack Director FE Storage View Virtual volumes are exported out of front- … end ports and exposed to hosts Cache Distributed Coherent Cache Caching leverages local and global cache, maintains consistency between all VPLEX directors Device Virtualization The device virtualization layer creates Virtual Volumes composite devices from storage volumes, providing slicing, striping, concatenation, … and mirroring BE Storage volumes represent claimed Storage Volumes devices from back-end arrays …© Copyright 2010 EMC Corporation. All rights reserved. 33
    • Scale Out Cluster Architecture Centralized Aggregation Distributed Federation + + + + + + Add additional appliances or Larger engine cluster scales out controllers to scale up capacity performance and/or capacity as and/or performance needed Independent virtual storage Storage resources aggregated pools (management) into a single virtual storage pool Workloads isolated within each Workloads dynamically cluster (usually two nodes) distributed across engines© Copyright 2010 EMC Corporation. All rights reserved. 34
    • Scale Out Cluster Architecture: Availability Centralized Aggregation Distributed Federation Dual node Better architecture: predictability Availability in Higher + the event of a availability single node More performance failure Single node failure: lose half of High availability and predictable storage I/O resources performance in the event of a component failure Performance impact can be significant for active storage pools Failover redistributes workloads across all remaining engines Data is unavailable in the event of a dual nodes failure Add additional engines to increase resiliency© Copyright 2010 EMC Corporation. All rights reserved. 35
    • Distributed Cache Coherency: Write Directory based distributed cache coherence efficiently maintains cache state consistency across all Engines Engine Cache Coherency Directory Block Address 1 2 3 4 5 6 7 8 9 10 11 12 13 … Cache ANew Write: Cache C Block 3 Cache E Cache G Cache Directory B Cache Directory D Cache Directory F Cache Directory H Cache Directory A Cache Directory C Cache Directory E Cache Directory G Cache Cache Cache Cache© Copyright 2010 EMC Corporation. All rights reserved. 36
    • Distributed Cache Coherency: Read Directory based distributed cache coherence efficiently maintains cache state consistency across all Engines Engine Cache Coherency Directory Block Address 1 2 3 4 5 6 7 8 9 10 11 12 13 … Cache A Cache C Read: Cache E Block 3 Cache G Cache Directory B Cache Directory D Cache Directory F Cache Directory H Cache Directory A Cache Directory C Cache Directory E Cache Directory G Cache Cache Cache Cache© Copyright 2010 EMC Corporation. All rights reserved. 37
    • Online Workload Migration Site A Site A Site B Site B VMotion over Distance HyperV Live Migration OVM Live Migrator VPLEX Metro VPLEX Cluster VPLEX Cluster Heterogeneous Distributed Storage© Copyright 2010 EMC Corporation. All rights reserved. 38
    • VPLEX Metro Use Case EMC solution VPLEX Metro Share, access, and relocate data between sites over distance VMware VMotion over distance Microsoft SQL, SharePoint, SAP, Oracle ESX Cluster A ESX Cluster B Symmetrix VMAX and CLARiiON CX4 to Vblock Type 1 Nondisruptive migrations and relocations to 100 km Synchronous Access Anywhere Migrate and relocate VMs, applications, and data with support for VMotion over distance Transparently share and balance resources between data centers© Copyright 2010 EMC Corporation. All rights reserved. 39
    • Putting it all Together: Unified Virtualization and The Journey to the Private Cloud© Copyright 2010 EMC Corporation. All rights reserved. 40
    • Key Attributes for Enterprise Virtualization Scalable, high-performance architecture – Infrastructure that grows with the business Supports heterogeneous environments Continuous availability – No single point of failure – Nondisruptive upgrades Disaster recovery Enterprise management – Reduce risk and operational costs Incremental deployment – Easy physical-to-virtual migration – Deploy as problems and opportunities arise© Copyright 2010 EMC Corporation. All rights reserved. 41
    • App Provisioning: Selective Virtualization Install operating systems OS OS Authenticate users or Effect applications OS Online: Allocate server resources Storage IP Set up storage environments Network Network (disk, SAN, or NAS) Effect Configure networks Online: Allocate storage resources – leading reason for forcing systems offlinePoint virtualization technologies Effectcan accomplish near-term goals Online:but create long-term problems.© Copyright 2010 EMC Corporation. All rights reserved. 42
    • App Provisioning: All Resources Virtualized Install operating systems Authenticate users or Effect OS OS applications Online: OS Allocate server resources Set up storage environments Unified Network (disk, SAN, or NAS) Effect Configure networks Online: Allocate storage resources to and from the available pool Effect Online: Virtualization of all resources: continuous online operation.© Copyright 2010 EMC Corporation. All rights reserved. 43
    • A Unified Virtualization Infrastructure Virtual Virtual Networks Servers Each application sees its own logical OS OS OS server, independent of physical servers Unified Network Virtual Storage Each application sees its own logical storage, independent of physical disks© Copyright 2010 EMC Corporation. All rights reserved. 44
    • A Unified Virtualization Infrastructure Virtual Virtual Networks Servers OS Virtual Managing and Securing OS OS Storage Virtualization Consistent models of the entire virtual infrastructure Unified Network Management: Enables end-to-end dynamic provisioning, troubleshooting, and optimization Security: Enables transparent consistent security policy application, monitoring and compliance reporting© Copyright 2010 EMC Corporation. All rights reserved. 45
    • Journey to the Private Cloud Trusted Flexible Control Dynamic Reliable On-demand Secure Efficient Virtualization Virtualized Information Cloud Data Center Computing Security Internal Cloud External Cloud© Copyright 2010 EMC Corporation. All rights reserved. 46
    • Journey to the Private Cloud Private Cloud Federation Virtualization Virtualized Information Cloud Data Center Computing Security Internal Cloud External Cloud© Copyright 2010 EMC Corporation. All rights reserved. 47
    • Journey to the Private Cloud Virtual Client Virtual Client Virtual Client Private Cloud Distributed Virtual App App App App App Virtualization: Applications Loads Loads Loads Loads Loads Foundation for Private Clouds Federation Virtualization Virtualized Information Cloud Data Center Computing Security Internal Cloud External Cloud© Copyright 2010 EMC Corporation. All rights reserved. 48
    • Moving a Virtual Machine over Distance: Distributed Virtualization in Action 4 4 VM Movement Requirements 1. Preserve Shared Storage Access Example: VPLEX 2 Network A Network B 2. Preserve Network Connectivity Example: OTV Site A Site A Site B Site B 3. Move the Virtual Machine VMotion Example: VMotion 3 4. Optimize External Network Access VPLEX  VPLEX Metro VPLEX  Example: DNS based route optimization Cluster Cluster Very useful, not an absolute requirement 1 Distributed Virtualization used to meet first three requirements Heterogeneous Distributed Storage© Copyright 2010 EMC Corporation. All rights reserved. 49
    • Private Cloud: Mobility Vision Non-disruptive movement: Private 1. Any Workload Cloud 2. Any Where 3. Any Time Virtualized Data Center Cloud Computing Reality Check: Can’t repeal the laws of physics – But magic (sufficiently advanced technology) is still possible© Copyright 2010 EMC Corporation. All rights reserved. 50
    • Conclusions and Recommendations Conclusions: – Server, network, and storage virtualization Virtualization benefits increase with extent of deployment – Virtualization can be distributed Virtualization benefits extend across multiple locations – Distributed Virtualization: Key enabler of Private Cloud Enables application mobility among locations Recommendations: – Virtualization is a strategic decision Don’t let short-term tactics disrupt your long-term strategy – Pick your partners wisely – virtualization is not a technology you implement and then remove – it’s around for the long haul Technology, services, and support© Copyright 2010 EMC Corporation. All rights reserved. 51
    • Related EMC World Sessions (selected subset) Server Virtualization – Microsoft Corporation: Microsoft Virtualization - A Technical Look Into Microsoft Hyper-V and Microsoft Systems Center – Vision Into the Future of Desktop Virtualization (VMware) – vSphere vStorage Technologies Unified Virtualization: Mobility – Cisco: Workload Mobility across Data Centers with innovations from VMware, Cisco and EMC – includes Cisco OTV and VMware VMotion across data centers; Unified Networks (storage) – Converged Data Center: FCoE, iSCSI and the Future of Storage Networking VPLEX (sessions TBA)© Copyright 2010 EMC Corporation. All rights reserved. 52