Hypervisor Selection in CloudStack 4.3
Understanding the choices available
OSCON 2014
Tim Mackey – XenServer Community Man...
© 2014 Citrix.
whoami
Name: Tim Mackey
Current roles: XenServer Community Manager and Evangelist; occasional coder
Cool th...
What are we trying to accomplish?
Building a successful cloud
© 2014 Citrix.
Service Offerings
Clearly define what you want to offer
• What types of applications
• Who has access, and ...
© 2014 Citrix.
Define Tenancy Requirements
Department data local to department
• Where is the application data stored
Data...
© 2014 Citrix.
Virtualization Infrastructure
Hypervisor defined by service offerings
• Don’t select hypervisor based on “s...
Defining the network
© 2014 Citrix.
Flat Network – Basic Layer 3 Network
Option XenServer vSphere KVM LXC Hyper-V
Security Groups Yes- bridge N...
© 2014 Citrix.
VLANs for Private Cloud
Option XenServer vSphere KVM LXC Hyper-V
Max VLANs 800 254 1024 1024 4094
IPv6 No N...
© 2014 Citrix.
Beyond the VLAN – Network Virtualization
Option XenServer vSphere KVM LXC Hyper-V
OVS GRE Yes No No No No
N...
© 2014 Citrix.
Virtual Private Cloud and nTier Applications
Feature XenServer vSphere KVM LXC Hyper-V
PVLAN Yes - ovs Yes ...
© 2014 Citrix.
Delivering specific network services
KVM
• IPv6
• Security groups
• Large quantity of VLANs
vSphere
• VXLAN...
Instances need a home …
Storage, Storage and more Storage
© 2014 Citrix.
Primary Storage Options
Feature XenServer vSphere KVM LXC Hyper-V
Local storage Yes Yes Yes Yes Yes
NFS Yes...
© 2014 Citrix.
Secondary Storage Options
Option XenServer vSphere KVM LXC Hyper-V
NFS Yes Yes Yes Yes No
Swift(1) Yes Yes ...
Core virtualization capabilities
The limits and features which matter
© 2014 Citrix.
CloudStack Features
Feature XenServer vSphere KVM LXC Hyper-V
Disk IO Statistics Yes No Yes No Yes
Memory O...
© 2014 Citrix.
XenServer 6.2
Feature
Source code model Open Source (GPLv2)
Maximum VM Density 650 (Linux)
CloudStack VM De...
© 2014 Citrix.
vSphere 5.5 ( 5.5 support added in ACS 4.3)
Feature
Source code model Proprietary
Maximum VM Density 512
Cl...
© 2014 Citrix.
KVM (RHEL/CentOS 6.5 and Ubuntu 12.04)
Feature
Source code model Open Source (GPLv2)
Maximum VM Density 10 ...
© 2014 Citrix.
Linux Containers
Feature
Source code model Open Source (GPLv2)
Maximum container Density 6000 (theoretical)...
© 2014 Citrix.
Microsoft Hyper-V
Feature
Source code model Proprietary
Maximum VM Density 1024
CloudStack VM Density 1024
...
Picking the “best one”
When to use which hypervisor…
© 2014 Citrix.
KVM
Primary value proposition:
• Low cost with available vendor support
• Familiar administration model
• B...
© 2014 Citrix.
Linux Containers
Primary value proposition:
• Low cost with available vendor support
• Familiar administrat...
© 2014 Citrix.
Microsoft Hyper-V
Primary value proposition:
• Unlimited Windows Server VM licenses
• Familiar Windows mana...
© 2014 Citrix.
vSphere
Primary value proposition:
• Broad application and operating system support with large eco-system o...
© 2014 Citrix.
XenServer
Primary value proposition:
• Low cost with available vendor support
• Broad CloudStack feature se...
© 2014 Citrix.
What About Multiple Hypervisor Support?
Networking
• Ensure network labels match
• Topology is intersect of...
© 2014 Citrix.
Tying it all Together
1. Define success criteria
2. Select a topology which works
3. Decide on storage opti...
© 2014 Citrix.
WORK BETTER. LIVE BETTER.
Upcoming SlideShare
Loading in …5
×

OSCON2014: Understanding Hypervisor Selection in Apache CloudStack

2,370 views

Published on

A presented at OSCON 2014, this deck covers the matrix of capabilities each supported hypervisor brings to the Apache CloudStack table when building a cloud.

0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,370
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
39
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide
  • Notes:
    - VXLAN support requires Linux kernel 3.7 or later with KVM
    Contrial only supported on XenServer due to testing
  • New with 4.3:

    - Quiesed snapshots on vSphere can be performed with “quiese” option for both VM only. Volume only works for both if hardware storage plugin supports feature
    - Queised snapshots on XenServer don’t call XenServer queise API, so quiese snapshots work if the hardware storage plugin supports feature
  • OSCON2014: Understanding Hypervisor Selection in Apache CloudStack

    1. 1. Hypervisor Selection in CloudStack 4.3 Understanding the choices available OSCON 2014 Tim Mackey – XenServer Community Manager and Evangelist
    2. 2. © 2014 Citrix. whoami Name: Tim Mackey Current roles: XenServer Community Manager and Evangelist; occasional coder Cool things I’ve done • Designed laser communication systems • Early designer of retail self-checkout machines • Embedded special relativity algorithms into industrial control system Find me • Twitter: @XenServerArmy • SlideShare: slideshare.net/TimMackey
    3. 3. What are we trying to accomplish? Building a successful cloud
    4. 4. © 2014 Citrix. Service Offerings Clearly define what you want to offer • What types of applications • Who has access, and who owns them • What type of access Define how templates need to be managed • Operating system support • Patching requirements Define expectations around compliance and availability • Who owns backup and monitoring
    5. 5. © 2014 Citrix. Define Tenancy Requirements Department data local to department • Where is the application data stored Data and service isolation • VM migration and host HA • Network services Encryption of PII/PCI • Where do keys live when data location unknown • Need encryption designed for the cloud Showback to stakeholders • More than just usage, compliance and audits
    6. 6. © 2014 Citrix. Virtualization Infrastructure Hypervisor defined by service offerings • Don’t select hypervisor based on “standards” • Understand true costs of virtualization • Multiple hypervisors are “OK” • Bare metal can be a hypervisor To “Pool” resources or not • Is there a real requirement for pooled resources • Can the cloud management solution do better? • Real cost of shared storage Primary storage defined by hypervisor
    7. 7. Defining the network
    8. 8. © 2014 Citrix. Flat Network – Basic Layer 3 Network Option XenServer vSphere KVM LXC Hyper-V Security Groups Yes- bridge No Yes Yes Yes IPv6 No No Yes Yes No Multiple IPs per NIC Yes Yes Yes Yes Yes Nicira NVP Yes No Yes No No BigSwitch VNS Yes No Yes No No 65.11.1.2 65.11.1.3 65.11.1.4 65.11.1.5 Public Network 65.11.0.0/16 Guest VM 1 Guest VM 2 Guest VM 3 Guest VM 4 DHCP, DNS CloudStack Virtual Router Security Group 1 Security Group 2
    9. 9. © 2014 Citrix. VLANs for Private Cloud Option XenServer vSphere KVM LXC Hyper-V Max VLANs 800 254 1024 1024 4094 IPv6 No No Yes Yes No Multiple IPs Yes Yes Yes Yes Yes Nicira NVP Yes No Yes No No BigSwitch VNS Yes No Yes No No MidoKura No No Yes No No VPC Yes Yes Yes No Yes NetScaler Yes Yes Yes No Yes F5 BigIP Yes Yes Yes No Yes Juniper SRX No Yes Yes No Yes Cisco VNMC No Yes No No No 10.1.1.1 10.1.1.3 10.1.1.4 10.1.1.5 Public Network/Internet Guest Virtual Network 10.0.0.0/8 VLAN 100 DHCP, DNS NAT Load Balancing VPN Public IP 65.37.14.1 Gateway 10.1.1.1 Guest VM 1 Guest VM 2 Guest VM 3 Guest VM 4 CloudStack Virtual Router
    10. 10. © 2014 Citrix. Beyond the VLAN – Network Virtualization Option XenServer vSphere KVM LXC Hyper-V OVS GRE Yes No No No No Nicira STT Yes Yes Yes No No MidoNet No No Yes No No VXLAN No Yes Yes No No NVGRE No No No No No Nexus 1000v No Yes No No No Juniper Contrail Yes No No No No Palo Alto Yes Yes Yes No No
    11. 11. © 2014 Citrix. Virtual Private Cloud and nTier Applications Feature XenServer vSphere KVM LXC Hyper-V PVLAN Yes - ovs Yes ovs No No Web App DB Router DC1 DC2 DC3 DC4 DC5 DC6 VLAN 1 VLAN 2 VLAN 3 S2S VPN Private GW
    12. 12. © 2014 Citrix. Delivering specific network services KVM • IPv6 • Security groups • Large quantity of VLANs vSphere • VXLAN required vSphere Enterprise Plus • Cisco Nexus 1000v and ASA 1000v require vSphere Enterprise Plus XenServer • Security groups • Large quantity of VLANs • Juniper Contrail
    13. 13. Instances need a home … Storage, Storage and more Storage
    14. 14. © 2014 Citrix. Primary Storage Options Feature XenServer vSphere KVM LXC Hyper-V Local storage Yes Yes Yes Yes Yes NFS Yes Yes Yes Yes No SMB No No No No SMB3 Single path iSCSI Yes Yes Yes No No Multipath iSCSI PreSetup No No No No Direct array No VAAI No No No Shared Mount No No Yes Yes No Template format VHD OVA QCOW2 TAR VHD SolidFire Plugin Yes Yes Yes No No NetApp Plugin Yes Yes Yes No No Zone wide No Yes Yes No No Ceph RBD No No Yes No No Clustered LVM No No Yes No No Cluster Host Host Primary Storage
    15. 15. © 2014 Citrix. Secondary Storage Options Option XenServer vSphere KVM LXC Hyper-V NFS Yes Yes Yes Yes No Swift(1) Yes Yes Yes Yes No S3 compatible (2) Yes Yes Yes Yes No SMB No No No No Yes (1) Requires NFS staging area (2) Can be region wide, but must not have NFS secondary storage in zone Zone Secondary Storage Pod Cluster Host Host Primary Storage
    16. 16. Core virtualization capabilities The limits and features which matter
    17. 17. © 2014 Citrix. CloudStack Features Feature XenServer vSphere KVM LXC Hyper-V Disk IO Statistics Yes No Yes No Yes Memory Overcommit Yes (4x) Yes No No No Dedicated resources Yes Not with HA/DRS Yes No Yes Disk IO throttling No No Yes Yes No Disk snapshot (running) Yes Yes No No No Disk snapshot (pluggable) Partial Partial No No No Disk snapshot (Stopped) Yes Yes Yes No Yes Memory snapshot Yes Yes Yes No No Zone wide primary storage No Yes Yes Yes No Resize disk Offline Online Grow Online No No High availability CloudStack Native CloudStack No CloudStack CPU sockets 6.2 and higher Yes Yes Host count Yes Affinity groups Yes Yes Yes No Yes
    18. 18. © 2014 Citrix. XenServer 6.2 Feature Source code model Open Source (GPLv2) Maximum VM Density 650 (Linux) CloudStack VM Density 500 CloudStack integration Direct XAPI calls Maximum native cluster size 16 Maximum pRAM 1 TB Largest VM 16vCPU/128GB Windows Operating System All Windows supported by Microsoft Linux Operating Systems RHEL, CentOS, Debian, Ubuntu, SLES, OEL Advanced features supported ovs, Storage XenMotion, DMC
    19. 19. © 2014 Citrix. vSphere 5.5 ( 5.5 support added in ACS 4.3) Feature Source code model Proprietary Maximum VM Density 512 CloudStack VM Density 128 CloudStack integration vCenter Maximum native cluster size 32 Maximum pRAM 4 TB Largest VM 64 vCPU/1TB Windows Operating Systems DOS, All Windows Server/Client Linux Operating Systems Most Advanced features supported HA, DRS, vDS, Storage vMotion
    20. 20. © 2014 Citrix. KVM (RHEL/CentOS 6.5 and Ubuntu 12.04) Feature Source code model Open Source (GPLv2) Maximum VM Density 10 times the number of pCores CloudStack VM Density 50 CloudStack integration CloudStack Agent (libvirt) Maximum native cluster size No native cluster support Maximum pRAM 2 TB Largest VM 160 vCPU/2TB Windows Operating Systems Windows XP and higher Linux Operating Systems Varies Advanced features supported None
    21. 21. © 2014 Citrix. Linux Containers Feature Source code model Open Source (GPLv2) Maximum container Density 6000 (theoretical) CloudStack container Density 50 CloudStack integration CloudStack Agent (libvirt), requires KVM for SVMs Maximum native cluster size N/A Maximum pRAM 2 TB Largest container 2TB Windows Operating Systems N/A Linux Operating Systems Kernel compatible distros
    22. 22. © 2014 Citrix. Microsoft Hyper-V Feature Source code model Proprietary Maximum VM Density 1024 CloudStack VM Density 1024 CloudStack integration CloudStack Agent (C# calling WMI) Maximum native cluster Size 64 Maximum pRAM 4 TB Largest VM 64 vCPU/1TB Windows Operating Systems All Windows supported by Microsoft Linux Operating Systems RHEL, CentOS, Debian, Ubuntu, SLES, OEL Advanced features supported None
    23. 23. Picking the “best one” When to use which hypervisor…
    24. 24. © 2014 Citrix. KVM Primary value proposition: • Low cost with available vendor support • Familiar administration model • Broad CloudStack feature set with active development Cloud use cases: • Dev/test clouds • Web hosting • Tenant density which dictates SDN options Weaknesses: • Requires use of an installed CloudStack libvirt agent • Limited native storage options • No use of advanced native features
    25. 25. © 2014 Citrix. Linux Containers Primary value proposition: • Low cost with available vendor support • Familiar administration model Cloud use cases: • Dev/test clouds • Web application hosting Weaknesses: • Requires use of an installed CloudStack libvirt agent • Requires KVM for system VMs • No use of advanced native features • First introduced in CloudStack 4.2
    26. 26. © 2014 Citrix. Microsoft Hyper-V Primary value proposition: • Unlimited Windows Server VM licenses • Familiar Windows management paradigm Cloud use cases: • Windows and Linux workloads • Dev/test clouds • .Net application web hosting • Desktop as a Service clouds Weaknesses: • Minimal use of advanced native features • First introduced with CloudStack 4.3
    27. 27. © 2014 Citrix. vSphere Primary value proposition: • Broad application and operating system support with large eco-system of partners • Many CloudStack features are native implementations • Direct feature integration via vCenter Cloud use cases: • Private enterprise clouds • Dev/test clouds Weaknesses: • vSphere up-front license and ongoing support costs • vCenter integration requires redundant designs • Single data center per zone model
    28. 28. © 2014 Citrix. XenServer Primary value proposition: • Low cost with available vendor support • Broad CloudStack feature set with active development and large install base • Direct integration via XAPI toolstack Cloud use cases: • Dev/test clouds • Web hosting • Desktop as a Service clouds • Large VM density and secure tenant isolation Weaknesses: • Minimal use of advanced native features
    29. 29. © 2014 Citrix. What About Multiple Hypervisor Support? Networking • Ensure network labels match • Topology is intersect of chosen hypervisors Storage • For system VMs to specific hypervisor type • Zone with primary storage limited Operations • vSphere Datacenter can not span zones • Hyper-V may not be mixed with other hypervisors • HA won’t migrate between hypervisors • Capacity planning at the cluster/pod level more difficult
    30. 30. © 2014 Citrix. Tying it all Together 1. Define success criteria 2. Select a topology which works 3. Decide on storage options 4. Define supported configurations 5. Select preferred hypervisor(s) 6. Validate matrix 7. Build your Cloud
    31. 31. © 2014 Citrix. WORK BETTER. LIVE BETTER.

    ×