®




                             ®




Xen Community Update

Ian Pratt,
Citrix Systems and Chairman of Xen.org
Xen Summit Program Committee               ®




Boris Quiroz           Justin Ryan
Anil Madhavapeddy      Tim Mueting
Dan Magenheimer        Hitoshi Matsumoto
Jose Renato Santos     Sang-bum Suh
Hitoshi Oi             Patrick Colp
Pasi Karkkainen


                                  2
Xen Summit Agenda – Day 1                                                                        ®




9:00 – 9:15 Welcome from AMD                   13:30 – 14:00 Case Study: IaaS using XCP and
                                               XAPI
9:15 – 10:00 Xen Community Update
                                               14:00 – 14:30 VastSky – Cluster Storage
10:00- 10:15 Xen Project Update                System for XCP
10:15 – 10:45 BREAK                            14:30 – 15:00 Sheng Liang Building an Infra. as
10:45 – 11:15 AMD, Xen, and Virtual.           a Service Cloud on XCP

11:15 – 11:45 SleepServer System               15:00 – 15:15 BREAK

11:45 – 12:15 Energy-Efficient Storage in VM   15:15 – 15:45 XRM: Event-based Resource
Environments                                   Management Framework for XCP

12:15 – 13:00 LUNCH                            15:45 – 16:15 PVOps Update

13:00 – 13:30 Xen Cloud Platform Project       16:15 – 16:45 Xen Scheduler
Update                                         16:45 – 17:15 PCI Express Support in QEMU


                                                                    3
Event Party                                 ®




Dave and Buster's Party
April 28: 6 – 9 pm
Printed Directions Available
Free Pool / Buffet / Game Card / 3 Drinks
(tickets at door)


                                  4
Xen Summit Agenda – Day 2                                                                        ®




9:30 – 10:00 GoGrid and Xen                     14:15 – 14:45 Fuzzy Control Theory to
                                                Resource Management
10:00 – 10:45 Open Source Cloud Computing
                                                14:45 - 15:15 Update on Transcendent Memory
10:45 – 11:00 BREAK                             in Xen
11:00 - 11:30 Supporting Soft-Real Time Tasks   15:15 - 15:25 BREAK
11:30 – 12:15 Embedded and Communication        15:25 – 15:45 Neon Project
Workloads
                                                15:45 – 16:15 Xenalyze: Analyze Xen Traces
12:15 - 13:00 LUNCH
                                                16:15 – 16:45 Evolving New Configuration Tools
13:00 – 13:30 Graphics Passthrough Challenges   for IOV Network Devices
13:30 – 14:15 Guest NUMA Support                16:45– 17:15 libxenlight
                                                17:15 - 17:30 Closing Presentation - Ian Pratt
Xen.org Events 2010                                    ®




Xen Summit Asia 2010
Seoul, Korea on Nov 2-3
Sponsored by Samsung & Korea University
Xen Directions
South America 2010 in Sao Paulo, Brazil on Aug 31 –
Sept 1
North America 2010 in Boston, MA on Nov 9 as part of
LinuxCon
                                      6
Xen.org Events 2010 Cont'd                                      ®




Xen.org Booth Participation
Citrix Synergy in SF, CA on May 11 – 13
   ●   Zenoss and VMOps in booth
WorldIT Show in Seoul, Korea on May 25 – 28
SouthEast LinuxFest in Spartanburg, SC on June 12 – 13
   ●   Speaking Session on Xen.org
Contact Stephen Spector to support a Xen.org booth at a local
event

                                               7
Outline                 ®




Project Status
New Xen 4.0 Features
Xen Cloud Platform
Xen Client Initiative
The Xen Advisory Board                        ®




Fujitsu and VA Linux joined the Xen Advisor
Board in November 2009, in recognition of
their many contributions to the Xen project
Xen Today                                                  ®




~20% enterprise server market share
>80% of the Public Cloud is Xen based
World's largest virtualization deployments are Xen based
Development Community: over 50 Companies,
25 Universities, from 25 Countries, ~250 developers
More than 20,000 code submissions
Used in Severs, Desktops, Laptops, Storage Appliances,
Network Appliances and Smart Phones
x86, IA64, ARM support
®
Xen Powers the World’s Infrastructure Clouds


                   “   Xen is great. It’s powerful
                       and easy to use. But most
                       important is the very active
                       community around it.

                       That was a very big reason
                       for us in selecting Xen.
  Werner Vogels
 CTO, Amazon.com                          ”
Xen Tops Performance Comparisons                       ®




           “Xen is the Porsche of hypervisors”

            Keith Ward, Virtualization Review




                 “Xen outperforms VMware ESX 3.5
                  by 41% in user scalability tests.”
                                  The Tolly Group
®




                                         Pioneers of
                                     OS Para-virtualization
                    Xen Hypervisor

First and Best to
  support new
 CPU, chipset,
 and Smart IO
 Technologies
®




          ®




Xen 4.0
Xen 4.0                                      ®




Released 12 Apr 2010
Reliability, Availability, Scalability
Enhanced MCA support, blktap2, netchannel2
Memory optimizations
pvops privileged domain support
Fault tolerance for VMs
Hardware Fault Tolerance                                             ®




                                   Restart-HA monitors hosts
     X                             and VMs to keep apps
                                   running


                                    Hardware Fault Tolerance

     X                               with deterministic replay
                                     or checkpointing
Xen’s Software-Implemented Hardware Fault Tolerance enables true
High Availability for unmodified applications and operating systems
Hardware Fault Tolerance                                                            ®




University of British Columbia’s “Remus” project is
now in xen 4.0
Smart checkpointing approach yields excellent
performance
VM executes in parallel with checkpoint transmission, with all externally visible
state changes suppressed until checkpoint receipt acknowledged
Checkpoints delta compressed

Checkpointing possible across wide-area, even for multi-
vCPU guests
SR-IOV                                                               ®




SR-IOV: Single Root IO Virtualization
Virtualization friendly IO devices
High performance, high efficiency, low latency
Enables even the most demanding applications to now be virtualized
Compatible with live relocation via hotplug
World First, demonstrated at Intel Developer Forum in September!
SR-IOV NIC Demonstration                                                                                               ®




                                          Dell 10G Switch

              Dell R710 Server                                                             Dell R710 Server

     XenServer and Intel 10G SR-IOV NIC                                           XenServer and Intel 10G SR-IOV NIC




                                                               NFS Common
                                                            Storage w/OpenFiler
               Dell R710 Server
     XenServer and Intel 10G SR-IOV NIC



Full 20Gb/s bi-directional throughput to VMs
Low latency, High CPU efficiency
Live relocation between hosts - Even hosts with different NICs
Network Performance                                        ®




       201%                             Type-0
                   123%        103%          100%

      s/w only   basic smart   SR-IOV            native
                     NIC        NIC
•
  New Smart NICs reduce CPU overhead substantially
• Care must be taken with SR-IOV NICs to ensure benefits

of VM portability and live relocation are not lost
• Need for an industry standard for “driver plugins”
®




                     ®




Xen Cloud Platform
Xen Cloud Platform (XCP)                                             ®




XCP Expands Xen.org’s scope beyond the core hypervisor, to
create a full virtual infrastructure layer for Cloud deployments
Simplify and streamline use of Xen by Cloud providers and vendors
Promote greater standardisation of components between vendors

Advanced virtual infrastructure to enable Virtual Private
Datacenters rather than just Virtual Private Servers
Multi-tenant hosts, networking, storage, etc
Promote interoperability between xen-based clouds and other clouds
Drive standards activities via DMTF
August 2009 XCP Announcement   ®
®

Where Xen Cloud Platform Fits




        Management API
          & OVF Format
                                        VM
                        VM   VM
                                                        VM
   VM      VM
                               Mgt
                              State     Mgt                  VM
                                        State

                 Mgt
                        Resource Pool                   VM
                State
                                                 Mgt
                                                State
                                                             VM
XCP 0.2                                                           ®




Xen 3.4; Linux 2.6.27; optimized dom0 file system
xapi toolstack
Resource Pools; VM, host, networking and storage management;
snapshots and checkpoints; live and persistent performance
statistics; status alerting; role-based access control; OVF/CIM
support
Windows PV Drivers; Full installer etc.
Open vSwitch
®

New Open vSwitch
     Isolation · Resource control · Multi-tenancy · Visibility · Security

      VM   VM    VM     VM    VM   VM    VM     VM    VM   VM           VM


           Hypervisor              Hypervisor              Hypervisor




 • Open Source Virtual Switch maintained at www.openvswitch.org
 • Rich layer 2 feature set
®

Distributed vSwitch
  Built-in policy-based ACLs move with VMs

    VM   VM    VM     VM           VM       VM        VM       VM                      VM   VM           VM


         Hypervisor                      Hypervisor
                           Virtual Interface (VIF) {MAC, IP} ACLs                           Hypervisor

                           permit tcp 10.0.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain
                           permit tcp 192.168.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain
                           permit tcp 172.16.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain
                           permit udp 10.0.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain
                           permit udp 192.168.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain
                           permit udp 172.16.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain
                           permit tcp 10.0.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq 123



                            Distributed Virtual Switch
®

Distributed vSwitch
  Isolation · Resource control · Multi-tenancy · Visibility · Security

    VM   VM           VM      VM   VM    VM     VM        VM   VM    VM     VM


         Hypervisor                Hypervisor                  Hypervisor




                           Distributed Virtual Switch
                             Distributed Virtual Switch

 Tenant A
 Tenant B
XCP 1.0 Plans                             ®




New Storage Repository plug-ins
For cloud-optimized storage models

libxenlight integration
Enhanced vswitch capabilities
pvops domain0
Better integration of OVF support
Secure boot and attestation
Cloud orchestration and management APIs
Easier complete build environment
®




                        ®




Xen Client Initiative
The Xen Client Initiative                                       ®




Formed in 2007 to develop Xen for desktop and laptop
Develop enhanced power management, USB, WiFi,
WWAN, 3D Graphics, fingerprint reader, multi-touch, etc
Support for latest hardware technologies
Tiny footprint hypervisor, Embeddable in Flash memory or
small disk partition
Aiming to make virtualization ubiquitous on client devices...
Client Hypervisor Benefits                                                    ®




Security, Manageability, Supportability, Auditability
Building Multi-Level Secure systems
Run multiple VMs with policy controlled information flow
    ●   E.g. Personal VM; Corporate VM; VM for web browsing; VM for banking
Trusted hypervisor provides secure isolation

Enables “out-of-band” management and policy enforcement via Service
VMs
Malware detection, remote access, image update, backup, VPN, etc.
ð   Requires a true type-1 hypervisor architecture
ð   Xen is ideally suited to this!
Xen Client Architecture                                      ®




                                  User VM1        User VM2
          Control     Service
          Domain        VM




                                 Xen Hypervisor

           Audio    USB    GPU                        TXT


            Disk    ACPI   NIC
                                 x86 Hardware         TPM
“Business” & “Personal” Environments                      ®




          Busin                      Personal
          ess




 • Locked Down                Allows Local App Installs
 • No Local App Installs      Minimal Management
 • Tightly Managed            Virus Scanner
   • Self-Service Corporate   Security Patches
     App Installs
                              No SLA
                              Self-Service Wipe
Conclusions                                              ®




The Xen Community continues to grow from strength
to strength
Xen’s architecture makes it #1 in security, with great
performance
From Cloud to Client
Xen.org’s role is broadening to develop whole
reference platforms, promote standards, interopability

Xen community update

  • 1.
    ® ® Xen Community Update Ian Pratt, Citrix Systems and Chairman of Xen.org
  • 2.
    Xen Summit ProgramCommittee ® Boris Quiroz Justin Ryan Anil Madhavapeddy Tim Mueting Dan Magenheimer Hitoshi Matsumoto Jose Renato Santos Sang-bum Suh Hitoshi Oi Patrick Colp Pasi Karkkainen 2
  • 3.
    Xen Summit Agenda– Day 1 ® 9:00 – 9:15 Welcome from AMD 13:30 – 14:00 Case Study: IaaS using XCP and XAPI 9:15 – 10:00 Xen Community Update 14:00 – 14:30 VastSky – Cluster Storage 10:00- 10:15 Xen Project Update System for XCP 10:15 – 10:45 BREAK 14:30 – 15:00 Sheng Liang Building an Infra. as 10:45 – 11:15 AMD, Xen, and Virtual. a Service Cloud on XCP 11:15 – 11:45 SleepServer System 15:00 – 15:15 BREAK 11:45 – 12:15 Energy-Efficient Storage in VM 15:15 – 15:45 XRM: Event-based Resource Environments Management Framework for XCP 12:15 – 13:00 LUNCH 15:45 – 16:15 PVOps Update 13:00 – 13:30 Xen Cloud Platform Project 16:15 – 16:45 Xen Scheduler Update 16:45 – 17:15 PCI Express Support in QEMU 3
  • 4.
    Event Party ® Dave and Buster's Party April 28: 6 – 9 pm Printed Directions Available Free Pool / Buffet / Game Card / 3 Drinks (tickets at door) 4
  • 5.
    Xen Summit Agenda– Day 2 ® 9:30 – 10:00 GoGrid and Xen 14:15 – 14:45 Fuzzy Control Theory to Resource Management 10:00 – 10:45 Open Source Cloud Computing 14:45 - 15:15 Update on Transcendent Memory 10:45 – 11:00 BREAK in Xen 11:00 - 11:30 Supporting Soft-Real Time Tasks 15:15 - 15:25 BREAK 11:30 – 12:15 Embedded and Communication 15:25 – 15:45 Neon Project Workloads 15:45 – 16:15 Xenalyze: Analyze Xen Traces 12:15 - 13:00 LUNCH 16:15 – 16:45 Evolving New Configuration Tools 13:00 – 13:30 Graphics Passthrough Challenges for IOV Network Devices 13:30 – 14:15 Guest NUMA Support 16:45– 17:15 libxenlight 17:15 - 17:30 Closing Presentation - Ian Pratt
  • 6.
    Xen.org Events 2010 ® Xen Summit Asia 2010 Seoul, Korea on Nov 2-3 Sponsored by Samsung & Korea University Xen Directions South America 2010 in Sao Paulo, Brazil on Aug 31 – Sept 1 North America 2010 in Boston, MA on Nov 9 as part of LinuxCon 6
  • 7.
    Xen.org Events 2010Cont'd ® Xen.org Booth Participation Citrix Synergy in SF, CA on May 11 – 13 ● Zenoss and VMOps in booth WorldIT Show in Seoul, Korea on May 25 – 28 SouthEast LinuxFest in Spartanburg, SC on June 12 – 13 ● Speaking Session on Xen.org Contact Stephen Spector to support a Xen.org booth at a local event 7
  • 8.
    Outline ® Project Status New Xen 4.0 Features Xen Cloud Platform Xen Client Initiative
  • 9.
    The Xen AdvisoryBoard ® Fujitsu and VA Linux joined the Xen Advisor Board in November 2009, in recognition of their many contributions to the Xen project
  • 10.
    Xen Today ® ~20% enterprise server market share >80% of the Public Cloud is Xen based World's largest virtualization deployments are Xen based Development Community: over 50 Companies, 25 Universities, from 25 Countries, ~250 developers More than 20,000 code submissions Used in Severs, Desktops, Laptops, Storage Appliances, Network Appliances and Smart Phones x86, IA64, ARM support
  • 11.
    ® Xen Powers theWorld’s Infrastructure Clouds “ Xen is great. It’s powerful and easy to use. But most important is the very active community around it. That was a very big reason for us in selecting Xen. Werner Vogels CTO, Amazon.com ”
  • 12.
    Xen Tops PerformanceComparisons ® “Xen is the Porsche of hypervisors” Keith Ward, Virtualization Review “Xen outperforms VMware ESX 3.5 by 41% in user scalability tests.” The Tolly Group
  • 13.
    ® Pioneers of OS Para-virtualization Xen Hypervisor First and Best to support new CPU, chipset, and Smart IO Technologies
  • 14.
    ® ® Xen 4.0
  • 15.
    Xen 4.0 ® Released 12 Apr 2010 Reliability, Availability, Scalability Enhanced MCA support, blktap2, netchannel2 Memory optimizations pvops privileged domain support Fault tolerance for VMs
  • 16.
    Hardware Fault Tolerance ® Restart-HA monitors hosts X and VMs to keep apps running Hardware Fault Tolerance X with deterministic replay or checkpointing Xen’s Software-Implemented Hardware Fault Tolerance enables true High Availability for unmodified applications and operating systems
  • 17.
    Hardware Fault Tolerance ® University of British Columbia’s “Remus” project is now in xen 4.0 Smart checkpointing approach yields excellent performance VM executes in parallel with checkpoint transmission, with all externally visible state changes suppressed until checkpoint receipt acknowledged Checkpoints delta compressed Checkpointing possible across wide-area, even for multi- vCPU guests
  • 18.
    SR-IOV ® SR-IOV: Single Root IO Virtualization Virtualization friendly IO devices High performance, high efficiency, low latency Enables even the most demanding applications to now be virtualized Compatible with live relocation via hotplug World First, demonstrated at Intel Developer Forum in September!
  • 19.
    SR-IOV NIC Demonstration ® Dell 10G Switch Dell R710 Server Dell R710 Server XenServer and Intel 10G SR-IOV NIC XenServer and Intel 10G SR-IOV NIC NFS Common Storage w/OpenFiler Dell R710 Server XenServer and Intel 10G SR-IOV NIC Full 20Gb/s bi-directional throughput to VMs Low latency, High CPU efficiency Live relocation between hosts - Even hosts with different NICs
  • 20.
    Network Performance ® 201% Type-0 123% 103% 100% s/w only basic smart SR-IOV native NIC NIC • New Smart NICs reduce CPU overhead substantially • Care must be taken with SR-IOV NICs to ensure benefits of VM portability and live relocation are not lost • Need for an industry standard for “driver plugins”
  • 21.
    ® ® Xen Cloud Platform
  • 22.
    Xen Cloud Platform(XCP) ® XCP Expands Xen.org’s scope beyond the core hypervisor, to create a full virtual infrastructure layer for Cloud deployments Simplify and streamline use of Xen by Cloud providers and vendors Promote greater standardisation of components between vendors Advanced virtual infrastructure to enable Virtual Private Datacenters rather than just Virtual Private Servers Multi-tenant hosts, networking, storage, etc Promote interoperability between xen-based clouds and other clouds Drive standards activities via DMTF
  • 23.
    August 2009 XCPAnnouncement ®
  • 24.
    ® Where Xen CloudPlatform Fits Management API & OVF Format VM VM VM VM VM VM Mgt State Mgt VM State Mgt Resource Pool VM State Mgt State VM
  • 25.
    XCP 0.2 ® Xen 3.4; Linux 2.6.27; optimized dom0 file system xapi toolstack Resource Pools; VM, host, networking and storage management; snapshots and checkpoints; live and persistent performance statistics; status alerting; role-based access control; OVF/CIM support Windows PV Drivers; Full installer etc. Open vSwitch
  • 26.
    ® New Open vSwitch Isolation · Resource control · Multi-tenancy · Visibility · Security VM VM VM VM VM VM VM VM VM VM VM Hypervisor Hypervisor Hypervisor • Open Source Virtual Switch maintained at www.openvswitch.org • Rich layer 2 feature set
  • 27.
    ® Distributed vSwitch Built-in policy-based ACLs move with VMs VM VM VM VM VM VM VM VM VM VM VM Hypervisor Hypervisor Virtual Interface (VIF) {MAC, IP} ACLs Hypervisor permit tcp 10.0.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain permit tcp 192.168.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain permit tcp 172.16.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain permit udp 10.0.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain permit udp 192.168.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain permit udp 172.16.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq domain permit tcp 10.0.0.0 0.0.0.255 10.20.0.0 0.0.0.255 eq 123 Distributed Virtual Switch
  • 28.
    ® Distributed vSwitch Isolation · Resource control · Multi-tenancy · Visibility · Security VM VM VM VM VM VM VM VM VM VM VM Hypervisor Hypervisor Hypervisor Distributed Virtual Switch Distributed Virtual Switch Tenant A Tenant B
  • 29.
    XCP 1.0 Plans ® New Storage Repository plug-ins For cloud-optimized storage models libxenlight integration Enhanced vswitch capabilities pvops domain0 Better integration of OVF support Secure boot and attestation Cloud orchestration and management APIs Easier complete build environment
  • 30.
    ® ® Xen Client Initiative
  • 31.
    The Xen ClientInitiative ® Formed in 2007 to develop Xen for desktop and laptop Develop enhanced power management, USB, WiFi, WWAN, 3D Graphics, fingerprint reader, multi-touch, etc Support for latest hardware technologies Tiny footprint hypervisor, Embeddable in Flash memory or small disk partition Aiming to make virtualization ubiquitous on client devices...
  • 32.
    Client Hypervisor Benefits ® Security, Manageability, Supportability, Auditability Building Multi-Level Secure systems Run multiple VMs with policy controlled information flow ● E.g. Personal VM; Corporate VM; VM for web browsing; VM for banking Trusted hypervisor provides secure isolation Enables “out-of-band” management and policy enforcement via Service VMs Malware detection, remote access, image update, backup, VPN, etc. ð Requires a true type-1 hypervisor architecture ð Xen is ideally suited to this!
  • 33.
    Xen Client Architecture ® User VM1 User VM2 Control Service Domain VM Xen Hypervisor Audio USB GPU TXT Disk ACPI NIC x86 Hardware TPM
  • 34.
    “Business” & “Personal”Environments ® Busin Personal ess • Locked Down Allows Local App Installs • No Local App Installs Minimal Management • Tightly Managed Virus Scanner • Self-Service Corporate Security Patches App Installs No SLA Self-Service Wipe
  • 35.
    Conclusions ® The Xen Community continues to grow from strength to strength Xen’s architecture makes it #1 in security, with great performance From Cloud to Client Xen.org’s role is broadening to develop whole reference platforms, promote standards, interopability