Your SlideShare is downloading. ×
XS Oracle 2009 Intro Slides
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

XS Oracle 2009 Intro Slides

716

Published on

Ian Pratt and Keir Fraser Opening to Xen Summit at Oracle 2009

Ian Pratt and Keir Fraser Opening to Xen Summit at Oracle 2009

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
716
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
32
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Welcome & Project Update Ian Pratt Keir Fraser Xen Summit at Oracle Feb 24-25, 2009
  • 2. Attendee Profile 100+ Attendees  8+ Countries  36+ Companies  5+ Universities  Xen Summit at Oracle Feb 24-25, 2009
  • 3. Program Committee Dan Magenheimer – Oracle  Jose Renato Santos – HP  Jun Nakajima - Intel  John Janakiraman – Skytap  Alex Vasilevsky – Virtual Computer  Victor Hugo dos Santos  Sang-bum Suh - Samsung  Hitoshi Matsumoto - Fujitsu  Thanks for putting together a great event! Xen Summit at Oracle Feb 24-25, 2009
  • 4. Event Information • Breakout Room Available During Event • Room 105 • See handout for Wireless Setup • Lunch – Provided for Registered Attendees at Conference Center • Abstracts & Speaker Profiles at http://www.xen.org/community/xensummit.html Xen Summit at Oracle Feb 24-25, 2009
  • 5. Evening Event – Tuesday 6:30 pm – 9:30 pm http://www.computerhistory.org/ • Dinner, Wine, Beer, and Sodas • 2 Guides for Private Museum Tours • Directions at Registration Table • Sign-up Sheet for Carpooling Xen Summit at Oracle Feb 24-25, 2009
  • 6. Xen Summit Gear Xen Summit Jackets  Carabiners for Event Pass  Xen Summit at Oracle Feb 24-25, 2009
  • 7. Agenda Overview - Tuesday 9:30 – 10:00 am Welcome and Project Status 10:00 – 10:30 am Roadmap & Releases 10:50 – 11:10 am Difference Engine 11:10 – 11:40 am PVOPS Status 11:40 – 12:15 pm Transcendent Memory on Xen 1:15 - 1:45 pm Satori: Enlightened Page-Sharing 1:45 – 2:05 pm Paravirtualized USB Support 2:05 – 2:35 pm PCI-Pass Through Techniques 2:35 – 3:05 pm Status of SR-IOV & VT-D 3:30 – 4:00 pm Cross Vendor Migration 4:00 – 4:20 pm Power Management in Xen 4:20 – 4:40 pm Detecting and Correcting Transient Errors via Xen Xen Summit at Oracle Feb 24-25, 2009
  • 8. Agenda Overview - Wed 9:00 – 9:30 am Open Nebula VM Manager 9:30 – 10:00 am Client Virtualization Framework 10:00 – 10:30 am Tralfamadore 10:45 – 11:00 am VM Snapshots 11:00 – 11:30 am Real-time and VMM 11:30 – 12:00 Nested Page Tables 1:00 – 1:30 pm Project Zentific 1:30 – 2:00 pm Just Run It 2:00 – 2:30 pm 3D Rendering on Xen 2:30 – 3:00 pm REFLINK Operation in ocfs2 3:30 – 4:00 pm Achieving 10GB/s Paravirt Drivers 4:00 – 4:30 pm Xen Scalability Xen Summit at Oracle Feb 24-25, 2009
  • 9. Xen Summit Europe at LinuxTAG Xen Summit at Oracle Feb 24-25, 2009
  • 10. Overview • XenEmbedded • XenClient • HostedXen • Xen Introspection API Xen Summit at Oracle Feb 24-25, 2009
  • 11. XenEmbedded • Small footprint Xen environment • For embedding into Servers, Desktops, Laptops, Routers, Storage Arrays • buildroot/busybox/uclibc based • 8MB compressed image size • xenvm/xenops embedded toolstack • Simple configuration file • Process per VM with control socket • Fast booting • See xenbits.xen.org/xenclient Xen Summit at Oracle Feb 24-25, 2009
  • 12. XenClient • Repository for bleeding-edge client related work, feeding in to xen-unstable • Enhanced device pass-through • Intel, ATI, nVidia graphics • Power conservation and suspend • ACPI/SMBIOS virtualization • function keys, battery state, etc • Secure mouse/keyboard routing • Graphics virtualization • Fast boot and measured launch • Enhanced USB emulation • “In-place P2V”, easy to install Xen Summit at Oracle Feb 24-25, 2009
  • 13. Hosted Xen • Xen engine run as a kernel module to enable hosted (type-2) VMM • Runs on Windows and OSX today • Enables Xen to also compete with other type-2 VMMs • KVM, VirtualBox, Parallels, VirtualPC, VMWare Workstation/ACE/Fusion • Looses the security and isolation benefits of a true type-1 hypervisor, but still useful in some scenarios Xen Summit at Oracle Feb 24-25, 2009
  • 14. Hosted Xen • Xen loaded as an ELF module, linked via dispatch table into host kernel • Less than 1000 LOC to plumb Xen module into Windows and OSX • Leverages all of the great feature development, optimization, broad testing that's done on Xen • Latest hardware support, SMP guests, PV drivers etc Xen Summit at Oracle Feb 24-25, 2009
  • 15. Xen Introspection API • API to enable monitoring and control of VMs by a suitably privileged entity • CPU, memory, disk, network, etc • Enables Security, Forensics, Debugging, System Management • Georgia Tech Xen Access library • Accessing memory, pagetable walking • Shadow/HAP enhancements for trap-on access/write/execute • UofAlaska/UC Davis VIX Xen Summit at Oracle Feb 24-25, 2009
  • 16. Observations • Security is becoming increasingly important in virtualization • Xen as a true type-1 is well placed • Must continue disaggregation and de- privileging campaign • Must continue to foster academic research on and using Xen • Community must help turn prototypes into production code Xen Summit at Oracle Feb 24-25, 2009
  • 17. Xen Releases and Roadmap Keir Fraser 02/25/09 17 Xen Summit at Oracle Feb 24-25, 2009
  • 18. Release plans Current stable releases: 3.2.3 and 3.3.1 Both released in early January Next releases: 3.3.2 and 3.4.0 Both anticipated around Easter time Ongoing strategy: Maintain two stable branches until the later one has matured enough for switchover Quarterly releases from stable branches Six to nine months between major releases 02/25/09 18 Xen Summit at Oracle Feb 24-25, 2009
  • 19. Memory management More efficient heap allocators No separate ‘xenheap’ Better ‘malloc’ Populate-on-demand HVM guest memory Boot an HVM guest with a big memory map But no need to allocate it all up front OS won’t use much memory during boot And then balloon driver can claim large swathes 02/25/09 19 Xen Summit at Oracle Feb 24-25, 2009
  • 20. Page sharing Potential for reducing memory pressure by sharing identical pages across VMs Significant savings in ‘ideal’ cases Rather smaller gains in typical heterogeneous scenarios (10-20%) How to find identical pages? Memory scanning vs. disc block tracking Allows memory overcommit Hence requires demand paging Or don’t give spare pages directly back to guests 02/25/09 20 Xen Summit at Oracle Feb 24-25, 2009
  • 21. Virtual block devices: blktap2 Support VHD storage format Snapshot virtual disks Checkpoints, backups, gold images, etc Live coalescing of snapshots Simplified kernel support Leverage blkback Simpler invocation model More generic, easier test and debug 21 Xen Summit at Oracle Feb 24-25, 2009
  • 22. Cross-hypervisor compatibility Viridian interface CPUID, hypercalls Actually turn on just a few optimisations And turn off some annoying checks VHD format support 22 Xen Summit at Oracle Feb 24-25, 2009
  • 23. High availability Detect hardware failures Hardware-based: Machine Check Architecture Software-based: e.g., compare replicas React appropriately… CPU/memory offlining Disable the offending hardware Switch to a ‘hot spare’ UBC’s ongoing Remus project Kemari developed at NTT Japan 23 Xen Summit at Oracle Feb 24-25, 2009
  • 24. Network performance Network virtualisation is particularly hard High packet rates; latency sensitive Existing netfront/back drivers have limitations High cost for packet receive Not designed for next-generation NICs Ongoing work on netchannel2 to address this Lazy copy in the guest (reduces dom0 load) Provide guest a copy-only, sub-page, revocable grant Support multi-queue NICs DMA directly to guest buffers Reusable extensible ring architecture 02/25/09 24 Xen Summit at Oracle Feb 24-25, 2009
  • 25. Security Deprivileged service domains Qemu-dm, pvgrub, … Secure boot Measurement and containment Xen Introspection Project Allow guest state to be monitored and dissected Read memory, registers, etc Callbacks when critical state is modified Virus scanners, test/debug, … 02/25/09 25 Xen Summit at Oracle Feb 24-25, 2009
  • 26. Power management Range timers fuzzy deadlines, allowing batched firing and fewer wakeups Selectable PM policy Admin can choose governor to trade off power vs performance Smarter scheduling Further work is ongoing: George Dunlap, Intel, etc 02/25/09 26 Xen Summit at Oracle Feb 24-25, 2009
  • 27. Managing development Use the developer mailing list xen-devel@lists.xensource.com Requests for comments Announcements of dev plans Patches posted for comment, review and checkin Use the wiki http://wiki.xensource.com/xenwiki/XenRoadMap 27 Xen Summit at Oracle Feb 24-25, 2009
  • 28. Welcome & Project Update Ian Pratt Keir Fraser Xen Summit at Oracle Feb 24-25, 2009 1
  • 29. Attendee Profile 100+ Attendees  8+ Countries  36+ Companies  5+ Universities  Xen Summit at Oracle Feb 24-25, 2009 2
  • 30. Program Committee Dan Magenheimer – Oracle  Jose Renato Santos – HP  Jun Nakajima - Intel  John Janakiraman – Skytap  Alex Vasilevsky – Virtual Computer  Victor Hugo dos Santos  Sang-bum Suh - Samsung  Hitoshi Matsumoto - Fujitsu  Thanks for putting together a great event! Xen Summit at Oracle Feb 24-25, 2009 3
  • 31. Event Information • Breakout Room Available During Event • Room 105 • See handout for Wireless Setup • Lunch – Provided for Registered Attendees at Conference Center • Abstracts & Speaker Profiles at http://www.xen.org/community/xensummit.html Xen Summit at Oracle Feb 24-25, 2009
  • 32. Evening Event – Tuesday 6:30 pm – 9:30 pm http://www.computerhistory.org/ • Dinner, Wine, Beer, and Sodas • 2 Guides for Private Museum Tours • Directions at Registration Table • Sign-up Sheet for Carpooling Xen Summit at Oracle Feb 24-25, 2009
  • 33. Xen Summit Gear Xen Summit Jackets  Carabiners for Event Pass  Xen Summit at Oracle Feb 24-25, 2009 6
  • 34. Agenda Overview - Tuesday 9:30 – 10:00 am Welcome and Project Status 10:00 – 10:30 am Roadmap & Releases 10:50 – 11:10 am Difference Engine 11:10 – 11:40 am PVOPS Status 11:40 – 12:15 pm Transcendent Memory on Xen 1:15 - 1:45 pm Satori: Enlightened Page-Sharing 1:45 – 2:05 pm Paravirtualized USB Support 2:05 – 2:35 pm PCI-Pass Through Techniques 2:35 – 3:05 pm Status of SR-IOV & VT-D 3:30 – 4:00 pm Cross Vendor Migration 4:00 – 4:20 pm Power Management in Xen 4:20 – 4:40 pm Detecting and Correcting Transient Errors via Xen Xen Summit at Oracle Feb 24-25, 2009 7
  • 35. Agenda Overview - Wed 9:00 – 9:30 am Open Nebula VM Manager 9:30 – 10:00 am Client Virtualization Framework 10:00 – 10:30 am Tralfamadore 10:45 – 11:00 am VM Snapshots 11:00 – 11:30 am Real-time and VMM 11:30 – 12:00 Nested Page Tables 1:00 – 1:30 pm Project Zentific 1:30 – 2:00 pm Just Run It 2:00 – 2:30 pm 3D Rendering on Xen 2:30 – 3:00 pm REFLINK Operation in ocfs2 3:30 – 4:00 pm Achieving 10GB/s Paravirt Drivers 4:00 – 4:30 pm Xen Scalability Xen Summit at Oracle Feb 24-25, 2009 8
  • 36. Xen Summit Europe at LinuxTAG Xen Summit at Oracle Feb 24-25, 2009 9
  • 37. Overview • XenEmbedded • XenClient • HostedXen • Xen Introspection API Xen Summit at Oracle Feb 24-25, 2009
  • 38. XenEmbedded • Small footprint Xen environment • For embedding into Servers, Desktops, Laptops, Routers, Storage Arrays • buildroot/busybox/uclibc based • 8MB compressed image size • xenvm/xenops embedded toolstack • Simple configuration file • Process per VM with control socket • Fast booting • See xenbits.xen.org/xenclient Xen Summit at Oracle Feb 24-25, 2009
  • 39. XenClient • Repository for bleeding-edge client related work, feeding in to xen-unstable • Enhanced device pass-through • Intel, ATI, nVidia graphics • Power conservation and suspend • ACPI/SMBIOS virtualization • function keys, battery state, etc • Secure mouse/keyboard routing • Graphics virtualization • Fast boot and measured launch • Enhanced USB emulation • “In-place P2V”, easy to install Xen Summit at Oracle Feb 24-25, 2009
  • 40. Hosted Xen • Xen engine run as a kernel module to enable hosted (type-2) VMM • Runs on Windows and OSX today • Enables Xen to also compete with other type-2 VMMs • KVM, VirtualBox, Parallels, VirtualPC, VMWare Workstation/ACE/Fusion • Looses the security and isolation benefits of a true type-1 hypervisor, but still useful in some scenarios Xen Summit at Oracle Feb 24-25, 2009
  • 41. Hosted Xen • Xen loaded as an ELF module, linked via dispatch table into host kernel • Less than 1000 LOC to plumb Xen module into Windows and OSX • Leverages all of the great feature development, optimization, broad testing that's done on Xen • Latest hardware support, SMP guests, PV drivers etc Xen Summit at Oracle Feb 24-25, 2009
  • 42. Xen Introspection API • API to enable monitoring and control of VMs by a suitably privileged entity • CPU, memory, disk, network, etc • Enables Security, Forensics, Debugging, System Management • Georgia Tech Xen Access library • Accessing memory, pagetable walking • Shadow/HAP enhancements for trap-on access/write/execute • UofAlaska/UC Davis VIX Xen Summit at Oracle Feb 24-25, 2009
  • 43. Observations • Security is becoming increasingly important in virtualization • Xen as a true type-1 is well placed • Must continue disaggregation and de- privileging campaign • Must continue to foster academic research on and using Xen • Community must help turn prototypes into production code Xen Summit at Oracle Feb 24-25, 2009
  • 44. .org Xen Releases and Roadmap Keir Fraser 02/25/09 17 Xen Summit at Oracle Feb 24-25, 2009 17
  • 45. Release plans Current stable releases: 3.2.3 and 3.3.1 Both released in early January Next releases: 3.3.2 and 3.4.0 Both anticipated around Easter time Ongoing strategy: Maintain two stable branches until the later one has matured enough for switchover Quarterly releases from stable branches Six to nine months between major releases 02/25/09 18 Xen Summit at Oracle Feb 24-25, 2009
  • 46. Memory management More efficient heap allocators No separate ‘xenheap’ Better ‘malloc’ Populate-on-demand HVM guest memory Boot an HVM guest with a big memory map But no need to allocate it all up front OS won’t use much memory during boot And then balloon driver can claim large swathes 02/25/09 19 Xen Summit at Oracle Feb 24-25, 2009 Amazon * Mar 1999 HotOS paper on XenoServers * XXX grant application [lessons from the Nemesis experience - the importance of compatibility] [accounting and billing at core (unlike PlanetLab] [speed of light, something fundamental] [struggle for funding] * Aug 2002 Xen development started [pub bet] * [2002 XenoServers project funded] * Oct 2003 SOSP paper quot;Xen and the Art of Virtualizationquot; [could have stopped, interesting platform, keep going to build something real] [Enterprise software is hard, respect for folk that make stuff work] [resource revocation, 24x7 operation, benchmarks] * Apr 2004 Xen 1.0 released * Jun 2004 First Xen developer's meeting at OLS * Nov 2004 Xen 2.0 released * Dec 2004 XenSource formed * working with CPU and IO hardware vendors * RedHat, Novell, Sun adopt Xen in their OSes * Microsoft and VMware adopt paravirtualziation * Sep 2006 XenEnterprise released [Oct 2007 XenSource acquired by Citrix Systems Inc] * May 2008 XenServer 3.2 embedded in flash memory on Dell and HP servers [proud, part of the platform, ubiquitous, back to the 1970's] 19
  • 47. Page sharing Potential for reducing memory pressure by sharing identical pages across VMs Significant savings in ‘ideal’ cases Rather smaller gains in typical heterogeneous scenarios (10-20%) How to find identical pages? Memory scanning vs. disc block tracking Allows memory overcommit Hence requires demand paging Or don’t give spare pages directly back to guests 02/25/09 20 Xen Summit at Oracle Feb 24-25, 2009 Satori – Enlightened guests detect sharing opportunities and give up memory when sharing breaks Difference Engine – all automatic Tmem – a different plan for spare memory
  • 48. Virtual block devices: blktap2 Support VHD storage format Snapshot virtual disks Checkpoints, backups, gold images, etc Live coalescing of snapshots Simplified kernel support Leverage blkback Simpler invocation model More generic, easier test and debug 21 Xen Summit at Oracle Feb 24-25, 2009
  • 49. Cross-hypervisor compatibility Viridian interface CPUID, hypercalls Actually turn on just a few optimisations And turn off some annoying checks VHD format support 22 Xen Summit at Oracle Feb 24-25, 2009
  • 50. High availability Detect hardware failures Hardware-based: Machine Check Architecture Software-based: e.g., compare replicas React appropriately… CPU/memory offlining Disable the offending hardware Switch to a ‘hot spare’ UBC’s ongoing Remus project Kemari developed at NTT Japan 23 Xen Summit at Oracle Feb 24-25, 2009 MCA – AMD, Intel, Sun Replication – John Byrne 23
  • 51. A m a z o n * M a Network performance r 1 Network virtualisation is particularly hard 9 9 High packet rates; latency sensitive 9 Existing netfront/back drivers have limitations H o t High cost for packet receive O S Not designed for next-generation NICs p Ongoing work on netchannel2 to address this a p Lazy copy in the guest (reduces dom0 load) e r Provide guest a copy-only, sub-page, revocable grant o Support multi-queue NICs n X DMA directly to guest buffers e n Reusable extensible ring architecture o S e 02/25/09 24 Xen Summit at Oracle Feb 24-25, 2009 r v e r s * X X X g r a n t a p p l i c a t i o n [ l e s s o n s f r o m t h 24 e
  • 52. Security Deprivileged service domains Qemu-dm, pvgrub, … Secure boot Measurement and containment Xen Introspection Project Allow guest state to be monitored and dissected Read memory, registers, etc Callbacks when critical state is modified Virus scanners, test/debug, … 02/25/09 25 Xen Summit at Oracle Feb 24-25, 2009
  • 53. Power management Range timers fuzzy deadlines, allowing batched firing and fewer wakeups Selectable PM policy Admin can choose governor to trade off power vs performance Smarter scheduling Further work is ongoing: George Dunlap, Intel, etc 02/25/09 26 Xen Summit at Oracle Feb 24-25, 2009
  • 54. Managing development Use the developer mailing list xen-devel@lists.xensource.com Requests for comments Announcements of dev plans Patches posted for comment, review and checkin Use the wiki http://wiki.xensource.com/xenwiki/XenRoadMap 27 Xen Summit at Oracle Feb 24-25, 2009

×