0
Adding Multitenant StorageCapability to the illumos Kernel   Richard Elling and Garrett D’Amore
Agenda       •           Why multitenancy?       •           Survey of available technologies       •           OS virtual...
Why Multitenancy?February 24 2012     Presented at the SCALE 11x Conference
Userland Process                Userland Process                   Kernel                Device Driver                   S...
Strike up the band!February 24 2012     Presented at the SCALE 11x Conference
Guest                                         Userland Process                       Kernel               Device Driver   ...
Java                                          Java Application                      JVM                          APIs     ...
Guest                                                     Userland Process                   Userland       Kernel        ...
Userland Process                   HVM                   Guest                                        I/O Proxy           ...
Userland Process                   DomU             Device Driver                                  Front-end driver       ...
Userland Process                Userland Process                   Kernel                Device Driver    Return to simple...
Zone                                   Zone                   Userland Process                   Userland Process         ...
Jail                                          Userland Process                                      Directory             ...
Zone                                          Userland Process                                                            ...
The first thing we do, let’s kill all the lawyers                                                           King Henry VI ...
The first thing we do, let’s kill all the lawyers                                                           King Henry VI ...
Zone                                    Zone                   Userland Process                   Userland Process        ...
Kernel                                                 Zone A                                                          Zon...
Global state ➾ Per-zone state    NFS - rpc now zoned  SMB - in-kernel, multithreaded, zonediSCSI - per-zone block devicesF...
Zone                             VM                          NFS                                        NFS               ...
Kernel                                                Zone A                                                         Zone ...
Zone                                                                                Zone                   NFS            ...
Zone A                                          Resource caps                                          Network usage      ...
All in due time?February 24 2012   Presented at the SCALE 11x Conference
Tenant A                   Tree AB                                                             Domain A                   ...
Summary       • Efficient, multitenant storage in illumos       • Sit out of the traditional VM dance       • OS virtualiz...
www.illumos.org                                www.dey-sys.com                       www.RichardElling.com                ...
Adding Multitenant StorageCapability to the illumos Kernel      Richard.Elling@dey-sys.com     Garrett.D’Amore@dey-sys.com
Upcoming SlideShare
Loading in...5
×

Multitenant storage-scale11x

644

Published on

Adding multitenant storage capability to the illumos kernel

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
644
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
21
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Multitenant storage-scale11x"

  1. 1. Adding Multitenant StorageCapability to the illumos Kernel Richard Elling and Garrett D’Amore
  2. 2. Agenda • Why multitenancy? • Survey of available technologies • OS virtualization • Multitenant storage services in illumosFebruary 24 2012 Presented at the SCALE 11x Conference
  3. 3. Why Multitenancy?February 24 2012 Presented at the SCALE 11x Conference
  4. 4. Userland Process Userland Process Kernel Device Driver Simple model: multitasking OSFebruary 24 2012 Presented at the SCALE 11x Conference
  5. 5. Strike up the band!February 24 2012 Presented at the SCALE 11x Conference
  6. 6. Guest Userland Process Kernel Device Driver Hypervisor Device Driver Native Hypervisor ModelExamples: VMware ESX, XenServer, KVMFebruary 24 2012 Presented at the SCALE 11x Conference
  7. 7. Java Java Application JVM APIs OS Device DriverJava Virtual Machines are Virtual Machines, too February 24 2012 Presented at the SCALE 11x Conference
  8. 8. Guest Userland Process Userland Kernel Device Driver Process Hypervisor Device Driver Kernel Device Driver Hosted Hypervisor ModelExamples: VMware Workstation, VirtualBoxFebruary 24 2012 Presented at the SCALE 11x Conference
  9. 9. Userland Process HVM Guest I/O Proxy OS Device Driver QEMU Host OS Device Driver KVMFebruary 24 2012 Presented at the SCALE 11x Conference
  10. 10. Userland Process DomU Device Driver Front-end driver Back-end driver Dom0 Userland I/O Proxy Device Driver XenServerFebruary 24 2012 Presented at the SCALE 11x Conference
  11. 11. Userland Process Userland Process Kernel Device Driver Return to simple model: multitasking OSFebruary 24 2012 Presented at the SCALE 11x Conference
  12. 12. Zone Zone Userland Process Userland Process Device Driver KernelFebruary 24 2012 Presented at the SCALE 11x Conference
  13. 13. Jail Userland Process Directory structure IP Address BSD File system Kernel Storage Device Drivers NIC Driver BSD JailsFebruary 24 2012 Presented at the SCALE 11x Conference
  14. 14. Zone Userland Process TCP/IP File system Virtual NIC Kernel Classification Engine Storage Device Drivers NIC Driver illumos OSFebruary 24 2012 Presented at the SCALE 11x Conference
  15. 15. The first thing we do, let’s kill all the lawyers King Henry VI Act IV, Scene IIFebruary 24 2012 Presented at the SCALE 11x Conference
  16. 16. The first thing we do, let’s kill all the lawyers King Henry VI Act IV, Scene IIThe first thing we do, let’s kill all the layers UNIX Performance GurusFebruary 24 2012 Presented at the SCALE 11x Conference
  17. 17. Zone Zone Userland Process Userland Process Device Driver KernelFebruary 24 2012 Presented at the SCALE 11x Conference
  18. 18. Kernel Zone A Zone B NFS SMB NFS iSCSI TCP/IP TCP/IPFile system File system File system Block device Virtual NIC Virtual NIC Transactional Object Store Virtual and Data Management Unit Switch Storage Device Drivers NIC Driver February 24 2012 Presented at the SCALE 11x Conference
  19. 19. Global state ➾ Per-zone state NFS - rpc now zoned SMB - in-kernel, multithreaded, zonediSCSI - per-zone block devicesFebruary 24 2012 Presented at the SCALE 11x Conference
  20. 20. Zone VM NFS NFS FS Cache Kernel Zone kernel Traditional SMB Hypervisor Zone VM iSCSI Samba FS Cache NFS kernel Adaptive Replacement Cache Big shared caches Inefficient small caches ~ 100 MB/tenant > 1000 MB/tenantFebruary 24 2012 Presented at the SCALE 11x Conference
  21. 21. Kernel Zone A Zone B ANP iSCSI iSCSI TCP/IP TCP/IP New Block deviceAwesome interface? Virtual NIC Virtual NIC New Block Device device Transactional Object Store Virtual and Data Management Unit Switch Storage Device Drivers NIC Driver Deep access to devicesFebruary 24 2012 Presented at the SCALE 11x Conference
  22. 22. Zone Zone NFS iSCSI NFS SMB TCP TCP IP Multipath Group IP Multipath Group Virtual NIC Virtual NIC Virtual NIC Virtual NIC Virtual Switch Virtual Switch Physical NIC Physical NIC Virtual NetworkingFebruary 24 2012 Presented at the SCALE 11x Conference
  23. 23. Zone A Resource caps Network usage I/O usage Zone B All kstats Resource caps Network usage I/O usage Kernel statistics ✦ kstatsFebruary 24 2012 Presented at the SCALE 11x Conference
  24. 24. All in due time?February 24 2012 Presented at the SCALE 11x Conference
  25. 25. Tenant A Tree AB Domain A Tenant B A SMB B SMB Domain B C NFS ✦ SMB Tenant C Domain CFebruary 24 2012 Presented at the SCALE 11x Conference
  26. 26. Summary • Efficient, multitenant storage in illumos • Sit out of the traditional VM dance • OS virtualization rulez!February 24 2012 Presented at the SCALE 11x Conference
  27. 27. www.illumos.org www.dey-sys.com www.RichardElling.com Richard.Elling@dey-sys.com Garrett.D’Amore@dey-sys.comFebruary 24 2012 Presented at the SCALE 11x Conference
  28. 28. Adding Multitenant StorageCapability to the illumos Kernel Richard.Elling@dey-sys.com Garrett.D’Amore@dey-sys.com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×