Your SlideShare is downloading. ×
0
Large-scale Virtualization in the Emulab Network Testbed Mike Hibler,  Robert Ricci, Leigh Stoller Jonathon Duerig Shashi ...
Contents <ul><li>Introduction </li></ul><ul><li>Motivation </li></ul><ul><li>Key techniques </li></ul><ul><li>Results </li...
Introduction <ul><li>Testbed is more realistic than simulation </li></ul><ul><ul><li>Experimenters can use real OS, other ...
Motivation <ul><li>Emulab is not scale </li></ul><ul><ul><li>Too small </li></ul></ul><ul><ul><li>Inefficient </li></ul></...
Three Goals <ul><li>Application  transparency </li></ul><ul><ul><li>Real application on virtual machines </li></ul></ul><u...
Key techniques <ul><li>Virtualization technology </li></ul><ul><ul><li>Host and network </li></ul></ul><ul><li>Resource ma...
Virtualization <ul><li>Extending FreeBSD jail </li></ul><ul><ul><li>Namespace isolation </li></ul></ul><ul><ul><li>Virtual...
Virtualization 06/16/10 MMLAB
Mapping <ul><li>Map the virtual topology to a physical topology </li></ul><ul><li>Good mapping </li></ul><ul><ul><li>Pack ...
Mapping quickly <ul><li>Apply a heuristic pre-pass to the virtual graph before running  assign </li></ul><ul><ul><li>Explo...
Mapping quickly 06/16/10 MMLAB 200
Mapping quality 06/16/10 MMLAB
Feedback <ul><li>Do I know how tightly I can pack my virtual nodes? </li></ul><ul><ul><li>No , But we have a  closed, repe...
Results <ul><li>Application fidelity </li></ul><ul><li>Adaptation </li></ul><ul><li>Application transparency </li></ul>06/...
Application Fidelity <ul><li>Setup </li></ul><ul><ul><li>All results gathered on Emulab’s low-end “pc850” machines </li></...
Application Fidelity <ul><li>Application Fidelity </li></ul>06/16/10 MMLAB
Adaptation Results <ul><li>Setup </li></ul><ul><ul><li>Java-based web server on one host with 69 clients </li></ul></ul><u...
Adaptation results <ul><li>Feedback case study </li></ul>06/16/10 MMLAB
Conclusion <ul><li>Virtualization increase Emulab’s capacity </li></ul><ul><ul><li>Transparently </li></ul></ul><ul><ul><l...
Upcoming SlideShare
Loading in...5
×

[ppt]

253

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
253
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Inter-vnode disk space separation Virtual Ethernet interface device
  • Bandwidth, latency, and packet loss
  • Transcript of "[ppt]"

    1. 1. Large-scale Virtualization in the Emulab Network Testbed Mike Hibler, Robert Ricci, Leigh Stoller Jonathon Duerig Shashi Guruprasad, Tim Stack, Kirk Webb, Jay Lepreau Proc. Of the 2008 USENIX Annual Technical Conference Hoon-gyu Choi [email_address] 2008.10.27
    2. 2. Contents <ul><li>Introduction </li></ul><ul><li>Motivation </li></ul><ul><li>Key techniques </li></ul><ul><li>Results </li></ul><ul><li>Conclusion </li></ul>06/16/10 MMLAB
    3. 3. Introduction <ul><li>Testbed is more realistic than simulation </li></ul><ul><ul><li>Experimenters can use real OS, other software, and obtain actual performance measures </li></ul></ul><ul><li>Emulab: Network Testbed </li></ul><ul><ul><li>Provide time- and space-shared public facility </li></ul></ul>06/16/10 MMLAB
    4. 4. Motivation <ul><li>Emulab is not scale </li></ul><ul><ul><li>Too small </li></ul></ul><ul><ul><li>Inefficient </li></ul></ul><ul><ul><ul><li>Original Emulab maps virtual network nodes and links one-to-one onto dedicated PCs and switched Ethernet link </li></ul></ul></ul><ul><li>Solution </li></ul><ul><ul><li>Multiplex logical nodes and networks onto the physical infrastructure </li></ul></ul><ul><ul><li>Use Virtualization to perform network experiments using fewer physical resources </li></ul></ul><ul><ul><li>Should be transparent to applications and should preserves experiment fidelity </li></ul></ul>06/16/10 MMLAB
    5. 5. Three Goals <ul><li>Application transparency </li></ul><ul><ul><li>Real application on virtual machines </li></ul></ul><ul><ul><li>Keep most semantics of unshared machines </li></ul></ul><ul><li>Application fidelity </li></ul><ul><ul><li>Physical results ≈ Virtual results </li></ul></ul><ul><ul><li>Avoid virtual node interference </li></ul></ul><ul><li>System capacity </li></ul><ul><ul><li>Low overhead </li></ul></ul><ul><ul><li>Don’t prolong experiments </li></ul></ul>06/16/10 MMLAB
    6. 6. Key techniques <ul><li>Virtualization technology </li></ul><ul><ul><li>Host and network </li></ul></ul><ul><li>Resource mapping </li></ul><ul><li>Feedback-directed emulation </li></ul>06/16/10 MMLAB
    7. 7. Virtualization <ul><li>Extending FreeBSD jail </li></ul><ul><ul><li>Namespace isolation </li></ul></ul><ul><ul><li>Virtual disks </li></ul></ul><ul><ul><li>Network virtualization </li></ul></ul><ul><ul><ul><li>Ability to bind to multiple interfaces </li></ul></ul></ul><ul><ul><ul><li>New virtual network device (veth) </li></ul></ul></ul><ul><ul><ul><li>Separate routing tables </li></ul></ul></ul>06/16/10 MMLAB
    8. 8. Virtualization 06/16/10 MMLAB
    9. 9. Mapping <ul><li>Map the virtual topology to a physical topology </li></ul><ul><li>Good mapping </li></ul><ul><ul><li>Pack using resources efficiently </li></ul></ul><ul><ul><ul><li>Packs virtual hosts, routers, and links on to a minimum number of physical nodes without overloading the physical nodes </li></ul></ul></ul><ul><ul><li>Do it quickly </li></ul></ul><ul><li>Use assign </li></ul><ul><ul><li>A solver for the Network Testbed Mapping Problem </li></ul></ul><ul><ul><li>Pack both nodes and link </li></ul></ul><ul><ul><li>Use Resource-based Packing </li></ul></ul><ul><ul><ul><li>Avoid scarce resources </li></ul></ul></ul><ul><ul><ul><li>Works well for heterogenious virtual and physical nodes </li></ul></ul></ul>06/16/10 MMLAB
    10. 10. Mapping quickly <ul><li>Apply a heuristic pre-pass to the virtual graph before running assign </li></ul><ul><ul><li>Exploit the structure of the input topology </li></ul></ul><ul><ul><li>Two coarsening algorithms </li></ul></ul><ul><ul><ul><li>Combine all leaf nodes from the same LAN </li></ul></ul></ul><ul><ul><ul><li>Graph partionining </li></ul></ul></ul>06/16/10 MMLAB
    11. 11. Mapping quickly 06/16/10 MMLAB 200
    12. 12. Mapping quality 06/16/10 MMLAB
    13. 13. Feedback <ul><li>Do I know how tightly I can pack my virtual nodes? </li></ul><ul><ul><li>No , But we have a closed, repeatable world </li></ul></ul><ul><li>Process </li></ul><ul><ul><li>Pick a packing </li></ul></ul><ul><ul><li>Run experiment </li></ul></ul><ul><ul><li>Monitor for artifacts </li></ul></ul><ul><ul><ul><li>CPU near 100%, significant paging activity, disk utilization </li></ul></ul></ul><ul><ul><li>Re-pack & Repeat </li></ul></ul><ul><ul><ul><li>Measure resource use </li></ul></ul></ul><ul><ul><ul><li>Feed into resource-based packing </li></ul></ul></ul>06/16/10 MMLAB
    14. 14. Results <ul><li>Application fidelity </li></ul><ul><li>Adaptation </li></ul><ul><li>Application transparency </li></ul>06/16/10 MMLAB
    15. 15. Application Fidelity <ul><li>Setup </li></ul><ul><ul><li>All results gathered on Emulab’s low-end “pc850” machines </li></ul></ul><ul><ul><ul><li>850 MHz PCs with 512MB RAM and four 100Mb Ethernet interfaces </li></ul></ul></ul><ul><ul><li>Uses Pathrate bandwidth measurement tool </li></ul></ul><ul><ul><li>Running p2p file sharing application, Kindex </li></ul></ul><ul><ul><ul><li>Total 60 clients </li></ul></ul></ul><ul><ul><ul><li>Each client </li></ul></ul></ul><ul><ul><ul><ul><li>Uploads a single file’s index, and random searches for other files </li></ul></ul></ul></ul><ul><ul><ul><ul><li>generates 20-40 request per minute </li></ul></ul></ul></ul><ul><ul><li>Network topology consists of six 10Mbps campus LANs </li></ul></ul><ul><ul><ul><li>Each LAN is connected to a router via a 3Mbps </li></ul></ul></ul>06/16/10 MMLAB
    16. 16. Application Fidelity <ul><li>Application Fidelity </li></ul>06/16/10 MMLAB
    17. 17. Adaptation Results <ul><li>Setup </li></ul><ul><ul><li>Java-based web server on one host with 69 clients </li></ul></ul><ul><ul><ul><li>Each clients continually download a 64KB file </li></ul></ul></ul><ul><ul><ul><li>Three different types </li></ul></ul></ul><ul><ul><ul><ul><li>9 clients were evenly spread across 3 links on a single router using 2MB LANs (to emulate cable modems ) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>40 clients were directly connected to a single router using 2MB multiplexed link (to emulate DSL modems ) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>20 clients were directly connected to a single router using 56Kb multiplexed link (to emulate phone modems ) </li></ul></ul></ul></ul>06/16/10 MMLAB
    18. 18. Adaptation results <ul><li>Feedback case study </li></ul>06/16/10 MMLAB
    19. 19. Conclusion <ul><li>Virtualization increase Emulab’s capacity </li></ul><ul><ul><li>Transparently </li></ul></ul><ul><ul><li>Preserves fidelity </li></ul></ul><ul><li>Requires solving several challenging problems </li></ul><ul><li>But, can be useful </li></ul>06/16/10 MMLAB
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×