0
Link Virtualizationbased on XenShinHyoung Lee, Chuck Yooshlee@os.korea.ac.kr,hxy@os.korea.ac.krSponsored by:              ...
ContentsIntroduction                              Bandwidth Isolation   Future Internet   Virtual Network               We...
introductionThe Future Internet   Requirement      Various network protocols can be existed in the Future Internet   Chall...
Virtual NetworkNode Virtualization  Implemented by Router Virtualization  e.g.) XenLink Virtualization  Implemented by NIC...
Example of Virtual NetworkVirtual network for IPv4Virtual network for CCN   Physical network
Performance network virtualizationCannot support over 10Gbps trafficSome virtualization techniques are try to solve  perfo...
SR-IOV Driver          Guest                Guest Domain         Domain 1             Domain 2      SR-IOV minimize I/O  I...
Related Work802.1q vlan  vlan tag in MAC header
Related Work (cont.)Vrouter at Lancaster University   Virtualized router based on Xen   Control plane is placed in guest d...
Related Work (cont.)Trellis   Container based virtualization   Use Ethernet over GRE tunneling   Hard to guarantee network...
Link VirtualizationConnect between Virtual Nodes through virtualized  NICNetwork Isolation  Node that is member of a virtu...
Network Isolation802.1q vlan  vlan tag is placed in MAC header and it cannot deliver across the    node that do not suppor...
MAC-in-UDP TunnelingWe use SR-IOV for performance   SR-IOV NIC support 5-tuple filter       Source/destination IP address,...
Mac-in-UDP Tunneling (cont.)Encapsulation/decapsulation is done in guest domain  Driver domain do not process the packets ...
vARPARP – matching between MAC address and IP addressvARP – matching between virtual network MAC  address and physical net...
vARP flow       Source Node                         Next Hop                   Destination Node  vARP req.                ...
Bandwidth IsolationIt is possible that many virtual networks share one   physical network  Many virtual networks share phy...
Bandwidth Isolation Structure                    Driver Domain                             Call BIC function using timerRe...
Policy of sharing physical bandwidthWeight Based ControlBandwidth Based Control with priority
Weight Based ControlEach virtual machines assign weightVirtual machines are send as assigned weightExample (Total 1Gbps)  ...
Bandwidth Based Control with priorityEach virtual machines assign bandwidthVirtual machines cannot send more data than ass...
Performance EvaluationPhysical machine environment   Intel XEON X5650 (2.67GHz, 6-cores) * 2   12GB physical memory   Inte...
Tunneling OverheadWe compare PV model and SR-IOV modelFlow of packets are different               PV Model            SR-I...
Tunneling Overhead400,000                               700,000                                      600,000300,000       ...
Weight Based Control Performance   Weight            BW (Mbps)               RatioVM1:VM2:VM3   VM1   VM2    VM3    total ...
Bandwidth Based Control Performance  Assigned Bandwidth   Priority   Measured Bandwidth (Mbps)  VM1:VM2:VM3 VM1:VM2:VM3   ...
Link Virtualization Performance 10.0.0.20   10.0.0.20   10.0.0.20   10.0.0.21   10.0.0.21   10.0.0.21  Vid 80      Vid 90 ...
Link Virtualization with Weight Based         Control Performance   Weight            BW (Mbps)              RatioVM1:VM2:...
Link Virtualization with Bandwidth Based          Control Performance   Bandwidth        Priority          BW (Mbps)  VM1:...
ConclusionNetwork virtualization is the core technology of the future InternetLink virtualization is necessary for network...
THANK YOU
Upcoming SlideShare
Loading in...5
×

Link Virtualization based on Xen

4,062

Published on

We implement link virtualization based on Xen. Link virtualization is a basic building block for network virtualizaiton that allows the co-existence of different Internet protocols. To minimize virtualize overhead, we use SR-IOV with Intel 82576

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
4,062
On Slideshare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
29
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Encapsulation and decapsulation is done in guest domain.If driver domain encapsulate or decapsulate the packets, all packets must prcessed in driver domain.It causes domain switch and lack of performance.So we do encapsulate and decapsulate in guest domain.
  • Transcript of "Link Virtualization based on Xen"

    1. 1. Link Virtualizationbased on XenShinHyoung Lee, Chuck Yooshlee@os.korea.ac.kr,hxy@os.korea.ac.krSponsored by: &
    2. 2. ContentsIntroduction Bandwidth Isolation Future Internet Virtual Network Weight Based Control Link Virtualization Bandwidth Based Control withRelated Works Priority 802.1q Performance Evaluation VRouter Trellis Network Isolation GENI and FIRE Bandwidth IsolationNetwork Isolation Virtual Link MAC-in-UDP tunneling vARP Conclusion
    3. 3. introductionThe Future Internet Requirement Various network protocols can be existed in the Future Internet Challenge How to isolate different networksNetwork Virtualization is a good solution Virtualization layer is an innovative substrate for Future Internet allowing multiple virtual networks isolating virtual networks
    4. 4. Virtual NetworkNode Virtualization Implemented by Router Virtualization e.g.) XenLink Virtualization Implemented by NIC Virtualization e.g.) Paravirtualization on Xen, SR-IOV
    5. 5. Example of Virtual NetworkVirtual network for IPv4Virtual network for CCN Physical network
    6. 6. Performance network virtualizationCannot support over 10Gbps trafficSome virtualization techniques are try to solve performance problem Paravirtualization with Xen SR-IOV with PCIeWe use both of them
    7. 7. SR-IOV Driver Guest Guest Domain Domain 1 Domain 2 SR-IOV minimize I/O IOVM virtualization overhead PF VF VF SR-IOV device has physicalXen function (PF) and virtualHW IO MMU / vT-d function (VF) Physical function PF VF VF Use all function of device Switch and Filters Initialize and configure SR-IOV NIC device Virtual function DMA and Message Signal Interrupts Communication directly Initialization and Configuration with domain
    8. 8. Related Work802.1q vlan vlan tag in MAC header
    9. 9. Related Work (cont.)Vrouter at Lancaster University Virtualized router based on Xen Control plane is placed in guest domain Data plane is placed in driver domain because of performance Cannot guarantee network isolation
    10. 10. Related Work (cont.)Trellis Container based virtualization Use Ethernet over GRE tunneling Hard to guarantee network isolationGeni and FIRE No definition of link virtualization Support network and bandwidth isolation indirectly through virtual router resource control
    11. 11. Link VirtualizationConnect between Virtual Nodes through virtualized NICNetwork Isolation Node that is member of a virtual network cannot see other virtual networks packetsBandwidth Isolation Virtual link shared physical link’s bandwidth A virtual link cannot intrude other virtual links’ bandwidth
    12. 12. Network Isolation802.1q vlan vlan tag is placed in MAC header and it cannot deliver across the node that do not support 802.1q Every node must support virtual networkTunneling Encapsulation/decapsulation overhead Not every node must support virtual networkWe choose tunneling Evolution of processing power It is impossible that every node support virtual network
    13. 13. MAC-in-UDP TunnelingWe use SR-IOV for performance SR-IOV NIC support 5-tuple filter Source/destination IP address, source/destination TCP/UDP port number, and protocol We use UDP port number over 50K as virtual network id SR-IOV NIC can filter via virtual network id through hardware Minimize filtering overheadMAC-in-UDP tunneling header Physical Network Virtual Network MAC IP UDP MAC Payload
    14. 14. Mac-in-UDP Tunneling (cont.)Encapsulation/decapsulation is done in guest domain Driver domain do not process the packets Avoid domain switch Minimize performance overheadGuest domain must know all information for tunneling Physical network information MAC, IP and UDP header Virtual network information MAC header
    15. 15. vARPARP – matching between MAC address and IP addressvARP – matching between virtual network MAC address and physical network IP address User input only physical IP address of other side node on virtual link vARP protocol gets physical source/destination MAC address, virtual MAC address automatically
    16. 16. vARP flow Source Node Next Hop Destination Node vARP req. ARP req. … ARP rep. (Physical MAC)vARP rep.(Physical MAC <next hop, himself>) vARP req. vARP rep. (Virtual MAC) VN PN PN VN
    17. 17. Bandwidth IsolationIt is possible that many virtual networks share one physical network Many virtual networks share physical bandwidth Total bandwidth has upper cap by physical linkDriver domain control guest domains sending rate the received packets have already used the network resource the transmission rate is the same as the receive rate of the next node
    18. 18. Bandwidth Isolation Structure Driver Domain Call BIC function using timerRead VF Bandwidth PF BIC Guest Guest Guest Driver Module Domain 1 Domain 2 … Domain n Select transmit enable VF Descriptor Fetch Arbiter Bandwidth Pool 1 Pool 2 Pool n VFTE D D D D D D Statistic Register Register Q Q Q Q … Q Q 0 1 0 1 n-1 n Packet Filter SR-IOV NIC Packet Transmit
    19. 19. Policy of sharing physical bandwidthWeight Based ControlBandwidth Based Control with priority
    20. 20. Weight Based ControlEach virtual machines assign weightVirtual machines are send as assigned weightExample (Total 1Gbps) VM1 VM2 VM3 Weight 1 2 3 166Mbps 333Mbps 500Mps Used BW =1/6Gbps =2/6Gbps =3/6Gbps
    21. 21. Bandwidth Based Control with priorityEach virtual machines assign bandwidthVirtual machines cannot send more data than assigned bandwidthPriority is used when summary of virtual networks bandwidth is more than physical networkTo avoid disconnect virtual link that have low priority, we guarantee minimum bandwidth
    22. 22. Performance EvaluationPhysical machine environment Intel XEON X5650 (2.67GHz, 6-cores) * 2 12GB physical memory Intel 82576 NIC (1Gbps with SR-IOV support)Software environment Xen 4.0 Guest OS Ubuntu 10.04 LTS with Paravirtualization (Kernel ver 2.6.37.1) 4 cores VCPU 2GB memory NIC Igbvf (Intel 82576 VF) 1.1.3 for SR-IOV E1000 (Xen PV NIC model)
    23. 23. Tunneling OverheadWe compare PV model and SR-IOV modelFlow of packets are different PV Model SR-IOV Model
    24. 24. Tunneling Overhead400,000 700,000 600,000300,000 500,000 400,000200,000 300,000 200,000100,000 100,000 0 0 without Link with Link without Link with Link pps Isolation Isolation pps Isolation Isolation Performance of E1000 (PV) Performance of Intel 82576 (SR-IOV)
    25. 25. Weight Based Control Performance Weight BW (Mbps) RatioVM1:VM2:VM3 VM1 VM2 VM3 total VM1:VM2:VM3 NA 314 314 314 942 1:1:1 314 314 314 942 1:1:1 1:1:8 94 94 752 940 1:1:8 1:2:3 157 314 471 942 1:2:3 1:2:4 135 268 538 941 1:1.99:3.99 1:3:3 135 403 403 941 1:2.99:2.99 1:3:6 94 283 565 942 1:3.01:6.01 1:4:5 95 377 471 943 1:3.97:4.96 2:2:3 269 269 403 941 2:2:3 2:3:4 209 314 418 941 2:3:4 3:3:4 283 283 376 942 3:3:3.99
    26. 26. Bandwidth Based Control Performance Assigned Bandwidth Priority Measured Bandwidth (Mbps) VM1:VM2:VM3 VM1:VM2:VM3 VM1 VM2 VM3 total 300:200:100 1:2:3 286 191 95.4 572.4 600:400:200 1:2:3 571 273 95.3 939.3 600:400:200 3:2:1 366 381 191 938 1200:600:300 1:2:3 751 95.4 95.4 941.8
    27. 27. Link Virtualization Performance 10.0.0.20 10.0.0.20 10.0.0.20 10.0.0.21 10.0.0.21 10.0.0.21 Vid 80 Vid 90 Vid 100 Vid 80 Vid 90 Vid 100 10.0.0.10 10.0.0.11 We use 2 physical machines Each physical machine has 3 guest domains (virtual networks)
    28. 28. Link Virtualization with Weight Based Control Performance Weight BW (Mbps) RatioVM1:VM2:VM3 VM1 VM2 VM3 total VM1:VM2:VM3 1:1:1 305 305 305 915 1:1:1 1:1:2 228 229 457 914 1:1:2 1:1:8 92 92 730 914 1:1:7.93 1:2:3 152 305 457 914 1:2.01:3.01 1:2:4 130 261 522 913 1:2.01:4.02 1:3:3 131 392 392 915 1:2.99:2.99 1:3:6 92 274 548 914 1:2.98:5.96 1:4:5 92 366 457 915 1:3.97:4.97 2:2:3 261 261 392 914 2:2:3 2:3:4 203 305 406 914 2:3:4 3:3:4 274 274 366 914 3:3:4.01
    29. 29. Link Virtualization with Bandwidth Based Control Performance Bandwidth Priority BW (Mbps) VM1:VM2:VM3 VM1:VM2:VM3 VM1 VM2 VM3 Total 300:200:100 1:2:3 278 185 92.7 555.7 600:400:200 1:2:3 556 264 92.8 912.8 600:400:200 3:2:1 356 371 185 912 1200:600:300 1:2:3 728 92.8 92.8 913.6
    30. 30. ConclusionNetwork virtualization is the core technology of the future InternetLink virtualization is necessary for network virtualizationWe propose and implement link virtualization on Xen with SR-IOVWe minimize virtualize overhead through Xen and SR- IOV
    31. 31. THANK YOU
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×