Downloaded 78 times
Uploaded byJason TC HOU (侯宗成)
Valiant Load Balancing and Traffic Oblivious Routing
The document discusses the Valiant Load Balancing (VLB) and Traffic Oblivious Routing (TOR) in data center networks, particularly within the VL2 architecture. It outlines the innovative goals, infrastructure, and techniques for achieving scalable and efficient routing in environments with unpredictable traffic patterns, while addressing traditional routing limitations. Furthermore, it explores the concept of combining randomization with dictation in routing schemes to optimize traffic management under varying conditions.
More Related Content
![[Webinar Slides] Programming the Network Dataplane in P4](https://cdn.slidesharecdn.com/ss_thumbnails/p4-webinar-intro-demo-oct2015-chang-151106220822-lva1-app6891-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Valiant Load Balancing and Traffic Oblivious Routing
Valiant Load Balancing and Traffic Oblivious Routing
- 1. Theoretical Foundation forValiant Load Balancing and Traffic Oblivious Routing 侯宗成, Oct. 13th, 2011 • A. Greenberg et al., “VL2: A Scalable and Flexible Data Center Network”, ACM SIGCOMM 2009. • M. Kodialam, T. V. Kakshman, S. Sengupta, “Efficient and Robust Routing of Highly Variable Traffic”, HotHets, 2004. • James Roberts, “Public Reviews of Papers Appearing at HotNets-III”, ”, HotHets, 2004.
- 2. Outline • Valiant LoadBalancing in VL2 • Background • Proposed Routing Scheme • Further Ideas
- 3. Outline • Valiant LoadBalancing in VL2 – Goals and Building Blocks of VL2 – Spreading for Uniform High Capacity – Randomization for Volatility – References of VLB • Background • Proposed Routing Scheme • Further Ideas
- 4. Goals and BuildingBlocks of VL2 • Current designs prevent agility – Poor server-server capacity: Oversubscription – Poor utilization: Fragmentation of resources – Poor reliability: Routing & computing deadlocks • Goals: Scalable, flexible, and agile DC – Uniform High Capacity – Performance Isolation – Layer-2 Semantics
- 5. Goals and BuildingBlocks of VL2 • Supporting Infrastructure – Directory System / Address Mapping • Key Innovation – Application and Location Addresses • Major Application of an Innovation – VLB and ECMP • Infrastructure – Clos Topology
- 6. Goals and BuildingBlocks of VL2 Supporting Innovation Application Infrastructure Building Blocks Goals
- 7. Spreading for UniformHigh Capacity • ECMP: among equal paths for a node • VLB: among nodes for entire network • Implement VLB by spreading traffic to bounce off several core switches • Hot-spot free: encapsulation and anycast address of core switches • No centralized engineering – Seemingly contradictory to OpenFlow – Discuss in further ideas
- 8. Randomization for Volatility • Destination-independent traffic spreading • Randomly-chosen intermediate switches • Traffic spreading ratios are uniform • Edge constraints hold – theoretical model provide later • Shim layer agent: enables path control by adjusting randomization • Claims no problem when elephant flows occur: where OpenFlow can work on
- 9. References of VLB •Specific example, VLB: – R. Zhang-Shen and N. McKeown “Designing a Predictable Internet Backbone Network”, HotNets-III, November 2004. • General Case, Traffic Oblivious Routing: – M. Kodialam, T.V. Lakshman, S Sengupta, “Efficient and Robust Routing of Highly Variable Traffic," HotNets, 2004. • Both met at Stanford Workshop on Load-Balancing, May 2004. • R. Zhang-Shen: student of McKeown(Ph.D.) and Roxford (post-doc), now at Google. • Sengupta: one of the authors of VL2, now at Microsoft Research • Early works by: Valiant, for processor interconnection networks, 1981.
- 10. Outline • Valiant LoadBalancing in VL2 • Background – Original Motivation in 2004 – Traditional Approach – Multi-Commodity Flow Problem – Preferred Routing Characteristics – Similarities with Data Center Network • Proposed Routing Scheme • Further Ideas
- 11. Original Motivation in2004 • For Internet Backbone, ISP, VPN services, and Autonomous Systems. • Also applicable to any scenarios: – Extreme traffic variations – Traffic matrix unknown and no pattern • Didn’t think of applying to DCN. • Found to be so ideal for DCN in VL2.
- 12. Traditional approach • Assumewe know matrix of demands of pairs of ingress/egress routers • Network design can be formulated as a multi-commodity flow problem • Routing and capacity be selected to: – optimize objective functions – while satisfying constraints. • For example: IP shortest path routing – implies that demands are over a single path satisfying least hops or delay.
- 13.
- 14.
- 15.
- 16. Preferred Routing Characteristics •Can handle unpredictable traffic and maintains good service • Minimize overprovisioning • Mostly static routing, without dynamic adjustments and complex mechanisms
- 17. Similarities with DataCenter Network • Traffic unpredictable and variant • Mostly static routing can release workload • Bandwidth on links are critical resources • DCN core works similarly as backbone network
- 18. Outline • Valiant LoadBalancing in VL2 • Background • Proposed Routing Scheme – Briefing – Modeling Traffic Variability – Traffic Oblivious Routing – Capacity Effectiveness – Key Knowledge Gained • Further Ideas
- 19. Briefing • View Internetbackbone as fully meshed • N nodes with inter-node links by tunneling • Traffic Ti-j is routed through an intermediate k: tunnel i→k→j • Traffic split over all possible two-hop routes • Including i→i→j and i→j→j
- 20. Briefing • Can beperformed at flow level by a hash function or by resequencing packets • Tunnels need to be sized to accommodate all possible traffic matrices • The only constraint: an upper bound on the total amount of incoming and outgoing capacity at each node.
- 21.
- 22.
- 23.
- 24.
- 25. Modeling Traffic Variability Avery tough condition, all nodes are at Ri Ci full capacity.
- 26.
- 27. Modeling Traffic Variability •A very tough condition, all nodes are at Ri Ci full capacity. • It we can route any matrix in T(R,C), we can route any other matrices with smaller column and row sums. • Can route any demands with nodes less than full capacity.
- 28.
- 29.
- 30. Traffic Oblivious Routing •Implementing this scheme by: – Forming fixed bandwidth tunnels between nodes. – Refer as Phase 1 and Phase 2 tunnels. • Bandwidth required for tunnels only depends on R and C values. • Not on the unknown individual entries in the varying traffic matrix. • Modeling tunnel demand next slide.
- 31.
- 32. Traffic Oblivious Routing •Property 1: Routing oblivious to traffic variations. • Property 2: Provisioned capacity is traffic matric independent. • Property 3: Complete utilization of provisioned capacity.
- 33. Traffic Oblivious Routing •Does not make any assumptions about T, apart from row and column sum bounds. • Does not require the network to detect changes in traffic. • Handles variability in the traffic matrix set by effectively routing a transformed matrix. • Depends only on row/column sum bounds and traffic distribution ratios. • Not on a specific matrix.
- 34.
- 35. Traffic Oblivious Routing Minimize link capacities Flow conservation Demand satisfaction Within hardware capacity Distribution ratios
- 36. Capacity Effectiveness • Resultswith no details in the paper. • Consider a 20-node and 33 bidirectional links network. (represent US backbone) • Ri’s and Ci’s are equal and normalized to 1. • Node capacities are identical, equals uR. • Below uR, routing infeasible. • Lowest uR =2.595 • uR =2.8, bandwidth efficiency 94%.
- 37. Key Knowledge Gained •Violating edge constraints: roots of all network deadlocks in DCN. • Edge and network problems can be separated. • Edge: how to ensure capacity constraints are not violated? • Network: how to balance loads and separate services?
- 38. Outline • Valiant Load Balancing in VL2 • Background • Proposed Routing Scheme • Further Ideas – Clos Topology – Traffic-Oblivious, Randomized, Load- Balanced routing – Randomization v.s. Dictation – Questions: Combining OpenFlow ?
- 39.
- 40. Further Ideas • Traffic-ObliviousRouting – Localized routing to switches • centralized / distributed split ratios computation – Need further research • OpenFlow Controllers and Switches – Good for planning elephant flows – Should be combined with traffic oblivious and randomized distributed routing – Randomization vs Dictation: Seemingly Contradictory
- 41. How to adoptboth concepts and implement into one scheme? • Depending on flow types and scenarios. When switches are able to do the routines, only leave important and critical tasks to controllers, • Prevent edges from being overflowed. – Design and placement of tenants and hosts. – Policies of edge switches, soft or hard.
- 42. When do systemsinitiate dictation / randomization? • For major controllers – When critical tasks or situations occur. – What are critical tasks? • For switches / secondary controllers – Reconfigure distribution ratios when environment changes. – How to reconfigure? • Logical topology / link capacities changed – Then switches start to reconfigure. – Define logical change?
- 43. What are relationsbetween controllers and switches? • Controllers plan resources allocation and routing when elephant flows or critical situations occur. • Switches utilize resources left by controllers and perform optimization for distribution remaining traffic. • Balance load between controllers and switches.