Technical Forum
Solutions for Scaling the Cloud Computing Network
Infrastructure
Autumn 2015
Technical Forum
Overlay Networking:Your Choice with Arista
SDN Controller Integration
Physical
infrastructure
Hardware VTEP added
to the logical switch
vSwitch
Software
VTEP
on host
Direct Integration
Tenant VLAN
creation on
compute node
link
Physical infrastructure
(Create VLAN on leaf node ->
static map to VNI )
MAC Distribution
Dynamic Flood-list create
Tenant Network
Virtual Machine creation
Network
Virtualization
Controller
CloudVision
eXchange
CloudVision
eXchange
Abstraction
Layer
Cloud Management Platform Cloud Management Platform
Technical Forum
Overlay
Controller
Scaling Controller Integration
3
OVSDB/eAPI
Overlay
Controller
Network Layer
Controller Layer
10x
Improvement
OVSDB/eAPI
Sysdb
State Sync
Topology/Device
Dependent
Topology/Device
Abstraction
Traditional
Approach
CloudVision
Approach
© 2015 Arista - Confidential
Highly Optimized
State Sync Protocol
Technical Forum
Topology-dependent config:Neutron ML2 example
[ml2_mech_vendor:1.1.1.1]
host1-port-channel:2
ssh_port=22
username=admin
password=myPass
[ml2_mech_vendor:1.1.1.2]
host1-port-channel:2
ssh_port=22
username=admin
password=myPass
[ml2_mech_vendor:1.1.1.1]
host1-port-channel:2
ssh_port=22
username=admin
password=myPass
[ml2_mech_vendor:1.1.1.2]
host1-port-channel:2
ssh_port=22
username=admin
password=myPass
[ml2_mech_vendor:1.1.1.3]
host1-port-channel:2
ssh_port=22
username=admin
password=myPass
Adding a new switch
requires configuration
changes in ml2:
Technical Forum
Use Case 1: OpenStack with ML2
Technical Forum
OpenStack ML2 Plugin – CVX via eAPI
OpenStack
Direct Integration
Tenant VLAN
creation on
compute node
link
Physical infrastructure
(Create VLAN on leaf node ->
static map to VNI )
MAC Distribution
Dynamic Flood-list create
Tenant Network
Virtual Machine creation
Cloud ManagementPlatform
(Neutron ML2 plugin)
CloudVision
eXchange
• Network topology abstraction via
CVX
• Provides Hypervisor Infrastructure
with VXLAN support
• Leverages proven vSwitch solution
• Wire-speed due to VXLAN in HW
• Easy to setup and manage
• Transparent to OpenStack
Technical Forum
Step 1: Create a new Segment in OpenStack
OVS Arista
Neutron
ML2
Create VLAN
Map VNI àVLAN
The new VLAN is not
connected yet
CloudVision
eXchange
L3 ECMP IP Fabric
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP VTEP
OVS OVS OVS OVS
VTI VTI VTI VNTI
HardwareVXLAN VTEP
configured on every leaf switch
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
eAPI
Layer 3 ECMP fabric
for increased
underlay scale
Technical Forum
Step 2: Create and deploy aVM
OVS Arista
Neutron
ML2
Create VM
Assign the Network
CloudVision
eXchange
L3 ECMP IP Fabric
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP VTEP
OVS OVS OVS OVS
VTI VTI VTI VTI
HardwareVXLAN VTEP
configured on every leaf switch
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
eAPI
Layer 3 ECMP fabric
for increased
underlay scale
Technical Forum
Step 3: Create and deploy a secondVM
OVS Arista
Neutron
ML2 CloudVision
eXchange
L3 ECMP IP Fabric
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP VTEP
OVS OVS OVS OVS
VTI VTI VTI VTI
HardwareVXLAN VTEP
configured on every leaf switch
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
Create another VM
Assign the Network
eAPI
Layer 3 ECMP fabric
for increased
underlay scale
Technical Forum
Step 4: L2 traffic flows between theVMs
Layer 3 ECMP fabric
for increased
underlay scale
OVS Arista
Neutron
ML2
L2 traffic is flowing
across L3 fabric
(VXLAN encaped)
CloudVision
eXchange
L3 ECMP IP Fabric
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP VTEP
OVS OVS OVS OVS
VTI VTI VTI VTI
VNI
HardwareVXLAN VTEP
configured on every leaf switch
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
eAPI
Technical Forum
Demo: Physical Network Diagram
HW
VTEP
leaf1 leaf2
spine1 spine2eBGP ECMP
Leaf-Spine
Network
172.28.171.101
HW
VTEP
kilo1 host3 host4 kilo2
3.3.3.3 4.4.4.4
ATF-NET1
10.11.0.0/24
L2, VLAN
L3, VXLAN
L2, VLAN
172.28.171.102
172.28.168.30 172.28.168.30
Technical Forum
Why Arista for OpenStack?
§ Automation of network provisioning
§ OpenStackVisibility:
• Virtual Machine / Bare Metal (OpenStack Ironic) configuration
• Network configuration
• Statistics
§ High availability support using MLAG via CVX
§ Smooth migration path towards SDN controller
§ Improved scaling via CVX
Technical Forum
Use Case 2: SDN Controller with OVSDB
Technical Forum
Use Case 2: SDN Controller with OVSDB
• SDN technologies in the overlay
network (NFV)
• Abstraction of network topology via
CVX
• Allows use of MLAG at the leaf
• ExtendVXLAN to the legacy non-
VXLAN network
• Tight integration with Cloud
Orchestration
• Avoid the ~4000VLAN limit
SDN Controller Integration
Physical infrastructure
Hardware VTEP added
to the logical switch
vSwitch
Software
VTEP on
host
CloudVision
eXchange
Network
Virtualization Controller
Cloud
Management
Platform
Technical Forum
Step 1: New Bare Metal Server Added
Layer 3 ECMP fabric
for increased
underlay scale
CloudVision
eXchange
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP
VTEP
VTI VTI VTI
VTI
HardwareVXLAN VTEP
configured on every leaf switch
for additional flexibility
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
OVSDB
Add BM server to any rack,
as each one has a HW VTEP
L3 ECMP IP Fabric
VNI
Technical Forum
Step 2: Add a HW Gateway to the Logical Switch
Layer 3 ECMP fabric
for increased
underlay scale
CloudVision
eXchange
L3 ECMP IP Fabric
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP
VTEP
VTI VTI VTI
VTI
HardwareVXLAN VTEP
configured on every leaf switch
for additional flexibility
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
VNI
OVSDB
Technical Forum
Step 3: L2 Adjacency Between VMs & BM Server
Layer 3 ECMP fabric
for increased
underlay scale
Traffic is flowing
as UDP between VTEPs
CloudVision
eXchange
L3 ECMP IP Fabric
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP
VTEP
VTI VTI VTI
VTI
HardwareVXLAN VTEP
configured on every leaf switch
for additional flexibility
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
VNI
OVSDB
Technical Forum
Demo: Logical Network Diagram
NSX Edge Services Gateway
(for Centralized Routing)
LS-web LS-app LS-db
192.168.1.0/24
192.168.2.0/24
192.168.3.0/24
web01
.10
web02
.11
baremetal
.12
app01
.10
app02
.11
db01
.10
db02
.11
.1 .1
.1
Technical Forum
Demo: Physical Network Diagram
web01
.10
web02
.11
app01
.10
app02
.11
db01
.10
db02
.11
NSX VTEP NSX VTEP NSX VTEP
baremetal
.12
Arista Hardware VTEP
NSX Edge Services Gateway
(for Centralized Routing)
bleaf13
MLAG
bleaf14 bleaf15
bspine1 bspine2eBGP ECMP
Leaf-Spine
Network
NSX Controller
Cluster
NSX Manager vCenter
10.0.131.10 10.0.132.10 10.0.133.10
192.168.1.1
192.168.2.1
192.168.3.1
192.168.1.0/24 192.168.2.0/24 192.168.3.0/24
10.0.14.253
Technical Forum
Why Arista forVMware NSX?
§ Network automation for bare metal provisioning
§ High availability support using MLAG via CVX
§ VMwareVisibility:
• Virtual Machine configuration
• Network configuration
• Statistics
§ Integration with NSX controller using standard OVSDB
§ CVX for improved scale
Technical Forum
Use Case 2a: OpenStack with L2 Gateway
Technical Forum
OpenStack Neutron,VXLAN, L2 Gateway
Layer 3 ECMP fabric
for increased
underlay scale
CloudVision
eXchange
L3 ECMP IP Fabric
Rack NRack N-1Rack N-2Rack 1
VTEP VTEP VTEP
VTEP
VNI VNI VNI
VNI
HardwareVXLAN VTEP
configured on every leaf switch
for additional flexibility
Layer 2 connectivity between rack
via VXLAN across the L3 fabric
VNI
OVS
Neutron
ML2
L2 GW
Svc plugin
L2 GW as a Service Plugin
is available for Kilo, part of
LibertyOS release
OVSDB
Technical Forum
ThankYou

Atf 3 q15-6 - solutions for scaling the cloud computing network infrastructure

  • 1.
    Technical Forum Solutions forScaling the Cloud Computing Network Infrastructure Autumn 2015
  • 2.
    Technical Forum Overlay Networking:YourChoice with Arista SDN Controller Integration Physical infrastructure Hardware VTEP added to the logical switch vSwitch Software VTEP on host Direct Integration Tenant VLAN creation on compute node link Physical infrastructure (Create VLAN on leaf node -> static map to VNI ) MAC Distribution Dynamic Flood-list create Tenant Network Virtual Machine creation Network Virtualization Controller CloudVision eXchange CloudVision eXchange Abstraction Layer Cloud Management Platform Cloud Management Platform
  • 3.
    Technical Forum Overlay Controller Scaling ControllerIntegration 3 OVSDB/eAPI Overlay Controller Network Layer Controller Layer 10x Improvement OVSDB/eAPI Sysdb State Sync Topology/Device Dependent Topology/Device Abstraction Traditional Approach CloudVision Approach © 2015 Arista - Confidential Highly Optimized State Sync Protocol
  • 4.
    Technical Forum Topology-dependent config:NeutronML2 example [ml2_mech_vendor:1.1.1.1] host1-port-channel:2 ssh_port=22 username=admin password=myPass [ml2_mech_vendor:1.1.1.2] host1-port-channel:2 ssh_port=22 username=admin password=myPass [ml2_mech_vendor:1.1.1.1] host1-port-channel:2 ssh_port=22 username=admin password=myPass [ml2_mech_vendor:1.1.1.2] host1-port-channel:2 ssh_port=22 username=admin password=myPass [ml2_mech_vendor:1.1.1.3] host1-port-channel:2 ssh_port=22 username=admin password=myPass Adding a new switch requires configuration changes in ml2:
  • 5.
    Technical Forum Use Case1: OpenStack with ML2
  • 6.
    Technical Forum OpenStack ML2Plugin – CVX via eAPI OpenStack Direct Integration Tenant VLAN creation on compute node link Physical infrastructure (Create VLAN on leaf node -> static map to VNI ) MAC Distribution Dynamic Flood-list create Tenant Network Virtual Machine creation Cloud ManagementPlatform (Neutron ML2 plugin) CloudVision eXchange • Network topology abstraction via CVX • Provides Hypervisor Infrastructure with VXLAN support • Leverages proven vSwitch solution • Wire-speed due to VXLAN in HW • Easy to setup and manage • Transparent to OpenStack
  • 7.
    Technical Forum Step 1:Create a new Segment in OpenStack OVS Arista Neutron ML2 Create VLAN Map VNI àVLAN The new VLAN is not connected yet CloudVision eXchange L3 ECMP IP Fabric Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP OVS OVS OVS OVS VTI VTI VTI VNTI HardwareVXLAN VTEP configured on every leaf switch Layer 2 connectivity between rack via VXLAN across the L3 fabric eAPI Layer 3 ECMP fabric for increased underlay scale
  • 8.
    Technical Forum Step 2:Create and deploy aVM OVS Arista Neutron ML2 Create VM Assign the Network CloudVision eXchange L3 ECMP IP Fabric Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP OVS OVS OVS OVS VTI VTI VTI VTI HardwareVXLAN VTEP configured on every leaf switch Layer 2 connectivity between rack via VXLAN across the L3 fabric eAPI Layer 3 ECMP fabric for increased underlay scale
  • 9.
    Technical Forum Step 3:Create and deploy a secondVM OVS Arista Neutron ML2 CloudVision eXchange L3 ECMP IP Fabric Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP OVS OVS OVS OVS VTI VTI VTI VTI HardwareVXLAN VTEP configured on every leaf switch Layer 2 connectivity between rack via VXLAN across the L3 fabric Create another VM Assign the Network eAPI Layer 3 ECMP fabric for increased underlay scale
  • 10.
    Technical Forum Step 4:L2 traffic flows between theVMs Layer 3 ECMP fabric for increased underlay scale OVS Arista Neutron ML2 L2 traffic is flowing across L3 fabric (VXLAN encaped) CloudVision eXchange L3 ECMP IP Fabric Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP OVS OVS OVS OVS VTI VTI VTI VTI VNI HardwareVXLAN VTEP configured on every leaf switch Layer 2 connectivity between rack via VXLAN across the L3 fabric eAPI
  • 11.
    Technical Forum Demo: PhysicalNetwork Diagram HW VTEP leaf1 leaf2 spine1 spine2eBGP ECMP Leaf-Spine Network 172.28.171.101 HW VTEP kilo1 host3 host4 kilo2 3.3.3.3 4.4.4.4 ATF-NET1 10.11.0.0/24 L2, VLAN L3, VXLAN L2, VLAN 172.28.171.102 172.28.168.30 172.28.168.30
  • 12.
    Technical Forum Why Aristafor OpenStack? § Automation of network provisioning § OpenStackVisibility: • Virtual Machine / Bare Metal (OpenStack Ironic) configuration • Network configuration • Statistics § High availability support using MLAG via CVX § Smooth migration path towards SDN controller § Improved scaling via CVX
  • 13.
    Technical Forum Use Case2: SDN Controller with OVSDB
  • 14.
    Technical Forum Use Case2: SDN Controller with OVSDB • SDN technologies in the overlay network (NFV) • Abstraction of network topology via CVX • Allows use of MLAG at the leaf • ExtendVXLAN to the legacy non- VXLAN network • Tight integration with Cloud Orchestration • Avoid the ~4000VLAN limit SDN Controller Integration Physical infrastructure Hardware VTEP added to the logical switch vSwitch Software VTEP on host CloudVision eXchange Network Virtualization Controller Cloud Management Platform
  • 15.
    Technical Forum Step 1:New Bare Metal Server Added Layer 3 ECMP fabric for increased underlay scale CloudVision eXchange Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP VTI VTI VTI VTI HardwareVXLAN VTEP configured on every leaf switch for additional flexibility Layer 2 connectivity between rack via VXLAN across the L3 fabric OVSDB Add BM server to any rack, as each one has a HW VTEP L3 ECMP IP Fabric VNI
  • 16.
    Technical Forum Step 2:Add a HW Gateway to the Logical Switch Layer 3 ECMP fabric for increased underlay scale CloudVision eXchange L3 ECMP IP Fabric Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP VTI VTI VTI VTI HardwareVXLAN VTEP configured on every leaf switch for additional flexibility Layer 2 connectivity between rack via VXLAN across the L3 fabric VNI OVSDB
  • 17.
    Technical Forum Step 3:L2 Adjacency Between VMs & BM Server Layer 3 ECMP fabric for increased underlay scale Traffic is flowing as UDP between VTEPs CloudVision eXchange L3 ECMP IP Fabric Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP VTI VTI VTI VTI HardwareVXLAN VTEP configured on every leaf switch for additional flexibility Layer 2 connectivity between rack via VXLAN across the L3 fabric VNI OVSDB
  • 18.
    Technical Forum Demo: LogicalNetwork Diagram NSX Edge Services Gateway (for Centralized Routing) LS-web LS-app LS-db 192.168.1.0/24 192.168.2.0/24 192.168.3.0/24 web01 .10 web02 .11 baremetal .12 app01 .10 app02 .11 db01 .10 db02 .11 .1 .1 .1
  • 19.
    Technical Forum Demo: PhysicalNetwork Diagram web01 .10 web02 .11 app01 .10 app02 .11 db01 .10 db02 .11 NSX VTEP NSX VTEP NSX VTEP baremetal .12 Arista Hardware VTEP NSX Edge Services Gateway (for Centralized Routing) bleaf13 MLAG bleaf14 bleaf15 bspine1 bspine2eBGP ECMP Leaf-Spine Network NSX Controller Cluster NSX Manager vCenter 10.0.131.10 10.0.132.10 10.0.133.10 192.168.1.1 192.168.2.1 192.168.3.1 192.168.1.0/24 192.168.2.0/24 192.168.3.0/24 10.0.14.253
  • 20.
    Technical Forum Why AristaforVMware NSX? § Network automation for bare metal provisioning § High availability support using MLAG via CVX § VMwareVisibility: • Virtual Machine configuration • Network configuration • Statistics § Integration with NSX controller using standard OVSDB § CVX for improved scale
  • 21.
    Technical Forum Use Case2a: OpenStack with L2 Gateway
  • 22.
    Technical Forum OpenStack Neutron,VXLAN,L2 Gateway Layer 3 ECMP fabric for increased underlay scale CloudVision eXchange L3 ECMP IP Fabric Rack NRack N-1Rack N-2Rack 1 VTEP VTEP VTEP VTEP VNI VNI VNI VNI HardwareVXLAN VTEP configured on every leaf switch for additional flexibility Layer 2 connectivity between rack via VXLAN across the L3 fabric VNI OVS Neutron ML2 L2 GW Svc plugin L2 GW as a Service Plugin is available for Kilo, part of LibertyOS release OVSDB
  • 23.