In this talk, Thomas will present Virtual Network over TRILL (VNT), a TRILL-based multi-tenant network architecture for virtualized data center networks. Through the TRILL protocol, this architecture achieves the best of both layers (bridging and routing), thus building a large-scale layer-2 network, while ensuring scalability, efficiency, fault-tolerance and simplified management. This architecture integrates the VNT solution, enabling the creation of large numbers of logical networks or Private VLANs within a virtualized data center.
The complete implementation of our solution is currently deployed and running in the Gandi cloud infrastructure. Gandi plans to release the code for this solution as open source.
4. 4
The Cloud provider perspective
Node
VM
VM
VM
VM
VM
VM
VM
VM
VM
Node
Node
Node
Node
Node
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
Background
5. 5
The Cloud provider perspective
Node
VM
VM
VM
VM
VM
VM
VM
VM
VM
Node
Node
Node
Node
Node
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
Background
6. 6
The Cloud provider perspective
Node
VM
VM
VM
VM
VM
VM
VM
VM
VM
Node
Node
Node
Node
Node
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
Background
8. 8
Large
scale
mul4-‐tenancy
StorageServers
Access
layer
Aggrega4on
Layer
Core
Layer
Internet
Customers
VM
VM
VM
VM
VM
VM
VM
VM
VM
Cloud
Data
Center
View
Why did we make it?
9. 9
Large
scale
mul4-‐tenancy
Customer
Logical
View:
Private
VLAN
VM
L2-‐Segment
Customer
C
VM
VM
L2-‐Segment
Customer
B
VM
VM
L2-‐Segment
Customer
A
VM
VM
VM
VM
10. 10
Large
scale
mul4-‐tenancy
Customer
Logical
View
VM
L2-‐Segment
Customer
C
VM
VM
L2-‐Segment
Customer
B
VM
VM
L2-‐Segment
Customer
A
VM
VM
VM
VM
12. 12
q What
is
VNT
?
TRILL
+
VNI
VNT
:
Virtual
Network
over
TRILL
Node
VM
VM
VM
VM
VM
VM
VM
VM
VM
TRILL
VNI
VNI
VNI
VNI
VNI
VNI
13. 13
q What
is
TRILL
?
• TRILL
=
Transparent
Interconnec4on
with
Lot
of
Links
(RFC6325)
TRILL
combines
the
best
of
Layer
2
and
Layer
3
VNT
:
Virtual
Network
over
TRILL
RBridge
14. 14
q What
is
VNI
?
• Virtual
network
iden4fier
VLAN**2
VNT
:
Virtual
Network
over
TRILL
15. 15
q What
is
VNI
?
• Virtual
network
iden4fier
VLAN**2
VNT
:
Virtual
Network
over
TRILL
16. 16
VNT
Frame
Format
VNT
Encapsula4on
Original
Ethernet
Frame
Outer
Des4na4on
Mac
Address
Outer
Source
Mac
Address
Op4onal
Outer
IEEE
802.1Q
TRILL
Header
VNT
Header
Extensions
Inner
Des4na4on
Mac
Address
Inner
Source
Mac
Address
Op4onal
Inner
IEEE
802.1Q
Original
Ethernet
Payload
CRC
Ensures
Layer
2
switching
Reduces
impact
on
ToR
MAC
Table
Transport
Vlan
Ensures
a
Layer
2
rou4ng
based
on
Rbridge
Nickname
Backwards
compa4bility
LAN
segments
to
scale
up
to
16
million
Broadcast
and
flooding
based
on
VNI
Egress
Rbridge
Nickname
Ingress
Rbridge
Nickname
Cri4cal
Op4on
TLV
VNI
Tag
(24
bits)
17. 17
VNT
Frame
Format
VNT
Encapsula4on
Original
Ethernet
Frame
Outer
Des4na4on
Mac
Address
Outer
Source
Mac
Address
Op4onal
Outer
IEEE
802.1Q
TRILL
Header
VNT
Header
Extensions
Inner
Des4na4on
Mac
Address
Inner
Source
Mac
Address
Op4onal
Inner
IEEE
802.1Q
Original
Ethernet
Payload
CRC
Ensures
Layer
2
switching
Reduces
impact
on
ToR
MAC
Table
Transport
Vlan
Ensures
a
Layer
2
rou4ng
based
on
Rbridge
Nickname
Backwards
compa4bility
LAN
segments
to
scale
up
to
16
million
Broadcast
and
flooding
based
on
VNI
Egress
Rbridge
Nickname
Ingress
Rbridge
Nickname
Cri4cal
Op4on
TLV
VNI
Tag
(24
bits)
24. 24
VNI
Propaga4on
Process
VNI
Supported
VNI
Forwarded
VNI
Unknown
VNI
Discovered
add
VNI
del
VNI
add
VNI
VNI
on
two
port
VNI
on
only
one
port
VNI
on
only
one
port
VNI
on
any
port
add
VNI
25. 25
VNI
Propaga4on
Process
VNI
Supported
VNI
Forwarded
VNI
Unknown
VNI
Discovered
add
VNI
del
VNI
add
VNI
VNI
on
two
port
VNI
on
only
one
port
VNI
on
only
one
port
VNI
on
any
port
add
VNI
Convergence = All RBridges know all VNIs
26. 26
Using
TRILL
Physical
Topology
Mul4cast
Tree
ARP
Flooding
n5
n2
n8
n3
n7
n4
n6
n1
3
4
5
8
7
6
1
2
A
B
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
VNT
Topology
Trees
27. 27
Physical
Topology
Mul4cast
Tree
ARP
Flooding
n5
n2
n8
n3
n7
n4
n6
n1
3
4
5
8
7
6
1
2
A
B
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
Using
TRILL
VNT
Topology
Trees
28. 28
Physical
Topology
Mul4cast
Tree
ARP
Flooding
n5
n2
n8
n3
n7
n4
n6
n1
3
4
5
8
7
6
1
2
A
B
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
Using
TRILL
Using
VNT
3
4
5
8
7
6
1
2
A
–Vni1
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
VNT
Topology
Trees
29. 29
Physical
Topology
Mul4cast
Tree
ARP
Flooding
n5
n2
n8
n3
n7
n4
n6
n1
3
4
5
8
7
6
1
2
A
B
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
Using
TRILL
Using
VNT
3
4
5
8
7
6
1
2
A
–Vni1
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
B-‐Vni1
n5
n2
n6
n1
VNT
Topology
Trees
30. 30
VNT
Topology
Trees
Physical
Topology
Mul4cast
Tree
ARP
Flooding
n5
n2
n8
n3
n7
n4
n6
n1
3
4
5
8
7
6
1
2
A
B
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
Using
TRILL
Using
VNT
3
4
5
8
7
6
1
2
A
–Vni1
Root_tree
n5
n2
n8
n3
n7
n4
n6
n1
B-‐Vni1
n5
n2
n6
n1