Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Introducing Cumulus Linux 3.0
What's new and different in 3.0?
cumulusnetworks.com
cumulusnetworks.com 2
Feature-Based Release (FBR) = 3.0
New Concept — Extended Support Release
Extended Support Release (E...
FBR vs. ESR
cumulusnetworks.com 3
Feature-Based Release
(FBR)
Extended Support Release
(ESR)
Functionality Latest and grea...
cumulusnetworks.com 4
The Big Picture
New Hardware
Debian Jessie
Easier Defaults
New Features
3.0
cumulusnetworks.com 5
The Big Picture
New Hardware
Debian Jessie
Easier Defaults
New Features
3.0
OSPF
Bonding
10Gbase-T
1...
cumulusnetworks.com 6
The Big Picture
New Hardware
Debian Jessie
Easier Defaults
New Features
3.0
7 New Hardware Platforms
cumulusnetworks.com 7
Family Vendor Model Number Configuration Chipset
10GT Edge-Core AS5812T 48x...
■ Next gen ASIC from Mellanox (100G & 40G)
■ Industry’s lowest power consumption
● 135w vs 170w
■ Line rate performance at...
Broadcom Tomahawk
cumulusnetworks.com 9
▪ New Port Speeds (100G/50G/25G)
▪ High Density
▪ 130 ports possible w/breakouts
▪...
cumulusnetworks.com 10
The Big Picture
New Hardware
Debian Jessie
Easier Defaults
New Features
3.0
v
ACPI Platform Description (APD)
Operating System
Operating System
ACPI Platform Description (APD)
12
▪ACPI extension for networking
▪ ACPI used for PCs/se...
Building an Open Ecosystem for Open Networking to Thrive
13
▪Switches
cumulusnetworks.com
Linux networking model
Self-desc...
v
Upgrades and Backups
Upgrades and Backups
Cumulus Linux 3.0 Eliminates Slots (and
/mnt/persist)
▪ Like a traditional server
Upgrades
▪ Moving f...
v
VPN Routing and Forwarding (VRF)
VRF – Virtual Routing and Forwarding
What is VRF?
VRF provides separate isolated routing tables for different
interfaces.
...
VRF Use Cases
▪Management plane separation
▪Multi-tenant environment
▪ Internal or external
▪OpenStack deployments
cumulus...
VRF in Cumulus Linux 3.0 – What Does It Provide?
▪ Full support in the Linux kernel
▪ Cumulus worked with kernel community...
Basic VRF Workflow in Cumulus Linux
▪Use ifupdown2
▪ Configure VRF and assign to a routing table
▪ Assign layer 3 interfac...
VRF Configuration
VRF configured similar to other interfaces
▪ Interface attached to VRF by specifying the vrf stanza
▪ Ta...
VRF Configuration
cumulusnetworks.com 22
auto <vrf-name>
iface <vrf-name>
vrf-table <table-id>
auto <intf>
iface <intf>
ad...
VRF Implementation — Quagga
▪BGP is VRF-aware
▪ Leverages BGP multiple instance support
▪ Per-VRF neighbors (EBGP/IBGP,
nu...
VRF Configuration — Quagga
cumulusnetworks.com 24
bgp multiple-instance
!
router bgp 64900 vrf vrf-1
bgp router-id 6.0.3.7...
VRF — Caveats in Cumulus Linux 3.0
▪Maximum VRF limit fixed at 64
▪
▪Fully supported on Broadcom chipsets —
Trident-II+, T...
v
Redistribute Neighbor
ECMP to the Server and Server Movement
cumulusnetworks.com 27
IP Fabric
L3 ECMP to the host
(no L2 or MLAG)
Host IP addres...
Redistribute Neighbor Functionality
▪1. Leaf watches the kernel neighbor (ARP) table
■ Adds a /32 route for each neighbor ...
Redistribute Neighbor Configuration
cumulusnetworks.com 29
route-map REDIST_NEIGHBOR permit 10
match interface swp1
!
ip i...
cumulusnetworks.com 30
The Big Picture
New Hardware
Debian Jessie
Better Defaults
New Features
3.0
v
Changes to Routing Protocol Configuration
Changes to BGP
March 23, 2016 cumulusnetworks.com 32
New Default Values
● Hostname data shown by default
● Import check en...
Changes to BGP
March 23, 2016 33
Making BGP Faster
● BGP does not have to be slow!
● Modern hardware supports fast (< 1 se...
Changes to BGP
March 23, 2016 cumulusnetworks.com 34
Simplified Configuration
● BGP displays the default IPv4 unicast addr...
OSPF Default Changes
cumulusnetworks.com 35
Timer Name New Value (in ms) Existing Value
SPF Delay 0 200
SPF Holddown 50 10...
v
Changes to Layer 2 Technologies
Changes to Layer 2 Technologies
cumulusnetworks.com 37
LACP Bypass
What is it?
Temporarily forwards traffic on an 802.3ad ...
cumulusnetworks.com 38
The Big Picture
New Hardware
Debian Jessie
Better Defaults
New Features
3.0
Cumulus Linux 3.0+ Based on Debian Jessie
▪ New LTS 4.1 Linux Kernel (Jessie is 3.16)
▪ systemd
▪ Starts/stops/monitors pr...
CUMULUS, the Cumulus Logo, CUMULUS NETWORKS, and the Rocket Turtle Logo (the “Marks”) are trademarks and service marks of ...
Upcoming SlideShare
Loading in …5
×

What's new and different in 3.0

577 views

Published on

This presentation provides a comprehensive overview of Cumulus Linux 3.0 release features.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

What's new and different in 3.0

  1. 1. Introducing Cumulus Linux 3.0 What's new and different in 3.0? cumulusnetworks.com
  2. 2. cumulusnetworks.com 2 Feature-Based Release (FBR) = 3.0 New Concept — Extended Support Release Extended Support Release (ESR) = 2.5.6+ vs.
  3. 3. FBR vs. ESR cumulusnetworks.com 3 Feature-Based Release (FBR) Extended Support Release (ESR) Functionality Latest and greatest No new functionality Hardware Platforms New platforms Re-branded platforms* ONLY Stability Leading edge Tried and true Frequency Business-driven Every 18 months Support Duration SW updates + support until ESR 12 months of support only after ESR 3 years Software Updates New functionality Bug fixes + security updates ONLY Security Updates ASAP (Current FBR branch) ASAP * Underlying platform must already be supported by this ESR.
  4. 4. cumulusnetworks.com 4 The Big Picture New Hardware Debian Jessie Easier Defaults New Features 3.0
  5. 5. cumulusnetworks.com 5 The Big Picture New Hardware Debian Jessie Easier Defaults New Features 3.0 OSPF Bonding 10Gbase-T 100G Redistribute NeighborVRF-lite BGP STP systemd LTS v4.1 Kernel
  6. 6. cumulusnetworks.com 6 The Big Picture New Hardware Debian Jessie Easier Defaults New Features 3.0
  7. 7. 7 New Hardware Platforms cumulusnetworks.com 7 Family Vendor Model Number Configuration Chipset 10GT Edge-Core AS5812T 48x10GT + 6x40G BRCM Trident-II+ 10GT DELL 4048T-ON 48x10GT + 6x40G BRCM Trident-II+ 40G Mellanox SN2700B 32x40G MLNX Spectrum 100G Mellanox SN2700 32x100G MLNX Spectrum 100G DELL Z9100-ON 32x100G BRCM Tomahawk 100G Penguin 3200C 32x100G BRCM Tomahawk 100G Supermicro SSE-C3632S 32x100G BRCM Tomahawk Cumulus Linux supports over 40 platforms!
  8. 8. ■ Next gen ASIC from Mellanox (100G & 40G) ■ Industry’s lowest power consumption ● 135w vs 170w ■ Line rate performance at ALL packet sizes ■ Low latency (300ns vs ~490ns) ■ Initially supported platforms: ● SN2700 (32x100G) ● SN2700B (32x40G) Mellanox Spectrum cumulusnetworks.com 8
  9. 9. Broadcom Tomahawk cumulusnetworks.com 9 ▪ New Port Speeds (100G/50G/25G) ▪ High Density ▪ 130 ports possible w/breakouts ▪ Supported connections: • 100G, 2x50G, 40G, 4x25G, 4x10G ▪ Tuneable forwarding table sizes (UFT) ▪ Defaults: L2 MAC = 40K (25% bigger than Trident-II) L3 Host = 20K (150% bigger) IPv4 LPM = 32K (same) IPv6 LPM = 8K (50% smaller)
  10. 10. cumulusnetworks.com 10 The Big Picture New Hardware Debian Jessie Easier Defaults New Features 3.0
  11. 11. v ACPI Platform Description (APD)
  12. 12. Operating System Operating System ACPI Platform Description (APD) 12 ▪ACPI extension for networking ▪ ACPI used for PCs/servers ▪ "Let the HW describe itself" ▪Cuts platform integration time ▪ Months to days ▪Accelerate platform availability cumulusnetworks.com ▪Standardizing Platform Description Before With APD Platform Specific Driver Platform Specific Driver Platform Specific Driver Description Description Description Generic Platform Driver
  13. 13. Building an Open Ecosystem for Open Networking to Thrive 13 ▪Switches cumulusnetworks.com Linux networking model Self-described platform to any OS Load any OS on any platform ▪Servers U-Boot and PXE SERVER OS ACPI NETWORK OS
  14. 14. v Upgrades and Backups
  15. 15. Upgrades and Backups Cumulus Linux 3.0 Eliminates Slots (and /mnt/persist) ▪ Like a traditional server Upgrades ▪ Moving from 2.X -> 3.0 requires full ONIE install Backups ▪ Full "installable" backup to external media (USB or network) cumulusnetworks.com 15
  16. 16. v VPN Routing and Forwarding (VRF)
  17. 17. VRF – Virtual Routing and Forwarding What is VRF? VRF provides separate isolated routing tables for different interfaces. VRF is a layer 3 construct that affects only IPv4 and IPv6 route lookups. Cumulus Linux supports VRF! Initial definition from BGP/MPLS IP VPNs (RFC 2547bis → RFC 4364) cumulusnetworks.com 17
  18. 18. VRF Use Cases ▪Management plane separation ▪Multi-tenant environment ▪ Internal or external ▪OpenStack deployments cumulusnetworks.com 18 HostsHostsHosts Hosts HostsHostsHosts Hosts spine Can also be used for: Default VRF Internet VRF FW Inside VRF FW Outside VRF LB Inside VRF LB Outside VRF DMZ VRF Security VRF Internal VRF
  19. 19. VRF in Cumulus Linux 3.0 – What Does It Provide? ▪ Full support in the Linux kernel ▪ Cumulus worked with kernel community to upstream ▪ Multiple isolated routing and forwarding tables ▪ Support for overlapping IP addresses ▪ VRF-aware BGP ▪ Works with existing tools (such as tcpdump) ▪ Daemons and apps can be associated with a VRF cumulusnetworks.com 19
  20. 20. Basic VRF Workflow in Cumulus Linux ▪Use ifupdown2 ▪ Configure VRF and assign to a routing table ▪ Assign layer 3 interfaces to VRF ▪Use Quagga ▪ BGP neighbor sessions (with BFD) can be configured per VRF ▪ Static routes can be configured per VRF ▪ Quagga uses Netlink to learn about VRFs ▪Management VRF and applications need additional steps cumulusnetworks.com 20
  21. 21. VRF Configuration VRF configured similar to other interfaces ▪ Interface attached to VRF by specifying the vrf stanza ▪ Table ID — manual or automatic ▪ Can have IP address — loopback interface for VRF ▪ VRF name is purely an operator's choice (except for management VRF) ▪ cumulusnetworks.com 21
  22. 22. VRF Configuration cumulusnetworks.com 22 auto <vrf-name> iface <vrf-name> vrf-table <table-id> auto <intf> iface <intf> address <IP address> …. vrf <vrf-name> ▪Step 1: Create the VRF ▪Step 2: Place the interface in the VRF
  23. 23. VRF Implementation — Quagga ▪BGP is VRF-aware ▪ Leverages BGP multiple instance support ▪ Per-VRF neighbors (EBGP/IBGP, numbered/unnumbered, etc.) ▪ Per-VRF parameters (address-families, redistribution, etc.) cumulusnetworks.com 23
  24. 24. VRF Configuration — Quagga cumulusnetworks.com 24 bgp multiple-instance ! router bgp 64900 vrf vrf-1 bgp router-id 6.0.3.7 network 20.7.2.0/24 network 20.7.3.0/24 neighbor 10.1.1.2 remote-as 20 neighbor 20.1.1.2 remote-as 30 ! address-family ipv4 unicast neighbor 10.1.1.2 activate neighbor 20.1.1.2 activate exit-address-family ! router bgp 64900 vrf vrf-2 bgp router-id 18.0.4.7 neighbor CUSTPEER peer-group neighbor CUSTPEER remote-as external neighbor swp1.10 peer-group CUSTPEER ! address-family ipv4 unicast neighbor CUSTPEER activate Redistribute connected exit-address-family !
  25. 25. VRF — Caveats in Cumulus Linux 3.0 ▪Maximum VRF limit fixed at 64 ▪ ▪Fully supported on Broadcom chipsets — Trident-II+, Trident-II ▪(Mellanox support planned Cumulus Linux 3.1.0) ▪Quagga: Only BGP supported ▪ OSPFv2 and OSPFv3 are not VRF-aware cumulusnetworks.com 25
  26. 26. v Redistribute Neighbor
  27. 27. ECMP to the Server and Server Movement cumulusnetworks.com 27 IP Fabric L3 ECMP to the host (no L2 or MLAG) Host IP address no longer tied to a rack Reachability moves with the host Routing protocol uses ARP and advertises hosts Advertises host routes (/32) into the IP fabric Hosts do not run a routing protocol Host1 Host1 Host1 /32 Host1 /32
  28. 28. Redistribute Neighbor Functionality ▪1. Leaf watches the kernel neighbor (ARP) table ■ Adds a /32 route for each neighbor to private kernel table ▪2. Quagga imports the routes from kernel table into Zebra ■ Route map used for filtering ▪3. Table is redistributed into BGP or OSPF ■ Unicast ARPs are sent to known hosts every 3 seconds cumulusnetworks.com 28 Note: IPv4 support only
  29. 29. Redistribute Neighbor Configuration cumulusnetworks.com 29 route-map REDIST_NEIGHBOR permit 10 match interface swp1 ! ip import-table 10 route-map REDIST_NEIGHBOR ! router bgp 10 redistribute table swp1 eth2 *swp1 is a host-facing port Quagga leaf configuration swp1 Leaf 1 Host eth1 Leaf 2
  30. 30. cumulusnetworks.com 30 The Big Picture New Hardware Debian Jessie Better Defaults New Features 3.0
  31. 31. v Changes to Routing Protocol Configuration
  32. 32. Changes to BGP March 23, 2016 cumulusnetworks.com 32 New Default Values ● Hostname data shown by default ● Import check enabled by default ● No-as-set is default when using "bgp bestpath as-path multipath relax" ● Maximum paths is now 64 by default ● Deterministic MED enabled by default ● Log neighbor changes on by default spine1# sh bgp ipv4 unicast summ BGP router identifier 10.1.1.1, local AS number 65001 BGP table version 2 RIB entries 3, using 360 bytes of memory Peers 2, using 32 KiB of memory Peer groups 1, using 56 bytes of memory Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd swp2 4 0 0 0 0 0 0 never Idle leaf1(swp1) 4 65011 87 88 0 0 0 00:04:10 1 IETF: draft-walton-bgp-hostname-capability-02 cumulusnetworks.com 32
  33. 33. Changes to BGP March 23, 2016 33 Making BGP Faster ● BGP does not have to be slow! ● Modern hardware supports fast (< 1 second) BGP reaction times ● When using link-detect, carrier failures influence routing even faster than timers Timer Name New Value (in seconds) Existing Value Keepalive Timer 3 60 Holddown Timer 9 180 Advertisement Interval 0 30 Connect Timer 10 120 cumulusnetworks.com 33
  34. 34. Changes to BGP March 23, 2016 cumulusnetworks.com 34 Simplified Configuration ● BGP displays the default IPv4 unicast address family ● Interfaces used for peership do not need to be explicitly declared ● Peer group configuration is inherited in address families ● Router advertisements (RA) w/lifetime=0 automatically enabled for interfaces with IPv6 addresses New Feature: BGP "Add-Path" Transmit Capability ● Allows BGP to advertise multiple paths for the same address prefix instead of just the best path ● Receive capability was already present cumulusnetworks.com 34
  35. 35. OSPF Default Changes cumulusnetworks.com 35 Timer Name New Value (in ms) Existing Value SPF Delay 0 200 SPF Holddown 50 1000 SPF Max Holddown 5000 10000 OSPF log-adjacency-changes on by default Making OSPF Faster
  36. 36. v Changes to Layer 2 Technologies
  37. 37. Changes to Layer 2 Technologies cumulusnetworks.com 37 LACP Bypass What is it? Temporarily forwards traffic on an 802.3ad bond with no LACP partner (during PXE boot). Bypass mode ends when first LACP frame is received from neighbor. Changes ▪ Active-active mode only (priority mode no longer supported) ▪ Easier to use, user doesn’t need to determine which port is active STP on by default (for bridges)
  38. 38. cumulusnetworks.com 38 The Big Picture New Hardware Debian Jessie Better Defaults New Features 3.0
  39. 39. Cumulus Linux 3.0+ Based on Debian Jessie ▪ New LTS 4.1 Linux Kernel (Jessie is 3.16) ▪ systemd ▪ Starts/stops/monitors processes • Restarts processes if they die (obsoletes jdoo) • Starts/stops in parallel for faster boot ▪ Provides journalctl • Has stderr/stdout/syslog from all processes started by systemd • "journalctl | grep" is very useful cumulusnetworks.com 39
  40. 40. CUMULUS, the Cumulus Logo, CUMULUS NETWORKS, and the Rocket Turtle Logo (the “Marks”) are trademarks and service marks of Cumulus Networks, Inc. in the U.S. and other countries. You are not permitted to use the Marks without the prior written consent of Cumulus Networks. The registered trademark Linux® is used pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the mark on a worldwide basis. All other marks are used under fair use or license from their respective owners. ▪Thank You! cumulusnetworks.com 40 Bringing the Linux Revolution to Networking

×