Sunay Tripathi CTO Hot Startups Session Agenda 1. Pluribus Freedom Architecture Overview 2. Freedom SDN: Beyond Traditional Networking 3. Use Cases 4. Conclusions ONS2015: http://bit.ly/ons2015sd ONS Inspire! Webinars: http://bit.ly/oiw-sd Watch the talk (video) on ONS Content Archives: http://bit.ly/ons-archives-sd

5. Pluribus “Freedom” Architecture
Fusion Of Compute-Network-Storage-Hypervisor
…How Does It Work?
Compute
Storage
Network
Hypervisor

6. CPU
RAM NIC
CPU
Devic
e
Devic
e
Mem+PCIe
Interconnects
Server OS
OS Virtual
Memory
Device Device
We start from an off-the-shelf server…
…and an Open Source Server OS…

7. CPU
RAM
CPU
Netvisor
OS Virtual
Memory
Mem+PCIe
Interconnects
Nx10GE
Device Device
And we replace the NIC with a
merchant silicon switch chip
Switch chip mapped
into OS (unlike
conventional switches!)
Switch-Chip controlled at
multi-10G speed (unlike
conventional switches!)
Switch chip is fully
programmable as an
application flow accelerator
(unlike conventional
switches!)
The Freedom Server-Switch
Devic
e
Devic
e

8. CPU
RAM
CPU
Netvisor
OS Virtual
Memory
Devic
e
Devic
e
Mem+PCIe
Interconnects
Nx10GE
Device Device
Dual Socket Xeon Off-the-shelf Server MB
Up to 1TB of RAM
Inside a Server-Switch

9. Netvisor Components and APIs

10. CPU
RAM
CPU
Device Device
Mem+PCIe
Interconnects
NIC
vNIC
VM
Guest OS
VM
SRIOV
Hypervisor
vSwitch
CPU
RAM
CPU
Device Device
Mem+PCIe
Interconnects
VM VM
SRIOV
Hypervisor
(Netvisor)
4x
10GE
VNET
Where Does This Fit In The Datacenter?
Server-Switch
Server

11. Freedom Development Kit Libraries
Netvisor Open Programmability
inNetwork SDN
CLI
Pluribus GUI
You Can work with the CLI, or you can use fully multi-threaded C, Java, REST
APIs

12. Fabric-Cluster Application
Every Node shares the
same view of the
Fabric: MAC, IP,
connections and app
flows
Single Point of
Mgmt
Applications/Services/Orc
hestration controllers
“see” only one device
Built-in ARP
suppression
Classic database
3-phase commit
for config
changes
Distributed cluster
free of centralized
controllers
The Fabric-Cluster Application

13. Fabric-Cluster Application
The Analytics Application
inNetwork Analytics: No Taps, No Monitoring Network
Track any connections
across the entire
fabric-cluster from any
node
Full visibility into
overlay network traffic
‘Industrial’ control plane
permits monitoring at wire-
rate as opposed to
sampling, where nuances
may be lost.
No limitation from
traditional switch
chip tables

14. Analytics Time Machine
Starts at tracking 1 million
application flows in Real
Time and log 400Gb of
data over Fusion-io
without losing any
information.
The VM and application
level analytics are
available in Real Time and
via Time Machine for
outlier analysis and
historical monitoring
Logging on Fusion-IO device
and can be exported over
NFS, iSCSI
3rd party tools can be hosted
on Netvisor itself to process
and visualize the data
natively right inNetwork

15. F64-L E68-M F64-XLExample:
CLI (network-admin@aquila12) > connection-show start-time 16:00 end-time 16:30
switch vlan vxlan vnet client-ip server-ip server-port cur-state latency obytes ibytes total-bytes age
-------- ----- ---- ----- ---- ------------ --------------- ----------- --------- ------- ------ ------ ----------- --------
Aquila12 1 0 10.9.9.73 10.9.9.86 nfs fin 49.1us 45 29 74 1h30m54s
Aquila12 1 0 10.9.9.73 10.9.9.9 nfs fin 109us 45 29 74 1h30m54s
Aquila12 1 0 10.9.9.33 10.9.9.73 nfs fin 103us 45 29 74 1h31m
Aquila12 1 0 10.9.9.33 10.9.9.9 nfs fin 311us 45 29 74 1h31m
Aquila12 1 0 10.9.9.9 199.59.149.201 https rst 30.5ms 499 174 673 1h31m6s
Aquila12 1 0 10.9.10.177 10.9.18.158 http fin 306us 1.59K 3.01K 4.60K 1h31m7s
Aquila12 1 0 10.9.10.177 10.9.18.158 http fin 302us 2.72K 11.4K 14.2K 1h31m8s
Aquila12 1 0 10.9.9.9 199.59.149.201 https rst 22.4ms 499 174 673 1h31m9s
pn-dev03 1 0 10.9.18.149 10.20.100.88 http fin 32.1us 153 362 515 1h30m48s
pn-dev03 1 0 10.9.18.149 10.20.100.88 http fin 594us 152 255 407 1h30m48s
pn-dev03 1 0 10.9.9.151 10.20.3.9 8084 fin 312us 88 480 568 1h30m50s
pn-dev03 1 0 10.9.9.151 10.20.3.9 8443 rst 233us 4.33K 3.31K 7.65K 1h30m50s
pn-dev03 1 0 10.9.9.73 10.9.9.86 nfs fin 32.3us 45 29 74 1h30m54s
pn-dev03 1 0 10.9.9.73 10.20.9.79 nfs fin 222us 45 29 74 1h30m54s
Aquila12 1 0 10.9.10.177 10.9.18.158 http fin 302us 2.72K 11.4K 14.2K 1h31m21s
Aquila12 1 0 10.9.9.9 199.59.149.201 https rst 22.4ms 499 174 673 1h31m22s
Aquila12 1 0 10.9.10.177 10.9.18.158 http rst 210us 3.17K 39.9K 43.1K 1h31m22s
Aquila12 1 0 10.9.9.186 173.164.164.42 ssh fin 13.7ms 2.53K 2.80K 5.33K 1h31m23s

16. Fabric-Cluster Application
The vFlow Application
Flow abc
Flow xyz
Ability to capture,
analyze, modify,
redirect, drop, and
police flows across the
entire fabric-cluster from
any node in the cluster.
Fabric-wide Flow Programmability

17. Freedom SDN
Eliminate Scalability Bottleneck of
Controller-Based SDN
The Controller programs ONE logical device
Pluribus inNetwork SDN
High-BW, low latency, TRUE Server
programming of application flows!
Freedom Development Kit Libraries
CLI
Pluribus GUI

18. Fabric-Cluster Application
Virtual Networking Application
inNetwork Virtualization
VLAN:100-200 / 16K MAC VLAN:500-600 / 32K MACs VLAN:800-900 / 64K MACs
RED NETWORK BLUE NETWORK GREEN NETWORK
#1
Port
17-46
#1
Port
47-64
#3
Port
1-16
#2
Port
17-46
#3
Port
17-46
#2
Port
47-64
#3
Port
47-64
#2
Port
1-16
#1
Port
1-16

19. IP Network
Eliminate Separate Overlay-Underlay
VLAN/VXLAN

20. Freedom Use Cases
Switching/
Analytics
• inNetwork
Monitoring/Anal
ytics
• Clustering
• Congestion
Mgmt
• Large buffers
(NPU)
Stanford Dept. of
Electrical Engineering
Rack/Cloud
Controller
• OpenStack
• inNetwork
Virtualization
• Services
• Storage
• Analytics
• Devops tools
inNetwork
Apps
• Unix-style
Programmability
• Optimize rack
space and
power
• Run services in
the rack
• Latency play
SDN/NFV @
scale
• L4-L7 services
• High-perf
application flow
programmability

21. Netvisor 2.0
IP Services
Software Defined Fabric
Advanced Software Defined Fabric
Advanced
Virtualization and
Storage Service
HA Clustering,
Analytics and
Network Services
Enterprise L2/L3
Switching
• L2/L3 Switching
• IPv4/IPv6 Routing
• Multicast
• QoS
• ACL
• sFlow / SPAN
• HA Fabric-Cluster
• Fabric-wide Analytcs
• Fabric-wide vFlow
• Services: DHCP, DNS,
PXE Server, NAT,
• Controllers: Floodlight
(Openflow), OpenStack
• Red Hat Linux
OpenStack
• VXLAN Gateway (VTEP)
• VLAG
• Virtual Networks (VNETs)
• VMs for 3rd party apps
• VMs for 3rd party L4-L7
Svcs
• NAS: iSCSI, NFS, CIFS
• Storage Mirroring, RAID
• Per VNET Services
• Per VNET Controllers
• Advanced Analytics
Logging

22. Pluribus “Freedom” Portfolio At-A-Glance
Netvisor Freedom
Operating System
Three Tiers
IPS, SDF, ASDF
E-Series Server-Switch
(Broadcom Trident 2)
F-Series Server-Switch
(Intel Alta)
One Model
E68-M
Three Models
F64-M, F64-L, F64-XL
Front view
44 x10G/1G + 6 x 40G 48 x10G/1G + 4 x 40G
Front view

23. Converged
Infrastructure
Beyond
Traditional
Networks
Unify
Devops-Netops
Pluribus
Value
FASTER DELIVERY OF IT
APPLICATIONS / REDUCE MEAN
TIME TO PROBLEM RESOLUTION
Pluribus Business Value Proposition

24. Summary
• SDN on bare metal switches is seeing good interest and
moving into production
• Every customer is looking to use the switches to do more.
Some use cases seeing deployments:
• Analytics
• Security
• Application performance and debugging
• Services

26. Fabric-Cluster Application
The Fabric-Cluster Application
IP Network
Works over
ANY IP
Network