DPDK	Summit	- San	Jose	– 2017
Nishant Lodha,	Cavium	Inc
“Serverless” DPDK
#DPDKSummit
2
DPDK
Everywhere
3#DPDKSummit
Agenda
u SmartNIC	Market	Share	and	Projections
u Current	and	Emerging	SmartNIC	Use	Cases
u Challenges	with	current	generation	SmartNICs
u Accelerating	Next	Gen	SmartNICs with	DPDK
u Nirvana?
4
©2017 Cavium Proprietary and Confidential
What	is	a	SmartNIC?
Common	Features
§ Stateless	Offloads	
§ Tunneling/Overlays:	 	VXLAN,	NVGRE,	GENEVE
§ SR-IOV
§ DPDK	PMDs
Standard	NIC
§ Speed	transitions	10G/25G/40G/50G/100G	
§ General	purpose	offloads	- RDMA,	Storage
§ Hardwired	or	Micro-coded	or		mix
Smart	NICs
§ Multi-core	/	Network	Processor	based	Adapters
§ Crypto	Accelerator	w/	IPSEC	/	SSL	
§ OVS	Offload,	Business	Application	offload
§ Customer	Programmable
SmartNIC
Standard	NIC
5
©2017 Cavium Proprietary and Confidential
SmartNIC	Market	Size:	2016-2021	(Network	Acceleration)
Cavium	Built	Model	for	10GbE	&	Higher	Speeds
$-
$200
$400
$600
$800
$1,000
$1,200
$1,400
$1,600
$1,800
Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC
2016 2017 2018 2019 2020 2021
$M
T1 MDC T2 Cloud/Telco Enteprise/Private Storage
$768
$942
$1,460
$1,576
$72 $101
$240
$573
$1,248
$1,530
$141
$381
6
SmartNIC	is	a	platform	for	Innovation
Key	Markets
All server compute resources need to have a revenue tie-in
7
OVS	+	IPsec	Performance	Benchmark
Benchmarking Test Setup
Plain	Text
Encrypted	Text
0
2
4
6
8
10
12
14
Host based OVS +
IPsec
SmartNIC OVS +
IPsec
Numberofcoresused
CPU Usage in the host
Available Used
Performance
0
1
2
3
4
5
6
7
8
9
10
64 Bytes 512 Bytes 1024 Bytes 1400 Bytes
ThroughputinGbps
message Size
Host based OVS + IPsec SmartNIC OVS + IPsec
8
Current Approach to OVS Offload on SmartNIC
• Proprietary:	SimpleExec - Run	
to	completion	model,	SDK
• Deployment	Model:	Packaged	
solution	or	SDK
• Implications:	Platform	specific	
skills,	customer	application	
porting,	time	to	market,	
ecosystem
• Need	to	simplify	the	SmartNIC
• Require	a	new	Networking	
Data	Plane
Challenges
x86	Userspace
x86	Kernel
PCI	Express	Slot
SmartNIC
X86	Userspace
x86	kernel
OVS-DB	Server OVSDB
port	1 port	2
PF PF
eth0 eth1
Accelerated	Data	Path
vSwitchd
VM
Apps
VM
Apps
OVS	Data	path
VM
DPDK
Apps
VM
DPDK
Apps
VM
Apps
Controller
Server
SmartNIC	accelerates	the	OVS	Data	path	and	restores	CPU	cores	back	to	the	server
9
©2017 Cavium Proprietary and Confidential
Open	Architecture
Upstream	Linux
Standard	DPDK
Next	Gen	SmartNIC
DPDK	for	the	Networking	Dataplane
MIPS	Based	Architecture
SDK
Sample	Applications
ARMv8	Cores
Standard	Linux
DPDK
Current	Gen	SmartNIC
MIPS
ARM
10
©2017 Cavium Proprietary and Confidential
u DPDK	is	a	“Proven”	networking	dataplane
u Majority	of	networking	applications	on	x86	are	written	for	DPDK
u Performance;	Innovation;	Licensing
Why	DPDK?
u SmartNICs growth	in	Telco	/	NFV	Use	Cases
u ARMv8	ecosystem	enables	DPDK	acceleration
u BYOA	- Path	of	least	resistance	– offloading	NFV	apps	to	SmartNICs
11
©2017 Cavium Proprietary and Confidential
Before
and
After
mgmt0
PMD PMD PMD PMD
Kernel
User
HW OffloadBlocks
OVS-DPDK
vhost-user
12
©2017 Cavium Proprietary and Confidential
Taking DPDK to a embedded
processor?
• Limited compute and memory resources
• Polling/Hogging
• Fixed Power Envelope
DPDK Version Dependency for NFV
Apps
A simplified way of leveraging HW
provided offloads
Performance?
Potential
Challenges
13
Questions?
u SmartNIC	Panel	Discussion	at	11:40am!
That’s it!

LF_DPDK17_Serverless DPDK - How SmartNIC resident DPDK Accelerates Packet Processing

  • 1.
    DPDK Summit - San Jose – 2017 NishantLodha, Cavium Inc “Serverless” DPDK #DPDKSummit
  • 2.
  • 3.
    3#DPDKSummit Agenda u SmartNIC Market Share and Projections u Current and Emerging SmartNIC Use Cases uChallenges with current generation SmartNICs u Accelerating Next Gen SmartNICs with DPDK u Nirvana?
  • 4.
    4 ©2017 Cavium Proprietaryand Confidential What is a SmartNIC? Common Features § Stateless Offloads § Tunneling/Overlays: VXLAN, NVGRE, GENEVE § SR-IOV § DPDK PMDs Standard NIC § Speed transitions 10G/25G/40G/50G/100G § General purpose offloads - RDMA, Storage § Hardwired or Micro-coded or mix Smart NICs § Multi-core / Network Processor based Adapters § Crypto Accelerator w/ IPSEC / SSL § OVS Offload, Business Application offload § Customer Programmable SmartNIC Standard NIC
  • 5.
    5 ©2017 Cavium Proprietaryand Confidential SmartNIC Market Size: 2016-2021 (Network Acceleration) Cavium Built Model for 10GbE & Higher Speeds $- $200 $400 $600 $800 $1,000 $1,200 $1,400 $1,600 $1,800 Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC Smart NIC L2 NIC 2016 2017 2018 2019 2020 2021 $M T1 MDC T2 Cloud/Telco Enteprise/Private Storage $768 $942 $1,460 $1,576 $72 $101 $240 $573 $1,248 $1,530 $141 $381
  • 6.
  • 7.
    7 OVS + IPsec Performance Benchmark Benchmarking Test Setup Plain Text Encrypted Text 0 2 4 6 8 10 12 14 Hostbased OVS + IPsec SmartNIC OVS + IPsec Numberofcoresused CPU Usage in the host Available Used Performance 0 1 2 3 4 5 6 7 8 9 10 64 Bytes 512 Bytes 1024 Bytes 1400 Bytes ThroughputinGbps message Size Host based OVS + IPsec SmartNIC OVS + IPsec
  • 8.
    8 Current Approach toOVS Offload on SmartNIC • Proprietary: SimpleExec - Run to completion model, SDK • Deployment Model: Packaged solution or SDK • Implications: Platform specific skills, customer application porting, time to market, ecosystem • Need to simplify the SmartNIC • Require a new Networking Data Plane Challenges x86 Userspace x86 Kernel PCI Express Slot SmartNIC X86 Userspace x86 kernel OVS-DB Server OVSDB port 1 port 2 PF PF eth0 eth1 Accelerated Data Path vSwitchd VM Apps VM Apps OVS Data path VM DPDK Apps VM DPDK Apps VM Apps Controller Server SmartNIC accelerates the OVS Data path and restores CPU cores back to the server
  • 9.
    9 ©2017 Cavium Proprietaryand Confidential Open Architecture Upstream Linux Standard DPDK Next Gen SmartNIC DPDK for the Networking Dataplane MIPS Based Architecture SDK Sample Applications ARMv8 Cores Standard Linux DPDK Current Gen SmartNIC MIPS ARM
  • 10.
    10 ©2017 Cavium Proprietaryand Confidential u DPDK is a “Proven” networking dataplane u Majority of networking applications on x86 are written for DPDK u Performance; Innovation; Licensing Why DPDK? u SmartNICs growth in Telco / NFV Use Cases u ARMv8 ecosystem enables DPDK acceleration u BYOA - Path of least resistance – offloading NFV apps to SmartNICs
  • 11.
    11 ©2017 Cavium Proprietaryand Confidential Before and After mgmt0 PMD PMD PMD PMD Kernel User HW OffloadBlocks OVS-DPDK vhost-user
  • 12.
    12 ©2017 Cavium Proprietaryand Confidential Taking DPDK to a embedded processor? • Limited compute and memory resources • Polling/Hogging • Fixed Power Envelope DPDK Version Dependency for NFV Apps A simplified way of leveraging HW provided offloads Performance? Potential Challenges
  • 13.
  • 14.