The document discusses the integration of Network Functions Virtualization (NFV) with OpenStack, outlining the involvement of prominent telecom operators and the opportunities presented by NFV for service providers. It details the architecture of NFV, challenges related to infrastructure, and ongoing projects in OpenStack aimed at enhancing NFV support, including features like VLAN trunking and high-performance networking. Additionally, it highlights performance improvements through 6windgate technology, which supports high bandwidth and low latency in virtualized environments.

1. NFV with OpenStack
Vincent Jardin Nick Barcet
CTO VP Products
6Wind eNovance
@VincentJardin @nijaba
Red Hat | NFV with 1 OpenStack | October 2014

2. Hello? The technology behind
Red Hat | NFV with 2 OpenStack | October 2014

3. Hello? The technology behind
Red Hat | NFV with 3 OpenStack | October 2014

4. Hello? The technology behind
Proprietary hardware
Red Hat | NFV with 4 OpenStack | October 2014

5. Hello? The technology behind
Full re-deployment for
each new generation
network
Red Hat | NFV with 5 OpenStack | October 2014

6. What if this went went virtual?
Red Hat | NFV with 6 OpenStack | October 2014

7. What if this went went virtual?
What if this went scalable?
Red Hat | NFV with 7 OpenStack | October 2014

8. What if this went went virtual?
What if this went scalable?
What if this was just like cloud?
Red Hat | NFV with 8 OpenStack | October 2014

9. Creation of ETSI NFV
● In November 2012 seven of the world's leading telecoms
network operators selected ETSI to be the home of the
Industry Specification Group for NFV.
● 2 years later: 230 individual companies including 37 of the
world's major service providers as well as representatives
from both telecoms and IT vendors.
Red Hat | NFV with 9 OpenStack | October 2014

10. NFV business opportunities
● Latest major disruption in the telco marketplace since IP
introduction
● Create opportunities for service providers:
● To accelerate development of new services
● To implement Network and IT convergence
● Force NEP
● To change their business model (transform themselves
as Software Providers)
● To redesign their software
Red Hat | NFV with 10 OpenStack | October 2014

11. OpenStack NFV subteam
● NFV support for OpenStack aims to provide the best
possible infrastructure for such workloads to be deployed
in, while respecting the design principles of a IaaS cloud.
● In order for VNF to perform correctly in a cloud world, the
underlying infrastructure needs to provide a certain number
of functionalities which range from scheduling to
networking and from orchestration to monitoring capacities.
● This means that to correctly support NFV use cases in
OpenStack, implementations may be required across most,
if not all, main OpenStack projects, starting with Neutron
and Nova.
https://wiki.openstack.org/wiki/Teams/NFV
Red Hat | NFV with 11 OpenStack | October 2014

12. 3 main specific problems for NFVi
● North/South connectivity requirements
Red Hat | NFV with 12 OpenStack | October 2014

13. 3 main specific problems for NFVi
● North <-> South connectivity requirements
● High Service Level Agreement requirements
Red Hat | NFV with 13 OpenStack | October 2014

14. 3 main specific problems for NFVi
● North <-> South connectivity requirements
● High Service Level Agreement requirements
● East <-> West connectivity requirements
Red Hat | NFV with 14 OpenStack | October 2014

15. NFV Simplified Architecture
Virtual Network Functions (VNFs)
VNF VNF VNF VNF VNF
Network Functions Virtualization Infrastructure (NFVi) NFV
Red Hat | NFV with 15 OpenStack | October 2014
Management
and
Orchestration
Virtual
Compute
Virtual
Storage
Virtual
Network
Virtualization Layer
Compute Storage Network
Hardware resources

16. Use Cases
Workload Type Description Characteristics Examples
Data plane Tasks related to packet handing
in an end-to-end
communication between edge
applications.
Intensive I/O requirements -
potentially millions of small VoIP
packets per second per core
Intensive memory R/W
requirements
Red Hat | NFV with 16 OpenStack | October 2014
CDN cache node
Router
IPSec tunneller
Session Border Controller - media relay
function
Control plane Any other communication
between network functions that
is not directly related to the
end-to-end data communication
between edge applications.
Less intensive I/O and R/W
requirements than data plane,
due to lower packets per second
More complicated transactions
resulting in (potentially) higher
CPU load per packet.
PPP session management
Border Gateway Protocol (BGP) routing
Remote Authentication Dial In User
Service (RADIUS) authentication in a
Broadband Remote Access Server
(BRAS) network function
Session Border Controller - SIP signaling
function
IMS core functions (S-CSCF / I-CSCF /
BGCF)
Signal processing All network function tasks
related to digital processing
Very sensitive to CPU processing
capacity.
Delay sensitive.
Fast Fourier Transform (FFT) decoding
Encoding in a Cloud-Radio Access
Network (C-RAN) Base Band Unit (BBU)
Audio transcoding in a Session Border
Controller
Storage All tasks related to disk storage. Varying disk, SAN, or NAS, I/O
requirements based on
applications, ranging from low to
extremely high intensity.
Logger
Network probe

17. Blueprints implemented in Juno
Description Project(s) Status
Support two interfaces from
one VM attached to the same
network
Nova Design Approved / Implemented
SR-IOV Networking Support Nova Design Approved / Needs Code Review
Virt driver guest vCPU topology
configuration
Nova Design Approved / Implemented
Evacuate instance to
scheduled host
Nova Approved / Implemented (juno-2)
Red Hat | NFV with 17 OpenStack | October 2014

18. What's brewing for Kilo? (Highest Priority)
Description Project(s) Status
● VLAN trunking networks for NFV
● VLAN tagged traffic transmissible over a
tenant network
● decomposition of VLAN trunks to virtual
networks
● VLAN tagged traffic to a physical
appliance
● management of VLANs on ports as sub-ports
Neutron New
Permit unaddressed interfaces for NFV use
cases
Neutron New
Red Hat | NFV with 18 OpenStack | October 2014

19. What's brewing for Kilo (the rest)
Description Project(s) Status Description Project(s) Status
Discless VM Nova Under discussion Port mirroring Neutron Under discussion
Framework for Advanced
Neutron Under Discussion Schedule vms per flavour
Services in Virtual
cpu overcommit
Machines
Red Hat | NFV with 19 OpenStack | October 2014
Nova New
I/O (PCIe) Based NUMA
Scheduling
Nova Design Approved / Needs
Code Review
Snabb NFV mechanism
driver
Neutron Approved
Network QoS API Neutron Under discussion Solver Scheduler -
complex constraints
scheduler with NFV use
cases
Nova Design review in progress
Neutron Services
Insertion, Chaining, and
Steering
Neutron Design Approved / Needs
Code Review
Support userspace vhost
in ovs vif bindings
Nova Design review in progress
NIC state aware
scheduling
Nova Rejected Traffic Steering Abstraction Neutron Design review in progress
Open vSwitch to use patch
ports in place of veth pairs
for vlan n/w
Neutron Superseded / Unknown VIF_VHOSTUSER (qemu
vhost-user) support
Nova Approved
Open vSwitch-based
Security Groups: Open
vSwitch Implementation of
FirewallDriver
Neutron Design review in progress Virt driver guest NUMA
node placement &
topology
Nova Design Approved / Needs
Code Review
OVF Meta-Data Import via
Glance
Glance New Virt driver large page
allocation for guest RAM *
Nova Design Approved / Needs
Code Review
Persist scheduler hints Nova Design review in progress Virt driver pinning guest
vCPUs to host pCPUs
Nova Design Approved / Needs
Code Review

20. Openstack related challenges
● Cultural Changes:
● Introduction of devops, Continuous Integration, …
● Work with opensource communities
● No more standards...
● 80% is good enough...
● Technical, R&D:
● Openstack is evolving very fast (major release every 6 months)
● Limited availability of skills
● Redesign of application to become cloud application
● Operation:
● Need to educate/train people
Red Hat | NFV with 20 OpenStack | October 2014

21. North ↔ South
East ↔ West
Virtual Network Performances
With 6WIND
Red Hat | NFV with 21 OpenStack | October 2014

22. Performance first

23. High Performance East-West Communications
Virtual Machine
Application
Linux
Virtual Machine
Application
Windows
Virtual Machine
Application
Any
OS
Virtual Machine
Application
Any
OS
Hypervisor
Virtual Switch
Throughput
Hardware Independence
©6WIND 2014 v9.3 | 23

24. What if SRIOV?
or what if XYZ PCI passthru technologies?
High Performance East-West Communications
Virtual Machine
Application
Linux
Virtual Machine
Application
Windows
Virtual Machine
Application
Any
OS
Virtual Machine
Application
Any
OS
Throughput
Hypervisor SR-IOV
Hardware Independence
©6WIND 2014 v9.3 | 24

25. Typical NFV Performance Bottlenecks
Virtual
Machine
Application
Software
Virtual
Machine
Application
Software
Hypervisor
Virtual Switch
4
Virtual Machine Bottleneck
Communication Bottleneck - Host vs Guest OS
2
Virtual Switch Bottleneck
1 Driver Level Bottleneck
3
Server Platform
©6WIND 2014 v9.3 | 25

26. 6WINDGate for Industry-Leading Processor Platforms
Architecture-independent “Fast Path Modules”
• Generic, processor-independent source code
• Cycle-level and pipeline-level optimizations
Architecture-specific "Fast Path Networking SDK"
• Zero-overhead API for fast path modules
• Support for processor-specific features and resources
• Leverages processor suppliers' SDKs
Data
Fast PPalathne
FPNF-PSND-KSDK
FPNFP-SND-SKDK
NetOS Simple Exec DPDK ZoL™
©6WIND 2014 v9.3 | 26

27. Linux Acceleration via 6WINDGate
 Standard Linux functions are accelerated by
6WINDGate
Linux Compatibility is Critical
Quagga
iptables iproute2
Linux Networking
Stack
Linux Kernel
Fast Path Configuration
Fast Path Statistics
Fast Path Modules
Fast Path
Protocol
Tables
Shared
Memory
Statistics
©6WIND 2014 v9.3 | 27

28. Neutron’s protocols – strong needs from a fast path
6WINDGate fast path
Nova Neutron
VLAN Link
IPv4/IPv6
Forwarding
Say no to proprietary
MPLS/VPLS
Encapsulation
Aggregation
GRE
Ethernet
Bridging
IPv4/IPv6 Multi-cast
Filtering
IPv4/IPv6
NAT
Flow Inspection
VXLAN
Tunneling
(IPinIP)
IPsec IPv4/IPv6
Openstack
6WINDGate
DPDK
VIRTIO Guest
XEN-KVM PMD
Cavium NITROX
SDK 5.X Crypto
VMXNET3 Guest Fast vNIC PMD
VMware PMD
OVS
Acceleration
Intel® QuickAssist
Crypto
Intel® Multi-Buffer
Crypto
Mellanox
ConnectX®-3 EN
Series PMD
6WINDGate FPN-SDK
Emulex
OCE14000 Series
©6WIND 2014 v9.3 | 28
PMD
QoS
plugins
Say no to SRIOV to
be SDN ready.
Accelerate Neutron

29. 6WINDGate Extensions to Virtualization
Virtual
Appliance
(DPDK-based)
Virtual
Appliance
(Linux-based)
Virtual
Appliance
(Other
OSs)
Fast
vNIC
PMD
VirtioG
uest
PMD
Drivers for Virtual Appliance
• 6WIND drivers for high performance
communications
• Standard drivers for existing Virtual
Appliances
• Extensible for all OSs
Virtual Acceleration
• 6WIND drivers for high performance
communications
• Accelerated virtual switch and bridging
• Extended network services
• Dpdk.org with multi-vendor NIC support
OVS Acceleration
NICs
Fast
vNIC
Linux
Virtio
Guest
Linux
Fast vNIC PMD Virtio Host PMD
IPsec
Filtering
NAT
Forwarding
Ethernet Bridge
VLAN VXLAN
GRE LAG
Fast
vNIC
Intel PMD Mellanox PMD Emulex PMD
Virtio
Guest
©6WIND 2014 v9.3 | 29

30. 6WINDGate NFVI + VM Performance Comparison
IPv4/IPv6 Forwarding
DPDK
Fast vNIC PMD
Fast vNIC PMD
Virtual Networking
R720 12 x 10G
Traffic
Generator
Fast
Path
Fast
Path
DPDK
Virtual Machine
Hypervisor
Linux kernel
Ports
©6WIND 2014 v9.3 | 30

31. Test 1:
Standard Open vSwitch + Virtio
IPv4/IPv6
Forwarding
Virtio Guest
Bottleneck
Virtio Host Linux
Linux kernel
Kernel Drivers
R720 12 x 10G
Traffic
Generator
Linux Based Virtual
Machine
Hypervisor
Linux
Ports
Bottleneck
Bottleneck
L2 Throughput
7,2 Gbps
Limited Bandwidth To
Linux Based Virtual
Machines
Bottleneck
©6WIND 2014 v9.3 | 31

32. Test 2:
6WINDGate OVS Acceleration + Fast vNIC Linux
IPv4/IPv6
Forwarding
Fast vNIC Linux
Fast vNIC PMD
Virtual
Networking
DPDK
Linux kernel
R720 12 x 10G
Traffic
Generator
Linux Based Virtual
Machine
Hypervisor
Ports
L2 Throughput
7,2 Gbps
59 Gbps
9X Throughput
Bottleneck
Performance Increase
Fast
Path
©6WIND 2014 v9.3 | 32

33. Test 3:
6WINDGate OVS Acceleration + Fast vNIC PMD
IP Forwarding
DPDK
Fast vNIC PMD
Fast vNIC PMD
Virtual
Networking
DPDK
Linux kernel
R720 12 x 10G
Traffic
Generator
DPDK Based Virtual
Machine
Hypervisor
Ports
L2 Throughput
7,2 Gbps
59 Gbps
118 Gbps
Wire Speed
Performance
Fast
Path
Fast
Path
©6WIND 2014 v9.3 | 33

34. Compute nodes with 6WINDGate, Openstack-horizon
Compute node/host:
# yum install 6windgate*.rpm
# systemctl enable 6windgate.service
©6WIND 2014 v9.3 | 34

35. Virtual Switch-Based NFVI
Lowest Latency and Flexible Chaining
Virtual
Network
Function
Virtual
Network
Function
Virtual
Network
Function
500 Gbps
6WINDGate Accelerated OVS
PCI Express
Local NIC
External Switch
Virtual Switching With 6WINDGate
• Hardware independent virtual switching (NIC driver)
• Aggregate 500 Gbps bandwidth with low latency
• No external limit to number of chained VNFs
Physical Switching Limitations
• Hardware dependent switching
(SR-IOV, RDMA, NIC embedded switching)
• Throughput is limited by PCI Express (50 Gbps) and
faces PCI Express and DMA additional latencies
• Available PCI slots limit the number of chained VNFs
• At 30 Gbps a single VNF is supported per node!
50
Gbps
©6WIND 2014 v9.3 | 35

36. ©6WIND 2014 v9.3 | 36

37. DPDK.org meetup – Jeudi prochain – Santa
Clara @ 6WIND
©6WIND 2014 v9.3 | 37

38. THANK YOU!
Red Hat | NFV with 38 OpenStack | October 2014