This document discusses Mellanox's CloudX solution for OpenStack clouds. It highlights how exponential data growth is driving the need for faster interconnects. Mellanox's CloudX architecture uses off-the-shelf components with Mellanox interconnects and provides performance advantages for storage, overlay networks, and virtualization. Mellanox also offers comprehensive integration with OpenStack through plugins to optimize networking and storage performance.

1. Tom Thirer, Sr. Director, Product Management
Erez Cohen, Sr. Director, Cloud Program
CloudX on OpenStack
OpenStack Israel, June 2014

2. © 2014 Mellanox Technologies 2- Mellanox Confidential -
Exponential Data Growth – Best Interconnect Required
0.8 Zettabyte
2009
35 Zettabyte
2020
44X
Source: IDC

3. © 2014 Mellanox Technologies 3- Mellanox Confidential -
The Future Depends on Fastest Interconnects
10Gb/s 40/56Gb/s1Gb/s

4. © 2014 Mellanox Technologies 4- Mellanox Confidential -
CloudX OpenCloud Architecture
Cloud Software, Plug-Ins, Automation
Mellanox Interconnect, Off-the Shelf Components

5. © 2014 Mellanox Technologies 5- Mellanox Confidential -
Leading Supplier of End-to-End Interconnect Solutions
Virtual Protocol Interconnect
Storage
Front / Back-End
Server / Compute Switch / Gateway
56G InfiniBand 56G InfiniBand
10/40/56GbE 10/40/56GbE
Virtual Protocol Interconnect
Host/Fabric SoftwareICs Switches/GatewaysAdapter Cards Cables/Modules
Comprehensive End-to-End InfiniBand and Ethernet Portfolio
Metro / WAN

6. © 2014 Mellanox Technologies 6- Mellanox Confidential -
Mellanox Advantages in the Cloud
Performance
Automation
Scalability &
Multi-tenancy
56Gb/s
OpenStack Storage (Cinder) over RDMA
SR-IOV accelerated performance
VXLAN & NVGRE HW offloads
Seamless Integration with Nova, Cinder
and Neutron core projects
Automated Deployment
Compatible with leading
OpenStack Vendors Supports Ethernet and InfiniBand
Efficient network convergence
End to end hardware based traffic
isolation and security features
Ethernet

7. © 2014 Mellanox Technologies 7- Mellanox Confidential -
OpenStack CloudX Physical Architecture Overview
 Hardware
• Off-the-shelf components
- Servers, storage, interconnect, software
• Mellanox 40/56Gb/s interconnect
- InfiniBand and Ethernet
• Solid State Drives (SSD)
• Latest CPU technology
 OpenStack components
• Nova compute
• Network controller node
• Storage node – Cinder, Ceph
• Mellanox OpenStack plug-ins
 Deployment and operations software
The Building Blocks for the Most Efficient Cloud
Internet
Compute Node 144
Compute Node 2
Compute Node 1
CentOS Linux + OFED
Puppet-agent
Nova-compute
MLNX-Neuron-plugin-agent
Controller Node 3 Act Storage Node 3 Act
API Network
1Gb Eth
Data Network
External Network
1Gb Eth
Cloud Management Network
Controller Node 2 Act
Controller Node 1 Act
CentOS Linux + OFED
Puppet-agent
Nova-API
Nova-scheduler
Keystone
Neutron-server
MySQL
Rabbit
Storage Node 2 Act
Storage Node 1 Act
CentOS Linux + OFED + Ceph
Puppet-agent
Cinder-volume-agent
Ceph-agent
SAS
HA
HA
Network Node 2 Pas
Network Node 1 Act
CentOS Linux + OFED
Puppet-agent
Neutron-Linux-Bridge
Neutron-DHCP- agent
Neutron-L3-agent
Neutron-VPN-agent
Mellanox UFM SDN
Appliance - HA
CloudX Deployment &
Orchestration Server
CentOS Linux + OFED
Puppet Server
PXE server
Storage Options

8. © 2014 Mellanox Technologies 8- Mellanox Confidential -
6200
1200 800
0
2000
4000
6000
8000
I/O Size - 64 [KB]Bandwidth
[MB/s]
SCSI Write Example, Linux KVM
iSER 16 VMs Write
10GbE
Fiber Channel - 8Gb
Accelerating Cloud Performance
Storage
Overlay Networks
Virtualization
2.5X
20X
6X
40
20
10
20
30
40
50
Message Size - 256 [bytes]
Latency[us]
VM-to-VM Latency Performance
TCP ParaVirtualization
RDMA Direct Access
Fibre Channel 8Gb
iSER 40GbE VMs Write
15
37.5
0
10
20
30
40
VXLAN
Bandwidth
[Gb/s] Bandwidth
W/O Offload
With Offload

9. © 2014 Mellanox Technologies 9- Mellanox Confidential -
Build Clouds with CloudX
“Mellanox provides our customers
with more features that they
couldn’t get with other clouds.”
- Robert Rizika, CEO, ProfitBricks
Public Clouds Private Clouds Cloud-in-a-Box

10. © 2014 Mellanox Technologies 10- Mellanox Confidential -
Mellanox CloudX World-Wide Deployments
Run Your Applications on CloudX
www.mellanox.com/cloudx

11. © 2014 Mellanox Technologies 11- Mellanox Confidential -
Comprehensive OpenStack Integration for Switch and Adapter
Integrated with Major
OpenStack
Distributions
In-Box With Havana and
Ice House
Neturon-ML2
support for
mixed
environment
Ethernet
Hardware
support for
performance
and security
(VXLAN, PV,
SRIOV)
Accelerating
storage
access by up
to 5x
OpenStack Plugins Create Seamless Integration , Control, & Management

12. © 2014 Mellanox Technologies 12- Mellanox Confidential -
Virtual Protocol Interconnect (VPI) Technology
64 ports 10GbE
36 ports 40/56GbE
48 10GbE + 12 40/56GbE
36 ports IB up to 56Gb/s
8 VPI subnets
Mezzanine Card
VPI Adapter VPI Switch
Ethernet: 10/40/56 Gb/s
InfiniBand:10/20/40/56 Gb/s
Unified Fabric Manager
Networking Storage Clustering Management
Applications
Acceleration Engines
LOM Adapter Card
3.0
From data center to
campus and metro
connectivity
Switch OS Layer

13. © 2014 Mellanox Technologies 13- Mellanox Confidential -
I/O Offload Frees Up CPU for Application Processing
~88% CPU
Efficiency
UserSpaceSystemSpace
~53% CPU
Efficiency
~47% CPU
Overhead/Idle
~12% CPU
Overhead/Idle
Without RDMA With RDMA and Offload
UserSpaceSystemSpace

14. © 2014 Mellanox Technologies 14- Mellanox Confidential -
What is iSER?
 iSER – iSCSI Extensions for RDMA
 Defined by IETF IP Storage WG
 Maps the iSCSI protocol over RDMA fabrics
 Leverages iSCSI management infrastructure
Ethernet (RoCE) / InfiniBand
SCSI Application Layer
iSCSI
iSER

15. © 2014 Mellanox Technologies 15- Mellanox Confidential -
Mellanox Accelerate OpenStack Cinder Storage
 Mellanox extends Cinder Project by adding
iSCSI over RDMA (iSER) support
Hypervisor (KVM)
OS
VM
OS
VM
OS
VM
Adapter
Open-iSCSI w iSER
Compute Servers
Switching Fabric
iSCSI/iSER Target (tgt)
Adapter Local Disks
RDMA Cache
Storage Servers
OpenStack (Cinder)
Utilizing OpenStack Built-in components and management
Tools to accelerate storage access
1.3
5.5
0
1
2
3
4
5
6
iSCSI over TCP iSER
GB/s
Cinder / Volume Storage Performance *
* iSER patches are available on OpenStack
branch: https://github.com/mellanox/openstack

16. © 2014 Mellanox Technologies 16- Mellanox Confidential -
Cinder Demo Video – TCP/IP Performance

17. © 2014 Mellanox Technologies 17- Mellanox Confidential -
Cinder Demo Video - Creating iSER volume

18. © 2014 Mellanox Technologies 18- Mellanox Confidential -
Cinder Demo Video – iSER Performance

19. © 2014 Mellanox Technologies 19- Mellanox Confidential -
Server
VM1 VM2 VM3 VM4
Overlay Networks: Shooting Star or Brave New World?
Overlay Network Virtualization: Isolation, Simplicity, Scalability
Virtual Domain 3
Virtual Domain 2
Virtual Domain 1
Physical
View
Server
VM5 VM6 VM7 VM8
Mellanox SDN Switches & Routers
Virtual
View
NVGRE/VXLAN Overlay Networks

20. © 2014 Mellanox Technologies 20- Mellanox Confidential -
Typical Overlay Network Deployment
OS
VM
OS
VM
OS
VM
UDP
OS
VM
BR0 BR1
VXLAN Overlay
IP
VNI100 VNI300Open vSwitch (OVS)
Underlay Network (Layer 2 or Layer 3)
Hypervisor
vTap vTap vTap vTap
OS
VM
OS
VM
OS
VM
UDP
OS
VM
BR0 BR1 BR2
VXLAN Overlay
IP
VNI100 VNI200 VNI300Open vSwitch (OVS)
Hypervisor
vTap vTap vTap vTap vTap
VxLAN Overlay
(tenant) networks
UDP
BR0 BR1
VXLAN
IP
VNI200 VNI300
Router / NAT
Software Gateway
vEth1vEth0
Internet
Gateway (Network) Nodes
OVS
SDN Manager e.g.
OpenStack Neutron,
ODL, VMware NSX
Generated by
the VM
Generated by
the Hypervisor
VXLAN Packet Format

21. © 2014 Mellanox Technologies 21- Mellanox Confidential -
Cloud 2.0 Technologies – Interconnect Offload Engines
 Challenge: Implementing overlay networks in software dramatically increases overheads and costs
 Solution: Use interconnect offload engines to handle all networking operations up to the VM
 Benefit: Reduce application cost, cloud CAPEX and OPEX
The Foundation of Cloud 2.0
The World’s First NVGRE / VXLAN Offloaded NIC

22. © 2014 Mellanox Technologies 22- Mellanox Confidential -
Cloud Overlay Acceleration Results With ConnectX-3 Pro 40GE

23. © 2014 Mellanox Technologies 23- Mellanox Confidential -
VXLAN Demo

24. © 2014 Mellanox Technologies 24- Mellanox Confidential -
Thank You
Reduces the Cost of Using Compute and Storage Infrastructure
Enables Applications to Use Much More Data at Real Time
to Get Conclusions and Make Business Decisions Faster
Test Your Applications on CloudX Platform
Join the Growing CloudX Eco-System
cloudx@mellanox.com, www.mellanox.com/cloudx

25. © 2014 Mellanox Technologies 25- Mellanox Confidential -
Thank YouThank You

26. © 2014 Mellanox Technologies 26- Mellanox Confidential -
Mellanox Advantages
• Support more VMs per server
• Offload hypervisor CPU
• Overlay networks
• Unlimited scalability
• Record braking throughput
• Record braking IOPS
• Higher storage density
• Centralized management (e.g. SDN)
• I/O consolidation (one wire)
• 56Gb/s per port with RDMA
• 2us for VM to VM connectivity
• Low CPU utilization
Higher
Performance
Cost Effective
Storage
Simplified and
Integrated
Solutions
Higher
Infrastructure
Efficiency
Maximizing Cloud Return on Investment