CloudX on OpenStack

Tom Thirer, Sr. Director, Product Management
Erez Cohen, Sr. Director, Cloud Program
CloudX on OpenStack
OpenStack Israel, June 2014

© 2014 Mellanox Technologies 2- Mellanox Confidential -
Exponential Data Growth – Best Interconnect Required
0.8 Zettabyte
2009
35 Zettabyte
2020
44X
Source: IDC

The Future Depends on Fastest Interconnects
10Gb/s 40/56Gb/s1Gb/s

CloudX OpenCloud Architecture
Cloud Software, Plug-Ins, Automation
Mellanox Interconnect, Off-the Shelf Components

Leading Supplier of End-to-End Interconnect Solutions
Virtual Protocol Interconnect
Storage
Front / Back-End
Server / Compute Switch / Gateway
56G InfiniBand 56G InfiniBand
10/40/56GbE 10/40/56GbE
Virtual Protocol Interconnect
Host/Fabric SoftwareICs Switches/GatewaysAdapter Cards Cables/Modules
Comprehensive End-to-End InfiniBand and Ethernet Portfolio
Metro / WAN

Mellanox Advantages in the Cloud
Performance
Automation
Scalability &
Multi-tenancy
56Gb/s
OpenStack Storage (Cinder) over RDMA
SR-IOV accelerated performance
VXLAN & NVGRE HW offloads
Seamless Integration with Nova, Cinder
and Neutron core projects
Automated Deployment
Compatible with leading
OpenStack Vendors Supports Ethernet and InfiniBand
Efficient network convergence
End to end hardware based traffic
isolation and security features
Ethernet

OpenStack CloudX Physical Architecture Overview
 Hardware
• Off-the-shelf components
- Servers, storage, interconnect, software
• Mellanox 40/56Gb/s interconnect
- InfiniBand and Ethernet
• Solid State Drives (SSD)
• Latest CPU technology
 OpenStack components
• Nova compute
• Network controller node
• Storage node – Cinder, Ceph
• Mellanox OpenStack plug-ins
 Deployment and operations software
The Building Blocks for the Most Efficient Cloud
Internet
Compute Node 144
Compute Node 2
Compute Node 1
CentOS Linux + OFED
Puppet-agent
Nova-compute
MLNX-Neuron-plugin-agent
Controller Node 3 Act Storage Node 3 Act
API Network
1Gb Eth
Data Network
External Network
1Gb Eth
Cloud Management Network
Controller Node 2 Act
Controller Node 1 Act
CentOS Linux + OFED
Puppet-agent
Nova-API
Nova-scheduler
Keystone
Neutron-server
MySQL
Rabbit
Storage Node 2 Act
Storage Node 1 Act
CentOS Linux + OFED + Ceph
Puppet-agent
Cinder-volume-agent
Ceph-agent
SAS
HA
HA
Network Node 2 Pas
Network Node 1 Act
CentOS Linux + OFED
Puppet-agent
Neutron-Linux-Bridge
Neutron-DHCP- agent
Neutron-L3-agent
Neutron-VPN-agent
Mellanox UFM SDN
Appliance - HA
CloudX Deployment &
Orchestration Server
CentOS Linux + OFED
Puppet Server
PXE server
Storage Options

6200
1200 800
0
2000
4000
6000
8000
I/O Size - 64 [KB]Bandwidth
[MB/s]
SCSI Write Example, Linux KVM
iSER 16 VMs Write
10GbE
Fiber Channel - 8Gb
Accelerating Cloud Performance
Storage
Overlay Networks
Virtualization
2.5X
20X
6X
40
20
10
20
30
40
50
Message Size - 256 [bytes]
Latency[us]
VM-to-VM Latency Performance
TCP ParaVirtualization
RDMA Direct Access
Fibre Channel 8Gb
iSER 40GbE VMs Write
15
37.5
0
10
20
30
40
VXLAN
Bandwidth
[Gb/s] Bandwidth
W/O Offload
With Offload

Build Clouds with CloudX
“Mellanox provides our customers
with more features that they
couldn’t get with other clouds.”
- Robert Rizika, CEO, ProfitBricks
Public Clouds Private Clouds Cloud-in-a-Box

Mellanox CloudX World-Wide Deployments
Run Your Applications on CloudX
www.mellanox.com/cloudx

Comprehensive OpenStack Integration for Switch and Adapter
Integrated with Major
OpenStack
Distributions
In-Box With Havana and
Ice House
Neturon-ML2
support for
mixed
environment
Ethernet
Hardware
support for
performance
and security
(VXLAN, PV,
SRIOV)
Accelerating
storage
access by up
to 5x
OpenStack Plugins Create Seamless Integration , Control, & Management

Virtual Protocol Interconnect (VPI) Technology
64 ports 10GbE
36 ports 40/56GbE
48 10GbE + 12 40/56GbE
36 ports IB up to 56Gb/s
8 VPI subnets
Mezzanine Card
VPI Adapter VPI Switch
Ethernet: 10/40/56 Gb/s
InfiniBand:10/20/40/56 Gb/s
Unified Fabric Manager
Networking Storage Clustering Management
Applications
Acceleration Engines
LOM Adapter Card
3.0
From data center to
campus and metro
connectivity
Switch OS Layer

I/O Offload Frees Up CPU for Application Processing
~88% CPU
Efficiency
UserSpaceSystemSpace
~53% CPU
Efficiency
~47% CPU
Overhead/Idle
~12% CPU
Overhead/Idle
Without RDMA With RDMA and Offload
UserSpaceSystemSpace

What is iSER?
 iSER – iSCSI Extensions for RDMA
 Defined by IETF IP Storage WG
 Maps the iSCSI protocol over RDMA fabrics
 Leverages iSCSI management infrastructure
Ethernet (RoCE) / InfiniBand
SCSI Application Layer
iSCSI
iSER

Mellanox Accelerate OpenStack Cinder Storage
 Mellanox extends Cinder Project by adding
iSCSI over RDMA (iSER) support
Hypervisor (KVM)
OS
VM
OS
VM
OS
VM
Adapter
Open-iSCSI w iSER
Compute Servers
Switching Fabric
iSCSI/iSER Target (tgt)
Adapter Local Disks
RDMA Cache
Storage Servers
OpenStack (Cinder)
Utilizing OpenStack Built-in components and management
Tools to accelerate storage access
1.3
5.5
0
1
2
3
4
5
6
iSCSI over TCP iSER
GB/s
Cinder / Volume Storage Performance *
* iSER patches are available on OpenStack
branch: https://github.com/mellanox/openstack

Cinder Demo Video – TCP/IP Performance

Cinder Demo Video - Creating iSER volume

Cinder Demo Video – iSER Performance

Server
VM1 VM2 VM3 VM4
Overlay Networks: Shooting Star or Brave New World?
Overlay Network Virtualization: Isolation, Simplicity, Scalability
Virtual Domain 3
Virtual Domain 2
Virtual Domain 1
Physical
View
Server
VM5 VM6 VM7 VM8
Mellanox SDN Switches & Routers
Virtual
View
NVGRE/VXLAN Overlay Networks

Typical Overlay Network Deployment
OS
VM
OS
VM
OS
VM
UDP
OS
VM
BR0 BR1
VXLAN Overlay
IP
VNI100 VNI300Open vSwitch (OVS)
Underlay Network (Layer 2 or Layer 3)
Hypervisor
vTap vTap vTap vTap
OS
VM
OS
VM
OS
VM
UDP
OS
VM
BR0 BR1 BR2
VXLAN Overlay
IP
VNI100 VNI200 VNI300Open vSwitch (OVS)
Hypervisor
vTap vTap vTap vTap vTap
VxLAN Overlay
(tenant) networks
UDP
BR0 BR1
VXLAN
IP
VNI200 VNI300
Router / NAT
Software Gateway
vEth1vEth0
Internet
Gateway (Network) Nodes
OVS
SDN Manager e.g.
OpenStack Neutron,
ODL, VMware NSX
Generated by
the VM
Generated by
the Hypervisor
VXLAN Packet Format

Cloud 2.0 Technologies – Interconnect Offload Engines
 Challenge: Implementing overlay networks in software dramatically increases overheads and costs
 Solution: Use interconnect offload engines to handle all networking operations up to the VM
 Benefit: Reduce application cost, cloud CAPEX and OPEX
The Foundation of Cloud 2.0
The World’s First NVGRE / VXLAN Offloaded NIC

Cloud Overlay Acceleration Results With ConnectX-3 Pro 40GE

VXLAN Demo

Thank You
Reduces the Cost of Using Compute and Storage Infrastructure
Enables Applications to Use Much More Data at Real Time
to Get Conclusions and Make Business Decisions Faster
Test Your Applications on CloudX Platform
Join the Growing CloudX Eco-System
cloudx@mellanox.com, www.mellanox.com/cloudx

Thank YouThank You

Mellanox Advantages
• Support more VMs per server
• Offload hypervisor CPU
• Overlay networks
• Unlimited scalability
• Record braking throughput
• Record braking IOPS
• Higher storage density
• Centralized management (e.g. SDN)
• I/O consolidation (one wire)
• 56Gb/s per port with RDMA
• 2us for VM to VM connectivity
• Low CPU utilization
Higher
Performance
Cost Effective
Storage
Simplified and
Integrated
Solutions
Higher
Infrastructure
Efficiency
Maximizing Cloud Return on Investment

CloudX on OpenStack

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to CloudX on OpenStack

Similar to CloudX on OpenStack (20)

More from Cloud Native Day Tel Aviv

More from Cloud Native Day Tel Aviv (20)

Recently uploaded

Recently uploaded (20)

CloudX on OpenStack

Editor's Notes