EMC & OpenStack:
A View from Within
Edgar StPierre
Sr. Consulting Solutions Architect

© Copyright 2013 EMC Corporation. All rights reserved.

1
Roadmap Information Disclaimer
 EMC makes no representation and undertakes no obligations with
regard to product planning information, anticipated product
characteristics, performance specifications, or anticipated release
dates (collectively, “Roadmap Information”).
 Roadmap Information is provided by EMC as an accommodation to the
recipient solely for purposes of discussion and without intending to be
bound thereby.
 Roadmap information is EMC Restricted Confidential and is provided
under the terms, conditions and restrictions defined in the EMC NonDisclosure Agreement in place with your organization.

© Copyright 2013 EMC Corporation. All rights reserved.

2
Agenda
 EMC Storage and OpenStack – Strategy Overview
 An OpenStack Technology Review
 EMC Participation And Contribution
 EMC Value-Add

© Copyright 2013 EMC Corporation. All rights reserved.

3
Mission Statement
"To produce the ubiquitous Open Source cloud computing platform
that will meet the needs of public and private cloud providers
regardless of size, by being simple to implement and massively
scalable."

Source: OpenStack Foundation

© Copyright 2013 EMC Corporation. All rights reserved.

4
OpenStack: Open Source Cloud OS
 Public clouds – level the playing field
against “the big three”
– Major Opportunists: Rackspace, HP
– And many more…

 Private clouds – open the door to
many distributors

…

Virtual
Data
Center

Virtual
Data
Center

Virtual
Data
Center

Virtual
Data
Center

Virtual
Data
Center

Virtual
Data
Center

– Canonical, Red Hat, SUSE,
Rackspace, and a host of others…
– And create opportunity for customers
to manage lower cost, and ultimately
flexible, private clouds

© Copyright 2013 EMC Corporation. All rights reserved.

5
Virtualized Data Centers

Resource disaggregation fundamental to Software Defined Data Centers
Favorite Cloud OS & Configuration Mgmt System
Favorite Hypervisor
CPU Pool

Mem Pool

Network Virtualizer
IP Pool

Service Pool

Storage Virtualizer
Storage Pool1

Storage Pool2

VM

© Copyright 2013 EMC Corporation. All rights reserved.

6
Disaggregation of Storage Resources
OpenStack
VM

VM

Hypervisor
DFS/LVM

 Disaggregation at host level
–
–
–

Roll-your-own storage nodes with services
based on a DFS or LVM
All storage and data services on storage
node
This is SDDC goal for many apps

 Disaggregation at array level
–
–
–
–
–

© Copyright 2013 EMC Corporation. All rights reserved.

Not as flexible/ubiquitous as disaggregation
at host level
But: proven, performant, and inherently
resilient
Storage arrays have been disaggregating
disks for years
Array-based storage & data services
This is topic for today

7
EMC Strategy For CloudOS Options
“Just say yes”

 Across Variety Of CloudOS Platforms
 Variety of Solutions Within Each CloudOS Platform
 Continuously Evolve Solutions To Support Customer
Options

© Copyright 2013 EMC Corporation. All rights reserved.

8
OpenStack
Technology Review

© Copyright 2013 EMC Corporation. All rights reserved.

9
The OpenStack Layer Cake
GUI

(Horizon)

App Orchestration

Presentation

Python CLIs

(Separate projects)

(Heat)

Admin
APIs

OpenStack API

(Both a native REST API plus an EC2-compatible API)

IAM

(Keystone)

Object

(MySQL)

Integration

Resources

© Copyright 2013 EMC Corporation. All rights reserved.

(Cinder)

(Quantum)

Policy

Policy

Scheduling

Scheduling

Scheduling

Orchestration

Orchestration
Adapters

Metrics

Policy

Adapters

Database

(Nova)

Scheduling
Control Logic

(Glance)
Policy

(Swift)

Messaging
(RabbitMQ)

Images Compute Storage Network

Orchestration Orchestration
Adapters

Adapters

(Ceilometer)

3rd Party
Monitoring
Tools
Administration

10
Creating An Ephemeral VM
1. POST /{tenant_id}/servers (…, imageRef, …)

Client

OpenStack API

(Both a native REST API plus an EC2-compatible API)
5. GET image

Object
(Swift)

Images Compute Storage Network
(Glance)

(Cinder)

(Nova)

4. GET image

(Quantum)

2. Allocate Network
3. GET image

Swift / NFS

8. Boot

6. Upload
7. Load

VM
KVM

© Copyright 2013 EMC Corporation. All rights reserved.

11
Attaching A Persistent Block Volume
1. POST /{tenant_id}/volumes

Client

3. POST /{tenant_id}/servers/{server_id}/os-volume_attachments (…, volume_id,… )

OpenStack API

(Both a native REST API plus an EC2-compatible API)

Object
(Swift)

Images Compute Storage Network
(Glance)

(Nova)

(Quantum)

(Cinder)

4. Init Connection

2. Create volume

6. Attach device

5. Map volume

VM
KVM

© Copyright 2013 EMC Corporation. All rights reserved.

7. iSCSI discover

12
Cinder Persistent Volume Functions
Supported Functions:

OpenStack
Compute
Manager

Nova

Compute
Virt Driver

 Create/Delete Block Volume

1

2
3

Volume
Manager

Volum
Cinder

1. “create volume”
2. “attach volume”

VM
libvirt

3. initialize_connection

KVM

e
Driver

 Initialize/Terminate Connection
(From Nova, Performs Map/Mask)
 Create/Delete Snapshot
 Create Cloned Volume
 Create Volume From Snapshot
 Copy Volume To/From Image
 New: Backup/Restore Volume

© Copyright 2013 EMC Corporation. All rights reserved.

13
An Example OpenStack Deployment
Internet
Cloud Mgmt
HA
Network Nodes

Compute Nodes

Controller Node

(Quantum)

(Nova)

(common services)
Controller Node
(common services)

VM Data
Storage Nodes

Configuration Mgmt System

© Copyright 2013 EMC Corporation. All rights reserved.

Image Service
Nodes
(Glance)

(Cinder)

14
EMC Participation
And Contribution

© Copyright 2013 EMC Corporation. All rights reserved.

15
EMC’s Commitment To OpenStack
 Joined OpenStack Foundation As “Corporate”
Sponsor In Dec 2012
–

http://www.openstack.org/foundation/companies/

–

http://gigaom.com/cloud/emc-follows-vmware-rest-of-world-into-openstack/

 Contributed VNX/VMAX iSCSI Adapters Into
Grizzly Build In Dec 2012
 Joined Rackspace “Alamo” Quality Assurance And
“Private Cloud” Certification Program In Jan 2013
–

http://www.rackspace.com/blog/rackspace-private-cloud-certification-programcombines-product-innovation-and-enterprise-stability/

 Engaged Other Distro Leaders:
– Canonical/Ubuntu, SUSE, Red Hat

© Copyright 2013 EMC Corporation. All rights reserved.

16
EMC Contributions To Date
 Post-Folsom Release (Dec 2012)
(For Use In Current Distro Programs)
– VNX iSCSI
– VMAX iSCSI

 Grizzly Release (April 2013)
– VNX iSCSI
– VMAX iSCSI

© Copyright 2013 EMC Corporation. All rights reserved.

17
VMAX / System Requirements
OpenStack

System Requirements
 Host for driver install: Ubuntu 12.04 or later
 Solutions Enabler: SMI-S 4.5.1 and higher

Compute
Manager

Nova

Compute
Virt Driver

Volume
Manager

Cinder
Volume

VMAX Requirements
VM

 Microcode: 5875 for most VMAX
–

5876 for VMAX10K

 Masking view for Compute host(s) including 6
gatekeepers mapped to each Compute host
 VMAX/VMAXe storage pool for Cinder use must be
created before using the VMAX/VMAXe Cinder driver

VMAX Constraints
 CreateVolumeFromSnapshot not supported

© Copyright 2013 EMC Corporation. All rights reserved.

libvirt

Driver

SMIS

Solutions
Enabler*

KVM

Compute Node
Compute Node

Masking Views

VMAX

Compute Node
*Solutions Enabler may be run as a SUSE VM, or on a standalone server.
Each Solutions Enabler supports multiple backend arrays.

18
VNX / System Requirements
OpenStack

System Requirements
 Host for driver install: Ubuntu 12.04 or
later

Compute
Manager

Nova

Compute
Virt Driver

Volume
Manager

Cinder
Volume

 Solutions Enabler: SMI-S 4.5.1 and higher

VNX Requirements
 Flare 31 or higher
 Compute hosts registered with VNX
–

VM
libvirt

Solutions
Enabler*

KVM

Compute Node
Compute Node
Register

Via iscsiadm

 VNX Storage Pool created on array for
Cinder to use (Thin LUN’s only)

Driver

SMIS

VNX
Compute Node
*Solutions Enabler may be run as an ESX VM, or on a standalone server.
Each Solutions Enabler supports multiple backend arrays.

© Copyright 2013 EMC Corporation. All rights reserved.

19
EMC Best Practices
 Run EMC Volume Drivers Anywhere
–
–
–
–
–

Each Driver Is An Independent ‘cinder-volume’ Service
Low CPU/IO Requirements
Run On Controller Node For Active/Passive HA
However: Future Backup Considerations Will Change This
Scale Practice: Run “storage controller nodes” as VMs

 Best Practices For Access Protocols:
– iSCSI For VNX
– NFS For Isilon (Havana)
– FC For VMAX

 Best Practice White Papers Are Work In Progress
© Copyright 2013 EMC Corporation. All rights reserved.

20
What’s Next

More
Products

© Copyright 2013 EMC Corporation. All rights reserved.

More
Protocols

More
Partners

More
Functionality

21
How To Access EMC Adapters
 Via OpenStack Foundation, Effective April
2013
– https://github.com/openstack/cinder/tree/mas
ter/cinder/volume/drivers/emc

 Via Rackspace “Alamo” Certification Program
– http://www.rackspace.com/knowledge_center/
article/implementing-openstack-cinder-withemc-storage-on-the-rackspace-private-cloudsoftware

 Via Other Distributions As They Become
Available – Including VARs and ISVs
© Copyright 2013 EMC Corporation. All rights reserved.

22
EMC Value-Add

© Copyright 2013 EMC Corporation. All rights reserved.

23
EMC Technology In OpenStack
 First Things First: Storage Platforms Available For Use
– EMC Storage Hardware For Building Private Clouds
– Include Hooks For Snapshot (And Backup in Havana)

 EMC Value Add
– Enterprise Class Storage And Services
– Highly Available Infrastructure
– Deliver Value Above And Beyond Via Advanced Capabilities

 Avenues For Advanced Capabilities*
–
–
–

Consistency Groups
Integrated Backup Policy And Scheduling
Remote Replication

*These features are not committed; we’re looking at all the obvious choices and gathering feedback

© Copyright 2013 EMC Corporation. All rights reserved.

24
Advanced Capability Delivery
 Initially:

– Partners
– VARs/ISVs
– Customers

 Where it makes sense

– Contribute Upstream Into OpenStack

© Copyright 2013 EMC Corporation. All rights reserved.

25
Wrap up

© Copyright 2013 EMC Corporation. All rights reserved.

26
Resources
 Technical Resources
–
–
–
–
–
–

Datasheets
Implementation Guides
Knowledge Center Articles
Certification Program Test Results
Reference Architectures
Blogs

 For more information on OpenStack,
please refer to the following links:
– http://one.emc.com/clearspace/com
munity/active/everything_openstack
– http://virtualgeek.typepad.com/
– http://chucksblog.emc.com/
– http://openstack.org/start

 EMC World Resources
– ESG OpenStack Kiosk
– OpenStack Demo
– See ViPR Demo In ASD Boot

© Copyright 2013 EMC Corporation. All rights reserved.

27
Wrap Up: EMC and OpenStack
 EMC Embraces Multiple Cloud OS Frameworks
 EMC Is Active In The OpenStack Cinder Project
 Cinder Volume Drivers Available Now
 Through 2013:
– More Feature & Driver Contributions To Havana Release
– In Some Cases: EAP May Be Available For Havana capabilities

 Stay Tuned as EMC Delivers On Advanced Capabilities

© Copyright 2013 EMC Corporation. All rights reserved.

28
EMC & OpenStack: A View From Within

EMC & OpenStack: A View From Within

  • 1.
    EMC & OpenStack: AView from Within Edgar StPierre Sr. Consulting Solutions Architect © Copyright 2013 EMC Corporation. All rights reserved. 1
  • 2.
    Roadmap Information Disclaimer EMC makes no representation and undertakes no obligations with regard to product planning information, anticipated product characteristics, performance specifications, or anticipated release dates (collectively, “Roadmap Information”).  Roadmap Information is provided by EMC as an accommodation to the recipient solely for purposes of discussion and without intending to be bound thereby.  Roadmap information is EMC Restricted Confidential and is provided under the terms, conditions and restrictions defined in the EMC NonDisclosure Agreement in place with your organization. © Copyright 2013 EMC Corporation. All rights reserved. 2
  • 3.
    Agenda  EMC Storageand OpenStack – Strategy Overview  An OpenStack Technology Review  EMC Participation And Contribution  EMC Value-Add © Copyright 2013 EMC Corporation. All rights reserved. 3
  • 4.
    Mission Statement "To producethe ubiquitous Open Source cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable." Source: OpenStack Foundation © Copyright 2013 EMC Corporation. All rights reserved. 4
  • 5.
    OpenStack: Open SourceCloud OS  Public clouds – level the playing field against “the big three” – Major Opportunists: Rackspace, HP – And many more…  Private clouds – open the door to many distributors … Virtual Data Center Virtual Data Center Virtual Data Center Virtual Data Center Virtual Data Center Virtual Data Center – Canonical, Red Hat, SUSE, Rackspace, and a host of others… – And create opportunity for customers to manage lower cost, and ultimately flexible, private clouds © Copyright 2013 EMC Corporation. All rights reserved. 5
  • 6.
    Virtualized Data Centers Resourcedisaggregation fundamental to Software Defined Data Centers Favorite Cloud OS & Configuration Mgmt System Favorite Hypervisor CPU Pool Mem Pool Network Virtualizer IP Pool Service Pool Storage Virtualizer Storage Pool1 Storage Pool2 VM © Copyright 2013 EMC Corporation. All rights reserved. 6
  • 7.
    Disaggregation of StorageResources OpenStack VM VM Hypervisor DFS/LVM  Disaggregation at host level – – – Roll-your-own storage nodes with services based on a DFS or LVM All storage and data services on storage node This is SDDC goal for many apps  Disaggregation at array level – – – – – © Copyright 2013 EMC Corporation. All rights reserved. Not as flexible/ubiquitous as disaggregation at host level But: proven, performant, and inherently resilient Storage arrays have been disaggregating disks for years Array-based storage & data services This is topic for today 7
  • 8.
    EMC Strategy ForCloudOS Options “Just say yes”  Across Variety Of CloudOS Platforms  Variety of Solutions Within Each CloudOS Platform  Continuously Evolve Solutions To Support Customer Options © Copyright 2013 EMC Corporation. All rights reserved. 8
  • 9.
    OpenStack Technology Review © Copyright2013 EMC Corporation. All rights reserved. 9
  • 10.
    The OpenStack LayerCake GUI (Horizon) App Orchestration Presentation Python CLIs (Separate projects) (Heat) Admin APIs OpenStack API (Both a native REST API plus an EC2-compatible API) IAM (Keystone) Object (MySQL) Integration Resources © Copyright 2013 EMC Corporation. All rights reserved. (Cinder) (Quantum) Policy Policy Scheduling Scheduling Scheduling Orchestration Orchestration Adapters Metrics Policy Adapters Database (Nova) Scheduling Control Logic (Glance) Policy (Swift) Messaging (RabbitMQ) Images Compute Storage Network Orchestration Orchestration Adapters Adapters (Ceilometer) 3rd Party Monitoring Tools Administration 10
  • 11.
    Creating An EphemeralVM 1. POST /{tenant_id}/servers (…, imageRef, …) Client OpenStack API (Both a native REST API plus an EC2-compatible API) 5. GET image Object (Swift) Images Compute Storage Network (Glance) (Cinder) (Nova) 4. GET image (Quantum) 2. Allocate Network 3. GET image Swift / NFS 8. Boot 6. Upload 7. Load VM KVM © Copyright 2013 EMC Corporation. All rights reserved. 11
  • 12.
    Attaching A PersistentBlock Volume 1. POST /{tenant_id}/volumes Client 3. POST /{tenant_id}/servers/{server_id}/os-volume_attachments (…, volume_id,… ) OpenStack API (Both a native REST API plus an EC2-compatible API) Object (Swift) Images Compute Storage Network (Glance) (Nova) (Quantum) (Cinder) 4. Init Connection 2. Create volume 6. Attach device 5. Map volume VM KVM © Copyright 2013 EMC Corporation. All rights reserved. 7. iSCSI discover 12
  • 13.
    Cinder Persistent VolumeFunctions Supported Functions: OpenStack Compute Manager Nova Compute Virt Driver  Create/Delete Block Volume 1 2 3 Volume Manager Volum Cinder 1. “create volume” 2. “attach volume” VM libvirt 3. initialize_connection KVM e Driver  Initialize/Terminate Connection (From Nova, Performs Map/Mask)  Create/Delete Snapshot  Create Cloned Volume  Create Volume From Snapshot  Copy Volume To/From Image  New: Backup/Restore Volume © Copyright 2013 EMC Corporation. All rights reserved. 13
  • 14.
    An Example OpenStackDeployment Internet Cloud Mgmt HA Network Nodes Compute Nodes Controller Node (Quantum) (Nova) (common services) Controller Node (common services) VM Data Storage Nodes Configuration Mgmt System © Copyright 2013 EMC Corporation. All rights reserved. Image Service Nodes (Glance) (Cinder) 14
  • 15.
    EMC Participation And Contribution ©Copyright 2013 EMC Corporation. All rights reserved. 15
  • 16.
    EMC’s Commitment ToOpenStack  Joined OpenStack Foundation As “Corporate” Sponsor In Dec 2012 – http://www.openstack.org/foundation/companies/ – http://gigaom.com/cloud/emc-follows-vmware-rest-of-world-into-openstack/  Contributed VNX/VMAX iSCSI Adapters Into Grizzly Build In Dec 2012  Joined Rackspace “Alamo” Quality Assurance And “Private Cloud” Certification Program In Jan 2013 – http://www.rackspace.com/blog/rackspace-private-cloud-certification-programcombines-product-innovation-and-enterprise-stability/  Engaged Other Distro Leaders: – Canonical/Ubuntu, SUSE, Red Hat © Copyright 2013 EMC Corporation. All rights reserved. 16
  • 17.
    EMC Contributions ToDate  Post-Folsom Release (Dec 2012) (For Use In Current Distro Programs) – VNX iSCSI – VMAX iSCSI  Grizzly Release (April 2013) – VNX iSCSI – VMAX iSCSI © Copyright 2013 EMC Corporation. All rights reserved. 17
  • 18.
    VMAX / SystemRequirements OpenStack System Requirements  Host for driver install: Ubuntu 12.04 or later  Solutions Enabler: SMI-S 4.5.1 and higher Compute Manager Nova Compute Virt Driver Volume Manager Cinder Volume VMAX Requirements VM  Microcode: 5875 for most VMAX – 5876 for VMAX10K  Masking view for Compute host(s) including 6 gatekeepers mapped to each Compute host  VMAX/VMAXe storage pool for Cinder use must be created before using the VMAX/VMAXe Cinder driver VMAX Constraints  CreateVolumeFromSnapshot not supported © Copyright 2013 EMC Corporation. All rights reserved. libvirt Driver SMIS Solutions Enabler* KVM Compute Node Compute Node Masking Views VMAX Compute Node *Solutions Enabler may be run as a SUSE VM, or on a standalone server. Each Solutions Enabler supports multiple backend arrays. 18
  • 19.
    VNX / SystemRequirements OpenStack System Requirements  Host for driver install: Ubuntu 12.04 or later Compute Manager Nova Compute Virt Driver Volume Manager Cinder Volume  Solutions Enabler: SMI-S 4.5.1 and higher VNX Requirements  Flare 31 or higher  Compute hosts registered with VNX – VM libvirt Solutions Enabler* KVM Compute Node Compute Node Register Via iscsiadm  VNX Storage Pool created on array for Cinder to use (Thin LUN’s only) Driver SMIS VNX Compute Node *Solutions Enabler may be run as an ESX VM, or on a standalone server. Each Solutions Enabler supports multiple backend arrays. © Copyright 2013 EMC Corporation. All rights reserved. 19
  • 20.
    EMC Best Practices Run EMC Volume Drivers Anywhere – – – – – Each Driver Is An Independent ‘cinder-volume’ Service Low CPU/IO Requirements Run On Controller Node For Active/Passive HA However: Future Backup Considerations Will Change This Scale Practice: Run “storage controller nodes” as VMs  Best Practices For Access Protocols: – iSCSI For VNX – NFS For Isilon (Havana) – FC For VMAX  Best Practice White Papers Are Work In Progress © Copyright 2013 EMC Corporation. All rights reserved. 20
  • 21.
    What’s Next More Products © Copyright2013 EMC Corporation. All rights reserved. More Protocols More Partners More Functionality 21
  • 22.
    How To AccessEMC Adapters  Via OpenStack Foundation, Effective April 2013 – https://github.com/openstack/cinder/tree/mas ter/cinder/volume/drivers/emc  Via Rackspace “Alamo” Certification Program – http://www.rackspace.com/knowledge_center/ article/implementing-openstack-cinder-withemc-storage-on-the-rackspace-private-cloudsoftware  Via Other Distributions As They Become Available – Including VARs and ISVs © Copyright 2013 EMC Corporation. All rights reserved. 22
  • 23.
    EMC Value-Add © Copyright2013 EMC Corporation. All rights reserved. 23
  • 24.
    EMC Technology InOpenStack  First Things First: Storage Platforms Available For Use – EMC Storage Hardware For Building Private Clouds – Include Hooks For Snapshot (And Backup in Havana)  EMC Value Add – Enterprise Class Storage And Services – Highly Available Infrastructure – Deliver Value Above And Beyond Via Advanced Capabilities  Avenues For Advanced Capabilities* – – – Consistency Groups Integrated Backup Policy And Scheduling Remote Replication *These features are not committed; we’re looking at all the obvious choices and gathering feedback © Copyright 2013 EMC Corporation. All rights reserved. 24
  • 25.
    Advanced Capability Delivery Initially: – Partners – VARs/ISVs – Customers  Where it makes sense – Contribute Upstream Into OpenStack © Copyright 2013 EMC Corporation. All rights reserved. 25
  • 26.
    Wrap up © Copyright2013 EMC Corporation. All rights reserved. 26
  • 27.
    Resources  Technical Resources – – – – – – Datasheets ImplementationGuides Knowledge Center Articles Certification Program Test Results Reference Architectures Blogs  For more information on OpenStack, please refer to the following links: – http://one.emc.com/clearspace/com munity/active/everything_openstack – http://virtualgeek.typepad.com/ – http://chucksblog.emc.com/ – http://openstack.org/start  EMC World Resources – ESG OpenStack Kiosk – OpenStack Demo – See ViPR Demo In ASD Boot © Copyright 2013 EMC Corporation. All rights reserved. 27
  • 28.
    Wrap Up: EMCand OpenStack  EMC Embraces Multiple Cloud OS Frameworks  EMC Is Active In The OpenStack Cinder Project  Cinder Volume Drivers Available Now  Through 2013: – More Feature & Driver Contributions To Havana Release – In Some Cases: EAP May Be Available For Havana capabilities  Stay Tuned as EMC Delivers On Advanced Capabilities © Copyright 2013 EMC Corporation. All rights reserved. 28