1© Copyright 2016 EMC Corporation. All rights reserved.
SCALEIO IN
AN OPENSTACK
ENVIRONMENT
JASON STURGEON & RANDY BIAS
2© Copyright 2016 EMC Corporation. All rights reserved.
• Role: ScaleIO Product Manager
• Mission: Drive ScaleIO integration with OpenStack &
Partners
• 20 years in tech
• Big tech geek and love helping people build clouds
• Contact info
– Twitter: @osaddict
– Email: jason.sturgeon@emc.com
JASON STURGEON
3© Copyright 2016 EMC Corporation. All rights reserved.
WHAT IS EMC SCALEIO?
ScaleIO agent
(minimal footprint)
• Installs on industry-standard x86 servers that run
databases, hypervisors, or any other applications
• Aggregates application servers’ local disks
• Add storage and/or compute on the fly
Software that
uses application
servers to create
an elastic,
scalable, and
resilient Server
SAN at a
fraction of the
cost and
complexity of
traditional SANs
4EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY
MIX AND MATCH OS, HYPERVISORS, PLATFORMS,
AND MEDIA IN THE SAME SCALEIO SYSTEM!
INFRASTRUCTURE AGNOSTIC
HYPERVISORSOPERATING
SYSTEM
CLOUD MEDIA
SSDs
HDDs
PCIe
Flash
5© Copyright 2016 EMC Corporation. All rights reserved.
SCALEIO LOGICAL ARCHITECTURE
Application(s)
SDC: ScaleIO
Data Client
SDS: ScaleIO
Data Server
MDM: Metadata
Manager
C
S
PRESENTATION LAYER
ScaleIO Data Client (SDC)
DATA SERVER
ScaleIO Data
Server (SDS)
ScaleIO Metadata
Manager (MDM)
6© Copyright 2016 EMC Corporation. All rights reserved.
• ScaleIO integrated with
OpenStack since Havana
• Upstreamed since Liberty
• Plugins for Mirantis Fuel,
Charms for Canonical, &
Ansible / Puppet scripts
SCALEIO & OPENSTACK
7© Copyright 2016 EMC Corporation. All rights reserved.
• Cinder driver interfaces between ScaleIO
and OpenStack
– Presents volumes to OpenStack as block
devices available for storage
• Nova driver handles compute and
instance volume-related operations
• ScaleIO driver executes volume
operations by communicating with the
backend ScaleIO components through the
ScaleIO REST Gateway
SCALEIO – BLOCK SERVICES
SDC
SDS
MDM
Applications
(NOVA)
Cinder Volume
GATEWAY
Driver
Rest API
Commodity Platform
8© Copyright 2016 EMC Corporation. All rights reserved.
• Full support of QoS
– QoS support previously, but using Extra Specs
• Support for Consistency Groups
• Option to bring existing ScaleIO volumes
under OpenStack management
– As well as remove from OpenStack managment
OPENSTACK MITAKA
EMC SCALEIO NEW FEATURES
9© Copyright 2016 EMC Corporation. All rights reserved.
• 1 Oracle VM
– 64G RAM & 16 vCPUs
• 1 Load Generation Client VM
– Running Swingbench tool
• Demo flow
– FIO load -> Live Migrate
– 20 User DB load -> Live Migrate
– 200 User DB load -> Live Migrate
ORACLE RUNNING IN OPENSTACK W/SCALEIO
10© Copyright 2016 EMC Corporation. All rights reserved.
• Storage Side
– 7 Cisco C240 M4SX hosts
• CPU: 2xE5-2680 v3 @ 2.5GHz
• RAM: 128G or 256G depending
on node
– Storage
• 3 Toshiba 400GB SSDs each
• Mix of either 6 or 10 900GB
HDDS
– Not used in Demo, but available as
slower tier
WHAT’S THE HARDWARE UNDER THE HOOD?
• Compute Side
– Same 7 Cisco C240
M4SX hosts
• AKA Hyper-Converged
– 1 Server that is only a
client
• AKA 2-layer
11© Copyright 2016 EMC Corporation. All rights reserved.
• Database
– Oracle Version 12.1.0.2.0
• OpenStack Version
– Liberty 12.0.1
• Operating System
– CentOS Linux 7.2.1511
– Kernel 3.10.0-327.13.1.el7.x86_64
• Storage Software
– ScaleIO 2.0.0.0
WHAT’S THE SOFTWARE UNDER THE HOOD?
12© Copyright 2016 EMC Corporation. All rights reserved.
app app app app app
10G
Ethernet
C S S
app
S C CC S S C C S
CONNECTIONS AND ROLES
MM M
app
C S
app
C
c1 c3c2 c8c7c6c5c4
3
CISCO NEXUS N5548P 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
STAT
ID
Cisco Nexus 5548
Each node connects with
• 2 Intel 10GbE NICs
13© Copyright 2016 EMC Corporation. All rights reserved.
DEMO
14© Copyright 2016 EMC Corporation. All rights reserved.
DON’T WAIT
• OpenStack deployments can take time
– Get comfortable with the scale-out storage now
• ScaleIO is useful in building any cloud
• One click download with no limits: Search ”Download ScaleIO”
• Try out our plugins and give use feedback: Chad’s Blog
• Check out recent reviews on storagereview.com
• Other Sessions:
– “Swisscom in Production with OpenStack and Cloud Foundry” – 4:40pm
– “Optimizing SDS for OpenStack” feat. EMC & Mirantis – Thursday 11:00am
– Check out the ScaleIO / Ceph live bakeoff session from Tokyo Summit
• OpenStack session on Ceph vs ScaleIO
• Shorter video: http://www.emc.com/scaleiocephbattle

Using ScaleIO in an OpenStack Environment

  • 1.
    1© Copyright 2016EMC Corporation. All rights reserved. SCALEIO IN AN OPENSTACK ENVIRONMENT JASON STURGEON & RANDY BIAS
  • 2.
    2© Copyright 2016EMC Corporation. All rights reserved. • Role: ScaleIO Product Manager • Mission: Drive ScaleIO integration with OpenStack & Partners • 20 years in tech • Big tech geek and love helping people build clouds • Contact info – Twitter: @osaddict – Email: jason.sturgeon@emc.com JASON STURGEON
  • 3.
    3© Copyright 2016EMC Corporation. All rights reserved. WHAT IS EMC SCALEIO? ScaleIO agent (minimal footprint) • Installs on industry-standard x86 servers that run databases, hypervisors, or any other applications • Aggregates application servers’ local disks • Add storage and/or compute on the fly Software that uses application servers to create an elastic, scalable, and resilient Server SAN at a fraction of the cost and complexity of traditional SANs
  • 4.
    4EMC CONFIDENTIAL—INTERNAL USEONLYEMC CONFIDENTIAL—INTERNAL USE ONLY MIX AND MATCH OS, HYPERVISORS, PLATFORMS, AND MEDIA IN THE SAME SCALEIO SYSTEM! INFRASTRUCTURE AGNOSTIC HYPERVISORSOPERATING SYSTEM CLOUD MEDIA SSDs HDDs PCIe Flash
  • 5.
    5© Copyright 2016EMC Corporation. All rights reserved. SCALEIO LOGICAL ARCHITECTURE Application(s) SDC: ScaleIO Data Client SDS: ScaleIO Data Server MDM: Metadata Manager C S PRESENTATION LAYER ScaleIO Data Client (SDC) DATA SERVER ScaleIO Data Server (SDS) ScaleIO Metadata Manager (MDM)
  • 6.
    6© Copyright 2016EMC Corporation. All rights reserved. • ScaleIO integrated with OpenStack since Havana • Upstreamed since Liberty • Plugins for Mirantis Fuel, Charms for Canonical, & Ansible / Puppet scripts SCALEIO & OPENSTACK
  • 7.
    7© Copyright 2016EMC Corporation. All rights reserved. • Cinder driver interfaces between ScaleIO and OpenStack – Presents volumes to OpenStack as block devices available for storage • Nova driver handles compute and instance volume-related operations • ScaleIO driver executes volume operations by communicating with the backend ScaleIO components through the ScaleIO REST Gateway SCALEIO – BLOCK SERVICES SDC SDS MDM Applications (NOVA) Cinder Volume GATEWAY Driver Rest API Commodity Platform
  • 8.
    8© Copyright 2016EMC Corporation. All rights reserved. • Full support of QoS – QoS support previously, but using Extra Specs • Support for Consistency Groups • Option to bring existing ScaleIO volumes under OpenStack management – As well as remove from OpenStack managment OPENSTACK MITAKA EMC SCALEIO NEW FEATURES
  • 9.
    9© Copyright 2016EMC Corporation. All rights reserved. • 1 Oracle VM – 64G RAM & 16 vCPUs • 1 Load Generation Client VM – Running Swingbench tool • Demo flow – FIO load -> Live Migrate – 20 User DB load -> Live Migrate – 200 User DB load -> Live Migrate ORACLE RUNNING IN OPENSTACK W/SCALEIO
  • 10.
    10© Copyright 2016EMC Corporation. All rights reserved. • Storage Side – 7 Cisco C240 M4SX hosts • CPU: 2xE5-2680 v3 @ 2.5GHz • RAM: 128G or 256G depending on node – Storage • 3 Toshiba 400GB SSDs each • Mix of either 6 or 10 900GB HDDS – Not used in Demo, but available as slower tier WHAT’S THE HARDWARE UNDER THE HOOD? • Compute Side – Same 7 Cisco C240 M4SX hosts • AKA Hyper-Converged – 1 Server that is only a client • AKA 2-layer
  • 11.
    11© Copyright 2016EMC Corporation. All rights reserved. • Database – Oracle Version 12.1.0.2.0 • OpenStack Version – Liberty 12.0.1 • Operating System – CentOS Linux 7.2.1511 – Kernel 3.10.0-327.13.1.el7.x86_64 • Storage Software – ScaleIO 2.0.0.0 WHAT’S THE SOFTWARE UNDER THE HOOD?
  • 12.
    12© Copyright 2016EMC Corporation. All rights reserved. app app app app app 10G Ethernet C S S app S C CC S S C C S CONNECTIONS AND ROLES MM M app C S app C c1 c3c2 c8c7c6c5c4 3 CISCO NEXUS N5548P 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 STAT ID Cisco Nexus 5548 Each node connects with • 2 Intel 10GbE NICs
  • 13.
    13© Copyright 2016EMC Corporation. All rights reserved. DEMO
  • 14.
    14© Copyright 2016EMC Corporation. All rights reserved. DON’T WAIT • OpenStack deployments can take time – Get comfortable with the scale-out storage now • ScaleIO is useful in building any cloud • One click download with no limits: Search ”Download ScaleIO” • Try out our plugins and give use feedback: Chad’s Blog • Check out recent reviews on storagereview.com • Other Sessions: – “Swisscom in Production with OpenStack and Cloud Foundry” – 4:40pm – “Optimizing SDS for OpenStack” feat. EMC & Mirantis – Thursday 11:00am – Check out the ScaleIO / Ceph live bakeoff session from Tokyo Summit • OpenStack session on Ceph vs ScaleIO • Shorter video: http://www.emc.com/scaleiocephbattle

Editor's Notes

  • #4 EMC® ScaleIO® is software defined storage designed with enterprise-grade resiliency to deliver, scale-out, block storage using commodity hardware. ScaleIO provides the scalability, elasticity, flexibility and performance needed to meet the demands for whatever comes next. It is also a key building block in next generation hyper-converged systems.
  • #8 The ScaleIO elastic storage solution includes a Cinder driver, which interfaces between ScaleIO and OpenStack, and presents volumes to OpenStack as block devices which are available for block storage. It also includes an OpenStack Nova driver, for handling compute and instance volume related operations. The ScaleIO driver executes the volume operations by communicating with the backend ScaleIO components through the ScaleIO REST Gateway.
  • #14  Tech notes: ------ Jumpbox: 10.241.6.169 (administrator / Password123) ------------ OpenStack ------ Horizon: https://10.248.133.172/dashboard (default / admin / Openstackrocks!) OpenStack Controller (keys to the castle): 10.248.133.172/192.168.100.172/192.168.200.172 (root / password) Any cloud image (ssh centos@ip-address from controller) or login to the console using oracle / Openstackrocks! ------Oracle------ Oracle info: oracle / Openstackrocks! Database name: db1 System user password:  Openstackrocks (no !) Start / Stop database:  from the console, login as oracle or ssh 192.168.200.229 / sudo bash / su – oracle / lsnrctl <start/stop> / sqlplus “/ as sysdba” <startup or shutdown immediate> -----ScaleIO------ MDM: 10.248.133.174 (192.168.100.174/192.168.200.174) /10.248.133.176 (192.168.100.176/192.168.200.176) admin / Openstackrocks! REST gateway is on .174 -------