Mirantis Overview
● Leading OpenStack
distribution
● Plan, architect,
implement with focus
on business outcomes
● Fully managed
OpenStack with up
to 99.99% SLA
guarantee
● Clouds, tooling, and
Ops Team 100%
focused on
OpenStack success
● Co-manage for a fixed
period
● Train and certify customer
ops team on your terms
● Transfer to customer
support
Build Operate Transfer
#1 $200M
Source of the source
code: Top contributor
Mitaka Release
Well funded
700+
Employees
• Open Source: Huge community of supporters ensuring low costs
• Enable: Modular, scalable and flexible utilities offering efficiency and agility
• Decoupling: complete hardware vendor independence and no vendor lock-in
• Integrated: Scale out Storage (e.g. ScaleIO, ECS) and Software Defined Networking
• Interoperability: Open-Source APIs offer full manageability in hybrid IT landscapes
• Proven: Operated at many companies clouds (AT&T, Volkswagen, …)
• Ease of integration: supported by all major vendors (e.g. Dell EMC, VMware, HP, …)
Why Mirantis?
• Proven at joint Customers
• Broad Integration: Pluggable support for ScaleIO, XtremIO, Unity, VNX
• Validated: EMC Storage Solutions with Mirantis OpenStack reference architecture
https://www.mirantis.com/partners/dell-emc/
Dell EMC and Mirantis
• Web/Cloud native apps: Microservices, containerized, User generated content
• Data analytics: In memory processing (Kafka, Spark), batch processing (Hadoop)
• Telco: Network function virtualization (NFV), Cloudify orchestration
• Upcoming: IoT, HPC
Use Cases of OpenStack
https://codedellemc.com
What is Dell EMC ScaleIO?
• Installs on industry-standard x86 servers that run databases,
hypervisors, or any other applications
• Aggregate applications servers’ local disks
• Add storage and/or compute on the fly
Software that uses
application servers
to create an elastic,
scalable, and
resilient server SAN
at a fraction of the
cost and complexity
of traditional SANs
ScaleIO Software
Minimal footprint:
• 1 GB RAM
• Max 10% cpu for all HDD
configurations
• Max 20% cpu for all flash
configurations
Big results!
© Copyright 2015 EMC Corporation. All rights reserved.
ENTERPRISE FEATURES
SNMP &
Call Home
OpenStack, vSphere, Xen,
Hyper-V, Bare metal Windows &
Linux
Data-at-Rest-Encryption
& Certificate
Authentication
Protection Domains &
QoS Controls
DRAM Cache &
Read Flash Cache
Checksum &
NDU
Rack Level
High Availability
Automatic
Rebalance &
Rebuild
Thin ProvisioningWriteable
Snapshots &
DR with RecoverPoint
APP 1
APP 2
APP 3
PERFORMANCE INTEROPERABILITY MONITORING FAULT TOLERANCE RESILIENCY
MULTI-TENANCY PROTECTION SECURITY ELASTICITY EFFICIENCY
• ScaleIO integrated with
OpenStack since Havana
• Full contribution and
integration since Liberty
• Cinder (block) & Nova
(compute) drivers
• Mirantis Fuel Plugins
• Canonical Juju Charms
• More partner extensions to
come…
SCALEIO & OPENSTACK
OPENSTACK EXTENSIONS FOR SCALEIO
• Why create the extensions?
– Orchestrates ScaleIO deployments along with all other OpenStack components
– Makes storage much simpler to deploy
– Provides the user with a unified experience
– Enables OpenStack customers to get to production with ScaleIO faster
• What do they do?
– Deploys all components of ScaleIO with few inputs
– Deployment is done using the native framework of that distribution
– Deploys ScaleIO in a consistent way that should provide stability to the entire
deployment
PARTNER EXTENSIONS
Key ScaleIO Software Defined Storage takeaways:
• Reliable
– Rock solid Software Defined Storage which easily support 5x9’s or higher levels of availability. Easy to
manage and upgrade.
• Flexible
– Scale-up & down, support multiple environments: VMware, Hyper-V, OpenStack & bare metal with one
solution.
– Easy to scale, supporting cloud infrastructure requirements
• High Performance with tiny footprint: http://www.storagereview.com/node/5992
– Fastest most scalable storage solution, virtually no limits, sub ms RT with SSD/Flash
– Predictable performance no matter the application type (scale-out & scale-up!)
– 10-20% cpu & memory 10’s of MB’s to a few GB drives record breaking performance
• Highly scalable
– Start small grow big without worry
– Scale compute & storage independently
• Tremendous value
– 505% ROI -> source IDC paper https://www.emc.com/collateral/white-papers/idc-business-value-of-vxrack-
and-scaleio.pdf
What is ECS ?
Turnkey
Appliance
Dedicated Hybrid
Cloud
ECS Software
Multi-tenant Storage
Cloud
Magic Quadrant for Distributed File Systems and Object
Storage
– October 2016
Dell EMC has two products that are included in this research:
Dell EMC Isilon and Dell EMC Elastic Cloud Storage (ECS). With
Isilon, a mature scale-out NAS product with deployment across
many enterprises and service provider verticals and
geographies, end users consolidate large datasets onto one
distributed file system for high scalability and throughput. ECS is
a platform that supports object, NFS and Hadoop Distributed File
System (HDFS), with the ability to store billions of objects for
cloud-native applications.
https://www.gartner.com/doc/reprints?id=1-
3HYASF6&ct=160919&st=sb
Gartner Magic Quadrant
2MB Buffered Writer
Box-Carting
High performance and low overhead for both small and large objects
15
AA
A
Store
objects in
chunks on
disks
Add parity
Delete
original
chunks
In memory
Requests
Geo Capabilities
High durability with a low overhead
16
A
A
B
B
C
A
PUT obj1 (1 MB)
PUT obj2
GET obj1GET obj1
Replicate
the 128 MB
container
XOR reductionobj1 (1 MB) Read the
Object from
Site-1
Cache the
128 MB chunk
Read from
the cache
B
Multi-Protocol Support
Access the same data from any access method
17
• Atmos: version 2.0
support for upgrade
• CAS: SDK v3.1.54 or
later support for upgrade
• Swift: byte range update
within an object
• Retentions
• Keystone integration:
drop-in replacement for
OpenStack Swift
• Primary file system with
native Ambari 2.2
integration
• Byte range updates
• Retentions
• Metadata search
extension
• NFS v3
• Global namespace with
global locking
XXXXX
Remove the cost and complexity of external databases
18
Save objects with metadata
Search objects using GPS coordinates, image resolution, …
/?query=x-amz-meta-image-gps-latitude>50&…
Metadata search
– Integration with Open Stack Keystone V3
API
– ECS consumes keystone tenancy and
identity model
› ECS Swift registers as service with Keystone
› Enforcement of service policies
– A drop-in replacement for OpenStack Swift
– A repository for Glance images
– A target for Cinder backups
Features
Key Benefits
ECS & Openstack
What about PaaS & Linux containers
NoSQL is often the first option used to store unstructured content
Linux
containers
But is NOSQL the right solution ?
Not really
• NOSQL DB are designed to store XML documents,
metadata, …
• But, they are not efficient to store unstructured content (ex:
they protect data by creating several replicas)
• And they are in the data path
• Object storage is the de facto solution
XXX
XX
Sensors
Distributed messaging system
Analytic frameworks
Web servers
Code
Artifacts
Images
Images
App servers
Logs
Backups
XXX
XX
Sensors
Distributed messaging system
Analytic frameworks
Web servers
Code
Artifacts
Images
Images
App servers
Logs
Backups
Cloud Optimization for Service Providers
CHALLENGES
• Rising access time
• High document processing time
• A large number of documents
• Growing size of documents
“The most impressive thing with
ECS was the fact that real-life
performance appeared twice as
high and more effective.
Vadim V. Chicherini
Data Center Director
Tenzor
Video Testimonial
RESULTS
• 1 million clients with hundreds of millions of
files
• Reduced latency
• Improved SLAs to customers
• Improved data center performance
Questions ?
Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

Speed up Digital Transformation with Openstack Cloud & Software Defined Storage

  • 2.
    Mirantis Overview ● LeadingOpenStack distribution ● Plan, architect, implement with focus on business outcomes ● Fully managed OpenStack with up to 99.99% SLA guarantee ● Clouds, tooling, and Ops Team 100% focused on OpenStack success ● Co-manage for a fixed period ● Train and certify customer ops team on your terms ● Transfer to customer support Build Operate Transfer #1 $200M Source of the source code: Top contributor Mitaka Release Well funded 700+ Employees
  • 3.
    • Open Source:Huge community of supporters ensuring low costs • Enable: Modular, scalable and flexible utilities offering efficiency and agility • Decoupling: complete hardware vendor independence and no vendor lock-in • Integrated: Scale out Storage (e.g. ScaleIO, ECS) and Software Defined Networking • Interoperability: Open-Source APIs offer full manageability in hybrid IT landscapes • Proven: Operated at many companies clouds (AT&T, Volkswagen, …) • Ease of integration: supported by all major vendors (e.g. Dell EMC, VMware, HP, …) Why Mirantis?
  • 4.
    • Proven atjoint Customers • Broad Integration: Pluggable support for ScaleIO, XtremIO, Unity, VNX • Validated: EMC Storage Solutions with Mirantis OpenStack reference architecture https://www.mirantis.com/partners/dell-emc/ Dell EMC and Mirantis
  • 5.
    • Web/Cloud nativeapps: Microservices, containerized, User generated content • Data analytics: In memory processing (Kafka, Spark), batch processing (Hadoop) • Telco: Network function virtualization (NFV), Cloudify orchestration • Upcoming: IoT, HPC Use Cases of OpenStack
  • 6.
  • 7.
    What is DellEMC ScaleIO? • Installs on industry-standard x86 servers that run databases, hypervisors, or any other applications • Aggregate applications servers’ local disks • Add storage and/or compute on the fly Software that uses application servers to create an elastic, scalable, and resilient server SAN at a fraction of the cost and complexity of traditional SANs ScaleIO Software Minimal footprint: • 1 GB RAM • Max 10% cpu for all HDD configurations • Max 20% cpu for all flash configurations Big results!
  • 8.
    © Copyright 2015EMC Corporation. All rights reserved. ENTERPRISE FEATURES SNMP & Call Home OpenStack, vSphere, Xen, Hyper-V, Bare metal Windows & Linux Data-at-Rest-Encryption & Certificate Authentication Protection Domains & QoS Controls DRAM Cache & Read Flash Cache Checksum & NDU Rack Level High Availability Automatic Rebalance & Rebuild Thin ProvisioningWriteable Snapshots & DR with RecoverPoint APP 1 APP 2 APP 3 PERFORMANCE INTEROPERABILITY MONITORING FAULT TOLERANCE RESILIENCY MULTI-TENANCY PROTECTION SECURITY ELASTICITY EFFICIENCY
  • 9.
    • ScaleIO integratedwith OpenStack since Havana • Full contribution and integration since Liberty • Cinder (block) & Nova (compute) drivers • Mirantis Fuel Plugins • Canonical Juju Charms • More partner extensions to come… SCALEIO & OPENSTACK
  • 10.
    OPENSTACK EXTENSIONS FORSCALEIO • Why create the extensions? – Orchestrates ScaleIO deployments along with all other OpenStack components – Makes storage much simpler to deploy – Provides the user with a unified experience – Enables OpenStack customers to get to production with ScaleIO faster • What do they do? – Deploys all components of ScaleIO with few inputs – Deployment is done using the native framework of that distribution – Deploys ScaleIO in a consistent way that should provide stability to the entire deployment
  • 11.
  • 12.
    Key ScaleIO SoftwareDefined Storage takeaways: • Reliable – Rock solid Software Defined Storage which easily support 5x9’s or higher levels of availability. Easy to manage and upgrade. • Flexible – Scale-up & down, support multiple environments: VMware, Hyper-V, OpenStack & bare metal with one solution. – Easy to scale, supporting cloud infrastructure requirements • High Performance with tiny footprint: http://www.storagereview.com/node/5992 – Fastest most scalable storage solution, virtually no limits, sub ms RT with SSD/Flash – Predictable performance no matter the application type (scale-out & scale-up!) – 10-20% cpu & memory 10’s of MB’s to a few GB drives record breaking performance • Highly scalable – Start small grow big without worry – Scale compute & storage independently • Tremendous value – 505% ROI -> source IDC paper https://www.emc.com/collateral/white-papers/idc-business-value-of-vxrack- and-scaleio.pdf
  • 13.
    What is ECS? Turnkey Appliance Dedicated Hybrid Cloud ECS Software Multi-tenant Storage Cloud
  • 14.
    Magic Quadrant forDistributed File Systems and Object Storage – October 2016 Dell EMC has two products that are included in this research: Dell EMC Isilon and Dell EMC Elastic Cloud Storage (ECS). With Isilon, a mature scale-out NAS product with deployment across many enterprises and service provider verticals and geographies, end users consolidate large datasets onto one distributed file system for high scalability and throughput. ECS is a platform that supports object, NFS and Hadoop Distributed File System (HDFS), with the ability to store billions of objects for cloud-native applications. https://www.gartner.com/doc/reprints?id=1- 3HYASF6&ct=160919&st=sb Gartner Magic Quadrant
  • 15.
    2MB Buffered Writer Box-Carting Highperformance and low overhead for both small and large objects 15 AA A Store objects in chunks on disks Add parity Delete original chunks In memory Requests
  • 16.
    Geo Capabilities High durabilitywith a low overhead 16 A A B B C A PUT obj1 (1 MB) PUT obj2 GET obj1GET obj1 Replicate the 128 MB container XOR reductionobj1 (1 MB) Read the Object from Site-1 Cache the 128 MB chunk Read from the cache B
  • 17.
    Multi-Protocol Support Access thesame data from any access method 17 • Atmos: version 2.0 support for upgrade • CAS: SDK v3.1.54 or later support for upgrade • Swift: byte range update within an object • Retentions • Keystone integration: drop-in replacement for OpenStack Swift • Primary file system with native Ambari 2.2 integration • Byte range updates • Retentions • Metadata search extension • NFS v3 • Global namespace with global locking XXXXX
  • 18.
    Remove the costand complexity of external databases 18 Save objects with metadata Search objects using GPS coordinates, image resolution, … /?query=x-amz-meta-image-gps-latitude>50&… Metadata search
  • 19.
    – Integration withOpen Stack Keystone V3 API – ECS consumes keystone tenancy and identity model › ECS Swift registers as service with Keystone › Enforcement of service policies – A drop-in replacement for OpenStack Swift – A repository for Glance images – A target for Cinder backups Features Key Benefits ECS & Openstack
  • 20.
    What about PaaS& Linux containers NoSQL is often the first option used to store unstructured content Linux containers
  • 21.
    But is NOSQLthe right solution ? Not really • NOSQL DB are designed to store XML documents, metadata, … • But, they are not efficient to store unstructured content (ex: they protect data by creating several replicas) • And they are in the data path • Object storage is the de facto solution
  • 22.
    XXX XX Sensors Distributed messaging system Analyticframeworks Web servers Code Artifacts Images Images App servers Logs Backups
  • 23.
    XXX XX Sensors Distributed messaging system Analyticframeworks Web servers Code Artifacts Images Images App servers Logs Backups
  • 24.
    Cloud Optimization forService Providers CHALLENGES • Rising access time • High document processing time • A large number of documents • Growing size of documents “The most impressive thing with ECS was the fact that real-life performance appeared twice as high and more effective. Vadim V. Chicherini Data Center Director Tenzor Video Testimonial RESULTS • 1 million clients with hundreds of millions of files • Reduced latency • Improved SLAs to customers • Improved data center performance
  • 25.