SlideShare a Scribd company logo
1 of 33
Download to read offline
Peanut butter and jelly
Mapping the deep Integration
between Ceph and OpenStack
Sean Cohen
Associate Manager, OpenStack Product Team
Sébastien Han
Principal Software Engineer, Storage Architect
Federico Lucifredi
Product Manager Director, Red Hat Ceph Storage
OPENSTACK?
Source: OpenStack Foundation April 2016 User Survey
65% OF CLOUDS ARE IN PRODUCTION
OpenStack adoption
Red Hat Open Hybrid Cloud
Red Hat OpenStack Platform
Overview
Red Hat OpenStack Platform delivers an integrated and open foundation to
create, scale, and manage a secure and reliable public or private
OpenStack cloud.
Customer benefits:
Delivers a production-ready cloud platform that combines Red Hat’s hardened
OpenStack infrastructure
Co-engineered and integrated with Red Hat Enterprise Linux
Offers a telco-grade, massively scalable platform
Delivers the highest levels of OpenStack performance
OpenStack provides elastic and scalable
platforms
Managed Private
Cloud
A Managed Private cloud
is a compute platform
implemented on premise
under the control of the IT
department, with a
management framework to
bring flexibility across
various resource pools.
Software to manage
policy-based provisioning
and management of data
storage independent of
the underlying hardware.
Can use industry standard
servers and disks rather
than purpose-built or
proprietary appliances.
Software Defined
Storage
Telco/NFV
Provides a stable, robust
and scalable means for
Telco providers to detach
from current networking
equipment at a lower cost
that allows them greater
flexibility for future growth
needs
Hybrid Cloud
Hybrid cloud is a cloud
computing environment
which uses a mix of on-
premises, private cloud
and third-party, public
cloud services with
orchestration between the
two platforms.
OpenStack enables agile and responsive
Apps
Converged IaaS and PaaS
Develop, run, orchestrate, and
manage multi-container based
applications at cloud scale on a
private cloud platform based on
OpenStack.
Container Infrastructure
Integrated container
infrastructure platform built to run,
orchestrate, and scale container-
based applications (traditional and
cloud native) across a managed
cluster of container hosts
Container-based application
development platform
An extension of the container
infrastructure platform to include
developer tools, services,
workflows, automation, and
application lifecycle management
capabilities.
●  Over 350+ members since launch in April 2013
●  Over 900 certified solutions in partner Marketplace
●  Over 4,000 RHEL certified compute servers
The image cannot be
displayed. Your computer
may not have enough
memory to open the image,
or the image may have
been corrupted. Restart
Largest Certified Partner Ecosystem
Channel Partners
Cloud Service Providers
Managed Service Providers
OEMs, IHVs,
ISVs
System Integrators
OpenStack: Framework for the
Cloud
●  Needs to access hardware resources
●  Needs an operating environment, hypervisor, services
●  Leverages existing code libraries for functionality
Main components
OpenStack Storage
OpenStack supports four types of persistent Storage:
-  Block storage (Cinder) Provides persistent block storage to running instances. Its
pluggable driver architecture facilitates the creation and management of block
storage devices.
-  Image Storage (Glance) - Stores and retrieves virtual machine disk images.
OpenStack Compute makes use of this during instance provisioning.
-  Shared File Systems (Manila) - provides a set of services for management of
shared file systems such as CIFS, NFS, CephFS & HDFS in a multi-tenant
environment.
-  Object storage (Swift) - Stores and retrieves arbitrary unstructured data objects via
a RESTful, HTTP based API. It is highly fault tolerant with its data replication and
scale out architecture. Its implementation is not like a file server with mountable
directories.
WHY TRADITIONAL STORAGE
SOLUTIONS WON'T WORK?
Storage challenges in OpenStack
Multiple storage interfaces to consume
File
Block
Object
They don’t all scale at the same pace
Mixing up storage technologies is painful to manage, needs
more talents/skills
Traditional Open, software-defined
Custom GUI
Proprietary Software
Proprietary
Hardware
Standard
computers
and disks
Standard
Hardware
OpenSource
Software
Ceph Gluster +++
Control Plane (API, GUI)
ADMIN USER
The Future of Storage
ADMIN
USER
ADMIN
USER
ADMIN
USER
Custom GUI
Proprietary Software
Proprietary
Hardware
Custom GUI
Proprietary Software
Proprietary
Hardware
Rising tide of software-defined storage
“By 2020, between 70-80% of unstructured
data will be held on lower-cost storage
managed by SDS environments.”
“By 2016, server-based storage solutions will
lower storage hardware costs by 50% or more.”
Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry”
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
~20% CAGR between 2015 and 2019
2013 2014 2015 2016 2017 2018 2019
$1,349M
$1,195M
$1,029M
$859M
$706M
$592M
SDS MARKET SIZE BY SEGMENT
$457M
Block Storage
File Storage
Object Storage
Hyper converged
Source: IDC
“By 2019, 70% of existing storage array products
will also be available as software only versions”
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
CEPH?
What is Ceph?
Open, massively-scalable, software-defined
Flexible, scale-out architecture on clustered commodity hardware
Single, efficient, unified storage platform
User-driven storage lifecycle management with 100% API
coverage
Integrated, easy-to-use management console
Designed for cloud infrastructure and emerging workloads
CRUSH
Controlled Replication Under Scalable Hashing:
Pseudo-random placement algorithm
Statistically uniform distribution (hash based)
Rule-based configuration
Topology aware
Powerful, production-grade, distributed storage for OpenStack
Open, massively scalable, and software-defined
Flexible, scale-out architecture on clustered commodity hardware
Specifically designed for cloud infrastructure and emerging workloads
Seamlessly integrated: Block (ephemeral and persistent), Object, and
file storage on COTS
2
2
RGW
Multisite v2
AWSv4
LDAP/AD
KeyStone v3
Swift API updates (Multi-
tenant, Expiration, SLO, Bulk
Delete)
RBD
Volume Mirroring
“DevOps” deployment
ceph-ansible (with Ansible 1.9)
“Apple” deployment
Red Hat Storage Console 2
RADOS
Improved Security
(uid ‘ceph’ for all processes)
Reduced impact of scrubbing
on client I/O
(Unified Queue)
3x small write performance
on SSD with RHEL 7.2
Tech Previews
BlueStore
CephFS
NFS Gateway for RGW
OPENSTACK AND CEPH
INTEGRATION
Ceph adoption in OpenStack
The unified story
Ongoing effort since OpenStack’s creation
Ceph is the foundation of the storage stack in OpenStack
Provides a single and flexible storage layer
Delivers the complete Open Source stack
Integrates perfectly with all OpenStack’s components
Tight product integration
As of Red Hat OpenStack Platform 8 you get:
64TB capacity of Red Hat Ceph Storage now included with Red Hat
OpenStack Platform.
Red Hat OpenStack Platform Director (deployment tool) integration -
RHCS is the default block storage for RHOSP.
OPENSTACK ARCHITECTURE
EXAMPLES WITH CEPH
Hyperconverged
Hypercon… what?
Co-locate compute and storage resources on the same machine
Fine control of resources using cgroups, NUMA and CPU
pinning
Enabler for container-based infrastructure
Can benefit from a local hit when performing an IO from a guest
Component upgrades made easy with containers
Multi-site with replicated storage
Re-using our basic robust stack
Multiple isolated OpenStack environments
With replicated storage for disaster recovery using Ceph
Each site has each other’s data
Live synchronization
Get your free copy!
The brand new OpenStack
Storage for Dummies is
available at the Red Hat
booth!
Thanks!
Sean Cohen - scohen@redhat.com
Sébastien Han - seb@redhat.com
Federico Lucifredi - federico@redhat.com

More Related Content

What's hot

Openstack Summit HK - Ceph defacto - eNovance
Openstack Summit HK - Ceph defacto - eNovanceOpenstack Summit HK - Ceph defacto - eNovance
Openstack Summit HK - Ceph defacto - eNovance
eNovance
 
Openstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - IsraelOpenstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - Israel
Arthur Berezin
 
6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view
openstackindia
 
High Availability from the DevOps side - OpenStack Summit Portland
High Availability from the DevOps side - OpenStack Summit PortlandHigh Availability from the DevOps side - OpenStack Summit Portland
High Availability from the DevOps side - OpenStack Summit Portland
eNovance
 

What's hot (20)

Openstack Summit HK - Ceph defacto - eNovance
Openstack Summit HK - Ceph defacto - eNovanceOpenstack Summit HK - Ceph defacto - eNovance
Openstack Summit HK - Ceph defacto - eNovance
 
Manila, an update from Liberty, OpenStack Summit - Tokyo
Manila, an update from Liberty, OpenStack Summit - TokyoManila, an update from Liberty, OpenStack Summit - Tokyo
Manila, an update from Liberty, OpenStack Summit - Tokyo
 
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
 
OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for Ope...
OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for Ope...OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for Ope...
OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for Ope...
 
Deploying openstack using ansible
Deploying openstack using ansibleDeploying openstack using ansible
Deploying openstack using ansible
 
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
 
Rook cncf-wg-storage
Rook cncf-wg-storageRook cncf-wg-storage
Rook cncf-wg-storage
 
Openstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - IsraelOpenstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - Israel
 
Ceph de facto storage backend for OpenStack
Ceph de facto storage backend for OpenStack Ceph de facto storage backend for OpenStack
Ceph de facto storage backend for OpenStack
 
6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view
 
Introduction to rook
Introduction to rookIntroduction to rook
Introduction to rook
 
High Availability from the DevOps side - OpenStack Summit Portland
High Availability from the DevOps side - OpenStack Summit PortlandHigh Availability from the DevOps side - OpenStack Summit Portland
High Availability from the DevOps side - OpenStack Summit Portland
 
以 Kubernetes 部屬 Spark 大數據計算環境
以 Kubernetes 部屬 Spark 大數據計算環境以 Kubernetes 部屬 Spark 大數據計算環境
以 Kubernetes 部屬 Spark 大數據計算環境
 
CEPH DAY BERLIN - CEPH ON THE BRAIN!
CEPH DAY BERLIN - CEPH ON THE BRAIN!CEPH DAY BERLIN - CEPH ON THE BRAIN!
CEPH DAY BERLIN - CEPH ON THE BRAIN!
 
Enhancing Kubernetes with Autoscaling & Hybrid Cloud IaaS
Enhancing Kubernetes with Autoscaling & Hybrid Cloud IaaSEnhancing Kubernetes with Autoscaling & Hybrid Cloud IaaS
Enhancing Kubernetes with Autoscaling & Hybrid Cloud IaaS
 
Kubernetes and OpenStack at Scale
Kubernetes and OpenStack at ScaleKubernetes and OpenStack at Scale
Kubernetes and OpenStack at Scale
 
John Spray - Ceph in Kubernetes
John Spray - Ceph in KubernetesJohn Spray - Ceph in Kubernetes
John Spray - Ceph in Kubernetes
 
Using Cinder Block Storage
Using Cinder Block StorageUsing Cinder Block Storage
Using Cinder Block Storage
 
Introduction to Container Storage Interface (CSI)
Introduction to Container Storage Interface (CSI)Introduction to Container Storage Interface (CSI)
Introduction to Container Storage Interface (CSI)
 
CEPH DAY BERLIN - DEPLOYING CEPH IN KUBERNETES WITH ROOK
CEPH DAY BERLIN - DEPLOYING CEPH IN KUBERNETES WITH ROOKCEPH DAY BERLIN - DEPLOYING CEPH IN KUBERNETES WITH ROOK
CEPH DAY BERLIN - DEPLOYING CEPH IN KUBERNETES WITH ROOK
 

Viewers also liked

Deep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatDeep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Sean Cohen
 

Viewers also liked (20)

Tricircle overview
Tricircle overviewTricircle overview
Tricircle overview
 
Issues of OpenStack multi-region mode
Issues of OpenStack multi-region modeIssues of OpenStack multi-region mode
Issues of OpenStack multi-region mode
 
Multisite OpenStack for NFV: Bridging the Gap
Multisite OpenStack for NFV: Bridging the GapMultisite OpenStack for NFV: Bridging the Gap
Multisite OpenStack for NFV: Bridging the Gap
 
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatDeep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red Hat
 
Deterministic capacity planning for OpenStack as elastic cloud infrastructure
Deterministic capacity planning for OpenStack as elastic cloud infrastructureDeterministic capacity planning for OpenStack as elastic cloud infrastructure
Deterministic capacity planning for OpenStack as elastic cloud infrastructure
 
Open stack summit 2016 austin参加報告
Open stack summit 2016 austin参加報告Open stack summit 2016 austin参加報告
Open stack summit 2016 austin参加報告
 
What Multisite Means for Identity Management
What Multisite Means for Identity ManagementWhat Multisite Means for Identity Management
What Multisite Means for Identity Management
 
Designing and Building Multi-Region Swift Deployment
Designing and Building Multi-Region Swift DeploymentDesigning and Building Multi-Region Swift Deployment
Designing and Building Multi-Region Swift Deployment
 
WordCamp Seoul 2012 - WordPress Multisite & Security
WordCamp Seoul 2012 - WordPress Multisite & SecurityWordCamp Seoul 2012 - WordPress Multisite & Security
WordCamp Seoul 2012 - WordPress Multisite & Security
 
OpenStack Storage Buddy Ceph
OpenStack Storage Buddy CephOpenStack Storage Buddy Ceph
OpenStack Storage Buddy Ceph
 
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
 
Introduction of OpenStack cascading solution
Introduction of OpenStack cascading solutionIntroduction of OpenStack cascading solution
Introduction of OpenStack cascading solution
 
The OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack NordicThe OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack Nordic
 
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
Multi-Cell OpenStack: How to Evolve Your Cloud to Scale - November, 2014
 
Build cloud like Rackspace with OpenStack Ansible
Build cloud like Rackspace with OpenStack AnsibleBuild cloud like Rackspace with OpenStack Ansible
Build cloud like Rackspace with OpenStack Ansible
 
Build Your Own Open Source Cloud
Build Your Own Open Source CloudBuild Your Own Open Source Cloud
Build Your Own Open Source Cloud
 
Multisite core concepts final
Multisite core concepts finalMultisite core concepts final
Multisite core concepts final
 
Building Multi-Site and Multi-OpenStack Cloud with OpenStack Cascading
Building Multi-Site and Multi-OpenStack Cloud with OpenStack CascadingBuilding Multi-Site and Multi-OpenStack Cloud with OpenStack Cascading
Building Multi-Site and Multi-OpenStack Cloud with OpenStack Cascading
 
OpenStack Summits 101: A Guide For Attendees
OpenStack Summits 101: A Guide For AttendeesOpenStack Summits 101: A Guide For Attendees
OpenStack Summits 101: A Guide For Attendees
 
Summit 16: Keynote: HPE Presentation- Transforming Communication Service Prov...
Summit 16: Keynote: HPE Presentation- Transforming Communication Service Prov...Summit 16: Keynote: HPE Presentation- Transforming Communication Service Prov...
Summit 16: Keynote: HPE Presentation- Transforming Communication Service Prov...
 

Similar to Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack

Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
Rodrigo Missiaggia
 
OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick Hamon
OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick HamonOpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick Hamon
OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick Hamon
eNovance
 
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Community
 

Similar to Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack (20)

Red Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph StorageRed Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph Storage
 
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise CloudsCEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
 
Introduction to OpenStack (2012)
Introduction to OpenStack (2012)Introduction to OpenStack (2012)
Introduction to OpenStack (2012)
 
Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
 
Red Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and FutureRed Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and Future
 
Red Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) OverviewRed Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) Overview
 
An overview of OpenStack for the VMware community
An overview of OpenStack for the VMware communityAn overview of OpenStack for the VMware community
An overview of OpenStack for the VMware community
 
The Next Generation Datacenter
The Next Generation DatacenterThe Next Generation Datacenter
The Next Generation Datacenter
 
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...
 
OpenStack - An Overview
OpenStack - An OverviewOpenStack - An Overview
OpenStack - An Overview
 
OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick Hamon
OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick HamonOpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick Hamon
OpenStack in Action! 5 - Dell - OpenStack powered solutions - Patrick Hamon
 
A Look at the Future of Storage
A Look at the Future of StorageA Look at the Future of Storage
A Look at the Future of Storage
 
Open Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit ParisOpen Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit Paris
 
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
 
Ceph as software define storage
Ceph as software define storageCeph as software define storage
Ceph as software define storage
 
OpenStack for VMware Administrators
OpenStack for VMware AdministratorsOpenStack for VMware Administrators
OpenStack for VMware Administrators
 
Red Hat Summit 2015: Red Hat Storage Breakfast session
Red Hat Summit 2015: Red Hat Storage Breakfast sessionRed Hat Summit 2015: Red Hat Storage Breakfast session
Red Hat Summit 2015: Red Hat Storage Breakfast session
 
Scalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the CloudScalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the Cloud
 
Ceph Day Shanghai - Hyper Converged PLCloud with Ceph
Ceph Day Shanghai - Hyper Converged PLCloud with Ceph Ceph Day Shanghai - Hyper Converged PLCloud with Ceph
Ceph Day Shanghai - Hyper Converged PLCloud with Ceph
 
Ravi Namboori 's Open stack framework introduction
Ravi Namboori 's Open stack framework introductionRavi Namboori 's Open stack framework introduction
Ravi Namboori 's Open stack framework introduction
 

More from Sean Cohen

More from Sean Cohen (6)

Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
 
3-2-1 Action! Running OpenStack Shared File System Service in Production
3-2-1 Action! Running OpenStack Shared File System Service in Production3-2-1 Action! Running OpenStack Shared File System Service in Production
3-2-1 Action! Running OpenStack Shared File System Service in Production
 
The road to enterprise ready open stack storage as service
The road to enterprise ready open stack storage as serviceThe road to enterprise ready open stack storage as service
The road to enterprise ready open stack storage as service
 
Dude where's my volume, open stack summit vancouver 2015
Dude where's my volume, open stack summit vancouver 2015Dude where's my volume, open stack summit vancouver 2015
Dude where's my volume, open stack summit vancouver 2015
 
Kvm forum 2013 - future integration points for oVirt storage
Kvm forum 2013 - future integration points for oVirt storageKvm forum 2013 - future integration points for oVirt storage
Kvm forum 2013 - future integration points for oVirt storage
 
Integration of Storage, OpenStack & Virtualization
 Integration of Storage, OpenStack & Virtualization Integration of Storage, OpenStack & Virtualization
Integration of Storage, OpenStack & Virtualization
 

Recently uploaded

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 

Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack

  • 1. Peanut butter and jelly Mapping the deep Integration between Ceph and OpenStack Sean Cohen Associate Manager, OpenStack Product Team Sébastien Han Principal Software Engineer, Storage Architect Federico Lucifredi Product Manager Director, Red Hat Ceph Storage
  • 3. Source: OpenStack Foundation April 2016 User Survey 65% OF CLOUDS ARE IN PRODUCTION OpenStack adoption
  • 4. Red Hat Open Hybrid Cloud
  • 5. Red Hat OpenStack Platform Overview Red Hat OpenStack Platform delivers an integrated and open foundation to create, scale, and manage a secure and reliable public or private OpenStack cloud. Customer benefits: Delivers a production-ready cloud platform that combines Red Hat’s hardened OpenStack infrastructure Co-engineered and integrated with Red Hat Enterprise Linux Offers a telco-grade, massively scalable platform Delivers the highest levels of OpenStack performance
  • 6. OpenStack provides elastic and scalable platforms Managed Private Cloud A Managed Private cloud is a compute platform implemented on premise under the control of the IT department, with a management framework to bring flexibility across various resource pools. Software to manage policy-based provisioning and management of data storage independent of the underlying hardware. Can use industry standard servers and disks rather than purpose-built or proprietary appliances. Software Defined Storage Telco/NFV Provides a stable, robust and scalable means for Telco providers to detach from current networking equipment at a lower cost that allows them greater flexibility for future growth needs Hybrid Cloud Hybrid cloud is a cloud computing environment which uses a mix of on- premises, private cloud and third-party, public cloud services with orchestration between the two platforms.
  • 7. OpenStack enables agile and responsive Apps Converged IaaS and PaaS Develop, run, orchestrate, and manage multi-container based applications at cloud scale on a private cloud platform based on OpenStack. Container Infrastructure Integrated container infrastructure platform built to run, orchestrate, and scale container- based applications (traditional and cloud native) across a managed cluster of container hosts Container-based application development platform An extension of the container infrastructure platform to include developer tools, services, workflows, automation, and application lifecycle management capabilities.
  • 8. ●  Over 350+ members since launch in April 2013 ●  Over 900 certified solutions in partner Marketplace ●  Over 4,000 RHEL certified compute servers The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart Largest Certified Partner Ecosystem Channel Partners Cloud Service Providers Managed Service Providers OEMs, IHVs, ISVs System Integrators
  • 9. OpenStack: Framework for the Cloud ●  Needs to access hardware resources ●  Needs an operating environment, hypervisor, services ●  Leverages existing code libraries for functionality
  • 11. OpenStack Storage OpenStack supports four types of persistent Storage: -  Block storage (Cinder) Provides persistent block storage to running instances. Its pluggable driver architecture facilitates the creation and management of block storage devices. -  Image Storage (Glance) - Stores and retrieves virtual machine disk images. OpenStack Compute makes use of this during instance provisioning. -  Shared File Systems (Manila) - provides a set of services for management of shared file systems such as CIFS, NFS, CephFS & HDFS in a multi-tenant environment. -  Object storage (Swift) - Stores and retrieves arbitrary unstructured data objects via a RESTful, HTTP based API. It is highly fault tolerant with its data replication and scale out architecture. Its implementation is not like a file server with mountable directories.
  • 13. Storage challenges in OpenStack Multiple storage interfaces to consume File Block Object They don’t all scale at the same pace Mixing up storage technologies is painful to manage, needs more talents/skills
  • 14. Traditional Open, software-defined Custom GUI Proprietary Software Proprietary Hardware Standard computers and disks Standard Hardware OpenSource Software Ceph Gluster +++ Control Plane (API, GUI) ADMIN USER The Future of Storage ADMIN USER ADMIN USER ADMIN USER Custom GUI Proprietary Software Proprietary Hardware Custom GUI Proprietary Software Proprietary Hardware
  • 15. Rising tide of software-defined storage “By 2020, between 70-80% of unstructured data will be held on lower-cost storage managed by SDS environments.” “By 2016, server-based storage solutions will lower storage hardware costs by 50% or more.” Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry” Innovation Insight: Separating Hype From Hope for Software-Defined Storage ~20% CAGR between 2015 and 2019 2013 2014 2015 2016 2017 2018 2019 $1,349M $1,195M $1,029M $859M $706M $592M SDS MARKET SIZE BY SEGMENT $457M Block Storage File Storage Object Storage Hyper converged Source: IDC “By 2019, 70% of existing storage array products will also be available as software only versions” Innovation Insight: Separating Hype From Hope for Software-Defined Storage
  • 16. CEPH?
  • 17. What is Ceph? Open, massively-scalable, software-defined Flexible, scale-out architecture on clustered commodity hardware Single, efficient, unified storage platform User-driven storage lifecycle management with 100% API coverage Integrated, easy-to-use management console Designed for cloud infrastructure and emerging workloads
  • 18.
  • 19. CRUSH Controlled Replication Under Scalable Hashing: Pseudo-random placement algorithm Statistically uniform distribution (hash based) Rule-based configuration Topology aware
  • 20. Powerful, production-grade, distributed storage for OpenStack Open, massively scalable, and software-defined Flexible, scale-out architecture on clustered commodity hardware Specifically designed for cloud infrastructure and emerging workloads Seamlessly integrated: Block (ephemeral and persistent), Object, and file storage on COTS 2
  • 21. 2 RGW Multisite v2 AWSv4 LDAP/AD KeyStone v3 Swift API updates (Multi- tenant, Expiration, SLO, Bulk Delete) RBD Volume Mirroring “DevOps” deployment ceph-ansible (with Ansible 1.9) “Apple” deployment Red Hat Storage Console 2 RADOS Improved Security (uid ‘ceph’ for all processes) Reduced impact of scrubbing on client I/O (Unified Queue) 3x small write performance on SSD with RHEL 7.2 Tech Previews BlueStore CephFS NFS Gateway for RGW
  • 23. Ceph adoption in OpenStack
  • 24. The unified story Ongoing effort since OpenStack’s creation Ceph is the foundation of the storage stack in OpenStack Provides a single and flexible storage layer Delivers the complete Open Source stack Integrates perfectly with all OpenStack’s components
  • 25.
  • 26. Tight product integration As of Red Hat OpenStack Platform 8 you get: 64TB capacity of Red Hat Ceph Storage now included with Red Hat OpenStack Platform. Red Hat OpenStack Platform Director (deployment tool) integration - RHCS is the default block storage for RHOSP.
  • 28. Hyperconverged Hypercon… what? Co-locate compute and storage resources on the same machine Fine control of resources using cgroups, NUMA and CPU pinning Enabler for container-based infrastructure Can benefit from a local hit when performing an IO from a guest Component upgrades made easy with containers
  • 29.
  • 30. Multi-site with replicated storage Re-using our basic robust stack Multiple isolated OpenStack environments With replicated storage for disaster recovery using Ceph Each site has each other’s data Live synchronization
  • 31.
  • 32. Get your free copy! The brand new OpenStack Storage for Dummies is available at the Red Hat booth!
  • 33. Thanks! Sean Cohen - scohen@redhat.com Sébastien Han - seb@redhat.com Federico Lucifredi - federico@redhat.com