SlideShare a Scribd company logo
1 of 24
Introduction to
OpenStack
Cinder
Sean McGinnis
2 of 24
OpenStack Components
Horizon
UI
Keyston
e
Identity Service
Nova
Compute
Glance
Image Service
Neutron
Networking
Cinder
Block Storage
Manila
Shared File
Storage
Swift
Object Store
3 of 24
Cinder Mission Statement
To implement services and libraries to provide on
demand, self-service access to Block Storage
resources. Provide Software Defined Block Storage
via abstraction and automation on top of various
traditional backend block storage devices.
4 of 24
What is Cinder?
• Created in the OpenStack Folsom release (2012)
– Spun off from Nova volume
• Cinder manages block storage
– Different than shared file storage – that’s Manila
– Different than object storage – that’s Swift
– Provides management abstraction over a variety of backends
– Provides:
› Create/delete
› Attach/detach
› Snapshot
› Backup
• Volumes have lifecycles independent of VMs
5 of 24
Where Does Cinder Fit?
• Cinder provides API’s to interact with vendors’ storage backends
• Exposes vendor’s storage hardware to the cloud
• Provides persistent storage to VMs, containers, bare metal…
• Enables end users to manage their storage without knowing
where that storage is coming from
6 of 24
Where Does Cinder Fit?
Legend
Control Path
Data Path
Note that iSCSI is just
an example – several
additional protocols are
supported
(e.g., FC, NFS)
Storage Controller
Nova
VM
/dev/vda
KVM
iSCSI
initiator
Cinder
iSCSI
target
VM
7 of 24
Cinder Architecture
cinder-api
cinder-scheduler
cinder-volume
driver
cinder-backup
SQL DB
client
REST
Storage
Message Queue
8 of 24
Cinder Services
• API
– REST interface to Cinder
– Generally runs on control node
• Scheduler
– Takes requests from the API service
– Works with the volume service to satisfy requests
– Generally runs on control node
9 of 24
Cinder Services
• Volume
– Interacts with vendor storage backends
– Can run on control node
– Sometimes offloaded to different host
› Especially for LVM backend
• Backup
– Interface to backup volumes to storage like Swift, TSM, Google Cloud
Storage, etc.
– Able to scale out to multiple nodes for simultaneous operations
10 of 24
Clients
• Cinder Client
– python-cinderclient is the command line interface to Cinder
› ‘cinder volume create 1 --name Test’
– Also client library for Python code
– Uses REST to communicate with the cinder-api service
• OpenStack Client
– All projects moving to OpenStack Client
› ‘openstack volume create --size 1 Test’
11 of 24
Horizon Dashboard
12 of 24
Cinder Drivers
● Block Device Driver (local)
● Blockbridge (iSCSI)
● CloudByte (iSCSI)
● Coho (NFS)
● Datera (iSCSI)
● Dell Equallogic (iSCSI)
● Dell Storage Center (iSCSI/FC)
● Disco (disco)
● DotHill (iSCSI/FC)
● DRBD (DRBD/iSCSI)
● EMC VMAX (iSCSI/FC)
● EMC VNX (iSCSI/FC)
● EMC XtremIO (iSCSI/FC)
● EMC ScaleIO (scaleio)
● Fujitsu ETERNUS (iSCSI/FC)
● GlusterFS (GlusterFS)
● HGST (NFS)
● HPE 3PAR (iSCSI/FC)
● HPE LeftHand (iSCSI)
● HPE MSA (iSCSI/FC)
● HPE XP (FC)
● Hitachi HBSD (iSCSI/FC)
● Hitachi HNAS (iSCSI/NFS)
● Huawei (iSCSI/FC)
● IBM DS8000 (FC)
● IBM Flashsystem (iSCSI/FC)
● IBM GPFS (GPFS)
● IBM Storwize SVC (iSCSI/FC)
● IBM XIV (iSCSI/FC)
● Infortrend (iSCSI/FC)
● Lenovo (iSCSI/FC)
● LVM (iSCSI) – Reference*
● NetApp ONTAP (iSCSI/NFS/FC)
● NetApp E Series (iSCSI/FC)
● Nexenta (iSCSI/NFS)
● NFS – Reference
● Nimble Storage (iSCSI)
● Oracle Zfssa (iSCSI/NFS)
● Pure Storage (iSCSI/FC)
● ProphetStor (iSCSI/FC)
● Quobyte (quobyte)
● RBD (Ceph) - Reference
● Scality SOFS (scality)
● Sheepdog (sheepdog)
● SMBFS (SMB)
● SolidFire (iSCSI)
● Tegile (iSCSI/FC)
● Tintri (NFS)
● Violin (FC)
● VMware (VMDK)
● Virtuozzo Storage (NFS)
● Windows (SMB)
● X-IO (iSCSI/FC)
(Drivers in bold are the reference for the architecture)
13 of 24
Minimum Driver Features
Drivers must implement support for the core
features:
 Volume Create/Delete
 Volume Attach/Detach
 Snapshot Create/Delete
 Create Volume from Snapshot
 Copy Image to Volume
 Copy Volume to Image
 Clone Volume
 Extend Volume
14 of 24
Volume Types
• Used to request properties of
volumes during creation
• Can also control users’ access
to different storage
• Only admins can create
volume types
• Users specify the volume type
when they create a volume
15 of 24
Volume Type Extra Specs
• Extra specs are used to set type properties
• Some standard, some vendor specific
– volume_backend_name=lvm1
– sio:provisioning_type:thin
– hp3par:persona=3
• Extra specs are only visible to the admin
16 of 24
Volume Type Extra Specs
• Extra specs can be modified via UI, CLI, or API
# cinder type-create GoldVolume
# cinder type-key GoldVolume set storagetype:storageprofile=highpriority
# cinder type-create BronzeVolume
# cinder type-key BronzeVolume set storagetype:storageprofile=lowpriorty
17 of 24
Retype and Migration
• Retype is used to change settings of a
volume
– Some retypes can happen without moving
data
– Some require moving the volume to a
different backend
• Migration is used to move a volume
between two different backends
– For example – from LVM to Ceph
18 of 24
Fibre Channel Support
• Fibre Channel Zone Manager
• Dynamically create and delete switch zoning
• Drivers to support fabric management:
– Brocade
– Cisco
19 of 24
Cinder Backup
• Backup and restore volumes
• Must be either in Available state or able to create and mount
snapshot
• Several backup drivers supported:
– Ceph
– Google Cloud Storage
– NFS
– Posix Filesystem
– Swift
– Tivoli Storage Manager
20 of 24
Cinder Backup
• Backup via CLI, UI, or API
• Needs to be enabled in Horizon
– /etc/openstack-dashboard/local_settings.py
– OPENSTACK_CINDER_FEATURES = {‘enable_backup’: True}
• No cron type scheduling in Cinder
# cinder backup-create --name MyBackup --description “prepatch” 
--incremental vol1
# cinder backup-restore a006718b-b583-4d59-9ddb-d1109dc98ebf
21 of 24
Mitaka Updates
• Basic support for replication
• Backup improvements
– Backup of snapshots
– Scale out of backup-service nodes
– Full and incremental backup
• Active/Active HA progress
• OS-brick library and client
• Rolling upgrades
• Work toward multiattach
• API microversions
22 of 24
Ongoing/Future Work
• Better support for replication
• Active/Active High Availability
• More backend storage support
• Better user error reporting
• Improved OpenStack Client support
23 of 24
References
OpenStack Documentation
• http://docs.openstack.org/
Cinder Developer Wiki
• https://wiki.openstack.org/wiki/Cinder
Bug and New Feature Tracking
• https://launchpad.net/cinder
Introduction to Cinder

More Related Content

What's hot

OpenStack Tokyo Meeup - Gluster Storage Day
OpenStack Tokyo Meeup - Gluster Storage DayOpenStack Tokyo Meeup - Gluster Storage Day
OpenStack Tokyo Meeup - Gluster Storage DayDan Radez
 
Copr HD OpenStack Day India
Copr HD OpenStack Day IndiaCopr HD OpenStack Day India
Copr HD OpenStack Day Indiaopenstackindia
 
Filesystem as a service in OpenStack
Filesystem as a service in OpenStackFilesystem as a service in OpenStack
Filesystem as a service in OpenStackopenstackindia
 
Open stack solidfire-mavenspire-meetup
Open stack solidfire-mavenspire-meetupOpen stack solidfire-mavenspire-meetup
Open stack solidfire-mavenspire-meetupGene Dubensky
 
OpenStack Best Practices and Considerations - terasky tech day
OpenStack Best Practices and Considerations  - terasky tech dayOpenStack Best Practices and Considerations  - terasky tech day
OpenStack Best Practices and Considerations - terasky tech dayArthur Berezin
 
3 ubuntu open_stack_ceph
3 ubuntu open_stack_ceph3 ubuntu open_stack_ceph
3 ubuntu open_stack_cephopenstackindia
 
Introduction to OpenStack Cinder
Introduction to OpenStack CinderIntroduction to OpenStack Cinder
Introduction to OpenStack CinderSean McGinnis
 
Laying OpenStack Cinder Block Services
Laying OpenStack Cinder Block ServicesLaying OpenStack Cinder Block Services
Laying OpenStack Cinder Block ServicesKenneth Hui
 
Storage as a service and OpenStack Cinder
Storage as a service and OpenStack CinderStorage as a service and OpenStack Cinder
Storage as a service and OpenStack Cinderopenstackindia
 
Kata Container - The Security of VM and The Speed of Container | Yuntong Jin
Kata Container - The Security of VM and The Speed of Container | Yuntong Jin	Kata Container - The Security of VM and The Speed of Container | Yuntong Jin
Kata Container - The Security of VM and The Speed of Container | Yuntong Jin Vietnam Open Infrastructure User Group
 
Using Cinder Block Storage
Using Cinder Block StorageUsing Cinder Block Storage
Using Cinder Block StorageRed_Hat_Storage
 
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red Hat
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red HatMultiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red Hat
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red HatOpenStack
 
What's new in OpenStack Liberty
What's new in OpenStack LibertyWhat's new in OpenStack Liberty
What's new in OpenStack LibertyStephen Gordon
 
Build cloud like Rackspace with OpenStack Ansible
Build cloud like Rackspace with OpenStack AnsibleBuild cloud like Rackspace with OpenStack Ansible
Build cloud like Rackspace with OpenStack AnsibleJirayut Nimsaeng
 
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...NETWAYS
 
Storage based on_openstack_mariocho
Storage based on_openstack_mariochoStorage based on_openstack_mariocho
Storage based on_openstack_mariochoMario Cho
 

What's hot (20)

OpenStack Tokyo Meeup - Gluster Storage Day
OpenStack Tokyo Meeup - Gluster Storage DayOpenStack Tokyo Meeup - Gluster Storage Day
OpenStack Tokyo Meeup - Gluster Storage Day
 
OpenStack Watcher
OpenStack WatcherOpenStack Watcher
OpenStack Watcher
 
Copr HD OpenStack Day India
Copr HD OpenStack Day IndiaCopr HD OpenStack Day India
Copr HD OpenStack Day India
 
Filesystem as a service in OpenStack
Filesystem as a service in OpenStackFilesystem as a service in OpenStack
Filesystem as a service in OpenStack
 
OpenStack Storage Overview
OpenStack Storage OverviewOpenStack Storage Overview
OpenStack Storage Overview
 
Open stack solidfire-mavenspire-meetup
Open stack solidfire-mavenspire-meetupOpen stack solidfire-mavenspire-meetup
Open stack solidfire-mavenspire-meetup
 
OpenStack Best Practices and Considerations - terasky tech day
OpenStack Best Practices and Considerations  - terasky tech dayOpenStack Best Practices and Considerations  - terasky tech day
OpenStack Best Practices and Considerations - terasky tech day
 
3 ubuntu open_stack_ceph
3 ubuntu open_stack_ceph3 ubuntu open_stack_ceph
3 ubuntu open_stack_ceph
 
Introduction to OpenStack Cinder
Introduction to OpenStack CinderIntroduction to OpenStack Cinder
Introduction to OpenStack Cinder
 
Openstack ansible
Openstack ansibleOpenstack ansible
Openstack ansible
 
Laying OpenStack Cinder Block Services
Laying OpenStack Cinder Block ServicesLaying OpenStack Cinder Block Services
Laying OpenStack Cinder Block Services
 
Storage as a service and OpenStack Cinder
Storage as a service and OpenStack CinderStorage as a service and OpenStack Cinder
Storage as a service and OpenStack Cinder
 
Kata Container - The Security of VM and The Speed of Container | Yuntong Jin
Kata Container - The Security of VM and The Speed of Container | Yuntong Jin	Kata Container - The Security of VM and The Speed of Container | Yuntong Jin
Kata Container - The Security of VM and The Speed of Container | Yuntong Jin
 
Using Cinder Block Storage
Using Cinder Block StorageUsing Cinder Block Storage
Using Cinder Block Storage
 
Devstack On Demand
Devstack On DemandDevstack On Demand
Devstack On Demand
 
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red Hat
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red HatMultiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red Hat
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red Hat
 
What's new in OpenStack Liberty
What's new in OpenStack LibertyWhat's new in OpenStack Liberty
What's new in OpenStack Liberty
 
Build cloud like Rackspace with OpenStack Ansible
Build cloud like Rackspace with OpenStack AnsibleBuild cloud like Rackspace with OpenStack Ansible
Build cloud like Rackspace with OpenStack Ansible
 
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
OpenNebula Conf 2014 | Understanding the OpenNebula Model for Cloud Provision...
 
Storage based on_openstack_mariocho
Storage based on_openstack_mariochoStorage based on_openstack_mariocho
Storage based on_openstack_mariocho
 

Viewers also liked

Your first patch to OpenStack
Your first patch to OpenStackYour first patch to OpenStack
Your first patch to OpenStackopenstackindia
 
The OpenStack Contribution Workflow
The OpenStack Contribution WorkflowThe OpenStack Contribution Workflow
The OpenStack Contribution Workflowopenstackindia
 
OpenStack Storage Buddy Ceph
OpenStack Storage Buddy CephOpenStack Storage Buddy Ceph
OpenStack Storage Buddy Cephopenstackindia
 
OpenStack Tempest and REST API testing
OpenStack Tempest and REST API testingOpenStack Tempest and REST API testing
OpenStack Tempest and REST API testingopenstackindia
 
OpenStack Neutron Behind The Senes
OpenStack Neutron Behind The SenesOpenStack Neutron Behind The Senes
OpenStack Neutron Behind The Senesopenstackindia
 
State of Containers in OpenStack
State of Containers in OpenStackState of Containers in OpenStack
State of Containers in OpenStackopenstackindia
 
OpenStack NFV Edge computing for IOT microservices
OpenStack NFV Edge computing for IOT microservicesOpenStack NFV Edge computing for IOT microservices
OpenStack NFV Edge computing for IOT microservicesopenstackindia
 

Viewers also liked (9)

OpenStack Cinder
OpenStack CinderOpenStack Cinder
OpenStack Cinder
 
Your first patch to OpenStack
Your first patch to OpenStackYour first patch to OpenStack
Your first patch to OpenStack
 
The OpenStack Contribution Workflow
The OpenStack Contribution WorkflowThe OpenStack Contribution Workflow
The OpenStack Contribution Workflow
 
OpenStack Storage Buddy Ceph
OpenStack Storage Buddy CephOpenStack Storage Buddy Ceph
OpenStack Storage Buddy Ceph
 
OPNFV & OpenStack
OPNFV & OpenStackOPNFV & OpenStack
OPNFV & OpenStack
 
OpenStack Tempest and REST API testing
OpenStack Tempest and REST API testingOpenStack Tempest and REST API testing
OpenStack Tempest and REST API testing
 
OpenStack Neutron Behind The Senes
OpenStack Neutron Behind The SenesOpenStack Neutron Behind The Senes
OpenStack Neutron Behind The Senes
 
State of Containers in OpenStack
State of Containers in OpenStackState of Containers in OpenStack
State of Containers in OpenStack
 
OpenStack NFV Edge computing for IOT microservices
OpenStack NFV Edge computing for IOT microservicesOpenStack NFV Edge computing for IOT microservices
OpenStack NFV Edge computing for IOT microservices
 

Similar to Introduction to Cinder

OpenStack Cinder, Implementation Today and New Trends for Tomorrow
OpenStack Cinder, Implementation Today and New Trends for TomorrowOpenStack Cinder, Implementation Today and New Trends for Tomorrow
OpenStack Cinder, Implementation Today and New Trends for TomorrowEd Balduf
 
Storage as a service OpenStack
Storage as a service OpenStackStorage as a service OpenStack
Storage as a service OpenStackopenstackindia
 
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatDeep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatSean Cohen
 
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...Celia Chase
 
stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...
stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...
stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...NETWAYS
 
7. Cloud Native Computing - Kubernetes - Bratislava - Rook.io
7. Cloud Native Computing - Kubernetes - Bratislava - Rook.io7. Cloud Native Computing - Kubernetes - Bratislava - Rook.io
7. Cloud Native Computing - Kubernetes - Bratislava - Rook.ioDávid Kőszeghy
 
LibCT: one lib to rule them all -- Andrey Vagin
LibCT: one lib to rule them all -- Andrey VaginLibCT: one lib to rule them all -- Andrey Vagin
LibCT: one lib to rule them all -- Andrey VaginOpenVZ
 
XenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud EnvironmentsXenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud EnvironmentsTim Mackey
 
Ippevent : openshift Introduction
Ippevent : openshift IntroductionIppevent : openshift Introduction
Ippevent : openshift Introductionkanedafromparis
 
Presentation citrix cloud platform for infrastructure as a service
Presentation   citrix cloud platform for infrastructure as a servicePresentation   citrix cloud platform for infrastructure as a service
Presentation citrix cloud platform for infrastructure as a servicexKinAnx
 
OpenStack Cinder Best Practices - Meet Up
OpenStack Cinder Best Practices - Meet UpOpenStack Cinder Best Practices - Meet Up
OpenStack Cinder Best Practices - Meet UpAaron Delp
 
Security of Linux containers in the cloud
Security of Linux containers in the cloudSecurity of Linux containers in the cloud
Security of Linux containers in the cloudDobrica Pavlinušić
 
Private Cloud with Open Stack, Docker
Private Cloud with Open Stack, DockerPrivate Cloud with Open Stack, Docker
Private Cloud with Open Stack, DockerDavinder Kohli
 
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...DataStax Academy
 
Leveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analyticsLeveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analyticsJulien Anguenot
 
Leveraging OpenStack Cinder for Peak Application Performance
Leveraging OpenStack Cinder for Peak Application PerformanceLeveraging OpenStack Cinder for Peak Application Performance
Leveraging OpenStack Cinder for Peak Application PerformanceNetApp
 
Climb Technical Overview
Climb Technical OverviewClimb Technical Overview
Climb Technical OverviewArif Ali
 

Similar to Introduction to Cinder (20)

OpenStack Cinder, Implementation Today and New Trends for Tomorrow
OpenStack Cinder, Implementation Today and New Trends for TomorrowOpenStack Cinder, Implementation Today and New Trends for Tomorrow
OpenStack Cinder, Implementation Today and New Trends for Tomorrow
 
Storage as a service OpenStack
Storage as a service OpenStackStorage as a service OpenStack
Storage as a service OpenStack
 
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatDeep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red Hat
 
Cncf meetup-rook
Cncf meetup-rookCncf meetup-rook
Cncf meetup-rook
 
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...
 
stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...
stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...
stackconf 2020 | Replace your Docker based Containers with Cri-o Kata Contain...
 
Cncf meetup-rook
Cncf meetup-rookCncf meetup-rook
Cncf meetup-rook
 
7. Cloud Native Computing - Kubernetes - Bratislava - Rook.io
7. Cloud Native Computing - Kubernetes - Bratislava - Rook.io7. Cloud Native Computing - Kubernetes - Bratislava - Rook.io
7. Cloud Native Computing - Kubernetes - Bratislava - Rook.io
 
LibCT: one lib to rule them all -- Andrey Vagin
LibCT: one lib to rule them all -- Andrey VaginLibCT: one lib to rule them all -- Andrey Vagin
LibCT: one lib to rule them all -- Andrey Vagin
 
XenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud EnvironmentsXenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud Environments
 
Ippevent : openshift Introduction
Ippevent : openshift IntroductionIppevent : openshift Introduction
Ippevent : openshift Introduction
 
Presentation citrix cloud platform for infrastructure as a service
Presentation   citrix cloud platform for infrastructure as a servicePresentation   citrix cloud platform for infrastructure as a service
Presentation citrix cloud platform for infrastructure as a service
 
OpenStack Cinder Best Practices - Meet Up
OpenStack Cinder Best Practices - Meet UpOpenStack Cinder Best Practices - Meet Up
OpenStack Cinder Best Practices - Meet Up
 
Security of Linux containers in the cloud
Security of Linux containers in the cloudSecurity of Linux containers in the cloud
Security of Linux containers in the cloud
 
OpenVZ Linux Containers
OpenVZ Linux ContainersOpenVZ Linux Containers
OpenVZ Linux Containers
 
Private Cloud with Open Stack, Docker
Private Cloud with Open Stack, DockerPrivate Cloud with Open Stack, Docker
Private Cloud with Open Stack, Docker
 
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...
 
Leveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analyticsLeveraging Cassandra for real-time multi-datacenter public cloud analytics
Leveraging Cassandra for real-time multi-datacenter public cloud analytics
 
Leveraging OpenStack Cinder for Peak Application Performance
Leveraging OpenStack Cinder for Peak Application PerformanceLeveraging OpenStack Cinder for Peak Application Performance
Leveraging OpenStack Cinder for Peak Application Performance
 
Climb Technical Overview
Climb Technical OverviewClimb Technical Overview
Climb Technical Overview
 

More from openstackindia

Ceph openstack-jun-2015-meetup
Ceph openstack-jun-2015-meetupCeph openstack-jun-2015-meetup
Ceph openstack-jun-2015-meetupopenstackindia
 
Role of sdn controllers in open stack
Role of sdn controllers in open stackRole of sdn controllers in open stack
Role of sdn controllers in open stackopenstackindia
 
Outreachy with-openstack-zaqar
Outreachy with-openstack-zaqarOutreachy with-openstack-zaqar
Outreachy with-openstack-zaqaropenstackindia
 
Enhancing OpenStack FWaaS for real world application
Enhancing OpenStack FWaaS for real world applicationEnhancing OpenStack FWaaS for real world application
Enhancing OpenStack FWaaS for real world applicationopenstackindia
 
Why open stack database as a service offerings are doomed
Why open stack database as a service offerings are doomedWhy open stack database as a service offerings are doomed
Why open stack database as a service offerings are doomedopenstackindia
 
OpenStack Neutron Reverse Engineered
OpenStack Neutron Reverse EngineeredOpenStack Neutron Reverse Engineered
OpenStack Neutron Reverse Engineeredopenstackindia
 
Database experiences designing cassandra schema for keystone
Database experiences designing cassandra schema for keystone Database experiences designing cassandra schema for keystone
Database experiences designing cassandra schema for keystone openstackindia
 
6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_viewopenstackindia
 
8 devstack beyond_hello-world
8 devstack beyond_hello-world8 devstack beyond_hello-world
8 devstack beyond_hello-worldopenstackindia
 
7 distributed storage_open_stack
7 distributed storage_open_stack7 distributed storage_open_stack
7 distributed storage_open_stackopenstackindia
 
2 planning your_open_stack_cloud
2 planning your_open_stack_cloud2 planning your_open_stack_cloud
2 planning your_open_stack_cloudopenstackindia
 

More from openstackindia (14)

Ceph openstack-jun-2015-meetup
Ceph openstack-jun-2015-meetupCeph openstack-jun-2015-meetup
Ceph openstack-jun-2015-meetup
 
Role of sdn controllers in open stack
Role of sdn controllers in open stackRole of sdn controllers in open stack
Role of sdn controllers in open stack
 
Outreachy with-openstack-zaqar
Outreachy with-openstack-zaqarOutreachy with-openstack-zaqar
Outreachy with-openstack-zaqar
 
Enhancing OpenStack FWaaS for real world application
Enhancing OpenStack FWaaS for real world applicationEnhancing OpenStack FWaaS for real world application
Enhancing OpenStack FWaaS for real world application
 
OpenStack Heat
OpenStack HeatOpenStack Heat
OpenStack Heat
 
Why open stack database as a service offerings are doomed
Why open stack database as a service offerings are doomedWhy open stack database as a service offerings are doomed
Why open stack database as a service offerings are doomed
 
OpenStack Neutron Reverse Engineered
OpenStack Neutron Reverse EngineeredOpenStack Neutron Reverse Engineered
OpenStack Neutron Reverse Engineered
 
Database experiences designing cassandra schema for keystone
Database experiences designing cassandra schema for keystone Database experiences designing cassandra schema for keystone
Database experiences designing cassandra schema for keystone
 
6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view
 
8 devstack beyond_hello-world
8 devstack beyond_hello-world8 devstack beyond_hello-world
8 devstack beyond_hello-world
 
7 distributed storage_open_stack
7 distributed storage_open_stack7 distributed storage_open_stack
7 distributed storage_open_stack
 
5 cisco open_stack
5 cisco open_stack5 cisco open_stack
5 cisco open_stack
 
4 hp converged_cloud
4 hp converged_cloud4 hp converged_cloud
4 hp converged_cloud
 
2 planning your_open_stack_cloud
2 planning your_open_stack_cloud2 planning your_open_stack_cloud
2 planning your_open_stack_cloud
 

Recently uploaded

Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

Introduction to Cinder

  • 2. 2 of 24 OpenStack Components Horizon UI Keyston e Identity Service Nova Compute Glance Image Service Neutron Networking Cinder Block Storage Manila Shared File Storage Swift Object Store
  • 3. 3 of 24 Cinder Mission Statement To implement services and libraries to provide on demand, self-service access to Block Storage resources. Provide Software Defined Block Storage via abstraction and automation on top of various traditional backend block storage devices.
  • 4. 4 of 24 What is Cinder? • Created in the OpenStack Folsom release (2012) – Spun off from Nova volume • Cinder manages block storage – Different than shared file storage – that’s Manila – Different than object storage – that’s Swift – Provides management abstraction over a variety of backends – Provides: › Create/delete › Attach/detach › Snapshot › Backup • Volumes have lifecycles independent of VMs
  • 5. 5 of 24 Where Does Cinder Fit? • Cinder provides API’s to interact with vendors’ storage backends • Exposes vendor’s storage hardware to the cloud • Provides persistent storage to VMs, containers, bare metal… • Enables end users to manage their storage without knowing where that storage is coming from
  • 6. 6 of 24 Where Does Cinder Fit? Legend Control Path Data Path Note that iSCSI is just an example – several additional protocols are supported (e.g., FC, NFS) Storage Controller Nova VM /dev/vda KVM iSCSI initiator Cinder iSCSI target VM
  • 7. 7 of 24 Cinder Architecture cinder-api cinder-scheduler cinder-volume driver cinder-backup SQL DB client REST Storage Message Queue
  • 8. 8 of 24 Cinder Services • API – REST interface to Cinder – Generally runs on control node • Scheduler – Takes requests from the API service – Works with the volume service to satisfy requests – Generally runs on control node
  • 9. 9 of 24 Cinder Services • Volume – Interacts with vendor storage backends – Can run on control node – Sometimes offloaded to different host › Especially for LVM backend • Backup – Interface to backup volumes to storage like Swift, TSM, Google Cloud Storage, etc. – Able to scale out to multiple nodes for simultaneous operations
  • 10. 10 of 24 Clients • Cinder Client – python-cinderclient is the command line interface to Cinder › ‘cinder volume create 1 --name Test’ – Also client library for Python code – Uses REST to communicate with the cinder-api service • OpenStack Client – All projects moving to OpenStack Client › ‘openstack volume create --size 1 Test’
  • 11. 11 of 24 Horizon Dashboard
  • 12. 12 of 24 Cinder Drivers ● Block Device Driver (local) ● Blockbridge (iSCSI) ● CloudByte (iSCSI) ● Coho (NFS) ● Datera (iSCSI) ● Dell Equallogic (iSCSI) ● Dell Storage Center (iSCSI/FC) ● Disco (disco) ● DotHill (iSCSI/FC) ● DRBD (DRBD/iSCSI) ● EMC VMAX (iSCSI/FC) ● EMC VNX (iSCSI/FC) ● EMC XtremIO (iSCSI/FC) ● EMC ScaleIO (scaleio) ● Fujitsu ETERNUS (iSCSI/FC) ● GlusterFS (GlusterFS) ● HGST (NFS) ● HPE 3PAR (iSCSI/FC) ● HPE LeftHand (iSCSI) ● HPE MSA (iSCSI/FC) ● HPE XP (FC) ● Hitachi HBSD (iSCSI/FC) ● Hitachi HNAS (iSCSI/NFS) ● Huawei (iSCSI/FC) ● IBM DS8000 (FC) ● IBM Flashsystem (iSCSI/FC) ● IBM GPFS (GPFS) ● IBM Storwize SVC (iSCSI/FC) ● IBM XIV (iSCSI/FC) ● Infortrend (iSCSI/FC) ● Lenovo (iSCSI/FC) ● LVM (iSCSI) – Reference* ● NetApp ONTAP (iSCSI/NFS/FC) ● NetApp E Series (iSCSI/FC) ● Nexenta (iSCSI/NFS) ● NFS – Reference ● Nimble Storage (iSCSI) ● Oracle Zfssa (iSCSI/NFS) ● Pure Storage (iSCSI/FC) ● ProphetStor (iSCSI/FC) ● Quobyte (quobyte) ● RBD (Ceph) - Reference ● Scality SOFS (scality) ● Sheepdog (sheepdog) ● SMBFS (SMB) ● SolidFire (iSCSI) ● Tegile (iSCSI/FC) ● Tintri (NFS) ● Violin (FC) ● VMware (VMDK) ● Virtuozzo Storage (NFS) ● Windows (SMB) ● X-IO (iSCSI/FC) (Drivers in bold are the reference for the architecture)
  • 13. 13 of 24 Minimum Driver Features Drivers must implement support for the core features:  Volume Create/Delete  Volume Attach/Detach  Snapshot Create/Delete  Create Volume from Snapshot  Copy Image to Volume  Copy Volume to Image  Clone Volume  Extend Volume
  • 14. 14 of 24 Volume Types • Used to request properties of volumes during creation • Can also control users’ access to different storage • Only admins can create volume types • Users specify the volume type when they create a volume
  • 15. 15 of 24 Volume Type Extra Specs • Extra specs are used to set type properties • Some standard, some vendor specific – volume_backend_name=lvm1 – sio:provisioning_type:thin – hp3par:persona=3 • Extra specs are only visible to the admin
  • 16. 16 of 24 Volume Type Extra Specs • Extra specs can be modified via UI, CLI, or API # cinder type-create GoldVolume # cinder type-key GoldVolume set storagetype:storageprofile=highpriority # cinder type-create BronzeVolume # cinder type-key BronzeVolume set storagetype:storageprofile=lowpriorty
  • 17. 17 of 24 Retype and Migration • Retype is used to change settings of a volume – Some retypes can happen without moving data – Some require moving the volume to a different backend • Migration is used to move a volume between two different backends – For example – from LVM to Ceph
  • 18. 18 of 24 Fibre Channel Support • Fibre Channel Zone Manager • Dynamically create and delete switch zoning • Drivers to support fabric management: – Brocade – Cisco
  • 19. 19 of 24 Cinder Backup • Backup and restore volumes • Must be either in Available state or able to create and mount snapshot • Several backup drivers supported: – Ceph – Google Cloud Storage – NFS – Posix Filesystem – Swift – Tivoli Storage Manager
  • 20. 20 of 24 Cinder Backup • Backup via CLI, UI, or API • Needs to be enabled in Horizon – /etc/openstack-dashboard/local_settings.py – OPENSTACK_CINDER_FEATURES = {‘enable_backup’: True} • No cron type scheduling in Cinder # cinder backup-create --name MyBackup --description “prepatch” --incremental vol1 # cinder backup-restore a006718b-b583-4d59-9ddb-d1109dc98ebf
  • 21. 21 of 24 Mitaka Updates • Basic support for replication • Backup improvements – Backup of snapshots – Scale out of backup-service nodes – Full and incremental backup • Active/Active HA progress • OS-brick library and client • Rolling upgrades • Work toward multiattach • API microversions
  • 22. 22 of 24 Ongoing/Future Work • Better support for replication • Active/Active High Availability • More backend storage support • Better user error reporting • Improved OpenStack Client support
  • 23. 23 of 24 References OpenStack Documentation • http://docs.openstack.org/ Cinder Developer Wiki • https://wiki.openstack.org/wiki/Cinder Bug and New Feature Tracking • https://launchpad.net/cinder