SlideShare a Scribd company logo
1 of 31
Download to read offline
Cinder
Project overview and update
Jay Bryant (Cinder PTL for Train)
Brian Rosmaita (Cinder PTL for Ussuri)
IRC: jungleboyj , rosmaita
Twitter: @jungleboyj , @br14nr
November 2019
What does Cinder do?
• Provide block storage service
• Implement services and
libraries to provide on demand,
self-service access to Block
Storage resources. Provide
Software Defined Block
Storage via abstraction and
automation on top of various
traditional backend block
storage devices.
Project background
• Founded during the Folsom
release of OpenStack
• 150 contributors in Stein (51
companies)
• 115 contributors in Train (39
companies)
Project background
Latest user survey adoption
numbers:
• Deployed in 98% of production
deployments
(out of 463 deployments)
Are we satisfied with 98%? NO!!!
● cinderlib
○ Reuse Cinder drivers in any Python code
■ No API, Scheduler, or Volume services
■ No Keystone, MySQL, or RabbitMQ
○ Used in:
○ “Cycle-trailing” release (since it depends on Cinder)
■ Stein: v0.9.0
■ Train: v1.0.0 on the way
→ Kubernetes: Ember-CSI
→ oVirt: Managed Block Storage
→ Ansible: Storage Role PoC
Mid-Cycle Meeting
● August 21-23 at Morrisville (North Carolina,
USA) Lenovo Site
● Approximately 5 people in Physical
Attendance
● Approximately 8 people remotely
participated
● Was a productive 3 days
Seriously, we do more than just eat at these meetings ----->
Agenda
● The State of Cinder
● Update on Train release
● Priorities for Ussuri
The State of Cinder
Contributions
● Slow decline of commits during the last few releases
● Why?
○ Transition from new feature development to bug fixing and
User Experience improvements
○ Drivers have stabilized and are more reliable
○ Deprioritization of upstream development by some
companies
● Is this good?
○ Yes ... and No
○ Cinder is a more mature and stable offering
○ The software doesn’t stabilize itself!
Participation in Train
Red Hat
22.9%
Dell EMC 14.2%
SUSE 9.5%
Others
21.5%
Lenovo 5.7%
NEC 7.1%
Huawei 5.1%
Drivers
● 59 supported drivers
○ All have third-party CI running in Python 3.7
○ Has remained stable for the last few releases with
about the same number going out as coming in
● 17 unsupported drivers
○ Some of these are unsupported due to their 3rd-party
CI systems not being able to handle Python 3.7
○ Will hopefully get this solved early in the Ussuri cycle
Bottom Line
● Cinder’s participation remains fairly healthy
● With cinderlib, the project has relevance in the
containerized world
○ This is particularly true for the backend drivers, so
hopefully vendors will beef up their support
Train Release Update
New Drivers
● New drivers in Train
○ Infortrend (restored; had been removed in Queens)
○ LINSTOR
○ RackScale Design NVMe-oF
○ Seagate -- FC and iSCSI
Additionally, many current drivers added enhanced
functionality. See the Train release notes for details.
Removed Drivers
● The following drivers, deprecated in Stein, failed to restore
their 3rd party CI during the Train cycle and were removed:
○ Nexenta Edge
○ Veritas HyperScale
○ Tintri
● The DRBDManage driver was removed; it is replaced by
the new LINSTOR driver
Unsupported Drivers
● Some due to lack of interest in keeping 3rd Party CI
running, and some due to unanticipated problems
converting 3rd Party CI to running under Python 3.7
○ See the “Unsupported Drivers” section of the
“Available Drivers” page in the Cinder documentation
○ https://docs.openstack.org/cinder/latest/drivers.html
Multi-Attach
● Several drivers added multi-attach support
○ HPE 3PAR and MSA
○ NEC
○ NexentaStor5 iSCSI and NFS
○ StorPool
Compression of volumes uploaded as images
● Admin-facing
○ uploaded qcow2 images are compressed using the native
qemu-img compression
○ Less data to upload/store, but requires more CPU
○ “On” by default (image_compress_on_upload option)
Compression of volumes uploaded as images
● User-facing
○ support added for hardware accelerated compression
○ User selects ‘compressed’ container format for the image
○ Has a software fallback if a HW accelerator is not configured
○ “Off” by default (allow_compression_on_image_upload
option)
○ See the Train release notes and “Accelerate image
compression” in the Cinder Administration Guide
No Untyped Volumes
● It’s now impossible to have untyped volumes
● There is a default volume type cleverly named __DEFAULT__
● It is assigned when:
○ A new volume is created without a type, and
○ The default_volume_type option is unset in cinder.conf
Upgrade Checks
● Allow administrators to check their environment to ensure
compatibility with the new Cinder release
● cinder-status upgrade check
● Upgrade-to-Stein checks were included in Cinder 14.0.1 (the
first Stein update release)
● Upgrade-to-Train checks are included in Cinder 15.0.0
There was a forum session about this yesterday -- if you missed it,
see the etherpad:
https://etherpad.openstack.org/p/shanghai-forum-upgrade-checker
Priorities for Ussuri
New features & enhancements
planned for Ussuri
● A reminder that this is just a statement of plan … actual
mileage may vary.
● Priorities will be discussed at the Ussuri PTG later this week.
○ https://etherpad.openstack.org/p/shanghai-ptg-cinder
● What follows is a short list of topics off the top of my head
Theme: Stability
● Want to increase automated test coverage to handle
scenarios not currently covered by unit, functional, or tempest
tests
○ Use the cinder-tempest-plugin to use the tempest
framework to do more thorough testing
○ Should be an easy integration for third party CI systems
to run these more thorough tests as well
OSSN-0085
● Applies to Ceph backend, but only when the rbd_keyring_conf
option is set
○ Option is unset by default
○ Vulnerability is: Ceph credentials can be leaked
○ Mitigation is: do not use the option
○ Option is deprecated in Ussuri for removal in “V”
○ Migration path: none
■ Contact me if you have a use case for this functionality
● https://wiki.openstack.org/wiki/OSSN/OSSN-0085
Driver Capabilities Reporting
● Not currently easy to see capabilities reported by drivers
enabled in an environment
● Working to make the information more readily available and
usable
More default volume types
● Having a single volume type default is too restrictive for
bigger clouds with multiple AZs and many tenants/projects
● There are use cases for per-project default volume types
○ There are some inelegant workarounds, we’d like to
enable a better user experience
Removal of V2 API
● V3 is a supserset of V2. Would like to remove duplicate V2
code
● Working with API consumers to determine possible impacts
● Did not happen in Train -- maybe in Ussuri?
Reference Links
● Release notes
○ https://docs.openstack.org/releasenotes/cinder/train.html
● Launchpad
○ https://launchpad.net/cinder
● Cinder wiki
○ https://wiki.openstack.org/wiki/Cinder
● Cinder YouTube
○ https://www.youtube.com/channel/UCJ8Koy4gsISMy0qW3CWZmaQ
Moar contributors!
● Everyone in this room can be a contributor
● “10 ways to contribute to an open source project without
writing code”
○ A 2013 article by Heiko W. Rupp, but still very relevant
○ http://tiny.cc/10-ways
@OpenSta
ck
THANKS.
Questions?
openstack openstack OpenStackFoundation

More Related Content

What's hot

Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...
Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...
Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...Anne Nicolas
 
Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...
Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...
Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...Anne Nicolas
 
Deep Dive into Openstack Storage, Sean Cohen, Red Hat
Deep Dive into Openstack Storage, Sean Cohen, Red HatDeep Dive into Openstack Storage, Sean Cohen, Red Hat
Deep Dive into Openstack Storage, Sean Cohen, Red HatCloud Native Day Tel Aviv
 
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...OpenNebula Project
 
Kernel Recipes 2016 - Control Group Status Update
Kernel Recipes 2016 -  Control Group Status UpdateKernel Recipes 2016 -  Control Group Status Update
Kernel Recipes 2016 - Control Group Status UpdateAnne Nicolas
 
Qt5 (minimal) on beaglebone, with Yocto
Qt5 (minimal) on beaglebone, with YoctoQt5 (minimal) on beaglebone, with Yocto
Qt5 (minimal) on beaglebone, with YoctoPrabindh Sundareson
 
Storage best practices
Storage best practicesStorage best practices
Storage best practicesMaor Lipchuk
 
Yocto usage for Graphics SDK on AM335x
Yocto usage for Graphics SDK on AM335xYocto usage for Graphics SDK on AM335x
Yocto usage for Graphics SDK on AM335xPrabindh Sundareson
 
Data Reduction for Gluster with VDO
Data Reduction for Gluster with VDOData Reduction for Gluster with VDO
Data Reduction for Gluster with VDOGluster.org
 
BKK16-407 AOSP Toolchain Evolution and experimental languages on AOSP
BKK16-407 AOSP Toolchain Evolution and experimental languages on AOSPBKK16-407 AOSP Toolchain Evolution and experimental languages on AOSP
BKK16-407 AOSP Toolchain Evolution and experimental languages on AOSPLinaro
 
Virtualization Management The oVirt Way (August Penguin 2015)
Virtualization Management The oVirt Way (August Penguin 2015)Virtualization Management The oVirt Way (August Penguin 2015)
Virtualization Management The oVirt Way (August Penguin 2015)Allon Mureinik
 
Kvm forum 2013 - future integration points for oVirt storage
Kvm forum 2013 - future integration points for oVirt storageKvm forum 2013 - future integration points for oVirt storage
Kvm forum 2013 - future integration points for oVirt storageSean Cohen
 
Cinder Live Migration and Replication - OpenStack Summit Austin
Cinder Live Migration and Replication - OpenStack Summit AustinCinder Live Migration and Replication - OpenStack Summit Austin
Cinder Live Migration and Replication - OpenStack Summit AustinEd Balduf
 
Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)Wan Leung Wong
 
LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...
LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...
LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...Linaro
 
XPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius Systems
XPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius SystemsXPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius Systems
XPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius SystemsThe Linux Foundation
 

What's hot (20)

Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...
Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...
Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...
 
Make Accelerator Pluggable for Container Engine
Make Accelerator Pluggable for Container EngineMake Accelerator Pluggable for Container Engine
Make Accelerator Pluggable for Container Engine
 
Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...
Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...
Kernel Recipes 2018 - Live (Kernel) Patching: status quo and status futurus -...
 
Deep Dive into Openstack Storage, Sean Cohen, Red Hat
Deep Dive into Openstack Storage, Sean Cohen, Red HatDeep Dive into Openstack Storage, Sean Cohen, Red Hat
Deep Dive into Openstack Storage, Sean Cohen, Red Hat
 
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...
 
Kernel Recipes 2016 - Control Group Status Update
Kernel Recipes 2016 -  Control Group Status UpdateKernel Recipes 2016 -  Control Group Status Update
Kernel Recipes 2016 - Control Group Status Update
 
Qt5 (minimal) on beaglebone, with Yocto
Qt5 (minimal) on beaglebone, with YoctoQt5 (minimal) on beaglebone, with Yocto
Qt5 (minimal) on beaglebone, with Yocto
 
Qt5 beta1 on ti platforms
Qt5 beta1 on ti platformsQt5 beta1 on ti platforms
Qt5 beta1 on ti platforms
 
IITCC15: Xen Project 4.6 Update
IITCC15: Xen Project 4.6 UpdateIITCC15: Xen Project 4.6 Update
IITCC15: Xen Project 4.6 Update
 
Storage best practices
Storage best practicesStorage best practices
Storage best practices
 
Yocto usage for Graphics SDK on AM335x
Yocto usage for Graphics SDK on AM335xYocto usage for Graphics SDK on AM335x
Yocto usage for Graphics SDK on AM335x
 
Linux based Stubdomains
Linux based StubdomainsLinux based Stubdomains
Linux based Stubdomains
 
Data Reduction for Gluster with VDO
Data Reduction for Gluster with VDOData Reduction for Gluster with VDO
Data Reduction for Gluster with VDO
 
BKK16-407 AOSP Toolchain Evolution and experimental languages on AOSP
BKK16-407 AOSP Toolchain Evolution and experimental languages on AOSPBKK16-407 AOSP Toolchain Evolution and experimental languages on AOSP
BKK16-407 AOSP Toolchain Evolution and experimental languages on AOSP
 
Virtualization Management The oVirt Way (August Penguin 2015)
Virtualization Management The oVirt Way (August Penguin 2015)Virtualization Management The oVirt Way (August Penguin 2015)
Virtualization Management The oVirt Way (August Penguin 2015)
 
Kvm forum 2013 - future integration points for oVirt storage
Kvm forum 2013 - future integration points for oVirt storageKvm forum 2013 - future integration points for oVirt storage
Kvm forum 2013 - future integration points for oVirt storage
 
Cinder Live Migration and Replication - OpenStack Summit Austin
Cinder Live Migration and Replication - OpenStack Summit AustinCinder Live Migration and Replication - OpenStack Summit Austin
Cinder Live Migration and Replication - OpenStack Summit Austin
 
Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)Virtualization - Kernel Virtual Machine (KVM)
Virtualization - Kernel Virtual Machine (KVM)
 
LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...
LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...
LAS16-301: OpenStack on Aarch64, running in production, upstream improvements...
 
XPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius Systems
XPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius SystemsXPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius Systems
XPDS14 - OSv - A Modern Semi-POSIX LibraryOS - Glauber Costa, Cloudius Systems
 

Similar to OpenStack Cinder Project Update - Shanghai 2019

Cinder Project On-Boarding - OpenInfra Summit Denver 2019
Cinder Project On-Boarding - OpenInfra Summit Denver 2019Cinder Project On-Boarding - OpenInfra Summit Denver 2019
Cinder Project On-Boarding - OpenInfra Summit Denver 2019Jay Bryant
 
Cinder project update at OpenStack Boston Summit May 2017
Cinder project update at OpenStack Boston Summit May 2017Cinder project update at OpenStack Boston Summit May 2017
Cinder project update at OpenStack Boston Summit May 2017Miroslav Halas
 
OpenStack Cinder On-Boarding Education - Boston Summit - 2017
OpenStack Cinder On-Boarding Education - Boston Summit - 2017OpenStack Cinder On-Boarding Education - Boston Summit - 2017
OpenStack Cinder On-Boarding Education - Boston Summit - 2017Jay Bryant
 
The road to enterprise ready open stack storage as service
The road to enterprise ready open stack storage as serviceThe road to enterprise ready open stack storage as service
The road to enterprise ready open stack storage as serviceSean Cohen
 
Cinder On-boarding Room - Berlin (11-13-2018)
Cinder On-boarding Room - Berlin (11-13-2018)Cinder On-boarding Room - Berlin (11-13-2018)
Cinder On-boarding Room - Berlin (11-13-2018)Jay Bryant
 
LMG Lightning Talks - SFO17-205
LMG Lightning Talks - SFO17-205LMG Lightning Talks - SFO17-205
LMG Lightning Talks - SFO17-205Linaro
 
Strategies for developing and deploying your embedded applications and images
Strategies for developing and deploying your embedded applications and imagesStrategies for developing and deploying your embedded applications and images
Strategies for developing and deploying your embedded applications and imagesMender.io
 
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018OpenStack Cinder On-Boarding Room - Vancouver Summit 2018
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018Jay Bryant
 
Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26
Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26
Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26Brian Rosmaita
 
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...DoKC
 
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatDeep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatSean Cohen
 
Taking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and DecideTaking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and DecideBret Fisher
 
Taking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and DecideTaking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and DecideDocker, Inc.
 
Lessons Learned: Using Concourse In Production
Lessons Learned: Using Concourse In ProductionLessons Learned: Using Concourse In Production
Lessons Learned: Using Concourse In ProductionShingo Omura
 
Thinking inside the box (shared)
Thinking inside the box (shared)Thinking inside the box (shared)
Thinking inside the box (shared)Joe Brockmeier
 
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019VMware Tanzu
 
LAS16-209: Finished and Upcoming Projects in LMG
LAS16-209: Finished and Upcoming Projects in LMGLAS16-209: Finished and Upcoming Projects in LMG
LAS16-209: Finished and Upcoming Projects in LMGLinaro
 
NetflixOSS meetup lightning talks and roadmap
NetflixOSS meetup lightning talks and roadmapNetflixOSS meetup lightning talks and roadmap
NetflixOSS meetup lightning talks and roadmapRuslan Meshenberg
 

Similar to OpenStack Cinder Project Update - Shanghai 2019 (20)

Cinder Project On-Boarding - OpenInfra Summit Denver 2019
Cinder Project On-Boarding - OpenInfra Summit Denver 2019Cinder Project On-Boarding - OpenInfra Summit Denver 2019
Cinder Project On-Boarding - OpenInfra Summit Denver 2019
 
Cinder project update at OpenStack Boston Summit May 2017
Cinder project update at OpenStack Boston Summit May 2017Cinder project update at OpenStack Boston Summit May 2017
Cinder project update at OpenStack Boston Summit May 2017
 
OpenStack Cinder On-Boarding Education - Boston Summit - 2017
OpenStack Cinder On-Boarding Education - Boston Summit - 2017OpenStack Cinder On-Boarding Education - Boston Summit - 2017
OpenStack Cinder On-Boarding Education - Boston Summit - 2017
 
The road to enterprise ready open stack storage as service
The road to enterprise ready open stack storage as serviceThe road to enterprise ready open stack storage as service
The road to enterprise ready open stack storage as service
 
Cinder On-boarding Room - Berlin (11-13-2018)
Cinder On-boarding Room - Berlin (11-13-2018)Cinder On-boarding Room - Berlin (11-13-2018)
Cinder On-boarding Room - Berlin (11-13-2018)
 
LMG Lightning Talks - SFO17-205
LMG Lightning Talks - SFO17-205LMG Lightning Talks - SFO17-205
LMG Lightning Talks - SFO17-205
 
Strategies for developing and deploying your embedded applications and images
Strategies for developing and deploying your embedded applications and imagesStrategies for developing and deploying your embedded applications and images
Strategies for developing and deploying your embedded applications and images
 
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018OpenStack Cinder On-Boarding Room - Vancouver Summit 2018
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018
 
Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26
Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26
Cinder Update, OpenInfra Meetup Q3 China, 2020-09-26
 
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
 
Deep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red HatDeep dive into OpenStack storage, Sean Cohen, Red Hat
Deep dive into OpenStack storage, Sean Cohen, Red Hat
 
Tdc2014 tizen common_20140603
Tdc2014 tizen common_20140603Tdc2014 tizen common_20140603
Tdc2014 tizen common_20140603
 
Taking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and DecideTaking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and Decide
 
Taking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and DecideTaking Docker to Production: What You Need to Know and Decide
Taking Docker to Production: What You Need to Know and Decide
 
Lessons Learned: Using Concourse In Production
Lessons Learned: Using Concourse In ProductionLessons Learned: Using Concourse In Production
Lessons Learned: Using Concourse In Production
 
Cinder Updates - Liberty Edition
Cinder Updates - Liberty Edition Cinder Updates - Liberty Edition
Cinder Updates - Liberty Edition
 
Thinking inside the box (shared)
Thinking inside the box (shared)Thinking inside the box (shared)
Thinking inside the box (shared)
 
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
Pivotal Greenplum Cloud Marketplaces - Greenplum Summit 2019
 
LAS16-209: Finished and Upcoming Projects in LMG
LAS16-209: Finished and Upcoming Projects in LMGLAS16-209: Finished and Upcoming Projects in LMG
LAS16-209: Finished and Upcoming Projects in LMG
 
NetflixOSS meetup lightning talks and roadmap
NetflixOSS meetup lightning talks and roadmapNetflixOSS meetup lightning talks and roadmap
NetflixOSS meetup lightning talks and roadmap
 

More from Brian Rosmaita

Ecosystem Projects for Data Management Challenges: Cinder
Ecosystem Projects for Data Management Challenges: CinderEcosystem Projects for Data Management Challenges: Cinder
Ecosystem Projects for Data Management Challenges: CinderBrian Rosmaita
 
OpenShift Commons Briefing: Ask Me Anything about Cinder and Glance
OpenShift Commons Briefing: Ask Me Anything about Cinder and GlanceOpenShift Commons Briefing: Ask Me Anything about Cinder and Glance
OpenShift Commons Briefing: Ask Me Anything about Cinder and GlanceBrian Rosmaita
 
You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...
You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...
You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...Brian Rosmaita
 
OpenStack Glance Project Update
OpenStack Glance Project UpdateOpenStack Glance Project Update
OpenStack Glance Project UpdateBrian Rosmaita
 
The Evolution of Glance API: On the Way From v1 to v3
The Evolution of Glance API: On the Way From v1 to v3The Evolution of Glance API: On the Way From v1 to v3
The Evolution of Glance API: On the Way From v1 to v3Brian Rosmaita
 
Making Glance tasks work for you - OpenStack Summit May 2015 Vancouver
Making Glance tasks work for you - OpenStack Summit May 2015 VancouverMaking Glance tasks work for you - OpenStack Summit May 2015 Vancouver
Making Glance tasks work for you - OpenStack Summit May 2015 VancouverBrian Rosmaita
 

More from Brian Rosmaita (6)

Ecosystem Projects for Data Management Challenges: Cinder
Ecosystem Projects for Data Management Challenges: CinderEcosystem Projects for Data Management Challenges: Cinder
Ecosystem Projects for Data Management Challenges: Cinder
 
OpenShift Commons Briefing: Ask Me Anything about Cinder and Glance
OpenShift Commons Briefing: Ask Me Anything about Cinder and GlanceOpenShift Commons Briefing: Ask Me Anything about Cinder and Glance
OpenShift Commons Briefing: Ask Me Anything about Cinder and Glance
 
You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...
You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...
You can't make a (Denver) omelette without breaking eggs: Using OpenStack pol...
 
OpenStack Glance Project Update
OpenStack Glance Project UpdateOpenStack Glance Project Update
OpenStack Glance Project Update
 
The Evolution of Glance API: On the Way From v1 to v3
The Evolution of Glance API: On the Way From v1 to v3The Evolution of Glance API: On the Way From v1 to v3
The Evolution of Glance API: On the Way From v1 to v3
 
Making Glance tasks work for you - OpenStack Summit May 2015 Vancouver
Making Glance tasks work for you - OpenStack Summit May 2015 VancouverMaking Glance tasks work for you - OpenStack Summit May 2015 Vancouver
Making Glance tasks work for you - OpenStack Summit May 2015 Vancouver
 

Recently uploaded

Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...OnePlan Solutions
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsArshad QA
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendArshad QA
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providermohitmore19
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVshikhaohhpro
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️anilsa9823
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdfWave PLM
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 

Recently uploaded (20)

Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and Backend
 
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Exploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the ProcessExploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the Process
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 

OpenStack Cinder Project Update - Shanghai 2019

  • 1. Cinder Project overview and update Jay Bryant (Cinder PTL for Train) Brian Rosmaita (Cinder PTL for Ussuri) IRC: jungleboyj , rosmaita Twitter: @jungleboyj , @br14nr November 2019
  • 2. What does Cinder do? • Provide block storage service • Implement services and libraries to provide on demand, self-service access to Block Storage resources. Provide Software Defined Block Storage via abstraction and automation on top of various traditional backend block storage devices.
  • 3. Project background • Founded during the Folsom release of OpenStack • 150 contributors in Stein (51 companies) • 115 contributors in Train (39 companies)
  • 4. Project background Latest user survey adoption numbers: • Deployed in 98% of production deployments (out of 463 deployments)
  • 5. Are we satisfied with 98%? NO!!! ● cinderlib ○ Reuse Cinder drivers in any Python code ■ No API, Scheduler, or Volume services ■ No Keystone, MySQL, or RabbitMQ ○ Used in: ○ “Cycle-trailing” release (since it depends on Cinder) ■ Stein: v0.9.0 ■ Train: v1.0.0 on the way → Kubernetes: Ember-CSI → oVirt: Managed Block Storage → Ansible: Storage Role PoC
  • 6. Mid-Cycle Meeting ● August 21-23 at Morrisville (North Carolina, USA) Lenovo Site ● Approximately 5 people in Physical Attendance ● Approximately 8 people remotely participated ● Was a productive 3 days Seriously, we do more than just eat at these meetings ----->
  • 7. Agenda ● The State of Cinder ● Update on Train release ● Priorities for Ussuri
  • 8. The State of Cinder
  • 9. Contributions ● Slow decline of commits during the last few releases ● Why? ○ Transition from new feature development to bug fixing and User Experience improvements ○ Drivers have stabilized and are more reliable ○ Deprioritization of upstream development by some companies ● Is this good? ○ Yes ... and No ○ Cinder is a more mature and stable offering ○ The software doesn’t stabilize itself!
  • 10. Participation in Train Red Hat 22.9% Dell EMC 14.2% SUSE 9.5% Others 21.5% Lenovo 5.7% NEC 7.1% Huawei 5.1%
  • 11. Drivers ● 59 supported drivers ○ All have third-party CI running in Python 3.7 ○ Has remained stable for the last few releases with about the same number going out as coming in ● 17 unsupported drivers ○ Some of these are unsupported due to their 3rd-party CI systems not being able to handle Python 3.7 ○ Will hopefully get this solved early in the Ussuri cycle
  • 12. Bottom Line ● Cinder’s participation remains fairly healthy ● With cinderlib, the project has relevance in the containerized world ○ This is particularly true for the backend drivers, so hopefully vendors will beef up their support
  • 14. New Drivers ● New drivers in Train ○ Infortrend (restored; had been removed in Queens) ○ LINSTOR ○ RackScale Design NVMe-oF ○ Seagate -- FC and iSCSI Additionally, many current drivers added enhanced functionality. See the Train release notes for details.
  • 15. Removed Drivers ● The following drivers, deprecated in Stein, failed to restore their 3rd party CI during the Train cycle and were removed: ○ Nexenta Edge ○ Veritas HyperScale ○ Tintri ● The DRBDManage driver was removed; it is replaced by the new LINSTOR driver
  • 16. Unsupported Drivers ● Some due to lack of interest in keeping 3rd Party CI running, and some due to unanticipated problems converting 3rd Party CI to running under Python 3.7 ○ See the “Unsupported Drivers” section of the “Available Drivers” page in the Cinder documentation ○ https://docs.openstack.org/cinder/latest/drivers.html
  • 17. Multi-Attach ● Several drivers added multi-attach support ○ HPE 3PAR and MSA ○ NEC ○ NexentaStor5 iSCSI and NFS ○ StorPool
  • 18. Compression of volumes uploaded as images ● Admin-facing ○ uploaded qcow2 images are compressed using the native qemu-img compression ○ Less data to upload/store, but requires more CPU ○ “On” by default (image_compress_on_upload option)
  • 19. Compression of volumes uploaded as images ● User-facing ○ support added for hardware accelerated compression ○ User selects ‘compressed’ container format for the image ○ Has a software fallback if a HW accelerator is not configured ○ “Off” by default (allow_compression_on_image_upload option) ○ See the Train release notes and “Accelerate image compression” in the Cinder Administration Guide
  • 20. No Untyped Volumes ● It’s now impossible to have untyped volumes ● There is a default volume type cleverly named __DEFAULT__ ● It is assigned when: ○ A new volume is created without a type, and ○ The default_volume_type option is unset in cinder.conf
  • 21. Upgrade Checks ● Allow administrators to check their environment to ensure compatibility with the new Cinder release ● cinder-status upgrade check ● Upgrade-to-Stein checks were included in Cinder 14.0.1 (the first Stein update release) ● Upgrade-to-Train checks are included in Cinder 15.0.0 There was a forum session about this yesterday -- if you missed it, see the etherpad: https://etherpad.openstack.org/p/shanghai-forum-upgrade-checker
  • 23. New features & enhancements planned for Ussuri ● A reminder that this is just a statement of plan … actual mileage may vary. ● Priorities will be discussed at the Ussuri PTG later this week. ○ https://etherpad.openstack.org/p/shanghai-ptg-cinder ● What follows is a short list of topics off the top of my head
  • 24. Theme: Stability ● Want to increase automated test coverage to handle scenarios not currently covered by unit, functional, or tempest tests ○ Use the cinder-tempest-plugin to use the tempest framework to do more thorough testing ○ Should be an easy integration for third party CI systems to run these more thorough tests as well
  • 25. OSSN-0085 ● Applies to Ceph backend, but only when the rbd_keyring_conf option is set ○ Option is unset by default ○ Vulnerability is: Ceph credentials can be leaked ○ Mitigation is: do not use the option ○ Option is deprecated in Ussuri for removal in “V” ○ Migration path: none ■ Contact me if you have a use case for this functionality ● https://wiki.openstack.org/wiki/OSSN/OSSN-0085
  • 26. Driver Capabilities Reporting ● Not currently easy to see capabilities reported by drivers enabled in an environment ● Working to make the information more readily available and usable
  • 27. More default volume types ● Having a single volume type default is too restrictive for bigger clouds with multiple AZs and many tenants/projects ● There are use cases for per-project default volume types ○ There are some inelegant workarounds, we’d like to enable a better user experience
  • 28. Removal of V2 API ● V3 is a supserset of V2. Would like to remove duplicate V2 code ● Working with API consumers to determine possible impacts ● Did not happen in Train -- maybe in Ussuri?
  • 29. Reference Links ● Release notes ○ https://docs.openstack.org/releasenotes/cinder/train.html ● Launchpad ○ https://launchpad.net/cinder ● Cinder wiki ○ https://wiki.openstack.org/wiki/Cinder ● Cinder YouTube ○ https://www.youtube.com/channel/UCJ8Koy4gsISMy0qW3CWZmaQ
  • 30. Moar contributors! ● Everyone in this room can be a contributor ● “10 ways to contribute to an open source project without writing code” ○ A 2013 article by Heiko W. Rupp, but still very relevant ○ http://tiny.cc/10-ways