OpenStack Manila
Project overview and update
Tom Barron <tpb@dyncloud.net>
irc: tbarron
04.29.2019
Goutham Pacha Ravi <gouthampravi@gmail.com>
irc: gouthamr
Open Infrastructure Summit 2019, Denver, CO
Agenda
What’s Manila
Problem Space, Problem Background
Stein Release Update
API changes, Features, Driver improvements
Train and Beyond
Priorities, Themes
Manila is the control plane to provision and
manage shared file systems across storage
systems.
One popular oversimplification: Manila is Cinder
for file shares.
Fork of OpenStack Cinder, built by a shared pool
of developers, shares much of Cinder’s
architecture.
But it solves a new class of problems that Cinder
does not naturally address.
Think: manila file folders
What is Manila
● Consistent, simple REST API
● Open Source drivers & drivers for proprietary vendor back ends (over 35 now)
● Multiple NAS protocols
● Stein release had over 49 unique reviewers and 56 unique contributors representing
25 companies
● 9th
production quality release
● Growing interest + adoption (2018 user survey)
● Increasing development activity and use outside manila proper in TripleO, Kolla,
Charms, Gophercloud, CSI, Terraform etc. to use, integrate and deploy manila both
inside and outside of OpenStack
What is Manila
19th release of OpenStack
9th
official release of Manila
X-Openstack-Manila-API-Version
2.47
Bring share servers, shares,
snapshots into manila for
DHSS=True drivers
2.492.48
Share replication
export location
APIs
User visible
“availability_zones”
extra-spec
Stein API changes
● Release Notes: https://docs.openstack.org/releasenotes/manila/stein.html
● Python3 support - Integration tests have been run with python 3.5 and 3.6, 3.7 is smoke tested
● Python3 is in the default testing environments
● Default testing switched to Ubuntu Bionic Beaver, CentOS 7 experimental
● Upgrade checker
New in Stein
● Edge computing needs:
○ Export location improvements: AZ based separation, replication API enhancements
○ Share types can be assigned to storage availability zones
New in Stein
○ Separation of service and storage availability zones is now possible
New in Stein
stack@ostk-stein:~$ manila service-list
+----+------------------+-----------------------+-----------------------+---------+-------+----------------------------+
| Id | Binary | Host | Zone | Status | State | Updated_at |
+----+------------------+-----------------------+-----------------------+---------+-------+----------------------------+
| 1 | manila-share | ostk-stein@cephfsnfs1 | ostk-controller-zone0 | enabled | up | 2019-04-25T21:14:05.000000 |
| 2 | manila-scheduler | ostk-stein | ostk-controller-zone0 | enabled | up | 2019-04-25T21:14:06.000000 |
| 3 | manila-data | ostk-stein | ostk-controller-zone0 | enabled | up | 2019-04-25T21:14:11.000000 |
| 4 | manila-share | ostk-stein@beta | dc-east-01 | enabled | up | 2019-04-25T21:14:14.000000 |
| 5 | manila-share | ostk-stein@alpha | dc-east-01 | enabled | up | 2019-04-25T21:14:06.000000 |
| 6 | manila-share | ostk-stein@gamma | dc-west-01 | enabled | up | 2019-04-25T21:14:05.000000 |
| 7 | manila-share | ostk-stein@delta | dc-west-01 | enabled | up | 2019-04-25T21:14:05.000000 |
+----+------------------+-----------------------+-----------------------+---------+-------+----------------------------+
stack@ostk-stein:~$ manila availability-zone-list
+--------------------------------------+-----------------------+----------------------------+------------+
| Id | Name | Created_At | Updated_At |
+--------------------------------------+-----------------------+----------------------------+------------+
| 1d4a3016-b6a5-48d1-934a-4e7bdac964f8 | ostk-controller-zone0 | 2019-04-25T21:14:06.000000 | None |
| 46791b97-4fec-4056-8c29-6809a5557560 | dc-east-01 | 2019-04-25T21:12:04.000000 | None |
| 8a0081c9-fa4c-442f-9fba-cc92263ceff5 | dc-west-01 | 2019-04-25T21:12:05.000000 | None |
+--------------------------------------+-----------------------+----------------------------+------------+
Configured with
storage_availability_zone
Configured with
backend_availability_zone
○ You may now bring in share servers, shares and snapshots into manila when using drivers
that handle provisioning and management of share servers
New in Stein
usage: manila share-server-manage
[--driver_options [<key=value> [<key=value> ...]]]
<host> <share_network> <identifier>
Manage share server not handled by Manila (Admin only).
Positional arguments:
<host> Backend name as "<node_hostname>@<backend_name>".
<share_network> Share network where share server has network
allocations in.
<identifier> A driver-specific share server identifier required by
the driver to manage the share server.
Optional arguments:
--driver_options [<key=value> [<key=value> ...]], --driver-options [<key=value> [<key=value> ...]]
One or more driver-specific key=value pairs that may
be necessary to manage the share server (Optional,
Default=None).
○ Storage pools API performance improvements
New in Stein
● Revert to snapshot support and shrink support in Dell EMC/Unity driver
● QNAP driver supports more storage models
● Ability to configure HA for security services for DHSS=True drivers
● Improvements to the generic driver
○ performance
○ reliability
● A much better container driver - still not recommended for production use
Driver enhancements in Stein
● Public share creation can be controlled by policy
● Making things easier for contributors
○ Simpler review process
■ https://docs.openstack.org/manila/latest/contributor/manila-review-policy.html
● Manifests to deploy first party drivers
○ https://docs.openstack.org/manila/latest/contributor/development-environment-devstack.html#
sample-local-conf-files-that-get-you-started
● Categorizing “low-hanging-fruit”
○ https://bugs.launchpad.net/manila/+bugs?field.tag=low-hanging-fruit
○ https://bugs.launchpad.net/python-manilaclient/+bugs?field.tag=low-hanging-fruit
○ https://bugs.launchpad.net/manila-ui/+bugs?field.tag=low-hanging-fruit
Other enhancements in Stein
Train release
20th release of OpenStack
10th
official release of Manila
SCALABILITY RESILIENCY MANAGEABILITY MODULARITY
INTEROPERABILITY SECURITY USER EXPERIENCE
MAJOR
FOCUS
NO
INFO
NO
INFO
NO
INFO
Train release themes for Manila
MAJOR
FOCUS
MAJOR
FOCUS
MINOR
FOCUS
MINOR
FOCUS
SCALABILITY RESILIENCY MANAGEABILITY MODULARITY
INTEROPERABILITY SECURITY USER EXPERIENCE
MAJOR
FOCUS
MINOR
FOCUS
NO
INFO
NO
INFO
NO
INFO
NO
INFO
U release themes for Manila
MAJOR
FOCUS
MINOR
FOCUS
MINOR
FOCUS
Train themes
Manila at scale and in edge deployments
active-active share service
when to use DLM, when to use DB for exclusion
Manila for Container Orchestrators
Wednesday 5:10-5:50pm Room 501/502
no-auth standalone deployments
Production Quality Open Source back ends
Create new share form CephFS snapshots
per-tenant share servers and better network isolation
● Tag [manila] on the OpenStack discuss mail list
● Find us in #openstack-manila on freenode
● Feel free to reach out to our PTL, contributors directly
○ https://review.opendev.org/#/admin/groups/213,members
How to give feedback
Manila project onboarding session:
Monday, April 29, 12:00pm-12:40pm, The Colorado Convention Center - 406
Developer Docs:
https://docs.openstack.org/manila/latest/contributor/index.html
How to contribute
We need your help!
• [Question #1]
• [Question #2]
• [Question #3]
• [Developer request #1]
• [Developer request #2]
• [Developer request #3]
@OpenStack
THANKS.
Questions?
openstack openstack OpenStackFoundation

Manila Project Update - Denver Open Infrastructure Summit - May 2019

  • 1.
    OpenStack Manila Project overviewand update Tom Barron <tpb@dyncloud.net> irc: tbarron 04.29.2019 Goutham Pacha Ravi <gouthampravi@gmail.com> irc: gouthamr Open Infrastructure Summit 2019, Denver, CO
  • 2.
    Agenda What’s Manila Problem Space,Problem Background Stein Release Update API changes, Features, Driver improvements Train and Beyond Priorities, Themes
  • 3.
    Manila is thecontrol plane to provision and manage shared file systems across storage systems. One popular oversimplification: Manila is Cinder for file shares. Fork of OpenStack Cinder, built by a shared pool of developers, shares much of Cinder’s architecture. But it solves a new class of problems that Cinder does not naturally address. Think: manila file folders What is Manila
  • 4.
    ● Consistent, simpleREST API ● Open Source drivers & drivers for proprietary vendor back ends (over 35 now) ● Multiple NAS protocols ● Stein release had over 49 unique reviewers and 56 unique contributors representing 25 companies ● 9th production quality release ● Growing interest + adoption (2018 user survey) ● Increasing development activity and use outside manila proper in TripleO, Kolla, Charms, Gophercloud, CSI, Terraform etc. to use, integrate and deploy manila both inside and outside of OpenStack What is Manila
  • 5.
    19th release ofOpenStack 9th official release of Manila
  • 6.
    X-Openstack-Manila-API-Version 2.47 Bring share servers,shares, snapshots into manila for DHSS=True drivers 2.492.48 Share replication export location APIs User visible “availability_zones” extra-spec Stein API changes
  • 7.
    ● Release Notes:https://docs.openstack.org/releasenotes/manila/stein.html ● Python3 support - Integration tests have been run with python 3.5 and 3.6, 3.7 is smoke tested ● Python3 is in the default testing environments ● Default testing switched to Ubuntu Bionic Beaver, CentOS 7 experimental ● Upgrade checker New in Stein
  • 8.
    ● Edge computingneeds: ○ Export location improvements: AZ based separation, replication API enhancements ○ Share types can be assigned to storage availability zones New in Stein
  • 9.
    ○ Separation ofservice and storage availability zones is now possible New in Stein stack@ostk-stein:~$ manila service-list +----+------------------+-----------------------+-----------------------+---------+-------+----------------------------+ | Id | Binary | Host | Zone | Status | State | Updated_at | +----+------------------+-----------------------+-----------------------+---------+-------+----------------------------+ | 1 | manila-share | ostk-stein@cephfsnfs1 | ostk-controller-zone0 | enabled | up | 2019-04-25T21:14:05.000000 | | 2 | manila-scheduler | ostk-stein | ostk-controller-zone0 | enabled | up | 2019-04-25T21:14:06.000000 | | 3 | manila-data | ostk-stein | ostk-controller-zone0 | enabled | up | 2019-04-25T21:14:11.000000 | | 4 | manila-share | ostk-stein@beta | dc-east-01 | enabled | up | 2019-04-25T21:14:14.000000 | | 5 | manila-share | ostk-stein@alpha | dc-east-01 | enabled | up | 2019-04-25T21:14:06.000000 | | 6 | manila-share | ostk-stein@gamma | dc-west-01 | enabled | up | 2019-04-25T21:14:05.000000 | | 7 | manila-share | ostk-stein@delta | dc-west-01 | enabled | up | 2019-04-25T21:14:05.000000 | +----+------------------+-----------------------+-----------------------+---------+-------+----------------------------+ stack@ostk-stein:~$ manila availability-zone-list +--------------------------------------+-----------------------+----------------------------+------------+ | Id | Name | Created_At | Updated_At | +--------------------------------------+-----------------------+----------------------------+------------+ | 1d4a3016-b6a5-48d1-934a-4e7bdac964f8 | ostk-controller-zone0 | 2019-04-25T21:14:06.000000 | None | | 46791b97-4fec-4056-8c29-6809a5557560 | dc-east-01 | 2019-04-25T21:12:04.000000 | None | | 8a0081c9-fa4c-442f-9fba-cc92263ceff5 | dc-west-01 | 2019-04-25T21:12:05.000000 | None | +--------------------------------------+-----------------------+----------------------------+------------+ Configured with storage_availability_zone Configured with backend_availability_zone
  • 10.
    ○ You maynow bring in share servers, shares and snapshots into manila when using drivers that handle provisioning and management of share servers New in Stein usage: manila share-server-manage [--driver_options [<key=value> [<key=value> ...]]] <host> <share_network> <identifier> Manage share server not handled by Manila (Admin only). Positional arguments: <host> Backend name as "<node_hostname>@<backend_name>". <share_network> Share network where share server has network allocations in. <identifier> A driver-specific share server identifier required by the driver to manage the share server. Optional arguments: --driver_options [<key=value> [<key=value> ...]], --driver-options [<key=value> [<key=value> ...]] One or more driver-specific key=value pairs that may be necessary to manage the share server (Optional, Default=None).
  • 11.
    ○ Storage poolsAPI performance improvements New in Stein
  • 12.
    ● Revert tosnapshot support and shrink support in Dell EMC/Unity driver ● QNAP driver supports more storage models ● Ability to configure HA for security services for DHSS=True drivers ● Improvements to the generic driver ○ performance ○ reliability ● A much better container driver - still not recommended for production use Driver enhancements in Stein
  • 13.
    ● Public sharecreation can be controlled by policy ● Making things easier for contributors ○ Simpler review process ■ https://docs.openstack.org/manila/latest/contributor/manila-review-policy.html ● Manifests to deploy first party drivers ○ https://docs.openstack.org/manila/latest/contributor/development-environment-devstack.html# sample-local-conf-files-that-get-you-started ● Categorizing “low-hanging-fruit” ○ https://bugs.launchpad.net/manila/+bugs?field.tag=low-hanging-fruit ○ https://bugs.launchpad.net/python-manilaclient/+bugs?field.tag=low-hanging-fruit ○ https://bugs.launchpad.net/manila-ui/+bugs?field.tag=low-hanging-fruit Other enhancements in Stein
  • 14.
    Train release 20th releaseof OpenStack 10th official release of Manila
  • 15.
    SCALABILITY RESILIENCY MANAGEABILITYMODULARITY INTEROPERABILITY SECURITY USER EXPERIENCE MAJOR FOCUS NO INFO NO INFO NO INFO Train release themes for Manila MAJOR FOCUS MAJOR FOCUS MINOR FOCUS MINOR FOCUS
  • 16.
    SCALABILITY RESILIENCY MANAGEABILITYMODULARITY INTEROPERABILITY SECURITY USER EXPERIENCE MAJOR FOCUS MINOR FOCUS NO INFO NO INFO NO INFO NO INFO U release themes for Manila MAJOR FOCUS MINOR FOCUS MINOR FOCUS
  • 17.
    Train themes Manila atscale and in edge deployments active-active share service when to use DLM, when to use DB for exclusion Manila for Container Orchestrators Wednesday 5:10-5:50pm Room 501/502 no-auth standalone deployments Production Quality Open Source back ends Create new share form CephFS snapshots per-tenant share servers and better network isolation
  • 18.
    ● Tag [manila]on the OpenStack discuss mail list ● Find us in #openstack-manila on freenode ● Feel free to reach out to our PTL, contributors directly ○ https://review.opendev.org/#/admin/groups/213,members How to give feedback
  • 19.
    Manila project onboardingsession: Monday, April 29, 12:00pm-12:40pm, The Colorado Convention Center - 406 Developer Docs: https://docs.openstack.org/manila/latest/contributor/index.html How to contribute
  • 20.
    We need yourhelp! • [Question #1] • [Question #2] • [Question #3] • [Developer request #1] • [Developer request #2] • [Developer request #3]
  • 21.