Webinar MayaData OpenEBS 1.1 release
•
0 likes•288 views
OpenEBS 1.1 has been released and is now ready for prime time. MayaData Agility Platform, the commercial distribution of OpenEBS combined with MayaOnline or MayaOnPrem and support, has also been updated and loaded with a lot of new features. In this webinar, we will cover new features like: Kubernetes Job for auto update of releases Support for an alpha version of CSI driver with limited functionality for provisioning and de-provisioning of cStor volumes. Additional platforms like Amazon Marketplace, Openshift Operator Hub, Rancher K3OS. Bug fixes reported around the cStor volume, NDM, cStor Target, cStor Sparse tool and Jiva volumes. Upgrade of the Valero plugin. Link to view webinar: https://go.mayadata.io/webinar/openebs-1.1release
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Webinar MayaData OpenEBS 1.1 release
Similar to Webinar MayaData OpenEBS 1.1 release (20)
More from MayaData Inc
More from MayaData Inc (11)
Recently uploaded
Recently uploaded (20)
Webinar MayaData OpenEBS 1.1 release
- 2. Your Presenters: Philippe Theriault murat Uma Mukkara @phil_Theriault @muratkarslioglu @uma_mukkara Philippe Theriault CRO MayaData Inc Murat Karslioglu VP of Product MayaData Inc Uma Mukkara COO MayaData Inc
- 3. Agenda ● Introduction ● What’s new with 1.1 Release ● Performance ● What’s coming? ● Demo ● Q&A
- 4. CAS - Container Attached Storage + OpenEBS
- 5. CAS?
- 6. App K8s Node PV PV PV App App Storage Server Vol Vol Vol NAS/EBS K8s Node App PV PV App PV App DAS/Local PV K8s Node App PV PV App PV App CAS Pod(s) CAS Pod(s) CAS Pod(s) CAS CAS Pod(s) CAS Pod(s) ● Not agile ● Lock-in ● Incompatible Snapshots ● No HA ● Lock-in ● No Snapshots ● Agile/Easy ● App Granular ● HA ● Elastic O/S CAS Architecture Comparison
- 7. OpenEBS - Leading CAS + Simple + Teams are autonomous + 100% Open source + In user-space + Granular + Additive to underlying systems or cloud volumes or JBODs
- 9. Making OpenEBS users successful + OpenEBS Enterprise Open Source - self adopted by teams + Litmus: Prove that Kubernetes & your stateful workloads working well + MayaOnline: Control and visibility for central IT + Services such as DMaaS: Data migration as a service + Proactive support Commercial product
- 10. Visibility, validation and control
- 12. Updates on Data Plane Storage Engines Jiva cStor Local PV Stable Beta Beta
- 13. Support for ARM64 A 1.5GHz quad-core 64-bit ARM Cortex-A72 CPU (~3× performance) Up to 4GB of LPDDR4 SDRAM Full-throughput Gigabit Ethernet Dual-band 802.11ac wireless networking C1.large.arm on PacketAWS EC2 A1 instances
- 14. Release frequency Monthly Releases Plan->Build->Test->Document Backlog grooming Release tracking
- 15. Transparent Alpha / Beta categorization
- 16. Overview of OpenEBS 1.1 Changes ● Improved Upgrade Process - Details here ● Enhancements ○ Improved Prometheus metrics for Jiva volumes ○ NDM operator capabilities for handling NDM CRDs installation and upgrade. ○ velero-plugin to take backup based on the openebs.io/cas-type:cstor. ○ Improved velero-plugin to allow users to save/backup configuration and volume snapshot data under the same location. ● Bug fixes - List here ● Initial CSI Driver - Details here kubectl apply -f https://raw.githubusercontent.com/openebs/csi/master/deploy/csi-operator.yaml
- 17. ● Application Dashboard MayaOnline is now OpenEBS Director ● Director OnPrem available (Enterprise) ● Application Analytics
- 19. Demo
- 21. Roadmap for 1.2 and after + Documentation - Best practices + Support for cStor volume resize via CSI + cStor Pool expansion by adding disks + NDM BlockDevice UUID generation + Upgrade enhancement and cleanup + OpenEBS Operator - Monitoring health of the components
- 22. Q & A
- 23. Get Started
- 24. Why MayaData OpenEBS Enterprise Platform OpenEBS Community OpenEBS Enterprise Platform Support Self Up to 24x7 Performance enhancement X Yes Bug / patches / updates When released Priority and personalized MayaOnline Basic - 7 days logs / 3 nodes SaaS Advanced - Up to 13 months SaaS and On-Premises DMaaS, RBAC, Backup & Migration X Yes You support the development of OpenEBS X Yes
- 25. Starting at $ 63/Month ➔ $ 63 per month ➔ Up to 10 hours of professional assistance to set up OpenEBS Enterprise + MayaOnline in your environment with 3 subs. ➔ Expert advice on how to deal with Stateful Applications on Kubernetes ➔ Enterprise class support ➔ Yaml for most popular use cases ➔ Intro training ➔ Personalized ROI document
- 26. Get Started - Go to mayadata.io + Connect with us via “REQUEST DEMO” + Quick chat with our engineer about your use cases + We will setup your Premium support and MayaOnline Account + We will show you the full potential and tune the performance + We will assist with your pilot or POC. + We will make you successful, we know storage and K8s very well!
- 27. Thank You
Editor's Notes
- EVAN STARTS
- Cadence of release ARM Extra items from Kiran’s blog
- EVAN <START>
- EVAN </END>
- MURAT STARTS HERE
- Data Plane The OpenEBS data plane is responsible for the actual volume IO path. A storage engine implements the actual IO path in the data plane. Currently, OpenEBS provides three storage engines that can be plugged in easily. These are called Jiva, cStor and LocalPV. All current storage engines run completely in Linux user space and are based on micro services architecture. Recently we clarified that our release gates are defined by OpenEBS Litmus based GitLab pipelines that run end-to-end tests on multiple different platforms and stateful workloads. These pipelines used to catch any regressions. A feature is marked as Beta only after it has been added to the test pipelines. For example, LocalPV as of OpenEBS 1.1 is now Beta because it is passing these tests — and also is seeing a lot of production usage as well. The first and most widely deployed OpenEBS Data Engine - Jiva has graduated to stable. Jiva is ideal for use cases where Kubernetes nodes have storage available via hostpaths. Jiva Volumes support thin provisioning and supports backup and restore via Velero. cStor Data Engine continues to be a preferred solution for use cases that require instant snapshot and clone of volumes. This release has some more fixes around the rebuild and backup/restore scenarios. The latest volume type - OpenEBS Local PV has graduated to beta with some users already using it in production. For those applications that do not need storage level replication, LocalPV may be good option as it gives higher performance. OpenEBS LocalPV is similar to Kubernetes LocalPV except that it is dynamically provisioned by OpenEBS control plane, just like any other regular PV. OpenEBS LocalPV is of two types - hostpath LocalPV or device LocalPV. hostpath LocalPV refers to a subdirectory on the host and device LocalPV referes to a discovered disk (either directly attached or network attached) on the node. OpenEBS has introduced a LocalPV provisioner for selecting a matching disk or hostpath against some criteria in PVC and storage class specifications. Jiva Jiva storage engine is developed with Rancher's LongHorn and gotgt as the base. Jiva engine is written in GO language and runs in the user space. LongHorn controller synchronously replicates the incoming IO to the LongHorn replicas. The replica considers a Linux sparse file as the foundation for building the storage features such as thin provisioning, snapshotting, rebuilding etc. cStor cStor data engine is written in C and has a high performing iSCSI target and Copy-On-Write block system to provide data integrity, data resiliency and point-in-time snapshots and clones. cStor has a pool feature that aggregates the disks on a node in striped, mirrored or in RAIDZ mode to give larger units of capacity and performance. cStor also provides the synchronous replication of data to multiple nodes even across zones so that node loss or node reboots do not cause unavailability of data. LocalPV For those applications that do not need storage level replication, LocalPV may be good option as it gives higher performance. OpenEBS LocalPV is similar to Kubernetes LocalPV except that it is dynamically provisioned by OpenEBS control plane, just like any other regular PV. OpenEBS LocalPV is of two types - hostpath LocalPV or device LocalPV. hostpath LocalPV refers to a subdirectory on the host and device LocalPV referes to a discovered disk (either directly attached or network attached) on the node. OpenEBS has introduced a LocalPV provisioner for selecting a matching disk or hostpath against some criteria in PVC and storage class specifications.
- As an example of a new platform, we have seen quite a bit of usage of especially the low footprint Jiva on ARM and are now releasing container images for built for the ARM64 architecture, making OpenEBS operational on RPi4 as well as Amazon A1 instances with custom silicon AWS Graviton Processors or Packet’s powerful Cavium Thuderx Based ARM Compute servers.
- Before we get into the specifics of the current release, the last three OpenEBS releases have set an interesting goal towards attaining a monthly release cadence. Before the start of the release, we look at the backlogs which are on GitHub. Items are selected based on contributor availability and balancing the development of new features, fixing existing features, updating and improving documentation, improving e2e coverage, and hardening the usage of OpenEBS on new platforms. The list of selected items are tracked for the current release using these Google Sheets. It is not fancy, but it helps to get all the collaborators together and very easily provides a no-barrier objective follow-up — between release manager, leads and reviewers. The final two weeks — As we reach the end of a one month release cycle the focus turns to refactoring and adding more test cases while stabilizing the features rather than introducing new features. The last two weeks are also about polishing documentation and trying to reach out to users whose requests have been incorporated into the product to get some early feedback.
- Clarity of criteria for alpha and beta — Recently we clarified that our release gates are defined by OpenEBS Litmus based GitLab pipelines that run end-to-end tests on multiple different platforms and stateful workloads. Perhaps goes without saying — however we use these pipelines to catch any regressions. What is more — a feature is marked as Beta only after it has been added to the test pipelines. For example, LocalPV as of OpenEBS 1.1 is now Beta because it is passing these tests — and also is seeing a lot of production usage as well.
- A significant improvement in the upgrade process compared to earlier releases, is that upgrades can be triggered as Kubernetes jobs instead of downloading and executing shell scripts. The detailed steps are provided here. Upgrade to 1.1 is supported only from 1.0 Kubernetes Job based upgrade is a step towards completely automating the upgrades in the upcoming releases. Support for an alpha version of CSI driver with limited functionality for provisioning and deprovisioning of cStor volumes. Once you have OpenEBS 1.1 installed, you can take it for a spin on your development clusters using the instructions provided here. CSI driver also requires a shift in the paradigm of how the configuration of the storage class parameters should be passed on to the drivers. We want to keep this seamless, please let us know if you have any inputs on what you notice as some of the nice to have as we shift towards the CSI driver. - Prometheus metrics exported by Jiva for identifying whether an iSCSI Initiator is connected to Jiva target. - Enhanced NDM operator capabilities for handling NDM CRDs installation and upgrade. Earlier this process was handled through maya-apiserver. - Enhanced velero-plugin to take backup based on the openebs.io/cas-type:cstor and it will skip backup for unsupported volumes(or storage providers). - Enhanced velero-plugin to allow users to specify a backupPathPrefix for storing the volume snapshots in a custom location. This allows users to save/backup configuration and volume snapshot data under the same location.
- PATRICK
- EVAN
- Murat
- Murat
- PHILIPPE TO UPDATE
- Murat