Open ebs 101

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

OpenEBS 101
Container Attached Storage
Updated: August 2021

OpenEBS
• Leading Open Source Container Attached Storage Solution for
simplifying the running of Stateful workloads in Kub...

Kubernetes Clusters w/ OpenEBS

Data Platforms and Services
Data Platform
(Stateful)
(Databases, Key/Value
Stores, Message Bus)
read/write files,blocks
(P...

Challenges with existing Storage
Agility and
Productivity
Monolithic data platform
software is being redesigned
with micro...

Paradigm Shift. Change is inevitable.
Development and People
Processes have changed
Loosely coupled applications and loose...

Origins of OpenEBS
Data Platform
(Stateful)
(Databases, Key/Value
Stores, Message Bus)
read/write files,blocks
(POSIX)
Vol...

Why Data on Kubernetes?
• Hybrid Cloud Readiness
• Declarative installation of stateful stacks
for developer environments
...

Where does OpenEBS fit?
https://www.cncf.io/blog/2020/07/06/announcing-the-updated-cncf-storage-landscape-whitepaper/
Loca...

Changing Storage Needs
Workload Type Standalone
(MinIO or MySQL)
Standalone
(Prometheus or Jenkins)
Distributed
(TiDB, Kaf...

Kubernetes as universal control plane
Functionality How does Kubernetes (aka containers help?)
Resource Management
and Sch...

Container Attached Storage
https://www.cncf.io/blog/2020/09/22/container-attached-storage-is-cloud-native-storage-cas/
htt...

K8s Stateful Stack with OpenEBS
OpenEBS Control Plane
CSI Drivers
Storage Operators, Data
Engine Operators
Prometheus Expo...

OpenEBS Persistent Volumes
Storage Devices
NVMe/SCSI, SSD/HDD, Cloud/SAN
Block Devices or Device Aggregation/Pooling using...

CAS
OpenEBS Persistent Volumes
Local Volumes Replicated Volumes
CAS - Hyperconverged
Kubernetes native
Runs anywhere.
Easy...

OpenEBS Persistent Volumes
Engine Type Local Volumes Replicated Volumes
Example Device, Hostpath, LVM,
Rawfile, ZFS
cStor,...

How does OpenEBS work?
Storage Devices
NVMe/SCSI, SSD/HDD, Cloud/SAN
Volume Replica
Jiva, cStor,
Mayastor
Volume Target
Ji...

OpenEBS - User Journey
Developer
SRE / Platform Engineer
Run Stateful with local storage
(ML Job or simple app, local s3)
...

OpenEBS Benefits and Limitations
Beneﬁts
• Kubernetes native - ease of use and operations. integrates
into the standard cl...

Quick Start
OpenEBS Local PV - Hostpath

Kubernetes Cluster
node2
node1
OpenEBS Local PV (hostpath)
Pod
Stateful
Workload
(DB, etc)
Setup OpenEBS
PV1
DevOps
admin
...

kubectl apply -f https://openebs.github.io/charts/hostpath-operator.yaml
OpenEBS Local PV (hostpath)
apiVersion: storage.k...

kind: PersistentVolumeClaim
apiVersion: v1
metadata:
name: local-hostpath-pvc
spec:
storageClassName: local-hostpath
acces...

apiVersion: v1
kind: PersistentVolume
metadata:
name: pvc-864a5ac8-dd3f-416b-9f4b-ffd7d285b425
...
spec:
capacity:
storage...

OpenEBS Local PV - FAQ
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
name: local-hostpath
annotations:
openeb...

Troubleshooting Local PV (hostpath)

Where to find us?
https://slack.k8s.io
#openebs
Join OpenEBS
Channel on
Kubernetes Slack
https://openebs.io/community

OpenEBS 201
Container Attached Storage
Updated: Aug 2021

Where does OpenEBS fit?
https://www.cncf.io/blog/2020/07/06/announcing-the-updated-cncf-storage-landscape-whitepaper/
Loca...

CAS
OpenEBS Data Engine Evolution
Local Volumes Replicated Volumes
CAS CAS
OpenEBS 1.0 Hostpath, Device Jiva, cStor
OpenEB...

OpenEBS 3.0
● GA:
a. cStor CSI
b. Local PV ZFS
c. Local PV LVM
d. Local PV Hostpath
● Beta:
a. Dynamic NFS
b. Mayastor
c. ...

OpenEBS Data Engine comparison
Hostpath Device Rawﬁle LVM ZFS Jiva cStor Mayastor
Dynamic Provisioned Volumes Yes Yes Yes ...

OpenEBS Data Engine comparison
Hostpath Device Rawﬁle LVM ZFS Jiva cStor Mayastor
Node Storage Pooling (RAID) Yes Yes Yes ...

OpenEBS Local PV - Use cases
node1 node2 node3
Local PVs are great for Cloud Native Workloads (or distributed
system) that...

LocalPV HostPath
Node 3
LocalPV Device
Node 1
ZFS or LVM LocalPV
Node 2 Pool
Application
Namespace
Internet
Physical Hard ...

OpenEBS 3.0 (Local PV)
OpenEBS Local Storage Operators make it easy to provision Local Volumes with different flavors of
l...

kubectl apply -f https://openebs.github.io/charts/hostpath-operator.yaml
OpenEBS LocalPV (hostpath)
apiVersion: storage.k8...

OpenEBS Replicated PV - Use cases
node1 node2 node3
Replicated PVs are great for Cloud Native Workloads (or
distributed sy...

Application
Namespace
Internet
OpenEBS CStor
Stateful
Application
Running
Inside Pod in
Kubernetes
Persistent
Volume for
A...

OpenEBS 3.0 (Replicated PV)
OpenEBS Replicated Volumes enable users make use of the local storage available to kubernetes
...

Node 3
Node 1
Node 2
Application
Namespace
Internet
OpenEBS Mayastor
Stateful
Application
Running
Inside Pod in
Kubernetes...

OpenEBS Mayastor (Beta In Progress)
Mayastor delivers high performance access to
persistent data and services, using the i...

OpenEBS Mayastor (Beta In Progress)
Mayastor (ANA) Volumes
OpenEBS 3.1 Mayastor with ANA
CAS CAS CAS
Mayastor (ANA) Faster...

OpenEBS 3.0 (Other Features)
Beyond the improvements to the data engines and their corresponding control plane, there are ...

kubectl apply -f https://openebs.github.io/charts/nfs-operator.yaml
OpenEBS NFS (RWX Volumes)
apiVersion: storage.k8s.io/v...

kubectl krew install openebs
OpenEBS CLI
$ kubectl openebs version
COMPONENT VERSION
Client v0.4.0
OpenEBS CStor 3.0.0
Ope...

OpenEBS CLI
$ kubectl openebs describe volume pvc-dea356c2-7bd0-442e-a92f-98d503c65fb3
pvc-dea356c2-7bd0-442e-a92f-98d503c...

OpenEBS Monitoring
helm repo add openebs-monitoring https://openebs.github.io/monitoring/
helm repo update
helm install op...

OpenEBS Monitoring
helm repo add openebs-monitoring https://openebs.github.io/monitoring/
helm repo update
helm install op...

OpenEBS 3.1 ( Planning )
Stateful Operator (STS) with Local PV
● Fault tolerant scheduling for
distributed applications
● ...

OpenEBS 3.1 (LocalPV ++)
Local Volumes
OpenEBS 3.1 Local PV ++ ( Shared Devices)
Local Volumes (HA)

OpenEBS 3.1 (LocalPV ++)
Local Volumes
OpenEBS 3.1 Local PV ++ ( Shared Devices + Remote Access via
NVMe )
CAS
Local Volum...

OpenEBS 3.1 (LocalPV ++)
Local Volumes
OpenEBS 3.1 Local PV ++ ( Shared Devices + Remote Access via
NVMe )
CAS CAS
Local V...

OpenEBS 3.1 Storage Cohort
A storage cohort is an autonomous storage
unit that consists of a set of storage devices
(group...

OpenEBS 3.1 (Cluster topology)
AZ-A1 AZ-A2 AZ-A3
AZ-A1x AZ-A2y AZ-A3z
FD-A1a FD-A1b FD-A2a FD-A2b FD-A3a FD-A3b
FD-A1a
FD-...

OpenEBS 3.1 - Fault Tolerant Scheduling
NVMe NVMe NVMe NVMe NVMe NVMe
AZ-A1 AZ-A2 AZ-A3
AZ-A1x AZ-A2y AZ-A3z
FD-A1a FD-A1b...

Application Node
Application Node
Storage Cohort - 1
Storage Node
NVMe
Storage Node
pv
NVMe
Cohort
Manager
OpenEBS 3.1 (w ...

OpenEBS Volume Types (Recap)
NVMe NVMe
pv
OpenEBS Local PV ++
(Shared Local Device)
pv
OpenEBS Replicated
(Mayastor)
(over...

OpenEBS 401
Container Attached Storage
Updated: Aug 2021

CAS
OpenEBS Future Deployments
Any Workload, Any Cluster
CAS CAS
OpenEBS 4.0 (Multipath) NVMe over Local (Multipath) Mayas...

OpenEBS Volume Types (Recap)
NVMe NVMe
pv
OpenEBS Local PV ++
(Shared Local Device)
pv
OpenEBS Replicated
(Mayastor)
(over...

OpenEBS Storage Cohort
A storage cohort is an autonomous storage
unit that consists of a set of storage devices
(grouped t...

Storage Cohort Examples

Storage Cohort Examples

Storage Cohort Examples

Storage Cohort Example
Nodes with PCIe SSDs
40-100Gb NICs
512 GB RAM
32-96 cores
(Horizontally scalable / Rack
Scaled)
NW ...

Application Node
Application Node
Storage Cohort - 1
Storage Node
NVMe
Storage Node
pv
NVMe
Cohort
Manager
OpenEBS 3.1 Loc...

NW Fabric for NVMe
Application Node
Application Node
Storage Cohort
NVMe
Storage Node
pv
NVMe
Cohort
Manager
Application C...

OpenEBS 4.0 - Fault Tolerant Scheduling
NVMe NVMe NVMe NVMe NVMe NVMe
AZ-A1 AZ-A2 AZ-A3
AZ-S1 AZ-S2 AZ-S3
FD-S1a FD-S1b FD...

OpenEBS 4.0 - Fault Tolerant Scheduling
NVMe NVMe NVMe NVMe NVMe NVMe
AZ-A1 AZ-A2 AZ-A3
AZ-S1x AZ-S1y AZ-S1z
FD-S1a FD-S1b...

OpenEBS 4.0 - Fault Tolerant Scheduling
NVMe NVMe NVMe NVMe NVMe NVMe
AZ-A1 AZ-A2 AZ-A3
AZ-S1x AZ-S1y AZ-S1z
FD-S1a FD-S1b...

OpenEBS 4.0 - Aﬃnity Scheduling
NVMe NVMe NVMe NVMe NVMe NVMe
AZ-A1 AZ-A2 AZ-A3
AZ-A1x AZ-A2y AZ-A3z
FD-A1a FD-A1b FD-A2a ...

Mayastor Control Plane
OpenEBS integration with MayaData
Application Cluster Node(s)
Application Node
Application Node
May...

OpenEBS integration with VDA
Application Cluster Node(s)
Application Node
Application Node
VDA Node
OpenEBS CSI Controller...

OpenEBS integration with RedFish (RF)
Application Cluster Node(s)
Application Node
Application Node
RF Node
OpenEBS CSI Co...

Enterprise Tools and
Operators
(Integrations)
NW Fabric for NVMe
Application Node
Application Node
Storage Cohort
Storage ...

NW Fabric for NVMe
Application Node
Application Node
Storage Cohort
Storage Node
NVMe
Storage Node
pv
NVMe
Cohort
Manager
...

OpenEBS 4.0 ( Features )
CSI Driver (with Application and Platform
Awareness)
● Application and Storage proximity
● Applic...

Thank you!

OpenEBS 3.0 (Hyperconvergence Achieved)
Cluster
Components
Helm Chart /
YAML
Data Engine Operator CSI Driver
CSI Driver
Pl...

OpenEBS 3.1 Release Timeline
Nov 31st 2021
3.1 POC
Mar 31st 2022
3.1 Alpha Release
● Virtual SAS Array
● VDA

OpenEBS 4.0 ( SCP for Any NVMe Target)
NVMe NVMe
pv
OpenEBS NVMe
over Shared Local Device
pv
Storage Array(s) with
exposin...

Node 3
Node 1
Node 2
Application
Namespace
Internet
SSD
OpenEBS Mayastor
Stateful
Application
Running
Inside Pod in
Kubern...

Share SlideShare

Facebook
Twitter
LinkedIn

Embed

Size (px)

Show related SlideShares at end

WordPress Shortcode

Link

LinkedIn
Facebook
Twitter
Email

Replay

Top clipped slide

1 of 84 Ad

1 of 84 Ad