Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
South Bay Kubernetes DevOps Meetup #2- October 2017
Murat Karslioglu - @muratkarslioglu
VP of Solutions and Technology @Op...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
2
Who?
v
Team of storage and DevOps
engineers wi...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
3
2017 CloudByte Inc. All Rights Reserved
What i...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
4
2017 CloudByte Inc. All Rights Reserved
Cross ...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
5
2017 CloudByte Inc. All Rights Reserved
What i...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
6
OpenEBS metrics
2017 CloudByte Inc. All Rights...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
7
Architecture: Kubernetes
K8S Master
Minion
POD...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
8
Architecture: Kubernetes + OpenEBS
K8S Master
...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
9
Architecture: Kubernetes + OpenEBS + Maya
K8S ...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
10
DAS increasingly preferred to NAS/SAN
DAS
Ben...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
11
DAS increasingly preferred to NAS/SAN
DAS
Ben...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
12
DAS and Distributed
DAS
Benefits:
Simple
Ties...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
13
DAS and Distributed
DAS
Benefits:
Simple
Ties...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
14
DAS
Under-utilized hardware
Hard to manage
La...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
15
YASSS: yet another scale out storage system
2...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
16
YASSS: yet another scale out storage system
H...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
17
!YASSS
Yet Another Scale
Out Storage
System
2...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
18
!YASSS
Yet Another Scale
Out Storage
System
2...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
19
Container Attached Storage = DAS++
DAS
Benefi...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
20
Container Attached Storage
No special skills ...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
21
Why per micro-service granularity important?
...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
22
Today’s scale out storage systems are almost ...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
23
Normal behavior
POD
Container
Container
Conta...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
24
Normal behavior
POD
Container
Container
Conta...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
25
Normal behavior
POD
Container
Container
Conta...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
26
2017 CloudByte Inc. All Rights Reserved
Norma...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
27
2017 CloudByte Inc. All Rights Reserved
Norma...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
28
Personas
2017 CloudByte Inc. All Rights Reser...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
29
Storage Orchestration - K8s Vs OpenEBS
Functi...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
30
Storage just fades away as a concern
2017 Clo...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
31
Benefits of Cloud Native approach
OpenEBS alw...
2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved.
32
Q&A
Please tell us we are crazy.
Find out HOW...
Upcoming SlideShare
Loading in …5
×

South Bay Kubernetes DevOps

193 views

Published on

Containerized storage for CI/CD Pipeline and DevOps - why, how, huh? What is wrong w/ stateful workloads on containers today? What is happening at the Linux kernel to improve the security of containers as a platform FOR storage? Could containers and Kubernetes become the foundations of a new approach to storage? How to deal with storage in multi-cloud environment. Quick view into the OpenEBS project.

Murat Karslioglu is a serial entrepreneur, technologist, and startup geek with over 15 years of experience in storage, distributed systems, and enterprise software development. He is currently the VP of Solutions and Technology at CloudByte / OpenEBS, a startup developing open-source containerized storage for containers.

Prior to joining CloudByte, Murat has worked at Hewlett Packard Enterprise / 3PAR Storage in various advanced development projects including storage file stack performance optimization and the storage management stack for HPE’s Hyper-converged solution. Murat holds a Bachelor’s Degree in Industrial Engineering from the Sakarya University.

Published in: Education
  • Be the first to comment

  • Be the first to like this

South Bay Kubernetes DevOps

  1. 1. South Bay Kubernetes DevOps Meetup #2- October 2017 Murat Karslioglu - @muratkarslioglu VP of Solutions and Technology @OpenEBS Blog: www.containerized.me Containerized Storage for Containers
  2. 2. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 2 Who? v Team of storage and DevOps engineers with a 5 year track record of delivering containerized storage (built on jails) to NTT, eSilicon, TCS and other service providers. CloudByte – our SDS brand. 2017 CloudByte Inc. All Rights Reserved
  3. 3. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 3 2017 CloudByte Inc. All Rights Reserved What if the drivers disrupting the storage industry helped to fix storage – and data management – once for all? DevOps Containerization Docker AWS Microservices OpenSource Non-volatile Memory (NVMe) Fear of lock-in
  4. 4. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 4 2017 CloudByte Inc. All Rights Reserved Cross cloud infrastructure becomes a reality – and data management is fixed once and for all. And storage concerns just fade away for containerized enterprises.
  5. 5. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 5 2017 CloudByte Inc. All Rights Reserved What if storage for container native applications was itself container native?
  6. 6. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 6 OpenEBS metrics 2017 CloudByte Inc. All Rights Reserved
  7. 7. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 7 Architecture: Kubernetes K8S Master Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t etcd APIs Cntrl Schl d Minions run on physical nodes PODs group containers, share an IP address, and each include a Kubelet agent K8S Master services include: etcd, APIs, the scheduler, the control manager & others 2017 CloudByte Inc. All Rights Reserved
  8. 8. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 8 Architecture: Kubernetes + OpenEBS K8S Master Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t etcd APIs Cntrl Schld OpenEBSAPIs Schld Data Containers run in PODs on physical machines Data Containers group physical disks local or remote, manage replicas, provide QoS control & more OpenEBS brain runs on the Master; delivers services such as: APIs, a storage scheduler, analytics… 2017 CloudByte Inc. All Rights Reserved
  9. 9. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 9 Architecture: Kubernetes + OpenEBS + Maya K8S Master Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t Minion POD Container Container Container Kubele t POD Container Container Container Kubele t POD Container Container Container Kubele t etcd APIs Cntrl Schld OpenEBSAPIs Schld Data Containers run in PODs on physical machines Data Containers group physical disks local or remote, manage replicas, provide QoS control & more OpenEBS brain runs on the Master; delivers services such as: APIs, a storage scheduler, analytics… Maya delivered as Cloud Converged Appliance & SaaS solution to fully automate storage operations 2017 CloudByte Inc. All Rights Reserved
  10. 10. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 10 DAS increasingly preferred to NAS/SAN DAS Benefits: Simple Ties application to storage Predictable for capacity planning App deals with resiliency Can be faster Concerns: Under-utilized hardware ○ 10% or less utilization Wastes data center Difficult to manage Lacks storage features Cannot be repurposed - made for one workload Does not support mobility of workloads via containers Cross cloud impossible “We have ~100k nodes of Cassandra alone, and use DAS because it is easier even if it burns energy and capEx.” Other example DAS users moving to Kubernetes: 2017 CloudByte Inc. All Rights Reserved
  11. 11. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 11 DAS increasingly preferred to NAS/SAN DAS Benefits: Simple Ties application to storage Predictable for capacity planning App deals with resiliency Can be faster Concerns: Under-utilized hardware ○ 10% or less utilization Wastes data center Difficult to manage Lacks storage features Cannot be repurposed - made for one workload Does not support mobility of workloads via containers Cross cloud impossible Other example DAS users moving to Kubernetes: “We have ~100k nodes of Cassandra alone, and use DAS because it is easier even if it burns energy and capEx.” 2017 CloudByte Inc. All Rights Reserved
  12. 12. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 12 DAS and Distributed DAS Benefits: Simple Ties application to storage Predictable for capacity planning App deals with resiliency Can be faster Concerns: Under-utilized hardware ○ 10% or less utilization Wastes data center Difficult to manage Lacks storage features Cannot be repurposed - made for one workload Does not support mobility of workloads via containers Cross cloud impossible Distributed Benefits: Centralized management Greater density and efficiency Storage features such as: ○ Data protection ○ Snapshots for versioning Concerns: Additional complexity Enormous blast radius Expensive Requires storage engineering Challenged by container dynamism No per microservice storage policy I/O blender impairs performance Locks customers into vendor Cross cloud impossible 2017 CloudByte Inc. All Rights Reserved
  13. 13. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 13 DAS and Distributed DAS Benefits: Simple Ties application to storage Predictable for capacity planning App deals with resiliency Can be faster Concerns: Under-utilized hardware ○ 10% or less utilization Wastes data center Difficult to manage Lacks storage features Cannot be repurposed - made for one workload Does not support mobility of workloads via containers Cross cloud impossible Distributed Benefits: Centralized management Greater density and efficiency Storage features such as: ○ Data protection ○ Snapshots for versioning Concerns: Additional complexity Enormous blast radius Expensive Requires storage engineering Challenged by container dynamism No per microservice storage policy I/O blender impairs performance Locks customers into vendor Cross cloud impossible 2017 CloudByte Inc. All Rights Reserved
  14. 14. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 14 DAS Under-utilized hardware Hard to manage Lacks all storage features Hard to support workload mobility 2017 CloudByte Inc. All Rights Reserved
  15. 15. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 15 YASSS: yet another scale out storage system 2017 CloudByte Inc. All Rights Reserved
  16. 16. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 16 YASSS: yet another scale out storage system Huge blast radius 2017 CloudByte Inc. All Rights Reserved
  17. 17. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 17 !YASSS Yet Another Scale Out Storage System 2017 CloudByte Inc. All Rights Reserved
  18. 18. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 18 !YASSS Yet Another Scale Out Storage System 2017 CloudByte Inc. All Rights Reserved
  19. 19. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 19 Container Attached Storage = DAS++ DAS Benefits: Simple Ties application to storage Predictable for capacity planning App deals with resiliency Can be faster Concerns: Under-utilized hardware ○ 10% or less utilization Wastes data center Difficult to manage Lacks storage features Cannot be repurposed - made for one workload Does not support mobility of workloads via containers Cross cloud impossible OpenEBS = “CAS” ✓ Simple ✓ No new skills required ✓ Per microservice storage policy ✓ Data protection & snapshots ✓ Reduces cloud vendor lock-in ✓ Eliminates storage vendor lock-in ✓ Highest possible efficiency ✓ Large & growing OSS community ✓ Natively cross cloud Distributed Benefits: Centralized management Greater density and efficiency Storage features such as: ○ Data protection ○ Snapshots for versioning Concerns: Additional complexity Enormous blast radius Expensive Requires storage engineering Challenged by container dynamism No per microservice storage policy I/O blender impairs performance Locks customers into vendor Cross cloud impossible 2017 CloudByte Inc. All Rights Reserved CAS DAS Distributed
  20. 20. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 20 Container Attached Storage No special skills needed! 2017 CloudByte Inc. All Rights Reserved
  21. 21. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 21 Why per micro-service granularity important? Today’s scale out storage systems are almost infinitely configurable. Matching their configurations to static workloads is difficult. In a world of dynamic, ever evolving workloads due to micro-services and multi-cloud deployments, it is not a tractable problem for humans. Let’s say you want to benchmark for your workload: Source: Alex Aizman’s blog: https://storagetarget.com/author/alexaizman/ 2017 CloudByte Inc. All Rights Reserved
  22. 22. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 22 Today’s scale out storage systems are almost infinitely configurable. Matching their configurations to static workloads is difficult. In a world of dynamic, ever evolving workloads due to micro services and multi-cloud deployments, it is not a tractable problem for humans. Let’s say you want to benchmark for your workload: Duration of run 6,700 years Source: Alex Aizman’s blog: https://storaget arget.com/auth or/alexaizman/ Why per micro-service granularity important? 2017 CloudByte Inc. All Rights Reserved
  23. 23. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 23 Normal behavior POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 1 Maya POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 2 POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet EBS AWS EBS EBS EBS POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet GPD GCE GPD GPD GPD 1. CI/CD pipeline deploys: 2. OpenEBS reads intent FROM K8S For example: - 2 sync copies - 50 / 50 cloud - 2 Data centers 2017 CloudByte Inc. All Rights Reserved
  24. 24. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 24 Normal behavior POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 1 Maya POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 2 POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet EBS AWS EBS EBS EBS 1. CI/CD pipeline deploys: 2. OpenEBS reads intent FROM K8S For example: - 2 sync copies - 50 / 50 cloud - 2 Data centers POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet GPD GCE GPD GPD GPD 2017 CloudByte Inc. All Rights Reserved
  25. 25. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 25 Normal behavior POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 1 Maya POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 2 POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet EBS AWS EBS EBS EBS 1. CI/CD pipeline deploys: 2. OpenEBS reads intent FROM K8S For example: - 2 sync copies - 50 / 50 cloud - 2 Data centers 3. writes STORED locally: - working set in NVM - rebalancing in background POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet GPD GCE GPD GPD GPD 2017 CloudByte Inc. All Rights Reserved
  26. 26. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 26 2017 CloudByte Inc. All Rights Reserved Normal behavior: differentiation POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 1 Maya POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 2 POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet EBS AWS EBS EBS EBS 1. Transparency: - works across clouds, & CAS, seamlessly 2. FAST: - Much faster than DAS or network attached - Could be 100 or even 1000x faster POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet GPD GCE GPD GPD GPD
  27. 27. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 27 2017 CloudByte Inc. All Rights Reserved Normal behavior: differentiation POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 1 Maya POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet Data Center 2 POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet EBS AWS EBS EBS EBS 1. Transparency: - works across clouds, & CAS, seamlessly 2. FAST: - Much faster than DAS or network attached - Could be 100 or even 1000x faster 3. Happier Cassandra: - When Cassandra nodes fail, rebalancing, which degrades performance, typically NOT needed POD Container Container ContainerKubelet POD Container Container ContainerKubelet POD Container Container ContainerKubelet GPD GCE GPD GPD GPD 4. Happier CFO: - Far greater utilization - No more cloud lock-in
  28. 28. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 28 Personas 2017 CloudByte Inc. All Rights Reserved
  29. 29. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 29 Storage Orchestration - K8s Vs OpenEBS Functionality K8s OpenEBS Volume Life-cycle - provisioning, attaching/detach, de-provisioning ✓ Monitoring the volume data ✓ Scheduling the volume provisioning intelligently ✓ Smart space management ✓ Availability of volume ✓ Application aware backup/snapshots ✓ QoS guarantee (latency guarantee) ✓ Smart movement of the volumes across racks and regions ✓ Cataloging of storage requirements for different applications ✓ 2017 CloudByte Inc. All Rights Reserved
  30. 30. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 30 Storage just fades away as a concern 2017 CloudByte Inc. All Rights Reserved
  31. 31. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 31 Benefits of Cloud Native approach OpenEBS always available multi-cloud block services are delivered via containerized microservices Granularity: Each pod has its own block protocol stack, tiering engine, QoS engine and more. SLAs per POD. Performance & efficiency: access patterns maintained per-volume. Hot-data on NVMe-Flash or on 3DX-Memory. Cold- data on slower disks / SAN/ Cloud-Storage/S3. Scalability: Metadata based on “size of the volume” & not on “number of volumes”. Can reduce metadata traversal 100x. Blast radius: Eliminates risk of scale out storage system corruption. And much, much more such as cost savings due to resource efficiency, innate multitenancy, and cross cloud portability The Conway’s Law benefits might be the most important - innovation unlocked ✓ ✓ ✓ ✓ 2017 CloudByte Inc. All Rights Reserved
  32. 32. 2017 Storage Developer Conference. © CloudByte Inc.. All Rights Reserved. 32 Q&A Please tell us we are crazy. Find out HOW it works! Meet some folks who want storage to be fixed once and for all. Slack.openebs.io blog.openebs.io Github.com/openEBS @openebs Me: @muratkarslioglu Blog: www.containerized.me 2017 CloudByte Inc. All Rights Reserved

×