SlideShare a Scribd company logo
1 of 23
Download to read offline
Miguel Rojas
Cloud Architect EMEA
Portworx by Pure Storage
mrojas@purestorage.com
@portworx
@purestorage
Delivering a Kubernetes data
platform with Portworx
©
2022 Pure Storage 2
Kubernetes,
Containers
and
Companies
What’s your story?
Founded
2014
‘15 ‘20
‘17
A little history
3
©
2022 Pure Storage, Inc.
Cloud Native is driven by Kubernetes adoption
OF NEW APPS
are developed in
containers.
95% OF ENTERPRISES
81%
OF CNCF MEMBERS
78%
use Kubernetes in
production.
work with 2+ public
cloud providers.
OF GLOBAL BUSINESSES
85%
will be running containers in
production by 2025
(up from 35% in 2019).
Source: CNCF Survey 2021
4
©
2022 Pure Storage, Inc.
The Kubernetes stack has room to mature
Which areas of the Kubernetes tech stack need to mature the most to
make it easier to deploy cloud-native apps?
Source: Kubernetes Adoption Survey 2021 - Portworx
Ranked top three
Application
development
frameworks
Storage and
data
management
Monitoring
and
observability
Networking Orchestration
and
management
75% 68% 57% 54% 46%
5
©
2022 Pure Storage, Inc.
Connector Approach to Container-Native
Two approaches common in the industry today…
Container-Native Storage Approach
”Connector” Approach
Storage Array
1
Storage Array
2
CSI
• 1:1 container <> volume mapping
• Container capabilities vary depending on the capabilities of the
underlying array
• Storage arrays often are challenged by the object count (#
volumes, connections) and change rate (10,000s changes/day)
• Innovation limited to the features in the open CSI specification
• Storage arrays managed independently from K8s
Storage
Array
Local
SSDs/HDDs
Storage Pool
Cloud
Storage
• Many (1,000s):1 container <> volume mapping
• Designed to scale to 10,000s operations/day
• Ensures consistent storage services across ANY infrastructure
• Storage services container-granular and application consistent
• Storage “encapsulated” in a container-native virtual volume that
is free to move with the container
• Managed as a native part of K8s
Pure PSO
NetApp
Dell
6
©
2022 Pure Storage, Inc.
Kubernetes key attributes
MASSIVE-SCALE
KUBERNETES-NATIVE
PLUGGABLE
ARCHITECTURE
OPTIMIZED FOR
MULTI-CLOUD WORLD
APPLICATION CENTRIC
Scales to 1,000s of nodes, 1,000s
of concurrent operations per
minute
All platform operations should be
through a consistent control plane,
the Kubernetes API
Able to offer a consistent control pane on
heterogeneous infrastructure environments
Easily swap in and out core
”infrastructure” services –
networking, storage, monitoring
Platform capabilities should be
focused on the needs of an
application first
Compute
Platform
7
©
2022 Pure Storage, Inc.
Today, Portworx Is the Leading
Kubernetes Data Services Platform
Any App Any Distribution
GKE
DATABASE ANALYTICS STREAMING SEARCH/LOG AI/ML
5G/IoT
Any Cloud Any Infrastructure
Bare Metal Pilot
Go
Live
Global
CaaS
Test/
Dev
Every Stage
The Kubernetes Data Services Platform
PX-Store PX-Secure
PX-Backup PX-DR PX-Migrate PX-Autopilot
Portworx
Data
Services
8
©
2022 Pure Storage, Inc.
What would you like to solve?
The Kubernetes Data Services Platform
PX-Store PX-Secure
PX-Backup PX-DR PX-Migrate PX-Autopilot
Storage,
Share, Scale,
Monitor
Anywhere in
K8s
Backup and
restore from,
and to,
anywhere
DR:
RTO of minutes,
Minutes RPO
Migrate or
duplicate
environments
fast
Auto-pilot
Intelligent,
performant, hyper
converged
self-service
Storage.
The Kubernetes Data Services Platform
PX-Store PX-Secure
PX-Backup PX-DR PX-Migrate PX-Autopilot
Portworx
Data
Services
Secure and
grant storage
access with
RBAC and
Integrations
DBaaS
anywhere fully
managed by
Portworx.
9
©
2022 Pure Storage, Inc.
Portworx sets the gold standard for Kubernetes Storage
Portworx named a Cloud-Native Data Storage & Enterprise Kubernetes Storage leader in 2021 GigaOm Radars
Cloud-Native Data
Storage
GigaOm Radar for Cloud-Native Data Storage for Kubernetes, 2021 GigaOm Radar for Enterprise Kubernetes Storage, 2021
Enterprise Kubernetes
Storage
10
©
2022 Pure Storage, Inc.
Use case: App and Data Migrations
Data centre 1 / Cloud 1 Data centre 2 / Cloud 2
Kubernetes 1 Kubernetes 2
OBJECT STORAGE
► Async data & object replication
► Snap restore based
► Scheduled or on-demand
► RPO 5 minutes
► RTO 5 minutes
11
©
2022 Pure Storage, Inc.
Use case: Container backup & restore
Application granular backup & restore
App 1 App 2
1. k8s objects
2. Config
3. Data
On-premises
ANY Object Storage
NFS – coming soon!
PX-Backup App 1 App 2
App 1 App 2
Second site
Cloud environment
RESTORE
RESTORE
12
©
2022 Pure Storage, Inc.
Portworx Backup
Namespace A
AWS mysql-0
Namespace B
On-Prem mongo-0
Backup Location
Schedule
Rules
Backup Location
Schedule
AWS S3-A AWS S3-B
Daily Hourly
FB S3-A FB S3-B
Weekly Monthly
Developer
User Type
App Owner
Admin
● Backup/restore
their apps
● App + namespace
granularity
Permissions
+
● Set schedules
● Set rules
● Use existing
cloud accounts
+
● Add users
● Create and share
cloud accounts &
backup locations
● Create custom
roles
Building platforms with
Portworx
14
©
2022 Pure Storage, Inc.
Operator
Kubernetes
Installing Portworx
Installing Portworx deploys an Operator to run worker nodes, not on the control plane nodes
Control plane
Worker Worker
Worker
Spec based installation HELM Package manager
15
©
2022 Pure Storage, Inc.
Installing Portworx
Local storage or SAN based storage will be used to create a virtual storage pool
SSD
SSD
LUN
SSD
SSD
LUN
SSD
SSD
LUN
Storage Pool
Worker Worker
Worker
16
©
2022 Pure Storage, Inc.
Using Portworx
Application can create Persistent Volumes from the storage pool using Persistent Volume Claims
SSD
SSD
LUN
SSD
SSD
LUN
SSD
SSD
LUN
Storage Pool
Worker Worker
Worker
Replication factor 1
Replication factor 2
Replication factor 3
50G 50G 50G
For high availability you can
mirror volumes across nodes
using a replication factor,
which can be applied to the
volume or the stroage class
17
©
2022 Pure Storage, Inc.
Respond to a node failure
Application can create Persistent Volumes from the storage pool using Persistent Volume Claims
SSD
SSD
LUN
SSD
SSD
LUN
SSD
SSD
LUN
Storage Pool
Worker Worker
Worker
50G 50G 50G
Portworx integrates with the
Kubernetes scheduler to
reschedule the Pod on a
worker with a local replica
Designing a Portworx deployment
Deployment models
19
©
2022 Pure Storage, Inc.
Standard deployment
• Single Portworx and Kubernetes cluster
• Minimum of three worker nodes
• A block storage device
Worker Worker
Worker
20
©
2022 Pure Storage, Inc.
AZ 2 AZ 3
AZ 1
Worker
Worker
Worker
Multi-zone high availability (HA)
VOL
VOL VOL
Volume replica placement
Follows K8s failure
domains
Multi-zone
Kubernetes cluster
ETCD ETCD
ETCD
Worker Worker
Worker
21
©
2022 Pure Storage, Inc.
Storage Cluster
Scale and manage storage
Compute Cluster
Scale and manage compute
PWX
PWX PWX
PWX
Portworx cluster
KVDB
VOL
VOL
VOL
VOL
Disaggregated compute and storage
PVC PVC PVC
22
©
2022 Pure Storage, Inc.
Case Study: Consumer scale for Enterprise PaaS
CHALLENGE
► Scale back-office apps responsible for T-Mobile
store experience during Apple launches
SOLUTION
► Portworx Enterprise running on-prem to provide
complete data lifecycle management- provisioning,
encryption, backup, and more.
RESULTS
► Regularly withstand the launch of new Apple
products results in dramatic spike in usage Data services used:
23
©
2022 Pure Storage, Inc.
©
2022 Pure Storage, Inc.

More Related Content

What's hot

GEA-NZ v3.1 Data and Information Reference Model and Taxonomy
GEA-NZ v3.1 Data and Information Reference Model and TaxonomyGEA-NZ v3.1 Data and Information Reference Model and Taxonomy
GEA-NZ v3.1 Data and Information Reference Model and Taxonomy
Regine Deleu
 
GEA-NZ v3.1 Business Reference Model and Taxonomy
GEA-NZ v3.1 Business Reference Model and TaxonomyGEA-NZ v3.1 Business Reference Model and Taxonomy
GEA-NZ v3.1 Business Reference Model and Taxonomy
Regine Deleu
 
IT Strategy Assessment & Optimization - Catallysts Approach
IT Strategy Assessment & Optimization - Catallysts ApproachIT Strategy Assessment & Optimization - Catallysts Approach
IT Strategy Assessment & Optimization - Catallysts Approach
Rajanish Dass
 

What's hot (20)

Flipkart's Hybrid Cloud Infrastructure Strategy for Optimal Cost Efficiency a...
Flipkart's Hybrid Cloud Infrastructure Strategy for Optimal Cost Efficiency a...Flipkart's Hybrid Cloud Infrastructure Strategy for Optimal Cost Efficiency a...
Flipkart's Hybrid Cloud Infrastructure Strategy for Optimal Cost Efficiency a...
 
Oracle Cloud Infrastructure (OCI)
Oracle Cloud Infrastructure (OCI)Oracle Cloud Infrastructure (OCI)
Oracle Cloud Infrastructure (OCI)
 
4.30.19 HPE GreenLake and Cloud Technology Partners (CTP)
4.30.19 HPE GreenLake and Cloud Technology Partners (CTP)4.30.19 HPE GreenLake and Cloud Technology Partners (CTP)
4.30.19 HPE GreenLake and Cloud Technology Partners (CTP)
 
Shared services what global companies do
Shared services what global companies doShared services what global companies do
Shared services what global companies do
 
GEA-NZ v3.1 Data and Information Reference Model and Taxonomy
GEA-NZ v3.1 Data and Information Reference Model and TaxonomyGEA-NZ v3.1 Data and Information Reference Model and Taxonomy
GEA-NZ v3.1 Data and Information Reference Model and Taxonomy
 
Software AG’s webMethods Integration Cloud: Integrate Cloud Apps with ease
Software AG’s webMethods Integration Cloud: Integrate Cloud Apps with ease Software AG’s webMethods Integration Cloud: Integrate Cloud Apps with ease
Software AG’s webMethods Integration Cloud: Integrate Cloud Apps with ease
 
IT4IT - The Full Story for Digital Transformation - Part 1
IT4IT - The Full Story for Digital Transformation - Part 1IT4IT - The Full Story for Digital Transformation - Part 1
IT4IT - The Full Story for Digital Transformation - Part 1
 
Platform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on AzurePlatform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on Azure
 
5 Managed Services to Sell and How to Sell Them
5 Managed Services to Sell and How to Sell Them5 Managed Services to Sell and How to Sell Them
5 Managed Services to Sell and How to Sell Them
 
Enterprise Architecture in Strategy Deployment
Enterprise Architecture in Strategy DeploymentEnterprise Architecture in Strategy Deployment
Enterprise Architecture in Strategy Deployment
 
High Tech Digital Transformation
High Tech Digital TransformationHigh Tech Digital Transformation
High Tech Digital Transformation
 
Commvault Story - CVTSP_1.pptx
Commvault Story - CVTSP_1.pptxCommvault Story - CVTSP_1.pptx
Commvault Story - CVTSP_1.pptx
 
Customer Experience Reimagined
Customer Experience ReimaginedCustomer Experience Reimagined
Customer Experience Reimagined
 
Deloitte gov federal practice
Deloitte gov federal practiceDeloitte gov federal practice
Deloitte gov federal practice
 
GEA-NZ v3.1 Business Reference Model and Taxonomy
GEA-NZ v3.1 Business Reference Model and TaxonomyGEA-NZ v3.1 Business Reference Model and Taxonomy
GEA-NZ v3.1 Business Reference Model and Taxonomy
 
Why Solutions Fail and the Business Value of Solution Architecture
Why Solutions Fail and the Business Value of Solution ArchitectureWhy Solutions Fail and the Business Value of Solution Architecture
Why Solutions Fail and the Business Value of Solution Architecture
 
Application Value Assessment
Application Value AssessmentApplication Value Assessment
Application Value Assessment
 
IT Strategy Assessment & Optimization - Catallysts Approach
IT Strategy Assessment & Optimization - Catallysts ApproachIT Strategy Assessment & Optimization - Catallysts Approach
IT Strategy Assessment & Optimization - Catallysts Approach
 
IT4IT Framework Overview
IT4IT Framework OverviewIT4IT Framework Overview
IT4IT Framework Overview
 
Introducing the Oracle Cloud Infrastructure (OCI) Best Practices Framework
Introducing the Oracle Cloud Infrastructure (OCI) Best Practices FrameworkIntroducing the Oracle Cloud Infrastructure (OCI) Best Practices Framework
Introducing the Oracle Cloud Infrastructure (OCI) Best Practices Framework
 

Similar to stackconf 2022: Data Management in Kubernetes – Backup, DR, HA

Pivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in aziendaPivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
VMware Tanzu
 
StorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStackStorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStack
ShapeBlue
 

Similar to stackconf 2022: Data Management in Kubernetes – Backup, DR, HA (20)

Portworx 201 Customer Deck.pptx
Portworx 201 Customer Deck.pptxPortworx 201 Customer Deck.pptx
Portworx 201 Customer Deck.pptx
 
Autopilot : Securing Cloud Native Storage
Autopilot : Securing Cloud Native StorageAutopilot : Securing Cloud Native Storage
Autopilot : Securing Cloud Native Storage
 
Portworx Data Services 101 Deck.pdf
Portworx Data Services 101 Deck.pdfPortworx Data Services 101 Deck.pdf
Portworx Data Services 101 Deck.pdf
 
OpenShift 4, the smarter Kubernetes platform
OpenShift 4, the smarter Kubernetes platformOpenShift 4, the smarter Kubernetes platform
OpenShift 4, the smarter Kubernetes platform
 
Leveraging HybridMultiCloud for Devops and Automation Platform
Leveraging HybridMultiCloud for Devops and Automation PlatformLeveraging HybridMultiCloud for Devops and Automation Platform
Leveraging HybridMultiCloud for Devops and Automation Platform
 
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google CloudPSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
 
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaSOverpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
 
OpenStack and Kubernetes - A match made for Telco Heaven
OpenStack and Kubernetes - A match made for Telco HeavenOpenStack and Kubernetes - A match made for Telco Heaven
OpenStack and Kubernetes - A match made for Telco Heaven
 
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in aziendaPivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
 
Red hat cloud platforms
Red hat cloud platformsRed hat cloud platforms
Red hat cloud platforms
 
The rise of microservices
The rise of microservicesThe rise of microservices
The rise of microservices
 
The ultimate Kubernetes Deployment Checklist - Infra to Microservices
The ultimate Kubernetes Deployment Checklist - Infra to MicroservicesThe ultimate Kubernetes Deployment Checklist - Infra to Microservices
The ultimate Kubernetes Deployment Checklist - Infra to Microservices
 
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring BootSpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
 
CA Performance Manager Agility by using Docker Containers for Network Manag...
CA Performance Manager Agility by using Docker Containers for Network Manag...CA Performance Manager Agility by using Docker Containers for Network Manag...
CA Performance Manager Agility by using Docker Containers for Network Manag...
 
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid CloudVMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
 
Application Modernization with PKS / Kubernetes
Application Modernization with PKS / KubernetesApplication Modernization with PKS / Kubernetes
Application Modernization with PKS / Kubernetes
 
VMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDCVMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDC
 
Kubernetes for the VI Admin
Kubernetes for the VI AdminKubernetes for the VI Admin
Kubernetes for the VI Admin
 
StorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStackStorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStack
 
Docker Bday #5, SF Edition: Introduction to Docker
Docker Bday #5, SF Edition: Introduction to DockerDocker Bday #5, SF Edition: Introduction to Docker
Docker Bday #5, SF Edition: Introduction to Docker
 

Recently uploaded

TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
Wonjun Hwang
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 

Recently uploaded (20)

ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
الأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهلهالأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهله
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
Navigating the Large Language Model choices_Ravi Daparthi
Navigating the Large Language Model choices_Ravi DaparthiNavigating the Large Language Model choices_Ravi Daparthi
Navigating the Large Language Model choices_Ravi Daparthi
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 

stackconf 2022: Data Management in Kubernetes – Backup, DR, HA

  • 1. Miguel Rojas Cloud Architect EMEA Portworx by Pure Storage mrojas@purestorage.com @portworx @purestorage Delivering a Kubernetes data platform with Portworx
  • 2. © 2022 Pure Storage 2 Kubernetes, Containers and Companies What’s your story? Founded 2014 ‘15 ‘20 ‘17 A little history
  • 3. 3 © 2022 Pure Storage, Inc. Cloud Native is driven by Kubernetes adoption OF NEW APPS are developed in containers. 95% OF ENTERPRISES 81% OF CNCF MEMBERS 78% use Kubernetes in production. work with 2+ public cloud providers. OF GLOBAL BUSINESSES 85% will be running containers in production by 2025 (up from 35% in 2019). Source: CNCF Survey 2021
  • 4. 4 © 2022 Pure Storage, Inc. The Kubernetes stack has room to mature Which areas of the Kubernetes tech stack need to mature the most to make it easier to deploy cloud-native apps? Source: Kubernetes Adoption Survey 2021 - Portworx Ranked top three Application development frameworks Storage and data management Monitoring and observability Networking Orchestration and management 75% 68% 57% 54% 46%
  • 5. 5 © 2022 Pure Storage, Inc. Connector Approach to Container-Native Two approaches common in the industry today… Container-Native Storage Approach ”Connector” Approach Storage Array 1 Storage Array 2 CSI • 1:1 container <> volume mapping • Container capabilities vary depending on the capabilities of the underlying array • Storage arrays often are challenged by the object count (# volumes, connections) and change rate (10,000s changes/day) • Innovation limited to the features in the open CSI specification • Storage arrays managed independently from K8s Storage Array Local SSDs/HDDs Storage Pool Cloud Storage • Many (1,000s):1 container <> volume mapping • Designed to scale to 10,000s operations/day • Ensures consistent storage services across ANY infrastructure • Storage services container-granular and application consistent • Storage “encapsulated” in a container-native virtual volume that is free to move with the container • Managed as a native part of K8s Pure PSO NetApp Dell
  • 6. 6 © 2022 Pure Storage, Inc. Kubernetes key attributes MASSIVE-SCALE KUBERNETES-NATIVE PLUGGABLE ARCHITECTURE OPTIMIZED FOR MULTI-CLOUD WORLD APPLICATION CENTRIC Scales to 1,000s of nodes, 1,000s of concurrent operations per minute All platform operations should be through a consistent control plane, the Kubernetes API Able to offer a consistent control pane on heterogeneous infrastructure environments Easily swap in and out core ”infrastructure” services – networking, storage, monitoring Platform capabilities should be focused on the needs of an application first Compute Platform
  • 7. 7 © 2022 Pure Storage, Inc. Today, Portworx Is the Leading Kubernetes Data Services Platform Any App Any Distribution GKE DATABASE ANALYTICS STREAMING SEARCH/LOG AI/ML 5G/IoT Any Cloud Any Infrastructure Bare Metal Pilot Go Live Global CaaS Test/ Dev Every Stage The Kubernetes Data Services Platform PX-Store PX-Secure PX-Backup PX-DR PX-Migrate PX-Autopilot Portworx Data Services
  • 8. 8 © 2022 Pure Storage, Inc. What would you like to solve? The Kubernetes Data Services Platform PX-Store PX-Secure PX-Backup PX-DR PX-Migrate PX-Autopilot Storage, Share, Scale, Monitor Anywhere in K8s Backup and restore from, and to, anywhere DR: RTO of minutes, Minutes RPO Migrate or duplicate environments fast Auto-pilot Intelligent, performant, hyper converged self-service Storage. The Kubernetes Data Services Platform PX-Store PX-Secure PX-Backup PX-DR PX-Migrate PX-Autopilot Portworx Data Services Secure and grant storage access with RBAC and Integrations DBaaS anywhere fully managed by Portworx.
  • 9. 9 © 2022 Pure Storage, Inc. Portworx sets the gold standard for Kubernetes Storage Portworx named a Cloud-Native Data Storage & Enterprise Kubernetes Storage leader in 2021 GigaOm Radars Cloud-Native Data Storage GigaOm Radar for Cloud-Native Data Storage for Kubernetes, 2021 GigaOm Radar for Enterprise Kubernetes Storage, 2021 Enterprise Kubernetes Storage
  • 10. 10 © 2022 Pure Storage, Inc. Use case: App and Data Migrations Data centre 1 / Cloud 1 Data centre 2 / Cloud 2 Kubernetes 1 Kubernetes 2 OBJECT STORAGE ► Async data & object replication ► Snap restore based ► Scheduled or on-demand ► RPO 5 minutes ► RTO 5 minutes
  • 11. 11 © 2022 Pure Storage, Inc. Use case: Container backup & restore Application granular backup & restore App 1 App 2 1. k8s objects 2. Config 3. Data On-premises ANY Object Storage NFS – coming soon! PX-Backup App 1 App 2 App 1 App 2 Second site Cloud environment RESTORE RESTORE
  • 12. 12 © 2022 Pure Storage, Inc. Portworx Backup Namespace A AWS mysql-0 Namespace B On-Prem mongo-0 Backup Location Schedule Rules Backup Location Schedule AWS S3-A AWS S3-B Daily Hourly FB S3-A FB S3-B Weekly Monthly Developer User Type App Owner Admin ● Backup/restore their apps ● App + namespace granularity Permissions + ● Set schedules ● Set rules ● Use existing cloud accounts + ● Add users ● Create and share cloud accounts & backup locations ● Create custom roles
  • 14. 14 © 2022 Pure Storage, Inc. Operator Kubernetes Installing Portworx Installing Portworx deploys an Operator to run worker nodes, not on the control plane nodes Control plane Worker Worker Worker Spec based installation HELM Package manager
  • 15. 15 © 2022 Pure Storage, Inc. Installing Portworx Local storage or SAN based storage will be used to create a virtual storage pool SSD SSD LUN SSD SSD LUN SSD SSD LUN Storage Pool Worker Worker Worker
  • 16. 16 © 2022 Pure Storage, Inc. Using Portworx Application can create Persistent Volumes from the storage pool using Persistent Volume Claims SSD SSD LUN SSD SSD LUN SSD SSD LUN Storage Pool Worker Worker Worker Replication factor 1 Replication factor 2 Replication factor 3 50G 50G 50G For high availability you can mirror volumes across nodes using a replication factor, which can be applied to the volume or the stroage class
  • 17. 17 © 2022 Pure Storage, Inc. Respond to a node failure Application can create Persistent Volumes from the storage pool using Persistent Volume Claims SSD SSD LUN SSD SSD LUN SSD SSD LUN Storage Pool Worker Worker Worker 50G 50G 50G Portworx integrates with the Kubernetes scheduler to reschedule the Pod on a worker with a local replica
  • 18. Designing a Portworx deployment Deployment models
  • 19. 19 © 2022 Pure Storage, Inc. Standard deployment • Single Portworx and Kubernetes cluster • Minimum of three worker nodes • A block storage device Worker Worker Worker
  • 20. 20 © 2022 Pure Storage, Inc. AZ 2 AZ 3 AZ 1 Worker Worker Worker Multi-zone high availability (HA) VOL VOL VOL Volume replica placement Follows K8s failure domains Multi-zone Kubernetes cluster ETCD ETCD ETCD Worker Worker Worker
  • 21. 21 © 2022 Pure Storage, Inc. Storage Cluster Scale and manage storage Compute Cluster Scale and manage compute PWX PWX PWX PWX Portworx cluster KVDB VOL VOL VOL VOL Disaggregated compute and storage PVC PVC PVC
  • 22. 22 © 2022 Pure Storage, Inc. Case Study: Consumer scale for Enterprise PaaS CHALLENGE ► Scale back-office apps responsible for T-Mobile store experience during Apple launches SOLUTION ► Portworx Enterprise running on-prem to provide complete data lifecycle management- provisioning, encryption, backup, and more. RESULTS ► Regularly withstand the launch of new Apple products results in dramatic spike in usage Data services used:
  • 23. 23 © 2022 Pure Storage, Inc. © 2022 Pure Storage, Inc.