Integrating Backup Into Your GitOps
CI/CD Pipeline
Michael Cade
Senior Global Technologist
Kasten by Veeam
@MichaelCade1
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Continuous Integration / Deployment / Delivery
Code
ContinuousIntegration
Build Test
Release
ContinuousDeployment
Update Deploy
Staging
Production
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
The Need for Backup!
Persistent
Volume
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
It’s All about the DATA!
Brings back
Kubernetes Objects
& Configuration
Persistent data is
not captured in
version control!
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
It’s All about the DATA!
Persistent
Volume
Any persistent data or volumes used by
applications are not captured in version
control
Example: any stateful service, such as a
relational database or NoSQL system
Requires the entire application stack
including the data!
Data, and the dependencies of the stack on
the data be discovered, tracked, and
captured.
ActionSet
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Continuous Delivery – Scenario
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Adding Data - Scenario
Data added from external
source.
Users | Customers etc
Update
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Continuous Delivery – Scenario
Update
ConfigMap
Something that
can modify our
data
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Data Changes - Scenario
Mistakes were made!
Update
Dropped table or
some other
failure scenario!
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Solution: Implement Backup - Scenario
Update
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Solution: Data Recovery - Scenario
Update
Recovery from
backup into our
database
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
After Recovery, Fix Mistakes - Scenario
Fix Mistakes
Update
Kanister
Execution Walkthrough
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Execution Walkthrough
Controller
Blueprint
Database
Workload
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Execution Walkthrough
ActionSet
Controller
Blueprint
Database
Workload
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Execution Walkthrough
ActionSet
Controller
Blueprint
Database
Workload
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Execution Walkthrough
ActionSet
Controller
Blueprint
Kanister
Function
Database
Workload
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Execution Walkthrough
ActionSet
Controller
Blueprint
Kanister
Function
Database
Workload
Object Storage/
Cloud Snapshot
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Execution Walkthrough
ActionSet
Controller
Blueprint
Database
Workload
Object Storage/
Cloud Snapshot
Demo
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Roadmap / New Futures
1. File store destinations for backups
2. Encryption, deduplication and compression support with kando
3. Kanister functions to manage data in Data Service Operators like K8ssandra
© 2022 Kasten by V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners.
Next Steps
Closing
Please look at the project
Feedback & Contributions
Spread the word
An extensible open-source framework for
application-level data management on
Kubernetes

Mc git ops_incorpbackups_kanister

  • 1.
    Integrating Backup IntoYour GitOps CI/CD Pipeline Michael Cade Senior Global Technologist Kasten by Veeam @MichaelCade1
  • 2.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Continuous Integration / Deployment / Delivery Code ContinuousIntegration Build Test Release ContinuousDeployment Update Deploy Staging Production
  • 3.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. The Need for Backup! Persistent Volume
  • 4.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. It’s All about the DATA! Brings back Kubernetes Objects & Configuration Persistent data is not captured in version control!
  • 5.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. It’s All about the DATA! Persistent Volume Any persistent data or volumes used by applications are not captured in version control Example: any stateful service, such as a relational database or NoSQL system Requires the entire application stack including the data! Data, and the dependencies of the stack on the data be discovered, tracked, and captured. ActionSet
  • 6.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Continuous Delivery – Scenario
  • 7.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Adding Data - Scenario Data added from external source. Users | Customers etc Update
  • 8.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Continuous Delivery – Scenario Update ConfigMap Something that can modify our data
  • 9.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Data Changes - Scenario Mistakes were made! Update Dropped table or some other failure scenario!
  • 10.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Solution: Implement Backup - Scenario Update
  • 11.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Solution: Data Recovery - Scenario Update Recovery from backup into our database
  • 12.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. After Recovery, Fix Mistakes - Scenario Fix Mistakes Update
  • 13.
  • 14.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Execution Walkthrough Controller Blueprint Database Workload
  • 15.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Execution Walkthrough ActionSet Controller Blueprint Database Workload
  • 16.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Execution Walkthrough ActionSet Controller Blueprint Database Workload
  • 17.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Execution Walkthrough ActionSet Controller Blueprint Kanister Function Database Workload
  • 18.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Execution Walkthrough ActionSet Controller Blueprint Kanister Function Database Workload Object Storage/ Cloud Snapshot
  • 19.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Execution Walkthrough ActionSet Controller Blueprint Database Workload Object Storage/ Cloud Snapshot
  • 20.
  • 21.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Roadmap / New Futures 1. File store destinations for backups 2. Encryption, deduplication and compression support with kando 3. Kanister functions to manage data in Data Service Operators like K8ssandra
  • 22.
    © 2022 Kastenby V eeam.All rights reserv ed.A ll trademarks are the property of their respectiv e owners. Next Steps
  • 23.
    Closing Please look atthe project Feedback & Contributions Spread the word An extensible open-source framework for application-level data management on Kubernetes