This document provides an overview of an open-source Linux KVM backup project. It discusses the goal of developing an in-house backup solution for migrating production systems to KVM from other hypervisors. The backup solution is built using BORG, Python, Docker, and utilizes KVM snapshots, asynchronous tasks with Celery, and a web dashboard. It allows for incremental backups to a storage-agnostic backend with storage efficiency and reduced load. A demo is shown of backing up and restoring files on a VM to simulate data recovery. Future plans include one-click deployment, integration with Cloudstack, and file-level restores.

1. Open-source
Linux KVM backupproject

2. About Us
Project overview (Goal, features)
Technologies
Demo
What’s next
2
Tableof content

3. DIMSI
Is a dev. Company created in 2006, 35 people in 2022
Offices in Paris, Lorient and Sousse (Tunisia)
Provides services to our customers using Cloudstack IAAS platform
Provides Cloudstack features through a dedicated portal
3
About Us
Joffrey Luangsaysana
j.luangsaysana@dimsi.fr
Compute, Storage and network
Quentin Roccia
q.roccia@dimsi.fr
Devops, Python and network
Grégoire Lamodière
g.lamodiere@dimsi.fr
Co-founder, Cloud builder

4. Project history
Want to migrate from different Hypervisor to KVM for many years
All attempts were stopped by a lack of professionnel and efficient
backup solution
2021 -> decision is made to move our production to KVM and
develop a in house backup solution (fast, reliable, affordable)
2022 -> open-sourcing this project and move to the next-level
4
Projectoverview

5. Features
VM’s backup on a forever incremental way
Storage efficiency
Reduce load
No agent installation on VMs
Backend Storage-agnostic
APIs to access features
Provide a nice Front-end to define backup strategy
5
Projectoverview

6. Backup solution build on top of the following technologies
BORG
Python (FastAPI / Celery)
Docker
And, of course, KVM :)
One frontend and one backend, built as docker images
Asynchronous task queuing thanks to Celery / Flower
Web dashboard to track and monitor backup tasks in real time
6
Technologies

7. 7
Architecture

8. 8
Architecture
Backend
Task
Celery
Task
Task
KVM Host 1
KVM Host n
NFS Backup
Cliquez pour ajouter du
texte

9. 9
Backup/ restoreflow
Backup is made using virsh and snapshot capabilities
Incremental since last backup
Command : virsh snapshot-create-as
Exported to a borg repo
Command: virsh blockcommit + virsh snapshot-delete
Manage the retention using borg prune
Restore is made with borg extract

10. Scenario
Creation of files simulating important data on a selected VM
Backing up the virtual machine with these files
Deleting files to simulate data loss
Restore the disk of the affected VM
Check if everything is back on track
10
Demo

11. Release project as open-sourced
Receipt of opinions/suggestions
Provide new features
One-click deployment
Full integration to Cloudstack (backup api / as a module ? )
File-level restore
Any other important features for the community
Quality process
Industrialize testing process
Test on other hardware
Market the project
Project website
Create and federate a community of developpers and users
11
What’s next?

12. THANK YOU
ANY QUESTIONS?