Scylla Kubernetes support is long anticipated. Powered by Kubernetes, Scylla becomes easy to manage. Scale out, rolling upgrade, automatic configuration change in canary deployment style and so forth. The talk will demonstrate Scylla Operator 1.0 and go over its supported feature set and describe the roadmap ahead.

1. Scylla Operator 1.0
Maciej Zimnoch

2. Maciej Zimnoch
Software Engineer
■ Go, C++ and coffee enthusiast
■ Proud member of Scylla Manager and Scylla Operator teams
2

3. Scylla Operator 1.0
3

4. Scylla Operator
Open source:
https://github.com/scylladb/scylla-operator
Documentation:
https://scylladb.github.io/scylla-operator/master/
Runs on:
Minikube, Google Kubernetes Engine (GKE)
Apache 2.0 licensed
4

5. Architecture
5

6. Features
6

7. Feature set
▪ Scaling operations
▪ Rolling config change
▪ Rolling Scylla upgrades
▪ Auto healing
▪ Multi AZ support
▪ Repair
▪ Backup
▪ Multi cluster support
and more...
7

8. Scaling operations
8

9. Scaling operations
9
I would like to scale my
cluster to 6 nodes
Spec:
us-east-1: 3 members
Status:
us-east-1: 3 members 3 ready members
10.0.0.2
10.0.0.310.0.0.4

10. Scaling operations
10
Spec:
us-east-1: 6 members
Status:
us-east-1: 3 members 3 ready members
10.0.0.4 10.0.0.3
10.0.0.2

11. Scaling operations
11
Spec:
us-east-1: 6 members
Status:
us-east-1: 4 members 3 ready members
10.0.0.5
10.0.0.4 10.0.0.3
10.0.0.2

12. Scaling operations
12
Spec:
us-east-1: 6 members
Status:
us-east-1: 4 members 4 ready
members
10.0.0.5
10.0.0.4 10.0.0.3
10.0.0.2

13. Scaling operations
13
Spec:
us-east-1: 6 members
Status:
us-east-1: 5 members 4 ready members
10.0.0.6
10.0.0.4 10.0.0.3
10.0.0.2
10.0.0.5

14. Scaling operations
14
Spec:
us-east-1: 6 members
Status:
us-east-1: 5 members 5 ready
members
10.0.0.6
10.0.0.4 10.0.0.3
10.0.0.2
10.0.0.5

15. Scaling operations
15
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 5 ready members
10.0.0.7
10.0.0.4 10.0.0.3
10.0.0.2
10.0.0.5 10.0.0.6

16. Scaling operations
16
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready
members
😊
10.0.0.4 10.0.0.3
10.0.0.2
10.0.0.5 10.0.0.6
10.0.0.7

17. Rolling config change
17

18. Rolling config change
18
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready members
I changed config,
please rollout the
change

19. Rolling config change
19
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 5 ready
members

20. Rolling config change
20
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready
members
💡

21. Rolling config change
21
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 5 ready
members
💡

22. Rolling config change
22
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready
members
💡
💡

23. Rolling config change
23
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 5 ready
members
💡
💡

24. Rolling config change
24
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready
members
💡
💡
💡

25. Rolling config change
25
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 5 ready
members
💡
💡
💡

26. Rolling config change
26
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready
members
💡
💡
💡
💡

27. Rolling config change
27
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 5 ready
members
💡
💡
💡
💡

28. Rolling config change
28
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready
members
💡
💡
💡
💡
💡

29. Rolling config change
29
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 5 ready
members
💡
💡
💡
💡
💡

30. Rolling config change
30
Spec:
us-east-1: 6 members
Status:
us-east-1: 6 members 6 ready
members
💡
💡
💡
💡
💡
💡

31. Rolling Scylla upgrade
31

32. Rolling Scylla upgrade
32
kind: ScyllaCluster
spec:
version: 4.2.0
agentVersion: 2.2.0
datacenter:
name: us-east-1
racks:
- name: us-east-1a
▪ Automatic major/minor/patch version
upgrade

33. Rolling Scylla upgrade
33
For each node
▪ Drain node
▪ Backup data
▪ Update image
▪ Validate

34. Auto healing
34

35. Auto healing
35
Node 1
scylla-0
10.0.0.2
Node 2
scylla-1
10.0.0.3
Node 3
scylla-2
10.0.0.4
Node 4
10.0.0.5
Spec:
3 members
Status:
3 ready members

36. Auto healing
36
Node 1
scylla-0
10.0.0.2
Node 2
scylla-1
10.0.0.3
Node 3
scylla-2
10.0.0.4
Node 4
10.0.0.5
Spec:
3 members
Status:
2 ready members
Failure!

37. Auto healing
37
Node 1
scylla-0
10.0.0.2
Node 2
scylla-1
10.0.0.3
Node 3
scylla-2
10.0.0.4
Node 4
10.0.0.5
replace node 10.0.0.3
Spec:
3 members
Status:
2 ready members
Failure!

38. Auto healing
38
Node 1
scylla-0
10.0.0.2
Node 2
scylla-1
10.0.0.3
Node 3
scylla-2
10.0.0.4
Node 4
10.0.0.5
scylla-1
stream
data
Spec:
3 members
Status:
2 ready members
Failure!

39. Auto healing
39
Node 1
scylla-0
10.0.0.2
Node 2
scylla-1
10.0.0.3
Node 3
scylla-2
10.0.0.4
Node 4
10.0.0.5
scylla-1
Spec:
3 members
Status:
3 ready members
Failure!

40. Repair and backup
40

41. Repair
41
kind: ScyllaCluster
spec:
repairs:
- name: "weekly us-east-1 repair"
intensity: 2
interval: "7d"
keyspaces: ["user_sessions"]
backups:
- name: "weekly full cluster backup"
rateLimit: 100
location: ["gcs:cluster-backups"]
interval: "7d"
Scylla Manager Scylla Manager Agent

42. Backup
42
Scylla Manager Scylla Manager Agent
AWS S3 Google Cloud Storage
kind: ScyllaCluster
spec:
repairs:
- name: "weekly us-east-1 repair"
intensity: 2
interval: "7d"
keyspaces: ["user_sessions"]
backups:
- name: "weekly full cluster backup"
rateLimit: 100
location: ["gcs:cluster-backups"]
interval: "7d"

43. Multi-AZ support
43

44. Multi-AZ support
44
Scylla Operator
Rack us-east-1a Rack us-east-1b Rack us-east-1c
us-east-1 us-east-1 us-east-1

45. Multi-cluster support
45

46. Multi-cluster support
46
Scylla Operator
Cluster A
Cluster B

47. Demo
47

48. Future work
▪ Automatic restore when version upgrade fails
▪ Replace live node
▪ Replace seed node
▪ Multi region support
▪ More performance related improvements
▪ Support more K8s platforms
and more...
48

49. Thank You
scylla-operator@scylladb.com
Maciej Zimnoch
maciej@scylladb.com