Slides from talk at Kubernetes London meetup on thoughts having worked on Kubernetes Operators

2. The teamThe teamThe team

4. Kubeflow pipeline
azure-databricks-operator
Kubernetes cluster
Azure Databricks
Run

5. Pod starts at 16:30
16:20 16:30 16:40
Cron job to start at 16:30 – have available nodes in cluster

6. Pod starts at 16:35
16:20 16:30 16:40
Cron job to start at 16:30 – wait for node scaling
Node scaling

7. Pod starts at 16:30
16:20 16:30 16:40
Cron job to start at 16:25 – wait for node scaling
Node scaling

8. Pod starts at 16:28
16:20 16:30 16:40
Cron job to start at 16:25 – wait for node scaling
Node scaling

9. Pod starts at 16:30Init container waits
16:20 16:30 16:40
Cron job to start at 16:20 – wait for node scaling and block with init container
Node scaling

10. The Reconcile loop

11. Custom Resource Definition (CRD) ‘Thing’
https://en.wikipedia.org/wiki/
Corrugated_box_design
Operator

12. Don’t block the reconciler
https://www.flickr.com/photos/40119308@N05/7611666272/

14. Multiple parallel reconcilers
https://www.flickr.com/photos/sharif/2423144088/

15. Configuring…

16. Metrics
https://www.flickr.com/photos/smemon/14618772953/

20. Use events

21. Retry back-offs

22. Interacting with the world
https://www.flickr.com/photos/beeveephoto/33630895864/

23. Open Policy Agent

24. Kubeflow pipeline
azure-databricks-operator
Kubernetes cluster
Azure Databricks
Run
Validate cluster spec based on namespace
Inject cost centre tags by namespace

25. https://www.flickr.com/photos/jakubsteiner/2717493657/