How we run one of our k8s clusters (over esxi)

1. ||
ETHZ
SIS Project Presentation Meeting, 12 September 2019
Nicolas Kowenski
High Performance Computing Group, Scientific IT Services, ETH Zurich
Nicolas Kowenski | 2019-09-12 | 1
Kubernetes @ HPC

2. ||
Why?
▪ We need to run some services outside the HPC cluster(s)
▪ Large amount of standalone VM’s (one per service)
▪ Leonhard introduces multi-tenancy. Even more services are needed
Nicolas Kowenski | 2019-09-12 | 2

3. ||
How we tackle that?
▪ High availability
▪ Fault tolerant
▪ Improve resource utilization
▪ Manage one cluster vs multiple servers (logs, metrics, alerts)
Kubernetes
Nicolas Kowenski | 2019-09-12 | 3

4. ||
Approach? GitOps
Declarative, version controlled way to define the infrastructure.
▪ git pull && cdist config → create kubernetes cluster
▪ git pull && helmfile sync → deploy an application
▪ CI integration with GitLabCI: git push → build, test, push, deploy
Nicolas Kowenski | 2019-09-12 | 4

5. ||
yeah ok, but.. how is this working?
HPC Admin Kubernetes V1.15 cluster implementation.
Nicolas Kowenski | 2019-09-12 | 5

6. ||
Questions?
▪ Speak now or forever hold your peace. or:
▪ chat-support channel at ETH-SIS team.
▪ @nico at
▪ nicolas.kowenski@id.ethz.ch
Nicolas Kowenski | 2019-09-12 | 9
The name Kubernetes originates from Greek,
meaning helmsman or pilot oder Steuermann.
Google open-sourced the Kubernetes project in
2014