Daho.am meetup Side Event - Kubernetes Evolution @ABI

1. Kubernetes Platform Evolution at
Audi Business Innovation
A simple story by Ovidiu Hutuleac
Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18

2. An unexpected journey
Oct ‘16
Kubernetes
PoC on AWS
Jan ‘2017
500+ containers
1 Man Power Apr ‘18
Outage Strikes
Because of
Cluster Upgrade
Jan ‘18
1000+ containers
60+ dev teams
30+ incidents/month
2 Men Power
May ‘18
2nd Outage Strikes
Because of
Romana CNI
Apr ‘16
Plain EC2 + Docker
Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18
?

3. What went wrong?
* no dev-stage-prod pipeline
* not saving the stuff in Git
* missing standards
Ad-hoc Deployment
strategy
* we did had backups for data
* but no backup for
cluster/apps configuration
* no team communication
strategy
No Recovery Plan
* Doing to many stuff with
small amount of people
* doing urgent stuff instead of
important work
* starting new products before
finishing the existing ones
Bad prioritization
Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18

4. Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18

5. Learnings
Choose to do important stuff and commit to it.
➔ Recovery Plan
Build a Recovery/Rollback Plan in case
of failures
➔ GitOps with Helm deployment
Save everything in Git and use Helm to
deploy the applications
➔ People
Listen to feedback, share knowledge and
commit to what is decided

6. MonitoringIngress/NetTiller
Apps/Deployments/Config
IaaS, Terraform, Kubernetes
How did we implement backup/recovery?
Admin
Sandbox
Git Secrets Backup
Data (EFS/EBS)
MonitoringIngress/NetTiller
Data (EFS/EBS)
IaaS, Terraform, Kubernetes
Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18
Configuration
Data
Backup (S3/Snapshot)
Configuration
Data
Backup (S3/Snapshot)
Apps/Deployments/Configrestore

7. Where should Which deployments run?
> kubectl config set-context <kube-context>
> helm install -f values.yaml --namespace <ns> --name <app-name> <repo-name>/<chart-name>
Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18
MonitoringIngress/NetTiller
Apps/Deployments/Config
Data (EFS/EBS)
IaaS, Terraform, Kubernetes
Admin
Sandbox
Git Secrets

8. Takeaways
What to start with ?
➔ Cloud environment
Don’t spend too much time to fix, just
throw it away and build a new one
➔ GitOps
Git is your Single Point of Truth
➔ Basics
Ensure the basics first and be aware of
the bad prioritization
➔ People Mindset
Invest in People Skills

9. An organization’s greatest asset is NOT the
People...
Source: Todd Davis | FranklinCovey
Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18
but the relationships between its people (their
ability to build and sustain great working
relationships)

10. Daho.am Meetup @ Audi Business Innovation GmbH - 23rd July ‘18
When you are vulnerable,
you are learning the most!

11. Thank you !
-> Q/A
Audi Business Innovation GmbH

12. #agile
bravecompetencies
collaborative
responsible
pragmatic
Open-minded
entrepreneurial
ABI
GmbH#203 People
» Average Age #34,7
» 19 nationalities
#karriere.audibusinessinnovation.com
ovidiuhutuleac
ovidiu.hutuleac@gmail.com
Daho.am Meetup - 23rd July ‘18
Audi Business Innovation GmbH