1. © 2019 PIVOTAL SOFTWARE, INC. All Rights Reserved. Confidential & Provided Under
NDA —Do Not Distribute. Forwarding this document outside your organization is prohibited.
K8s At Scale in The Enterprise
Self Service Through The View of Personas
Gabrielle Bufrem & Ryan Jones
October 2019

2. Kubernetes, Simple at First
VM
@gbufremsays

3. Kubernetes, Simple at First
VM
@gbufremsays

4. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

5. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

6. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

7. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

8. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

9. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

10. Kubernetes, Simple at First
VM
VM
VM
?
@gbufremsays

11. Kubernetes, Simple at First
VM
VM
VM
? ?
@gbufremsays

12. Kubernetes, Simple at First
VM
VM
VM
? ? ?
@gbufremsays

13. Kubernetes, Simple at First
VM
VM
VM
? ? ?
@gbufremsays

14. Kubernetes, Simple at First
VM
VM
VM
? ? ? ?
@gbufremsays

15. Feel Free to Walk Out If:
● If you are a small company (few teams) and don’t expect to grow
● 100% of your k8s deployments are managed by a third party (ex. AKS)
● 100% of your deployments are using an abstraction layer (ex. Pivotal
Application Service)
@gbufremsays

16. If You’re a Large Enterprise or Expect to Scale:
● Many are hybrid cloud (on-prem and public clouds)
● Dozens, hundreds, or thousands of k8s clusters
● 100s of teams
● 1000s of Devs
● 10,000s of containers

17. Kubernetes: The Silver bullet
● Brings operational efficiency to all workloads - greenfield, legacy (brownfield),
data services, etc
● Includes self healing properties to manage itself
● Ability to outsource a lot of the work to the large open source community
● Decrease or provide zero downtime of all applications/services
● Provides a consistent deployment strategy across the organization
● Abstract away the IAAS for teams and operations
● Simplify dev tools by giving direct access to Kubernetes and the tools built for it
@gbufremsays

18. It’s Not, so How do You Manage This at Scale?!
● I’m sorry to say, k8s is not a silver bullet and it calls for a different structure
● Most are keeping the same org structures and expecting them to handle the rise
in k8s
● Various options and steps to scale
@gbufremsays

19. Introduction
Gabrielle Bufrem
Manager, Product
Management
Ryan Jones
Former Product Lead
for Pivotal Container
Service (PKS)
@gbufremsays

20. Introducing More Members of The Team
People within Alana's group
manage platform services for
the application team.
Alana
@gbufremsays

21. Introducing More Members of The Team
People within Cody's group are
responsible for developing
applications and products and are
directly tied to the Line of business.
Cody
@gbufremsays

22. Day 0 - Testing of The Kubernetes Platform
Create Workloads
& Manage Legacy
Workloads
@gbufremsays

23. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
@gbufremsays

24. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

25. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

26. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

27. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

28. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

29. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

30. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

31. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

32. And More Members of the Team!
Naomi
People within Naomi's group are
responsible for containerizing and
deploying workloads
@gbufremsays

33. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

34. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

35. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

36. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
NaomiCharlie
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

37. Last Member of The Team!
Charlie
People within Charlie's group are
responsible for deploying and
managing Kubernetes clusters
@gbufremsays

38. Day 2 - Production @ Scale
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
NaomiCharlie
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

39. Day 2 - Production @ Scale
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Naomi
Charlie
Platform
Management
(IAAS, VMs, k8s)
Deploy Workloads
to Namespaces
Containerize
Workloads
Automation
@gbufremsays

40. Day 2 - Production @ Scale - Winnie-the-Pooh Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Charlie
Platform
Management
(IAAS, VMs, k8s)
Containerize
Workloads
Deploy Workloads
to Namespaces
Automation
@gbufremsays

41. Day 2 - Production @ Scale - Winnie-the-Pooh Option
Alana
Charlie
Cody
Charlie Charlie
Cody Cody Cody Cody Cody
Line of Business Line of Business
@gbufremsays

42. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
Containerize
Workloads
Deploy Workloads
to Namespaces
Automation
@gbufremsays
Charlie

43. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
Containerize and
Deploy Workloads
Automation
@gbufremsays

44. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

45. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
Deploy & Manage
K8s Clusters
Containerize and
Deploy Workloads
Automation
@gbufremsays

46. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
Containerize and
Deploy Workloads
Deploy &
Manage
K8s
Clusters
Automation & Abstraction
@gbufremsays

47. @gbufremsays

48. AUTOMATION TEAMS
● Automate as much as
possible
● Add abstraction layers to
manage K8s
● K8s is much harder to
manage than people
expect
● You need self service &
org structure changes to
scale
● Shared Kubernetes
expertise: the division,
specialization and
distribution of expertise;
reducing overhead -
“move it to the right”
Key Takeaways
@gbufremsays

49. Thank You!
© 2019 PIVOTAL SOFTWARE, INC. All Rights Reserved. Confidential & Provided Under
NDA —Do Not Distribute. Forwarding this document outside your organization is prohibited.