The document discusses the implementation of Kubernetes (k8s) at scale within enterprise environments, focusing on the perspective of different personas involved in the process. It highlights the operational efficiencies k8s can bring, along with the challenges that organizations face when scaling, such as the need for structural changes and increased expertise. The authors emphasize that while k8s offers significant benefits, it is not a one-size-fits-all solution and requires careful management and adaptation to be effectively utilized.

1. © 2019 PIVOTAL SOFTWARE, INC. All Rights Reserved. Confidential & Provided Under
NDA —Do Not Distribute. Forwarding this document outside your organization is prohibited.
K8s At Scale in The Enterprise
Self Service Through The View of Personas
Gabrielle Bufrem & Ryan Jones
October 2019

2. Kubernetes, Simple at First
VM
@gbufremsays

3. Kubernetes, Simple at First
VM
@gbufremsays

4. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

5. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

6. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

7. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

8. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

9. Kubernetes, Simple at First
VM
VM
VM
@gbufremsays

10. Kubernetes, Simple at First
VM
VM
VM
?
@gbufremsays

11. Kubernetes, Simple at First
VM
VM
VM
? ?
@gbufremsays

12. Kubernetes, Simple at First
VM
VM
VM
? ? ?
@gbufremsays

13. Kubernetes, Simple at First
VM
VM
VM
? ? ?
@gbufremsays

14. Kubernetes, Simple at First
VM
VM
VM
? ? ? ?
@gbufremsays

15. Feel Free to Walk Out If:
● If you are a small company (few teams) and don’t expect to grow
● 100% of your k8s deployments are managed by a third party (ex. AKS)
● 100% of your deployments are using an abstraction layer (ex. Pivotal
Application Service)
@gbufremsays

16. If You’re a Large Enterprise or Expect to Scale:
● Many are hybrid cloud (on-prem and public clouds)
● Dozens, hundreds, or thousands of k8s clusters
● 100s of teams
● 1000s of Devs
● 10,000s of containers

17. Kubernetes: The Silver bullet
● Brings operational efficiency to all workloads - greenfield, legacy (brownfield),
data services, etc
● Includes self healing properties to manage itself
● Ability to outsource a lot of the work to the large open source community
● Decrease or provide zero downtime of all applications/services
● Provides a consistent deployment strategy across the organization
● Abstract away the IAAS for teams and operations
● Simplify dev tools by giving direct access to Kubernetes and the tools built for it
@gbufremsays

18. It’s Not, so How do You Manage This at Scale?!
● I’m sorry to say, k8s is not a silver bullet and it calls for a different structure
● Most are keeping the same org structures and expecting them to handle the rise
in k8s
● Various options and steps to scale
@gbufremsays

19. Introduction
Gabrielle Bufrem
Manager, Product
Management
Ryan Jones
Former Product Lead
for Pivotal Container
Service (PKS)
@gbufremsays

20. Introducing More Members of The Team
People within Alana's group
manage platform services for
the application team.
Alana
@gbufremsays

21. Introducing More Members of The Team
People within Cody's group are
responsible for developing
applications and products and are
directly tied to the Line of business.
Cody
@gbufremsays

22. Day 0 - Testing of The Kubernetes Platform
Create Workloads
& Manage Legacy
Workloads
@gbufremsays

23. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
@gbufremsays

24. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

25. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

26. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

27. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

28. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

29. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

30. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

31. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

32. And More Members of the Team!
Naomi
People within Naomi's group are
responsible for containerizing and
deploying workloads
@gbufremsays

33. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

34. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

35. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

36. Day 1 - Pre-Production / Production
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
NaomiCharlie
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

37. Last Member of The Team!
Charlie
People within Charlie's group are
responsible for deploying and
managing Kubernetes clusters
@gbufremsays

38. Day 2 - Production @ Scale
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
NaomiCharlie
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

39. Day 2 - Production @ Scale
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Naomi
Charlie
Platform
Management
(IAAS, VMs, k8s)
Deploy Workloads
to Namespaces
Containerize
Workloads
Automation
@gbufremsays

40. Day 2 - Production @ Scale - Winnie-the-Pooh Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Charlie
Platform
Management
(IAAS, VMs, k8s)
Containerize
Workloads
Deploy Workloads
to Namespaces
Automation
@gbufremsays

41. Day 2 - Production @ Scale - Winnie-the-Pooh Option
Alana
Charlie
Cody
Charlie Charlie
Cody Cody Cody Cody Cody
Line of Business Line of Business
@gbufremsays

42. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
Containerize
Workloads
Deploy Workloads
to Namespaces
Automation
@gbufremsays
Charlie

43. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Platform
Management
(IAAS, VMs, k8s)
Containerize and
Deploy Workloads
Automation
@gbufremsays

44. Day 0 - Testing of The Kubernetes Platform
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Deploy & Manage
K8s Clusters
Deploy Workloads
to Namespaces
Containerize
Workloads
Naomi
Platform
Management
(IAAS, VMs, k8s)
@gbufremsays

45. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
Deploy & Manage
K8s Clusters
Containerize and
Deploy Workloads
Automation
@gbufremsays

46. Day 2 - Production @ Scale - Poolside Option
Cody
Create Workloads
& Manage Legacy
Workloads
Alana
Platform
Management
(IAAS, VMs, k8s)
Containerize and
Deploy Workloads
Deploy &
Manage
K8s
Clusters
Automation & Abstraction
@gbufremsays

47. @gbufremsays

48. AUTOMATION TEAMS
● Automate as much as
possible
● Add abstraction layers to
manage K8s
● K8s is much harder to
manage than people
expect
● You need self service &
org structure changes to
scale
● Shared Kubernetes
expertise: the division,
specialization and
distribution of expertise;
reducing overhead -
“move it to the right”
Key Takeaways
@gbufremsays

49. Thank You!
© 2019 PIVOTAL SOFTWARE, INC. All Rights Reserved. Confidential & Provided Under
NDA —Do Not Distribute. Forwarding this document outside your organization is prohibited.