The document discusses Kubernetes and container orchestration. It begins with an introduction to the problem of managing containers and microservices across multiple machines. It then covers key Kubernetes concepts like pods, controllers, services, labels and selectors. It also demonstrates Kubernetes in action and discusses options for hosting Kubernetes clusters, particularly Google Container Engine which provides a hosted Kubernetes environment.

1. ‹#›
@tpryan
Terrence Ryan
Developer Advocate
Containing Chaos
with Kubernetes

2. ‹#›
@tpryan
Who are you?

3. ‹#›
@tpryan
01 Introduction
Why Kubernetes?

4. ‹#›
@tpryan
What problem are
we trying to solve?

5. ‹#›
@tpryan
# FRONTEND AND SERVICES
FROM nginx-php-fpm
COPY nginx.conf /etc/nginx/nginx.conf
ADD www /var/www/

6. ‹#›
@tpryan
# BACKEND
FROM ubuntu:12.04
ADD ./mysql-setup.sh /tmp/mysql-setup.sh
RUN /bin/sh /tmp/mysql-setup.sh
EXPOSE 3306
CMD ["/usr/sbin/mysqld"]

7. ‹#›
@tpryan

8. ‹#›
@tpryan

9. ‹#›
@tpryan

10. ‹#›
@tpryan
# FRONTEND AND SERVICES
FROM nginx-php-fpm
COPY nginx.conf /etc/nginx/nginx.conf
ADD www /var/www/

11. ‹#›
@tpryan
# FRONTEND AND SERVICES
FROM nginx-php-fpm
COPY nginx.conf /etc/nginx/nginx.conf
ADD www /var/www/
# JUST SERVICES
FROM nginx-php-fpm
COPY nginx.conf /etc/nginx/nginx.conf
ADD www /var/www/

12. ‹#›
@tpryan
# FRONTEND AND SERVICES
FROM nginx-php-fpm
COPY nginx.conf /etc/nginx/nginx.conf
ADD www /var/www/

13. ‹#›
@tpryan
# FRONTEND AND SERVICES
FROM nginx-php-fpm
COPY nginx.conf /etc/nginx/nginx.conf
ADD www /var/www/
# FRONTEND
FROM nginx
COPY nginx.conf /etc/nginx/nginx.conf
ADD www /var/www/

14. ‹#›
@tpryan

15. ‹#›
@tpryan

16. ‹#›
@tpryan
# BACKEND
FROM ubuntu:12.04
ADD ./mysql-setup.sh /tmp/mysql-setup.sh
RUN /bin/sh /tmp/mysql-setup.sh
EXPOSE 3306
CMD ["/usr/sbin/mysqld"]

17. ‹#›
@tpryan
# BACKEND
FROM ubuntu:12.04
ADD ./mysql-setup.sh /tmp/mysql-setup.sh
RUN /bin/sh /tmp/mysql-setup.sh
EXPOSE 3306
CMD ["/usr/sbin/mysqld"]
# BACKEND
FROM ubuntu:12.04
ADD ./mysql-setup.sh /tmp/mysql-setup.sh
RUN /bin/sh /tmp/mysql-setup.sh
EXPOSE 3306
VOLUME ["/etc/mysql", "/var/lib/mysql"]
CMD ["/usr/sbin/mysqld"]

18. ‹#›
@tpryan

19. ‹#›
@tpryan

20. ‹#›
@tpryan

21. ‹#›
@tpryan

22. ‹#›
@tpryan

23. ‹#›
@tpryan

24. ‹#›
@tpryan

25. ‹#›
@tpryan

26. ‹#›
@tpryan

27. ‹#›
@tpryan

28. ‹#›
@tpryan
That’s a lot to manage.

29. ‹#›
@tpryan

30. ‹#›
@tpryan
4 3 2

31. ‹#›
@tpryan
02 Concepts
What is Kubernetes?

32. ‹#›
@tpryan
Desired State

33. ‹#›
@tpryan
Build Script

34. ‹#›
@tpryan
Build Script
./create_docker_images.sh

35. ‹#›
@tpryan
Build Script
./create_docker_images.sh
./launch_frontend.sh x 3

36. ‹#›
@tpryan
Build Script
./create_docker_images.sh
./launch_frontend.sh x 3
./launch_services.sh x 2

37. ‹#›
@tpryan
Build Script
./create_docker_images.sh
./launch_frontend.sh x 3
./launch_services.sh x 2
./launch_backend.sh x 1

38. ‹#›
@tpryan
Build Script
./create_docker_images.sh
./launch_frontend.sh x 3
./launch_services.sh x 2
./launch_backend.sh x 1

39. ‹#›
@tpryan
Build Script
./create_docker_images.sh
./launch_frontend.sh x 3
./launch_services.sh x 2
./launch_backend.sh x 1

40. ‹#›
@tpryan
Build Script
./create_docker_images.sh
./launch_frontend.sh x 3
./launch_services.sh x 2
./launch_backend.sh x 1

41. ‹#›
@tpryan
Desired State
There should be:
3 Frontends
2 Services
1 Backend

42. ‹#›
@tpryan
Desired State
There should be:
3 Frontends
2 Services
1 Backend

43. ‹#›
@tpryan
Desired State
There should be:
3 Frontends
2 Services
1 Backend

44. ‹#›
@tpryan
Pods
• Atomic component of Kubernetes
• Made from one or more containers
• It’s okay to have just one container
• Share
• IP Address
• Namespace
• Examples
• Webserver + CMS
• All Web available services
• Converting an all in one box

45. ‹#›
@tpryan
Containers
• Subatomic particles of Kubernetes
• Dockerfiles just like you are used to.

46. ‹#›
@tpryan
Controllers
• Handle turning current state into desired state
• Example
• Replication Controllers

47. ‹#›
@tpryan
Controllers
• Handle turning current state into desired state
• Example
• Replication Controllers
Observe

48. ‹#›
@tpryan
Controllers
• Handle turning current state into desired state
• Example
• Replication Controllers
Observe
Act

49. ‹#›
@tpryan
Controllers
• Handle turning current state into desired state
• Example
• Replication Controllers
Observe
Diff
Act

50. ‹#›
@tpryan
Service
• Defines a set of pods that work together for a
common purpose
• Gets a virtual IP address
• Used for exposing an application to non
Kubernetes clients
Virtual IP address

51. ‹#›
@tpryan
Labels & Selectors
• Metadata for Objects
• Select sections of your infrastructure
App
Tier
Env
todo
frontend
stage
App
Tier
Env
todo
frontend
prod
App
Tier
Env
todo
frontend
dev
App
Tier
Env
todo
frontend
test
App
Tier
Env
todo
api
prod
App
Tier
Env
todo
backend
prod
App
Tier
Env
todo
api
stage
App
Tier
Env
todo
api
test
App
Tier
Env
todo
api
dev
App
Tier
Env
todo
backend
stage
App
Tier
Env
todo
backend
test
App
Tier
Env
todo
backend
dev

52. ‹#›
@tpryan
Labels & Selectors
• Metadata for Objects
• Select sections of your infrastructure
App
Tier
Env
todo
frontend
stage
App
Tier
Env
todo
frontend
prod
App
Tier
Env
todo
frontend
dev
App
Tier
Env
todo
frontend
test
App
Tier
Env
todo
api
prod
App
Tier
Env
todo
backend
prod
App
Tier
Env
todo
api
stage
App
Tier
Env
todo
api
test
App
Tier
Env
todo
api
dev
App
Tier
Env
todo
backend
stage
App
Tier
Env
todo
backend
test
App
Tier
Env
todo
backend
dev

53. ‹#›
@tpryan
Labels & Selectors
• Metadata for Objects
• Select sections of your infrastructure
App
Tier
Env
todo
frontend
stage
App
Tier
Env
todo
frontend
prod
App
Tier
Env
todo
frontend
dev
App
Tier
Env
todo
frontend
test
App
Tier
Env
todo
api
prod
App
Tier
Env
todo
backend
prod
App
Tier
Env
todo
api
stage
App
Tier
Env
todo
api
test
App
Tier
Env
todo
api
dev
App
Tier
Env
todo
backend
stage
App
Tier
Env
todo
backend
test
App
Tier
Env
todo
backend
dev

54. ‹#›
@tpryan
Labels & Selectors
• Metadata for Objects
• Select sections of your infrastructure
App
Tier
Env
todo
frontend
stage
App
Tier
Env
todo
frontend
prod
App
Tier
Env
todo
frontend
dev
App
Tier
Env
todo
frontend
test
App
Tier
Env
todo
api
prod
App
Tier
Env
todo
backend
prod
App
Tier
Env
todo
api
stage
App
Tier
Env
todo
api
test
App
Tier
Env
todo
api
dev
App
Tier
Env
todo
backend
stage
App
Tier
Env
todo
backend
test
App
Tier
Env
todo
backend
dev

55. ‹#›
@tpryan
Demo: Kubernetes in Action

56. ‹#›
@tpryan
There’s More
• Secrets
• Rolling Updates
• Persistent Volumes

57. ‹#›
@tpryan
03 Container Engine
Hosted Kubernetes

58. ‹#›
@tpryan
I’ve mostly talked about
developing on Kubernetes

59. ‹#›
@tpryan
Setting up a cluster

60. ‹#›
@tpryan
Setting up a cluster
• Choose a cloud:
• GCE, AWS, Azure, Rackspace, on-premises, …

61. ‹#›
@tpryan
Setting up a cluster
• Choose a cloud:
• GCE, AWS, Azure, Rackspace, on-premises, …
• Choose a node OS:
• CoreOS, Atomic, RHEL, Debian, CentOS, Ubuntu, ...

62. ‹#›
@tpryan
Setting up a cluster
• Choose a cloud:
• GCE, AWS, Azure, Rackspace, on-premises, …
• Choose a node OS:
• CoreOS, Atomic, RHEL, Debian, CentOS, Ubuntu, ...
• Provision machines:
• Boot VMs, install and run kube components, ...

63. ‹#›
@tpryan
Setting up a cluster
• Choose a cloud:
• GCE, AWS, Azure, Rackspace, on-premises, …
• Choose a node OS:
• CoreOS, Atomic, RHEL, Debian, CentOS, Ubuntu, ...
• Provision machines:
• Boot VMs, install and run kube components, ...
• Configure networking:
• IP ranges for Pods, Services, SDN, ...

64. ‹#›
@tpryan
Setting up a cluster
• Choose a cloud:
• GCE, AWS, Azure, Rackspace, on-premises, …
• Choose a node OS:
• CoreOS, Atomic, RHEL, Debian, CentOS, Ubuntu, ...
• Provision machines:
• Boot VMs, install and run kube components, ...
• Configure networking:
• IP ranges for Pods, Services, SDN, ...
• Start cluster services:
• DNS, logging, monitoring, ...

65. ‹#›
@tpryan
Setting up a cluster
• Choose a cloud:
• GCE, AWS, Azure, Rackspace, on-premises, …
• Choose a node OS:
• CoreOS, Atomic, RHEL, Debian, CentOS, Ubuntu, ...
• Provision machines:
• Boot VMs, install and run kube components, ...
• Configure networking:
• IP ranges for Pods, Services, SDN, ...
• Start cluster services:
• DNS, logging, monitoring, ...
• Manage nodes:
• kernel upgrades, OS updates, hardware failures...

66. ‹#›
@tpryan
Or…

67. ‹#›
@tpryan

68. ‹#›
@tpryan

69. ‹#›
@tpryan
Container Engine

70. ‹#›
@tpryan
Container Engine
• Hosted Kubernetes

71. ‹#›
@tpryan
Container Engine
• Hosted Kubernetes
• A few smart defaults set

72. ‹#›
@tpryan
Container Engine
• Hosted Kubernetes
• A few smart defaults set
• Allow for dipping your feet in

73. ‹#›
@tpryan
05 Conclusions
Bring it home

74. Google has been developing and
using containers to manage our
applications for over 10 years.

75. ‹#›
@tpryan

76. ‹#›
@tpryan
Everything at Google runs on Containers:
• Gmail, Web Search, Maps, ...
• MapReduce, batch, ...
• GFS, Colossus, ...
• Even Google’s Cloud Platform: VMs run
in containers!

77. ‹#›
@tpryan
Everything at Google runs on Containers:
• Gmail, Web Search, Maps, ...
• MapReduce, batch, ...
• GFS, Colossus, ...
• Even Google’s Cloud Platform: VMs run
in containers!
We launch 2 Billion Containers a week

78. ‹#›
@tpryan
We think containers are the
way to manage scale.

79. ‹#›
@tpryan
You should carefully consider
whether running everything on
containers is right for you.

80. ‹#›
@tpryan
You should run everything on
containers.
Just in case it isn’t clear here. this is not what I am recommending. I’m saying don’t Cherry Pick from the last statements to come to the conclusion that you have to go
this way.

81. ‹#›
@tpryan
Container Engine can make
dipping your toes in a little
easier.

82. ‹#›
@tpryan
Thank You
terrenceryan.com
@tpryan
This preso: http://bit.ly/tpryan-chaos