A talk given to Container Summit 2015, Taipei on 2015-12-10. 【Docker 對傳統 DevOps 工具鏈的衝擊】 Docker 爆紅，以及隨之而來的生態圈，衝擊傳統 DevOps 工具鏈，任何人都無法忽視 Docker 帶來的威脅或機會。 已經上手、或正在評估 DevOps 工具的我們，該如何看待這個新局面？對哪些舊方法該持保留態度？對哪些新方法該積極學習？ 本講座會鳥瞰檯面上的 DevOps 工具，提出新舊交替世代的建議方針。

1. William Yeh
Architect @ Gogolook
2015-12-10

7. Albert Camus

12. 1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
Do you have basic infrastructure? (2015-11-18)
http://www.robustperception.io/do-you-have-basic-infrastructure/

13. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN LB API servers DB servers
1.1 -
1.2 -

14. 1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN LB API servers DB servers
public network
.1 -
.2 -

15. 1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN LB API servers DB servers
public network
detection
recovery
diagnosis

16. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN LB API servers DB servers
1.1 -
1.2 -

17. hardware
bare metal
OS
runtime
app
VM
hardware
OS
runtime
app
hypervisor

18. VM
hardware
OS
runtime
app
hypervisor

19. VM
hardware
OS
runtime
app
hypervisor
Docker
hardware
OS
runtime
app
hypervisor
container

20. Docker
hardware
OS
runtime
app
hypervisor
container
We know:
• Container is faster than VM
• Container is lightweight
• Dockerized app anywhere…
What if…
• An OS runs only containers?

22. Docker
hardware
OS
runtime
app
hypervisor
container
CoreOS
RancherOS
Red Hat Atomic
VMware Photon
Snappy Ubuntu Core
Windows Nano Server

23. Docker
hardware
OS
runtime
app
hypervisor
container
Container per VM
hardware
OS
runtime
app
hypervisor
container

24. Container per VM
hardware
OS
runtime
app
hypervisor
container
Intel Clear Linux
http://www.ithome.com.tw/news/96119
Hyper
https://hyper.sh/

25. Container per VM
hardware
OS
runtime
app
hypervisor
container
Unikernel
hardware
library OS
app
hypervisor
unikernel
app stack

26. Unikernel
hardware
library OS
app
hypervisor
unikernel
app stack
Unikernels are constructed by
using “library operating
systems,” from which the
developer selects only the
minimal set of services
required for an application to
run.

27. Unikernel
hardware
library OS
app
hypervisor
unikernel
app stack
MirageOS
https://mirage.io/
Boxfuse
https://boxfuse.com/
ClickOS
Clive
HaLVM
LING
Rump Kernels
OSv

28. Unikernel image
Immutable infrastructure

29. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN ELB API servers DB servers
1.1 -
1.2 -

30. service consolidation
resourceisolation
native app
VM
container per VM
unikernel
Docker

31. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN LB API servers DB servers
1.1 -
1.2 -

32. public network
private network
API servers
JDK
app server (Tomcat, …)
app (jar, war, …)
Node.js runtime
npm
app source
Python runtime
pip
uWSGI/Gunicorn
app source

33. public network
private network
DB servers
JDK
Elasticsearch
JDK
CassandraMongoDBMySQL
dependenciesdependencies

34. public network
private network
LB
HAProxynginx
AWS ELB dependenciesdependencies

35. JDK
app server (Tomcat, …)
app (jar, war, …)
Node.js runtime
npm
app source
Python runtime
pip
uWSGI/Gunicorn
app source
JDK
Elasticsearch
JDK
CassandraMongoDBMySQL
dependenciesdependencies
HAProxynginx
AWS ELB dependenciesdependencies

37. JDK
app server (Tomcat, …)
app (jar, war, …)
Node.js runtime
npm
app source
Python runtime
pip
uWSGI/Gunicorn
app source
JDK
Elasticsearch
JDK
CassandraMongoDBMySQL
dependenciesdependencies
HAProxynginx
AWS ELB dependenciesdependencies
DevOps tools
• Configuration management
• Build system
• Deployment pipeline
• Continuous integration

38. JDK
app server (Tomcat, …)
app (jar, war, …)
Node.js runtime
npm
app source
Python runtime
pip
uWSGI/Gunicorn
app source
JDK
Elasticsearch
JDK
CassandraMongoDBMySQL
dependenciesdependencies
HAProxynginx
AWS ELB dependenciesdependencies
Docker
runtime
app
image
immutable image
versioned image
dev/prod parity
Dockerfile
docker build
docker push
docker pull

39. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN ELB API servers DB servers
1.1 -
1.2 -

40. uniform
Docker
Config management will only be used to install
Docker, an orchestration system, configure
PAM/SSH auth, and tune OS sysctl values.
traditional
DevOps
toolchain
tedious
… Basically anything not having to do with app deployment.
https://blog.containership.io/containers-vs-config-management-e64cbb744a94

41. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN LB API servers DB servers
1.1 -
1.2 -

42. public network
private network
API servers
As the number of machines grows…
how to ensure better allocation?

45. pets cattle

46. pets cattle
naming?

47. pets cattle
dispensable?

48. pets cattle
naming?
dispensable?

49. pets cattle
PaaS
Hadoop MapReduce
AWS Lambda
AWS Kinesis
Google Dataflow

50. public network
private network
API servers
As the number of machines grows…
how to ensure better allocation?

51. Traditional app
OS
runtime
app
tight
interaction
host
resources
pets

52. https://prezi.com/e7sdy9rdujgp

53. public network
private network
API servers
better mobility
cattle

54. public network
private network
API servers
even better mobilitycontainer
cattle
independent of
underlying
machines

55. cattle
Docker Swarm
Mesos
Kubernetes
allocation, orchestration

56. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN ELB API servers DB servers
1.1 -
1.2 -

57. Docker Swarm
Mesos
Kubernetes
Config management will only be used to install
Docker, an orchestration system…
traditional
DevOps
toolchain
… Don’t assume too much about underlying infrastructure.
cattlepets

59. cattle
Long Running Services
• Aurora
• Marathon
• Singularity
• SSSP
Batch Scheduling
• Chronos
• Jenkins
• JobServer
Big Data Processing
• Cray Chapel
• Dpark
• Exelixi
• Hadoop
• Hama
• MPI
• Spark
• Storm
Data Storage
• Cassandra
• Elasticsearch
• Hypertable
Mesos framework

60. cattle
Mesos

61. 1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
.1 -
.2 -
private network
CDN LB API servers DB servers
public network

62. private network
LB API servers DB servers
• Rolling upgrade
• Blue/green deployment
• Canary deployment
Traditional app
• in-place update
• immutable infra

63. public network
private network
API servers
immutable imagescontainer
cattle
independent of
underlying
machines

64. cattle
Docker Swarm
Mesos
Kubernetes
allocation, orchestration

65. kubectl rolling-update my-nginx --image=nginx:1.9.1
• Rolling upgrade
• Canary deployment
• use label
Kubernetes

66. Mesos
http://blog.qubit.com/opensourcing-bamboo-automated-mesos-marathon-load-balancing
http://www.slideshare.net/johnadowns/making-developers-happier-with-mesos-docker-and-marathon

67. Universal Control Plane
https://www.docker.com/universal-control-plane

68. public network
1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
private network
CDN ELB API servers DB servers
.1 -
.2 -

69. Docker Swarm
Mesos
Kubernetes
traditional
DevOps
toolchain
Consider the benefits:
• immutable infrastructure
• automated allocation
• automated orchestration
cattlepets

70. private network
CDN LB API servers DB servers
Key Takeaways

71. 1. How to recreate your system
2. How to safely change your system
3. When something has gone wrong
Do you have basic infrastructure? (2015-11-18)
http://www.robustperception.io/do-you-have-basic-infrastructure/

72. service consolidation
resourceisolation
native app
VM
container per VM
unikernel
Docker
Immutable infrastructure

73. uniform
Docker
Config management will only be used to install
Docker, an orchestration system… anything
other than app deployment.
traditional
DevOps
toolchain
tedious

74. Docker Swarm
Mesos
Kubernetes
traditional
DevOps
toolchain
… Don’t assume too much about underlying infrastructure.
cattlepets

75. cattle
Docker Swarm
Mesos
Kubernetes
allocation, orchestration

76. http://send.wtf/docker2015