Delivering Microservices Using Docker

1. DELIVERING
MICROSERVICES
USING DOCKER
Kiru Samapathy
Agile India, 2016
1

2. 2

3. FEEDBACK LOOP?
3
Hours/Months?

4. CONTINUOUS DELIVERY
4
4
Automation maturity
SpeedofDelivery

5. CONTINUOUS DELIVERY
4
4
Automation maturity
SpeedofDelivery

6. CONTINUOUS DELIVERY
4
4
Automation maturity
SpeedofDelivery

7. Build
5
Test Integration Production
5

8. Build
5
Test Integration Production
5

9. Build
5
Test Integration Production
5

10. 6

11. 6
Single Technology

12. 6
Complex codebase
Single Technology

13. 6
Complex codebase
Hard to isolate issues
Single Technology

14. 6
Complex codebase
Hard to isolate issues
Single Technology
Scaling is difficult

15. 6
Complex codebase
Hard to isolate issues
Single Technology
Scaling is difficult

16. WHY THINK MICRO?
7
I have been doing it for years, why change now?

17. 8
Sam Newman
Small autonomous services
that work together

18. 9

19. 9

20. 9

21. 10

22. 11

23. 12

24. 13
Small
Sam Newman
that work together
autonomous services

25. 13
Small
Sam Newman
that work together
autonomous services

26. 13
Small
Sam Newman
that work together
autonomous services

27. 13
Small
Sam Newman
that work together
autonomous services

28. 13
Small
Sam Newman
that work together
autonomous services

29. 1414

30. 1414

31. 15
CAN THE SERVICES BE DEPLOYED
INDEPENDENTLY

32. CONFIDENCE TO
DEPLOY
Testing multiple parts
16

33. 17
Complex and smart integration

34. 18

35. 18
Dumb Pipelines
Open Standards

36. CONSUMER-DRIVEN CONTRACTS
19

37. CONSUMER-DRIVEN CONTRACTS
19

38. CONSUMER-DRIVEN CONTRACTS
19
Define request
and expected response

39. CONSUMER-DRIVEN CONTRACTS
19
Define request
and expected response
Record expectations

40. CONSUMER-DRIVEN CONTRACTS
19
Define request
and expected response
request - mock server
Record expectations

41. CONSUMER-DRIVEN CONTRACTS
19
Define request
and expected response
request - mock server
response from mock
Record expectations

42. CONSUMER-DRIVEN CONTRACTS
20

43. CONSUMER-DRIVEN CONTRACTS
20

44. CONSUMER-DRIVEN CONTRACTS
20
Replay

45. CONSUMER-DRIVEN CONTRACTS
20
Replay
request

46. CONSUMER-DRIVEN CONTRACTS
20
Replay
request
response

47. CONSUMER-DRIVEN CONTRACTS
20
Replay
request
response

48. CONSUMER-DRIVEN CONTRACTS
20
Replay
request
response

49. https://github.com/realestate-com-au/pact

50. 22

51. 23

52. 23

53. 23

54. 23

57. Hold on… I am already
doing it
24

58. VIRTUAL MACHINES
25
Hardware
Operating System
1 2

59. VIRTUAL MACHINES
25
Hardware
Operating System
Hypervisor

60. VIRTUAL MACHINES
25
Hardware
Operating System
Hypervisor
Guest OS Guest OS

61. VIRTUAL MACHINES
25
Hardware
Operating System
Hypervisor
Guest OS Guest OS
1

62. VIRTUAL MACHINES
25
Hardware
Operating System
Hypervisor
Guest OS Guest OS
1 2

63. DOCKER
26
Hardware

64. DOCKER
26
Hardware
Linux Operating System

65. DOCKER
26
Hardware
Linux Operating System
Docker daemon

66. DOCKER
26
Hardware
Linux Operating System
Docker daemon
1
Container

67. DOCKER
26
Hardware
Linux Operating System
Docker daemon
1 2
Container Container

68. 27

69. 27
cgroups

70. 27
Namespaces
cgroups

71. 27
Namespaces
cgroups
copy-on-write storage

72. CGROUPS
28

73. CGROUPS
28
Count the resources
memory, cpu,network…
Limit the resources usage

74. CGROUPS
29

75. CGROUPS
29
memory
1

76. CGROUPS
29
memory
1
32
51
realtime

77. CGROUPS
29
memory
1
32
51
realtime
nginx
redis
98
1008

78. CGROUPS
29
memory cpu
1
32
51
realtime
nginx
redis
98
1008
1
454
51
databases
32
98
1008

79. NAMESPACES
30

80. NAMESPACES
30
Processes with their own view of the system
Limit the resources visibility
pid, net, uts, mnt, ipc, user

81. NAMESPACES
31
host
1
32
51

82. NAMESPACES
31
host
1
32
51
Container1
1
1008

83. NAMESPACES
31
host
1
32
51
Container1
1
1008
Container2
1
1008
78

84. 32
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
apt-get update && apt-get -y install nginxLayer 3 - 71.05 MB
EXPOSE 80/tcp
Layer 4 - 0 B
CMD ["nginx" "-g" "daemon off;”]
nginx-demo:latest
ac3b9cb4e821
Layer 5 - 0 B
Base Layers
(Shared between
images)

85. 33
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB

86. 33
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
Base Layers
(Shared between
images)

87. 33
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
Base Layers
(Shared between
images)

88. 33
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
apt-get update && apt-get -y install nginxLayer 3 - 71.05 MB
Base Layers
(Shared between
images)

89. 33
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
apt-get update && apt-get -y install nginxLayer 3 - 71.05 MB
EXPOSE 80/tcp
Layer 4 - 0 B
Base Layers
(Shared between
images)

90. 33
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
apt-get update && apt-get -y install nginxLayer 3 - 71.05 MB
EXPOSE 80/tcp
Layer 4 - 0 B
CMD ["nginx" "-g" "daemon off;”]
nginx-demo:latest
ac3b9cb4e821
Layer 5 - 0 B
Base Layers
(Shared between
images)

91. 34

92. Kernel (Shared between containers)
34

93. Kernel (Shared between containers)
34
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
apt-get update && apt-get -y install nginxLayer 3 - 71.05 MB
EXPOSE 80/tcp
Layer 4 - 0 B
CMD ["nginx" "-g" "daemon off;”]
nginx-demo:latest
ac3b9cb4e821
Layer 5 - 0 B

94. Kernel (Shared between containers)
34
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
apt-get update && apt-get -y install nginxLayer 3 - 71.05 MB
EXPOSE 80/tcp
Layer 4 - 0 B
CMD ["nginx" "-g" "daemon off;”]
nginx-demo:latest
ac3b9cb4e821
Layer 5 - 0 B
thirsty_franklin
Container
nginx
masternginx
worker
Process(es)

95. Kernel (Shared between containers)
35
ADD file:5f0fca122586fe4ea7Layer 0 - 125.1 MB
CMD ["/bin/bash"]
Layer 1 - 0 B
MAINTAINER John CitizenLayer 2 - 0 B
apt-get update && apt-get -y install nginxLayer 3 - 71.05 MB
EXPOSE 80/tcp
Layer 4 - 0 B
CMD ["nginx" "-g" "daemon off;”]
nginx-demo:latest
ac3b9cb4e821
Layer 5 - 0 B
thirsty_franklin
Container
nginx
masternginx
worker
Process(es)
Read-only Layers
(Shared between
containers)
Writeable Layer

96. 36

97. 37
Namespaces
cgroups
copy-on-write storage

98. 38
CI Server Production

99. 38
Docker
file
CI Server Production

100. 38
Docker
file
CI Server Production
Build
Test
Package

101. 38
Docker
file
CI Server Production
Build
Test
Package
Image

102. 38
Docker
file
CI Server Production
Build
Test
Package
Image
Push

103. 38
Docker
file
CI Server Production
Docker
Registry
Build
Test
Package
Image
Push

104. 38
Docker
file
CI Server Production
Docker
Registry
Build
Test
Package
Image
Push
Search

105. 38
Docker
file
CI Server Production
Docker
Registry
Build
Test
Package
Image
Push
Search
Pull
Run

106. 39

107. ONE PROCESS PER
CONTAINER!
40

108. SERVICE DISCOVERY
41
Register and Lookup

109. 42

110. 42

111. 42

112. 42

113. 42

114. 42

115. 42

116. 43
address

117. 43
address

118. 43
address

119. 43
address

120. Cattle not Pets
44

121. 44
Any update is a
redeployment

122. 45
DNS

123. 45
Service Registry
Consul
etcd
Zookeeper

124. 45
Service Registry Templates
Consul
etcd
Zookeeper
Consul template
confd
Interlock

125. 45
Service Registry Templates Reverse Proxy
Consul
etcd
Zookeeper
Consul template
confd
Interlock
NGINX
HAProxy
kube-proxy

126. 46
Use Docker events API
to discover new containers

127. 47
Docker
Engine

128. 47
Docker
Engine
Listener

129. 47
Docker
Engine
Listener
start

130. 47
Docker
Engine
Listener
start
stop

131. 47
Docker
Engine
Listener
start
stop

132. 47
Docker
Engine
Listener
start
stop

133. 47
Docker
Engine
Listener
start
stop
Interlock

134. 47
Docker
Engine
Listener
start
stop
InterlockRegistrator

135. 48
Docker
Engine
Listener
Start
Stop
Key/Value
Store

136. 48
Docker
Engine
Listener
Start
Stop
Keep
watching….
Key/Value
Store

137. 48
Docker
Engine
Listener
Start
Stop
Keep
watching….
Update
Reverse
Proxy
Key/Value
Store

138. Even better…
49

139. ORCHESTRATION
Automated arrangement
50

140. 51
Credit: https://www.flickr.com/photos/58435349@N05/7924872072/
https://www.flickr.com/photos/ackab/15899607032

141. 52
6:00 am

142. 52
6:00 am 2 hours sales..

143. 52
6:00 am 2 hours sales.. 11:00 pm

144. 53

145. LOGGING
Do it before you need it
54

146. 55

147. 55
Collect logs

148. 55
Collect logs Ship
Parse
Store

149. 55
Collect logs Ship
Parse
Store
Query
Dashboard

150. 56

151. 56
Collect & Ship
Fluentd
Logstash
docker-log-collector

152. 56
Collect & Ship Index & Search
Fluentd
Logstash
docker-log-collector
Elastic Search
InfluxDB
Splunk

153. 56
Collect & Ship Index & Search Query Dashboard
Fluentd
Logstash
docker-log-collector
Elastic Search
InfluxDB
Splunk
Kibana
Grafana
Sumologic

154. 57

155. 57
Log directly from the application

156. 57
Log directly from the application
File collector in the container

157. 57
Log directly from the application
File collector in the container
File collector as a container

158. 57
Log directly from the application
File collector in the container
File collector as a container
Syslog collector as a container

159. 57
Log directly from the application
File collector in the container
File collector as a container
Syslog collector as a container
Log to standard out & forward to syslog

160. Not enough…
58

161. 59

162. 59

163. 59
id:abc

164. 59
id:abc id:abc

165. 59
id:abc id:abc
id:abc
id:abc

166. 59
id:abc
id:abc
id:abc
id:abc,123

167. 60

168. 60

169. 60

170. 60

171. 60
Dapper
Zipkin

172. MONITORING
Not an act, it’s a habit
61

173. 62
Up Up

174. 62
Up
Down

175. 62
UpUp

176. 62
UpUp

177. 62
Down
Up

178. 62
Partial service
Up

179. 62
Partial service
Up

180. 62
Partial service
Up

181. 62
Up
Down

182. 63
Collect stats

183. 63
/health
/health
Collect stats

184. 63
/health
/health
Collect stats

185. 63
/health
/health
Collect stats
<stats>

186. 63
Monitoring
Tool
/health
/health
Collect stats
<stats>

187. 63
Monitoring
Tool
/health
/health
Collect stats
<stats>
Alert

188. 64

189. 64
Modelled Around
Business Domain

190. 64
Modelled Around
Business Domain
Culture Of
Automation

191. 64
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details

192. 64
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Decentralise All
The Things

193. 64
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Deploy
Independently
Decentralise All
The Things

194. 64
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Customer
First
Deploy
Independently
Decentralise All
The Things

195. 64
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Isolate
Failure
Customer
First
Deploy
Independently
Decentralise All
The Things

196. 64
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Isolate
Failure
Customer
First
Deploy
Independently
Decentralise All
The Things
Highly
Observable

197. Strong foundation on
Continuous Delivery
65

198. 66
Martin Fowler
Let's face it,
all we are doing is writing tomorrow's
legacy software

199. 67

200. 68
https://www.thoughtworks.com/radar

201. @kirusamapathy
ksama@thoughtworks.com
THANK YOU