The document discusses the challenges and lessons learned from transitioning from monoliths to microservices in a cloud-based environment. It emphasizes the importance of agility, risk management, and careful architecture to avoid pitfalls associated with distributed systems. Key topics include deployment strategies, messaging systems, and the use of AWS services like Elastic Beanstalk and DynamoDB.

1. Microservice Scars:
Lessons we learnt
Abhaya Chauhan
@AbhayaChauhan
www.abhayachauhan.com
Joshua Toth
@TothJoshuaJ

2. Question Policy

3. Let’s go on a
Journey

4. Context

5. PageUp
Context

6. Talent
Management
SaaS
Context

7. 100% Cloud
based
AWS + Azure
Context

8. 19 years
Context

9. 25% growth
year on year
Context

10. PageUp =
Market Leaders
Context

11. The Monolith
Context

12. Fragility
The Monolith
Context

13. Agility
The Monolith
Context

14. Complexity
The Monolith
Context

15. Innovation
The Monolith
Context

16. Deployment
The Monolith
Context

17. Production
Hardened
The Monolith
Context

18. #Scale
Context

19. Large Projects
Context

20. Big Rewrite
Context

21. If you can’t build a monolith,
what makes you think
microservices are the answer?
Simon Brown
Context

22. First rule of Distributed
Computing
Context

23. Don’t do it.
Context

24. Why
Microservices?
Context

25. Reduce time
to market
Context

26. Reduce
blast radius
Context

27. Enable
Evolutionary
Architecture
Context

29. Sprint Zero

30. Decisions
Sprint Zero

31. The stack
Sprint Zero

32. Sprint Zero

33. Sprint Zero
Frontend

34. Sprint Zero
Backend
Frontend

35. Sprint Zero
Backend
DB
Frontend

36. Sprint Zero
Elastic
Beanstalk
S3

37. .Net
Sprint Zero

38. Self hosted
Sprint Zero

39. Angular
Sprint Zero

40. DynamoDB
Sprint Zero

41. Pact
Sprint Zero

44. Infancy
Sprint Zero

45. Limitations
Sprint Zero

46. Investment
Sprint Zero

47. Deployment
Sprint Zero

48. Continuous
Sprint Zero

49. Phabricator
Sprint Zero

50. Phabro slides
had to be
removed.
Please contact us
for any queries
Sprint Zero

51. Pipeline
Sprint Zero

52. Sprint Zero

53. Pipeline
Sprint Zero

54. Pipeline
Sprint Zero

55. F# Make (Fake)
Sprint Zero

56. Monolith Scripts
Sprint Zero

57. Sharing != caring
Sprint Zero

58. Clear separation
Sprint Zero

59. Development
Practices
Sprint Zero

60. TDD
Sprint Zero

61. BDD
Sprint Zero

62. Sprint Zero

64. Elastic Beanstalk

66. Full stack
Elastic Beanstalk

74. Visualization
Elastic Beanstalk

75. Monitoring
Elastic Beanstalk

76. Monitoring
Elastic Beanstalk

77. Monitoring
Elastic Beanstalk

78. Monitoring
Elastic Beanstalk

79. Elastic Beanstalk

80. Elastic Beanstalk

81. Elastic Beanstalk

82. Rebuilds
Elastic Beanstalk

83. No Downtime
Elastic Beanstalk

84. The Hack
Elastic Beanstalk

85. Elastic Beanstalk

86. Elastic Beanstalk

87. Elastic Beanstalk

88. Speed
Elastic Beanstalk

89. Care
Elastic Beanstalk

90. Synchronization
Elastic Beanstalk

91. 50 shades of
“fuck we can’t
roll this back”
Grey
Elastic Beanstalk

92. Scaling
Elastic Beanstalk

93. Authentication

94. IdentityServer3
(Locksmith)
OAuth2

95. Immediate return
OAuth2

96. Questions

97. Messaging

99. Messaging

100. Messaging

101. Messaging

102. Request
Response Pain
Messaging

103. Resource
intensive
Messaging

104. Fault Prone
Messaging

105. 1 to 1
communication
Messaging

106. Event Driven
Architecture
Messaging

107. Webhooks
Messaging

108. Messaging

109. Messaging

110. :`(
Messaging

111. Queuing (SQS)
Messaging

112. Resource Intensive
Fault Prone
1 - many Communication
Messaging

113. Resource Intensive
Fault Prone
1 - many Communication
Messaging

114. Resource Intensive
Fault Prone
1 - many Communication
Messaging

115. Resource Intensive
Fault Prone
1 - many Communication
Messaging

116. Simple Notification
Service (SNS)
Messaging

117. Push messages
Messaging

118. Mobile Devices
Messaging

119. Mobile Devices
SMS
Messaging

120. Mobile Devices
SMS
Emails
Messaging

121. Mobile Devices
SMS
Emails
HTTP Endpoints
Messaging

122. Mobile Devices
SMS
Emails
HTTP Endpoints
Lambda
Messaging

123. Mobile Devices
SMS
Emails
HTTP Endpoints
Lambda
Queues
Messaging

124. Messaging

125. Messaging

126. Messaging

127. Messaging
SNS + SQS = Amazing Service Bus

128. Resource Intensive
Fault Prone
1 - many Communication
Messaging

129. Circuit Breaker
Messaging

130. Messaging

131. CloudWatch
Messaging

132. Historical Events
Messaging

133. A store for
events
Messaging

134. DynamoDb

135. Fully Managed
NoSQL DB
DynamoDb

136. Fast and
Predictable
DynamoDb

137. Distributed
DynamoDb

138. Key-Value
Document
DynamoDb

139. Hash (Range)
Partition 1 Partition 2 Partition 3 Partition N
Read & Write capacity equally distributed
Max
400kb
DynamoDb

140. 1 Read unit = 4KB/s
1 Write unit = 1KB/s
DynamoDb

141. CQRS
DynamoDb

142. DynamoDb

143. Oh shit!
DynamoDb

144. Write is 20x more
expensive
DynamoDb

145. DynamoDb
{"Key":"Mauritania","Value":"42803"},{"Key":"Mauritius","Value":"42804"},{"Key":"Mexico","Value":"42805"},{"Key":"Micronesia","Value":"42806"},{"Key":"Monaco","
Value":"42807"},{"Key":"Mongolia","Value":"42808"},{"Key":"Montenegro","Value":"42809"},{"Key":"Montserrat","Value":"42810"},{"Key":"Morocco","Value":"42811"},
{"Key":"Mozambique","Value":"42812"},{"Key":"Namibia","Value":"42813"},{"Key":"Nauru","Value":"42814"},{"Key":"Nepal","Value":"42815"},{"Key":"Netherlands","
Value":"42816"},{"Key":"Netherlands Antilles","Value":"42817"},{"Key":"New Caledonia","Value":"42818"},{"Key":"New Zealand","Value":"42819"},{"Key":"Nicaragua","
Value":"42820"},{"Key":"Niger","Value":"42821"},{"Key":"Nigeria","Value":"42822"},{"Key":"Niue","Value":"42823"},{"Key":"Northern Mariana Islands","Value":"42824"},
{"Key":"Norway","Value":"42825"},{"Key":"Oman","Value":"42826"},{"Key":"Pakistan","Value":"42827"},{"Key":"Palau, Republic Of","Value":"42828"},{"Key":"
Palestine","Value":"42829"},{"Key":"Panama","Value":"42830"},{"Key":"Papua New Guinea","Value":"42831"},{"Key":"Paraguay","Value":"42832"},{"Key":"Peru","
Value":"42833"},{"Key":"Philippines","Value":"42834"},{"Key":"Poland","Value":"42835"},{"Key":"Portugal","Value":"42836"},{"Key":"Puerto Rico","Value":"42837"},
{"Key":"Qatar","Value":"42838"},{"Key":"Republic Of Korea","Value":"42839"},{"Key":"Republic Of Moldova","Value":"42840"},{"Key":"Republic Of Yemen","Value":"
42841"},{"Key":"Reunion","Value":"42842"},{"Key":"Romania","Value":"42843"},{"Key":"Russian Federation","Value":"42844"},{"Key":"Rwanda","Value":"42845"},
{"Key":"Saint Kitts And Nevis","Value":"42846"},{"Key":"Saint Lucia","Value":"42847"},{"Key":"Sao Tome & Principe","Value":"42848"},{"Key":"Saudi Arabia","Value":"
42849"},{"Key":"Senegal","Value":"42850"},{"Key":"Serbia","Value":"42851"},{"Key":"Serbia & Monten","Value":"42852"},{"Key":"Seychelles","Value":"42853"},{"Key":"
Sierra Leone","Value":"42854"},{"Key":"Singapore","Value":"42855"},{"Key":"Slovakia","Value":"42856"},{"Key":"Slovenia","Value":"42857"},{"Key":"Solomon Islands","
Value":"42858"},{"Key":"Somalia","Value":"42859"},{"Key":"South Africa","Value":"42860"},{"Key":"South Sudan","Value":"42861"},{"Key":"Spain","Value":"42862"},
{"Key":"Sri Lanka","Value":"42863"},{"Key":"St. Vincent And The Grena","Value":"42864"},{"Key":"Sudan","Value":"42865"},{"Key":"Surinam","Value":"42866"},{"Key":"
Swaziland","Value":"42867"},{"Key":"Sweden","Value":"42868"},{"Key":"Switzerland","Value":"42869"},{"Key":"Syrian Arab Republic","Value":"42870"},{"Key":"
Tajikistan","Value":"42871"},{"Key":"Tanzania, United Rep. Of","Value":"42872"},{"Key":"Tfyr Of Macedonia","Value":"42873"},{"Key":"Thailand","Value":"42874"},
{"Key":"Timor-Leste","Value":"42875"},{"Key":"Togo","Value":"42876"},{"Key":"Tokelau Islands","Value":"42877"},{"Key":"Tonga","Value":"42878"},{"Key":"Trinidad And
Tobago","Value":"42879"},{"Key":"Tunisia","Value":"42880"},{"Key":"Turkey","Value":"42881"},{"Key":"Turkmenistan","Value":"42882"},{"Key":"Turks And Caicos
Island","Value":"42883"},{"Key":"Mauritania","Value":"42803"},{"Key":"Mauritius","Value":"42804"},{"Key":"Mexico","Value":"42805"},{"Key":"Micronesia","Value":"
42806"},{"Key":"Monaco","Value":"42807"},{"Key":"Mongolia","Value":"42808"},{"Key":"Montenegro","Value":"42809"},{"Key":"Montserrat","Value":"42810"},{"Key":"
Morocco","Value":"42811"},{"Key":"Mozambique","Value":"42812"},{"Key":"Namibia","Value":"42813"},{"Key":"Nauru","Value":"42814"},{"Key":"Nepal","Value":"
42815"},{"Key":"Netherlands","Value":"42816"},{"Key":"Netherlands Antilles","Value":"42817"},{"Key":"New Caledonia","Value":"42818"},{"Key":"New Zealand","
Value":"42819"},{"Key":"Nicaragua","Value":"42820"},{"Key":"Niger","Value":"42821"},{"Key":"Nigeria","Value":"42822"},{"Key":"Niue","Value":"42823"},{"Key":"
Northern Mariana Islands","Value":"42824"},{"Key":"Norway","Value":"42825"},{"Key":"Oman","Value":"42826"},{"Key":"Pakistan","Value":"42827"},{"Key":"Palau,
Republic Of","Value":"42828"},{"Key":"Palestine","Value":"42829"},{"Key":"Panama","Value":"42830"},{"Key":"Papua New Guinea","Value":"42831"},{"Key":"
Paraguay","Value":"42832"},{"Key":"Peru","Value":"42833"},{"Key":"Philippines","Value":"42834"},{"Key":"Poland","Value":"42835"},{"Key":"Portugal","Value":"42836"},
{"Key":"Puerto Rico","Value":"42837"},{"Key":"Qatar","Value":"42838"},{"Key":"Republic Of Korea","Value":"42839"},{"Key":"Republic Of Moldova","Value":"42840"},
{"Key":"Republic Of Yemen","Value":"42841"},{"Key":"Reunion","Value":"42842"},{"Key":"Romania","Value":"42843"},{"Key":"Russian Federation","Value":"42844"},
{"Key":"Rwanda","Value":"42845"},{"Key":"Saint Kitts And Nevis","Value":"42846"},{"Key":"Saint Lucia","Value":"42847"},{"Key":"Sao Tome & Principe","Value":"
42848"},{"Key":"Saudi Arabia","Value":"42849"},{"Key":"Senegal","Value":"42850"},{"Key":"Serbia","Value":"42851"},{"Key":"Serbia & Monten","Value":"42852"},
{"Key":"Seychelles","Value":"42853"},{"Key":"Sierra Leone","Value":"42854"},{"Key":"Singapore","Value":"42855"},{"Key":"Slovakia","Value":"42856"},{"Key":"
Slovenia","Value":"42857"}

146. DynamoDb
{"Key":"Mauritania","Value":"42803"},{"Key":"Mauritius","Value":"42804"},{"Key":"
Mexico","Value":"42805"},{"Key":"Micronesia","Value":"42806"},{"Key":"Monaco","
Value":"42807"},{"Key":"Mongolia","Value":"42808"},{"Key":"Montenegro","
Value":"42809"},{"Key":"Montserrat","Value":"42810"},{"Key":"Morocco","Value":"
42811"},{"Key":"Mozambique","Value":"42812"},{"Key":"Namibia","Value":"
42813"},{"Key":"Nauru","Value":"42814"},{"Key":"Nepal","Value":"42815"},{"Key":"
Netherlands","Value":"42816"},{"Key":"Netherlands Antilles","Value":"42817"},
{"Key":"New Caledonia","Value":"42818"},{"Key":"New Zealand","Value":"
42819"},{"Key":"Nicaragua","Value":"42820"},{"Key":"Niger","Value":"42821"},
{"Key":"Nigeria","Value":"42822"},{"Key":"Niue","Value":"42823"},{"Key":"Northern
Mariana Islands","Value":"42824"},{"Key":"Norway","Value":"42825"},{"Key":"
Oman","Value":"42826"},{"Key":"Pakistan","Value":"42827"},{"Key":"Palau,
Republic Of","Value":"42828"},{"Key":"Palestine","Value":"42829"},{"Key":"
Panama","Value":"42830"},{"Key":"Papua New Guinea","Value":"42831"},{"Key":"
Paraguay","Value":"42832"},{"Key":"Peru","Value":"42833"},{"Key":"Philippines","
Value":"42834"},{"Key":"Poland","Value":"42835"},{"Key":"Portugal","Value":"
42836"},{"Key":"Puerto Rico","Value":"42837"},{"Key":"Qatar","Value":"42838"},
{"Key":"Republic Of Korea","Value":"42839"},{"Key":"Republic Of Moldova","
Value":"42840"},{"Key":"Republic Of Yemen","Value":"42841"},{"Key":"Reunion","
Value":"42842"},{"Key":"Romania","Value":"42843"},{"Key":"Russian
Federation","Value":"42844"},{"Key":"Rwanda","Value":"42845"},{"Key":"Saint
Kitts And Nevis","Value":"42846"},{"Key":"Saint Lucia","Value":"42847"},{"Key":"
Sao Tome & Principe","Value":"42848"},{"Key":"Saudi Arabia","Value":"42849"},
{"Key":"Senegal","Value":"42850"},{"Key":"Serbia","Value":"42851"},{"Key":"
Serbia & Monten","Value":"42852"},{"Key":"Seychelles","Value":"42853"},{"Key":"
Sierra Leone","Value":"42854"},{"Key":"Singapore","Value":"42855"},{"Key":"
Slovakia","Value":"42856"},{"Key":"Slovenia","Value":"42857"},{"Key":"Solomon
Islands","Value":"42858"},{"Key":"Somalia","Value":"42859"},{"Key":"South
Africa","Value":"42860"},{"Key":"South
{"Key":"Papua New Guinea","Value":"42831"},{"Key":"Paraguay","Value":"
42832"},{"Key":"Peru","Value":"42833"},{"Key":"Philippines","Value":"42834"},
{"Key":"Poland","Value":"42835"},{"Key":"Portugal","Value":"42836"},{"Key":"
Puerto Rico","Value":"42837"},{"Key":"Qatar","Value":"42838"},{"Key":"Republic
Of Korea","Value":"42839"},{"Key":"Republic Of Moldova","Value":"42840"}
Static (Read Optimised) Volatile (Write Optimised)

147. Oh shit #2
DynamoDb

148. DynamoDb

149. Recovery Point
Objective = 30
minutes
DynamoDb

150. Recovery Time
Objective = 1 day
DynamoDb

151. Distributed
Triggers
DynamoDb

153. DynamoDb

154. DynamoDb

155. DynamoDb

156. DynamoDb

157. S3 Versioned
Buckets
DynamoDb

158. DynamoDb

159. DynamoDb

160. DynamoDb

161. DynamoDb
Version Control
DynamoDb

162. Risk Profile
Low
High

163. Team

172. Skillset

173. Frontend

174. First
Microservice

175. Quality

176. NoSql

177. Infrastructure

178. Security / DR

179. Estimation

180. Risk Profile at
startup

181. PM 101 -Risk
Management

182. Risk Profile: Team
1. Team availability
2. Experience level of the Team
3. Domain knowledge of the Team
4. Technical skillset of the Team
5. Team flow, size and track record

183. Risk Profile: Product
1. Product Complexity
2. Product Criticality
3. Product Stability
4. Problem Clarity
5. User perspection / expectations

184. Risk vs Returns

185. Risk vs Business
Value

191. Retrospective

192. Monolith
Gateway

193. Stakeholders

194. More than
you think
Stakeholders

195. Metrics
Stakeholders

196. Transparency
Stakeholders

197. Support Balance

198. Business value

199. Team goals

200. Bake some goods

201. Time to iterate

202. Don’t
underestimate
users

203. Pair pair pair

204. Questions

205. Thank you

206. https://github.com/PageUpPeopleOrg

207. https://en.wikipedia.org/wiki/Test-driven_development
https://en.wikipedia.org/wiki/Behavior-driven_development
https://angularjs.org/
http://fsharp.github.io/FAKE/
http://owin.org/
https://aws.amazon.com/documentation/
https://twitter.com/simonbrown
http://phabricator.org/
https://github.com/realestate-com-au/pact
https://github.com/IdentityServer/IdentityServer3
http://martinfowler.com/bliki/CQRS.html