Diego Berrueta discusses the challenges and solutions related to scaling microservices at Sydney Serversiders. The four main challenges include creating a secure platform, facilitating knowledge reuse, ensuring rapid service creation, and maintaining operational excellence. The proposed solutions enhance compliance, foster collaboration, optimize costs, and promote continuous improvement across engineering teams.

1. DIEGO BERRUETA | ENGINEERING PRINCIPAL
Scaling towards
a thousand micro services
Sydney Serversiders - June 2019

2. Royal Australian Historical Society @ Flickr

3. 4
challenges

4. FIRST
CHALLENGE

5. Read this book
One does not simply…

6. A secure
platform with
uniform
processes
Enable every
engineer to
easily develop
and deploy
secure services
CHALLENGE OUR SOLUTION

7. Clear contract
Similar packaging and
operations
Micros: our internal PaaS
Uniform deployments
Familiar processes across all
services and environments
Built on top of AWS
Standardise service
architecture and promote
best practices (12 factor)

8. Deployment process
$ micros service:deploy …
CONTAINER
DESCRIPTOR

9. Robin Fernandes
Art of PaaS
(2016)
Roaan Vos
Atlassian’s voyage with AWS
(2018)
Learn more about Micros

11. https://s2sauth.bitbucket.io/

12. Value unlocked
Compliance
Change traceability and strict
permissions
Visibility
Cost allocation and optimisation,
bird’s eye view of the platform
Security
Service-to-service authentication,
security scans, secret store…
Resilience
Chaos engineering, failover tests and
automated backups

13. SECOND
CHALLENGE

14. Converge on
a handful of
tech stacks
Reuse knowledge
and enable
experimentation
CHALLENGE OUR SOLUTION

15. Tech stack guidelines
(Extract from the Java tech stack)

16. Value unlocked
Collaboration
Engineers can understand and
contribute to other teams’ services
Experimentation
Recommendations are regularly
updated (example: Kotlin)
Economies of scale
Shared libraries and tools are used in
hundreds of services
Training
Internal brownbags, intranet blog
posts, peer support

17. THIRD
CHALLENGE

18. Cookie-cutter
approach to
service creation
and maintenance
CHALLENGE OUR SOLUTION
Copy-pasting code
does not scale

21. Value unlocked
Frictionless decomposition
Avoid temptation to add more code to
the monolith
Reuse best practices
From resilience to code organisation
Quick prototyping
Create and deploy a new service in
minutes
Scalable maintenance
Fix it once for everyone by eliminating
code duplication

22. FOURTH
CHALLENGE

23. End-to-end
service ownership
and continuous
improvement
A sustainable
balance between
changes and
reliability
CHALLENGE OUR SOLUTION

24. https://www.atlassian.com/incident-management/handbook

25. Continuous improvement

26. Value unlocked
Trust
Blameless incident investigations find
and address root cause
Scalable model
Decentralised operations scale
horizontally and interests are aligned
Transparency
Teams set their objectives and openly
track their success
Close feedback loop
Teams are motivated and empowered
to continuously learn and improve

27. 1st challenge:
A secure
platform
2nd challenge:
Knowledge
reuse
3rd challenge:
Speed at scale
4th challenge:
Operational
excellence
Recap

28. DIEGO BERRUETA
Thank you