Let’s assume you’ve already had every *Docker 101 tutorial* for breakfast. You’re now ready to take that brilliantly crafted application into production. But wait… first you need to test your container-based microservices architecture. What does the whole DevOps workflow look like? What about performance and security? And last but not least; how the hell do I run my microservices in production, and will it scale? Let Daniël guide you through the wonderful world of container-based development and running microservice architectures at scale. By attending the talk, you’ll gain insight into how to bootstrap and dive straight into learning what DevOps workflow should look like when using containers.

1. Daniël van Gils
@foldingbeauty
daniel@cloud66.com
www.cloud66.com
How the hell do I run
Microservices Docker in Production?...
and will it scale?

2. OpsDev
Design
Developer Advocate

3. Build, deploy and maintain any application
on any server, on the cloud provider of your
choice or bring your own servers.
Running Docker in production for almost 1½
years for our customers.
We simplify DevOps.
Researched how our customers are using
Docker.

4. Daniël van Gils
@folding beauty
daniel@cloud66.com
www.cloud66.com
How the hell do I run
Docker in Production?...
and will it scale?

5. Ɨ
ǽ
#1 the right container image
#2 containers in production
ƗƗ

6. api / ruby
static / middleman
whatsapp api / python
AI / tensor flow
hidden service / tor
chat bot / go
analytics / R
bigdata / java
iot / c++

8. NOISE
$docker run alpine echo 'hello world’
you don’t know what kind of skills you need
production
you know what kind of skill you need
you think you know your gained all the skills
but you don’t know
time
skills

9. Ɨ
Ȑ
Ȑ
containers
Ɨ ƗƗƗ
Ɨ
Ɨ
Ɨ
bin/libs
os
bin/libs bin/libs
Ǹ
Ȑserver
os
bin/libs
Ǹ
Ȑ
Ȑ
cloud/VM
os
bin/libs
Ǹ
Ȑ
os
bin/libs

10. Ǹ
cloud/VM
Ǹ
containers
Ǹ
server
dev
ops
ops
ops
dev dev

11. simple
complex
ǽ
Minimal Lovable Service

12. technology
ǽ
♥
NOISE

14. service
Ɨ containers
server cluster(s)Ȑ
imageƗǽ
ƗƗ
= code
= docker file
= docker engine
= platform
Ɨ
build
ship
deploy

15. containerisation
Ǹ
the containerisation machine
ƗƗƗ

16. you can’t polish a turd
Ɨ
containerisation
Ǹ
Dž
ƗƗƗ =

17. dev » test » stage » production
small - secure - performant - stable - immutable
ǽ
Minimal Lovable Service Image

18. SMALL
SECURE
PERFORMANT
STABLE
IMMUTABLE
Ɨǽ

19. SMALL
Start with the smallest minimal
image you can find.
Remove compile time
dependencies.
Remove packages you don’t need.
Run stats for the image.
Ɨǽ

20. SMALL
SECURE
PERFORMANT
STABLE
IMMUTABLE
Ɨǽ

21. SECURE
Remove all the secrets.
Patch to the latest security
updates.
Run the image with the
right UID.
Test the image.
Ɨǽ

22. SMALL
SECURE
PERFORMANT
STABLE
IMMUTABLE
Ɨǽ

23. PERFORMANT
Optimise code.
Memory and cpu usage.
One process.
Load testing.
Ɨǽ

24. SMALL
SECURE
PERFORMANT
STABLE
IMMUTABLE
Ɨǽ

25. STABLE
Lock the image version.
Lock the runtime version(s).
Tag your image.
Proper logging.
Image guideline for your
team.
Ɨǽ

26. SMALL
SECURE
PERFORMANT
STABLE
IMMUTABLE
Ɨǽ

27. IMMUTABLE
Use volumes wisely.
Loosely coupled.
Don’t use databases inside
a image.
Use external services for
persistency.
Ɨǽ

28. dev » test » stage » production
small - secure - performant - stable - immutable
ǽ
Minimal Lovable Service Image

29. How the hell do I run
Docker in Production?...
and will it scale?

30. Ɨǽ
Ɨ 
monolith containerisation ± 70 %
monolith 1x
monolith image FAT

31. Ɨǽ
Ɨ

API first containerisation ± 20%
Ɨǽ
Ɨ
api 1x
frontend 1x
image frontend FAT
image api FAT

32. Ɨǽ
Ɨ

splitting monolith containerisation ± 6%
Ɨǽ
api 6x
frontend 1x
Ɨǽ
Ɨ
workers 10x
ƗƗƗ
ƗƗƗƗ
ƗƗ
image frontend FAT
image api THIN
image workers THIN
ƗƗƗ
ƗƗ
Ɨ

33. Ɨǽ
Ɨǽ
A 6x
B 12x
Ɨǽ
Ɨ
C 10x
ƗƗƗ
ƗƗƗƗ
ƗƗ
image B THIN
image A THIN
image C THIN
ƗƗƗ
ƗƗ
Ɨ
microservice architecture ± 4%
ƗƗƗ
ƗƗ
ƗƗ
ƗƗ
ƗƗ
Ɨ

message queue

34. people
good service
ǽ

35. DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING
DATA MANAGMENT
MONITORING
SECURITY

36. DEV/OPS/DESIGN FLOW
Have an image guideline.
Create a workflow using the same
image in all the software cycle
stages.
From design to production mimic
the environment.
Test heavily.
Ǻ

37. DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING
DATA MANAGMENT
MONITORING
SECURITY

38. ORCHESTRATION
Isolation of services.
Make use of the resource available.
Self healing.
Load distribution.
Adding nodes to your cluster.
Ǻ

39. DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING
DATA MANAGMENT
MONITORING
SECURITY

40. DISCOVERY
Find your services and
datasources with minimal code
change.
Versioning of running services.
Automagically update
discovery when new services
are online or scaled up/down.
Ǻ

41. DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING/SCHEDULING
DATA MANAGMENT
MONITORING
SECURITY

42. SCALING/SCHEDULING
Scale your containers.
Scale your docker cluster.
Scale your on/off jobs.
Failover groups.
Cross cloud clusters.
Load balancing.
Ǻ

43. DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING
DATA MANAGMENT
MONITORING
SECURITY


44. DATA MANAGEMENT
Backup and restores.
Clustering.
Verify your backups.
Run natively not in a container.
Ǻ


45. DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING
DATA MANAGMENT
MONITORING
SECURITY
ǟ

46. MONITORING
Get all the statistics of
resources (mem/load/net/res) used.
Aggregating of logs.
Debugging your containers.
Ǻ
ǟ

47. DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING
DATA MANAGMENT
MONITORING
SECURITYǺ

48. SECURITY
Intrusion detection and
prevention systems.
Denial of service protection.
Firewalling.
Failover groups.
Segregate container groups
VPC / bastion servers.
Verification of images.
Ǻ
Ǻ

49. start small & smart - scale up later
Ɨ
containerisation
Ǹ
Dž
ƗƗƗ

50. SMALL
SECURE
PERFORMANT
STABLE
IMMUTABLE
Ɨǽ
DEV/OPS/DESIGN FLOW
ORCHESTRATION
DISCOVERY
SCALING/SCHEDULING
DATA MANAGMENT
MONITORING
SECURITY
MLI
PLATFORM
CONTAINERS AS A SERVICE

51. When you get DevOps right, Microservices
architecture right and creating the right
minimal lovable Image and having the right
platform to run containers.
Ohh man, the future is bright and you don’t
go to hell!
ǽ

52. Daniël van Gils
@foldingbeauty
daniel@cloud66.com
www.cloud66.com
www.cloud66.com
blog.cloud66.com
habitus.io
startwithdocker.com
ready for your quest?
thank you