The document discusses different microservices deployment patterns at scale, including one microservice per virtual machine or container with load balancing, continuous delivery using CI/CD systems, and deployment strategies like rolling updates, canary releases, A/B testing, and blue-green deployments. It also covers deploying microservices on PaaS platforms and serverless architectures using functions as a service.

1. MICROSERVICES
DEPLOYMENT PATTERNS
Abhishek Tiwari http://abhishek-tiwari.com ! @abhishektiwari

2. CUPCAKE MICROTECTURE

3. TO BUILD MICROSERVICE
AT SCALE YOU NEED

4. TO BUILD MICROSERVICE
AT SCALE YOU NEED

5. TO BUILD MICROSERVICE
AT SCALE YOU NEED

6. Well-architected

7. Well-architected

8. Well-architected

9. Well-architected

10. Well-architected

11. DEPLOYMENT PATTERNS
•
•
•
•

12. THINGS TO CONSIDER
!
"
"
!
"
"
!
"
"
!

13. EXAMPLE MICROSERVICES LANDSCAPE
Web " Mobile #
API Gateway

14. EXAMPLE MICROSERVICES LANDSCAPE
Web " Mobile #
API Gateway

15. EXAMPLE MICROSERVICES LANDSCAPE
Web " Mobile #
API Gateway

16. ONE MICROSERVICE PER VM/SERVER
OS
Service
Hypervisor
OS OS
Service Service
VM VM
Abhishek Tiwari http://abhishek-tiwari.com ! @abhishektiwari

17. ONE MICROSERVICE PER VIRTUAL MACHINE
(WITH ELB)
API Gateway

18. ONE MICROSERVICE PER VIRTUAL MACHINE
(WITH ELB)
API Gateway

19. ONE MICROSERVICE PER VIRTUAL MACHINE
(WITH ELB)

20. ONE MICROSERVICE PER VIRTUAL MACHINE
(WITH ELB)
API Gateway

21. ONE MICROSERVICE PER VIRTUAL MACHINE
(WITH ELB)
API Gateway

22. ONE MICROSERVICE PER VIRTUAL MACHINE
(WITH ELB)
API Gateway

23. CONTINUOUS DELIVERY

24. CONTINUOUS DELIVERY
Using CI System Only

25. CONTINUOUS DELIVERY
Using CI System Only

26. DEPLOYMENT STRATEGY
Rolling Update – One Instance At A Time

27. DEPLOYMENT STRATEGY
Rolling Update – One Instance At A Time

28. DEPLOYMENT STRATEGY
Rolling Update – One Instance At A Time

29. DEPLOYMENT STRATEGY
Rolling Update – One Instance At A Time

30. DEPLOYMENT STRATEGY
Rolling Update – One Instance At A Time

31. DEPLOYMENT STRATEGY
Rolling Update – One Instance At A Time

32. DEPLOYMENT STRATEGY
Rolling Update – One Instance At A Time

33. DEPLOYMENT STRATEGY
Canary Release – % Users At A Time
100%

34. DEPLOYMENT STRATEGY
Canary Release – % Users At A Time
25%75%

35. DEPLOYMENT STRATEGY
Canary Release – % Users At A Time
60% 40%

36. DEPLOYMENT STRATEGY
Canary Release – % Users At A Time
50% 50%

37. DEPLOYMENT STRATEGY
Canary Release – % Users At A Time
40% 60%

38. DEPLOYMENT STRATEGY
Canary Release – % Users At A Time
25% 75%

39. DEPLOYMENT STRATEGY
Canary Release – % Users At A Time
0% 100%

40. DEPLOYMENT STRATEGY
A/B– Equal Split of % Users
100%

41. DEPLOYMENT STRATEGY
A/B– Equal Split of % Users
50%50%

42. DEPLOYMENT STRATEGY
Blue-Green

43. DEPLOYMENT STRATEGY
Blue-Green

44. DEPLOYMENT STRATEGY
Blue-Green

45. DEPLOYMENT STRATEGY
Blue-Green

46. CONTINUOUS DELIVERY
Using CI System + Spinnaker

47. Spinnaker Deck

48. OBSERVATIONS

49. ONE MICROSERVICE PER CONTAINER
Abhishek Tiwari http://abhishek-tiwari.com ! @abhishektiwari

50. ONE MICROSERVICE PER CONTAINER
(WITH ELB)
API Gateway

51. ONE MICROSERVICE PER CONTAINER
(WITH ELB)
API Gateway

52. ONE MICROSERVICE PER CONTAINER
(WITH ELB)
API Gateway

53. ONE MICROSERVICE PER CONTAINER
(WITH ELB)

54. ONE MICROSERVICE PER CONTAINER
(WITH HA/AUTO-SCALING)
API Gateway
Port Instance 8003
Port Container 8003
Port ELB 80 Port ELB 80
Port Instance 6003
Port Container 6003

55. ONE MICROSERVICE PER CONTAINER
(SINGLE MULTI-AZ CONTAINER CLUSTER)
API Gateway

56. ONE MICROSERVICE PER CONTAINER
(MULTIPLE SINGLE-AZ CONTAINER CLUSTER)
API Gateway

57. ONE MICROSERVICE PER CONTAINER
With ELB & ILB
API Gateway

58. ONE MICROSERVICE PER CONTAINER
More On ELB, ILB & Cluster

59. ONE MICROSERVICE PER CONTAINER
More On Service Discovery & Networking

60. ONE MICROSERVICE PER CONTAINER
Rolling Updates, Blue-Green and Canary

61. CONTINUOUS DELIVERY

62. CONTINUOUS DELIVERY
Using CI System Only

63. MARATHON DC/OS

64. KUBERNETES

65. OBSERVATIONS

66. ONE MICROSERVICE PER PaaS SERVICE
Abhishek Tiwari http://abhishek-tiwari.com ! @abhishektiwari

67. ONE MICROSERVICE PER PaaS SERVICE
(GOOGLE APP ENGINE)
https://version-dot-service-dot-app-id.appspot.com

68. GOOGLE APP ENGINE

69. GOOGLE APP ENGINE

70. GOOGLE APP ENGINE

71. GOOGLE APP ENGINE

72. GOOGLE APP ENGINE

73. GOOGLE APP ENGINE

74. OBSERVATIONS

75. ONE MICROSERVICE AS A SET OF COMPUTE
FUNCTIONS
Abhishek Tiwari http://abhishek-tiwari.com ! @abhishektiwari

76. FaaS - Function as a Service

77. AWS Lambda Function
Amazon API Gateway
ƛƛ
ƛ
ƛ
ƛ
ƛ ƛ
ƛ
ƛ
ƛ

78. AWS Lambda Function

79. AWS Lambda Function

80. AWS Lambda Function

81. OBSERVATIONS

82. Thank you
Abhishek Tiwari http://abhishek-tiwari.com ! @abhishektiwari