Modern applications are often composed of multiple microservices that each perform a specific function. Reliable service-to-service communication is achievable with a service mesh which removes the complexity for data monitoring and traffic routing. In this session we will present the key features provided by AWS App Mesh as a service mesh that makes it easy to control and monitor communications for container-based microservices running on AWS.

1. S U M M I T
SYDNEY

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Control and monitor microservices
on AWS using AWS AppMesh
Nickk Sun
Solutions Architect
Amazon Web Services

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Monolith

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Monoliths are good,
but they have some limitations
Coordination overhead
Poor modularity - No DRY
High impact of change
Poor scalability
Long build time
Monolith

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
When the impact of change is small,
release velocity can increase
Monolith
Does everything
Microservices
Does one thing
Monolith

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
MICROSERVICE
API
API
MICROSERVICE
MICROSERVICE
EVENT
API
MICROSERVICE
EVENT
API
MICROSERVICE
APPLICATION
Mobile client
Client
IoT
PERSISTENCE PERSISTENCE

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Service
Service
Service
Service
Service
Service
Service
Service
Service
Service
Service
Service

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Istio

13. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“AWS App Mesh is a service mesh based on the
Envoy proxy that makes it easy to monitor and
control containerised microservices.”

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Observability and traffic control
Easily export logs, metrics, and traces
Routes for deployments
AWS container services compatibility
AWS Fargate
Amazon Elastic Container Service (Amazon ECS)
Amazon Elastic Container Service for Kubernetes (Amazon EKS)
Self-managed Kubernetes on AWS
AWS App Mesh

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
OSS project
Wide community support, numerous integrations
Stable and production-proven
“Graduated Project” in Cloud Native Computing Foundation
Started at Lyft in 2016
AWS App Mesh uses Envoy proxy

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
envoy

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Representing your sample app in AWS App Mesh
Elastic
Load
Balancing
Microservices
Mesh – [myapp]
Virtual
Node A
Service
Discovery
Listener Backends
Virtual
Node B
Service
Discovery
Listener Backends

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Virtual node
Virtual Node
Service
Discovery
BackendsListeners
Virtual Node
Logical representation
of runtime services
Backends
Set of destinations that this node
will communicate with (hostnames)
Service Discovery
Describes how its callers and locate this
node (DNS hostname or AWS Cloud Map)
Listeners
Policies to handle incoming
traffic
e.g.: port, Health check

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Elastic
Load
Balancing
Microservices
Mesh – [myapp]
Virtual
Node A
Virtual
Node B
Virtual
Router
Routes
Create route
Virtual Service

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Virtual router and routes
Virtual router: B
HTTP route
targets:
prefix: /
B
Route B
Virtual node
destination + weight

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Virtual service
Virtual Service
Virtual Node B
Service
Discovery
Listener Backends
Virtual router: B
HTTP route
targets:
prefix: /
B

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Update routes
Virtual router: B
HTTP route
targets:
prefix: /
B
B’
Route B
Virtual node
destination + weight
Route B’
New service or service
version

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Mesh – [myapp]
Virtual
Node A
Service
Discovery
BackendListener
Virtual router
HTTP route
action:
match: /
B
B’
Service B
Virtual
Node B’
Service
Discovery
Listener Backends
Virtual
Node B
Service
Discovery
Listener Backends

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Virtual
Node B
Mesh
Service A
Service B
Service C
Virtual
router
Virtual
router
Service D
Virtual
router

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Demo - architecture - microservices
Colour
Gateway
Colour
Teller

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Demo - architecture - microservices
Colour
Gateway
Virtual router:
Colour Teller
HTTP route
targets:
prefix: /
red
blue
white
Colour
Teller
Red
Colour
Teller
Blue
Colour
Teller
White
Virtual Service

27. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Demo - architecture - microservices
Colour
Gateway
Virtual router:
Colour Teller
HTTP route
targets:
prefix: /
red
blue
white
Colour
Teller
Red
Colour
Teller
Blue
Colour
Teller
White
Virtual Service

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Monitor with AWS X-Ray
Environment Variable:
ENABLE_ENVOY_XRAY_TRACING 1

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Monitor with AWS X-Ray
Avg.1ms
59 t/min
Avg.0.17ms
59 t/min
Avg.1ms
59 t/min
Avg. 8ms
58 t/min
Client
AWS X-Ray

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Monitor with Amazon CloudWatch
Valid values: trace, debug, info, warning, error, critical, off
Environment Variable:
ENABLE_ENVOY_LOG_LEVEL debug

32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Monitor with Prometheus
scrape_configs:
- job_name: 'envoy'
metrics_path: '/stats/prometheus'
static_configs:
- targets: ['localhost:9901']

33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Recap – AWS App Mesh

34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS container services compatibility
AWS Fargate
Amazon Elastic Container Service (Amazon ECS)
Amazon Elastic Container Service for Kubernetes (Amazon EKS)
Self-managed Kubernetes on AWS
Now Available in AWS Sydney Region
There is no additional charge for using AWS App Mesh.

35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Resources
https://github.com/aws/aws-app-mesh-examples
vote app
https://github.com/aws-samples/voteapp

36. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Nickk Sun
yaoys@amazon.com
nickksun