In this session, learn how AWS App Mesh makes it easy to monitor and control microservices running on AWS App Mesh standardizes how the microservices communicate, provides end-to-end visibility, and helps ensure high availability for your applications.

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Introducing AWS App Mesh
Tony Pujals
Senior Developer Advocate
AWS
M A D 3 0 3

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Agenda
Microservices
Service mesh
App Mesh
Ecosystem

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Agenda
Microservices
What do we mean by microservices and what's the problem?
Service mesh
What's a service mesh and why would we want one?
App Mesh
Orientation and demo walkthrough
Ecosystem
Our roadmap, partners, and where to go for more information

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Microservices
Don't get hung up on definition
Important architectural pattern for modern cloud applications
Made pragmatic by container technology

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Microservices
Don't get hung up on definition
Develop, deploy, maintain, and evolve parts of an application separately
Important architectural pattern for modern cloud applications
Optimize use of self-service, on-demand compute resources
Made pragmatic by container technology
Strong process isolation, small footprint, fast start time, and resource scheduling

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Microservices
Good for developers
Good for enterprise

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Microservices
Good for developers
Smaller components are easier to write and debug—increases velocity
Good for enterprise
Better developer velocity—decreases time to market

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Microservices
Good for developers
Smaller components are easier to write and debug—increases velocity
Good for enterprise
Better developer velocity—decreases time to market
Good for DevOps/infrastructure teams…?
It's complicated

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Microservices
Good for DevOps/infrastructure teams…?
It's complicated
Can be easier to reason about and optimize
• Resource consumption
• Scaling performance
Increased challenges around
• Configuration of many communicating parts
• Identification/resolution of many more possible points of failure

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Challenges
Controlling application-level communication across different
• Compute environments
• Container orchestrators
• Clusters
Keeping configuration synchronized with dynamic state as
• Communication circuits fail and recover
• As replicas scale out and back under variable load
End-to-end observability
• Logs/metrics/distributed tracing

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What you really (really) need for success (and sanity)
Reliable communication between service nodes
Ability to control routing through policy
React autonomously and responsively to dynamically changing state
Uniform, dependable, non-invasive mechanism for observability
All decoupled from application code and applied in a standardized, declarative,
and reliable fashion

13. B
C
A
D

14. B
CA D
A
B
C D

15. B
CA D
A
B
C D
D

16. B
CA D
A
B
C D

17. B
CA D
A
B
C D

18. B
CA D
A
B
C D

19. B
CA D
A
B
C D

20. B
CA D
A
B
C

21. B
CA D
A
B
C D

22. B
CA D
A
B
C D

23. B
CA D
A
B
C D

24. B
C1
A
D
C2

25. B
c1A D
c2
A
B
c1
c2
D

26. B
A D
c2
A
B
c2
D

27. B
A D
c2
A
B
c2
D

28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The sidecar proxy pattern
All service-to-service traffic
("east-west") routed to out-
of-process sidecar proxy
Proxy
Microservice
All service ingress/egress
traffic flows through the
proxy

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The sidecar proxy pattern
Proxy
Microservice
Proxy
Discovery
Routing
Monitoring
Microservice
App logic

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The sidecar proxy pattern
with containers
Proxy
Microservice
Task or Pod

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Why sidecar proxy vs. libraries or app code?
Overall—migrate to microservices safer and faster
Reduce work required by
developers
Follow best practices Use any language
or platform
Simplify visibility,
troubleshooting, and
deployments

32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Sidecar proxy: Foundation of a service mesh
In general
Sidecar proxies are used as a common building block for implementing a service
mesh
Enables service-to-service communication control and observability
As a dedicated function outside of the application layer

33. B
A D
c2
A
B
c2
D

34. B
C1
A
D
C2

35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
This is what AWS App Mesh does

36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
And it does it continuously

37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
App Mesh uses Envoy proxy
OSS community project
Wide community support, numerous integrations
Stable and production proven
Graduated Project in Cloud Native Computing Foundation
Started at Lyft in 2016

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Why App Mesh?
http/tcp
Service
team A
Service
team B
Common need: Manage inter-service traffic
How to generate uniform logs,
metrics and traces
How to load balance traffic
How to shift traffic between
deployments
How to decouple service teams
How to minimize impact to
application code

39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Why App Mesh?
HTTP/TCP
Service
team A
Service
team B
Control plane
Translates logical intent to proxy config
Distributes proxy config
Proxy
Sits between all services
Manages and observes traffic
Control plane

40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
App Mesh: Application-level communication across AWS
Amazon ECS
AWS Fargate
Amazon EKS
Amazon EC2
AWS App Mesh
Kubernetes on EC2

41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
App Mesh: Application observability
Logging
HTTP access logging
Amazon CloudWatch Logs
Available as container logs on Amazon
ECS, Amazon EKS,
AWS Fargate
Metrics
CloudWatch metrics
StatsD (with tags)
Prometheus
Tracing
AWS X-Ray
Other Envoy tracing drivers

42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
App Mesh: Client-side traffic management
Traffic shaping
Load balancing
Weight targets
Service discovery (DNS + AWS Cloud Map)
Health checks
Retries*
Timeouts*
Circuit breakers*
Routing controls
Protocols support (HTTP, TCP, gRPC*)
Path based
Header based*
Cookie based*
Host based*
*Coming soon

43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
App Mesh is generally available worldwide
Observability and traffic control
Easily export logs, metrics, and traces
Client-side load balancing, routing
AWS container services compatibility
Amazon Elastic Container Service (Amazon ECS)
Amazon Elastic Container Service for Kubernetes (Amazon EKS)
AWS Fargate
EC2 compatibility
Integrate with services running directly on EC2 instances

44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Demo notes
Mesh
Virtual node
Virtual router and routes
Virtual service
Create and manage these in App Mesh
API, CLI, SDK, or
AWS Management Console
Proxies
Services
Service discovery
Configure and run proxies and services
on Amazon ECS, Fargate, Amazon EKS,
Amazon EC2
Service discovery with
AWS Cloud Map

46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Partners

48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Roadmap
Today
Client-side load balancing
Path-based routing
Egress traffic
AWS Cloud Map service discovery
App Mesh console
AWS X-Ray tracing
Envoy supported tracing
CloudWatch Logs, metrics
StatsD, Prometheus metrics
Amazon ECS, Fargate integration
Amazon EKS integration
Amazon EC2 integration
Near term
AWS PrivateLink
AWS Cloud Map selectors
gRPC routing
Header-based routing
Cookie-based routing
Host-based routing
Timeout policy
Retry policy
Circuit-breaker policy
End-to-end encryption
Longer term
mTLS
Mesh peering
Global rate limiting
Managed ingress
Other protocols

50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Getting started
Product overview
https://aws.amazon.com/app-mesh
Documentation
https://docs.aws.amazon.com/app-mesh/index.html
Examples
https://github.com/aws/aws-app-mesh-examples
Issues, roadmap, beta channel
https://github.com/aws/aws-app-mesh-roadmap

51. Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Tony Pujals
Senior Developer Advocate
AWS
@tonypujals