Microservices are a great way to segment your application into well-defined, self-contained units of functionality. Come join us in this chalk talk as we discuss two common architectures for deploying microservices: containers and serverless. Speaker: Rajanikanth Bhargava Chilakapati - Solutions Architect, AWS

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Using Containers & Serverless to
Deploy Microservices
Raj Chilakapati
Solutions Architect
AWS
A R C 2 1 4

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Our Goal
Explore the benefits and trade-offs of container and
serverless architectures
• Understand serverless and container options on AWS —
both offer an opportunity to leverage managed platforms.
•Overview of architectural considerations for both models
•Review of common use cases and approaches

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Options for architecting your microservices
AWS Lambda
Amazon EKS
Amazon ECS
AWS Fargate
Containers Serverless

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Containers: ECS, EKS, Fargate
• Platforms to run containerized applications on AWS
• Easily run and scale applications to meet your needs
• Native integration with other AWS services
• Pairs well with CI/CD
• Benefits
• Portability
• Control
• Rich Ecosystem

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Container Web Architecture
VPC
Availability Zone A Availability Zone B
Public Subnet
Private Subnet
Public Subnet
Private Subnet
NAT Gateway NAT Gateway
ECS Cluster
Auto Scaling Group
Instances Instances
Internet
Gateway

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.@ T I F F A N Y F A Y J
Customers needed an easier way to manage large clusters

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.@ T I F F A N Y F A Y J
Amazon Elastic Container Service
Cluster management as a hosted service
Scheduling and Orchestration
Cluster Manager Placement Engine

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.@ T I F F A N Y F A Y J
Scheduling and Orchestration
Cluster Manager Placement Engine
ECS
AMI
Docker
Engine
ECS
Agent
EC2 instance
ECS
AMI
Docker
Engine
ECS
Agent
EC2 instance
ECS
AMI
Docker
Engine
ECS
Agent
EC2 instance

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.@ T I F F A N Y F A Y J
Introducing AWS Fargate
Managed by AWS
No EC2 instances to provision, scale, or manage
Elastic
Scale up & down seamlessly
Pay only for what you use
Integrated
with the AWS ecosystem: VPC networking,
Elastic Load Balancing, IAM permissions, Amazon
CloudWatch, Service Discovery, and more

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.@ T I F F A N Y F A Y J
AWS container services landscape
Management
Deployment, scheduling, scaling, &
management of containerized
applications
Hosting
Where the containers run
Amazon Elastic
Container Service
Amazon Elastic
Container Service for
Kubernetes
Amazon EC2 AWS Fargate
Image registry
Container image repository
Amazon Elastic
Container Registry

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless: Lambda
• Platform to run code without thinking about servers
• Our definition:
• No servers to provision or manage
• Scales with usage
• Never pay for idle
• High Availability built in, Fault tolerance made easier.
• Native integration with other AWS services
• Benefits:
• Event-driven framework
• Multiple invocation models
• Opinionated

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Serverless Web Architecture
AWS Cloud

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architectural Considerations
• Custom code & services: build
your own environment
• Numerous choices
• Requires management and
orchestration*
• Standardized choices
• Opinionated approach drives
scalable platform
• Security and scaling
managed by AWS
• Serverless and
“containerless”
Containers Serverless
* - Fargate changes this model

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Other Considerations
• Wide array of power options
• Power level managed by container,
scoped by host
• Fargate offers streamlined model
• Multiple networking modes
• Mature tooling
• Easy power level selection
• 128MB to 3GB
• Network and CPU assigned
proportionally
• Can overwhelm backends
• Developing tooling
• Organizational readiness?
Containers Serverless
* - Fargate changes this model

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ideas on selecting … Containers
When you need…
• Lower startup latency
• Support for long running compute jobs (> 15 minutes)
• Predictable, high traffic usage
When you want…
• Complete control of compute environment
• But not just for the sake of control

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ideas on selecting … Serverless
When you need…
• To trigger action on an event
• Support for varying utilization
• Ability to handle unknown demand
When you want to…
• Quickly prove business value
• Hand operational complexity (e.g. patching, scaling) to AWS
• Make fewer decisions

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What if I can’t decide?

21. Runtime environment
compatible with AWS
Lambda?
.NET Core, Go, Java, Python,
or Node.js
Unknown
demand and
below RPS
breakeven
Stateful or
storage-
intensive use
case?
Desire orchestration
portability OR open
source fan?
Amazon EKSAre you comfortable
managing your own
infrastructure?
Amazon ECSAWS Fargate
Deployment
Package size
<= 50MB
Desired Service
runtime <= 15
minutes?
Decision Tree – well, almost!
AWS Lambda

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon API Gateway
Enables best practices for distributed systems:
• Throttling
• Retry with exponential fallback
• Fail fast
Support for public and private services

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS AppSync
Enables data-driven, real-time apps:
• Multiple data sources, one endpoint
• Client specifies payload
• Subscription to latest data

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS X-Ray
Delivers insight into distributed applications:
• Uncover application issues
• Improve application performance
• Ready for ECS, Lambda, and more

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
To learn more…
Containers
https://aws.amazon.com/containers/
Serverless
https://aws.amazon.com/serverless/

27. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Raj Chilakapati
chilakap@amazon.com

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.