By packaging software into standardized units, containers give code everything it needs to run, ensuring consistency from your laptop all the way into production. But once you have your code ready to ship, how do you run and scale it in the cloud? In this session, you will learn about your options for running containers on AWS and the integrated AWS services that you can take advantage of to run and scale containerized applications.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Tony Pujals
Sr. Developer Advocate
Amazon Elastic Container Services
August 8, 2018
Getting Started with Containers
and ECS

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why Docker containers? FizzBuzz!

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Application environment components
Runtime Engine
Code
Dependencies

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Local Laptop Staging / QA Production On-Premise
Different environments

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Local Laptop Staging / QA Production On-Prem
It worked on my machine, why not in
production?
v6.0.0 v7.0.0 v4.0.0 v7.0.0

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Docker
Lightweight container virtualization platform.
Licensed under the Apache 2.0 license.
First released March 2013
Built by Docker, Inc.

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
docker build

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Docker Image
Read only image that is used as a
template to launch a container.
Start from base images that have
your dependencies, add your custom
code.
Docker file for easy, reproducible
builds.
bootfs
kernel
Base image
Image
Image
Container
References
parent
image

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Container Registry
(Private or Public)
docker push

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Elastic Container Registry (Amazon ECR)
• Cloud-based Docker image registry
• Fully managed
• Secure – images encrypted at rest,
integrated with IAM
• Scalable and Highly Available
• Integrated with Amazon ECS and the
Docker CLI

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Container Registry
(Private or Public) Production
Development
docker run

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
docker push
docker rundocker build

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Local Laptop Staging / QA Production On-Prem
Four environments, same container

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Foo App
Bar App
Performance &
Cost Savings
One machine, multiple containers

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VM vs Container
Server (Host)
Host OS
Hypervisor
Guest OS Guest OS Guest OS
Bins/Libs Bins/Libs Bins/Libs
App 1 App 2 App 3
VM
Server (Host)
Host OS
Docker
Bins/Libs Bins/Libs Bins/Libs
App 1 App 2 App 3
Container

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Benefits
Portable runtime application environment
Package application and dependencies in a single artifact
Run different application versions (different dependencies)
simultaneously
Faster development & deployment cycles
Better resource utilization

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Use Cases
Consistent environment between Development & Production
Service-Oriented Architectures & Microservices
Short lived workflows, batch jobs, cron jobs
Isolated environments for testing

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
One monolithic container, a couple hosts

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A couple containers on a few hosts

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Many containers, many hosts

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How do I manage containers
across many hosts?

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Elastic Container Service (Amazon ECS)
• Container management service
• Fully managed
• Scalable and Highly Available
• Microservices, batch workers,
machine learning applications
• Integrated with
• Amazon ECR
• AWS networking, storage,
management tools
• AWS Fargate

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon ECS
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet LOAD
BALANCER
LOAD
BALANCER

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cluster of hosts
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet LOAD
BALANCER
LOAD
BALANCER
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lightweight agent on each host
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet LOAD
BALANCER
LOAD
BALANCER
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
API for launching containers on the cluster
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet LOAD
BALANCER
LOAD
BALANCER
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Task Definition (An application to run)
CPU and memory requirement
Image to run
Environment
Variables
Application networking details

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Service Definition (Where to run app, what to connect app to)
Description of task to run
Load balancer to associate
app with
Optional strategies for how to
control how to run the app in
the cluster

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Container task is placed on a host
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet LOAD
BALANCER
LOAD
BALANCER

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Traffic is sent to your host
EC2 INSTANCES
ECS
AGENT
TASK
Container
TASK
Container
ECS
AGENT
TASK
Container
TASK
Container AGENT COMMUNICATION
SERVICE
Amazon
ECS
API
CLUSTER MANAGEMENT
ENGINE
KEY/VALUE STORE
ECS
AGENT
TASK
Container
TASK
Container
Internet LOAD
BALANCER
LOAD
BALANCER

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PRODUCTION WORKLOADS ON AWS
AWS VPC
networking mode
Advanced task
placement
Deep integration
with AWS platform
ECS CLI…{ }
Global footprint
Powerful scheduling
engines
Auto scaling
CloudWatch metrics
Load balancers

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customers Using Containers at Scale

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CUSTOMERS ARE OUR KEY!
60+
releases
since 2015
CUSTOMERS
RELEASE
FEEDBACK /
NEW USE
CASES
LEARN
EXPERIMENT,
INNOVATE,
& BUILD
FEATURES

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
I don’t want to deal with
hosts at all!

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cluster
Management
is a relic
of physical
infrastructure

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ENABLE FOCUS ON APPLICATIONS

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
No instances
to manage
Task
native API
Resource
based pricing
Simple, easy to use,
powerful – and new
consumption model

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS ECS (Fully managed platform for your container)
Control Plane
Your container
HostsContainer
No instances! Amazon ECS API

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PRODUCTION WORKLOADS ON AWS
AWS VPC
networking mode
Advanced task
placement
Deep integration
with AWS platform
ECS CLI…{ }
Global footprint
Powerful scheduling
engines
Auto scaling
CloudWatch metrics
Load balancers

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Using Amazon ECS

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Deploying Containers on ECS – Choose a
Scheduler
Task scheduler
Batch Jobs
Run tasks once
RunTask (random)
StartTask (placed)
Service scheduler
Long-Running Apps
Health management
Scale-up and scale-down
AZ aware
Placement strategies

43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Unit of work
Grouping of related Containers
Runs on Fargate or EC2
Tasks

44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Task Definition (An application to run)
CPU and memory requirement
Image to run
Environment
Variables
Application networking details

45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Running services

46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Create a Service
Good for long-running
applications and services
What to run, and how
many to run, let ECS
launch containers,
monitor, and restart them

47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Service Definition (Where to run app, what to connect app to)
Description of task to run
Load balancer to associate
app with
Optional strategies for how to
control how to run the app in
the cluster

48. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Create Service
“Run 7 copies, distributed
across availability zones,
try to densely utilize CPU
on the instances”

49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Update Service
Deploy new version of application task

50. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Update Service (cont.)
Specify a deployment configuration for your service:
• minimumHealthyPercent: lower limit (as a percentage of
the service's desiredCount) of the number of running
tasks that must remain running in a service during a
deployment.
• maximumPercent: upper limit (as a percentage of the
service's desiredCount) of the number of running tasks
that can be running in a service during a deployment.

51. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Update Service (cont.)
Deploy using the least space: minimumHealthyPercent =
50%, maximumPercent = 100%

52. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Update Service (cont.)
Deploy quickly without reducing service capacity:
minimumHealthyPercent = 100%, maximumPercent =
200%

53. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ECS launches containers and
updates load balancer with
their IP addresses
Request
Client sends
request to load
balancer using its
CNAME
Load Balancer
directs request to
one of them
service.mycompany.com

54. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Application
Load Balancer

55. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Network
Load Balancer

56. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Routing via Application Load Balancer
Host and Path-based routing
Dynamic Port Mapping
HTTP/2
WebSockets
Detailed Logging

57. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Routing via Network Load Balancer
IP-based routing
Allows you to define rules that route traffic to different target groups based on the header information in the TCP
connection.
Layer 4 - TCP Pass Through
The NLB allows you to form direct TCP connections from clients to Amazon ECS tasks and services. This allows source
IP data to be passed directly to containers.
Dynamic Port Mapping
Provides the ability to load-balance across multiple ports on the same Amazon EC2 instance. This functionality
specifically targets the use of containers and is integrated into Amazon ECS.
High Throughput
Capable of handling millions of requests per second while maintaining ultra-low latencies.
Optimized to handle sudden and volatile traffic patterns while using a single static or dynamic IP address per
Availability Zone

58. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
In Summary
• Docker allows you to easily run different code across different
machines in a standardized, easily defined environment
• Amazon Elastic Container Registry is a secure, private registry for
Docker container images
• Amazon Elastic Container Service allows you to schedule and run
Docker containers on AWS

59. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AMAZON CONTAINER SERVICES
Choose your orchestration tool1
Choose your launch type2
ECS EKS
EC2 Fargate EC2 Fargate
We give you the power to choose:

60. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!