Presentation given at Raleigh DevDay on August 1, 2017 during the Container Session

2. WIFI: awsDevDay | PASS: CodeHappy
U P N E X T :
Advanced Container
Management and Scheduling

3. T H A N K S T O O U R F R I E N D S A T :

4. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
John Pignata, Solutions Architect
August 1, 2017
Advanced Container
Management and Scheduling

5. What is Amazon ECS?
Amazon EC2 Container Service (ECS) is a highly scalable,
high performance container management service. You
can use Amazon ECS to schedule the placement of
containers across your cluster. You can also integrate your
own scheduler or third-party scheduler to meet business
or application specific requirements.

6. Agenda
Container Management
Scheduling
Benefits
Demo

7. Container Management

8. Maintains Available Resources
Tracks Resource Changes
Accepts Resource Requests
Guarantees Accuracy and Consistency
What is a Container Manager?

9. CPU
Memory
Ports
Disk Space
Disk IOPS
Network Bandwidth
Resources

10. ECS
Agent
Docker
Task
Container Instance
Container
ECS Agent
Task
Container

11. Instance Registration
register-container-instance --total-resources
[
{
“name” : “cpu”,
“type” : “integerValue”,
“integerValue” : 2048
},
…
]

12. Modifying Exposed Resources

13. Accepting Resource Requests

14. Tasks
Shared Data Volume
Containers
launch
Container
Instance
Volume Definitions
Container Definitions

15. Starting a Task
API
User /
Scheduler
StartTask

16. Starting a Task
API
User /
Scheduler
StartTask
Cluster Management Engine

17. Starting a Task
API
User /
Scheduler
StartTask
Cluster Management Engine
Agent Communication

18. Starting a Task
API
User /
Scheduler
StartTask
Cluster Management Engine
Agent Communication
Docker
Container Instance
ECS Agent
Task
Container
WebSocket

19. Starting a Task
API
User /
Scheduler
StartTask
Cluster Management Engine
Agent Communication
Docker
Task
Container Instance
Container
ECS Agent
Task
Container
SubmitStateChange

20. Tracking Resource Changes

21. Terminated Task
API
User /
Scheduler
StartTask
Cluster Management Engine
Agent Communication
Docker
Task
Container Instance
Container
ECS Agent
SubmitStateChange

22. Missing Container Instance
API
User /
Scheduler
StartTask
Cluster Management Engine
Docker
Task
Container Instance
Container
ECS Agent
?
Agent Communication

23. Terminated Container Instance
API
User /
Scheduler
StartTask
Cluster Management Engine
Agent Communication
Termination
Notifier
Docker
Task
Container Instance
Container
ECS Agent

24. Guaranteeing Accuracy and
Consistency

25. Amazon ECS under the Hood
IDN-1 IDN IDN+1 IDN+2 IDN+3 IDN+4 IDN+5
IDN+6
IDN+5
WRITE
READ

26. Amazon ECS under the Hood
IDN-1 IDN IDN+1 IDN+2 IDN+3 IDN+4 IDN+5
IDN+6IDN+3
IDN+5IDN+2
WRITE WRITE
READREAD

27. Anatomy of Task Placement
Cluster Constraints
Custom Constraints
Placement Strategies
Apply Filter
Satisfy CPU, memory, and port requirements
Filter for location, instance-type, AMI, or custom
attribute constraints
Identify instances that meet spread or binpack
placement strategy
Select final container instances for placement

28. New Cluster Query Language

29. Filtering: Match on Instance Family or Type

30. Filtering: Match on Multiple Expressions

31. Filtering: Match on Custom Attributes

32. Task Placement Examples

33. g2.2xlarge t2.small t2.micro t2.medium
t2.medium t2.small g2.2xlarge
t2.small
t2.small t2.medium
us-east-1aus-east-1d
Placement: Targeting Instance Type & Zone

34. g2.2xlarge t2.small t2.micro t2.medium
t2.medium t2.small g2.2xlarge t2.small
us-east-1aus-east-1d
g2.2xlarge t2.medium
t2.micro t2.small
us-east-1c
Placement: Spread across Zone and Binpack

35. Running a Service

36. t2.medium g2.2xlarge t2.micro t2.small
t2.small t2.small g2.2xlarge t2.small
t2.small t2.small
g2.2xlarge t2.small
Placement: Services – Distinct Instances

37. Console: Getting Started with Placement

38. Console: Placement Templates to Get Started

39. Console: Customizing Placement Strategies

40. Scheduling

41. Server
Guest OS
Bins/Libs Bins/Libs
App2App1
Scheduling one resource is straightforward

42. Scheduling a cluster is hard
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS

43. Amazon ECS: Under the Hood
ALB ALB
AZ 1 AZ 2
user / scheduler
Scheduler
Cluster State Service
Placement Engine
Event Stream

44. Event Stream

45. Consuming Real-time Events

46. Three Steps to Getting Started with Events
Step 1: Create CWE Rule Step 2: Create SNS Topic Step 3: Put Events to SNS

47. Time and Event-Based Task Scheduling
• Schedule on fixed time intervals (e.g.: number of minutes, hours, or days)
• or use cron expressions.
• Set Amazon ECS as a CloudWatch Events target

48. Time and Event-Based Task Scheduling
• Schedule on fixed time intervals (e.g.: number of minutes, hours, or days)
• or use cron expressions.
• Set Amazon ECS as a CloudWatch Events target

49. Introducing

50. What is Blox?
Choice
Control
Developer Experience

51. Building with Blox
scheduler cluster state service

52. Set Up Blox Locally
Step 1: git clone https://github.com/blox/blox.git
Step 3: docker-compose up -d
Step 4: start using Blox locally
Step 2: deploy CloudFormation template to configure ECS event stream and SQS queue

53. Swagger Spec: Cluster State Service

54. Daemon Scheduler

55. t2.small t2.small t2.small
Blox: Daemon Scheduler
t2.small t2.small t2.small
scheduler cluster state service
t2.small t2.small t2.small

56. Contributing to Blox
• Blox is licensed under Apache 2.0
• Open an issue or pull request
• Watch our roadmap on GitHub
• Check out our Gitter channel
blox.github.io

57. Blox Scheduling

58. Blox - customized

59. Thank You!

60. Don’t Forget Evaluations!