Amazon EC2 Spot Instances save money by giving you compute at up to 90 percent less than On-Demand Instances. In this session, we show you how to add Spot Instances to your Kubernetes cluster managed by Amazon EKS. We discuss best practices for using Spot Instances with containers, including building heterogeneous clusters and gracefully handling terminations.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Spot with
Amazon EKS
Omar Lari and Abhijit Lele
BDM, Container Services
Amazon Web Services
C O N 4 0 6

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Overview of Amazon Elastic Container Service for Kubernetes
(Amazon EKS)
Overview of Amazon Elastic Compute Cloud
(Amazon EC2) Spot
Provisioning of Amazon EC2 Spot with Amazon EKS
Auto Scaling in Amazon EKS
Handling interruptions

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EKS overview
Availability
Zone 1
Availability
Zone 2
Availability
Zone 3
API Server API Server API Server
etcd etcd etcd
Worker nodes Worker nodes Worker nodes

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EKS architecture
[mycluster].eks.amazonaws.com
Availability
Zone 1
Availability
Zone 2
Availability
Zone 3
Kubectl
AWS Cloud
VPC

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pay for compute capacity
by the second with no
long-term commitments
Amazon EC2 purchase options
Spare Amazon EC2 capacity at
savings of up to 90%
off On-Demand prices
Make a one- or three-year
commitment
and receive a significant discount
off On-Demand prices
To optimize Amazon EC2, combine all three purchase options!

9. Why
Unused Amazon EC2 capacity offered at steep discounts that Amazon Web Services (AWS) can
reclaim with 2 min. of notification
Up to 90% discount over
On-Demand prices
Increase throughput up to
10x while staying in budget
Launch through AWS services
(for example, Amazon Elastic
Container Service [Amazon ECS],
Amazon EKS, AWS Batch,
Amazon EMR) or integrated
third-parties

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EKS worker node provisioning with Amazon
EC2 Spot
• Recommend using the node labels to identify Amazon EC2 Spot
Instances
• Launch Amazon EC2 Spot Instances as part of Auto Scaling group
• Use Amazon EC2 Spot Instances best practice of mixed instance types

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Auto Scaling with Amazon EKS
Two dimensions to scaling
• Amazon EC2 instance through cluster-autoscaler
• Scale out Amazon EC2 Spot Instances
• Pods through HPA
• Scale out pods

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Handling interruptions
Instance gets terminated / maintenance / interrupted, workflow should:
• Stop directing new-traffic to the pods on terminating Amazon EC2
instance
• Gracefully drain connections of traffic already being served
• Re-instantiate pods elsewhere in Amazon EKS cluster

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Interrupt handler
• Catch Amazon EC2 Spot interruption event
• Leverage K8’s functionality to set node state to DRAIN
• Leverage K8’s schedulers to re-instantiate pods
https://github.com/kube-aws/kube-spot-termination-notice-handler

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Put it all together
[mycluster].eks.amazonaws.com
Availability
Zone 1
Availability
Zone 2
Availability
Zone 3
Kubectl
VPC
Instance
Auto Scaling group for m4.large Spot Instances
Auto Scaling group for t2.medium Spot Instances
Auto Scaling group for On-Demand Instances
Cluster Autoscaler Daemonset
Spot Interruption handler
Daemonset

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• https://aws.amazon.com/blogs/compute/run-your-
kubernetes-workloads-on-amazon-ec2-spot-instances-
with-amazon-eks/
• https://github.com/kube-aws/kube-spot-termination-
notice-handler
• https://eksworkshop.com/spot/

20. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Omar Lari : olari@amazon.com
Abhijit Lele : abhijitl@amazon.com