Amazon EC2 Auto Scaling now makes it easier than ever to provision and automatically scale instances across purchase options, and instance types in a single Auto Scaling group (ASG), to optimize scale, performance, and cost. Now you can include Spot Instances with On-Demand and RIs in a single ASG, to save up to 90% on compute. In this chalk talk, we will show you how to set up these Auto Scaling groups and discuss the different combinations you can configure that best suit your use case for lowering cost and improving availability.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Save up to 90% using multiple
purchase options in Amazon EC2
Auto Scaling
Susanna Ng
Senior Software Development Engineer
AWS, EC2 Auto Scaling
C M P 3 9 0
Ramya Sunil
Software Development Manager
AWS, EC2 Auto Scaling

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Amazon EC2 Auto Scaling
Auto Scaling Groups with multiple purchase options and instance types
Example workload on AWS
Demo
Q&A

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is Amazon EC2 Auto Scaling?
Amazon EC2
Auto Scaling

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 purchase options

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Auto Scaling Group (ASG) introduction
Logical group of instances
for your service
Minimum and maximum bound
for the number of instances that can
be in the ASG
Launch or terminate instances
to meet the desired capacity
Desired
Min
Max

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Scheduled
scaling
Dynamic
scaling
Predictive
scaling
Manual
scaling
Amazon EC2 Auto Scaling

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Before: Multiple ASGs to use Spot, On-Demand, and RIs together
m4.large Spot ASG
m5.large Spot ASG
c4.large On-Demand ASG
Availability
Zone 1
Availability
Zone 2
Availability
Zone3
One ASG for each
purchase option
and instance type

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
After: Include Spot, On-Demand, and RIs in a single ASG
m4.large Spot
m5.large Spot
c4.large On-Demand
Availability
Zone 1
Availability
Zone 2
Availability
Zone3
A single ASG combines
purchase options and
instance types

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Save up to 90% using Amazon EC2 Auto Scaling
Automatically scale instances across instance types
and purchase options in a single ASG
Reduce cost
Specify what percentage of your ASG capacity should be fulfilled
by On-Demand Instances and Spot Instances to optimize cost
Optimize performance
Use a prioritized list of On-Demand instance types to scale capacity during
an urgent, unpredictable event to optimize performance
Eliminate operational overhead
Amazon EC2 Auto
Scaling
Reduce cost Optimize performance Eliminate operational overhead
On-Demand Instances
Spot Instances
Reserved Instances

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
API Parameters
"MixedInstancesPolicy": {
"LaunchTemplate": {
"LaunchTemplateSpecification": {
"LaunchTemplateName": ”MyLaunchTemplate"
},
"Overrides": [
{ "InstanceType": "c5.large" },
{ "InstanceType": "c4.large" }
]
},
"InstancesDistribution": {
"OnDemandAllocationStrategy": "prioritized",
"OnDemandBaseCapacity": 10,
"OnDemandPercentageAboveBaseCapacity": 50,
"SpotAllocationStrategy": "lowest-price",
"SpotInstancePools": 2,
"SpotMaxPrice": ”0.05"
}
}
AZ1 and AZ2
Desired
Min
Max
On-Demand Base
50% On-Demand
50% Spot
Minimum On-Demand (10)

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Fleet and Allocation strategies
• Amazon EC2 Fleet
• Provisions capacity across multiple instance types according to allocation strategies
• Allocation strategies
• On-Demand prioritized list of instance types
• Spot instances across the N lowest priced instance pools
• More coming soon
• Allocation strategies determine which instance types are launched and
terminated

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Big data reference architecture
Master Node
(OD or RI)
S3
EMRFS
Master Fleet
Task Node
(OD or RI)
Task Node
(Spot)
Task Node
(Spot)
Task Fleet
Instance
Store
EBS Volume
Instance
Store
EBS Volume
Instance
Store
EBS Volume
Core Fleet
HDFS
Instance Fleet
Core Node (OD
or RI)
Core Node (OD
or RI)
Core Node
(SpotI)
Amazon EMR
Amazon EC2 Auto
Scaling
Amazon EC2 Auto
Scaling

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Task node fleet configuration
"MixedInstancesPolicy": {
"LaunchTemplate": {
"LaunchTemplateSpecification": {
"LaunchTemplateName": ”MyLaunchTemplate"
},
"Overrides": [
{ "InstanceType": "m4.4xlarge" },
{ "InstanceType": "m5.4xlarge" },
{ "InstanceType": "c5d.4xlarge" },
{ "InstanceType": "m5d.4xlarge" },
{ "InstanceType": "c4.4xlarge" }
]
},
"InstancesDistribution": {
"OnDemandAllocationStrategy": "prioritized",
"OnDemandBaseCapacity": 250,
"OnDemandPercentageAboveBaseCapacity": 0,
"SpotAllocationStrategy": "lowest-price",
"SpotInstancePools": 2
}
}
AZ1 and AZ2
Minimum On-Demand (250)
Min - 200
Max - 350
On-Demand Base - 250
0% On-Demand (0)
100% Spot (50)
Desired - 300

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Core fleet configuration
"MixedInstancesPolicy": {
"LaunchTemplate": {
"LaunchTemplateSpecification": {
"LaunchTemplateName": ”MyLaunchTemplate"
},
"Overrides": [
{ "InstanceType": "m4.4xlarge" },
{ "InstanceType": "m5.4xlarge" },
{ "InstanceType": "c5d.4xlarge" },
{ "InstanceType": "m5d.4xlarge" },
{ "InstanceType": "c4.4xlarge" }
]
},
"InstancesDistribution": {
"OnDemandAllocationStrategy": "prioritized",
"OnDemandBaseCapacity": 0,
"OnDemandPercentageAboveBaseCapacity": 30,
"SpotAllocationStrategy": "lowest-price",
"SpotInstancePools": 2
}
}
AZ1 and AZ2
Desired - 50
Min - 20
Max - 80
30% On-Demand (15)
70% Spot (35)

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instances distribution
• ASG scales up and down according to the instances distribution
• Amazon EC2 Auto Scaling ensures base capacity is fulfilled with On-Demand Instances
• Capacity beyond base capacity is fulfilled with Spot or On-Demand Instances according to percentage
split
Example: OnDemandBaseCapacity: 10 OnDemandPercentageAboveBaseCapacity: 50
Desired Capacity On-Demand Instances Spot Instances
Desired < Base 5 5 0
Desired = Base 10 10 0
Desired > Base 20 15 5

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instance type overrides and allocation strategies
• ASG adjusts to new configuration
as scale up and down
• As ASG scales up
• Launch instances according to the new
configuration
• As ASG scales down
• Prioritize terminating instances not
matching the new configuration
• New termination policy:
AllocationStrategy
Instance type overrides: m4.large, m5.large
m4.large m5.large
Instance type overrides: m5.large, c5.large
m4.large m5.large c5.large
Instance type overrides: m5.large, c5.large
m4.large m5.large c5.large

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Recommendations on Mixed Instances Policy
• Choose at least 2 instance type overrides
• Improves availability for On-Demand and Spot Instances
• Diversify across at least N = 2 Spot Instance pools
• Reduces risk from fluctuations in Spot capacity and prices
• Choose instance types of same size across families
• Maintains stability as dynamically scale up and down
• Use default spot max price
• Leverages spot cost savings while defaulting to on-demand price as maximum price to pay

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
On-Demand and Spot Instance pools
• Instances Distribution
• Distribute instances evenly between availability zones for On-demand and Spot separately
• Launch Failures
• Launch instances in another availability zone when launches fail for On-Demand and Spot separately
Allows On-Demand capacity to be balanced while Spot capacity is migrated to
another availability zone due to low capacity or high prices

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
On-Demand and Spot Instance pools
VPC
Balanced capacity across Spot Instances
Balanced capacity across On-Demand Instances
Availability
Zone 1
Availability
Zone 2

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
On-Demand and Spot Instance pools
Spot Instances are unavailable in AZ1
Balanced capacity across On-Demand Instances
Availability
Zone 1
Availability
Zone 2
VPC

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
On-Demand and Spot Instance pools
Spot Instances are retargeted to AZ2
Balanced capacity across On-Demand Instances
Availability
Zone 1
Availability
Zone 2
VPC

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
On-Demand and Spot Instance pools
Balanced capacity across Spot Instances
Balanced capacity across On-Demand Instances
Availability
Zone 1
Availability
Zone 2
VPC

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Update existing Auto Scaling groups
• From launch configuration
• Copy launch configuration to a launch template (using console)
• Follow below steps to update existing Auto Scaling groups from launch template
• From launch template
• Choose at least 2 instances type overrides
• Determine desired base On-Demand capacity and On-Demand/Spot percentage split
• Update Auto Scaling group with Mixed Instances Policy containing
• Launch template
• Instance type overrides
• Base On-Demand capacity
• On-Demand/Spot percentage split

34. Create or update Auto Scaling groups to
use multiple purchase options and
instance types
https://docs.aws.amazon.com/autoscaling/ec2/userguide/AutoScalingGroup.html

35. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Susanna Ng
susannan@amazon.com
Ramya Sunil
suniramy@amazon.com

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.