SlideShare a Scribd company logo
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Come spendere fino al 90% in meno con
i container e le istanze spot
Massimo Sporchia – AWS Solutions Architect
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Agenda
• Spot fundamentals
• What type of workloads are Spot-friendly?
• How can I use Spot in K8s workloads?
• Customer Spotlight: Spreaker
• The simple rules of Spot
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Lower TCO with Amazon EC2 purchase options
On-Demand
Spiky workloads,
to define needs
Pay for compute capacity
by the second with no
long-term commitments
Reserved Instances
and Savings Plan
Committed and
steady-state usage
Make a commitment
and receive a significant
discount off compute
Spot Instances
Fault-tolerant, flexible,
stateless workloads
Spare EC2 capacity at
savings of up to 90%
off On-Demand prices
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Do more for less with Spot Instances
Low, predictable prices
Up to 90% discount over
On-Demand prices
Faster results
Increase throughput up to
10x while staying in budget
Easy to use
Launch through AWS services
(e.g. ECS, Batch, EMR)
or integrated third-parties
Spot Instances are reclaimed with a 2-minute warning and
only when On-Demand needs capacity back—no bidding!
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Spare capacity at scale
AWS customers are using more compute capacity on Amazon EC2 Spot
instances than customers in 2014 were running across all of Amazon EC2
Over 2.3 million simulation jobs on a
single HPC cluster of 1 million vCPUs
built using Amazon EC2 Spot Instances
Time to results: 20 days à 8 hours
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Saved 75% per month
by changing four lines
of code
Was able to save 74%
on their K8s cluster
Completed 2.5 million
tasks in 8 hours by
spinning up an EC2
cluster with over 1
million vCPUs
Reduced grid
infrastructure
costs by 60%
Reduced monthly
compute costs by 75%
while gaining more
compute power
Processes over
100 billion requests
per day with an average
response time of 90ms,
saving over $3M per year
Decreased the time it
took to analyze 10,000
biological samples from
7 years to 7 days
Saved 70% running
Kubernetes workloads
on AWS
Uses Spot Instances
and auto scaling for it’s
rendering-as-a-service
workload to spend
less and scale more
75% reduction
in compute cost
with Fleet
A containerized environment
that would have taken more
than a year to create previously
only took a few months.
Saved 40% over Reserved
Instances and increased
ETL processing time
100%
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Alerts Automation
Handling Options
§ Terminate
§ Stop/Start
§ Hibernate
Map to Strategy
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
$0.27 $0.29$0.28
AZ2 AZ3AZ1
8XL
$0.19 $0.16$0.214XL
$0.07 $0.08$0.082XL
$0.05 $0.04$0.04XL
$0.01 $0.02$0.01L
C4
$1.76
On-
Demand
$0.88
$0.44
$0.22
$0.11
Each instance family
Each instance size
Each availability zone
In every Region
Is a separate Spot pool
R5
M4
M5
I3 C5R4
i3en R5a
R5d
Amazon EC2 Spot Instance pools explained
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
(Not so) New EC2 Spot Pricing Model
Smooth pricing
After bidding was
Removed on Nov 2017
Predictable prices with slow, infrequent variations. Interruptions may only happen when
EC2 needs to reclaim capacity for a pool.
Spot “max_price”
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Spot Instances are perfect for fault-tolerant
workloads
Lean on Spot for
these workloads!
Containers
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
To optimize Amazon EC2, combine purchase options with EC2
Auto Scaling
Use RIs or Savings Plan for
known, steady-state workloads
On-demand, for new or
stateful spiky workloads
Scale using Spot for
fault-tolerant, flexible,
stateless workloads
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Web application - Spot interruption handling
AZ1 AZ2
Web servers
1
EC2 needs to reclaim Spot capacity for On-Demand.
Spot Interruption Notice is triggered to inform that
the instance will be interrupted in 2 minutes via EC2
metadata and CloudWatch Event.
A CloudWatch Events rule catches the interruption
event and triggers a Lambda Function that:
Calls the AutoScaling API to Detach the Instance
from the AutoScaling group
The Detach action tells ALB to stop sending new
connections to the instance that will be interrupted
and drain existing ones leveraging the 2 minutes.
The Detach action also tells AutoScaling to launch a
replacement instance according to the configured
allocation strategy (capacity-optimized or lowest-
price)
1
2
Lambda
Function
D B
3
2
5
3
4
4
5
App servers
ASG1
Amazon
CloudWatch
EC2 AutoScaling
API
draining
Event rule
M5.L
M4.L
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Containers + Spot = match made in heaven
ü Containers are often stateless, fault-tolerant, and a great fit for Spot Instances
ü Deploy containerized workloads and easily manage clusters at any scale at a
fraction of the cost with Spot Instances
ü Spot Instances can be used with ECS or Kubernetes to run any
containerized workload
Skyscanner is a travel fare aggregator
website and travel metasearch engine
based in Edinburgh, Scotland
“We are currently tracking
74% saving over all regions.”
—Paul Gillespie, Principal Architect/Tribe Lead
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Containers interruption handling example-
Kubernetes
Pod pod
podPod
Node-termination-
handler
Worker nodes
Pod pod
podPod
Node-termination-
handler
Pod pod
podPod
Node-termination-
handler
AZ1 AZ2
Control plane OD or RI. Worker nodes on
Spot instances.
Node-termination-handler will identify a
Spot Instance being reclaimed and will call
the Kube-API in the master node to:
• Taint the node and cordon it off to
prevent new pods from being
placed.
• Drain the running pods.
• Replace the evicted pods on
remaining nodes.
Workers will be scaled based on Cluster
Autoscaler when PODs on pending-state.
Control plane
Kube-
scheduler
Kube-API
ASG1
Kube-
controller
manager
Cluster autoscaler
Node-termination-
handler
overpr
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Containers interruption handling example-
Kubernetes
Node-termination-
handler
Worker nodes
Pod pod
podPod
Node-termination-
handler
Pod pod
podPod
Node-termination-
handler
AZ1 AZ2
Control plane OD or RI. Worker nodes on
Spot instances.
Node-termination-handler will identify a
Spot Instance being reclaimed and will call
the Kube-API in the master node to:
• Taint the node and cordon it off to
prevent new pods from being
placed.
• Drain the running pods.
• Replace the evicted pods on
remaining nodes.
Workers will be scaled based on Cluster
Autoscaler when PODs on pending-state.
Control plane
Kube-
scheduler
Kube-API
ASG1
Kube-
controller
manager
Cluster autoscaler
pod
pod
Node-termination-
handler
overpr
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Containers interruption handling example-
Kubernetes
Worker nodes
Pod pod
podPod
Node-termination-
handler
Pod pod
podPod
Node-termination-
handler
AZ1 AZ2
Control plane OD or RI. Worker nodes on
Spot instances.
Node-termination-handler will identify a
Spot Instance being reclaimed and will call
the Kube-API in the master node to:
• Taint the node and cordon it off to
prevent new pods from being
placed.
• Drain the running pods.
• Replace the evicted pods on
remaining nodes.
Workers will be scaled based on Cluster
Autoscaler when PODs on pending-state.
Control plane
Kube-
scheduler
Kube-API
ASG1
Kube-
controller
manager
Cluster autoscaler
Pod pod
podPod
Node-termination-
handler
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Containers interruption handling example-
Kubernetes
Worker nodes
Pod pod
podPod
Node-termination-
handler
Pod pod
podPod
Node-termination-
handler
AZ1 AZ2
Control plane OD or RI. Worker nodes on
Spot instances.
Node-termination-handler will identify a
Spot Instance being reclaimed and will call
the Kube-API in the master node to:
• Taint the node and cordon it off to
prevent new pods from being
placed.
• Drain the running pods.
• Replace the evicted pods on
remaining nodes.
Workers will be scaled based on Cluster
Autoscaler when PODs on pending-state.
Control plane
Kube-
scheduler
Kube-API
ASG1
Kube-
controller
manager
Cluster autoscaler
Pod pod
podPod
Node-termination-
handler
Node-termination-
handler
overpr
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Customer Spotlight:
Spreaker
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Spot pricing
Smooth, infrequent changes
no spikes, more predictable
Up to 90% off
Interruptions
Happen when EC2 needs
capacity
Spot infrastructure
Is same as On-Demand
and RIs
Diversify
Choose different instance types,
size and AZ in a single fleet
The simple rules of Spot
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
AWS Europe (Milan) Region
On April, 28th AWS expanded its global footprint with the opening of the AWS Infrastructure Region in Italy. The new
Region AWS Europe (Milano) brings advanced cloud technologies that enable opportunities for innovation,
entrepreneurship, and digital transformation. For additional information about services and characteristics of an AWS
Region, you can check the website: aws.amazon.com/local/italy/milan/
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Thanks!

More Related Content

What's hot

AWS Business Essentials
AWS Business EssentialsAWS Business Essentials
AWS Business Essentials
Amazon Web Services
 
AWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and StrategiesAWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
Amazon Web Services
 
Welcome - Keynote - AWSome Day Helsinki 2017
Welcome - Keynote - AWSome Day Helsinki 2017Welcome - Keynote - AWSome Day Helsinki 2017
Welcome - Keynote - AWSome Day Helsinki 2017
Amazon Web Services
 
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptxTrack 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Amazon Web Services
 
Design, Deploy, & Optimize SQL Server Workloads
Design, Deploy, & Optimize SQL Server Workloads Design, Deploy, & Optimize SQL Server Workloads
Design, Deploy, & Optimize SQL Server Workloads
Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Amazon Web Services
 
Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化
Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化
Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化
Amazon Web Services
 
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018
Amazon Web Services
 
Introduction to Hybrid Cloud on AWS - AWS Online Tech Talks
Introduction to Hybrid Cloud on AWS - AWS Online Tech TalksIntroduction to Hybrid Cloud on AWS - AWS Online Tech Talks
Introduction to Hybrid Cloud on AWS - AWS Online Tech Talks
Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
Amazon Web Services
 
AWS 101
AWS 101AWS 101
AWS 101 - Tel Aviv Summit 2018
AWS 101 - Tel Aviv Summit 2018AWS 101 - Tel Aviv Summit 2018
AWS 101 - Tel Aviv Summit 2018
Amazon Web Services
 
Moving your commercial databases to Amazon RDS
Moving your commercial databases to Amazon RDSMoving your commercial databases to Amazon RDS
Moving your commercial databases to Amazon RDS
Amazon Web Services
 
VMware Cloud on AWS - AWS Learning Series
VMware Cloud on AWS - AWS Learning SeriesVMware Cloud on AWS - AWS Learning Series
VMware Cloud on AWS - AWS Learning Series
Amazon Web Services
 
Technical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate OttawaTechnical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate Ottawa
Amazon Web Services
 
An Intro to Building and Optimizing a Hybrid Cloud on AWS
An Intro to Building and Optimizing a Hybrid Cloud on AWSAn Intro to Building and Optimizing a Hybrid Cloud on AWS
An Intro to Building and Optimizing a Hybrid Cloud on AWS
Amazon Web Services
 
AWS Technical Essentials Day
AWS Technical Essentials DayAWS Technical Essentials Day
AWS Technical Essentials Day
Amazon Web Services
 
AWS Webcast - What is Cloud Computing?
AWS Webcast - What is Cloud Computing?AWS Webcast - What is Cloud Computing?
AWS Webcast - What is Cloud Computing?
Amazon Web Services
 
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Amazon Web Services
 
Cloud Economics: il Business Case per la Cloud Migration
Cloud Economics: il Business Case per la Cloud MigrationCloud Economics: il Business Case per la Cloud Migration
Cloud Economics: il Business Case per la Cloud Migration
Amazon Web Services
 

What's hot (20)

AWS Business Essentials
AWS Business EssentialsAWS Business Essentials
AWS Business Essentials
 
AWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and StrategiesAWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
 
Welcome - Keynote - AWSome Day Helsinki 2017
Welcome - Keynote - AWSome Day Helsinki 2017Welcome - Keynote - AWSome Day Helsinki 2017
Welcome - Keynote - AWSome Day Helsinki 2017
 
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptxTrack 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
 
Design, Deploy, & Optimize SQL Server Workloads
Design, Deploy, & Optimize SQL Server Workloads Design, Deploy, & Optimize SQL Server Workloads
Design, Deploy, & Optimize SQL Server Workloads
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化
Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化
Track 3 Session 5_ 使用 Amazon EC2 打造企業計算平台與成本和容量優化
 
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018
Module 2: Core AWS Compute and Storage Services - Virtual AWSome Day June 2018
 
Introduction to Hybrid Cloud on AWS - AWS Online Tech Talks
Introduction to Hybrid Cloud on AWS - AWS Online Tech TalksIntroduction to Hybrid Cloud on AWS - AWS Online Tech Talks
Introduction to Hybrid Cloud on AWS - AWS Online Tech Talks
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 
AWS 101
AWS 101AWS 101
AWS 101
 
AWS 101 - Tel Aviv Summit 2018
AWS 101 - Tel Aviv Summit 2018AWS 101 - Tel Aviv Summit 2018
AWS 101 - Tel Aviv Summit 2018
 
Moving your commercial databases to Amazon RDS
Moving your commercial databases to Amazon RDSMoving your commercial databases to Amazon RDS
Moving your commercial databases to Amazon RDS
 
VMware Cloud on AWS - AWS Learning Series
VMware Cloud on AWS - AWS Learning SeriesVMware Cloud on AWS - AWS Learning Series
VMware Cloud on AWS - AWS Learning Series
 
Technical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate OttawaTechnical Essentials Training: AWS Innovate Ottawa
Technical Essentials Training: AWS Innovate Ottawa
 
An Intro to Building and Optimizing a Hybrid Cloud on AWS
An Intro to Building and Optimizing a Hybrid Cloud on AWSAn Intro to Building and Optimizing a Hybrid Cloud on AWS
An Intro to Building and Optimizing a Hybrid Cloud on AWS
 
AWS Technical Essentials Day
AWS Technical Essentials DayAWS Technical Essentials Day
AWS Technical Essentials Day
 
AWS Webcast - What is Cloud Computing?
AWS Webcast - What is Cloud Computing?AWS Webcast - What is Cloud Computing?
AWS Webcast - What is Cloud Computing?
 
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Cloud Economics: il Business Case per la Cloud Migration
Cloud Economics: il Business Case per la Cloud MigrationCloud Economics: il Business Case per la Cloud Migration
Cloud Economics: il Business Case per la Cloud Migration
 

Similar to Come spendere fino al 90% in meno con i container e le istanze spot

Getting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesGetting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar Series
Amazon Web Services
 
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
Amazon Web Services
 
Optimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot InstancesOptimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot Instances
Amazon Web Services
 
Amazon EC2 Spot Instances
Amazon EC2 Spot InstancesAmazon EC2 Spot Instances
Amazon EC2 Spot Instances
AWS User Group Bengaluru
 
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
Amazon Web Services
 
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Amazon Web Services
 
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Amazon Web Services
 
AWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS Cloud
AWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS CloudAWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS Cloud
AWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS Cloud
Amazon Web Services
 
AWSome Day Online 2020_Modul 3: Membangun di Cloud
AWSome Day Online 2020_Modul 3: Membangun di CloudAWSome Day Online 2020_Modul 3: Membangun di Cloud
AWSome Day Online 2020_Modul 3: Membangun di Cloud
Amazon Web Services
 
AWSome Day Online 2020_Module 3: Building in the cloud
AWSome Day Online 2020_Module 3: Building in the cloudAWSome Day Online 2020_Module 3: Building in the cloud
AWSome Day Online 2020_Module 3: Building in the cloud
Amazon Web Services
 
Cloud cost optimization (AWS, GCP)
Cloud cost optimization (AWS, GCP)Cloud cost optimization (AWS, GCP)
Cloud cost optimization (AWS, GCP)
Szabolcs Zajdó
 
AWS Cost Control
AWS Cost ControlAWS Cost Control
AWS Cost Control
Bob Brown
 
AWS Cloud cost optimization
AWS Cloud cost optimizationAWS Cloud cost optimization
AWS Cloud cost optimization
Yogesh Sharma
 
Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018
Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018
Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018
Amazon Web Services
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
Amazon Web Services
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 SpotIntroduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
Amazon Web Services
 
This One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You ThousandsThis One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You Thousands
Amazon Web Services
 
Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...
Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...
Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...
Amazon Web Services
 
Amazon EC2 Strategie per l'ottimizzazione dei costi
Amazon EC2 Strategie per l'ottimizzazione dei costiAmazon EC2 Strategie per l'ottimizzazione dei costi
Amazon EC2 Strategie per l'ottimizzazione dei costi
Amazon Web Services
 
(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands
Amazon Web Services
 

Similar to Come spendere fino al 90% in meno con i container e le istanze spot (20)

Getting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesGetting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar Series
 
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
Accelerating Containerized Workloads with Amazon EC2 Spot Instances - AWS Onl...
 
Optimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot InstancesOptimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot Instances
 
Amazon EC2 Spot Instances
Amazon EC2 Spot InstancesAmazon EC2 Spot Instances
Amazon EC2 Spot Instances
 
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
 
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
 
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
 
AWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS Cloud
AWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS CloudAWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS Cloud
AWSome Day Online 2020_โมดูล 3: การวางระบบบน AWS Cloud
 
AWSome Day Online 2020_Modul 3: Membangun di Cloud
AWSome Day Online 2020_Modul 3: Membangun di CloudAWSome Day Online 2020_Modul 3: Membangun di Cloud
AWSome Day Online 2020_Modul 3: Membangun di Cloud
 
AWSome Day Online 2020_Module 3: Building in the cloud
AWSome Day Online 2020_Module 3: Building in the cloudAWSome Day Online 2020_Module 3: Building in the cloud
AWSome Day Online 2020_Module 3: Building in the cloud
 
Cloud cost optimization (AWS, GCP)
Cloud cost optimization (AWS, GCP)Cloud cost optimization (AWS, GCP)
Cloud cost optimization (AWS, GCP)
 
AWS Cost Control
AWS Cost ControlAWS Cost Control
AWS Cost Control
 
AWS Cloud cost optimization
AWS Cloud cost optimizationAWS Cloud cost optimization
AWS Cloud cost optimization
 
Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018
Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018
Amazon EC2 Spot with Amazon EKS (CON406-R1) - AWS re:Invent 2018
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 SpotIntroduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
 
This One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You ThousandsThis One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You Thousands
 
Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...
Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...
Better, Faster, Cheaper – Cost Optimizing Compute with Amazon EC2 Fleet #savi...
 
Amazon EC2 Strategie per l'ottimizzazione dei costi
Amazon EC2 Strategie per l'ottimizzazione dei costiAmazon EC2 Strategie per l'ottimizzazione dei costi
Amazon EC2 Strategie per l'ottimizzazione dei costi
 
(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands
 

More from Amazon Web Services

Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
Amazon Web Services
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Amazon Web Services
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
Amazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
Amazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Amazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
Amazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Amazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 
Come costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWSCome costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWS
Amazon Web Services
 
AWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei serverAWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei server
Amazon Web Services
 
Crea dashboard interattive con Amazon QuickSight
Crea dashboard interattive con Amazon QuickSightCrea dashboard interattive con Amazon QuickSight
Crea dashboard interattive con Amazon QuickSight
Amazon Web Services
 
Costruisci modelli di Machine Learning con Amazon SageMaker Autopilot
Costruisci modelli di Machine Learning con Amazon SageMaker AutopilotCostruisci modelli di Machine Learning con Amazon SageMaker Autopilot
Costruisci modelli di Machine Learning con Amazon SageMaker Autopilot
Amazon Web Services
 
Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows
Amazon Web Services
 

More from Amazon Web Services (20)

Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Come costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWSCome costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWS
 
AWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei serverAWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei server
 
Crea dashboard interattive con Amazon QuickSight
Crea dashboard interattive con Amazon QuickSightCrea dashboard interattive con Amazon QuickSight
Crea dashboard interattive con Amazon QuickSight
 
Costruisci modelli di Machine Learning con Amazon SageMaker Autopilot
Costruisci modelli di Machine Learning con Amazon SageMaker AutopilotCostruisci modelli di Machine Learning con Amazon SageMaker Autopilot
Costruisci modelli di Machine Learning con Amazon SageMaker Autopilot
 
Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows
 

Come spendere fino al 90% in meno con i container e le istanze spot

  • 1. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Come spendere fino al 90% in meno con i container e le istanze spot Massimo Sporchia – AWS Solutions Architect
  • 2. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Agenda • Spot fundamentals • What type of workloads are Spot-friendly? • How can I use Spot in K8s workloads? • Customer Spotlight: Spreaker • The simple rules of Spot
  • 3. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Lower TCO with Amazon EC2 purchase options On-Demand Spiky workloads, to define needs Pay for compute capacity by the second with no long-term commitments Reserved Instances and Savings Plan Committed and steady-state usage Make a commitment and receive a significant discount off compute Spot Instances Fault-tolerant, flexible, stateless workloads Spare EC2 capacity at savings of up to 90% off On-Demand prices
  • 4. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Do more for less with Spot Instances Low, predictable prices Up to 90% discount over On-Demand prices Faster results Increase throughput up to 10x while staying in budget Easy to use Launch through AWS services (e.g. ECS, Batch, EMR) or integrated third-parties Spot Instances are reclaimed with a 2-minute warning and only when On-Demand needs capacity back—no bidding!
  • 5. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Spare capacity at scale AWS customers are using more compute capacity on Amazon EC2 Spot instances than customers in 2014 were running across all of Amazon EC2 Over 2.3 million simulation jobs on a single HPC cluster of 1 million vCPUs built using Amazon EC2 Spot Instances Time to results: 20 days à 8 hours
  • 6. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Saved 75% per month by changing four lines of code Was able to save 74% on their K8s cluster Completed 2.5 million tasks in 8 hours by spinning up an EC2 cluster with over 1 million vCPUs Reduced grid infrastructure costs by 60% Reduced monthly compute costs by 75% while gaining more compute power Processes over 100 billion requests per day with an average response time of 90ms, saving over $3M per year Decreased the time it took to analyze 10,000 biological samples from 7 years to 7 days Saved 70% running Kubernetes workloads on AWS Uses Spot Instances and auto scaling for it’s rendering-as-a-service workload to spend less and scale more 75% reduction in compute cost with Fleet A containerized environment that would have taken more than a year to create previously only took a few months. Saved 40% over Reserved Instances and increased ETL processing time 100%
  • 7. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Alerts Automation Handling Options § Terminate § Stop/Start § Hibernate Map to Strategy
  • 8. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential $0.27 $0.29$0.28 AZ2 AZ3AZ1 8XL $0.19 $0.16$0.214XL $0.07 $0.08$0.082XL $0.05 $0.04$0.04XL $0.01 $0.02$0.01L C4 $1.76 On- Demand $0.88 $0.44 $0.22 $0.11 Each instance family Each instance size Each availability zone In every Region Is a separate Spot pool R5 M4 M5 I3 C5R4 i3en R5a R5d Amazon EC2 Spot Instance pools explained
  • 9. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential (Not so) New EC2 Spot Pricing Model Smooth pricing After bidding was Removed on Nov 2017 Predictable prices with slow, infrequent variations. Interruptions may only happen when EC2 needs to reclaim capacity for a pool. Spot “max_price”
  • 10. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Spot Instances are perfect for fault-tolerant workloads Lean on Spot for these workloads! Containers
  • 11. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential To optimize Amazon EC2, combine purchase options with EC2 Auto Scaling Use RIs or Savings Plan for known, steady-state workloads On-demand, for new or stateful spiky workloads Scale using Spot for fault-tolerant, flexible, stateless workloads
  • 12. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Web application - Spot interruption handling AZ1 AZ2 Web servers 1 EC2 needs to reclaim Spot capacity for On-Demand. Spot Interruption Notice is triggered to inform that the instance will be interrupted in 2 minutes via EC2 metadata and CloudWatch Event. A CloudWatch Events rule catches the interruption event and triggers a Lambda Function that: Calls the AutoScaling API to Detach the Instance from the AutoScaling group The Detach action tells ALB to stop sending new connections to the instance that will be interrupted and drain existing ones leveraging the 2 minutes. The Detach action also tells AutoScaling to launch a replacement instance according to the configured allocation strategy (capacity-optimized or lowest- price) 1 2 Lambda Function D B 3 2 5 3 4 4 5 App servers ASG1 Amazon CloudWatch EC2 AutoScaling API draining Event rule M5.L M4.L
  • 13. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Containers + Spot = match made in heaven ü Containers are often stateless, fault-tolerant, and a great fit for Spot Instances ü Deploy containerized workloads and easily manage clusters at any scale at a fraction of the cost with Spot Instances ü Spot Instances can be used with ECS or Kubernetes to run any containerized workload Skyscanner is a travel fare aggregator website and travel metasearch engine based in Edinburgh, Scotland “We are currently tracking 74% saving over all regions.” —Paul Gillespie, Principal Architect/Tribe Lead
  • 14. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Containers interruption handling example- Kubernetes Pod pod podPod Node-termination- handler Worker nodes Pod pod podPod Node-termination- handler Pod pod podPod Node-termination- handler AZ1 AZ2 Control plane OD or RI. Worker nodes on Spot instances. Node-termination-handler will identify a Spot Instance being reclaimed and will call the Kube-API in the master node to: • Taint the node and cordon it off to prevent new pods from being placed. • Drain the running pods. • Replace the evicted pods on remaining nodes. Workers will be scaled based on Cluster Autoscaler when PODs on pending-state. Control plane Kube- scheduler Kube-API ASG1 Kube- controller manager Cluster autoscaler Node-termination- handler overpr
  • 15. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Containers interruption handling example- Kubernetes Node-termination- handler Worker nodes Pod pod podPod Node-termination- handler Pod pod podPod Node-termination- handler AZ1 AZ2 Control plane OD or RI. Worker nodes on Spot instances. Node-termination-handler will identify a Spot Instance being reclaimed and will call the Kube-API in the master node to: • Taint the node and cordon it off to prevent new pods from being placed. • Drain the running pods. • Replace the evicted pods on remaining nodes. Workers will be scaled based on Cluster Autoscaler when PODs on pending-state. Control plane Kube- scheduler Kube-API ASG1 Kube- controller manager Cluster autoscaler pod pod Node-termination- handler overpr
  • 16. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Containers interruption handling example- Kubernetes Worker nodes Pod pod podPod Node-termination- handler Pod pod podPod Node-termination- handler AZ1 AZ2 Control plane OD or RI. Worker nodes on Spot instances. Node-termination-handler will identify a Spot Instance being reclaimed and will call the Kube-API in the master node to: • Taint the node and cordon it off to prevent new pods from being placed. • Drain the running pods. • Replace the evicted pods on remaining nodes. Workers will be scaled based on Cluster Autoscaler when PODs on pending-state. Control plane Kube- scheduler Kube-API ASG1 Kube- controller manager Cluster autoscaler Pod pod podPod Node-termination- handler
  • 17. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Containers interruption handling example- Kubernetes Worker nodes Pod pod podPod Node-termination- handler Pod pod podPod Node-termination- handler AZ1 AZ2 Control plane OD or RI. Worker nodes on Spot instances. Node-termination-handler will identify a Spot Instance being reclaimed and will call the Kube-API in the master node to: • Taint the node and cordon it off to prevent new pods from being placed. • Drain the running pods. • Replace the evicted pods on remaining nodes. Workers will be scaled based on Cluster Autoscaler when PODs on pending-state. Control plane Kube- scheduler Kube-API ASG1 Kube- controller manager Cluster autoscaler Pod pod podPod Node-termination- handler Node-termination- handler overpr
  • 18. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Customer Spotlight: Spreaker
  • 19. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Spot pricing Smooth, infrequent changes no spikes, more predictable Up to 90% off Interruptions Happen when EC2 needs capacity Spot infrastructure Is same as On-Demand and RIs Diversify Choose different instance types, size and AZ in a single fleet The simple rules of Spot
  • 20. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential AWS Europe (Milan) Region On April, 28th AWS expanded its global footprint with the opening of the AWS Infrastructure Region in Italy. The new Region AWS Europe (Milano) brings advanced cloud technologies that enable opportunities for innovation, entrepreneurship, and digital transformation. For additional information about services and characteristics of an AWS Region, you can check the website: aws.amazon.com/local/italy/milan/
  • 21. © 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Thanks!