SlideShare a Scribd company logo
1 of 25
Download to read offline
Enterprise Cloud Access. Simplified.
Paddy Raghavan
Co-Founder
PROUD MEMBER OF
Spare Capacity at
Steep Discounts
(Sometimes 90%
lower)
Auction based
pricing model
Demand –Supply
Economics
What Is A Spot Instance?
AWS EC2 Instance Pricing Options
On Demand Instances: Hourly rate
Reserved Instances:
Upfront payment
Lower hourly fee
Capacity reservation
Spot Instances: Bid for unused EC2 capacity
AWS EC2 Instances (SI)
 Bid for unused EC2 capacity
 The hourly price for a SI (of each instance type in each Availability Zone) is
set by Amazon EC2
 Hourly price fluctuates depending on the supply of and demand of SI
 SI runs whenever your bid exceeds the current market price.
 SI might not start immediately
 AWS might terminate SI as hourly price or availability changes. Partial hours
are not charged.
AWS EC2 Instance Life Cycle
 Bid Price
 Instance Count
 Launch Specification: AMI Id,
Availability zone, Keypair, Security
Group VPC, SubnetID
 Type: One Time / Persistent
 ValidFrom , ValidUntil
Create
Request
Request
Launch
Instances
Interrupt
(Spot Termination)
One-TimeRequest
Failed
Interrupt
(Persistent)
Spot Instance requests
can be created with AWS
SDK’s, from management
console and AWS clients.
AWS EC2 Instance Request States
 open—The request is waiting to be fulfilled.
 active—The request is fulfilled and has an associated Spot Instance.
 failed—The request has one or more bad parameters.
 closed—The Spot Instance was interrupted or terminated.
 canceled—You canceled the request, or the request expired.
AWS EC2 Spot Request States
EC2 Spot Instance Termination Notices
 If current spot price > bid price, the Spot instance is reclaimed
by AWS.
 2 minutes before the spot instance is reclaimed the instance
state is set to marked-for-termination.
 Applications / scripts can poll the instance metadata or APIs to
check for this notice and save its state, upload final log files, or
remove itself from an Elastic Load Balancer.
EC2 Spot Fleet Request
 If current spot price > bid price, the Spot instance is reclaimed
by AWS.
 2 minutes before the spot instance is reclaimed the instance
state is set to marked-for-termination.
 Applications / scripts can poll the instance metadata or APIs to
check for this notice and save its state, upload final log files, or
remove itself from an Elastic Load Balancer.
EC2 Spot Fleet Request
Spot fleet request includes:
 Target Capacity
 One or more launch specification for the instances
 Launch specification includes – AMI Id, instance type,
subnet, AZ, security group and keypair name.
 Maximum price per instance hour (bid price)
Spot Fleet Request State
A Spot fleet request can be in one of the following states:
 Submitted —The Spot fleet request is being evaluated and Amazon EC2 is preparing to launch
the target number of Spot Instances.
 Active —The Spot fleet has been validated and Amazon EC2 is attempting to maintain the target
number of running Spot Instances.
 cancelled-running —The Spot fleet is canceled and will not launch additional Spot Instances, but
its existing Spot Instances will continue to run until they are interrupted or terminated. This is
the default behavior when canceling a Spot fleet.
 cancelled-terminating —The Spot fleet is canceled and its Spot Instances are terminating. This
is an option when canceling a Spot fleet.
 Cancelled —The Spot fleet is canceled and has no running Spot Instances. The Spot fleet will be
deleted two days after its instances were terminated.
Spot Fleet States
Spot Fleet Request
Prepare for Spot Interruptions
 Choose a reasonable bid price
 Ensure the AMI contains all required software, so that
you can start quickly.
 Sync important data to a persistent location (EBS / S3)
 Divide the work into smaller chunks or have
checkpoints to save work frequently.
EC2 Spot Instance Termination Notices
 Poll instance meta-data every 5 seconds with the following command
 if curl -s http://169.254.169.254/latest/meta-data/spot/termination-time | grep -q .*T.*Z;
then echo ‘notified for termination”; fi
 If your Spot Instance is marked for termination by the Spot service, the
termination-time item is present (2015-05-02T 01:00:00Z)
 the termination-time item is either not present (so you receive an
HTTP 404 error) or contains a value that is not a time value.
Financial Analysis
Scientific
Analysis
Batch
Workloads
Web
Crawling
Audio/ Video
Encoding
Testing
Document
Transformation
Map
Reduce
Hedge fund Analytics, Energy
Trading, Monte Carlo
Simulations
Scale Out
Processing
Extract &
Process Internet
Data
Encode, Render
& Process Large
Audio & Video
Files
Load &
Simulation
Testing For
Websites &
Apps
PDF Generation,
OCR Processing
Etc.
Big Data
Workloads
Simulations,
Drug Discovery,
Testing
Spotvantage
Companies Benefiting From Spot
 Mozilla saved over 15x times in 8 months by optimizing their AWS
infrastructure for their continuous integration needs.
 Vimeo saves over 50% in cloud costs by making intelligent use of AWS
Spot Instances for video encoding workloads
 Pharma company used 10,600 AWS EC2 SPOT instances to complete
a 341K hour workload in 11 hours
Batchly is a service that fully
automates cloud infrastructure
provisioning and management for
enterprise data processing
How does it work?
Large Scale Processing
Document Digitization
Bill Generation
Video Transcoding
Image Formatting
Log Analysis
Document Archival
Custom Batch / MapReduce
Jobs
Configuration
Monitoring
Upload Code
Define SLA
Run Job
Batchly
Delegated Trust
Automation
Amazon Web Services
Storage Queue Database
Notifications CloudWatch Email
EC2 Spot Instance
Continuous Learning Algorithm *
Standard Rank
Price Rank
Run Instances
Metrics
• Throughput
• Utilization
System Parameters
• Spot Price
• Availability
Market Parameters
* Patent Pending
Batchly: What it does
 Abstracts cloud complexity
 Uses your existing batch /MR jobs and data processing libraries
 Runs the job in cloud at a cost and time you define (User
Defined SLA)
 Automatically uses AWS Spot Instances for significant savings
 Provides an easy way to report the savings to Management
The interface
Batchly Impact
Financial Services
14x
Processing time reduced from
12 hours to under 50 minutes.
TIME
FASTER
COST
70%SAVINGS
Low TCO. Saved 70% over
on-demand cloud costs.
You Specify Your
Desired Cost Or Time
For Your Batchly Job
Your Data Stays
Secure In Your Cloud
Storage And Accessed
Only Within Your Code.Optimizes
Resources &
Utilization
Provisions &
Runs The
Correct AWS
Resources
Continuously
Improves
Allocation &
Utilization
Upload Code
Define SLA
Run Job
Batchly
Enterprise Data
Processing
Batchly – Single Interface for Data Processing Across Cloud Platforms
100% Support in place

More Related Content

What's hot

Using ansible to manage cloud platform by Accelerite
Using ansible to manage cloud platform by AcceleriteUsing ansible to manage cloud platform by Accelerite
Using ansible to manage cloud platform by AcceleriteMadan Ganesh Velayudham
 
Comparison of AWS, GCP & Azure web solutions
Comparison of AWS, GCP & Azure web solutionsComparison of AWS, GCP & Azure web solutions
Comparison of AWS, GCP & Azure web solutionsbasit raza
 
Azure functions: Quickstart
Azure functions: QuickstartAzure functions: Quickstart
Azure functions: QuickstartKwanghee Choi
 
Enterprise Cloud Batch Processing Compared
Enterprise Cloud Batch Processing ComparedEnterprise Cloud Batch Processing Compared
Enterprise Cloud Batch Processing ComparedCMPUTE
 
Managing Amazon AWS Costs
Managing Amazon AWS CostsManaging Amazon AWS Costs
Managing Amazon AWS CostsJoe Kinsella
 
(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014
(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014
(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014Amazon Web Services
 
AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...
AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...
AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...Edureka!
 
Amazon web services: A Quick Introduction from Cloudreach
Amazon web services: A Quick Introduction from CloudreachAmazon web services: A Quick Introduction from Cloudreach
Amazon web services: A Quick Introduction from Cloudreachcloudreachslideshare
 
Running Spot instance for production load
Running Spot instance for production loadRunning Spot instance for production load
Running Spot instance for production loadRyo Hang
 
How To Create instances in AWS EC2 | Edureka
How To Create instances in AWS EC2 | EdurekaHow To Create instances in AWS EC2 | Edureka
How To Create instances in AWS EC2 | EdurekaEdureka!
 
AWS Customer Presentation - Adobe's Foray into the Cloud
AWS Customer Presentation -  Adobe's Foray into the CloudAWS Customer Presentation -  Adobe's Foray into the Cloud
AWS Customer Presentation - Adobe's Foray into the CloudAmazon Web Services
 
LatJUG Amazon Web Services
LatJUG Amazon Web ServicesLatJUG Amazon Web Services
LatJUG Amazon Web ServicesDmitry Buzdin
 
Aws pricing overview
Aws pricing overviewAws pricing overview
Aws pricing overviewsaifam
 
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...Amazon Web Services
 

What's hot (20)

Using ansible to manage cloud platform by Accelerite
Using ansible to manage cloud platform by AcceleriteUsing ansible to manage cloud platform by Accelerite
Using ansible to manage cloud platform by Accelerite
 
Comparison of AWS, GCP & Azure web solutions
Comparison of AWS, GCP & Azure web solutionsComparison of AWS, GCP & Azure web solutions
Comparison of AWS, GCP & Azure web solutions
 
Azure functions: Quickstart
Azure functions: QuickstartAzure functions: Quickstart
Azure functions: Quickstart
 
Enterprise Cloud Batch Processing Compared
Enterprise Cloud Batch Processing ComparedEnterprise Cloud Batch Processing Compared
Enterprise Cloud Batch Processing Compared
 
Managing Amazon AWS Costs
Managing Amazon AWS CostsManaging Amazon AWS Costs
Managing Amazon AWS Costs
 
AWS Lambda
AWS LambdaAWS Lambda
AWS Lambda
 
(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014
(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014
(SDD420) Amazon WorkSpaces: Advanced Topics and Deep Dive | AWS re:Invent 2014
 
Aws day 2
Aws day 2Aws day 2
Aws day 2
 
Aws day 3
Aws day 3Aws day 3
Aws day 3
 
AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...
AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...
AWS vs Azure | Difference Between Microsoft Azure and Amazon AWS | AWS Traini...
 
Amazon web services: A Quick Introduction from Cloudreach
Amazon web services: A Quick Introduction from CloudreachAmazon web services: A Quick Introduction from Cloudreach
Amazon web services: A Quick Introduction from Cloudreach
 
Running Spot instance for production load
Running Spot instance for production loadRunning Spot instance for production load
Running Spot instance for production load
 
How To Create instances in AWS EC2 | Edureka
How To Create instances in AWS EC2 | EdurekaHow To Create instances in AWS EC2 | Edureka
How To Create instances in AWS EC2 | Edureka
 
Aws day 4
Aws day 4Aws day 4
Aws day 4
 
AWS Customer Presentation - Adobe's Foray into the Cloud
AWS Customer Presentation -  Adobe's Foray into the CloudAWS Customer Presentation -  Adobe's Foray into the Cloud
AWS Customer Presentation - Adobe's Foray into the Cloud
 
July in aws
July in awsJuly in aws
July in aws
 
Introduction to AWS
Introduction to AWSIntroduction to AWS
Introduction to AWS
 
LatJUG Amazon Web Services
LatJUG Amazon Web ServicesLatJUG Amazon Web Services
LatJUG Amazon Web Services
 
Aws pricing overview
Aws pricing overviewAws pricing overview
Aws pricing overview
 
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...
Customer Case Study Containerised Bioinformatics on AWS How we Achieved 20x l...
 

Viewers also liked

Trends in Modern Airline Booking
Trends in Modern Airline BookingTrends in Modern Airline Booking
Trends in Modern Airline BookingCMPUTE
 
AWS Spot infographic
AWS Spot infographicAWS Spot infographic
AWS Spot infographicCMPUTE
 
PriorityEngine E-Commerce
PriorityEngine E-CommercePriorityEngine E-Commerce
PriorityEngine E-CommerceCMPUTE
 
47Line PriorityEngine
47Line PriorityEngine47Line PriorityEngine
47Line PriorityEngineCMPUTE
 
PriorityEngine
PriorityEnginePriorityEngine
PriorityEngineCMPUTE
 
Rich User Experience Presentation by Luristic
Rich User Experience Presentation by LuristicRich User Experience Presentation by Luristic
Rich User Experience Presentation by LuristicLuristic
 
47Line Products & Services Overview
47Line Products & Services Overview47Line Products & Services Overview
47Line Products & Services OverviewCMPUTE
 
Batch processing in EDA (Event Driven Architectures)
Batch processing in EDA (Event Driven Architectures)Batch processing in EDA (Event Driven Architectures)
Batch processing in EDA (Event Driven Architectures)Álvaro Santuy Elena
 
(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You ThousandsAmazon Web Services
 

Viewers also liked (10)

Trends in Modern Airline Booking
Trends in Modern Airline BookingTrends in Modern Airline Booking
Trends in Modern Airline Booking
 
AWS Spot infographic
AWS Spot infographicAWS Spot infographic
AWS Spot infographic
 
PriorityEngine E-Commerce
PriorityEngine E-CommercePriorityEngine E-Commerce
PriorityEngine E-Commerce
 
47Line PriorityEngine
47Line PriorityEngine47Line PriorityEngine
47Line PriorityEngine
 
PriorityEngine
PriorityEnginePriorityEngine
PriorityEngine
 
Rich User Experience Presentation by Luristic
Rich User Experience Presentation by LuristicRich User Experience Presentation by Luristic
Rich User Experience Presentation by Luristic
 
47Line Products & Services Overview
47Line Products & Services Overview47Line Products & Services Overview
47Line Products & Services Overview
 
HPC Computing Trends
HPC Computing TrendsHPC Computing Trends
HPC Computing Trends
 
Batch processing in EDA (Event Driven Architectures)
Batch processing in EDA (Event Driven Architectures)Batch processing in EDA (Event Driven Architectures)
Batch processing in EDA (Event Driven Architectures)
 
(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands
 

Similar to An introduction to Spot Instances and AWS Fleet - Webinar

Leveraging elastic web scale computing with AWS
 Leveraging elastic web scale computing with AWS Leveraging elastic web scale computing with AWS
Leveraging elastic web scale computing with AWSShiva Narayanaswamy
 
AWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep diveAWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep divePeter Shi
 
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Amazon Web Services
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Amazon Web Services
 
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...Amazon Web Services
 
AWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet
AWS Atlanta Meetup -AWS Spot Blocks and Spot FleetAWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet
AWS Atlanta Meetup -AWS Spot Blocks and Spot FleetAdam Book
 
AWS Cost Control
AWS Cost ControlAWS Cost Control
AWS Cost ControlBob Brown
 
Getting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesGetting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesAmazon Web Services
 
Amazon cloud intance launch3
Amazon cloud intance launch3Amazon cloud intance launch3
Amazon cloud intance launch3Zenita Smythe
 
Amazon cloud intance launch
Amazon cloud intance launchAmazon cloud intance launch
Amazon cloud intance launchZenita Smythe
 
Amazon cloud intance launch3
Amazon cloud intance launch3Amazon cloud intance launch3
Amazon cloud intance launch3Zenita Smythe
 
Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options  Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options Cloudreach
 
Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...
Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...
Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...Amazon Web Services
 
Introduction to EC2
Introduction to EC2Introduction to EC2
Introduction to EC2Mark Squires
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWSJoseph K. Ziegler
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAmazon Web Services
 
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...Amazon Web Services
 
AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)
AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)
AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)Amazon Web Services
 

Similar to An introduction to Spot Instances and AWS Fleet - Webinar (20)

Leveraging elastic web scale computing with AWS
 Leveraging elastic web scale computing with AWS Leveraging elastic web scale computing with AWS
Leveraging elastic web scale computing with AWS
 
AWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep diveAWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep dive
 
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 SpotIntroduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
 
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
 
Amazon EC2 Spot Instances
Amazon EC2 Spot InstancesAmazon EC2 Spot Instances
Amazon EC2 Spot Instances
 
AWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet
AWS Atlanta Meetup -AWS Spot Blocks and Spot FleetAWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet
AWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet
 
AWS Cost Control
AWS Cost ControlAWS Cost Control
AWS Cost Control
 
Getting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesGetting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar Series
 
Amazon cloud intance launch3
Amazon cloud intance launch3Amazon cloud intance launch3
Amazon cloud intance launch3
 
Amazon cloud intance launch
Amazon cloud intance launchAmazon cloud intance launch
Amazon cloud intance launch
 
Amazon cloud intance launch3
Amazon cloud intance launch3Amazon cloud intance launch3
Amazon cloud intance launch3
 
Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options  Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options
 
Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...
Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...
Running Enterprise Test/Dev on Amazon EC2 Spot Instances (CMP407-R1) - AWS re...
 
Introduction to EC2
Introduction to EC2Introduction to EC2
Introduction to EC2
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWS
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
 
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
Running Amazon EKS Workloads on Amazon EC2 Spot Instances (CMP403-R1) - AWS r...
 
AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)
AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)
AWS re:Invent 2016: Searching Inside Video at Petabyte Scale Using Spot (WIN307)
 

Recently uploaded

Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.francesco barbera
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncObject Automation
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?SANGHEE SHIN
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum ComputingGDSC PJATK
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 

Recently uploaded (20)

Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation Inc
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum Computing
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 

An introduction to Spot Instances and AWS Fleet - Webinar

  • 1. Enterprise Cloud Access. Simplified. Paddy Raghavan Co-Founder PROUD MEMBER OF
  • 2. Spare Capacity at Steep Discounts (Sometimes 90% lower) Auction based pricing model Demand –Supply Economics What Is A Spot Instance?
  • 3. AWS EC2 Instance Pricing Options On Demand Instances: Hourly rate Reserved Instances: Upfront payment Lower hourly fee Capacity reservation Spot Instances: Bid for unused EC2 capacity
  • 4. AWS EC2 Instances (SI)  Bid for unused EC2 capacity  The hourly price for a SI (of each instance type in each Availability Zone) is set by Amazon EC2  Hourly price fluctuates depending on the supply of and demand of SI  SI runs whenever your bid exceeds the current market price.  SI might not start immediately  AWS might terminate SI as hourly price or availability changes. Partial hours are not charged.
  • 5. AWS EC2 Instance Life Cycle  Bid Price  Instance Count  Launch Specification: AMI Id, Availability zone, Keypair, Security Group VPC, SubnetID  Type: One Time / Persistent  ValidFrom , ValidUntil Create Request Request Launch Instances Interrupt (Spot Termination) One-TimeRequest Failed Interrupt (Persistent) Spot Instance requests can be created with AWS SDK’s, from management console and AWS clients.
  • 6. AWS EC2 Instance Request States  open—The request is waiting to be fulfilled.  active—The request is fulfilled and has an associated Spot Instance.  failed—The request has one or more bad parameters.  closed—The Spot Instance was interrupted or terminated.  canceled—You canceled the request, or the request expired.
  • 7. AWS EC2 Spot Request States
  • 8. EC2 Spot Instance Termination Notices  If current spot price > bid price, the Spot instance is reclaimed by AWS.  2 minutes before the spot instance is reclaimed the instance state is set to marked-for-termination.  Applications / scripts can poll the instance metadata or APIs to check for this notice and save its state, upload final log files, or remove itself from an Elastic Load Balancer.
  • 9. EC2 Spot Fleet Request  If current spot price > bid price, the Spot instance is reclaimed by AWS.  2 minutes before the spot instance is reclaimed the instance state is set to marked-for-termination.  Applications / scripts can poll the instance metadata or APIs to check for this notice and save its state, upload final log files, or remove itself from an Elastic Load Balancer.
  • 10. EC2 Spot Fleet Request Spot fleet request includes:  Target Capacity  One or more launch specification for the instances  Launch specification includes – AMI Id, instance type, subnet, AZ, security group and keypair name.  Maximum price per instance hour (bid price)
  • 11. Spot Fleet Request State A Spot fleet request can be in one of the following states:  Submitted —The Spot fleet request is being evaluated and Amazon EC2 is preparing to launch the target number of Spot Instances.  Active —The Spot fleet has been validated and Amazon EC2 is attempting to maintain the target number of running Spot Instances.  cancelled-running —The Spot fleet is canceled and will not launch additional Spot Instances, but its existing Spot Instances will continue to run until they are interrupted or terminated. This is the default behavior when canceling a Spot fleet.  cancelled-terminating —The Spot fleet is canceled and its Spot Instances are terminating. This is an option when canceling a Spot fleet.  Cancelled —The Spot fleet is canceled and has no running Spot Instances. The Spot fleet will be deleted two days after its instances were terminated.
  • 14. Prepare for Spot Interruptions  Choose a reasonable bid price  Ensure the AMI contains all required software, so that you can start quickly.  Sync important data to a persistent location (EBS / S3)  Divide the work into smaller chunks or have checkpoints to save work frequently.
  • 15. EC2 Spot Instance Termination Notices  Poll instance meta-data every 5 seconds with the following command  if curl -s http://169.254.169.254/latest/meta-data/spot/termination-time | grep -q .*T.*Z; then echo ‘notified for termination”; fi  If your Spot Instance is marked for termination by the Spot service, the termination-time item is present (2015-05-02T 01:00:00Z)  the termination-time item is either not present (so you receive an HTTP 404 error) or contains a value that is not a time value.
  • 16. Financial Analysis Scientific Analysis Batch Workloads Web Crawling Audio/ Video Encoding Testing Document Transformation Map Reduce Hedge fund Analytics, Energy Trading, Monte Carlo Simulations Scale Out Processing Extract & Process Internet Data Encode, Render & Process Large Audio & Video Files Load & Simulation Testing For Websites & Apps PDF Generation, OCR Processing Etc. Big Data Workloads Simulations, Drug Discovery, Testing Spotvantage
  • 17. Companies Benefiting From Spot  Mozilla saved over 15x times in 8 months by optimizing their AWS infrastructure for their continuous integration needs.  Vimeo saves over 50% in cloud costs by making intelligent use of AWS Spot Instances for video encoding workloads  Pharma company used 10,600 AWS EC2 SPOT instances to complete a 341K hour workload in 11 hours
  • 18. Batchly is a service that fully automates cloud infrastructure provisioning and management for enterprise data processing
  • 19. How does it work? Large Scale Processing Document Digitization Bill Generation Video Transcoding Image Formatting Log Analysis Document Archival Custom Batch / MapReduce Jobs Configuration Monitoring Upload Code Define SLA Run Job Batchly Delegated Trust Automation Amazon Web Services Storage Queue Database Notifications CloudWatch Email EC2 Spot Instance
  • 20. Continuous Learning Algorithm * Standard Rank Price Rank Run Instances Metrics • Throughput • Utilization System Parameters • Spot Price • Availability Market Parameters * Patent Pending
  • 21. Batchly: What it does  Abstracts cloud complexity  Uses your existing batch /MR jobs and data processing libraries  Runs the job in cloud at a cost and time you define (User Defined SLA)  Automatically uses AWS Spot Instances for significant savings  Provides an easy way to report the savings to Management
  • 23. Batchly Impact Financial Services 14x Processing time reduced from 12 hours to under 50 minutes. TIME FASTER COST 70%SAVINGS Low TCO. Saved 70% over on-demand cloud costs.
  • 24. You Specify Your Desired Cost Or Time For Your Batchly Job Your Data Stays Secure In Your Cloud Storage And Accessed Only Within Your Code.Optimizes Resources & Utilization Provisions & Runs The Correct AWS Resources Continuously Improves Allocation & Utilization
  • 25. Upload Code Define SLA Run Job Batchly Enterprise Data Processing Batchly – Single Interface for Data Processing Across Cloud Platforms 100% Support in place