SlideShare a Scribd company logo
Microservices on the SPOT!
Arif Amirani
CTO & Co-Founder at MetroGuild Inc
Agenda
◦ Basics of Spot instances & Microservices?
◦ Why use Spot instances?
◦ How MetroGuild uses microservices & Spot instances
to deliver high availability & cost savings
◦ Q&A
2
The bill comes due
◦ Are you running production workloads?
◦ Are you using Spot instances?
◦ Infrastructure needs to scale with the business…
frugally!
◦ Your job is not just to make it work
◦ Check your org/BU costs
3
SpotReserved
EC2 Purchase Options
On-demand
4
Spiky workloads Committed Flexible & stateless
Can I use Spot today?
◦ Is spot for everyone? – NO!
◦ Can everyone use Spot? – Maybe J
5
Microservices
6
• Scoped (Biz/Function)
• Decentralized
• Loosely coupled
• Autonomous
• Black box
• Shared nothing*
Spots are great!...Right?
◦ Interruptions are a reality!
◦ But… 95% of instances weren’t interrupted in 3
months
◦ We get a 2 minute warning before instance is killed
◦ Pricing was/is dynamic
7
HMMM… MICROSERVICES ON CONTAINERS
Is my workload ready for Spot?
8
STATELESS
FAULT
TOLERANT
FLEXIBLE
AZ + INSTANCE
LOOSELY
COUPLED
Spot Pricing/Bidding
◦ Remember Spot is spare capacity from the on-
demand pool
◦ If on-demand usage increases you may lose your spot
instances
◦ Bidding was the norm earlier
◦ Predictable pricing after Nov 2017
9
Spot Pools
10
INSTANCE FAMILY
c4
+
INSTANCE SIZE
xlarge
=
AVAILABILITY ZONE
1a
REGION
us-east
SPOT POOL
What does that mean?
11
Choose several availability zones
What does that mean?
12
Choose several instance types
Spot Integrations
13
We are a sales
accelerator for large
enterprises
14
What is MetroLeads?
Sourcing
Lead Management
Voice
CRM
Email and SMS
Sig management
Calendaring
Field Sales
Vertical centric
3rd party apps
Metroleads Cocktail for
Sales and Marketing
API
15
Analytics & Campaigns
Voice platform
Fast response times
Uptime
Quick updates
Experimentation
Security & Compliance
High throughput & scaled capacity
Low latency
Geo distribution
High availability
Fast control plane
A/B Testing & Environments
Isolation, certificate maintenance, etc
Business vs Engineering Goals
Metroleads
CRM
Insights
Reports
DATA CAPTURE
API EmailSMSCalls Web entries
Mobile App
IOS and Android
Web App
Expo App
USERS
◦ Microservices architecture
◦ Containers (Docker) & Orchestration (Puppet)
◦ Highly available data sources – Cassandra & Elasticsearch
Clusters
◦ Data (API) delivery - ReactJS/React Native
◦ Data Security – Isolated environments and secure access
◦ Open Source software is preferred (Self hosted)
16
Key Tenets
◦ Data Growth & Customer Growth
◦ Fluctuations of data (periodic spikes)
◦ Cost per customer was too high
17
Why did we even move to Spot?
18
No time to react – Auto Scaling
◦ We got outbid too often – Cost!
◦ No warnings – Data Loss!
◦ Code was not resilient to failure or load due to loss of
capacity – Broken windows!
◦ Lack of choices i.e. could not request classes of instances -
Locked on one type & spent time on deciding (we wrote a
prediction algorithm too)!
19
Initial Spot Hurdles – Circa ‘13
◦ Ease of deployment
◦ Auto registration with ALB/ELB – Target groups
◦ Moved to a real messaging queue (RabbitMQ) to
throttle load for non SLA services
◦ Gracefully handled failures (not too graceful though)
20
Advent of ECS/ECR a la mode Docker
21
Deployment
◦ Using init-data, instance registers with cluster
◦ Installs docker on boot
◦ ECS cluster in daemon/replica mode deploys app
◦ Target groups route ALB traffic to docker containers on Spot
instances
◦ Data is routed via message queue to non internet facing
services
22
Deployment Notes - Recap
ECS Clusters – Backbone of Spot
23
Slow deployments, manual scaling, over
provisioned system
Benefits so far…
24
◦ Spot fleet allows us to request a class of instances and
maintains capacity - Overprovisioning
◦ Stable pricing (max we pay is on-demand cost)
◦ Transparency in cost savings & no cost spikes –
Predictable bills
◦ Early warnings - We just use them to notify us
◦ 90% workloads on Spot
◦ Scale up/down capacity within minutes
Spot Savings - In Numbers (-3d)
25
Key Takeaways
26
◦ Spot Fleets should be part of your architecture
◦ Spot Fleets can save a lot of money only if you change
your architecture
◦ Spots can handle all types of workloads not just data
processing
◦ Trust AWS to innovate
27
Thanks!
We are hiring!
You can find us at:
◦ www.metroguild.com
◦ careers@metroguild.com
◦ https://www.linkedin.com/in/arifamirani/

More Related Content

What's hot

IT Risk Management
IT Risk ManagementIT Risk Management
IT Risk Management
nainikadesigncorp
 
Go for Real Time Streaming Architectures - DotGo 2017
Go for Real Time Streaming Architectures - DotGo 2017Go for Real Time Streaming Architectures - DotGo 2017
Go for Real Time Streaming Architectures - DotGo 2017
Mickaël Rémond
 
Grid calculations ELVIS event Antti Harjula
Grid calculations ELVIS event Antti HarjulaGrid calculations ELVIS event Antti Harjula
Grid calculations ELVIS event Antti Harjula
Fingrid Oyj
 
APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...
APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...
APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...
apidays
 
How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...
How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...
How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...
Amazon Web Services
 
Patterns for building resilient and scalable microservices platform on AWS
Patterns for building resilient and scalable microservices platform on AWSPatterns for building resilient and scalable microservices platform on AWS
Patterns for building resilient and scalable microservices platform on AWS
Boyan Dimitrov
 
ADC-as-a-Service
ADC-as-a-ServiceADC-as-a-Service
ADC-as-a-Service
Riverbed Technology
 
Enabling a Real-Time, Agile, Event-Driven Enterprise
Enabling a Real-Time, Agile, Event-Driven EnterpriseEnabling a Real-Time, Agile, Event-Driven Enterprise
Enabling a Real-Time, Agile, Event-Driven Enterprise
Solace
 
How to Measure the the Quality of Service in Cloud Based Technology?
How to Measure the the Quality of Service in Cloud Based Technology?How to Measure the the Quality of Service in Cloud Based Technology?
How to Measure the the Quality of Service in Cloud Based Technology?
Madushi Rathnayake
 
How to build & run a SaaS with a team of two
How to build & run a SaaS with a team of twoHow to build & run a SaaS with a team of two
How to build & run a SaaS with a team of two
Eficode
 
ELVIS transmission line maintenance ELVIS event. Vesa Malinen
ELVIS transmission line maintenance ELVIS event. Vesa MalinenELVIS transmission line maintenance ELVIS event. Vesa Malinen
ELVIS transmission line maintenance ELVIS event. Vesa Malinen
Fingrid Oyj
 
Event-Driven Transformation in Banking and FSI
Event-Driven Transformation in Banking and FSIEvent-Driven Transformation in Banking and FSI
Event-Driven Transformation in Banking and FSI
Solace
 
Real time serverless data pipelines on AWS
Real time serverless data pipelines on AWSReal time serverless data pipelines on AWS
Real time serverless data pipelines on AWS
The Incredible Automation Day
 
Keynote : évolution et vision d'Elastic Observability
Keynote : évolution et vision d'Elastic ObservabilityKeynote : évolution et vision d'Elastic Observability
Keynote : évolution et vision d'Elastic Observability
Elasticsearch
 
Stream events across your enterprise with the Solace Platform
Stream events across your enterprise with the Solace PlatformStream events across your enterprise with the Solace Platform
Stream events across your enterprise with the Solace Platform
Solace
 
High-Velocity, Real-Time Connected Industry – From Edge to Cloud
High-Velocity, Real-Time Connected Industry – From Edge to CloudHigh-Velocity, Real-Time Connected Industry – From Edge to Cloud
High-Velocity, Real-Time Connected Industry – From Edge to Cloud
Solace
 
ELVIS substation maintenance Hannu Hätönen
ELVIS substation maintenance Hannu HätönenELVIS substation maintenance Hannu Hätönen
ELVIS substation maintenance Hannu Hätönen
Fingrid Oyj
 
Savings on scale - Spot Instances with Autospotter
Savings on scale - Spot Instances with AutospotterSavings on scale - Spot Instances with Autospotter
Savings on scale - Spot Instances with Autospotter
AWS Germany
 
From AIX to Zero-ops by Pierre Baillet
From AIX to Zero-ops by Pierre BailletFrom AIX to Zero-ops by Pierre Baillet
From AIX to Zero-ops by Pierre Baillet
The Incredible Automation Day
 
Combining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityCombining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observability
Elasticsearch
 

What's hot (20)

IT Risk Management
IT Risk ManagementIT Risk Management
IT Risk Management
 
Go for Real Time Streaming Architectures - DotGo 2017
Go for Real Time Streaming Architectures - DotGo 2017Go for Real Time Streaming Architectures - DotGo 2017
Go for Real Time Streaming Architectures - DotGo 2017
 
Grid calculations ELVIS event Antti Harjula
Grid calculations ELVIS event Antti HarjulaGrid calculations ELVIS event Antti Harjula
Grid calculations ELVIS event Antti Harjula
 
APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...
APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...
APIdays Paris 2018 - Europ Assistance, the transformation through Public APIs...
 
How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...
How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...
How to Say Yes to Self-Service in the Cloud and Become an IT Hero (ENT217) | ...
 
Patterns for building resilient and scalable microservices platform on AWS
Patterns for building resilient and scalable microservices platform on AWSPatterns for building resilient and scalable microservices platform on AWS
Patterns for building resilient and scalable microservices platform on AWS
 
ADC-as-a-Service
ADC-as-a-ServiceADC-as-a-Service
ADC-as-a-Service
 
Enabling a Real-Time, Agile, Event-Driven Enterprise
Enabling a Real-Time, Agile, Event-Driven EnterpriseEnabling a Real-Time, Agile, Event-Driven Enterprise
Enabling a Real-Time, Agile, Event-Driven Enterprise
 
How to Measure the the Quality of Service in Cloud Based Technology?
How to Measure the the Quality of Service in Cloud Based Technology?How to Measure the the Quality of Service in Cloud Based Technology?
How to Measure the the Quality of Service in Cloud Based Technology?
 
How to build & run a SaaS with a team of two
How to build & run a SaaS with a team of twoHow to build & run a SaaS with a team of two
How to build & run a SaaS with a team of two
 
ELVIS transmission line maintenance ELVIS event. Vesa Malinen
ELVIS transmission line maintenance ELVIS event. Vesa MalinenELVIS transmission line maintenance ELVIS event. Vesa Malinen
ELVIS transmission line maintenance ELVIS event. Vesa Malinen
 
Event-Driven Transformation in Banking and FSI
Event-Driven Transformation in Banking and FSIEvent-Driven Transformation in Banking and FSI
Event-Driven Transformation in Banking and FSI
 
Real time serverless data pipelines on AWS
Real time serverless data pipelines on AWSReal time serverless data pipelines on AWS
Real time serverless data pipelines on AWS
 
Keynote : évolution et vision d'Elastic Observability
Keynote : évolution et vision d'Elastic ObservabilityKeynote : évolution et vision d'Elastic Observability
Keynote : évolution et vision d'Elastic Observability
 
Stream events across your enterprise with the Solace Platform
Stream events across your enterprise with the Solace PlatformStream events across your enterprise with the Solace Platform
Stream events across your enterprise with the Solace Platform
 
High-Velocity, Real-Time Connected Industry – From Edge to Cloud
High-Velocity, Real-Time Connected Industry – From Edge to CloudHigh-Velocity, Real-Time Connected Industry – From Edge to Cloud
High-Velocity, Real-Time Connected Industry – From Edge to Cloud
 
ELVIS substation maintenance Hannu Hätönen
ELVIS substation maintenance Hannu HätönenELVIS substation maintenance Hannu Hätönen
ELVIS substation maintenance Hannu Hätönen
 
Savings on scale - Spot Instances with Autospotter
Savings on scale - Spot Instances with AutospotterSavings on scale - Spot Instances with Autospotter
Savings on scale - Spot Instances with Autospotter
 
From AIX to Zero-ops by Pierre Baillet
From AIX to Zero-ops by Pierre BailletFrom AIX to Zero-ops by Pierre Baillet
From AIX to Zero-ops by Pierre Baillet
 
Combining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observabilityCombining logs, metrics, and traces for unified observability
Combining logs, metrics, and traces for unified observability
 

Similar to AWS Pune Meetup - Microservices

Serverless Computing: Driving Innovation and Business Value
Serverless Computing: Driving Innovation and Business ValueServerless Computing: Driving Innovation and Business Value
Serverless Computing: Driving Innovation and Business Value
Alibaba Cloud
 
CA Spectrum® Just Keeps Getting Better and Better
CA Spectrum® Just Keeps Getting Better and BetterCA Spectrum® Just Keeps Getting Better and Better
CA Spectrum® Just Keeps Getting Better and Better
CA Technologies
 
IoT and the Oil & Gas industry at M2M Oil & Gas 2014 in London
IoT and the Oil & Gas industry at M2M Oil & Gas 2014 in LondonIoT and the Oil & Gas industry at M2M Oil & Gas 2014 in London
IoT and the Oil & Gas industry at M2M Oil & Gas 2014 in London
Eurotech
 
5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS
Christian Beedgen
 
Attinad Software IoT offerings
Attinad Software IoT offeringsAttinad Software IoT offerings
Attinad Software IoT offerings
Shafeer Badharudeen
 
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise StrategyAWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
Amazon Web Services
 
Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...
Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...
Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...
Eurotech
 
Breaking the Monolith Road to Containers
Breaking the Monolith Road to ContainersBreaking the Monolith Road to Containers
Breaking the Monolith Road to Containers
Amazon Web Services
 
Transformação Digital – Onde se encontra a Indústria.
Transformação Digital – Onde se encontra a Indústria.Transformação Digital – Onde se encontra a Indústria.
Transformação Digital – Onde se encontra a Indústria.
Joao Galdino Mello de Souza
 
QueueMetrics Live
QueueMetrics LiveQueueMetrics Live
QueueMetrics Live
Clarotech_Events
 
Unleashing Apache Kafka and TensorFlow in the Cloud

Unleashing Apache Kafka and TensorFlow in the Cloud
Unleashing Apache Kafka and TensorFlow in the Cloud

Unleashing Apache Kafka and TensorFlow in the Cloud

Kai Wähner
 
Right scale enterprise solution
Right scale enterprise solution Right scale enterprise solution
Right scale enterprise solution
Brad , Yun Lee
 
Right scale enterprise solution
Right scale enterprise solution Right scale enterprise solution
Right scale enterprise solution
Brad , Yun Lee
 
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator SuiteOracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Ike Aniagoh
 
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
Edge AI and Vision Alliance
 
The Impact of Messaging Standards on Event-Driven Architecture and IoT
The Impact of Messaging Standards on Event-Driven Architecture and IoTThe Impact of Messaging Standards on Event-Driven Architecture and IoT
The Impact of Messaging Standards on Event-Driven Architecture and IoT
Solace
 
Should healthcare abandon the cloud final
Should healthcare abandon the cloud finalShould healthcare abandon the cloud final
Should healthcare abandon the cloud final
sapenov
 
RightScale Roadtrip Boston: Accelerate to Cloud
RightScale Roadtrip Boston: Accelerate to CloudRightScale Roadtrip Boston: Accelerate to Cloud
RightScale Roadtrip Boston: Accelerate to Cloud
RightScale
 
Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...
Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...
Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...
Amazon Web Services
 
Defining a Cloud Adoption Journey to Deliver Cloud Native Services
Defining a Cloud Adoption Journey to Deliver Cloud Native ServicesDefining a Cloud Adoption Journey to Deliver Cloud Native Services
Defining a Cloud Adoption Journey to Deliver Cloud Native Services
Amazon Web Services
 

Similar to AWS Pune Meetup - Microservices (20)

Serverless Computing: Driving Innovation and Business Value
Serverless Computing: Driving Innovation and Business ValueServerless Computing: Driving Innovation and Business Value
Serverless Computing: Driving Innovation and Business Value
 
CA Spectrum® Just Keeps Getting Better and Better
CA Spectrum® Just Keeps Getting Better and BetterCA Spectrum® Just Keeps Getting Better and Better
CA Spectrum® Just Keeps Getting Better and Better
 
IoT and the Oil & Gas industry at M2M Oil & Gas 2014 in London
IoT and the Oil & Gas industry at M2M Oil & Gas 2014 in LondonIoT and the Oil & Gas industry at M2M Oil & Gas 2014 in London
IoT and the Oil & Gas industry at M2M Oil & Gas 2014 in London
 
5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS
 
Attinad Software IoT offerings
Attinad Software IoT offeringsAttinad Software IoT offerings
Attinad Software IoT offerings
 
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise StrategyAWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
 
Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...
Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...
Addressing the Complexity and Risks of M2M Projects - M2M World Congress Apri...
 
Breaking the Monolith Road to Containers
Breaking the Monolith Road to ContainersBreaking the Monolith Road to Containers
Breaking the Monolith Road to Containers
 
Transformação Digital – Onde se encontra a Indústria.
Transformação Digital – Onde se encontra a Indústria.Transformação Digital – Onde se encontra a Indústria.
Transformação Digital – Onde se encontra a Indústria.
 
QueueMetrics Live
QueueMetrics LiveQueueMetrics Live
QueueMetrics Live
 
Unleashing Apache Kafka and TensorFlow in the Cloud

Unleashing Apache Kafka and TensorFlow in the Cloud
Unleashing Apache Kafka and TensorFlow in the Cloud

Unleashing Apache Kafka and TensorFlow in the Cloud

 
Right scale enterprise solution
Right scale enterprise solution Right scale enterprise solution
Right scale enterprise solution
 
Right scale enterprise solution
Right scale enterprise solution Right scale enterprise solution
Right scale enterprise solution
 
Oracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator SuiteOracle Open World 2018 - Cloud Lift Accelerator Suite
Oracle Open World 2018 - Cloud Lift Accelerator Suite
 
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
“Machine Learning for the Real World: What is Acceptable Accuracy, and How Ca...
 
The Impact of Messaging Standards on Event-Driven Architecture and IoT
The Impact of Messaging Standards on Event-Driven Architecture and IoTThe Impact of Messaging Standards on Event-Driven Architecture and IoT
The Impact of Messaging Standards on Event-Driven Architecture and IoT
 
Should healthcare abandon the cloud final
Should healthcare abandon the cloud finalShould healthcare abandon the cloud final
Should healthcare abandon the cloud final
 
RightScale Roadtrip Boston: Accelerate to Cloud
RightScale Roadtrip Boston: Accelerate to CloudRightScale Roadtrip Boston: Accelerate to Cloud
RightScale Roadtrip Boston: Accelerate to Cloud
 
Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...
Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...
Transforming Consumer Banking with a 100% Cloud-Based Bank (FSV204) - AWS re:...
 
Defining a Cloud Adoption Journey to Deliver Cloud Native Services
Defining a Cloud Adoption Journey to Deliver Cloud Native ServicesDefining a Cloud Adoption Journey to Deliver Cloud Native Services
Defining a Cloud Adoption Journey to Deliver Cloud Native Services
 

Recently uploaded

High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
Vadym Kazulkin
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
c5vrf27qcz
 
A Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's ArchitectureA Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's Architecture
ScyllaDB
 
Christine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptxChristine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptx
christinelarrosa
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
christinelarrosa
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
"Scaling RAG Applications to serve millions of users",  Kevin Goedecke"Scaling RAG Applications to serve millions of users",  Kevin Goedecke
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
Fwdays
 
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdfSession 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
UiPathCommunity
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
Fwdays
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
DianaGray10
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Neo4j
 

Recently uploaded (20)

High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
 
A Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's ArchitectureA Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's Architecture
 
Christine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptxChristine's Product Research Presentation.pptx
Christine's Product Research Presentation.pptx
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
"Scaling RAG Applications to serve millions of users",  Kevin Goedecke"Scaling RAG Applications to serve millions of users",  Kevin Goedecke
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
 
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdfSession 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
What is an RPA CoE? Session 1 – CoE Vision
What is an RPA CoE?  Session 1 – CoE VisionWhat is an RPA CoE?  Session 1 – CoE Vision
What is an RPA CoE? Session 1 – CoE Vision
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 

AWS Pune Meetup - Microservices

  • 1. Microservices on the SPOT! Arif Amirani CTO & Co-Founder at MetroGuild Inc
  • 2. Agenda ◦ Basics of Spot instances & Microservices? ◦ Why use Spot instances? ◦ How MetroGuild uses microservices & Spot instances to deliver high availability & cost savings ◦ Q&A 2
  • 3. The bill comes due ◦ Are you running production workloads? ◦ Are you using Spot instances? ◦ Infrastructure needs to scale with the business… frugally! ◦ Your job is not just to make it work ◦ Check your org/BU costs 3
  • 4. SpotReserved EC2 Purchase Options On-demand 4 Spiky workloads Committed Flexible & stateless
  • 5. Can I use Spot today? ◦ Is spot for everyone? – NO! ◦ Can everyone use Spot? – Maybe J 5
  • 6. Microservices 6 • Scoped (Biz/Function) • Decentralized • Loosely coupled • Autonomous • Black box • Shared nothing*
  • 7. Spots are great!...Right? ◦ Interruptions are a reality! ◦ But… 95% of instances weren’t interrupted in 3 months ◦ We get a 2 minute warning before instance is killed ◦ Pricing was/is dynamic 7
  • 8. HMMM… MICROSERVICES ON CONTAINERS Is my workload ready for Spot? 8 STATELESS FAULT TOLERANT FLEXIBLE AZ + INSTANCE LOOSELY COUPLED
  • 9. Spot Pricing/Bidding ◦ Remember Spot is spare capacity from the on- demand pool ◦ If on-demand usage increases you may lose your spot instances ◦ Bidding was the norm earlier ◦ Predictable pricing after Nov 2017 9
  • 10. Spot Pools 10 INSTANCE FAMILY c4 + INSTANCE SIZE xlarge = AVAILABILITY ZONE 1a REGION us-east SPOT POOL
  • 11. What does that mean? 11 Choose several availability zones
  • 12. What does that mean? 12 Choose several instance types
  • 14. We are a sales accelerator for large enterprises 14 What is MetroLeads? Sourcing Lead Management Voice CRM Email and SMS Sig management Calendaring Field Sales Vertical centric 3rd party apps Metroleads Cocktail for Sales and Marketing API
  • 15. 15 Analytics & Campaigns Voice platform Fast response times Uptime Quick updates Experimentation Security & Compliance High throughput & scaled capacity Low latency Geo distribution High availability Fast control plane A/B Testing & Environments Isolation, certificate maintenance, etc Business vs Engineering Goals Metroleads CRM Insights Reports DATA CAPTURE API EmailSMSCalls Web entries Mobile App IOS and Android Web App Expo App USERS
  • 16. ◦ Microservices architecture ◦ Containers (Docker) & Orchestration (Puppet) ◦ Highly available data sources – Cassandra & Elasticsearch Clusters ◦ Data (API) delivery - ReactJS/React Native ◦ Data Security – Isolated environments and secure access ◦ Open Source software is preferred (Self hosted) 16 Key Tenets
  • 17. ◦ Data Growth & Customer Growth ◦ Fluctuations of data (periodic spikes) ◦ Cost per customer was too high 17 Why did we even move to Spot?
  • 18. 18 No time to react – Auto Scaling
  • 19. ◦ We got outbid too often – Cost! ◦ No warnings – Data Loss! ◦ Code was not resilient to failure or load due to loss of capacity – Broken windows! ◦ Lack of choices i.e. could not request classes of instances - Locked on one type & spent time on deciding (we wrote a prediction algorithm too)! 19 Initial Spot Hurdles – Circa ‘13
  • 20. ◦ Ease of deployment ◦ Auto registration with ALB/ELB – Target groups ◦ Moved to a real messaging queue (RabbitMQ) to throttle load for non SLA services ◦ Gracefully handled failures (not too graceful though) 20 Advent of ECS/ECR a la mode Docker
  • 22. ◦ Using init-data, instance registers with cluster ◦ Installs docker on boot ◦ ECS cluster in daemon/replica mode deploys app ◦ Target groups route ALB traffic to docker containers on Spot instances ◦ Data is routed via message queue to non internet facing services 22 Deployment Notes - Recap
  • 23. ECS Clusters – Backbone of Spot 23 Slow deployments, manual scaling, over provisioned system
  • 24. Benefits so far… 24 ◦ Spot fleet allows us to request a class of instances and maintains capacity - Overprovisioning ◦ Stable pricing (max we pay is on-demand cost) ◦ Transparency in cost savings & no cost spikes – Predictable bills ◦ Early warnings - We just use them to notify us ◦ 90% workloads on Spot ◦ Scale up/down capacity within minutes
  • 25. Spot Savings - In Numbers (-3d) 25
  • 26. Key Takeaways 26 ◦ Spot Fleets should be part of your architecture ◦ Spot Fleets can save a lot of money only if you change your architecture ◦ Spots can handle all types of workloads not just data processing ◦ Trust AWS to innovate
  • 27. 27 Thanks! We are hiring! You can find us at: ◦ www.metroguild.com ◦ careers@metroguild.com ◦ https://www.linkedin.com/in/arifamirani/