SlideShare a Scribd company logo
1 of 32
@
#MDBlocal
Guillaume Meister
Principal Solutions Architect, EMEA
gmeister_fr
Atlas Autoscaling
#MDBLocal
GUILLAUME MEISTER
Principal Solutions Architect, EMEA
based in Paris MongoDB Office
#MDBLocal
Flexibility - Y
Reliability - Y
Performance - Y
Cost - ?
#MDBLocal
Managing Capacity is the Key to Cost Optimization
Reality Aspirations
#MDBLocal
Ever played Whack-A-Mole?
meet François
the Database
Administrateur !
Introducing Atlas Autoscaling
Automatically manage capacity to intelligently balance between
performance and cost
#MDBLocal
How does it work?
ComputeStorage
Predict future workload patterns
Automatically adjusts storage and compute to fit the workload
#MDBLocal
What do spikes look like ?
(Simulated Results)
#MDBLocal
How does it work?
Storage
For any given compute, provision the right disk
space
Automatically increases disk space to keep up
with writes
Compute
Adjusts the CPU and Memory provisioned to
keep up with workload
If workload increases, scale up to perform
If workload decreases, scale down to save
#MDBLocal
How do we do it?
Monitor Performance
& Learn
● Actually easier?
● How do we know we are
doing well?
● How do we know we are
not?
● How can we learn and
improve the system
Predict Future Workload
● Not easy :)
● Up
○ Too fast wastes $
○ Too slow degrades
performance
● Down
○ Too fast degrades
performance
○ Too slow wastes $
Adjust Capacity Safely
● Not easy :)
● Scaling is expensive
● How do we reduce
impact to app?
feedback
#MDBLocal
Step 1: Predicting Future Workload using Expert Learning
Up Scaling
Normalized CPU Util > 75%
OR Memory Util > 75%
For at-least 1 hour
Checked every 5 minutes
Down Scaling
Normalized CPU Util <50%
AND Memory Util <50%
For at-least 72 hour
Checked every 5 minutes
#MDBLocal
2. Perform Scaling Operations
User
Atlas
Metrics
Atlas
predicts
future
utilization
Executes
autoscalin
g
decisions
Check user
specified
conditions
Automated
hardware
provisionin
g
Atlas
automatically
changes
cluster’s
computation
capacity with
no downtime
Utilization
metrics are
captured in
real time
User
Alerts to
users
#MDBLocal
Step 3: Monitor Performance & Learn
Telemetry tracking how well we are predicting
Telemetry tracking how the workload pattern
changes
Testing new algorithms with historic data to improve
performance
Ability to tune algorithm per cluster, if needed
#MDBLocal
Quick UI Walkthrough
#MDBLocal
Quick UI Walkthrough
#MDBLocal
When to use autoscaling?
If utilization is variable throughout the day or week & you want to save $
If you want to not worry about scaling your cluster as you grow over time
If you have very high utilization & you are afraid of oversaturating your cluster
But don't forget to use ATLAS Performance Advisor
to optimize your queries !
#MDBLocal
Real life behavior
High CPU utilization indicates
that the Atlas cluster tier is
insufficient to meet the workload
requirements
After auto-scaling, CPU
utilization drops indicating the
Atlas cluster is sufficiently sized
#MDBLocal
Now François can relax !
is luv
MongoDB
autoscaling !
Q&A
#MDBlocal
Atlas Open Service Broker
Deploying managed MongoDB clusters from
within Kubernetes
LONDON
Ben Elgar
Who am I?
● Software engineer on Private Cloud
Kubernetes team
● MongoDB Enterprise Operator
● Lead development on the Atlas Open
Service Broker
Why should you listen?
● Manage your MongoDB clusters inside of Kubernetes
● Consistency
● Easily replicable
● No custom scripts
What is a service broker?
● An application that implements the Open Service Broker
API
● Provision third-party resources from within a platform
What is the Atlas service broker?
● Application you run inside of Kubernetes
● Exposes a standard API
● Manage Atlas clusters and users with Kubernetes
resources
Kubernetes
ServiceInstance
Resource
Service
Catalog
Atlas
Service
Broker
---
apiVersion: servicecatalog.k8s.io/v1beta1
kind: ServiceInstance
metadata:
name: atlas-cluster-instance
spec:
serviceClassExternalName: mongodb-atlas-aws
servicePlanExternalName: M10
parameters:
cluster:
providerSettings:
regionName: "EU_CENTRAL_1"
Atlas
Live Demo
Wish me luck.
Nota Bene
● Only clusters and users—everything else must be
managed in Atlas
● Resources in Kubernetes will not reflect changes made
outside
Open Source
● Free as in speech and free as in beer
● Apache Licensed
https://github.com/mongodb/mongodb-atlas-service-broker
CHEERS!
#MDBlocal
MongoDB Atlas New
Features: Open Service
Broker
Ben Elgar
https://www.surveymonkey.com/r/8KSJRK5
MongoDB .local London 2019: New Product Announcements: MongoDB Atlas Autoscaling and MongoDB Atlas Open Service Broker

More Related Content

What's hot

mabl's Machine Learning Implementation on Google Cloud Platform
mabl's Machine Learning Implementation on Google Cloud Platformmabl's Machine Learning Implementation on Google Cloud Platform
mabl's Machine Learning Implementation on Google Cloud PlatformJoseph Lust
 
Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...
Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...
Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...HostedbyConfluent
 
SITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAP
SITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAPSITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAP
SITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAPsitist
 
Introduction to the Data Grid
Introduction to the Data GridIntroduction to the Data Grid
Introduction to the Data GridOutSystems
 
Build scripting with psake
Build scripting with psakeBuild scripting with psake
Build scripting with psakeAdam Crane
 
Serverless Machine Learning Workshop
Serverless Machine Learning WorkshopServerless Machine Learning Workshop
Serverless Machine Learning WorkshopAlex Casalboni
 
CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNER
CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNERCREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNER
CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNERCodeOps Technologies LLP
 
OTP System with AWS Serverless
OTP System with AWS ServerlessOTP System with AWS Serverless
OTP System with AWS ServerlessPubudu Jayawardana
 
A Lap around ASP.NET 5 - VConf
A Lap around ASP.NET 5 - VConfA Lap around ASP.NET 5 - VConf
A Lap around ASP.NET 5 - VConfSam Basu
 
Building a Data Ingestion & Processing Pipeline with Spark & Airflow
Building a Data Ingestion & Processing Pipeline with Spark & AirflowBuilding a Data Ingestion & Processing Pipeline with Spark & Airflow
Building a Data Ingestion & Processing Pipeline with Spark & AirflowTom Lous
 
The future is Serveless | Filip Knapik | #4 Serverless UG Warsaw
The future is Serveless | Filip Knapik | #4 Serverless UG WarsawThe future is Serveless | Filip Knapik | #4 Serverless UG Warsaw
The future is Serveless | Filip Knapik | #4 Serverless UG WarsawServerless User Group Poland
 
Real time Object Detection and Analytics using RedisEdge and Docker
Real time Object Detection and Analytics using RedisEdge and DockerReal time Object Detection and Analytics using RedisEdge and Docker
Real time Object Detection and Analytics using RedisEdge and DockerAjeet Singh Raina
 
Front End Orlando - AWS Lambda
Front End Orlando - AWS LambdaFront End Orlando - AWS Lambda
Front End Orlando - AWS LambdaBrandon Westcott
 
Elastic Search Meetup Special - Yann Cluchey, Cogenta
Elastic Search Meetup Special - Yann Cluchey, Cogenta Elastic Search Meetup Special - Yann Cluchey, Cogenta
Elastic Search Meetup Special - Yann Cluchey, Cogenta Internet World
 
Building services for apps on a shoestring budget
Building services for apps on a shoestring budgetBuilding services for apps on a shoestring budget
Building services for apps on a shoestring budgetRobert MacLean
 
Introduction to Serverless and Google Cloud Functions
Introduction to Serverless and Google Cloud FunctionsIntroduction to Serverless and Google Cloud Functions
Introduction to Serverless and Google Cloud FunctionsMalepati Bala Siva Sai Akhil
 

What's hot (20)

mabl's Machine Learning Implementation on Google Cloud Platform
mabl's Machine Learning Implementation on Google Cloud Platformmabl's Machine Learning Implementation on Google Cloud Platform
mabl's Machine Learning Implementation on Google Cloud Platform
 
How to set up Kubernetes for all your machine learning workflows
How to set up Kubernetes for all your machine learning workflowsHow to set up Kubernetes for all your machine learning workflows
How to set up Kubernetes for all your machine learning workflows
 
Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...
Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...
Delivering Cloud-Native Data Pipelines with Kafka Connect on Kubernetes | Vik...
 
SITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAP
SITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAPSITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAP
SITIST 2018 Part 2 - Speed up Test Data Creation Process in ABAP
 
How To Build Auto-Adaptive Machine Learning Models with Kubernetes
How To Build Auto-Adaptive Machine Learning Models with KubernetesHow To Build Auto-Adaptive Machine Learning Models with Kubernetes
How To Build Auto-Adaptive Machine Learning Models with Kubernetes
 
Keynote TIAD Camp Serverless
Keynote TIAD Camp ServerlessKeynote TIAD Camp Serverless
Keynote TIAD Camp Serverless
 
Introduction to the Data Grid
Introduction to the Data GridIntroduction to the Data Grid
Introduction to the Data Grid
 
Build scripting with psake
Build scripting with psakeBuild scripting with psake
Build scripting with psake
 
Serverless Machine Learning Workshop
Serverless Machine Learning WorkshopServerless Machine Learning Workshop
Serverless Machine Learning Workshop
 
CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNER
CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNERCREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNER
CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNER
 
2016 History - update per month
2016 History - update per month2016 History - update per month
2016 History - update per month
 
OTP System with AWS Serverless
OTP System with AWS ServerlessOTP System with AWS Serverless
OTP System with AWS Serverless
 
A Lap around ASP.NET 5 - VConf
A Lap around ASP.NET 5 - VConfA Lap around ASP.NET 5 - VConf
A Lap around ASP.NET 5 - VConf
 
Building a Data Ingestion & Processing Pipeline with Spark & Airflow
Building a Data Ingestion & Processing Pipeline with Spark & AirflowBuilding a Data Ingestion & Processing Pipeline with Spark & Airflow
Building a Data Ingestion & Processing Pipeline with Spark & Airflow
 
The future is Serveless | Filip Knapik | #4 Serverless UG Warsaw
The future is Serveless | Filip Knapik | #4 Serverless UG WarsawThe future is Serveless | Filip Knapik | #4 Serverless UG Warsaw
The future is Serveless | Filip Knapik | #4 Serverless UG Warsaw
 
Real time Object Detection and Analytics using RedisEdge and Docker
Real time Object Detection and Analytics using RedisEdge and DockerReal time Object Detection and Analytics using RedisEdge and Docker
Real time Object Detection and Analytics using RedisEdge and Docker
 
Front End Orlando - AWS Lambda
Front End Orlando - AWS LambdaFront End Orlando - AWS Lambda
Front End Orlando - AWS Lambda
 
Elastic Search Meetup Special - Yann Cluchey, Cogenta
Elastic Search Meetup Special - Yann Cluchey, Cogenta Elastic Search Meetup Special - Yann Cluchey, Cogenta
Elastic Search Meetup Special - Yann Cluchey, Cogenta
 
Building services for apps on a shoestring budget
Building services for apps on a shoestring budgetBuilding services for apps on a shoestring budget
Building services for apps on a shoestring budget
 
Introduction to Serverless and Google Cloud Functions
Introduction to Serverless and Google Cloud FunctionsIntroduction to Serverless and Google Cloud Functions
Introduction to Serverless and Google Cloud Functions
 

Similar to MongoDB .local London 2019: New Product Announcements: MongoDB Atlas Autoscaling and MongoDB Atlas Open Service Broker

Addressing Your Backup Needs Using Ops Manager and Atlas
Addressing Your Backup Needs Using Ops Manager and AtlasAddressing Your Backup Needs Using Ops Manager and Atlas
Addressing Your Backup Needs Using Ops Manager and AtlasMongoDB
 
Infrastructure Agnostic Machine Learning Workload Deployment
Infrastructure Agnostic Machine Learning Workload DeploymentInfrastructure Agnostic Machine Learning Workload Deployment
Infrastructure Agnostic Machine Learning Workload DeploymentDatabricks
 
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfSlides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfvitm11
 
AWS Sydney Summit 2013 - Big Data Analytics
AWS Sydney Summit 2013 - Big Data AnalyticsAWS Sydney Summit 2013 - Big Data Analytics
AWS Sydney Summit 2013 - Big Data AnalyticsAmazon Web Services
 
Serverless for High Performance Computing
Serverless for High Performance ComputingServerless for High Performance Computing
Serverless for High Performance ComputingLuciano Mammino
 
ML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning Infrastructure
ML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning InfrastructureML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning Infrastructure
ML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning InfrastructureFei Chen
 
Serverless Architecture GCP In Production
Serverless Architecture GCP In ProductionServerless Architecture GCP In Production
Serverless Architecture GCP In ProductionOliver Fierro
 
MongoDB .local Munich 2019: MongoDB Atlas Auto-Scaling
MongoDB .local Munich 2019: MongoDB Atlas Auto-ScalingMongoDB .local Munich 2019: MongoDB Atlas Auto-Scaling
MongoDB .local Munich 2019: MongoDB Atlas Auto-ScalingMongoDB
 
Solving Your Backup Needs Using Ops Manager, Cloud Manager and Atlas
Solving Your Backup Needs Using Ops Manager, Cloud Manager and AtlasSolving Your Backup Needs Using Ops Manager, Cloud Manager and Atlas
Solving Your Backup Needs Using Ops Manager, Cloud Manager and AtlasMongoDB
 
Edge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEA
Edge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEAEdge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEA
Edge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEAAkamai Technologies
 
Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...
Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...
Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...Continuent
 
BigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLBigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLMárton Kodok
 
Get a clearer picture of potential cloud performance by looking beyond SPECra...
Get a clearer picture of potential cloud performance by looking beyond SPECra...Get a clearer picture of potential cloud performance by looking beyond SPECra...
Get a clearer picture of potential cloud performance by looking beyond SPECra...Principled Technologies
 
Ansible, MongoDB Ops Manager and AWS v1.1
Ansible, MongoDB Ops Manager and AWS v1.1Ansible, MongoDB Ops Manager and AWS v1.1
Ansible, MongoDB Ops Manager and AWS v1.1Michael Lynn
 
Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...
Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...
Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...Daniel Zivkovic
 
Building a Big Data & Analytics Platform using AWS
Building a Big Data & Analytics Platform using AWS Building a Big Data & Analytics Platform using AWS
Building a Big Data & Analytics Platform using AWS Amazon Web Services
 
Introducing MongoDB Atlas
Introducing MongoDB AtlasIntroducing MongoDB Atlas
Introducing MongoDB AtlasMongoDB
 
Is It Fast? : Measuring MongoDB Performance
Is It Fast? : Measuring MongoDB PerformanceIs It Fast? : Measuring MongoDB Performance
Is It Fast? : Measuring MongoDB PerformanceTim Callaghan
 
Adopting Karpenter for Cost and Simplicity at Grafana Labs.pdf
Adopting Karpenter for Cost and Simplicity at Grafana Labs.pdfAdopting Karpenter for Cost and Simplicity at Grafana Labs.pdf
Adopting Karpenter for Cost and Simplicity at Grafana Labs.pdfMichaelOLeary82
 

Similar to MongoDB .local London 2019: New Product Announcements: MongoDB Atlas Autoscaling and MongoDB Atlas Open Service Broker (20)

Addressing Your Backup Needs Using Ops Manager and Atlas
Addressing Your Backup Needs Using Ops Manager and AtlasAddressing Your Backup Needs Using Ops Manager and Atlas
Addressing Your Backup Needs Using Ops Manager and Atlas
 
Infrastructure Agnostic Machine Learning Workload Deployment
Infrastructure Agnostic Machine Learning Workload DeploymentInfrastructure Agnostic Machine Learning Workload Deployment
Infrastructure Agnostic Machine Learning Workload Deployment
 
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfSlides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
 
AWS Sydney Summit 2013 - Big Data Analytics
AWS Sydney Summit 2013 - Big Data AnalyticsAWS Sydney Summit 2013 - Big Data Analytics
AWS Sydney Summit 2013 - Big Data Analytics
 
Serverless for High Performance Computing
Serverless for High Performance ComputingServerless for High Performance Computing
Serverless for High Performance Computing
 
AWS User Group October
AWS User Group OctoberAWS User Group October
AWS User Group October
 
ML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning Infrastructure
ML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning InfrastructureML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning Infrastructure
ML Platform Q1 Meetup: Airbnb's End-to-End Machine Learning Infrastructure
 
Serverless Architecture GCP In Production
Serverless Architecture GCP In ProductionServerless Architecture GCP In Production
Serverless Architecture GCP In Production
 
MongoDB .local Munich 2019: MongoDB Atlas Auto-Scaling
MongoDB .local Munich 2019: MongoDB Atlas Auto-ScalingMongoDB .local Munich 2019: MongoDB Atlas Auto-Scaling
MongoDB .local Munich 2019: MongoDB Atlas Auto-Scaling
 
Solving Your Backup Needs Using Ops Manager, Cloud Manager and Atlas
Solving Your Backup Needs Using Ops Manager, Cloud Manager and AtlasSolving Your Backup Needs Using Ops Manager, Cloud Manager and Atlas
Solving Your Backup Needs Using Ops Manager, Cloud Manager and Atlas
 
Edge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEA
Edge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEAEdge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEA
Edge 2014: Maintaining the Balance: Getting the Most of Your CDN with IKEA
 
Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...
Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...
Marketing Automation at Scale: How Marketo Solved Key Data Management Challen...
 
BigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQLBigQuery ML - Machine learning at scale using SQL
BigQuery ML - Machine learning at scale using SQL
 
Get a clearer picture of potential cloud performance by looking beyond SPECra...
Get a clearer picture of potential cloud performance by looking beyond SPECra...Get a clearer picture of potential cloud performance by looking beyond SPECra...
Get a clearer picture of potential cloud performance by looking beyond SPECra...
 
Ansible, MongoDB Ops Manager and AWS v1.1
Ansible, MongoDB Ops Manager and AWS v1.1Ansible, MongoDB Ops Manager and AWS v1.1
Ansible, MongoDB Ops Manager and AWS v1.1
 
Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...
Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...
Running Business Analytics for a Serverless Insurance Company - Joe Emison & ...
 
Building a Big Data & Analytics Platform using AWS
Building a Big Data & Analytics Platform using AWS Building a Big Data & Analytics Platform using AWS
Building a Big Data & Analytics Platform using AWS
 
Introducing MongoDB Atlas
Introducing MongoDB AtlasIntroducing MongoDB Atlas
Introducing MongoDB Atlas
 
Is It Fast? : Measuring MongoDB Performance
Is It Fast? : Measuring MongoDB PerformanceIs It Fast? : Measuring MongoDB Performance
Is It Fast? : Measuring MongoDB Performance
 
Adopting Karpenter for Cost and Simplicity at Grafana Labs.pdf
Adopting Karpenter for Cost and Simplicity at Grafana Labs.pdfAdopting Karpenter for Cost and Simplicity at Grafana Labs.pdf
Adopting Karpenter for Cost and Simplicity at Grafana Labs.pdf
 

More from Lisa Roth, PMP

MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...
MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...
MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...Lisa Roth, PMP
 
MongoDB .local London 2019: The Human Element in an Automated World: Building...
MongoDB .local London 2019: The Human Element in an Automated World: Building...MongoDB .local London 2019: The Human Element in an Automated World: Building...
MongoDB .local London 2019: The Human Element in an Automated World: Building...Lisa Roth, PMP
 
MongoDB .local London 2019: Diverse Representations in Design
MongoDB .local London 2019: Diverse Representations in DesignMongoDB .local London 2019: Diverse Representations in Design
MongoDB .local London 2019: Diverse Representations in DesignLisa Roth, PMP
 
MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...
MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...
MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...Lisa Roth, PMP
 
MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...
MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...
MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...Lisa Roth, PMP
 
MongoDB .local London 2019: Streaming Data on the Shoulders of Giants
MongoDB .local London 2019: Streaming Data on the Shoulders of GiantsMongoDB .local London 2019: Streaming Data on the Shoulders of Giants
MongoDB .local London 2019: Streaming Data on the Shoulders of GiantsLisa Roth, PMP
 
MongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDB
MongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDBMongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDB
MongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDBLisa Roth, PMP
 
MongoDB .local London 2019: Fast Machine Learning Development with MongoDB
MongoDB .local London 2019: Fast Machine Learning Development with MongoDBMongoDB .local London 2019: Fast Machine Learning Development with MongoDB
MongoDB .local London 2019: Fast Machine Learning Development with MongoDBLisa Roth, PMP
 
MongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDB
MongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDBMongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDB
MongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDBLisa Roth, PMP
 
MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2
MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2
MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2Lisa Roth, PMP
 

More from Lisa Roth, PMP (10)

MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...
MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...
MongoDB .local London 2019: Gaining ML insight on Google Cloud with Google Vi...
 
MongoDB .local London 2019: The Human Element in an Automated World: Building...
MongoDB .local London 2019: The Human Element in an Automated World: Building...MongoDB .local London 2019: The Human Element in an Automated World: Building...
MongoDB .local London 2019: The Human Element in an Automated World: Building...
 
MongoDB .local London 2019: Diverse Representations in Design
MongoDB .local London 2019: Diverse Representations in DesignMongoDB .local London 2019: Diverse Representations in Design
MongoDB .local London 2019: Diverse Representations in Design
 
MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...
MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...
MongoDB .local London 2019: Launch Re-entry! How to Return to the Technical W...
 
MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...
MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...
MongoDB .local London 2019: Using AWS to Transform Customer Data in MongoDB i...
 
MongoDB .local London 2019: Streaming Data on the Shoulders of Giants
MongoDB .local London 2019: Streaming Data on the Shoulders of GiantsMongoDB .local London 2019: Streaming Data on the Shoulders of Giants
MongoDB .local London 2019: Streaming Data on the Shoulders of Giants
 
MongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDB
MongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDBMongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDB
MongoDB .local London 2019: Tips and Tricks++ for Querying and Indexing MongoDB
 
MongoDB .local London 2019: Fast Machine Learning Development with MongoDB
MongoDB .local London 2019: Fast Machine Learning Development with MongoDBMongoDB .local London 2019: Fast Machine Learning Development with MongoDB
MongoDB .local London 2019: Fast Machine Learning Development with MongoDB
 
MongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDB
MongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDBMongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDB
MongoDB .local London 2019: A Complete Methodology to Data Modeling for MongoDB
 
MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2
MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2
MongoDB .local London 2019: Using Client Side Encryption in MongoDB 4.2
 

Recently uploaded

SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsAndrey Dotsenko
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 

Recently uploaded (20)

SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 

MongoDB .local London 2019: New Product Announcements: MongoDB Atlas Autoscaling and MongoDB Atlas Open Service Broker

  • 1. @ #MDBlocal Guillaume Meister Principal Solutions Architect, EMEA gmeister_fr Atlas Autoscaling
  • 2. #MDBLocal GUILLAUME MEISTER Principal Solutions Architect, EMEA based in Paris MongoDB Office
  • 3. #MDBLocal Flexibility - Y Reliability - Y Performance - Y Cost - ?
  • 4. #MDBLocal Managing Capacity is the Key to Cost Optimization Reality Aspirations
  • 5. #MDBLocal Ever played Whack-A-Mole? meet François the Database Administrateur !
  • 6. Introducing Atlas Autoscaling Automatically manage capacity to intelligently balance between performance and cost
  • 7. #MDBLocal How does it work? ComputeStorage Predict future workload patterns Automatically adjusts storage and compute to fit the workload
  • 8. #MDBLocal What do spikes look like ? (Simulated Results)
  • 9. #MDBLocal How does it work? Storage For any given compute, provision the right disk space Automatically increases disk space to keep up with writes Compute Adjusts the CPU and Memory provisioned to keep up with workload If workload increases, scale up to perform If workload decreases, scale down to save
  • 10. #MDBLocal How do we do it? Monitor Performance & Learn ● Actually easier? ● How do we know we are doing well? ● How do we know we are not? ● How can we learn and improve the system Predict Future Workload ● Not easy :) ● Up ○ Too fast wastes $ ○ Too slow degrades performance ● Down ○ Too fast degrades performance ○ Too slow wastes $ Adjust Capacity Safely ● Not easy :) ● Scaling is expensive ● How do we reduce impact to app? feedback
  • 11. #MDBLocal Step 1: Predicting Future Workload using Expert Learning Up Scaling Normalized CPU Util > 75% OR Memory Util > 75% For at-least 1 hour Checked every 5 minutes Down Scaling Normalized CPU Util <50% AND Memory Util <50% For at-least 72 hour Checked every 5 minutes
  • 12. #MDBLocal 2. Perform Scaling Operations User Atlas Metrics Atlas predicts future utilization Executes autoscalin g decisions Check user specified conditions Automated hardware provisionin g Atlas automatically changes cluster’s computation capacity with no downtime Utilization metrics are captured in real time User Alerts to users
  • 13. #MDBLocal Step 3: Monitor Performance & Learn Telemetry tracking how well we are predicting Telemetry tracking how the workload pattern changes Testing new algorithms with historic data to improve performance Ability to tune algorithm per cluster, if needed
  • 16. #MDBLocal When to use autoscaling? If utilization is variable throughout the day or week & you want to save $ If you want to not worry about scaling your cluster as you grow over time If you have very high utilization & you are afraid of oversaturating your cluster But don't forget to use ATLAS Performance Advisor to optimize your queries !
  • 17. #MDBLocal Real life behavior High CPU utilization indicates that the Atlas cluster tier is insufficient to meet the workload requirements After auto-scaling, CPU utilization drops indicating the Atlas cluster is sufficiently sized
  • 18. #MDBLocal Now François can relax ! is luv MongoDB autoscaling !
  • 19. Q&A
  • 20.
  • 21. #MDBlocal Atlas Open Service Broker Deploying managed MongoDB clusters from within Kubernetes LONDON Ben Elgar
  • 22. Who am I? ● Software engineer on Private Cloud Kubernetes team ● MongoDB Enterprise Operator ● Lead development on the Atlas Open Service Broker
  • 23. Why should you listen? ● Manage your MongoDB clusters inside of Kubernetes ● Consistency ● Easily replicable ● No custom scripts
  • 24. What is a service broker? ● An application that implements the Open Service Broker API ● Provision third-party resources from within a platform
  • 25. What is the Atlas service broker? ● Application you run inside of Kubernetes ● Exposes a standard API ● Manage Atlas clusters and users with Kubernetes resources
  • 26. Kubernetes ServiceInstance Resource Service Catalog Atlas Service Broker --- apiVersion: servicecatalog.k8s.io/v1beta1 kind: ServiceInstance metadata: name: atlas-cluster-instance spec: serviceClassExternalName: mongodb-atlas-aws servicePlanExternalName: M10 parameters: cluster: providerSettings: regionName: "EU_CENTRAL_1" Atlas
  • 28. Nota Bene ● Only clusters and users—everything else must be managed in Atlas ● Resources in Kubernetes will not reflect changes made outside
  • 29. Open Source ● Free as in speech and free as in beer ● Apache Licensed https://github.com/mongodb/mongodb-atlas-service-broker
  • 31. #MDBlocal MongoDB Atlas New Features: Open Service Broker Ben Elgar https://www.surveymonkey.com/r/8KSJRK5