SlideShare a Scribd company logo
Copyright Valiton GmbH 1
Moving from AWS to
Atlas
Our Motivation and Journey from
Self-Hosted to Managed MongoDB
26th
June 2019
Copyright Valiton GmbH 2
Personal Background
2011
2009
Web Developer at food IT Consulting
2013
Co-Founder of allergenis UG
2016
now
Freelancer
Software-Engineer at Valiton GmbH
Christoph Caprano
Christoph.Caprano@valiton.com
Copyright Valiton GmbH 3
Valiton as a Subsidiary of Hubert Burda Media
Copyright Valiton GmbH 4
Project Background
...
Decreasing
Ad Revenue
New Markets
New
Business Models
Newsletter E-CommerceTracking
Copyright Valiton GmbH 5
New Business Models
Newsletter
Web-Tracking
User-Properties
E-Commerce
Audience Groups
Exclusive Shooting Workshop
…
Exclusive wine offers
Copyright Valiton GmbH 6
System Overview
Privacy Agreement, Contact Agreement and Deletion Process
userdata
LeadGen
raffle participations
Copyright Valiton GmbH 7
AWS MongoDB Architecture (1)
read write
Cluster B
Secondary Secondary
Amazon EC2 Amazon EC2
Amazon EC2
read write
Cluster A
Secondary Secondary
Amazon EC2 Amazon EC2
Amazon EC2
Replica-Set Replica-Set
PrimaryPrimary
Copyright Valiton GmbH 8
AWS MongoDB Architecture (2)
Elastic Load
Balancer
Cluster
Secondary Secondary
Amazon EC2 Amazon EC2
Amazon EC2
EBS-Volume
EBS-VolumeEBS-Volume
Primary
Copyright Valiton GmbH 9
Challenges with Self-Hosted Architecture
Security Monitoring Maintenance
Copyright Valiton GmbH 10
Challenges with Self-Hosted Architecture
Security Monitoring Maintenance
Copyright Valiton GmbH 11
Security – Authentication
Elastic Load
Balancer
Cluster
Secondary Secondary
Amazon EC2 Amazon EC2
Amazon EC2
EBS-Volume
EBS-VolumeEBS-Volume
Primary
Copyright Valiton GmbH 12
Security – Jump Host
EBS-Volume
EBS-Volume
Elastic Load
Balancer
Cluster
Secondary Secondary
Amazon EC2 Amazon EC2
Amazon EC2
EBS-Volume
Jump Host
VPN
Amazon EC2
Primary
Copyright Valiton GmbH 13
Challenges with Self-Hosted Architecture
Security Monitoring Maintenance
Copyright Valiton GmbH 14
Monitoring CPUonly Memory Disk
no Process Database
Copyright Valiton GmbH 15
Challenges with Self-Hosted Architecture
Security Monitoring Maintenance
Copyright Valiton GmbH 16
Maintenance – Mongo Upgrade
UPGRADE
High Effort
3.0
Copyright Valiton GmbH 17
Maintenance - Scaling
Seasonal traffic
Overprovisioning
Copyright Valiton GmbH 18
Maintenance – Agile Development
DevOps
Scrum-Master
Developers
Fix MongoDB
Problem
Try to fulfil
sprint goal
Copyright Valiton GmbH 19
Solution: Moving to MongoDB Atlas
Contracts
Migration Preparation
Migration
Advantages:
• Focus on Software Development
• Possibility of Cloud-Agnostic
Required Steps:
Copyright Valiton GmbH 20
Migration Preparation – MongoDB Upgrade
3.0
3.2
UPGRADE
UPGRADE
3.2
UPGRADE
3.4
3.6
Followed MongoDB
Migration Guide
Copyright Valiton GmbH 21
Migration Preparation – Add Authentication
Elastic Load
Balancer
Primary
Cluster
Secondary Secondary
Amazon EC2 Amazon EC2
Amazon EC2
EBS-Volume
EBS-VolumeEBS-Volume
Copyright Valiton GmbH 22
Migration – MongoDB Atlas Live Migration
Elastic Load
Balancer
Cluster
Secondary Secondary
Amazon EC2 Amazon EC2
Amazon EC2
EBS-Volume
EBS-VolumeEBS-Volume
x
Live
Migration
Atlas
Cluster
Primary
Copyright Valiton GmbH 23
Performance Boost via Performance Advisor
The number of database objects
requested for a query has been
drastically reduced.
This has caused the API to respond
twice as fast on average (~15 ms instead
of ~30 ms).
This reduces the average query
execution time from up to 7 ms to
significantly less than 1 ms.
Query Targeting Query Executor AVG API Response Time
Copyright Valiton GmbH 24
Look back: Challenges with Self-Hosted Architecture
Security Monitoring Maintenance
Authentication
IP Whitelisting
In parallel AWS and Atlas Version Upgrade: SaaS
Scaling: SaaS
Copyright Valiton GmbH 25
How to merge AWS and Atlas logs?
Problem: No Grafana integration yet available
Copyright Valiton GmbH 26
Solution: Develop and Open-Source Atlas Grafana
Plugin
Get the plugin:
https://github.com/valiton/grafana-mongodb-atlas-datasource
Copyright Valiton GmbH 27
Copyright Valiton GmbH 28
Copyright Valiton GmbH 29
What‘s next?
● Participation at MongoDB University
● Use Functions added in MongoDB > 3.0
● Data and Service Redesign
https://www.mongodb.com/blog/post/building-with-patterns-a-summary
● Implementation of Aggregation Pipelines
Copyright Valiton GmbH 30
Q & A
Security Monitoring Maintenance
Authentication
IP Whitelisting
In parallel AWS and Atlas Version Upgrade: SaaS
Scaling: SaaS

More Related Content

What's hot

5 Business Reasons Why Every CIO Should Consider Kubernetes
5 Business Reasons Why Every CIO Should Consider Kubernetes5 Business Reasons Why Every CIO Should Consider Kubernetes
5 Business Reasons Why Every CIO Should Consider Kubernetes
Tyrone Systems
 
Hybrid backup on Cloud classmethod canada
Hybrid backup on Cloud classmethod canada Hybrid backup on Cloud classmethod canada
Hybrid backup on Cloud classmethod canada
Simona Lam
 
IBM Bluemix Introdution for Hackathons
IBM Bluemix Introdution for HackathonsIBM Bluemix Introdution for Hackathons
IBM Bluemix Introdution for Hackathons
gjuljo
 
Hybrid connectivity options with the microsoft cloud
Hybrid connectivity options with the microsoft cloudHybrid connectivity options with the microsoft cloud
Hybrid connectivity options with the microsoft cloud
BizTalk360
 
Serverless integrations using Azure Logic Apps (intro)
Serverless integrations using Azure Logic Apps (intro)Serverless integrations using Azure Logic Apps (intro)
Serverless integrations using Azure Logic Apps (intro)
Callon Campbell
 
Google Cloud Platform Updates
Google Cloud Platform UpdatesGoogle Cloud Platform Updates
Google Cloud Platform Updates
Romin Irani
 
Cloud platform comparison
Cloud platform comparison Cloud platform comparison
Cloud platform comparison
Amit Ghosh
 
Azure Spring Cloud
Azure Spring CloudAzure Spring Cloud
Azure Spring Cloud
VMware Tanzu
 
Design - Integration Scenarios for Hybrid Cloud
Design - Integration Scenarios for Hybrid CloudDesign - Integration Scenarios for Hybrid Cloud
Design - Integration Scenarios for Hybrid Cloud
LaurenWendler
 
How IBM is helping developers win the race to innovate with next-gen cloud se...
How IBM is helping developers win the race to innovate with next-gen cloud se...How IBM is helping developers win the race to innovate with next-gen cloud se...
How IBM is helping developers win the race to innovate with next-gen cloud se...
Michael Elder
 
Building serverless integration solutions with Microsoft Azure
Building serverless integration solutions with Microsoft AzureBuilding serverless integration solutions with Microsoft Azure
Building serverless integration solutions with Microsoft Azure
BizTalk360
 
Unified Cloud Storage Api
Unified Cloud Storage ApiUnified Cloud Storage Api
Unified Cloud Storage Api
Dave Nielsen
 
Platform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) OverviewPlatform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) Overview
Richard Seroter
 
IBM Bluemix Talk at University College Cork (UCC)
IBM Bluemix Talk at University College Cork (UCC)IBM Bluemix Talk at University College Cork (UCC)
IBM Bluemix Talk at University College Cork (UCC)
Sanjay Nayak
 
From Monolith to Serverless
From Monolith to ServerlessFrom Monolith to Serverless
From Monolith to Serverless
Amazon Web Services
 
20150902 v mworld2015-recap
20150902 v mworld2015-recap20150902 v mworld2015-recap
20150902 v mworld2015-recap
Kevin Groat
 
Corent Slides For Impact
Corent Slides For ImpactCorent Slides For Impact
Corent Slides For Impact
thinkbeforetalking
 
An Integration Platform to Support Vision 2025
An Integration Platform to Support Vision 2025An Integration Platform to Support Vision 2025
An Integration Platform to Support Vision 2025
BizTalk360
 
Intro to Cloud Computing and Amazon web services(AWS)
Intro to Cloud Computing and Amazon web services(AWS)Intro to Cloud Computing and Amazon web services(AWS)
Intro to Cloud Computing and Amazon web services(AWS)
Suraj Kumar
 
Google Firebase Presentation
Google Firebase PresentationGoogle Firebase Presentation
Google Firebase Presentation
Aeni Patel
 

What's hot (20)

5 Business Reasons Why Every CIO Should Consider Kubernetes
5 Business Reasons Why Every CIO Should Consider Kubernetes5 Business Reasons Why Every CIO Should Consider Kubernetes
5 Business Reasons Why Every CIO Should Consider Kubernetes
 
Hybrid backup on Cloud classmethod canada
Hybrid backup on Cloud classmethod canada Hybrid backup on Cloud classmethod canada
Hybrid backup on Cloud classmethod canada
 
IBM Bluemix Introdution for Hackathons
IBM Bluemix Introdution for HackathonsIBM Bluemix Introdution for Hackathons
IBM Bluemix Introdution for Hackathons
 
Hybrid connectivity options with the microsoft cloud
Hybrid connectivity options with the microsoft cloudHybrid connectivity options with the microsoft cloud
Hybrid connectivity options with the microsoft cloud
 
Serverless integrations using Azure Logic Apps (intro)
Serverless integrations using Azure Logic Apps (intro)Serverless integrations using Azure Logic Apps (intro)
Serverless integrations using Azure Logic Apps (intro)
 
Google Cloud Platform Updates
Google Cloud Platform UpdatesGoogle Cloud Platform Updates
Google Cloud Platform Updates
 
Cloud platform comparison
Cloud platform comparison Cloud platform comparison
Cloud platform comparison
 
Azure Spring Cloud
Azure Spring CloudAzure Spring Cloud
Azure Spring Cloud
 
Design - Integration Scenarios for Hybrid Cloud
Design - Integration Scenarios for Hybrid CloudDesign - Integration Scenarios for Hybrid Cloud
Design - Integration Scenarios for Hybrid Cloud
 
How IBM is helping developers win the race to innovate with next-gen cloud se...
How IBM is helping developers win the race to innovate with next-gen cloud se...How IBM is helping developers win the race to innovate with next-gen cloud se...
How IBM is helping developers win the race to innovate with next-gen cloud se...
 
Building serverless integration solutions with Microsoft Azure
Building serverless integration solutions with Microsoft AzureBuilding serverless integration solutions with Microsoft Azure
Building serverless integration solutions with Microsoft Azure
 
Unified Cloud Storage Api
Unified Cloud Storage ApiUnified Cloud Storage Api
Unified Cloud Storage Api
 
Platform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) OverviewPlatform-as-a-Service (PaaS) Overview
Platform-as-a-Service (PaaS) Overview
 
IBM Bluemix Talk at University College Cork (UCC)
IBM Bluemix Talk at University College Cork (UCC)IBM Bluemix Talk at University College Cork (UCC)
IBM Bluemix Talk at University College Cork (UCC)
 
From Monolith to Serverless
From Monolith to ServerlessFrom Monolith to Serverless
From Monolith to Serverless
 
20150902 v mworld2015-recap
20150902 v mworld2015-recap20150902 v mworld2015-recap
20150902 v mworld2015-recap
 
Corent Slides For Impact
Corent Slides For ImpactCorent Slides For Impact
Corent Slides For Impact
 
An Integration Platform to Support Vision 2025
An Integration Platform to Support Vision 2025An Integration Platform to Support Vision 2025
An Integration Platform to Support Vision 2025
 
Intro to Cloud Computing and Amazon web services(AWS)
Intro to Cloud Computing and Amazon web services(AWS)Intro to Cloud Computing and Amazon web services(AWS)
Intro to Cloud Computing and Amazon web services(AWS)
 
Google Firebase Presentation
Google Firebase PresentationGoogle Firebase Presentation
Google Firebase Presentation
 

Similar to Moving from AWS to Atlas - Our Motivation and Journey from Self-Hosted to Managed MongoDB

Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...
Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...
Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...
Amazon Web Services
 
The Scout24 Data Platform (A Technical Deep Dive)
The Scout24 Data Platform (A Technical Deep Dive)The Scout24 Data Platform (A Technical Deep Dive)
The Scout24 Data Platform (A Technical Deep Dive)
RaffaelDzikowski
 
Breaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdfBreaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdf
Amazon Web Services
 
Breaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdfBreaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdf
Amazon Web Services
 
IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote
IBM
 
Breaking the Monolith using AWS Container Services
Breaking the Monolith using AWS Container ServicesBreaking the Monolith using AWS Container Services
Breaking the Monolith using AWS Container Services
Amazon Web Services
 
[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석
[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석
[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석
Amazon Web Services Korea
 
Integration (Application?) Modernization with IBM Garage
Integration (Application?) Modernization with IBM GarageIntegration (Application?) Modernization with IBM Garage
Integration (Application?) Modernization with IBM Garage
Andrew Ferrier
 
devworkshop-10_28_1015-amazon-conference-presentation
devworkshop-10_28_1015-amazon-conference-presentationdevworkshop-10_28_1015-amazon-conference-presentation
devworkshop-10_28_1015-amazon-conference-presentation
Alex Wu
 
Lessons learned while going serverless in production
Lessons learned while going serverless in productionLessons learned while going serverless in production
Lessons learned while going serverless in production
Mohamed Labouardy
 
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &MLAWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
Amazon Web Services
 
Lessons learned while going serverless in production
Lessons learned while going serverless in productionLessons learned while going serverless in production
Lessons learned while going serverless in production
Mohamed Labouardy
 
IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...
IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...
IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...
Michael O'Sullivan
 
IBM Bluemix Dedicated – GitHub Enterprise
IBM Bluemix Dedicated – GitHub EnterpriseIBM Bluemix Dedicated – GitHub Enterprise
IBM Bluemix Dedicated – GitHub Enterprise
IBM DevOps
 
Modernizing_your_Enterprise_Applications
Modernizing_your_Enterprise_ApplicationsModernizing_your_Enterprise_Applications
Modernizing_your_Enterprise_Applications
Amazon Web Services
 
Modern Applications Development on AWS
Modern Applications Development on AWSModern Applications Development on AWS
Modern Applications Development on AWS
Boaz Ziniman
 
Announcing Lambda @ the Edge - December 2016 Monthly Webinar Series
Announcing Lambda @ the Edge - December 2016 Monthly Webinar SeriesAnnouncing Lambda @ the Edge - December 2016 Monthly Webinar Series
Announcing Lambda @ the Edge - December 2016 Monthly Webinar Series
Amazon Web Services
 
5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS
Christian Beedgen
 
AWSome Day Seoul 2013 - Opening Keynote
AWSome Day Seoul 2013 - Opening KeynoteAWSome Day Seoul 2013 - Opening Keynote
AWSome Day Seoul 2013 - Opening Keynote
Amazon Web Services
 
[AWSome Day] Opening Keynote
[AWSome Day] Opening Keynote[AWSome Day] Opening Keynote
[AWSome Day] Opening Keynote
Amazon Web Services Korea
 

Similar to Moving from AWS to Atlas - Our Motivation and Journey from Self-Hosted to Managed MongoDB (20)

Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...
Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...
Building BMW Group's Customer Engagement Platform on AWS (AMT305) - AWS re:In...
 
The Scout24 Data Platform (A Technical Deep Dive)
The Scout24 Data Platform (A Technical Deep Dive)The Scout24 Data Platform (A Technical Deep Dive)
The Scout24 Data Platform (A Technical Deep Dive)
 
Breaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdfBreaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdf
 
Breaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdfBreaking the Monolith road to containers.pdf
Breaking the Monolith road to containers.pdf
 
IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote IBM Relay 2015: Opening Keynote
IBM Relay 2015: Opening Keynote
 
Breaking the Monolith using AWS Container Services
Breaking the Monolith using AWS Container ServicesBreaking the Monolith using AWS Container Services
Breaking the Monolith using AWS Container Services
 
[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석
[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석
[AWS Dev Day] 기조연설 – Olivier Klein AWS 신기술 부문 책임자, 정성권 삼성전자 수석
 
Integration (Application?) Modernization with IBM Garage
Integration (Application?) Modernization with IBM GarageIntegration (Application?) Modernization with IBM Garage
Integration (Application?) Modernization with IBM Garage
 
devworkshop-10_28_1015-amazon-conference-presentation
devworkshop-10_28_1015-amazon-conference-presentationdevworkshop-10_28_1015-amazon-conference-presentation
devworkshop-10_28_1015-amazon-conference-presentation
 
Lessons learned while going serverless in production
Lessons learned while going serverless in productionLessons learned while going serverless in production
Lessons learned while going serverless in production
 
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &MLAWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
 
Lessons learned while going serverless in production
Lessons learned while going serverless in productionLessons learned while going serverless in production
Lessons learned while going serverless in production
 
IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...
IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...
IBM Hybrid Cloud Integration UCC Talk, 23rd November 2021 - Cloud Application...
 
IBM Bluemix Dedicated – GitHub Enterprise
IBM Bluemix Dedicated – GitHub EnterpriseIBM Bluemix Dedicated – GitHub Enterprise
IBM Bluemix Dedicated – GitHub Enterprise
 
Modernizing_your_Enterprise_Applications
Modernizing_your_Enterprise_ApplicationsModernizing_your_Enterprise_Applications
Modernizing_your_Enterprise_Applications
 
Modern Applications Development on AWS
Modern Applications Development on AWSModern Applications Development on AWS
Modern Applications Development on AWS
 
Announcing Lambda @ the Edge - December 2016 Monthly Webinar Series
Announcing Lambda @ the Edge - December 2016 Monthly Webinar SeriesAnnouncing Lambda @ the Edge - December 2016 Monthly Webinar Series
Announcing Lambda @ the Edge - December 2016 Monthly Webinar Series
 
5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS5 Years Of Building SaaS On AWS
5 Years Of Building SaaS On AWS
 
AWSome Day Seoul 2013 - Opening Keynote
AWSome Day Seoul 2013 - Opening KeynoteAWSome Day Seoul 2013 - Opening Keynote
AWSome Day Seoul 2013 - Opening Keynote
 
[AWSome Day] Opening Keynote
[AWSome Day] Opening Keynote[AWSome Day] Opening Keynote
[AWSome Day] Opening Keynote
 

Recently uploaded

Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate
 
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we workMicroservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
Sven Peters
 
Using Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional SafetyUsing Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional Safety
Ayan Halder
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Łukasz Chruściel
 
Why Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise Edition
Why Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise EditionWhy Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise Edition
Why Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise Edition
Envertis Software Solutions
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
Boni García
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
GraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph TechnologyGraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph Technology
Neo4j
 
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language ProcessorsFundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
Rakesh Kumar R
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
kalichargn70th171
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
Deuglo Infosystem Pvt Ltd
 
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissancesAtelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Neo4j
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Adele Miller
 
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CDKuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
rodomar2
 
Webinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for EmbeddedWebinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for Embedded
ICS
 
Oracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptxOracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptx
Remote DBA Services
 
What is Augmented Reality Image Tracking
What is Augmented Reality Image TrackingWhat is Augmented Reality Image Tracking
What is Augmented Reality Image Tracking
pavan998932
 

Recently uploaded (20)

Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
 
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we workMicroservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
 
Using Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional SafetyUsing Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional Safety
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
 
Why Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise Edition
Why Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise EditionWhy Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise Edition
Why Choose Odoo 17 Community & How it differs from Odoo 17 Enterprise Edition
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
GraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph TechnologyGraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph Technology
 
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language ProcessorsFundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
 
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissancesAtelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
 
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CDKuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
 
Webinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for EmbeddedWebinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for Embedded
 
Oracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptxOracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptx
 
What is Augmented Reality Image Tracking
What is Augmented Reality Image TrackingWhat is Augmented Reality Image Tracking
What is Augmented Reality Image Tracking
 

Moving from AWS to Atlas - Our Motivation and Journey from Self-Hosted to Managed MongoDB

  • 1. Copyright Valiton GmbH 1 Moving from AWS to Atlas Our Motivation and Journey from Self-Hosted to Managed MongoDB 26th June 2019
  • 2. Copyright Valiton GmbH 2 Personal Background 2011 2009 Web Developer at food IT Consulting 2013 Co-Founder of allergenis UG 2016 now Freelancer Software-Engineer at Valiton GmbH Christoph Caprano Christoph.Caprano@valiton.com
  • 3. Copyright Valiton GmbH 3 Valiton as a Subsidiary of Hubert Burda Media
  • 4. Copyright Valiton GmbH 4 Project Background ... Decreasing Ad Revenue New Markets New Business Models Newsletter E-CommerceTracking
  • 5. Copyright Valiton GmbH 5 New Business Models Newsletter Web-Tracking User-Properties E-Commerce Audience Groups Exclusive Shooting Workshop … Exclusive wine offers
  • 6. Copyright Valiton GmbH 6 System Overview Privacy Agreement, Contact Agreement and Deletion Process userdata LeadGen raffle participations
  • 7. Copyright Valiton GmbH 7 AWS MongoDB Architecture (1) read write Cluster B Secondary Secondary Amazon EC2 Amazon EC2 Amazon EC2 read write Cluster A Secondary Secondary Amazon EC2 Amazon EC2 Amazon EC2 Replica-Set Replica-Set PrimaryPrimary
  • 8. Copyright Valiton GmbH 8 AWS MongoDB Architecture (2) Elastic Load Balancer Cluster Secondary Secondary Amazon EC2 Amazon EC2 Amazon EC2 EBS-Volume EBS-VolumeEBS-Volume Primary
  • 9. Copyright Valiton GmbH 9 Challenges with Self-Hosted Architecture Security Monitoring Maintenance
  • 10. Copyright Valiton GmbH 10 Challenges with Self-Hosted Architecture Security Monitoring Maintenance
  • 11. Copyright Valiton GmbH 11 Security – Authentication Elastic Load Balancer Cluster Secondary Secondary Amazon EC2 Amazon EC2 Amazon EC2 EBS-Volume EBS-VolumeEBS-Volume Primary
  • 12. Copyright Valiton GmbH 12 Security – Jump Host EBS-Volume EBS-Volume Elastic Load Balancer Cluster Secondary Secondary Amazon EC2 Amazon EC2 Amazon EC2 EBS-Volume Jump Host VPN Amazon EC2 Primary
  • 13. Copyright Valiton GmbH 13 Challenges with Self-Hosted Architecture Security Monitoring Maintenance
  • 14. Copyright Valiton GmbH 14 Monitoring CPUonly Memory Disk no Process Database
  • 15. Copyright Valiton GmbH 15 Challenges with Self-Hosted Architecture Security Monitoring Maintenance
  • 16. Copyright Valiton GmbH 16 Maintenance – Mongo Upgrade UPGRADE High Effort 3.0
  • 17. Copyright Valiton GmbH 17 Maintenance - Scaling Seasonal traffic Overprovisioning
  • 18. Copyright Valiton GmbH 18 Maintenance – Agile Development DevOps Scrum-Master Developers Fix MongoDB Problem Try to fulfil sprint goal
  • 19. Copyright Valiton GmbH 19 Solution: Moving to MongoDB Atlas Contracts Migration Preparation Migration Advantages: • Focus on Software Development • Possibility of Cloud-Agnostic Required Steps:
  • 20. Copyright Valiton GmbH 20 Migration Preparation – MongoDB Upgrade 3.0 3.2 UPGRADE UPGRADE 3.2 UPGRADE 3.4 3.6 Followed MongoDB Migration Guide
  • 21. Copyright Valiton GmbH 21 Migration Preparation – Add Authentication Elastic Load Balancer Primary Cluster Secondary Secondary Amazon EC2 Amazon EC2 Amazon EC2 EBS-Volume EBS-VolumeEBS-Volume
  • 22. Copyright Valiton GmbH 22 Migration – MongoDB Atlas Live Migration Elastic Load Balancer Cluster Secondary Secondary Amazon EC2 Amazon EC2 Amazon EC2 EBS-Volume EBS-VolumeEBS-Volume x Live Migration Atlas Cluster Primary
  • 23. Copyright Valiton GmbH 23 Performance Boost via Performance Advisor The number of database objects requested for a query has been drastically reduced. This has caused the API to respond twice as fast on average (~15 ms instead of ~30 ms). This reduces the average query execution time from up to 7 ms to significantly less than 1 ms. Query Targeting Query Executor AVG API Response Time
  • 24. Copyright Valiton GmbH 24 Look back: Challenges with Self-Hosted Architecture Security Monitoring Maintenance Authentication IP Whitelisting In parallel AWS and Atlas Version Upgrade: SaaS Scaling: SaaS
  • 25. Copyright Valiton GmbH 25 How to merge AWS and Atlas logs? Problem: No Grafana integration yet available
  • 26. Copyright Valiton GmbH 26 Solution: Develop and Open-Source Atlas Grafana Plugin Get the plugin: https://github.com/valiton/grafana-mongodb-atlas-datasource
  • 29. Copyright Valiton GmbH 29 What‘s next? ● Participation at MongoDB University ● Use Functions added in MongoDB > 3.0 ● Data and Service Redesign https://www.mongodb.com/blog/post/building-with-patterns-a-summary ● Implementation of Aggregation Pipelines
  • 30. Copyright Valiton GmbH 30 Q & A Security Monitoring Maintenance Authentication IP Whitelisting In parallel AWS and Atlas Version Upgrade: SaaS Scaling: SaaS