SlideShare a Scribd company logo
1 of 40
Download to read offline
Better, Faster, Stronger!
Migration to 3.0
©2015AmadeusITGroupSA
Upgrade MongoDB in the
enterprise environment
Attila Tozser, Amadeus Data
Processing GmbH, MongoDB Days
Germany, 20/10/2015
Amadeus IT Group
1
©2015AmadeusITGroupSA
Amadeus is a technology company dedicated to the
global travel industry.
We are present in 195 countries
with a worldwide team of more than 13,200 people.
Our solutions help improve the
business performance
of travel agencies, corporations, airlines,
airports, hotels, railways and more.
_ Introduction1Amadeus in a few words
©2015AmadeusITGroupSA
Our solutions facilitate journeys and enrich the travel
experience for hundreds of millions of people every year.
to shape the
future of travel
_ Introduction1
We are working together with
our customers and partners
We have a clear purpose
©2015AmadeusITGroupSA
Page 5
A history of shaping the future of travel _ Amadeus history2
1987
Amadeus
is founded
1995
World leader
in number of
travel agency
locations
1998
1 MILLION
bookings made on
a single day for
the first time
2010
Amadeus diversifies
into IT for hotel, rail
and airport
1992
First booking
made through
Amadeus
1996
e-Commerce
division launched
2000
Partnership with
BA and Qantas to
launch Amadeus
Altéa – our core
Airline IT offering
2014
Contracts with Ryanair
and Southwest Airlines
and a strategic
technology
relationship with IHG
©2015AmadeusITGroupSA
Page 6
_ Amadeus today3Robust global operations
©2015AmadeusITGroupSA
1.6+
billion
data requests
processed per day
526
million
travel agency
bookings
processed in 2014
695
million
Passengers
Boarded (PBs)
in 2014
95%
of the world’s
scheduled
network airline
seats
Page 7
Close to our customers
©2015AmadeusITGroupSA
Page 8
A global team of 13,200+ professionals
_ 118 nationalities
_ Cultural diversity
_ Clear focus on recruiting
and developing talent
_ Values based culture
MongoDB at Amadeus
2
©2015AmadeusITGroupSA
Page 10
Business needs
Gathered from customers
user-friendly way to query any data
in our main operational databases
_ Unpredictable ad-hoc search
_ Many advanced reporting requirements
A way to store orders of magnitude more different data
from various sources, but still maintain low latency
Sustain Organic growth of data and throughput (time-to-time
2X or more a year) without degradation
Page 11
Runs on standard x86 architecture
C++, Python & Java drivers
Enterprise-grade security
_ SSL encryption
_ Kerberos authentication
_ Data-at-rest encryption
MongoDB is perfect match to
our needs
Integration
In the Amadeus standards
New features in MongoDB 3.0
2
©2015AmadeusITGroupSA
©2015AmadeusITGroupSA
©2015AmadeusITGroupSA
WiredTiger our observations
• Compression ratio 3x-10x
• IO characteristic tunable
• Better latency
• Enhanced security
©2015AmadeusITGroupSA
In-memory our observations
• On OOM instant crash
• Sustained 150K/4KB IOPS
On a single box
• 1-6ms latency
Upgrade MongoDB in the enterprise
environment
2
©2015AmadeusITGroupSA
©2015AmadeusITGroupSA
AmadeusClients
©2015AmadeusITGroupSA
S
S
S
S
S
S
Application servers MongoDB
©2015AmadeusITGroupSA
S
S
S
S
S
S
Database sever:
Operating System
MongoDB binaries
Misc. processes:
Ops manager agents
Monitoring code
Automation code
©2015AmadeusITGroupSA
S
S
S
S
S
S
This appserver consist of
• Operating System
• Application code
• MongoDB driver
• Mongos binary
©2015AmadeusITGroupSA
MongoDB
Cluster
MMS/Ops
Manager
©2015AmadeusITGroupSA
MongoDB
Cluster
MMS/Ops
Manager
_Always Sharded and
replicated
_Over 10 test levels
_Monitoring
_Backup
_(automation)
Mongodb 3.0 needs Ops Manager > 1.6.0
Upgrading MMS3
©2015AmadeusITGroupSA
MMS
application
database
Backup
Database
Backup
Database
Backup
Database
MMS App Server MMS App Server MMS App Server
Backup Daemon
Backup Daemon
Backup Daemon
Backup
agents
Monitoring
agents
Automation
agents
Upgrading MMS3
©2015AmadeusITGroupSA
MMS
application
database
Backup
Database
Backup
Database
Backup
Database
MMS App Server MMS App Server MMS App Server
Backup Daemon
Backup Daemon
Backup Daemon
Backup
agents
Monitoring
agents
Automation
agents
Upgrade separately as any
other MongoDB cluster
3.0 only from MMS 1.6
The MMS server process contains the new versions
Should be on the same version: Upgrade together
Upgrading MMS3
©2015AmadeusITGroupSA
MMS App Server
REST API
Corporate Monitoring
API calls
Metrics
Corporate Automation
API calls
Config options
Upgrading MMS3
©2015AmadeusITGroupSA
MMS App Server
REST API
Corporate Monitoring
API calls
Metrics
Corporate Automation
API calls
Config options
Test the changes of the API to avoid
bad surprises
©2015AmadeusITGroupSA
S
S
S
S
S
S
http://docs.mongodb.org/manual/release-notes/3.0-upgrade/
_Upgrade MongoDB
_Be prepared for fallback funnies
_Backup, MONGODB-CR auth
_Lucky case: Give a try to Ops Manager
automation
_Less lucky case: Do it by hand
_Start from a 2.6 installation
Upgrading MMS3
©2015AmadeusITGroupSA
S
Upgrade the Mongos processes
Config 1 Config 2 Config 3
S, 3.xUpgrade cluster metadata
Upgrading MMS3
©2015AmadeusITGroupSA
S
Upgrade the Mongos processes
Config 1 Config 2 Config 3
S, 3.x
Upgrade all the mongos processes
Upgrading MMS3
©2015AmadeusITGroupSA
S
Upgrade the Mongos processes
Config 1 Config 2 Config 3
S, 3.x
Upgrade config
3
©2015AmadeusITGroupSA
Primary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Install
binaries
Install
binaries
Install
binaries
Secondary
MMAPv1
2.6
3
©2015AmadeusITGroupSA
Primary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Secondary
WT 3.0
3
©2015AmadeusITGroupSA
Primary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Secondary
WT 3.0
Secondary
MMAP v1
2.6
3
©2015AmadeusITGroupSA
Primary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Secondary
WT 3.0
Primary
WT 3.0
Secondary
WT 3.0
Secondary
WT 3.0
3
©2015AmadeusITGroupSA
Primary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Secondary
WT 3.0
Secondary
MMAPv1
2.6
Primary
WT 3.0
3
©2015AmadeusITGroupSA
Primary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Secondary
WT 3.0
Primary
WT 3.0
Secondary
WT 3.0
Secondary
MMAPv1
2.6
Secondary
WT 3.0
3
©2015AmadeusITGroupSA
Secondary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Secondary
WT 3.0
Primary
WT 3.0
Secondary
WT 3.0
Look into the future
3
©2015AmadeusITGroupSA
3
©2015AmadeusITGroupSA
MY MongoDB wishlist
_ Cross cluster replication
_ Filtered / delayed / batched
_ Multimaster (AP operation)
_ Multithreaded queries
_ Transactions
_ On multi update
Divider title here
1
©2015AmadeusITGroupSA
Thank you!
Questions?

More Related Content

What's hot

What's hot (15)

Best practices for queue processing in serverless applications - MAD313 - Chi...
Best practices for queue processing in serverless applications - MAD313 - Chi...Best practices for queue processing in serverless applications - MAD313 - Chi...
Best practices for queue processing in serverless applications - MAD313 - Chi...
 
Planning advanced AWS networking architectures - SVC304 - Chicago AWS Summit
Planning advanced AWS networking architectures - SVC304 - Chicago AWS SummitPlanning advanced AWS networking architectures - SVC304 - Chicago AWS Summit
Planning advanced AWS networking architectures - SVC304 - Chicago AWS Summit
 
Architecting SAP on Amazon Web Services - SVC216 - Chicago AWS Summit
Architecting SAP on Amazon Web Services - SVC216 - Chicago AWS SummitArchitecting SAP on Amazon Web Services - SVC216 - Chicago AWS Summit
Architecting SAP on Amazon Web Services - SVC216 - Chicago AWS Summit
 
Deploy and manage Kubernetes on AWS from your on-premises environment - DEM04...
Deploy and manage Kubernetes on AWS from your on-premises environment - DEM04...Deploy and manage Kubernetes on AWS from your on-premises environment - DEM04...
Deploy and manage Kubernetes on AWS from your on-premises environment - DEM04...
 
Safeguarding the integrity of your code for fast, secure deployments - SVC301...
Safeguarding the integrity of your code for fast, secure deployments - SVC301...Safeguarding the integrity of your code for fast, secure deployments - SVC301...
Safeguarding the integrity of your code for fast, secure deployments - SVC301...
 
Unified monitoring of the container environment, containers, and applications...
Unified monitoring of the container environment, containers, and applications...Unified monitoring of the container environment, containers, and applications...
Unified monitoring of the container environment, containers, and applications...
 
The evolution of continuous cloud security and compliance - DEM05-S - New Yor...
The evolution of continuous cloud security and compliance - DEM05-S - New Yor...The evolution of continuous cloud security and compliance - DEM05-S - New Yor...
The evolution of continuous cloud security and compliance - DEM05-S - New Yor...
 
Developing Intelligent Robots with AWS RoboMaker - SVC205 - Anaheim AWS Summit
Developing Intelligent Robots with AWS RoboMaker - SVC205 - Anaheim AWS SummitDeveloping Intelligent Robots with AWS RoboMaker - SVC205 - Anaheim AWS Summit
Developing Intelligent Robots with AWS RoboMaker - SVC205 - Anaheim AWS Summit
 
Self-service remediation, managing configuration drift, & automation - SVC311...
Self-service remediation, managing configuration drift, & automation - SVC311...Self-service remediation, managing configuration drift, & automation - SVC311...
Self-service remediation, managing configuration drift, & automation - SVC311...
 
Safeguard the Integrity of Your Code for Fast and Secure Deployments - SVC206...
Safeguard the Integrity of Your Code for Fast and Secure Deployments - SVC206...Safeguard the Integrity of Your Code for Fast and Secure Deployments - SVC206...
Safeguard the Integrity of Your Code for Fast and Secure Deployments - SVC206...
 
Connecting low-power devices to the cloud with Amazon FreeRTOS BLE - SVC206 -...
Connecting low-power devices to the cloud with Amazon FreeRTOS BLE - SVC206 -...Connecting low-power devices to the cloud with Amazon FreeRTOS BLE - SVC206 -...
Connecting low-power devices to the cloud with Amazon FreeRTOS BLE - SVC206 -...
 
Mythical Mysfits: Monolith to microservices using Docker and Fargate - MAD309...
Mythical Mysfits: Monolith to microservices using Docker and Fargate - MAD309...Mythical Mysfits: Monolith to microservices using Docker and Fargate - MAD309...
Mythical Mysfits: Monolith to microservices using Docker and Fargate - MAD309...
 
Securely deliver applications with AWS - SVC305 - Atlanta AWS Summit
Securely deliver applications with AWS - SVC305 - Atlanta AWS SummitSecurely deliver applications with AWS - SVC305 - Atlanta AWS Summit
Securely deliver applications with AWS - SVC305 - Atlanta AWS Summit
 
Breaking down monoliths - DEM04 - Santa Clara AWS Summit.pdf
Breaking down monoliths - DEM04 - Santa Clara AWS Summit.pdfBreaking down monoliths - DEM04 - Santa Clara AWS Summit.pdf
Breaking down monoliths - DEM04 - Santa Clara AWS Summit.pdf
 
Finding all the threats: AWS threat detection and remediation - SEC303 - Chic...
Finding all the threats: AWS threat detection and remediation - SEC303 - Chic...Finding all the threats: AWS threat detection and remediation - SEC303 - Chic...
Finding all the threats: AWS threat detection and remediation - SEC303 - Chic...
 

Similar to MongoDB 3.0 migration - MongoDB Days Munich

Applying MBSE to the Industrial IoT: Using SysML with Connext DDS and Simulink
Applying MBSE to the Industrial IoT: Using SysML with Connext DDS and SimulinkApplying MBSE to the Industrial IoT: Using SysML with Connext DDS and Simulink
Applying MBSE to the Industrial IoT: Using SysML with Connext DDS and Simulink
Gerardo Pardo-Castellote
 
2015 cloud trend and cloud DR
2015 cloud trend and cloud DR2015 cloud trend and cloud DR
2015 cloud trend and cloud DR
bizmerce
 
Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013
Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013
Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013
IBM Switzerland
 

Similar to MongoDB 3.0 migration - MongoDB Days Munich (20)

Better, Faster, Stronger! Migration to 3.0
Better, Faster, Stronger! Migration to 3.0Better, Faster, Stronger! Migration to 3.0
Better, Faster, Stronger! Migration to 3.0
 
Best Practices for Managing MongoDB with Ops Manager
Best Practices for Managing MongoDB with Ops ManagerBest Practices for Managing MongoDB with Ops Manager
Best Practices for Managing MongoDB with Ops Manager
 
Amadeus CI/CD
Amadeus CI/CDAmadeus CI/CD
Amadeus CI/CD
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
 
agados app engine platform Intro
agados app engine platform Introagados app engine platform Intro
agados app engine platform Intro
 
Containers for Startups
Containers for StartupsContainers for Startups
Containers for Startups
 
Strategy and Directions for the IBM® Mainframe
Strategy and Directions for the IBM® MainframeStrategy and Directions for the IBM® Mainframe
Strategy and Directions for the IBM® Mainframe
 
Applying MBSE to the Industrial IoT: Using SysML with Connext DDS and Simulink
Applying MBSE to the Industrial IoT: Using SysML with Connext DDS and SimulinkApplying MBSE to the Industrial IoT: Using SysML with Connext DDS and Simulink
Applying MBSE to the Industrial IoT: Using SysML with Connext DDS and Simulink
 
Power apps - Cloud business applications platform
Power apps - Cloud business applications platformPower apps - Cloud business applications platform
Power apps - Cloud business applications platform
 
2015 cloud trend and cloud DR
2015 cloud trend and cloud DR2015 cloud trend and cloud DR
2015 cloud trend and cloud DR
 
EUT303_Modernizing the Energy and Utilities Industry with IoT Moving SCADA to...
EUT303_Modernizing the Energy and Utilities Industry with IoT Moving SCADA to...EUT303_Modernizing the Energy and Utilities Industry with IoT Moving SCADA to...
EUT303_Modernizing the Energy and Utilities Industry with IoT Moving SCADA to...
 
Security as an Accelerator for Cloud Adoption
Security as an Accelerator for Cloud AdoptionSecurity as an Accelerator for Cloud Adoption
Security as an Accelerator for Cloud Adoption
 
Google Cloud Lightning Talk
Google Cloud Lightning TalkGoogle Cloud Lightning Talk
Google Cloud Lightning Talk
 
QCards: NAV2016 in the Cloud
QCards: NAV2016 in the CloudQCards: NAV2016 in the Cloud
QCards: NAV2016 in the Cloud
 
TENDENCIAS DE SEGURIDAD PARA AMBIENTES EN LA NUBE
TENDENCIAS DE SEGURIDAD PARA AMBIENTES EN LA NUBETENDENCIAS DE SEGURIDAD PARA AMBIENTES EN LA NUBE
TENDENCIAS DE SEGURIDAD PARA AMBIENTES EN LA NUBE
 
Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013
Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013
Integrierte Experten Systeme_Erik-Werner Radtke_IBM Symposium 2013
 
MongoDB World 2018: Supercharge Your MongoDB Deployment with Ops Manager Auto...
MongoDB World 2018: Supercharge Your MongoDB Deployment with Ops Manager Auto...MongoDB World 2018: Supercharge Your MongoDB Deployment with Ops Manager Auto...
MongoDB World 2018: Supercharge Your MongoDB Deployment with Ops Manager Auto...
 
Design - Start Your API Journey Today
Design - Start Your API Journey TodayDesign - Start Your API Journey Today
Design - Start Your API Journey Today
 
Tech Talk: Five Simple Steps to a More Powerful Database Experience
Tech Talk: Five Simple Steps to a More Powerful Database ExperienceTech Talk: Five Simple Steps to a More Powerful Database Experience
Tech Talk: Five Simple Steps to a More Powerful Database Experience
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 

MongoDB 3.0 migration - MongoDB Days Munich