Better, Faster, Stronger!
Migration to 3.0
©2015AmadeusITGroupSA
Upgrade MongoDB in the
enterprise environment
Attila Tozser, Amadeus Data
Processing GmbH, MongoDB Days
Germany, 20/10/2015
Amadeus IT Group
1
©2015AmadeusITGroupSA
Amadeus is a technology company dedicated to the
global travel industry.
We are present in 195 countries
with a worldwide team of more than 13,200 people.
Our solutions help improve the
business performance
of travel agencies, corporations, airlines,
airports, hotels, railways and more.
_ Introduction1Amadeus in a few words
©2015AmadeusITGroupSA
Our solutions facilitate journeys and enrich the travel
experience for hundreds of millions of people every year.
to shape the
future of travel
_ Introduction1
We are working together with
our customers and partners
We have a clear purpose
©2015AmadeusITGroupSA
Page 6
A history of shaping the future of travel _ Amadeus history2
1987
Amadeus
is founded
1995
World leader
in number of
travel agency
locations
1998
1 MILLION
bookings made on
a single day for
the first time
2010
Amadeus diversifies
into IT for hotel, rail
and airport
1992
First booking
made through
Amadeus
1996
e-Commerce
division launched
2000
Partnership with
BA and Qantas to
launch Amadeus
Altéa – our core
Airline IT offering
2014
Contracts with Ryanair
and Southwest Airlines
and a strategic
technology
relationship with IHG
©2015AmadeusITGroupSA
Page 7
_ Amadeus today3Robust global operations
©2015AmadeusITGroupSA
1.6+
billion
data requests
processed per day
526
million
travel agency
bookings
processed in 2014
695
million
Passengers
Boarded (PBs)
in 2014
95%
of the world’s
scheduled
network airline
seats
Page 8
Close to our customers
©2015AmadeusITGroupSA
Page 9
A global team of 13,200+ professionals
_ 118 nationalities
_ Cultural diversity
_ Clear focus on recruiting
and developing talent
_ Values based culture
MongoDB at Amadeus
2
©2015AmadeusITGroupSA
Page 11
Business needs
Gathered from customers
user-friendly way to query any data
in our main operational databases
_ Unpredictable ad-hoc search
_ Many advanced reporting requirements
A way to store orders of magnitude more different data
from various sources, but still maintain low latency
Sustain Organic growth of data and throughput (time-to-time
2X or more a year) without degradation
Page 12
Runs on standard x86 architecture
C++, Python & Java drivers
Enterprise-grade security
_ SSL encryption
_ Kerberos authentication
_ Data-at-rest encryption
MongoDB is perfect match to
our needs
Integration
In the Amadeus standards
New features in MongoDB 3.0
2
©2015AmadeusITGroupSA
©2015AmadeusITGroupSA
©2015AmadeusITGroupSA
WiredTiger our observations
• Compression ratio 3x-10x
• IO characteristic tunable
• Better latency
• Enhanced security
In-memory our observations
• On OOM instant crash
• Sustained 150K/4KB IOPS
On a single box
• 1-6ms latency
Upgrade MongoDB in the enterprise
environment
2
©2015AmadeusITGroupSA
AmadeusClients
©2015AmadeusITGroupSA
AmadeusClients
©2015AmadeusITGroupSA
S
S
S
S
S
S
Application servers MongoDB
©2015AmadeusITGroupSA
S
S
S
S
S
S
This appserver consist of
• Operating System
• Application code
• MongoDB driver
• Mongos binary
Database sever:
Operating System
MongoDB binaries
Misc. processes:
Ops manager agents
Monitoring code
Automation code
©2015AmadeusITGroupSA
MongoDB
Cluster
MMS/Ops
Manager
_Always Sharded and
replicated
_Over 10 test levels
_Monitoring
_Backup
_(automation)
Mongodb 3.0 needs Ops Manager > 1.6.0
Upgrading MMS3
©2015AmadeusITGroupSA
MMS
application
database
Backup
Database
Backup
Database
Backup
Database
MMS App Server MMS App Server MMS App Server
Backup Daemon
Backup Daemon
Backup Daemon
Backup
agents
Monitoring
agents
Automation
agents
Upgrade separately as any
other MongoDB cluster
3.0 only from MMS 1.6
The server processes contain the new versions
Should be on the same version: Upgrade together
Upgrading MMS3
©2015AmadeusITGroupSA
MMS App Server
REST API
Corporate Monitoring
API calls
Metrics
Corporate Automation
API calls
Config options
©2015AmadeusITGroupSA
S
S
S
S
S
S
http://docs.mongodb.org/manual/release-notes/3.0-upgrade/
_Upgrade MongoDB
_Be prepared for fallback funnies
_Backup, MONGODB-CR auth
_Lucky case: Give a try to Ops Manager
automation
_Less lucky case: Do it by hand
_Start from a 2.6 installation
Upgrading MMS3
©2015AmadeusITGroupSA
S
Upgrade the Mongos processes
Config 1 Config 2 Config 3
S, 3.xUpgrade cluster metadata
Upgrade all the mongos processes
Upgrade config
3
©2015AmadeusITGroupSA
Primary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Secondary
MMAP v1
2.6
Upgrade the Shards
Secondary
WT 3.0
Install
binaries
Install
binaries
Install
binaries
Primary
WT 3.0
Secondary
WT 3.0
Secondary
MMAPv1
2.6
Secondary
WT 3.0
Primary
WT 3.0
Secondary
WT 3.0
Look into the future
3
©2015AmadeusITGroupSA
MY MongoDB wishlist
_ Cross cluster replication
_ Filtered / delayed / batched
_ Multimaster (AP operation)
_ Multithreaded queries
_ Transactions
_ On multi update
Divider title here
1
©2015AmadeusITGroupSA
Thank you!
Questions?

Better, Faster, Stronger! Migration to 3.0

Editor's Notes

  • #4 For co-branding in dividers, insert the other company’s logo in the same size as the Amadeus logo, with no background and in reverse colour when using dark backgrounds
  • #5 Amadeus is a technology company dedicated to the world’s travel industry. A big part of our success is explained by our local presence in 195 countries. Put simply, we offer cutting-edge technology solutions that help key players in the travel industry succeed in their business. Our customers include travel agencies, that’s both offline and online, airlines, airports, corporations, hotels, railway companies, ferry and cruise lines, car rental companies, ground handlers & insurance companies.
  • #6 Our solutions facilitate journeys and enrich the travel experience for hundreds of millions of people every year. Think for a moment of a world on the move and of the technology that is behind it: travel searching and booking, pricing, ticketing, managing reservations, departure control systems, IT.  It demands free flowing data and information. The dots have to be connected and that’s what Amadeus does.  We have a clear purpose as a company. We are focused on the future and on playing a leading role in driving the industry forward. Our ambition is to facilitate the entire travel journey from door-to-door
  • #7 Over the years Amadeus has continued to grow and we have seen many changes. We have expanded our business to 195 markets. There has been an exponential increase in the number of travel players working with Amadeus and we have seen the birth and growth of online travel. In 1996 we launched our e-Commerce division, and we have become the second largest e-Commerce player in the world behind Amazon. In 2000 we expanded our business into complementary areas such as Airline IT. There are currently more than 200 airlines globally using Amadeus IT products and services. And leveraging our expertise in this area have we been able to diversify into IT solutions for hotel, rail and airports. And last year we announced a major distribution contract with Ryanair, a landmark contract with Southwest Airlines as their new reservation system for domestic service and a breakthrough strategic technology relationship with InterContinental Hotels to build a community model for the hotel industry – a replica of the highly successful Amadeus Altéa community model for airlines. (COMMENT MILESTONES ON THE SLIDE AS APPROPRIATE TO AUDIENCE)
  • #8 In addition to innovation, another key to our success has been our robust global operations. We designed and own our Data Processing Centre and here you get a sense of the scale and type of operations that we handle through the centre. It’s also worth mentioning our data recovery centre which is on standby in the case of natural disasters. Reliability is absolutely vital to our customers. (MENTION SPECIFIC DATA FROM SLIDE AS APPROPRIATE TO AUDIENCE).
  • #9 Geographically, Amadeus is also a truly global company. Here you can see where we have our main sites and principal Research & Development and Regional centres. Amadeus is present in all the countries in blue! That’s close to 200 countries serviced by more than 71 Amadeus Commercial Offices – that’s even more than the UN who’s global footprint covers 193 countries!
  • #10 We are also a truly global team, with a workforce made up of 118 nationalities. Diversity for us is key. We have a culture and defined values that have been agreed by all employees and a very clear focus on recruiting and developing talent. It’s the talent and hard work of our people that has enabled our success so far and what will define it in the future.
  • #11 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #14 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #15 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #16 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #17 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #18 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #19 For co-branding in dividers, insert the other company’s logo in the same size as the Amadeus logo, with no background and in reverse colour when using dark backgrounds
  • #20 For co-branding in dividers, insert the other company’s logo in the same size as the Amadeus logo, with no background and in reverse colour when using dark backgrounds
  • #21 For co-branding in dividers, insert the other company’s logo in the same size as the Amadeus logo, with no background and in reverse colour when using dark backgrounds
  • #22 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #23 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #24 For co-branding in dividers, insert the other company’s logo in the same size as the Amadeus logo, with no background and in reverse colour when using dark backgrounds
  • #25 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #26 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #27 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.
  • #28 The divider slides can be in blue, light blue, cherry and gray. All colours are available in this template.