Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Keynote: Amadeus Air Availability, Now on Couchbase – Couchbase Connect 2015


Published on

Stephane Roche has been working in the Travel Industry at Amadeus for seven years. In 2013 he introduced NoSQL technologies within the Amadeus Data Store portfolio.

Published in: Technology
  • Be the first to comment

Keynote: Amadeus Air Availability, Now on Couchbase – Couchbase Connect 2015

  1. 1. Amadeus Air Availability 2.5 MOps/s, Now on Couchbase! ©2014AmadeusITGroupSA Stéphane Roche R&D Project Manager NoSQL Technologies Architecture, Quality and Governance Santa Clara, June2015
  2. 2. Page 2 Agenda ©2014AmadeusITGroupSA 1. Amadeus is Not Only about Mozart! 2. Air Shopping platform, low latency stores 3. R-Box, distribution and ultra-high scalability 4. Hotel shopping and booking, ultra-high availability 5. Why Couchbase 4.X is a Must have for us?
  3. 3. Amadeus is Not Only about Mozart! ©2014AmadeusITGroupSA
  4. 4. Amadeus is a technology company dedicated to the global travel industry. We are present in 195 countries with a worldwide team of more than 12,000 people. Our solutions help improve the business performance of travel agencies, corporations, airlines, airports, hotels, railways and more. Page 4 Amadeus in a few words ©2015AmadeusITGroupSA
  6. 6. Page 6 Distribution IT • Data centre • Platforms and applications • Sales & marketing infrastructure • Customers In common Distribution & IT Businesses Two complementary business lines ©2015AmadeusITGroupSA
  7. 7. Page 7 ©2014AmadeusITGroupSA Amadeus, airlines partners 121 airlines contracted for Reservation and Inventory 800 millions passengers boarded each year by 2015(a) +93 airlines (List of airlines shown is a sample and not exhaustive. Passengers generated by airlines that are Altéa customers with Altéa Inventory and/or Departure Control modules implemented or have contracted the migration to any of these two modules. Estimated annual PBs calculated as follows: (i) annual PBs migrated to Altéa by 31 December 2010 plus (ii) annual PBs estimated to be migrated to Altéa by 31 December 2013 based on contracts signed through 31 December 2010; all annual PB volume data based on actual 2010 traffic volumes where migrated before 1 January 2011, remainder estimated using historic traffic volumes and therefore exclude any volume trend assumptions (a) 2015 estimated annual PB calculated by applying the IATA’s regional air traffic growth projections to the latest available annual PB figures to the 121 airlines contracted to Altéa as of 31 December 2012
  8. 8. Page 8 _ Amadeus today3Robust global operations ©2015AmadeusITGroupSA 1.6+ billion data requests processed per day 525+ million travel agency bookings processed in 2014 695+ million Passengers Boarded (PBs) in 2014 95% of the world’s scheduled network airline seats 16 PetaBytes OfStorage 500,000+ database disk IO/second 4,800+ IT Changes per Month
  9. 9. Page 9 Couchbase & Amadeus Q2 2013 Prototyped 2 use cases with Couchbase (air shopping/inventory) Q3 2014 Couchbase went live for Air Shopping 2015 Air Shopping ramp-up Q4 2013 Signed Premium Partnership with Couchbase Q4 2014 Implementing a new use case (hotel shopping & booking) Q4 2015 Couchbase will go live for Air Inventory ©2015AmadeusITGroupSA Q1 2016 Couchbase production readiness for hotel shopping & booking Q2 2016 New use case R-Box) live in production
  10. 10. Air Shopping Platform (Air Availability) High-throughput, low latency, key/value stores 2 ©2014AmadeusITGroupSA
  11. 11. Page 11 ©2014AmadeusITGroupSA The Air Shopping Flow Priced solutions End user Amadeus 1 Travel request 2 Route Explorer 3 Connection Builder 5 Faring 6 1A Agencies Self-serviceCall Centers B2T / Flight selection 4 Flt Validation Availability calculation
  12. 12. Page 12 ©2014AmadeusITGroupSA Legacy Availability Cache Architecture Availability Data Services Miss: read Database Memcached Servers, 12 servers * 1TB Miss: Populate Memcached Availability Services (600 servers) MySQL Farm, 7 * 4 servers Shard 1 Shard 2 Shard 3 Shard 4 Shard 5 Shard 6 Shard 7
  13. 13. Page 13 _Simplifying the architecture to • Remove the complex storage logic implemented in the application layer • Decrease operational costs due to: • Hardware usage optimisation • Day to day effort to operate _Online rebalancing • Extending capacity currently takes careful operations, many days of preparation and many days to warm up the new cache _Cold starts • Memcached (very rare) outages are (very) disruptive ©2014AmadeusITGroupSA Problems we are trying to solve
  14. 14. Page 14 ©2014AmadeusITGroupSA Availability Cache New Architecture Availability Data Services Couchbase Servers, 30 servers * 1TB Availability Services (600 servers)
  15. 15. Page 15 ©2014AmadeusITGroupSA Availability Data Workloads GET 2.6 M/s SET 1 M/s Already ramp-up 50% Already ramp-up 7% Including Major Airlines
  16. 16. Page 16 _Couchbase is fast • Microseconds adds up quickly when exploring thousands of travel solutions • Our cache queries returns in less than 0.5ms _Couchbase is predictably fast • Long tail latencies would kill our application response time • Couchbase leverages our memory capacity _Couchbase online rebalancing works without impacting our query latency ©2014AmadeusITGroupSA Couchbase benefits
  17. 17. Page 17 Asked for it, Got it  _ Ability to read on replica (since 2.1.0) • In failover scenarios, we prefer to be non consistent but still provide an answer _ Multithreaded read/write operations (since 2.1.0 + significant improvements in 3.0.1 ) • Our workload is write intensive • We want to get the most of our Fusion IO PCI-E SSDs _ Rack awareness (since 2.5.0) • Our data center has 6 firecells, we can lose one of them without losing any data _ Incremental Backup and Restore (since 3.0.0) _ XDCR filtering (to be release in 4.0.0) ©2014AmadeusITGroupSA Strong Partnership Build our story together _ Couchbase contributes to our Main Project Kickoff Meetings _ Dedicated Workshop sessions organized _ Set Task force when required _ Involved in our training sessions • R&D • Global Operations
  18. 18. Page 18 ©2014AmadeusITGroupSA _Improvement (compared to 2.5.1) • Automatic, optimized resource utilization _Consequences • Same volume processed with less writing threads • Increase of the write throughput + 30% write throughput - 20% CPU consumption on I/O threads Couchbase 3.0.3 our current choice for Production
  19. 19. R-Box Distribution Ultra-high Scalability 3 ©2014AmadeusITGroupSA
  20. 20. Page 20 R-Box: an extension of the shopping platform Projecting availability calculations in remote data centers Couchbase XDCR is a Must!
  21. 21. Page 21 What’s in the box? 265ced1609a17cf1a5979880a2ad364653895ae8 R-Box Shell Layer Core Layer Data Synchronization Live Data (Flight, Counters, Yields…) Data Flow Log/Stat Flow Polling Flow APP Data Synchronization Caches Data (ABR, RFD, Codeshare) File Distribution (bittorrent) Log & Stat Flow Log Server Administration Tool Admin API (XML) Admin Server Polling Request (XML, EDI) ESB Couchbase NoSQL APP APP APP APP APP Actually, a mini data center Administration and management Storage for live data: Couchbase Storage for static data Middleware components (ESB) Application servers Monitoring and logs
  22. 22. Hotel shopping and booking Ultra-high availability 4 ©2014AmadeusITGroupSA
  23. 23. Page 23 _ Largest hotel group worldwide • A bit more than 4,700 properties • About 680,000 rooms • Occupancy rate: 60-70% _Expected traffic: 80 M bookings/year _Amadeus to provide • Shopping services – 10,000 TPS • Booking _Strict SLAs Intercontinental Hotels Group Signed in March 2014
  24. 24. Page 24 (for mission critical and high-throughput applications) ©2014AmadeusITGroupSA Ultra-high availability _General trend of the market _Our target: _Complex infrastructure • Network, storage, databases, application servers, etc … _Not possible to achieve using conventional database engines 99.999 %99.95 %
  25. 25. Page 25 Cross data center replication, allowing for creative topologies ©2014AmadeusITGroupSA Couchbase XDCR ring topology Primary CB Secondary CB Shopping Shopping Shopping Primary CB Secondary CB Shopping Shopping Shopping Data Centre 1 Data Centre 2
  26. 26. Why Couchbase 4.0 is a Must have for us? 5 ©2014AmadeusITGroupSA
  27. 27. Page 27 _XDCR filtering capability • For R-box _Couchbase Security fits the Security Standards • R-box and IHG projects are no more deployed in our own premises • Must enforce security _N1QL Query Capabilities / Global Secondary Indexes • A requirement of our IHG platform to retrieve Bookings ©2014AmadeusITGroupSA Couchbase 4.0 features already part of our designs
  28. 28. Conclusion 6 ©2014AmadeusITGroupSA
  29. 29. Page 29 Couchbase delivers on what Amadeus values: _Scalability • Horizontal • Vertical _Predictability of raw performance _Operability _Complex distributed topologies (XDCR) ©2014AmadeusITGroupSA Key takeaways
  30. 30. Thank you ©2014AmadeusITGroupSA You can follow us on: AmadeusITGroup