Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value”

•

4 likes•975 views

Data & Analytics

Big Data Journey
A bumpy road
Aymeric Gerardin
©AmadeusITGroupanditsaffiliatesandsubsidiaries

2
©AmadeusITGroupanditsaffiliatesandsubsidiaries
It started
with…

The Big picture
©AmadeusITGroupanditsaffiliatesandsubsidiaries

4
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Why am I here?

5
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Amadeus
Shape the future of travel
595 million
total
bookings
processed
in 2016
1.4 billion
passengers
boarded in
2016
1.3
Petabytes of
Data
produced by
day

6
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Why
Amadeus BI products
_ Booking
_ Search
_ Traffic
_ Schedule
_ Booking
_ Search
_ Productivity
Airlines Insight Agency Insight

7
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Why
Prepare the Future
Customers
Data Swamp

8
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Why
Prepare the future
Customers
Data Lake
Chatbot
AI
Digitalization
IOT
BI
Mobile
Analytics
platform
Open API
Security
Cloud

9
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Timeline?

10
2012
Experimentation
_ Record replay framework
_ Repurposed Hardware
2014 - 2015
Implementation
_ Pilot project
_ Infrastructure
• Hardware
• Network
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Big data Journey Timeline
5 years! Time is flying so fast
2016
Expansion
_ From 1 to 30+ projects
_ From 300TB to 13 PB of data
2017
Optimization
_ Industrialization
_ Governance
_ Object store
_ GPU based HW

Data Lake
©2015AmadeusITGroupSA
©2016AmadeusITGroupSA
Data Archive
BI Platform
The Architecture slide
I think I achieved having all the fancy logos in one slide!
Amadeus
Products &
ext. sources
Bulk
File
Unified
Data
ingestion
Visualization
for users
Analytics platform

12
Dedicated Big data network
300Gb/s of maximal bandwidth
1.
2. Hpe DL380 and Apollo series
28 cores, 512GB RAM, 40-210 TB of
storage by node
3. Future
• Solid state Drive storage (SSD)
• Graphics Processing unit (GPU)
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Infrastructure
Yes, hardware! It is like speaking about cars

13
©AmadeusITGroupanditsaffiliatesandsubsidiaries
How many days to
transfer 600TB from
Nice to Munich?
• Hint : Network: 2Gb/s
(250MB/s)

14
©AmadeusITGroupanditsaffiliatesandsubsidiaries
2 Days!* With the Network it is 27 days minimum

Challenges
©AmadeusITGroupanditsaffiliatesandsubsidiaries

16
©AmadeusITGroupanditsaffiliatesandsubsidiaries
People
Generalists
Mind-set
over
experience
Passionate
with
technologies

17
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Processes
and tools
Regulations!
Proof of
concept
Is your
best friend
Don’t fit a
square peg
in a round
hole

18
©AmadeusITGroupanditsaffiliatesandsubsidiaries
OrganizationalCommunity
Show value!
Even if small
End to end
delivery
(POC)

Added value
©AmadeusITGroupanditsaffiliatesandsubsidiaries

20
TSM/ NAS
decommission
Logging
infrastructure
BI
Travel intelligence
Billing
Security
Security audit
Fraud detection
Operations
Monitoring
Quality KPI
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Added value
In cost, quality or service
Cost efficiency

21
©AmadeusITGroupanditsaffiliatesandsubsidiaries
At cruising
speed with AI
in sight

Thank you!
AmadeusITgroup
amadeus.com
Amadeus.com/blog
©AmadeusITGroupanditsaffiliatesandsubsidiaries
linkedin.com/in/gerardin
Twitter: @aymericgerardin
insideindustry4dot0.com
Aymeric@gerardin.com

23
©AmadeusITGroupanditsaffiliatesandsubsidiaries
Questions?
linkedin.com/in/gerardin
Twitter: @aymericgerardin
insideindustry4dot0.com
Aymeric@gerardin.com

This document discusses opportunities for SugarCRM partners through a partnership with IBM. It describes IBM's analytics offerings including Cognos Insight, Express, and Enterprise products. Palmtree Consulting is presented as an example partner that is both a SugarCRM and IBM Premier Partner. The presentation argues that adding analytics is a valuable way for Sugar partners to enhance their offerings and reach more markets by leveraging IBM's validated analytics solutions and SugarCRM's open platform integration. Use cases and benefits are reviewed for integrating IBM Cognos analytics within the SugarCRM platform.

Innovation in Travel Technology

Sasin SEC

This document discusses Amadeus, a global technology provider for the travel industry. It provides an overview of Amadeus' business operations and performance in 2017, including revenue growth and number of travel agency bookings. It also describes Amadeus' initiatives to drive innovation in travel technology through programs like Amadeus Next that partners with startups, and Amadeus Ventures that invests in early-stage companies. The document aims to promote collaboration and partnerships between Amadeus and other organizations to shape the future of travel through technology.

Bransys Group is an IoT company that provides fleet management solutions and tracking software for roll-off containers and other assets. They offer a solution called EZtoTrack that uses only 3 hardware components - an RFID reader, RFID tags, and GPS devices - to provide real-time tracking and monitoring of roll-off containers and other equipment. The system gives users map views, reports, and a mobile app to easily view detailed information about container locations and customer billing.

MongoDB 3.0 migration - MongoDB Days Munich

Attila Tozser

MongoDB 3.0 introduces a list of unique new features like compression, document level locking, DB side cache management which can help to accelerate your applications in most of the use-cases. Once you decide to go ahead, there is only a very small step to migrate and happily take the benefits. Too good to be true? The session will cover how migration works in theory and in practice, how to make it smooth without downtime and disturbance in the force. We will describe where we have seen the biggest change in the behaviour of the engine, and how the new features worked out for us along with the few caveats we identified so far. The goal of the session is to provide you all the means to plan and execute your MongoDB upgrade.

GES 2019 - Global Launch Lounge - “Collaborations for a Better Future” - PODI...

PODIS Ltd

The Global Entrepreneurship Summit GES 2019 spins off a cooperation agreement between PODIS Ltd, participant of GES 2019, and autoaid GmbH. This cooperation agreement is the foundation for bringing together a patented Automatic Crash Notification SaaS and a Pioneer in cloud based automotive and remote diagnoses. The new solution lands into the aftermarket telematics ecosystem implementing IoT, AI and big data technologies. PODIS patented filter of false alarms in the Autoaid ODBII dongle (http://www.autoaid.de) , together as a cloud based system, will empower B2B clients to: • Become a compliant TPSP in the eCall ecosystem, • Offer UBI (Usage Based Insurance), • Monitor driver's behavior. • Access detailed accident reports, • Gain Big Data analytics and insights from the continuous flow to a data lake, • Perform remote car diagnostics, enabling preventive and predictive maintenance, and • Improve Claim and the repair support providing to the insurer the First Notification of Loss (FNOL).

Industry 4.0 in the cloud - SVC214 - Chicago AWS Summit

Amazon Web Services

The document discusses Industry 4.0 and manufacturing in the cloud. It begins with an overview of manufacturing industry trends and challenges. It then discusses how AWS solutions can help manufacturers address issues like connecting products, leveraging data insights, and global collaboration. The presentation then shifts to discussing Spireon, a customer that provides vehicle tracking and fleet management solutions. It describes how Spireon uses AWS services like IoT, SageMaker, and Lambda to power its solutions and gain insights from sensor data.

INTERFACE by apidays_Building a developer program in a large corporation from...

apidays

Artificial Intelligence On Cruise Ships – The Fascinating Ways Royal Caribbea...

Bernard Marr

Internet of Things e Machine Learning: i principali casi d'uso

Amazon Web Services

In questa sessione, approfondiremo i principali casi d'uso di organizzazioni e aziende che hanno reso l'Internet of Things e il Machine Learning elementi centrali delle proprie attività e processi quotidiani. Vedremo come queste aziende hanno ottenuto un maggior livello di efficienza operativa e produttività, analizzando ciascun caso d'uso in termini di: sfide aziendali, metriche per il successo, ritorno dell'investimento (ROI), risorse e competenze.

The Art of the Business Pivot

Yvonne Gamble

CWIN 17 New-York / Keynote meeting the open innovation imperative

Capgemini

This document discusses how companies can leverage emerging technologies and innovation strategies to gain competitive advantages in today's digital era. It recommends that companies become "software companies" by adopting agile development practices like DevOps and having more flexible IT architectures. It also stresses the importance of "applied innovation" through partnerships in open innovation ecosystems. The document outlines trends in artificial intelligence, cloud computing, and other digital technologies that are disrupting industries and presents two innovation strategies for companies to pursue: becoming a software company and engaging in applied innovation.

CWIN17 Toulouse / How emerging technologies fuel business and disrupt market-...

Capgemini

This document discusses how Capgemini is helping clients adapt to new digital technologies and market demands through two approaches: becoming a software company and applied innovation. It highlights various initiatives Capgemini is taking to foster innovation, such as innovation centers and labs, startup programs, and an innovation newsletter. The document emphasizes that fully leveraging new technologies will define future market leaders.

Final create an app to perform intelligent searched on your data

Anam Mahmood

A standard search for a site can return too many results for someone to want to go through. However, it’s possible to quickly build out a search interface for your IBM Watson Discovery instance using out-of-the-box UI components that query and manipulate the enriched data to return more relevant search results. In this webinar, we will demonstrate how to use individual UI components to visualize insights.

SMAC - Presentation from RetailWeek Technology Summit, Sept 23

AirTight Networks

The document discusses the concept of #SMAC, which stands for social, mobile, analytics, and cloud technologies and how these technologies are transforming businesses. It provides examples of how various retailers have leveraged #SMAC technologies like mobile apps, secure Wi-Fi networks, social media, and cloud-based analytics to improve customer experiences, increase engagement and sales, and reduce IT costs. The document advocates that businesses must adopt #SMAC strategies to remain competitive and highlights how the convergence of these technologies presents opportunities for new business models and customer experiences.

2014 Automotive Trends

IPG Media Lab

2014 IPG Medialab trends and outlook for Automotive

Thorsten Linz

OpsRamp Tech Talk: Getting to a Hybrid IT Strategy with OpsRamp

OpsRamp

Are you prepared for managing the requirements of both on-premises and multi-cloud infrastructure discovery, monitoring and management? Do you have the right strategy for event management and automation in place? What about AIOps? In this session will talk about methods and strategies for maximizing efficiency and service delivery specifically for the challenges of the hybrid, multi-cloud environment. Watch the recording here: https://www.brighttalk.com/webcast/17791/394133 Learn more at https://www.opsramp.com Also, follow us on social media channels to learn about product highlights, news, announcements, events, conferences and more: Twitter - https://www.twitter.com/OpsRamp LinkedIn - https://www.linkedin.com/company/opsramp Facebook - https://www.facebook.com/OpsRampHQ/

SAP Cloud Platform Product Overview L2 deck

SAP Cloud Platform

Multidomain MDM at Amadeus

Orchestra Networks

The document discusses Amadeus' multidomain Master Data Management (MDM) program. It provides an overview of Amadeus' MDM roadmap and architecture, focusing on three key domains: workforce MDM, product MDM, and reference data management. For each domain, it describes the data governance process, key objectives, and approach to improve data quality and standardization across business units. It concludes by emphasizing the importance of executive sponsorship, achieving quick wins, bottom-up initiatives, and managing expectations for successful MDM programs.

Cwin16 - Paris- m rapid

Capgemini

mRapid is Capgemini's metadata-driven framework for ingesting large volumes of data from various sources like databases, files and mainframes into a data lake. It leverages Apache NiFi and in-house accelerators to transform and move data between systems. The solution provides benefits like lower time-to-market, reuse of ingestion processes and compliance with APIs. The document outlines mRapid's architecture and data ingestion workflows, as well as its roadmap including support for additional data formats and integration with authentication tools. Contact information is provided for individuals involved in the solution.

Covid-19 Massive Retrenchment and Unemployment: Individuals Upskilling & Resk...

Anthony Ng

REE LIVE WEBINAR Covid-19 Massive Retrenchment and Unemployment: Individuals Upskilling & Reskilling Training towards IR4.0 Digital Transformation  Join & Find out from Experts Industries Players Opinions by ✅1. YBhg. Dato’ Mohd Sahar Bin Darusman – Chief Employment Insurance Office of PERKESO ✅2. Mr. Ab Rahim Yusoff- Deputy Director General of Malaysia Productivity Corporation (MPC) ✅3. Dato’ Palaniappan Joseph - Chairman of Federation of Malaysian Manufacturers (FMM) TVET & Future Skills Committee ASEAN Future Workforce Council ✅4. Mr. Nizmar Mohd Nazar – Chief Information Officer of Malaysia Automotive Robotics and IOT Institute (MARII) ✅5. Dr. M Shahrul Azmi M Yusoff - Director of SIRIM Berhad (Innovation Centre of Innovation in Smart Manufacturing) Moderated by Anthony Ng, CEO of MIT Academy Sdn Bhd Date: 27 April 2020, Monday Time: 3.00pm to 4.30pm (Malaysian Time GMT+8) Free Registration Link: http://bit.ly/COVID19MIT (FREE Live Admission for Everyone)  Target Audience : Multinational Companies (MNC), Small Medium Enterprises (SME), Government Departments, Engineers & Technicians, Colleges and Universities Lecturers/Post Graduates in Engineering & Technical Fields, Retrenched and Unemployed Individuals. ℹ️ For any enquiry, kindly WhatsApp +60123831864, http://wa.me/60123831864

Data Natives Paris v 10.0 | "Blockchain in Healthcare" - Lea Dias & David An...

Dataconomy Media

Data Natives Frankfurt v 11.0 | "Competitive advantages with knowledge graphs...

Dataconomy Media

The challenges of increasing complexity of organizations, companies and projects are obvious and omnipresent. Everywhere there are connections and dependencies that are often not adequately managed or not considered at all because of a lack of technology or expertise to uncover and leverage the relationships in data and information. In his presentation, Axel Morgner talks about graph technology and knowledge graphs as indispensable building blocks for successful companies.

Similar to Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value”

EZtoTrack - Tracking Rolloffs - Bransys - Larry Colvin

Pandorka Chushkova

EZtoTrack - Tracking Rolloffs - Bransys Group

Pandorka Chushkova

MongoDB 3.0 migration - MongoDB Days Munich

Attila Tozser

GES 2019 - Global Launch Lounge - “Collaborations for a Better Future” - PODI...

PODIS Ltd

Industry 4.0 in the cloud - SVC214 - Chicago AWS Summit

Amazon Web Services

INTERFACE by apidays_Building a developer program in a large corporation from...

apidays

Artificial Intelligence On Cruise Ships – The Fascinating Ways Royal Caribbea...

Bernard Marr

Internet of Things e Machine Learning: i principali casi d'uso

Amazon Web Services

The Art of the Business Pivot

Yvonne Gamble

CWIN 17 New-York / Keynote meeting the open innovation imperative

Capgemini

CWIN17 Toulouse / How emerging technologies fuel business and disrupt market-...

Capgemini

Final create an app to perform intelligent searched on your data

Anam Mahmood

SMAC - Presentation from RetailWeek Technology Summit, Sept 23

AirTight Networks

2014 Automotive Trends

IPG Media Lab

2014 IPG Medialab trends and outlook for Automotive

Thorsten Linz

OpsRamp Tech Talk: Getting to a Hybrid IT Strategy with OpsRamp

OpsRamp

SAP Cloud Platform Product Overview L2 deck

SAP Cloud Platform

Multidomain MDM at Amadeus

Orchestra Networks

Cwin16 - Paris- m rapid

Capgemini

Covid-19 Massive Retrenchment and Unemployment: Individuals Upskilling & Resk...

Anthony Ng

Similar to Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value” (20)

EZtoTrack - Tracking Rolloffs - Bransys - Larry Colvin

EZtoTrack - Tracking Rolloffs - Bransys Group

MongoDB 3.0 migration - MongoDB Days Munich

GES 2019 - Global Launch Lounge - “Collaborations for a Better Future” - PODI...

Industry 4.0 in the cloud - SVC214 - Chicago AWS Summit

INTERFACE by apidays_Building a developer program in a large corporation from...

Artificial Intelligence On Cruise Ships – The Fascinating Ways Royal Caribbea...

Internet of Things e Machine Learning: i principali casi d'uso

The Art of the Business Pivot

CWIN 17 New-York / Keynote meeting the open innovation imperative

CWIN17 Toulouse / How emerging technologies fuel business and disrupt market-...

Final create an app to perform intelligent searched on your data

SMAC - Presentation from RetailWeek Technology Summit, Sept 23

2014 Automotive Trends

2014 IPG Medialab trends and outlook for Automotive

OpsRamp Tech Talk: Getting to a Hybrid IT Strategy with OpsRamp

SAP Cloud Platform Product Overview L2 deck

Multidomain MDM at Amadeus

Cwin16 - Paris- m rapid

Covid-19 Massive Retrenchment and Unemployment: Individuals Upskilling & Resk...

More from Dataconomy Media

Data Natives Paris v 10.0 | "Blockchain in Healthcare" - Lea Dias & David An...

Dataconomy Media

Data Natives Frankfurt v 11.0 | "Competitive advantages with knowledge graphs...

Dataconomy Media

Data Natives Frankfurt v 11.0 | "Can we be responsible for misuse of data & a...

Dataconomy Media

The document discusses emerging technologies and their potential impacts, and questions how individuals and societies can responsibly address issues arising from new technologies. It notes that governments, regulators, and individuals struggle to understand new concepts that spread rapidly. It asks if there are existing systems or forms of cooperation that could help societies address responsibilities related to technologies, but offers no definitive solutions, mainly posing questions.

Data Natives Munich v 12.0 | "How to be more productive with Autonomous Data ...

Dataconomy Media

Data Natives meets DataRobot | "Build and deploy an anti-money laundering mo...

Dataconomy Media

This document contains an agenda and presentation materials for a talk on building and deploying an anti-money laundering (AML) model using DataRobot. The agenda includes introductions to DataRobot and AML, an AML demo, a real AML use case example, and a question and answer section. The presentation materials provide background on DataRobot, including its history and products. It also gives an overview of money laundering and how AML works, both traditionally using rule-based systems and how machine learning can help by reducing false positives and improving efficiency. A case study shows how DataRobot has helped other organizations with AML use cases.

Data Natives Munich v 12.0 | "Political Data Science: A tale of Fake News, So...

Dataconomy Media

Trump, Brexit, Cambridge Analytica... In the last few years, we have had to confront the consequences of the use and misuse of data science algorithms in manipulating public opinion through social media. The use of private data to microtarget individuals is a daily practice (and a trillion-dollar industry), which has serious side-effects when the selling product is your political ideology. How can we cope with this new scenario?

Data Natives Vienna v 7.0 | "Building Kubernetes Operators with KUDO for Dat...

Dataconomy Media

Data Natives Vienna v 7.0 | "The Ingredients of Data Innovation" - Robbert de...

Dataconomy Media

The document discusses data innovation and Men on the Moon's approach. It notes that while there is a large amount of available data worldwide, only a small portion is used to create value. Most data science projects also fail. The document then outlines Men on the Moon's "Data Thinking" approach, which combines design thinking and data science. Their approach involves defining a data vision, identifying use cases, prototyping solutions, and enabling employees. The goal is to leverage data to create valuable solutions for people through data innovation.

Data Natives Cologne v 4.0 | "The Data Lorax: Planting the Seeds of Fairness...

Dataconomy Media

What does it take to build a good data product or service? Data practitioners always think about the technology, user experience and commercial viability. But rarely do they think about the implications of the systems they build. This talk will shed light on the impact of AI systems and the unintended consequences of the use of data in different products. It will also discuss our role, as data practitioners, in planting the seeds of fairness in the systems we build.

Data Natives Cologne v 4.0 | "How People Analytics Can Reveal the Hidden Aspe...

Dataconomy Media

People analytics uses data science techniques like machine learning and pattern recognition on employee data to generate insights and reports that can help businesses make smarter talent and operational decisions. These decisions can improve workforce effectiveness, engagement, recruitment, retention and performance while also increasing sales and reducing fraud and accidents. People analytics technologies include surveys, correlation analysis, machine learning and AI which can help companies improve their culture, develop employee skills and boost growth when the results are properly implemented.

Data Natives Amsterdam v 9.0 | "Ten Little Servers: A Story of no Downtime" -...

Dataconomy Media

Cloud Infrastructure is a hostile environment: a power supply failure or a network outage leads to downtime and big losses. There is nothing we can trust: a single server, a server rack, even a whole datacenter can fail, and if an application is fragile by design, disruption is inevitable. We must distribute our application and diversify cloud data strategy to survive disturbances of any scale. Apache Cassandra is a cloud-native platform-agnostic database that stores data with a distributed redundancy so it easily survives any issue. What to know how Apple and Netflix handle petabytes of data, keeping it highly available? Join us and listen to a story of 10 little servers and no downtime!

Data Natives Amsterdam v 9.0 | "Point in Time Labeling at Scale" - Timothy Th...

Dataconomy Media

Data Natives Hamburg v 6.0 | "Interpersonal behavior: observing Alex to under...

Dataconomy Media

This document discusses using machine learning to analyze individual and interpersonal behavior for clinical diagnosis and screening. It focuses on analyzing non-verbal behaviors like interpersonal synchronization that have been shown to be impaired in conditions like autism spectrum disorder. The document proposes that machine learning could provide an objective, automated tool for diagnosing conditions more quickly by analyzing video recordings of social interactions. This may help address bottlenecks in healthcare systems and allow earlier access to treatment.

Data Natives Hamburg v 6.0 | "About Surfing, Failing & Scaling" - Florian Sch...

Dataconomy Media

Data NativesBerlin v 20.0 | "Serving A/B experimentation platform end-to-end"...

Dataconomy Media

This document discusses the end-to-end experimentation platform at GetYourGuide for A/B testing. It outlines the challenges of running experiments such as imbalanced assignments, suspicious metric changes, and non-converging results. It also describes the tools used for planning experiments, monitoring assignments, performing daily checks, and analyzing results. The goal is to validate UX changes, estimate effects on customers, and make more objective decisions through A/B testing while addressing issues that could impact experiment quality.

Data Natives Berlin v 20.0 | "Ten Little Servers: A Story of no Downtime" - A...

Dataconomy Media

Big Data Frankfurt meets Thinkport | "The Cloud as a Driver of Innovation" - ...

Dataconomy Media

Creativity is the mental ability to create new ideas and designs. Innovation, on the other hand, Means developing useful solutions from new ideas. Creativity can be goal-oriented, Whereas innovation is always goal-oriented. This bedeutet, dass innovation aims to achieve defined goals. The use of cloud services and technologies promises enterprise users many benefits in terms of more flexible use of IT resources and faster access to innovative solutions. That’s why we want to examine the question in this talk, of what role cloud computing plays for innovation in companies.

Thinkport meets Frankfurt | "Financial Time Series Analysis using Wavelets" -...

Dataconomy Media

Big Data Helsinki v 3 | "Distributed Machine and Deep Learning at Scale with ...

Dataconomy Media

"With most machine learning (ML) and deep learning (DL) frameworks, it can take hours to move data for ETL, and hours to train models. It's also hard to scale, with data sets increasingly being larger than the capacity of any single server. The amount of the data also makes it hard to incrementally test and retrain models in near real-time. Learn how Apache Ignite and GridGain help to address limitations like ETL costs, scaling issues and Time-To-Market for the new models and help achieve near-real-time, continuous learning. Yuriy Babak, the head of ML/DL framework development at GridGain and Apache Ignite committer, will explain how ML/DL work with Apache Ignite, and how to get started. Topics include: — Overview of distributed ML/DL including architecture, implementation, usage patterns, pros and cons — Overview of Apache Ignite ML/DL, including built-in ML/DL algorithms, and how to implement your own — Model inference with Apache Ignite, including how to train models with other libraries, like Apache Spark, and deploy them in Ignite — How Apache Ignite and TensorFlow can be used together to build distributed DL model training and inference"

Big Data Helsinki v 3 | "Federated Learning and Privacy-preserving AI" - Oguz...

Dataconomy Media

"Machine learning algorithms require significant amounts of training data which has been centralized on one machine or in a datacenter so far. For numerous applications, such need of collecting data can be extremely privacy-invasive. Recent advancements in AI research approach this issue by a new paradigm of training AI models, i.e., Federated Learning. In federated learning, edge devices (phones, computers, cars etc.) collaboratively learn a shared AI model while keeping all the training data on device, decoupling the ability to do machine learning from the need to store the data in the cloud. From personal data perspective, this paradigm enables a way of training a model on the device without directly inspecting users’ data on a server. This talk will pinpoint several examples of AI applications benefiting from federated learning and the likely future of privacy-aware systems."

More from Dataconomy Media (20)