Bringing ML To Production, What Is Missing? AMLD 2020

Mikio L. Braun
Mikio L. BraunEngineering Lead and Data Scientist at Zalando
Bringing ML to Production,
what is missing?
Mikio Braun, Staff Data Scientist
Applied ML Days, Lausanne 2020
With thousands of incredible experiences around the world, GetYourGuide is at the
heart of travel
Applied ML Days, Lausanne 2020
We’ve built one of the world’s biggest marketplace 

for travel activities…
Millions of travelers use 

GetYourGuide every year
We facilitate the transaction We offer more than 40,000 

activities worldwide
Connecting 

customers...
...to suppliers 

around the world
Applied ML Days, Lausanne 2020
Hop-on hop-off Attractions Outdoor activities
TransfersAmusement parksCooking classesWalking tours
Applied ML Days, Lausanne 2020
So How Do You “Do AI?”
https://hackernoon.com/the-ai-hierarchy-of-needs-18f111fcc007
What is there beyond algorithms and tools?
● Figuring out where to apply ML
● Architecting ML applications
● Teams & Organizations
Business Problems to ML Problems
Applied ML Days, Lausanne 2020
GetYourGuide Overview
Applied ML Days, Lausanne 2020
GetYourGuide Overview
Applied ML Days, Lausanne 2020
From Business Problems To Machine Learning Problems
• Customer has a Job to be
done.
• Business has to give a
Solution that adds value.
• Solution consists of Activities,
and some of that activities
might be solved with ML.
• ML: solve a task by learning
from examples.
Applied ML Days, Lausanne 2020
Machine Learning: Learn From Examples
Applied ML Days, Lausanne 2020
Example: Recommendations
Applied ML Days, Lausanne 2020
Typical problem for machine learning:
• Hard to specify what exactly
means “similar.”
• A lot of example data is
available.
• Recommendations have to
change based on new articles
frequently.
Example: Recommendations
Applied ML Days, Lausanne 2020
• Business/customer view and
machine learning view often
have different metrics.
• Machine learning does not
know about the business
view.
• Figuring out the right
relationship is not easy.
• Also depends on the
available data.
Example: Recommendation
Applied ML Days, Lausanne 2020
Architectures for AI Systems
Applied ML Days, Lausanne 2020
Machine Learning Systems
Applied ML Days, Lausanne 2020
Design Patterns for AI Architectures
Core Machine Learning

—how to train, evaluate, etc.
Serving

—access predictions in real-time
Data Preprocessing and Features

—how to deal with preprocessing
Automation & Monitoring

—making it more production
ready
Machine Learning Integration

—how to fit it into a larger picture
Applied ML Days, Lausanne 2020
Machine Learning Integration Patterns
• Depending on how ML
is used, there are
different integration
patterns.
• Keep in mind that the
ML problem and the
application problem
are different and have
different metrics.
• Beware of interacting
ML models if the overall
training data is used.
Applied ML Days, Lausanne 2020
Serving Patterns
•How to provide the predictions of the machine learning model to the application.
•If the domain is small, precomputing predictions might be the easiest way to serve.
Applied ML Days, Lausanne 2020
Preprocessing Patterns
• If predictions are
precomputed, no
special treatment of
feature computation
is necessary.
• If it is served online,
you can either
precompute features
in a Feature Store. But
you don’t have
updates for new data.
• Or you can use the
Feature Store and
update features
online as well.
Applied ML Days, Lausanne 2020
Teams and Organization
How Data Scientists Work
Applied ML Days, Lausanne 2020
Data Scientists And Developers
Applied ML Days, Lausanne 2020
Data Scientists and Developers Collaboration
• What is the most
productive way?
• Ideally, interface on
code, not just
documentation
• Production logs often
become data analysis
input!
Applied ML Days, Lausanne 2020
Organizing Data Science
Applied ML Days, Lausanne 2020
Data Platforms
https://hackernoon.com/the-ai-hierarchy-of-needs-18f111fcc007
Applied ML Days, Lausanne 2020
Machine Learning: The High Interest Credit Card of Technical
Debt
Summary
● Not just about methods and tools.
● How to identify where to use ML?
● Building AI/ML systems.
● How to set up teams and
organizations for ML.
Questions?
mikio.braun@getyourguide.com
Twitter @mikiobraun
1 of 28

Recommended

Using MLOps to Bring ML to Production/The Promise of MLOps by
Using MLOps to Bring ML to Production/The Promise of MLOpsUsing MLOps to Bring ML to Production/The Promise of MLOps
Using MLOps to Bring ML to Production/The Promise of MLOpsWeaveworks
5.4K views89 slides
MLOps - The Assembly Line of ML by
MLOps - The Assembly Line of MLMLOps - The Assembly Line of ML
MLOps - The Assembly Line of MLJordan Birdsell
1.7K views19 slides
Robust MLOps with Open-Source: ModelDB, Docker, Jenkins, and Prometheus by
Robust MLOps with Open-Source: ModelDB, Docker, Jenkins, and PrometheusRobust MLOps with Open-Source: ModelDB, Docker, Jenkins, and Prometheus
Robust MLOps with Open-Source: ModelDB, Docker, Jenkins, and PrometheusManasi Vartak
604 views43 slides
MLOps with Azure DevOps by
MLOps with Azure DevOpsMLOps with Azure DevOps
MLOps with Azure DevOpsMarco Parenzan
389 views35 slides
MLOps for production-level machine learning by
MLOps for production-level machine learningMLOps for production-level machine learning
MLOps for production-level machine learningcnvrg.io AI OS - Hands-on ML Workshops
473 views12 slides
From Data Science to MLOps by
From Data Science to MLOpsFrom Data Science to MLOps
From Data Science to MLOpsCarl W. Handlin
452 views29 slides

More Related Content

What's hot

MLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle by
MLOps Virtual Event | Building Machine Learning Platforms for the Full LifecycleMLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
MLOps Virtual Event | Building Machine Learning Platforms for the Full LifecycleDatabricks
2.4K views41 slides
MLOps in action by
MLOps in actionMLOps in action
MLOps in actionPieter de Bruin
1.6K views23 slides
Seamless MLOps with Seldon and MLflow by
Seamless MLOps with Seldon and MLflowSeamless MLOps with Seldon and MLflow
Seamless MLOps with Seldon and MLflowDatabricks
1K views45 slides
Ml ops intro session by
Ml ops   intro sessionMl ops   intro session
Ml ops intro sessionAvinash Patil
361 views18 slides
MLOps with Kubeflow by
MLOps with Kubeflow MLOps with Kubeflow
MLOps with Kubeflow Saurabh Kaushik
874 views33 slides

What's hot(20)

MLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle by Databricks
MLOps Virtual Event | Building Machine Learning Platforms for the Full LifecycleMLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
MLOps Virtual Event | Building Machine Learning Platforms for the Full Lifecycle
Databricks2.4K views
Seamless MLOps with Seldon and MLflow by Databricks
Seamless MLOps with Seldon and MLflowSeamless MLOps with Seldon and MLflow
Seamless MLOps with Seldon and MLflow
Databricks1K views
Ist Daten-Liberalismus der richtige Weg? by confluent
Ist Daten-Liberalismus der richtige Weg?Ist Daten-Liberalismus der richtige Weg?
Ist Daten-Liberalismus der richtige Weg?
confluent95 views
ML-Ops how to bring your data science to production by Herman Wu
ML-Ops  how to bring your data science to productionML-Ops  how to bring your data science to production
ML-Ops how to bring your data science to production
Herman Wu5.7K views
Building NLP applications with Transformers by Julien SIMON
Building NLP applications with TransformersBuilding NLP applications with Transformers
Building NLP applications with Transformers
Julien SIMON1.1K views
MLops workshop AWS by Gili Nachum
MLops workshop AWSMLops workshop AWS
MLops workshop AWS
Gili Nachum651 views
Machine Learning using Kubeflow and Kubernetes by Arun Gupta
Machine Learning using Kubeflow and KubernetesMachine Learning using Kubeflow and Kubernetes
Machine Learning using Kubeflow and Kubernetes
Arun Gupta2.3K views
Apply MLOps at Scale by H&M by Databricks
Apply MLOps at Scale by H&MApply MLOps at Scale by H&M
Apply MLOps at Scale by H&M
Databricks1K views
Unlocking the Power of Generative AI An Executive's Guide.pdf by PremNaraindas1
Unlocking the Power of Generative AI An Executive's Guide.pdfUnlocking the Power of Generative AI An Executive's Guide.pdf
Unlocking the Power of Generative AI An Executive's Guide.pdf
PremNaraindas12.2K views
RESTful Machine Learning with Flask and TensorFlow Serving - Carlo Mazzaferro by PyData
RESTful Machine Learning with Flask and TensorFlow Serving - Carlo MazzaferroRESTful Machine Learning with Flask and TensorFlow Serving - Carlo Mazzaferro
RESTful Machine Learning with Flask and TensorFlow Serving - Carlo Mazzaferro
PyData2.2K views
Generative AI - Responsible Path Forward.pdf by Saeed Al Dhaheri
Generative AI - Responsible Path Forward.pdfGenerative AI - Responsible Path Forward.pdf
Generative AI - Responsible Path Forward.pdf
Saeed Al Dhaheri163 views
End to end Machine Learning using Kubeflow - Build, Train, Deploy and Manage by Animesh Singh
End to end Machine Learning using Kubeflow - Build, Train, Deploy and ManageEnd to end Machine Learning using Kubeflow - Build, Train, Deploy and Manage
End to end Machine Learning using Kubeflow - Build, Train, Deploy and Manage
Animesh Singh1.9K views
How to Utilize MLflow and Kubernetes to Build an Enterprise ML Platform by Databricks
How to Utilize MLflow and Kubernetes to Build an Enterprise ML PlatformHow to Utilize MLflow and Kubernetes to Build an Enterprise ML Platform
How to Utilize MLflow and Kubernetes to Build an Enterprise ML Platform
Databricks8.1K views
Managing the Machine Learning Lifecycle with MLOps by Fatih Baltacı
Managing the Machine Learning Lifecycle with MLOpsManaging the Machine Learning Lifecycle with MLOps
Managing the Machine Learning Lifecycle with MLOps
Fatih Baltacı218 views

Similar to Bringing ML To Production, What Is Missing? AMLD 2020

CIO Leadership Summit 2018 - From Digital to Intelligent Enterprise by
CIO Leadership Summit 2018 - From Digital to Intelligent EnterpriseCIO Leadership Summit 2018 - From Digital to Intelligent Enterprise
CIO Leadership Summit 2018 - From Digital to Intelligent EnterprisePhilippe Nemery
311 views66 slides
Reading the IBM AI Strategy for Business by
Reading the IBM AI Strategy for BusinessReading the IBM AI Strategy for Business
Reading the IBM AI Strategy for BusinessPietro Leo
24 views11 slides
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P... by
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...NUS-ISS
446 views48 slides
IBM i & Data Science in the AI era. by
IBM i & Data Science in the AI era.  IBM i & Data Science in the AI era.
IBM i & Data Science in the AI era. Benoit Marolleau
539 views72 slides
Salesforce Einstein: Use Cases and Product Features by
Salesforce Einstein: Use Cases and Product FeaturesSalesforce Einstein: Use Cases and Product Features
Salesforce Einstein: Use Cases and Product FeaturesNew Delhi Salesforce Developer Group
2.8K views37 slides
Ganintegrate- Think Smart Integration brochure by
Ganintegrate- Think Smart Integration brochure Ganintegrate- Think Smart Integration brochure
Ganintegrate- Think Smart Integration brochure Judith Mugeni
172 views12 slides

Similar to Bringing ML To Production, What Is Missing? AMLD 2020(20)

CIO Leadership Summit 2018 - From Digital to Intelligent Enterprise by Philippe Nemery
CIO Leadership Summit 2018 - From Digital to Intelligent EnterpriseCIO Leadership Summit 2018 - From Digital to Intelligent Enterprise
CIO Leadership Summit 2018 - From Digital to Intelligent Enterprise
Philippe Nemery311 views
Reading the IBM AI Strategy for Business by Pietro Leo
Reading the IBM AI Strategy for BusinessReading the IBM AI Strategy for Business
Reading the IBM AI Strategy for Business
Pietro Leo24 views
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P... by NUS-ISS
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
NUS-ISS446 views
IBM i & Data Science in the AI era. by Benoit Marolleau
IBM i & Data Science in the AI era.  IBM i & Data Science in the AI era.
IBM i & Data Science in the AI era.
Benoit Marolleau539 views
Ganintegrate- Think Smart Integration brochure by Judith Mugeni
Ganintegrate- Think Smart Integration brochure Ganintegrate- Think Smart Integration brochure
Ganintegrate- Think Smart Integration brochure
Judith Mugeni172 views
Perform data annotation for quality workforce management by Annotation World
Perform data annotation for quality workforce managementPerform data annotation for quality workforce management
Perform data annotation for quality workforce management
Annotation World31 views
AI for Customer Service - How to Improve Contact Center Efficiency with Machi... by Skyl.ai
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...AI for Customer Service - How to Improve Contact Center Efficiency with Machi...
AI for Customer Service - How to Improve Contact Center Efficiency with Machi...
Skyl.ai227 views
Architecting AI Applications by Mikio L. Braun
Architecting AI ApplicationsArchitecting AI Applications
Architecting AI Applications
Mikio L. Braun849 views
A Complete Guide to Implement AI and Machine Learning in Your Existing Applic... by default default
A Complete Guide to Implement AI and Machine Learning in Your Existing Applic...A Complete Guide to Implement AI and Machine Learning in Your Existing Applic...
A Complete Guide to Implement AI and Machine Learning in Your Existing Applic...
default default4 views
David Braun. Scaling service business. Is it possible? by IT Arena
David Braun. Scaling service business. Is it possible?David Braun. Scaling service business. Is it possible?
David Braun. Scaling service business. Is it possible?
IT Arena229 views
Tableau 2018 - Introduction to Visual analytics by Arun K
Tableau 2018 - Introduction to Visual analyticsTableau 2018 - Introduction to Visual analytics
Tableau 2018 - Introduction to Visual analytics
Arun K518 views
Top 10 Skills You Need For A High-Paying Machine Learning Career by Robert Smith
Top 10 Skills You Need For A High-Paying Machine Learning CareerTop 10 Skills You Need For A High-Paying Machine Learning Career
Top 10 Skills You Need For A High-Paying Machine Learning Career
Robert Smith114 views
Business intelligence solutions english by Stratebi
Business intelligence solutions englishBusiness intelligence solutions english
Business intelligence solutions english
Stratebi962 views
MongoDB World 2018: Building Intelligent Apps with MongoDB & Google Cloud by MongoDB
MongoDB World 2018: Building Intelligent Apps with MongoDB & Google CloudMongoDB World 2018: Building Intelligent Apps with MongoDB & Google Cloud
MongoDB World 2018: Building Intelligent Apps with MongoDB & Google Cloud
MongoDB1K views
Data Con LA 2022 - Demystifying the Art of Business Intelligence and Data Ana... by Data Con LA
Data Con LA 2022 - Demystifying the Art of Business Intelligence and Data Ana...Data Con LA 2022 - Demystifying the Art of Business Intelligence and Data Ana...
Data Con LA 2022 - Demystifying the Art of Business Intelligence and Data Ana...
Data Con LA8 views
Machine learning for product development by Claudio Villar
Machine learning for product developmentMachine learning for product development
Machine learning for product development
Claudio Villar230 views
Building Intelligent Apps with MongoDB and Google Cloud - Jane Fine by MongoDB
Building Intelligent Apps with MongoDB and Google Cloud - Jane FineBuilding Intelligent Apps with MongoDB and Google Cloud - Jane Fine
Building Intelligent Apps with MongoDB and Google Cloud - Jane Fine
MongoDB232 views

More from Mikio L. Braun

Academia to industry looking back on a decade of ml by
Academia to industry looking back on a decade of mlAcademia to industry looking back on a decade of ml
Academia to industry looking back on a decade of mlMikio L. Braun
532 views50 slides
Machine Learning for Time Series, Strata London 2018 by
Machine Learning for Time Series, Strata London 2018Machine Learning for Time Series, Strata London 2018
Machine Learning for Time Series, Strata London 2018Mikio L. Braun
2.3K views26 slides
Hardcore Data Science - in Practice by
Hardcore Data Science - in PracticeHardcore Data Science - in Practice
Hardcore Data Science - in PracticeMikio L. Braun
5.7K views13 slides
Data flow vs. procedural programming: How to put your algorithms into Flink by
Data flow vs. procedural programming: How to put your algorithms into FlinkData flow vs. procedural programming: How to put your algorithms into Flink
Data flow vs. procedural programming: How to put your algorithms into FlinkMikio L. Braun
2.9K views22 slides
Scalable Machine Learning by
Scalable Machine LearningScalable Machine Learning
Scalable Machine LearningMikio L. Braun
5.1K views25 slides
Realtime Data Analysis Patterns by
Realtime Data Analysis PatternsRealtime Data Analysis Patterns
Realtime Data Analysis PatternsMikio L. Braun
10.2K views35 slides

More from Mikio L. Braun(8)

Academia to industry looking back on a decade of ml by Mikio L. Braun
Academia to industry looking back on a decade of mlAcademia to industry looking back on a decade of ml
Academia to industry looking back on a decade of ml
Mikio L. Braun532 views
Machine Learning for Time Series, Strata London 2018 by Mikio L. Braun
Machine Learning for Time Series, Strata London 2018Machine Learning for Time Series, Strata London 2018
Machine Learning for Time Series, Strata London 2018
Mikio L. Braun2.3K views
Hardcore Data Science - in Practice by Mikio L. Braun
Hardcore Data Science - in PracticeHardcore Data Science - in Practice
Hardcore Data Science - in Practice
Mikio L. Braun5.7K views
Data flow vs. procedural programming: How to put your algorithms into Flink by Mikio L. Braun
Data flow vs. procedural programming: How to put your algorithms into FlinkData flow vs. procedural programming: How to put your algorithms into Flink
Data flow vs. procedural programming: How to put your algorithms into Flink
Mikio L. Braun2.9K views
Scalable Machine Learning by Mikio L. Braun
Scalable Machine LearningScalable Machine Learning
Scalable Machine Learning
Mikio L. Braun5.1K views
Realtime Data Analysis Patterns by Mikio L. Braun
Realtime Data Analysis PatternsRealtime Data Analysis Patterns
Realtime Data Analysis Patterns
Mikio L. Braun10.2K views
Cassandra - An Introduction by Mikio L. Braun
Cassandra - An IntroductionCassandra - An Introduction
Cassandra - An Introduction
Mikio L. Braun3.7K views
Cassandra - Eine Einführung by Mikio L. Braun
Cassandra - Eine EinführungCassandra - Eine Einführung
Cassandra - Eine Einführung
Mikio L. Braun3.2K views

Recently uploaded

Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...ShapeBlue
144 views12 slides
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... by
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...ShapeBlue
120 views13 slides
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O... by
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...ShapeBlue
88 views13 slides
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...ShapeBlue
138 views18 slides
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue by
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueShapeBlue
179 views7 slides
State of the Union - Rohit Yadav - Apache CloudStack by
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStackShapeBlue
253 views53 slides

Recently uploaded(20)

Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by ShapeBlue
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
ShapeBlue144 views
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... by ShapeBlue
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
ShapeBlue120 views
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O... by ShapeBlue
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
ShapeBlue88 views
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by ShapeBlue
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
ShapeBlue138 views
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue by ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
ShapeBlue179 views
State of the Union - Rohit Yadav - Apache CloudStack by ShapeBlue
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStack
ShapeBlue253 views
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc160 views
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ by ShapeBlue
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericConfidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
ShapeBlue88 views
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson156 views
Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P... by ShapeBlue
Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P...Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P...
Developments to CloudStack’s SDN ecosystem: Integration with VMWare NSX 4 - P...
ShapeBlue154 views
Future of AR - Facebook Presentation by Rob McCarty
Future of AR - Facebook PresentationFuture of AR - Facebook Presentation
Future of AR - Facebook Presentation
Rob McCarty62 views
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue by ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlueVNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
ShapeBlue163 views
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... by ShapeBlue
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
ShapeBlue123 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue146 views
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or... by ShapeBlue
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
ShapeBlue158 views
The Role of Patterns in the Era of Large Language Models by Yunyao Li
The Role of Patterns in the Era of Large Language ModelsThe Role of Patterns in the Era of Large Language Models
The Role of Patterns in the Era of Large Language Models
Yunyao Li80 views
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... by ShapeBlue
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
ShapeBlue98 views
"Surviving highload with Node.js", Andrii Shumada by Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays53 views

Bringing ML To Production, What Is Missing? AMLD 2020

  • 1. Bringing ML to Production, what is missing? Mikio Braun, Staff Data Scientist Applied ML Days, Lausanne 2020
  • 2. With thousands of incredible experiences around the world, GetYourGuide is at the heart of travel Applied ML Days, Lausanne 2020
  • 3. We’ve built one of the world’s biggest marketplace 
 for travel activities… Millions of travelers use 
 GetYourGuide every year We facilitate the transaction We offer more than 40,000 
 activities worldwide Connecting 
 customers... ...to suppliers 
 around the world Applied ML Days, Lausanne 2020
  • 4. Hop-on hop-off Attractions Outdoor activities TransfersAmusement parksCooking classesWalking tours Applied ML Days, Lausanne 2020
  • 5. So How Do You “Do AI?” https://hackernoon.com/the-ai-hierarchy-of-needs-18f111fcc007
  • 6. What is there beyond algorithms and tools? ● Figuring out where to apply ML ● Architecting ML applications ● Teams & Organizations
  • 7. Business Problems to ML Problems Applied ML Days, Lausanne 2020
  • 8. GetYourGuide Overview Applied ML Days, Lausanne 2020
  • 9. GetYourGuide Overview Applied ML Days, Lausanne 2020
  • 10. From Business Problems To Machine Learning Problems • Customer has a Job to be done. • Business has to give a Solution that adds value. • Solution consists of Activities, and some of that activities might be solved with ML. • ML: solve a task by learning from examples. Applied ML Days, Lausanne 2020
  • 11. Machine Learning: Learn From Examples Applied ML Days, Lausanne 2020
  • 12. Example: Recommendations Applied ML Days, Lausanne 2020
  • 13. Typical problem for machine learning: • Hard to specify what exactly means “similar.” • A lot of example data is available. • Recommendations have to change based on new articles frequently. Example: Recommendations Applied ML Days, Lausanne 2020
  • 14. • Business/customer view and machine learning view often have different metrics. • Machine learning does not know about the business view. • Figuring out the right relationship is not easy. • Also depends on the available data. Example: Recommendation Applied ML Days, Lausanne 2020
  • 15. Architectures for AI Systems Applied ML Days, Lausanne 2020
  • 16. Machine Learning Systems Applied ML Days, Lausanne 2020
  • 17. Design Patterns for AI Architectures Core Machine Learning
 —how to train, evaluate, etc. Serving
 —access predictions in real-time Data Preprocessing and Features
 —how to deal with preprocessing Automation & Monitoring
 —making it more production ready Machine Learning Integration
 —how to fit it into a larger picture Applied ML Days, Lausanne 2020
  • 18. Machine Learning Integration Patterns • Depending on how ML is used, there are different integration patterns. • Keep in mind that the ML problem and the application problem are different and have different metrics. • Beware of interacting ML models if the overall training data is used. Applied ML Days, Lausanne 2020
  • 19. Serving Patterns •How to provide the predictions of the machine learning model to the application. •If the domain is small, precomputing predictions might be the easiest way to serve. Applied ML Days, Lausanne 2020
  • 20. Preprocessing Patterns • If predictions are precomputed, no special treatment of feature computation is necessary. • If it is served online, you can either precompute features in a Feature Store. But you don’t have updates for new data. • Or you can use the Feature Store and update features online as well. Applied ML Days, Lausanne 2020
  • 22. How Data Scientists Work Applied ML Days, Lausanne 2020
  • 23. Data Scientists And Developers Applied ML Days, Lausanne 2020
  • 24. Data Scientists and Developers Collaboration • What is the most productive way? • Ideally, interface on code, not just documentation • Production logs often become data analysis input! Applied ML Days, Lausanne 2020
  • 25. Organizing Data Science Applied ML Days, Lausanne 2020
  • 26. Data Platforms https://hackernoon.com/the-ai-hierarchy-of-needs-18f111fcc007 Applied ML Days, Lausanne 2020 Machine Learning: The High Interest Credit Card of Technical Debt
  • 27. Summary ● Not just about methods and tools. ● How to identify where to use ML? ● Building AI/ML systems. ● How to set up teams and organizations for ML.