MLOps aims to streamline the deployment of machine learning models from idea to production with minimal risk and friction. It emphasizes collaborative, reproducible, and continuous processes while requiring various tools for data analysis, model serving, and monitoring. The document outlines the importance of shared principles and considerations in implementing MLOps effectively.
Why?
Because most ofyour ML system is
not about the ML code.
Data Verification
Serving
Infrastructure
Configuration Data Collection
Feature Extraction
Process Management Tools
Analysis Tools
Monitoring
Machine Resource
Management
ML Code
Hidden Technical Debt in Machine Learning Systems (2015): https://papers.nips.cc/paper/2015/file/86df7dcfd896fcaf2674f757a2463eba-Paper.pdf
Needed to
materialize
value
6.
The goal ofMLOps is to reduce technical friction
to get the model from an idea into production in
the shortest possible time with as little risk as
possible.
Process
A few sharedprinciples will take you a long way…
ML should be
collaborative.
ML should be
reproducible.
ML should be
continuous.
ML should be tested
& monitored.
10.
Tooling
And tooling willhelp implement your process.
ML should be
collaborative.
ML should be
reproducible.
ML should be
continuous.
ML should be tested
& monitored.
Shared
Infrastructure
Versioning for Code,
Data and Metadata
Machine Learning
Pipelines
Model Deployment
and Monitoring
11.
Time Risk
Short-term thinking
Long-termthinking
Do it fast Do it safe
Time
Do it right So it’ll be faster
next time
Risk
Avoid the “It’s too early for MLOps” trap.
12.
Data analysis
ML pipelineModel serving
Model monitoring
Experimentation
Feature store
Metadata store
Model registry
Code repository
The MLOps Stack
provides one way to
think about what
tooling you might
need.
Download template:
valohai.com/mlops
13.
Data analysis
ML pipelineModel serving
Model monitoring
Experimentation
Feature store
Metadata store
Model registry
Code repository
Considerations:
Self-Managed Tools
vs
Managed Tools
Point Solutions
vs
End-to-End Platforms
Download template:
valohai.com/mlops
14.
The MLOps toolsare aplenty…
but so are the requirements.
Self-driving car vs
recommendation
engine
Citizen data scientists
vs seasoned engineers
Healthcare & fintech vs
mobile gaming
Bootstrapping vs
well-funded
Use Case Team & skills Regulation Other resources