Let's introduce MLOps practice from a DevOps-derived experience with a nice demo wtih ML.NET

1. MLOps – DevOps for ML
Marco Parenzan (twitter: @marco_parenzan)

3. MLOps?!?!??!?!

4. What is DevOps

5. Devops
Agile
Alm
CI/CD
Microservices
Elasticity
Geo
redundancy

6. Build
& Test
Continuous
Delivery
Deploy
Operate
Monitor
&
Learn
Plan
&
Track
Develop

12. DevOps + ML = MLOps

13. © Microsoft Corporation
Reproducibility /
Auditability
MLOps Benefits
Validation
Automation /
Observability
• Code drives generation
and deployments
• Pipelines are
reproducible and
verifiable
• All artifacts can be
tagged and audited
• SWE best practices for
quality control
• Offline comparisons of
model quality
• Minimize bias and
enable explainability
• Controlled rollout
capabilities
• Live comparison of
predicted vs. expected
performance
• Results fed back to
watch for drift and
improve model

14. «The italian way »

17. .NET 5
INFRASTRUCTURE
.NET STANDARD
DESKTOP WEB CLOUD MOBILE GAMING IoT AI
WPF
Windows Forms
UWP
ASP.NET Xamarin UnityAzure ARM32
ARM64
ML.NET
.NET for
Apache Spark

19. Azure DevOps

20. Visual
Source Safe
Team
Foundation
Server
Visual
Studio
Online
Visual
Studio Team
Services
Azure
DevOps

21. Azure Boards
Offri valore agli utenti più
velocemente utilizzando strumenti
agili comprovati per pianificare,
monitorare e discutere il lavoro in
tutti i tuoi team.
Azure Pipelines
Compila, testa e distribuisci con CI/CD
che funziona con qualsiasi linguaggio,
piattaforma e cloud. Connettersi a
GitHub o qualsiasi altro provider Git e
distribuire continuamente.
Azure Repos
Ottieni repository Git privati
illimitati e ospitati nel cloud e
collabora per creare codice
migliore con richieste pull e
gestione avanzata dei file.
Azure Test Plans
Testare e spedire con sicurezza
utilizzandostrumentiditestmanualied
esplorativi.
Azure Artifacts
Crea, ospita e condividi pacchetti con
il tuo team e aggiungi elementi alle
pipeline CI/CD con un solo clic.

22. Maven
Target any cloud, on-prem or both and deploy to the servers you need

24. https://visualstudio.microsoft.com/vs/benefits/
https://visualstudio.microsoft.com/vs/pricing-details/
https://visualstudio.microsoft.com/vs/benefits/#azure

25. The operational pipeline

26. App developer
using Azure DevOps
Build appCollaborate Test app Release app Monitor app

27. App developer
using Azure DevOps
Build appCollaborate Test app Release app Monitor app
Data scientist using
Azure Machine Learning

28. Code, dataset, and
environment versioning
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning

29. Model validation
& profiling
Train model Validate
model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning

30. Model packaging
Simple deployment
across cloud and edge
Train model Validate
model
Deploy
model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning

31. Model
management
& monitoring
Model performance
analysis
Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning

32. Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Build appCollaborate Test app Release app Monitor app
Azure Machine Learning extension for Azure DevOps
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning

33. Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Build appCollaborate Test app Release app Monitor app
Audit trail management and model interpretability
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning

35. Marco Parenzan (twitter: @marco_parenzan)