Downloaded 31 times
![MLOps vs LLMOps - MLOps @ 127.0.0.1 | 21 Maggio 2024
LLMOps ● code
○ processing ++
○ [ training ] ++
○ inference ++
■ RAG
○ evaluation
● model & baselines
● embeddings ++
● prompt
● monitoring
○ metrics
○ logs
○ bias & malicious behaviors
■ training baseline vs new data
■ prediction baseline vs new pred
Resources versioned or
saved with a timestamp](https://image.slidesharecdn.com/mlops-240601105931-f502efd5/85/MLOps-vs-LLMOps-by-workflows-and-use-cases-2024-05-21-66-320.jpg)
Uploaded byAlessandra Bilardi
MLOps vs LLMOps (by workflows and use cases) - 2024-05-21
The document discusses the differences between MLOps and LLMOps, highlighting their respective methods, actors, and use cases such as forecasting, sentiment analysis, and chatbots. It provides a comparison of tools, training processes, monitoring practices, and evaluation metrics specific to MLOps and LLMOps. Key takeaways include the computing requirements and metrics evaluation differences between the two approaches.
More Related Content
Similar to MLOps vs LLMOps (by workflows and use cases) - 2024-05-21
MLOps vs LLMOps (by workflows and use cases) - 2024-05-21
- 1. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps vs LLMOps
- 2. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
- 3. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
- 4. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it
- 5. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 SUMMARY DevOps methods MLOps methods LLMOps methods Take away
- 6. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps methods & actors
- 7. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 CI / CD & actors
- 8. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps methods & actors
- 9. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps methods & actors
- 10. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 DevOps ● code ● monitoring ○ metrics ○ logs Resources versioned or saved with a timestamp
- 11. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & actors
- 12. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 CI / CD & actors
- 13. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 14. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 15. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 16. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML system
- 17. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 18. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 19. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 20. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 21. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 22. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 23. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Forecasting
- 24. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 25. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 26. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 27. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 28. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 29. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 30. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 31. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 32. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Sentiment analysis
- 33. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 34. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 35. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps ● code ○ processing ○ training ○ inference ○ evaluation ● model & baselines ● monitoring ○ metrics ○ logs ○ bias ■ training baseline vs new data ■ prediction baseline vs new pred Resources versioned or saved with a timestamp
- 36. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 37. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Face recognition
- 38. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Face recognition
- 39. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Face recognition
- 40. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & actors
- 41. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & actors
- 42. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 43. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 44. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 45. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 46. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 47. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps ● code ○ processing ○ training ○ inference ○ evaluation ● model & baselines ● embeddings ● monitoring ○ metrics ○ logs ○ bias ■ training baseline vs new data ■ prediction baseline vs new pred Resources versioned or saved with a timestamp
- 48. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & actors
- 49. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 CI / CD & actors
- 50. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 51. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 ML
- 52. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLM
- 53. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLM
- 54. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLM
- 55. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - preparation steps
- 56. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - preparation steps
- 57. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - production version 1.0
- 58. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - production version 1.1
- 59. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Use case - Chat bot - production version 2.0
- 60. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 MLOps methods & steps
- 61. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 62. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 63. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 64. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 65. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps methods & steps
- 66. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 LLMOps ● code ○ processing ++ ○ [ training ] ++ ○ inference ++ ■ RAG ○ evaluation ● model & baselines ● embeddings ++ ● prompt ● monitoring ○ metrics ○ logs ○ bias & malicious behaviors ■ training baseline vs new data ■ prediction baseline vs new pred Resources versioned or saved with a timestamp
- 67. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Take away MLOps vs LLMOps Methods Resources MLOps LLMOps Computing small & CPU or GPU big & GPU Training often rarely Evaluation metrics Accuracy, AUC, .. BLEU, ROGUE, .. Embeddings small big Prompt ❌ ✅ Monitoring metrics, logs, bias also hacking
- 68. MLOps vs LLMOps- MLOps @ 127.0.0.1 | 21 Maggio 2024 Thanks for listening!