Successfully reported this slideshow.
Your SlideShare is downloading. ×

Vertex AI: Pipelines for your MLOps workflows

Vertex AI: Pipelines for your MLOps workflows

Download to read offline

In recent years, one of the biggest trends in applications development has been the rise of Machine Learning solutions, tools, and managed platforms. Vertex AI is a managed unified ML platform for all your AI workloads. On the MLOps side, Vertex AI Pipelines solutions let you adopt experiment pipelining beyond the classic build, train, eval, and deploy a model. It is engineered for data scientists and data engineers, and it’s a tremendous help for those teams who don’t have DevOps or sysadmin engineers, as infrastructure management overhead has been almost completely eliminated.
Based on practical examples we will demonstrate how Vertex AI Pipelines scores high in terms of developer experience, how fits custom ML needs, and analyze results. It’s a toolset for a fully-fledged machine learning workflow, a sequence of steps in the model development, a deployment cycle, such as data preparation/validation, model training, hyperparameter tuning, model validation, and model deployment. Vertex AI comes with all standard resources plus an ML metadata store, a fully managed feature store, and a fully managed pipelines runner.
Vertex AI Pipelines is a managed serverless toolkit, which means you don't have to fiddle with infrastructure or back-end resources to run workflows.

In recent years, one of the biggest trends in applications development has been the rise of Machine Learning solutions, tools, and managed platforms. Vertex AI is a managed unified ML platform for all your AI workloads. On the MLOps side, Vertex AI Pipelines solutions let you adopt experiment pipelining beyond the classic build, train, eval, and deploy a model. It is engineered for data scientists and data engineers, and it’s a tremendous help for those teams who don’t have DevOps or sysadmin engineers, as infrastructure management overhead has been almost completely eliminated.
Based on practical examples we will demonstrate how Vertex AI Pipelines scores high in terms of developer experience, how fits custom ML needs, and analyze results. It’s a toolset for a fully-fledged machine learning workflow, a sequence of steps in the model development, a deployment cycle, such as data preparation/validation, model training, hyperparameter tuning, model validation, and model deployment. Vertex AI comes with all standard resources plus an ML metadata store, a fully managed feature store, and a fully managed pipelines runner.
Vertex AI Pipelines is a managed serverless toolkit, which means you don't have to fiddle with infrastructure or back-end resources to run workflows.

Advertisement
Advertisement

More Related Content

Advertisement

Related Books

Free with a 30 day trial from Scribd

See all

Vertex AI: Pipelines for your MLOps workflows

  1. 1. Vertex AI Pipelines for your MLOps workflows GDG DevFest, November 2021 Márton Kodok Google Developer Expert at REEA.net
  2. 2. ● Among the Top3 romanians on Stackoverflow 195k reputation ● Google Developer Expert on Cloud technologies ● Crafting Web/Mobile backends at REEA.net ● BigQuery + Redis database engine expert Slideshare: martonkodok Articles: martonkodok.medium.com Twitter: @martonkodok StackOverflow: pentium10 GitHub: pentium10 Vertex AI: Pipelines for your MLOps workflows @martonkodok About me
  3. 3. 1. What is MLOps? 2. What is Vertex AI? 3. Build, train and deploy ML solutions 4. Using Pipelines throughout your ML workflow 5. Adapting to changes of data 6. Conclusions Agenda Vertex AI: Pipelines for your MLOps workflows @martonkodok
  4. 4. @martonkodok What is MLOps? Part #1
  5. 5. “ DevOpsprinciples to MLsystems Vertex AI: Pipelines for your MLOps workflows @martonkodok What is MLOps?
  6. 6. Elements for ML systems Adapted from Hidden Technical Debt in Machine Learning Systems. @martonkodok
  7. 7. “Continuousdelivery and automationpipelines for machinelearning systems. Vertex AI: Pipelines for your MLOps workflows @martonkodok What is MLOps?
  8. 8. MLOps level 0: Manual process MLOps level 1: ML pipeline automation MLOps level 2: CI/CD pipeline automation Levelsofautomation defines maturity of theMLprocess @martonkodok
  9. 9. MLOps level 0: Manual process - Process for building and deploying ML models is entirely manual. Infrequent release iterations. No CI, No CD. Disconnection between ML and operations. MLOps level 1: ML pipeline automation - Continuous training of the model by automating the ML pipeline; achieve continuous delivery of model prediction service. New pipelines mostly based on new data. MLOps level 2: CI/CD pipeline automation -iteratively try out new ML algorithms and new modeling where the experiment steps are orchestrated. The output of this stage is the source code of the ML pipeline steps that are then pushed to a source repository. Build source. Run test. Output is pipeline. Levelsofautomation defines maturity of theMLprocess @martonkodok
  10. 10. MLOps level 2: CI/CDpipelineautomation @martonkodok
  11. 11. Levelsofautomation defines maturity of theMLprocess
  12. 12. @martonkodok What is Vertex AI? Part #2
  13. 13. “VertexAI is a managed ML platform for practitioners to accelerate experiments and deploy AI models. Vertex AI: Pipelines for your MLOps workflows @martonkodok
  14. 14. What’s included in VertexAI? Vertex AI: Pipelines for your MLOps workflows @martonkodok Data Labeling AutoML DL Environment (DL VM + DL Container) Prediction Feature Store Training Experiments Data Readiness Feature Engineering Training/ HP-Tuning Model Monitoring Model serving Understanding/ Tuning Edge Model Management Notebooks Pipelines (Orchestration) Explainable AI Hybrid AI Model Monitoring Metadata Vision Translation Tables Language Video AI Accelerators Models Datasets Custom Models Containers Python Endpoints Vizier Optimization
  15. 15. VertexAI is a unified MLOps platform Vertex AI: Pipelines for your MLOps workflows @martonkodok Operational Model Programming Model No Infra Management Managed Security Pay only for usage Model-as-a-service oriented Streamlined model development Open SDKs, integrates with ML frameworks
  16. 16. Using Pipelines throughout your ML workflow Part #3
  17. 17. VertexAI: Pipelines - Orchestrate your ML workflow Vertex AI: Pipelines for your MLOps workflows @martonkodok Data Labeling AutoML DL Environment (DL VM + DL Container) Prediction Feature Store Training Experiments Data Readiness Feature Engineering Training/ HP-Tuning Model Monitoring Model serving Understanding/ Tuning Edge Model Management Notebooks Pipelines (Orchestration) Explainable AI Hybrid AI Model Monitoring Metadata Vision Translation Tables Language Video AI Accelerators Models Datasets Custom Models Containers Python Endpoints Vizier Optimization
  18. 18. “ Why are MLpipelines useful? Vertex AI: Pipelines for your MLOps workflows @martonkodok
  19. 19. 1. Orchestrate ML workflow steps as a process. We no longer handle all data gathering, model training, tuning, evaluation, deployment as a monolith. 2. Adopt MLOps for production models. We need a repeatable, verifiable, and automatic process for making any change to a production model. 3. Develop steps independently -as you scale out, enables you to share your ML workflow with others on your team, so they can run it, and contribute code. Enablesyoutotracktheinputandoutputfromeach stepinareproducibleway. Why are ML pipelines useful? @martonkodok
  20. 20. Vertex AI: Pipelines Vertex AI: Pipelines for your MLOps workflows Source: Piero Esposito https://github.com/piEsposito/vertex-ai-tutorials
  21. 21. Using Pipelines throughout your ML workflow Vertex AI: Pipelines for your MLOps workflows @martonkodok Gather data Train model Deploy model
  22. 22. Pipeline Components Vertex AI: Pipelines for your MLOps workflows pipeline_components_automl_images.ipynb github.com/GoogleCloudPlatform/vertex-ai-samples
  23. 23. Using Pipelines throughout your ML workflow Vertex AI: Pipelines for your MLOps workflows @martonkodok Gather data Train model Evaluate model Scalably deploy model
  24. 24. Pipeline SDK: Condition Vertex AI: Pipelines for your MLOps workflows automl_tabular_classification_beans.ipynb github.com/GoogleCloudPlatform/vertex-ai-samples
  25. 25. 1. Use of the Google Cloud Pipeline Components, which support easy access to Vertex AI services 2. Custom Components - function that compiles to a task ‘factory’ function that can be used by pipelines 3. No more Kubeflow Pipelines that must be deployed on a Kubernetes Cluster. 4. Sharing component specifications - the YAML format allows the component to be put under version control and shared with others, or be used by other pipelines by calling the load_from_url function. 5. Leveraging Pipeline step caching to develop and debug 6. Vertex AI Metadata service + Artifacts Lineage tracking - inverse of pipeline DAG Developer friendly components @martonkodok
  26. 26. Recap Vertex AI: Pipelines for your MLOps workflows @martonkodok Data Labeling AutoML DL Environment (DL VM + DL Container) Prediction Feature Store Training Experiments Data Readiness Feature Engineering Training/ HP-Tuning Model Monitoring Model serving Understanding/ Tuning Edge Model Management Notebooks Pipelines (Orchestration) Explainable AI Hybrid AI Model Monitoring Metadata Vision Translation Tables Language Video AI Accelerators Models Datasets Custom Models Containers Python Endpoints Vizier Optimization
  27. 27. Part #4 Adapting to changes of data
  28. 28. Automatic CI / CD Perspective with GCP Services Vertex AI: Pipelines for your MLOps workflows @martonkodok Eventarc • Detect changes on data • React to events from Cloud services • Handle events on Cloud Workflows, Cloud Functions, Cloud Run • Reuse pipeline spec.json from GCS • Trigger Vertex AI pipeline • Detect changes in codebase • Build pipeline • Pipeline spec.json to Cloud Storage • Image to Cloud Registry • Trigger Vertex AI pipeline Cloud Build Cloud Scheduler • Poll for changes of any data • Launch based on schedule • In tandem with Cloud Workflows • Trigger Vertex AI pipeline
  29. 29. Conclusion Vertex AI: Pipelines for your MLOps workflows @martonkodok
  30. 30. 1. Build with the groundbreaking ML tools that power Google 2. Approachable from the non-ML developer perspective (AutoML, managed models, training) 3. Ease the life of a data scientist/ML (has feature store, managed datasets, endpoints, notebooks) 4. End-to-end integration for data and AI with build pipelines that outperform and solve complex ML tasks 5. GitOps-style continuous delivery with Cloud Build 6. Explainable AI and TensorBoard to visualize and track ML experiments Vertex AI: Enhanced developer experience Vertex AI: Pipelines for your MLOps workflows @martonkodok
  31. 31. Thank you. Q&A. Slides available on: slideshare.net/martonkodok Reea.net - Integrated web solutions driven by creativity to deliver projects.

×