SlideShare a Scribd company logo
ML Operationalization with Microsoft Azure
Kyle Akepanidtaworn (Krid/Kyle)
Cloud Solution Architect (Advanced Analytics & AI)
Global Digital Transformation Partnerships Team
Email | Linkedin | Quora | Medium | GitHub
Learning Objectives
In this workshop, you will learn:
1. To orchestrate and deploy updates to the application and the deep learning model in a unified way.
2. To design a DevOps pipeline to coordinate retrieving the latest best model from the model registry, packaging the
web application, deploying the web application and inferencing web service. You will also learn how to monitor the
model's performance after it is deployed so your startup can be proactive with performance issues.
The target audience for the workshop includes:
• Data Scientists
• App Developers
• AI Engineers
• DevOps Engineers
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{1.Let’s PlayandInteract}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
https://aka.ms/AA627pi
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{2.Introduction ofMLOps}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Machine Learning Across Microsoft
Microsoft 365
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Machine Learning at Scale
Monthly active Office
365 users, leveraging
Office AI capabilities
180
Million
Questions being
asked on Cortana
18
Billion
Number of signals
analyzed on behalf of
users to identify patterns
of emerging threats daily
6.5
Trillion
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
But ML is hard!
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Building
a model
Data ingestion Data analysis
Data
transformation
Data validation Data splitting
Trainer
Model
validation
Training
at scale
LoggingRoll-out Serving Monitoring
Machine Learning Process
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
E2E ML lifecycle
Train Model Validate Model Deploy ModelPackage Model Monitor Model
Retrain Model
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
MLOps = ML + DEV + OPS
Experiment
Data Acquisition
Business Understanding
Initial Modeling
Develop Operate
Continuous Delivery
Data Feedback Loop
System + Model Monitoring
ML
Modeling + Testing
Continuous Integration
Continuous Deployment
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
App developer
using Azure DevOps
Build appCollaborate Test app Release app Monitor app
Model reproducibility Model retrainingModel deploymentModel validation
Data scientist using
Azure Machine Learning
Code, dataset, and
environment versioning
Model reproducibility Model retrainingModel deploymentModel validation
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Model reproducibility Model retrainingModel deploymentModel validation
Automated ML
ML Pipelines
Hyperparameter tuning
Train model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Model validation
& certification
Model reproducibility Model retrainingModel deploymentModel validation
Train model Validate
model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Model packaging
Simple deployment
Model reproducibility Model retrainingModel deploymentModel validation
Train model Validate
model
Deploy
model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Model
management
& monitoring
Model performance
analysis
Model reproducibility Model retrainingModel deploymentModel validation
Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Build appCollaborate Test app Release app Monitor app
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
Train model Validate
model
Deploy
model
Monitor
model
Retrain model
Model reproducibility Model retrainingModel deploymentModel validation
Build appCollaborate Test app Release app Monitor app
Azure DevOps integration
App developer
using Azure DevOps
Data scientist using
Azure Machine Learning
MLOps Benefits
1. Reproducibility + Auditability
• Code drives generation and
deployments
• Pipelines are reproducible and verifiable
• All artifacts can be tagged and audited
2. Validation
• SWE best practices for quality control
• Offline comparisons of model quality
• Minimize bias and enable explainability
3. Automation + Observability
• Controlled rollout capabilities.
• Live comparison of predicted vs.
expected performance.
• Results fed back to watch for drift and
improve model.
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Azure MLOps
Asset management & orchestration
services to help manage the ML lifecycle.
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{3.Hands-on Workshop}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
https://aka.ms/AA610wt
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{4.Before Hands-on Lab}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Critical Requirements
1. Azure subscription. You will need a valid and active Azure account to complete the quickstarts. If you do
not have one, you can sign up for a free trial.
• The Microsoft Azure subscription must be pay-as-you-go or MSDN.
• Trial subscriptions will not work. You will run into issues with Azure resource quota limits.
• Subscriptions with access limited to a single resource group will not work. You will need the ability to deploy
multiple resource groups.
2. Azure DevOps subscription. You will need a valid and active Azure DevOps account to complete the
quickstarts. If you do not have one, you can sign up for a free account. (Please provision in “East US” to
leverage GPU.)
3. Azure Notebooks. You will need an Azure Notebooks project to import the quickstart notebooks into. See
instructions below on how to prepare your Azure Notebooks environment. (Please provision in “East
US” to leverage GPU.)
4. Azure Machine Learning service workspace. (Please provision in “East US” to leverage GPU.)
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
https://azure.com/devops
@AzureDevOps
https://aka.ms/AzureDevOpsForum
https://aka.ms/DevOpsBlog/
Azure DevOps
#AzureDevOps
Azure DevOps
Deliver value to your users faster
using proven agile tools to plan,
track, and discuss work across
your teams.
Build, test, and deploy with CI/CD that
works with any language, platform,
and cloud. Connect to GitHub or any
other Git provider and deploy
continuously.
Get unlimited, cloud-hosted
private Git repos and collaborate
to build better code with pull
requests and advanced file
management.
Test and ship with confidence
using manual and exploratory
testing tools.
Create, host, and share packages with
your team, and add artifacts to your
CI/CD pipelines with a single click.
Azure Boards Azure ReposAzure Pipelines
Azure Test Plans Azure Artifacts
https://azure.com/devops
➔
Cloud-hosted pipelines for Linux, Windows and
macOS, with unlimited minutes for open source
Azure Pipelines
Any language, any platform, any cloud
Build, test, and deploy Node.js, Python, 
Java, PHP, Ruby,
C/C++, .NET, Android, and iOS apps. Run in parallel on
Linux, macOS, and Windows. Deploy to Azure, AWS,
GCP or on-premises
Extensible
Explore and implement a wide range of community-
built build, test, and deployment tasks, along with
hundreds of extensions from Slack to SonarCloud.
Support for YAML, reporting and more
Best-in-class for open source
Ensure fast continuous integration/continuous delivery
(CI/CD) pipelines for every open source project. Get
unlimited build minutes for all open source projects with
up to 10 free parallel jobs across Linux, macOS and
Windows
https://azure.com/pipelines➔
Containers and Kubernetes
Easily build and push images to container registries like
Docker Hub and Azure Container Registry. Deploy
containers to individual hosts or Kubernetes.
Track work with Kanban boards, backlogs, team
dashboards, and custom reporting
Azure Boards
https://azure.com/devops➔
Connected from idea to release
Track all your ideas at every development stage and
keep your team aligned with all code changes linked
directly to work items.
Scrum ready
Use built-in scrum boards and planning tools to help
your teams run sprints, stand-ups, and planning
meetings.
Project insights
Gain new insights into the health and status of your
project with powerful analytics tools and dashboard
widgets.
Unlimited private Git repo hosting and support for
TFVC that scales from a hobby project to the
world’s largest Git repositories
Azure Repos
https://azure.com/devops➔
Works with your Git client
Securely connect with and push code into your Git
repos from any IDE, editor, or Git client.
Web hooks and API integration
Add validations and extensions from the marketplace
or build your own using web hooks and REST APIs.
Semantic code search
Quickly find what you’re looking for with code-aware
search that understands classes and variables.
Get end-to-end traceability. Run tests and log
defects from your browser. Track and assess quality
throughout your testing lifecycle.
Azure Test Plans
Capture rich data
Capture rich scenario data as you execute tests to
make discovered defects actionable. Explore user
stories without test cases or test steps. You can
create test cases directly from your exploratory test
sessions.
Test across web and desktop
Test your application where it lives. Complete
scripted tests across desktop or web scenarios. Test
on-premises application from the cloud and vice-
versa.
Get end-to-end traceability
Leverage the same test tools across your engineers
and user acceptance testing stakeholders. Pay for the
tools only when you need them.
https://azure.com/devops➔
Create and share Maven, npm, and NuGet package
feeds from public and private sources – fully
integrated into CI/CD pipelines
Azure Artifacts
Manage all package types
Get universal artifact management for Maven, npm,
and NuGet.
Add packages to any pipeline
Share packages, and use built-in CI/CD, versioning,
and testing.
Share code efficiently
Easily share code across small teams and large
enterprises.
https://azure.com/devops➔
Azure DevOps Services Pricing
Free
Unlimited users and build time
• Azure Pipelines: 10 parallel jobs with
unlimited minutes for CI/CD
• Azure Boards: Work item tracking and
Kanban boards
• Azure Repos: Unlimited public Git repos
Free
Start free with up to 5 users
• Azure Pipelines: Run 1 Microsoft-hosted
job for 1,800 minutes per month and 1
self-hosted job for any amount of time
• Azure Boards: Work item tracking and
Kanban boards
• Azure Repos: Unlimited public Git repos
• Azure Artifacts: package management
• Unlimited stakeholders
Starts at $6
per user, per month for Boards & Repos*
Easy pricing that grows with your team
• Azure Pipelines: Run 1 Microsoft-hosted
job for 1,800 minutes per month and 1
self-hosted job for any amount of time
• Azure Boards: Work item tracking and
Kanban boards
• Azure Repos: Unlimited public Git repos
• Azure Artifacts: package management
• Unlimited stakeholders
• Boards & Repos included for Visual
Studio subscribers
https://azure.com/pricing/details/devops/➔
5 Boards & Repos users and 5 Artifacts users free. Pipelines
with unlimited minutes, Test Plans users and additional
Artifacts users also available. Please see the Azure pricing
calculator for details.
*
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{5.Hands-on LabBefore Lunch Break}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Registering the Model (via Notebook & Portal)
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup New Project in Azure DevOps
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup New Project in Azure DevOps
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Import Quickstart code from a GitHub Repo
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Import Quickstart code from a GitHub Repo
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Update the build YAML file
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Update the build YAML file
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Create New Service Connection
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Create New Service Connection
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Create New Service Connection
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup and Run the Build Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup and Run the Build Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup and Run the Build Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup and Run the Build Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup and Run the Build Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup and Run the Build Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{6.Hands-on LabAfterLunch Break}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup and Run the Build Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Review Build Outputs
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup the Release Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup the Release Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add the Build Artifact
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add the Build Artifact
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Variables to Deploy & Test stage
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Variables to Deploy & Test stage
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Variables to Deploy & Test stage
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup Agent Pool for Deploy & Test Stage
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Setup Agent Pool for Deploy & Test Stage
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Use Python Version Task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Use Python Version Task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Install Requirements Task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Install Requirements Task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Install Requirements Task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Install Requirements Task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Install Requirements Task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Deploy & Test Webservice task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Deploy & Test Webservice task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Deploy & Test Webservice task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Add Deploy & Test Webservice task
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Define Deployment Trigger
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Enable Continuous Deployment Trigger
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Save the Release Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Save the Release Pipeline
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{7.Test, Build, ReleasePipelines}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Test, Build, Release Pipelines
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Test, Build, Release Pipelines
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Test, Build, Release Pipelines
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Test, Build, Release Pipelines (~1 Hour+)
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
Test, Build, Release Pipelines (~1 Hour+)
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
{8.Q&A}
Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
© Microsoft Corporation
Thank You

More Related Content

What's hot

Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data PipelinesPutting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
DATAVERSITY
 
MLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at ScaleMLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at Scale
Databricks
 
Enterprise Data Architecture Deliverables
Enterprise Data Architecture DeliverablesEnterprise Data Architecture Deliverables
Enterprise Data Architecture Deliverables
Lars E Martinsson
 
Building-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWSBuilding-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWS
Amazon Web Services
 
Ml ops on AWS
Ml ops on AWSMl ops on AWS
Ml ops on AWS
PhilipBasford
 
Azure ML Studio
Azure ML StudioAzure ML Studio
Azure ML Studio
Vikas Sinha
 
AWS Glue - let's get stuck in!
AWS Glue - let's get stuck in!AWS Glue - let's get stuck in!
AWS Glue - let's get stuck in!
Chris Taylor
 
Data Mesh
Data MeshData Mesh
Vertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google CloudVertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Márton Kodok
 
Data as a Product by Wayne Eckerson
Data as a Product by Wayne EckersonData as a Product by Wayne Eckerson
Data as a Product by Wayne Eckerson
Zoomdata
 
Modernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureModernizing to a Cloud Data Architecture
Modernizing to a Cloud Data Architecture
Databricks
 
MLOps and Reproducible ML on AWS with Kubeflow and SageMaker
MLOps and Reproducible ML on AWS with Kubeflow and SageMakerMLOps and Reproducible ML on AWS with Kubeflow and SageMaker
MLOps and Reproducible ML on AWS with Kubeflow and SageMaker
Provectus
 
Data Architecture for Solutions.pdf
Data Architecture for Solutions.pdfData Architecture for Solutions.pdf
Data Architecture for Solutions.pdf
Alan McSweeney
 
Introduction to AWS Lake Formation.pptx
Introduction to AWS Lake Formation.pptxIntroduction to AWS Lake Formation.pptx
Introduction to AWS Lake Formation.pptx
SwathiPonugumati
 
Strategic Approach To Data Migration Project Plan
Strategic Approach To Data Migration Project PlanStrategic Approach To Data Migration Project Plan
Strategic Approach To Data Migration Project Plan
SlideTeam
 
Platform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on AzurePlatform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on Azure
WSO2
 
Moving to Databricks & Delta
Moving to Databricks & DeltaMoving to Databricks & Delta
Moving to Databricks & Delta
Databricks
 
Deploy and Govern at Scale with AWS Control Tower
Deploy and Govern at Scale with AWS Control TowerDeploy and Govern at Scale with AWS Control Tower
Deploy and Govern at Scale with AWS Control Tower
Amazon Web Services
 
Azure Data Engineering.pptx
Azure Data Engineering.pptxAzure Data Engineering.pptx
Azure Data Engineering.pptx
priyadharshini626440
 
What is MLOps
What is MLOpsWhat is MLOps
What is MLOps
Henrik Skogström
 

What's hot (20)

Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data PipelinesPutting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
Putting the Ops in DataOps: Orchestrate the Flow of Data Across Data Pipelines
 
MLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at ScaleMLOps Virtual Event: Automating ML at Scale
MLOps Virtual Event: Automating ML at Scale
 
Enterprise Data Architecture Deliverables
Enterprise Data Architecture DeliverablesEnterprise Data Architecture Deliverables
Enterprise Data Architecture Deliverables
 
Building-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWSBuilding-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWS
 
Ml ops on AWS
Ml ops on AWSMl ops on AWS
Ml ops on AWS
 
Azure ML Studio
Azure ML StudioAzure ML Studio
Azure ML Studio
 
AWS Glue - let's get stuck in!
AWS Glue - let's get stuck in!AWS Glue - let's get stuck in!
AWS Glue - let's get stuck in!
 
Data Mesh
Data MeshData Mesh
Data Mesh
 
Vertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google CloudVertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
Vertex AI - Unified ML Platform for the entire AI workflow on Google Cloud
 
Data as a Product by Wayne Eckerson
Data as a Product by Wayne EckersonData as a Product by Wayne Eckerson
Data as a Product by Wayne Eckerson
 
Modernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureModernizing to a Cloud Data Architecture
Modernizing to a Cloud Data Architecture
 
MLOps and Reproducible ML on AWS with Kubeflow and SageMaker
MLOps and Reproducible ML on AWS with Kubeflow and SageMakerMLOps and Reproducible ML on AWS with Kubeflow and SageMaker
MLOps and Reproducible ML on AWS with Kubeflow and SageMaker
 
Data Architecture for Solutions.pdf
Data Architecture for Solutions.pdfData Architecture for Solutions.pdf
Data Architecture for Solutions.pdf
 
Introduction to AWS Lake Formation.pptx
Introduction to AWS Lake Formation.pptxIntroduction to AWS Lake Formation.pptx
Introduction to AWS Lake Formation.pptx
 
Strategic Approach To Data Migration Project Plan
Strategic Approach To Data Migration Project PlanStrategic Approach To Data Migration Project Plan
Strategic Approach To Data Migration Project Plan
 
Platform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on AzurePlatform Strategy to Deliver Digital Experiences on Azure
Platform Strategy to Deliver Digital Experiences on Azure
 
Moving to Databricks & Delta
Moving to Databricks & DeltaMoving to Databricks & Delta
Moving to Databricks & Delta
 
Deploy and Govern at Scale with AWS Control Tower
Deploy and Govern at Scale with AWS Control TowerDeploy and Govern at Scale with AWS Control Tower
Deploy and Govern at Scale with AWS Control Tower
 
Azure Data Engineering.pptx
Azure Data Engineering.pptxAzure Data Engineering.pptx
Azure Data Engineering.pptx
 
What is MLOps
What is MLOpsWhat is MLOps
What is MLOps
 

Similar to [AI] ML Operationalization with Microsoft Azure

Azure DevOps Best Practices Webinar
Azure DevOps Best Practices WebinarAzure DevOps Best Practices Webinar
Azure DevOps Best Practices Webinar
Cambay Digital
 
MLOps in action
MLOps in actionMLOps in action
MLOps in action
Pieter de Bruin
 
Tour of Azure DevOps
Tour of Azure DevOpsTour of Azure DevOps
Tour of Azure DevOps
Callon Campbell
 
MLOps with Azure DevOps
MLOps with Azure DevOpsMLOps with Azure DevOps
MLOps with Azure DevOps
Marco Parenzan
 
DevOps para Open Source com Azure DevOps
DevOps para Open Source com Azure DevOpsDevOps para Open Source com Azure DevOps
DevOps para Open Source com Azure DevOps
Emmanuel Gomes Brandão
 
Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...
Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...
Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...
VMware Tanzu
 
Accelerate Spring Apps to Cloud at Scale
Accelerate Spring Apps to Cloud at ScaleAccelerate Spring Apps to Cloud at Scale
Accelerate Spring Apps to Cloud at Scale
Asir Selvasingh
 
Azure dev ops
Azure dev opsAzure dev ops
Azure dev ops
Swaminathan Vetri
 
[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps
Naoki (Neo) SATO
 
How Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivityHow Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivity
Ivan Porta
 
Azure DevOps työkalut - Roundtable 14.3.2019
Azure DevOps työkalut - Roundtable 14.3.2019Azure DevOps työkalut - Roundtable 14.3.2019
Azure DevOps työkalut - Roundtable 14.3.2019
Janne Mattila
 
DevOps lagos meetup
DevOps lagos meetupDevOps lagos meetup
DevOps lagos meetup
Ewere Diagboya
 
DevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-usDevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-us
eltonrodriguez11
 
Drive business outcomes using Azure Devops
Drive business outcomes using Azure DevopsDrive business outcomes using Azure Devops
Drive business outcomes using Azure Devops
Belatrix Software
 
Azure DevOps
Azure DevOpsAzure DevOps
Azure DevOps
Juan Fabian
 
Azure DevOps Day - Trivandrum
Azure DevOps Day - TrivandrumAzure DevOps Day - Trivandrum
Azure DevOps Day - Trivandrum
Amal Dev
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
Amazon Web Services
 
Azure DevOps Day - Kochi
Azure DevOps Day - KochiAzure DevOps Day - Kochi
Azure DevOps Day - Kochi
Amal Dev
 
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
Janusz Nowak
 

Similar to [AI] ML Operationalization with Microsoft Azure (20)

Azure DevOps Best Practices Webinar
Azure DevOps Best Practices WebinarAzure DevOps Best Practices Webinar
Azure DevOps Best Practices Webinar
 
MLOps in action
MLOps in actionMLOps in action
MLOps in action
 
Tour of Azure DevOps
Tour of Azure DevOpsTour of Azure DevOps
Tour of Azure DevOps
 
MLOps with Azure DevOps
MLOps with Azure DevOpsMLOps with Azure DevOps
MLOps with Azure DevOps
 
DevOps para Open Source com Azure DevOps
DevOps para Open Source com Azure DevOpsDevOps para Open Source com Azure DevOps
DevOps para Open Source com Azure DevOps
 
Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...
Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...
Accelerate Spring Apps to Cloud at Scale—Discussion with Azure Spring Cloud C...
 
Accelerate Spring Apps to Cloud at Scale
Accelerate Spring Apps to Cloud at ScaleAccelerate Spring Apps to Cloud at Scale
Accelerate Spring Apps to Cloud at Scale
 
Azure dev ops
Azure dev opsAzure dev ops
Azure dev ops
 
[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps[JAZUG Tohoku Azure DevOps] Azure DevOps
[JAZUG Tohoku Azure DevOps] Azure DevOps
 
How Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivityHow Azure DevOps can boost your organization's productivity
How Azure DevOps can boost your organization's productivity
 
Azure DevOps työkalut - Roundtable 14.3.2019
Azure DevOps työkalut - Roundtable 14.3.2019Azure DevOps työkalut - Roundtable 14.3.2019
Azure DevOps työkalut - Roundtable 14.3.2019
 
DevOps lagos meetup
DevOps lagos meetupDevOps lagos meetup
DevOps lagos meetup
 
Azure DevOps
Azure DevOpsAzure DevOps
Azure DevOps
 
DevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-usDevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-us
 
Drive business outcomes using Azure Devops
Drive business outcomes using Azure DevopsDrive business outcomes using Azure Devops
Drive business outcomes using Azure Devops
 
Azure DevOps
Azure DevOpsAzure DevOps
Azure DevOps
 
Azure DevOps Day - Trivandrum
Azure DevOps Day - TrivandrumAzure DevOps Day - Trivandrum
Azure DevOps Day - Trivandrum
 
DevOps on AWS
DevOps on AWSDevOps on AWS
DevOps on AWS
 
Azure DevOps Day - Kochi
Azure DevOps Day - KochiAzure DevOps Day - Kochi
Azure DevOps Day - Kochi
 
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
Continues Integration and Continuous Delivery with Azure DevOps - Deploy Anyt...
 

More from Korkrid Akepanidtaworn

Data Science & Analytics Talk @ ExxonMobil
Data Science & Analytics Talk @ ExxonMobilData Science & Analytics Talk @ ExxonMobil
Data Science & Analytics Talk @ ExxonMobil
Korkrid Akepanidtaworn
 
Dashboard in a Day
Dashboard in a DayDashboard in a Day
Dashboard in a Day
Korkrid Akepanidtaworn
 
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdfIntro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
Korkrid Akepanidtaworn
 
LSESU a Taste of R Language Workshop
LSESU a Taste of R Language WorkshopLSESU a Taste of R Language Workshop
LSESU a Taste of R Language Workshop
Korkrid Akepanidtaworn
 
Open Data, Open Opportunity, Open to Progress
Open Data, Open Opportunity, Open to ProgressOpen Data, Open Opportunity, Open to Progress
Open Data, Open Opportunity, Open to Progress
Korkrid Akepanidtaworn
 
Learning from Conversation with the Governor: Big Data Challenges for Bank of...
Learning from Conversation with the Governor: Big Data Challenges for Bank of...Learning from Conversation with the Governor: Big Data Challenges for Bank of...
Learning from Conversation with the Governor: Big Data Challenges for Bank of...
Korkrid Akepanidtaworn
 

More from Korkrid Akepanidtaworn (6)

Data Science & Analytics Talk @ ExxonMobil
Data Science & Analytics Talk @ ExxonMobilData Science & Analytics Talk @ ExxonMobil
Data Science & Analytics Talk @ ExxonMobil
 
Dashboard in a Day
Dashboard in a DayDashboard in a Day
Dashboard in a Day
 
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdfIntro to Azure OpenAI Service L100 (Thai Ver).pdf
Intro to Azure OpenAI Service L100 (Thai Ver).pdf
 
LSESU a Taste of R Language Workshop
LSESU a Taste of R Language WorkshopLSESU a Taste of R Language Workshop
LSESU a Taste of R Language Workshop
 
Open Data, Open Opportunity, Open to Progress
Open Data, Open Opportunity, Open to ProgressOpen Data, Open Opportunity, Open to Progress
Open Data, Open Opportunity, Open to Progress
 
Learning from Conversation with the Governor: Big Data Challenges for Bank of...
Learning from Conversation with the Governor: Big Data Challenges for Bank of...Learning from Conversation with the Governor: Big Data Challenges for Bank of...
Learning from Conversation with the Governor: Big Data Challenges for Bank of...
 

Recently uploaded

Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
Subhajit Sahu
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Subhajit Sahu
 
社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .
NABLAS株式会社
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
ocavb
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
TravisMalana
 
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
yhkoc
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
haila53
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
John Andrews
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
axoqas
 
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
NABLAS株式会社
 
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdfSample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Linda486226
 
SOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape ReportSOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape Report
SOCRadar
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
axoqas
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
ArpitMalhotra16
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
ewymefz
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
slg6lamcq
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
mbawufebxi
 
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
nscud
 
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
v3tuleee
 
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Subhajit Sahu
 

Recently uploaded (20)

Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
 
社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .社内勉強会資料_LLM Agents                              .
社内勉強会資料_LLM Agents                              .
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
 
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
一比一原版(CU毕业证)卡尔顿大学毕业证成绩单
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
 
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
【社内勉強会資料_Octo: An Open-Source Generalist Robot Policy】
 
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdfSample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
 
SOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape ReportSOCRadar Germany 2024 Threat Landscape Report
SOCRadar Germany 2024 Threat Landscape Report
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
 
standardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghhstandardisation of garbhpala offhgfffghh
standardisation of garbhpala offhgfffghh
 
一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单一比一原版(NYU毕业证)纽约大学毕业证成绩单
一比一原版(NYU毕业证)纽约大学毕业证成绩单
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
 
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
一比一原版(CBU毕业证)不列颠海角大学毕业证成绩单
 
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理一比一原版(UofS毕业证书)萨省大学毕业证如何办理
一比一原版(UofS毕业证书)萨省大学毕业证如何办理
 
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
 

[AI] ML Operationalization with Microsoft Azure

  • 1. ML Operationalization with Microsoft Azure Kyle Akepanidtaworn (Krid/Kyle) Cloud Solution Architect (Advanced Analytics & AI) Global Digital Transformation Partnerships Team Email | Linkedin | Quora | Medium | GitHub
  • 2. Learning Objectives In this workshop, you will learn: 1. To orchestrate and deploy updates to the application and the deep learning model in a unified way. 2. To design a DevOps pipeline to coordinate retrieving the latest best model from the model registry, packaging the web application, deploying the web application and inferencing web service. You will also learn how to monitor the model's performance after it is deployed so your startup can be proactive with performance issues. The target audience for the workshop includes: • Data Scientists • App Developers • AI Engineers • DevOps Engineers Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 3. {1.Let’s PlayandInteract} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 4. https://aka.ms/AA627pi Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 5. {2.Introduction ofMLOps} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 6. Machine Learning Across Microsoft Microsoft 365 Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 7. Machine Learning at Scale Monthly active Office 365 users, leveraging Office AI capabilities 180 Million Questions being asked on Cortana 18 Billion Number of signals analyzed on behalf of users to identify patterns of emerging threats daily 6.5 Trillion Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 8. But ML is hard! Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 9. Building a model Data ingestion Data analysis Data transformation Data validation Data splitting Trainer Model validation Training at scale LoggingRoll-out Serving Monitoring Machine Learning Process Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 10. E2E ML lifecycle Train Model Validate Model Deploy ModelPackage Model Monitor Model Retrain Model Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 11. MLOps = ML + DEV + OPS Experiment Data Acquisition Business Understanding Initial Modeling Develop Operate Continuous Delivery Data Feedback Loop System + Model Monitoring ML Modeling + Testing Continuous Integration Continuous Deployment Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 12. App developer using Azure DevOps Build appCollaborate Test app Release app Monitor app Model reproducibility Model retrainingModel deploymentModel validation Data scientist using Azure Machine Learning
  • 13. Code, dataset, and environment versioning Model reproducibility Model retrainingModel deploymentModel validation Build appCollaborate Test app Release app Monitor app App developer using Azure DevOps Data scientist using Azure Machine Learning
  • 14. Model reproducibility Model retrainingModel deploymentModel validation Automated ML ML Pipelines Hyperparameter tuning Train model Build appCollaborate Test app Release app Monitor app App developer using Azure DevOps Data scientist using Azure Machine Learning
  • 15. Model validation & certification Model reproducibility Model retrainingModel deploymentModel validation Train model Validate model Build appCollaborate Test app Release app Monitor app App developer using Azure DevOps Data scientist using Azure Machine Learning
  • 16. Model packaging Simple deployment Model reproducibility Model retrainingModel deploymentModel validation Train model Validate model Deploy model Build appCollaborate Test app Release app Monitor app App developer using Azure DevOps Data scientist using Azure Machine Learning
  • 17. Model management & monitoring Model performance analysis Model reproducibility Model retrainingModel deploymentModel validation Train model Validate model Deploy model Monitor model Retrain model Build appCollaborate Test app Release app Monitor app App developer using Azure DevOps Data scientist using Azure Machine Learning
  • 18. Train model Validate model Deploy model Monitor model Retrain model Model reproducibility Model retrainingModel deploymentModel validation Build appCollaborate Test app Release app Monitor app Azure DevOps integration App developer using Azure DevOps Data scientist using Azure Machine Learning
  • 19. MLOps Benefits 1. Reproducibility + Auditability • Code drives generation and deployments • Pipelines are reproducible and verifiable • All artifacts can be tagged and audited 2. Validation • SWE best practices for quality control • Offline comparisons of model quality • Minimize bias and enable explainability 3. Automation + Observability • Controlled rollout capabilities. • Live comparison of predicted vs. expected performance. • Results fed back to watch for drift and improve model. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 20. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 21. Azure MLOps Asset management & orchestration services to help manage the ML lifecycle. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 22. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 23. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 24. {3.Hands-on Workshop} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 25. https://aka.ms/AA610wt Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 26. {4.Before Hands-on Lab} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 27. Critical Requirements 1. Azure subscription. You will need a valid and active Azure account to complete the quickstarts. If you do not have one, you can sign up for a free trial. • The Microsoft Azure subscription must be pay-as-you-go or MSDN. • Trial subscriptions will not work. You will run into issues with Azure resource quota limits. • Subscriptions with access limited to a single resource group will not work. You will need the ability to deploy multiple resource groups. 2. Azure DevOps subscription. You will need a valid and active Azure DevOps account to complete the quickstarts. If you do not have one, you can sign up for a free account. (Please provision in “East US” to leverage GPU.) 3. Azure Notebooks. You will need an Azure Notebooks project to import the quickstart notebooks into. See instructions below on how to prepare your Azure Notebooks environment. (Please provision in “East US” to leverage GPU.) 4. Azure Machine Learning service workspace. (Please provision in “East US” to leverage GPU.) Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 28. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 29. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 31. Azure DevOps Deliver value to your users faster using proven agile tools to plan, track, and discuss work across your teams. Build, test, and deploy with CI/CD that works with any language, platform, and cloud. Connect to GitHub or any other Git provider and deploy continuously. Get unlimited, cloud-hosted private Git repos and collaborate to build better code with pull requests and advanced file management. Test and ship with confidence using manual and exploratory testing tools. Create, host, and share packages with your team, and add artifacts to your CI/CD pipelines with a single click. Azure Boards Azure ReposAzure Pipelines Azure Test Plans Azure Artifacts https://azure.com/devops ➔
  • 32. Cloud-hosted pipelines for Linux, Windows and macOS, with unlimited minutes for open source Azure Pipelines Any language, any platform, any cloud Build, test, and deploy Node.js, Python, 
Java, PHP, Ruby, C/C++, .NET, Android, and iOS apps. Run in parallel on Linux, macOS, and Windows. Deploy to Azure, AWS, GCP or on-premises Extensible Explore and implement a wide range of community- built build, test, and deployment tasks, along with hundreds of extensions from Slack to SonarCloud. Support for YAML, reporting and more Best-in-class for open source Ensure fast continuous integration/continuous delivery (CI/CD) pipelines for every open source project. Get unlimited build minutes for all open source projects with up to 10 free parallel jobs across Linux, macOS and Windows https://azure.com/pipelines➔ Containers and Kubernetes Easily build and push images to container registries like Docker Hub and Azure Container Registry. Deploy containers to individual hosts or Kubernetes.
  • 33. Track work with Kanban boards, backlogs, team dashboards, and custom reporting Azure Boards https://azure.com/devops➔ Connected from idea to release Track all your ideas at every development stage and keep your team aligned with all code changes linked directly to work items. Scrum ready Use built-in scrum boards and planning tools to help your teams run sprints, stand-ups, and planning meetings. Project insights Gain new insights into the health and status of your project with powerful analytics tools and dashboard widgets.
  • 34. Unlimited private Git repo hosting and support for TFVC that scales from a hobby project to the world’s largest Git repositories Azure Repos https://azure.com/devops➔ Works with your Git client Securely connect with and push code into your Git repos from any IDE, editor, or Git client. Web hooks and API integration Add validations and extensions from the marketplace or build your own using web hooks and REST APIs. Semantic code search Quickly find what you’re looking for with code-aware search that understands classes and variables.
  • 35. Get end-to-end traceability. Run tests and log defects from your browser. Track and assess quality throughout your testing lifecycle. Azure Test Plans Capture rich data Capture rich scenario data as you execute tests to make discovered defects actionable. Explore user stories without test cases or test steps. You can create test cases directly from your exploratory test sessions. Test across web and desktop Test your application where it lives. Complete scripted tests across desktop or web scenarios. Test on-premises application from the cloud and vice- versa. Get end-to-end traceability Leverage the same test tools across your engineers and user acceptance testing stakeholders. Pay for the tools only when you need them. https://azure.com/devops➔
  • 36. Create and share Maven, npm, and NuGet package feeds from public and private sources – fully integrated into CI/CD pipelines Azure Artifacts Manage all package types Get universal artifact management for Maven, npm, and NuGet. Add packages to any pipeline Share packages, and use built-in CI/CD, versioning, and testing. Share code efficiently Easily share code across small teams and large enterprises. https://azure.com/devops➔
  • 37. Azure DevOps Services Pricing Free Unlimited users and build time • Azure Pipelines: 10 parallel jobs with unlimited minutes for CI/CD • Azure Boards: Work item tracking and Kanban boards • Azure Repos: Unlimited public Git repos Free Start free with up to 5 users • Azure Pipelines: Run 1 Microsoft-hosted job for 1,800 minutes per month and 1 self-hosted job for any amount of time • Azure Boards: Work item tracking and Kanban boards • Azure Repos: Unlimited public Git repos • Azure Artifacts: package management • Unlimited stakeholders Starts at $6 per user, per month for Boards & Repos* Easy pricing that grows with your team • Azure Pipelines: Run 1 Microsoft-hosted job for 1,800 minutes per month and 1 self-hosted job for any amount of time • Azure Boards: Work item tracking and Kanban boards • Azure Repos: Unlimited public Git repos • Azure Artifacts: package management • Unlimited stakeholders • Boards & Repos included for Visual Studio subscribers https://azure.com/pricing/details/devops/➔ 5 Boards & Repos users and 5 Artifacts users free. Pipelines with unlimited minutes, Test Plans users and additional Artifacts users also available. Please see the Azure pricing calculator for details. *
  • 38. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 39. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 40. {5.Hands-on LabBefore Lunch Break} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 41. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 42. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 43. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 44. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 45. Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 46. Registering the Model (via Notebook & Portal) Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 47. Setup New Project in Azure DevOps Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 48. Setup New Project in Azure DevOps Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 49. Import Quickstart code from a GitHub Repo Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 50. Import Quickstart code from a GitHub Repo Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 51. Update the build YAML file Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 52. Update the build YAML file Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 53. Create New Service Connection Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 54. Create New Service Connection Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 55. Create New Service Connection Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 56. Setup and Run the Build Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 57. Setup and Run the Build Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 58. Setup and Run the Build Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 59. Setup and Run the Build Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 60. Setup and Run the Build Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 61. Setup and Run the Build Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 62. {6.Hands-on LabAfterLunch Break} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 63. Setup and Run the Build Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 64. Review Build Outputs Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 65. Setup the Release Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 66. Setup the Release Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 67. Add the Build Artifact Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 68. Add the Build Artifact Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 69. Add Variables to Deploy & Test stage Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 70. Add Variables to Deploy & Test stage Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 71. Add Variables to Deploy & Test stage Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 72. Setup Agent Pool for Deploy & Test Stage Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 73. Setup Agent Pool for Deploy & Test Stage Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 74. Add Use Python Version Task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 75. Add Use Python Version Task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 76. Add Install Requirements Task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 77. Add Install Requirements Task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 78. Add Install Requirements Task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 79. Add Install Requirements Task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 80. Add Install Requirements Task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 81. Add Deploy & Test Webservice task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 82. Add Deploy & Test Webservice task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 83. Add Deploy & Test Webservice task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 84. Add Deploy & Test Webservice task Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 85. Define Deployment Trigger Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 86. Enable Continuous Deployment Trigger Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 87. Save the Release Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 88. Save the Release Pipeline Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 89. {7.Test, Build, ReleasePipelines} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 90. Test, Build, Release Pipelines Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 91. Test, Build, Release Pipelines Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 92. Test, Build, Release Pipelines Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 93. Test, Build, Release Pipelines (~1 Hour+) Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 94. Test, Build, Release Pipelines (~1 Hour+) Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team
  • 95. {8.Q&A} Copyright (c) Microsoft Corporation. All rights reserved. @Korkrid Akepanidtaworn, GSMO Digital Transformation Partnerships Team