SlideShare a Scribd company logo
Deep Dive into Azure
Automated Machine
Learning
Vivek Raja P S
Student
Microsoft Certified Azure Data Scientist, AI Engineer, Data Engineer Associate
Source: Tribune India, May 31, 2020
A little about myself...
● From Tamil Nadu, India
● Final year CS Undergrad (2020)
● 5x Microsoft Certified
● Microsoft Certified Data Scientist Associate, AI
Engineer Associate, Data Engineer Associate, Azure
Fundamentals
● 15x Hackathon Winner
● Active Speaker and Mentor (AI & Cloud) - 30+ sessions
● Published 3 research papers, 1 patent (in review)
● Loves to play guitar and hardcore metal fan
Agenda
● Introduction to Machine Learning
● What is AutoML (Automated Machine Learning) ?
● AutoML versus Conventional ML practices
● Intro to Azure Automated Machine Learning
● Hands-on demo
● Learning resources
● Conclusion
Introduction to
Machine Learning
What is Machine Learning?
Machine learning (ML) is the process of using
mathematical models of data to help a computer
learn without direct instruction.
It’s considered a subset of artificial intelligence
(AI). Machine learning uses algorithms to identify
patterns within data, and those patterns are then
used to create a data model that can make
predictions.
What is Machine Learning?
To be put into simple words,
Machine Learning Techniques
Supervised learning (Input - Target pairs)
Addressing datasets with labels or structure, data acts as a teacher and “trains” the machine,
increasing in its ability to make a prediction or decision.
Unsupervised learning (Input data only)
Addressing datasets without any labels or structure, finding patterns and relationships by grouping
data into clusters.
Reinforcement learning (Reward/Penalty based learning)
Replacing the human operator, an agent—a computer program acting on behalf of someone or
something—helps determine outcome based upon a feedback loop.
Benefits of Machine Learning
● Uncover insight
● Improve data integrity
● Enhance user experience
● Reduce risk
● Anticipate customer behavior
● Lower costs
Overview of Stages in Machine Learning
Data Collection &
Preprocessing
● Identify data
source
● Data collection
● Data
Transformation
● Anomaly
Detection
● Cleaning the
data
● Domain
understanding
Train the model
● Splitting the data
● Selecting the
model
● Training
● Hyper-parameter
tuning
Validate the model
● Validating on test
dataset
● Evaluating results
● Finalising the data
model
Interpret the results
● Prediction
● Model monitoring
● Visualizations
What is AutoML?
(Automated Machine Learning)
What is AutoML?
Automated machine learning, also referred to as automated ML or
AutoML, is the process of automating the time consuming, iterative tasks
of machine learning model development. It allows data scientists, analysts,
and developers to build ML models with high scale, efficiency, and
productivity all while sustaining model quality.
AutoML process
AutoML
Vs
Conventional ML Practices
Benefits of AutoML
● Implement ML solutions without extensive
programming knowledge
● Save time and resources
● Leverage data science best practices
● Provide agile problem-solving
When to use AutoML?
● A non-programmer or non-professional data
scientist wants to leverage the power of ML
● Handling too complex data
● Lack of data domain knowledge
● Quick Implementation
● Building complex model with huge number of
parameters to finetune
Introduction to
Azure Automated
Machine Learning
How Azure AutoML works?
During training, Azure Machine Learning creates a number of pipelines in
parallel that try different algorithms and parameters for you.
The service iterates through ML algorithms paired with feature selections,
where each iteration produces a model with a training score.
The higher the score, the better the model is considered to "fit" your data.
It will stop once it hits the exit criteria defined in the experiment.
How Azure AutoML works?
Identify ML problem
and Platform
ML problem:
classification,
forecasting, or
regression
Platform:
Azure ML Studio
(limited code)
Python SDK
Data and
Compute
source
Data Source: Numpy
arrays or Pandas
dataframe
Compute Source:
local computer,
Azure Machine
Learning Computes,
remote VMs, or
Azure Databricks
dictumst. Mauri
s nec convallis quam
dolor at. Morbi iaculis
Config AutoML
parameters
Iterations over
different models,
hyperparameter
settings, advanced
preprocessing/featuri
zation, metrics
dictumst. Mauris nec
convallis quam dolor
at. Morbi iaculis nec
dolor lorem dapibus.
convallis quam dolor
at. Morbi iaculis nec
dolor lorem dapibus.
Submit the run
Logged run
information contains
metrics
The training run
produces a Python
serialized object
(.pkl file) that
contains the model
and data
preprocessing.
dictumst. Mauris nec
convallis quam dolor
at. Morbi iaculis nec
dolor lorem dapibus.
Steps to design Azure AutoML
Feature Engineering by Azure AutoML
Feature engineering is the process of using domain knowledge of the
data by eliminating overfitting and imbalanced data to create features that
help ML algorithms learn better
Automated machine learning featurization steps (feature normalization,
handling missing data, converting text to numeric, etc.) become part of the
underlying model. When using the model for predictions, the same
featurization steps applied during training are applied to your input data
automatically.
You can also add your own feature engineering technique
Ensemble Models
Hands on Demo
Learning Resources
Basics of Machine Learning: https://medium.com/@vivekraja98/machine-
learning-for-beginners-187178d1326d
https://azure.microsoft.com/en-us/overview/what-is-machine-learning-
platform/#:~:text=Machine%20learning%20(ML)%20is%20the,computer%20learn%
20without%20direct%20instruction.&text=Machine%20learning%20uses%20algorit
hms%20to,model%20that%20can%20make%20predictions.
Azure free account:
https://azure.microsoft.com/en-in/free/
Automated Machine Learning:
https://docs.microsoft.com/en-in/azure/machine-learning/concept-automated-
ml#how-automl-works
Open for QnA
Let’s connect
Email ID: vivekraja98@gmail.com
Linkedin: @Vivek Raja P S GitHub: @Vivek0712 Twitter: @vivekraja007

More Related Content

What's hot

Microsoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine LearningMicrosoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine Learning
Setu Chokshi
 
Real World End to End machine Learning Pipeline
Real World End to End machine Learning PipelineReal World End to End machine Learning Pipeline
Real World End to End machine Learning Pipeline
Srivatsan Srinivasan
 
Azure Cognitive Services Bring AI to your applications in 3 steps.pptx
Azure Cognitive Services Bring AI to your applications in 3 steps.pptxAzure Cognitive Services Bring AI to your applications in 3 steps.pptx
Azure Cognitive Services Bring AI to your applications in 3 steps.pptx
Luis Beltran
 
From Data Science to MLOps
From Data Science to MLOpsFrom Data Science to MLOps
From Data Science to MLOps
Carl W. Handlin
 
MLOps for production-level machine learning
MLOps for production-level machine learningMLOps for production-level machine learning
MLOps for production-level machine learning
cnvrg.io AI OS - Hands-on ML Workshops
 
Introduction to Azure Machine Learning
Introduction to Azure Machine LearningIntroduction to Azure Machine Learning
Introduction to Azure Machine Learning
Paul Prae
 
Azure Machine Learning
Azure Machine LearningAzure Machine Learning
Azure Machine Learning
Mostafa
 
Overview on Azure Machine Learning
Overview on Azure Machine LearningOverview on Azure Machine Learning
Overview on Azure Machine Learning
James Serra
 
Machine Learning & Amazon SageMaker
Machine Learning & Amazon SageMakerMachine Learning & Amazon SageMaker
Machine Learning & Amazon SageMaker
Amazon Web Services
 
Introduction to Sagemaker
Introduction to SagemakerIntroduction to Sagemaker
Introduction to Sagemaker
Amazon Web Services
 
Automatic Machine Learning, AutoML
Automatic Machine Learning, AutoMLAutomatic Machine Learning, AutoML
Automatic Machine Learning, AutoML
Himadri Mishra
 
MLOps - The Assembly Line of ML
MLOps - The Assembly Line of MLMLOps - The Assembly Line of ML
MLOps - The Assembly Line of ML
Jordan Birdsell
 
Apply MLOps at Scale by H&M
Apply MLOps at Scale by H&MApply MLOps at Scale by H&M
Apply MLOps at Scale by H&M
Databricks
 
Managing the Machine Learning Lifecycle with MLOps
Managing the Machine Learning Lifecycle with MLOpsManaging the Machine Learning Lifecycle with MLOps
Managing the Machine Learning Lifecycle with MLOps
Fatih Baltacı
 
MLOps and Data Quality: Deploying Reliable ML Models in Production
MLOps and Data Quality: Deploying Reliable ML Models in ProductionMLOps and Data Quality: Deploying Reliable ML Models in Production
MLOps and Data Quality: Deploying Reliable ML Models in Production
Provectus
 
Intro to Microsoft Cognitive Services
Intro to Microsoft Cognitive ServicesIntro to Microsoft Cognitive Services
Intro to Microsoft Cognitive Services
Amanda Lange
 
Azure AI platform - Automated ML workshop
Azure AI platform - Automated ML workshopAzure AI platform - Automated ML workshop
Azure AI platform - Automated ML workshop
Parashar Shah
 
The Evolution of AutoML
The Evolution of AutoMLThe Evolution of AutoML
The Evolution of AutoML
Ning Jiang
 
MLOps Bridging the gap between Data Scientists and Ops.
MLOps Bridging the gap between Data Scientists and Ops.MLOps Bridging the gap between Data Scientists and Ops.
MLOps Bridging the gap between Data Scientists and Ops.
Knoldus Inc.
 
Machine Learning: Applications, Process and Techniques
Machine Learning: Applications, Process and TechniquesMachine Learning: Applications, Process and Techniques
Machine Learning: Applications, Process and Techniques
Rui Pedro Paiva
 

What's hot (20)

Microsoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine LearningMicrosoft Introduction to Automated Machine Learning
Microsoft Introduction to Automated Machine Learning
 
Real World End to End machine Learning Pipeline
Real World End to End machine Learning PipelineReal World End to End machine Learning Pipeline
Real World End to End machine Learning Pipeline
 
Azure Cognitive Services Bring AI to your applications in 3 steps.pptx
Azure Cognitive Services Bring AI to your applications in 3 steps.pptxAzure Cognitive Services Bring AI to your applications in 3 steps.pptx
Azure Cognitive Services Bring AI to your applications in 3 steps.pptx
 
From Data Science to MLOps
From Data Science to MLOpsFrom Data Science to MLOps
From Data Science to MLOps
 
MLOps for production-level machine learning
MLOps for production-level machine learningMLOps for production-level machine learning
MLOps for production-level machine learning
 
Introduction to Azure Machine Learning
Introduction to Azure Machine LearningIntroduction to Azure Machine Learning
Introduction to Azure Machine Learning
 
Azure Machine Learning
Azure Machine LearningAzure Machine Learning
Azure Machine Learning
 
Overview on Azure Machine Learning
Overview on Azure Machine LearningOverview on Azure Machine Learning
Overview on Azure Machine Learning
 
Machine Learning & Amazon SageMaker
Machine Learning & Amazon SageMakerMachine Learning & Amazon SageMaker
Machine Learning & Amazon SageMaker
 
Introduction to Sagemaker
Introduction to SagemakerIntroduction to Sagemaker
Introduction to Sagemaker
 
Automatic Machine Learning, AutoML
Automatic Machine Learning, AutoMLAutomatic Machine Learning, AutoML
Automatic Machine Learning, AutoML
 
MLOps - The Assembly Line of ML
MLOps - The Assembly Line of MLMLOps - The Assembly Line of ML
MLOps - The Assembly Line of ML
 
Apply MLOps at Scale by H&M
Apply MLOps at Scale by H&MApply MLOps at Scale by H&M
Apply MLOps at Scale by H&M
 
Managing the Machine Learning Lifecycle with MLOps
Managing the Machine Learning Lifecycle with MLOpsManaging the Machine Learning Lifecycle with MLOps
Managing the Machine Learning Lifecycle with MLOps
 
MLOps and Data Quality: Deploying Reliable ML Models in Production
MLOps and Data Quality: Deploying Reliable ML Models in ProductionMLOps and Data Quality: Deploying Reliable ML Models in Production
MLOps and Data Quality: Deploying Reliable ML Models in Production
 
Intro to Microsoft Cognitive Services
Intro to Microsoft Cognitive ServicesIntro to Microsoft Cognitive Services
Intro to Microsoft Cognitive Services
 
Azure AI platform - Automated ML workshop
Azure AI platform - Automated ML workshopAzure AI platform - Automated ML workshop
Azure AI platform - Automated ML workshop
 
The Evolution of AutoML
The Evolution of AutoMLThe Evolution of AutoML
The Evolution of AutoML
 
MLOps Bridging the gap between Data Scientists and Ops.
MLOps Bridging the gap between Data Scientists and Ops.MLOps Bridging the gap between Data Scientists and Ops.
MLOps Bridging the gap between Data Scientists and Ops.
 
Machine Learning: Applications, Process and Techniques
Machine Learning: Applications, Process and TechniquesMachine Learning: Applications, Process and Techniques
Machine Learning: Applications, Process and Techniques
 

Similar to Getting Started with Azure AutoML

Aws autopilot
Aws autopilotAws autopilot
Aws autopilot
Vivek Raja P S
 
Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019
Marco Zamana
 
Machine learning
Machine learningMachine learning
Machine learning
Saravanan Subburayal
 
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 -  Automated ML - Panagiotis PapaemmanouilGDG DEvFest Hellas 2020 -  Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis Papaemmanouil
Panagiotis Papaemmanouil
 
Walk through of azure machine learning studio new features
Walk through of azure machine learning studio new featuresWalk through of azure machine learning studio new features
Walk through of azure machine learning studio new features
Luca Zavarella
 
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Luca Zavarella
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Bhakthi Liyanage
 
201909 Automated ML for Developers
201909 Automated ML for Developers201909 Automated ML for Developers
201909 Automated ML for Developers
Mark Tabladillo
 
AI hype or reality
AI  hype or realityAI  hype or reality
AI hype or reality
Awantik Das
 
201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0
Mark Tabladillo
 
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Andrew Ly
 
Machine Learning Contents.pptx
Machine Learning Contents.pptxMachine Learning Contents.pptx
Machine Learning Contents.pptx
Naveenkushwaha18
 
DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)
Jasjeet Thind
 
Webinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para MicrocontroladoresWebinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para Microcontroladores
Embarcados
 
Lecture-6-7.pptx
Lecture-6-7.pptxLecture-6-7.pptx
Lecture-6-7.pptx
JohnMichaelPadernill
 
Machine learning for sensor Data Analytics
Machine learning for sensor Data AnalyticsMachine learning for sensor Data Analytics
Machine learning for sensor Data Analytics
MATLABISRAEL
 
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfSlides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
vitm11
 
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in PracticeGDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
James Anderson
 
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmeaIntroduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Sandesh Rao
 
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEAIntroduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Sandesh Rao
 

Similar to Getting Started with Azure AutoML (20)

Aws autopilot
Aws autopilotAws autopilot
Aws autopilot
 
Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019Automated machine learning - Global AI night 2019
Automated machine learning - Global AI night 2019
 
Machine learning
Machine learningMachine learning
Machine learning
 
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 -  Automated ML - Panagiotis PapaemmanouilGDG DEvFest Hellas 2020 -  Automated ML - Panagiotis Papaemmanouil
GDG DEvFest Hellas 2020 - Automated ML - Panagiotis Papaemmanouil
 
Walk through of azure machine learning studio new features
Walk through of azure machine learning studio new featuresWalk through of azure machine learning studio new features
Walk through of azure machine learning studio new features
 
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
Unleashing the Power of Machine Learning Prototyping Using Azure AutoML and P...
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
 
201909 Automated ML for Developers
201909 Automated ML for Developers201909 Automated ML for Developers
201909 Automated ML for Developers
 
AI hype or reality
AI  hype or realityAI  hype or reality
AI hype or reality
 
201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0
 
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
Summit Australia 2019 - Supercharge PowerPlatform with AI - Dipankar Bhattach...
 
Machine Learning Contents.pptx
Machine Learning Contents.pptxMachine Learning Contents.pptx
Machine Learning Contents.pptx
 
DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)DevOps and Machine Learning (Geekwire Cloud Tech Summit)
DevOps and Machine Learning (Geekwire Cloud Tech Summit)
 
Webinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para MicrocontroladoresWebinar: Machine Learning para Microcontroladores
Webinar: Machine Learning para Microcontroladores
 
Lecture-6-7.pptx
Lecture-6-7.pptxLecture-6-7.pptx
Lecture-6-7.pptx
 
Machine learning for sensor Data Analytics
Machine learning for sensor Data AnalyticsMachine learning for sensor Data Analytics
Machine learning for sensor Data Analytics
 
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdfSlides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
Slides-Артем Коваль-Cloud-Native MLOps Framework - DataFest 2021.pdf
 
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in PracticeGDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
GDG Cloud Southlake #3 Charles Adetiloye: Enterprise MLOps in Practice
 
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmeaIntroduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
Introduction to Machine learning - DBA's to data scientists - Oct 2020 - OGBEmea
 
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEAIntroduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
 

More from Vivek Raja P S

Model Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model AnalysisModel Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model Analysis
Vivek Raja P S
 
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Vivek Raja P S
 
Getting Started with Containers
Getting Started with ContainersGetting Started with Containers
Getting Started with Containers
Vivek Raja P S
 
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Vivek Raja P S
 
Tensorflow Ecosystem
Tensorflow EcosystemTensorflow Ecosystem
Tensorflow Ecosystem
Vivek Raja P S
 
Strategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any HackathonStrategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any Hackathon
Vivek Raja P S
 
AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19
Vivek Raja P S
 

More from Vivek Raja P S (7)

Model Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model AnalysisModel Drift Monitoring using Tensorflow Model Analysis
Model Drift Monitoring using Tensorflow Model Analysis
 
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
Literature Text Translation & Audio Synthesis using Microsoft Azure Cognitive...
 
Getting Started with Containers
Getting Started with ContainersGetting Started with Containers
Getting Started with Containers
 
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
Detecting and Visualizing Twitter Sentiment during COVID-19 Pandemic using AW...
 
Tensorflow Ecosystem
Tensorflow EcosystemTensorflow Ecosystem
Tensorflow Ecosystem
 
Strategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any HackathonStrategies and Roadmap to win any Hackathon
Strategies and Roadmap to win any Hackathon
 
AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19AI/ ML solutions to tackle COVID-19
AI/ ML solutions to tackle COVID-19
 

Recently uploaded

Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
Pixlogix Infotech
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 

Recently uploaded (20)

Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 

Getting Started with Azure AutoML

  • 1. Deep Dive into Azure Automated Machine Learning Vivek Raja P S Student Microsoft Certified Azure Data Scientist, AI Engineer, Data Engineer Associate
  • 2. Source: Tribune India, May 31, 2020
  • 3. A little about myself... ● From Tamil Nadu, India ● Final year CS Undergrad (2020) ● 5x Microsoft Certified ● Microsoft Certified Data Scientist Associate, AI Engineer Associate, Data Engineer Associate, Azure Fundamentals ● 15x Hackathon Winner ● Active Speaker and Mentor (AI & Cloud) - 30+ sessions ● Published 3 research papers, 1 patent (in review) ● Loves to play guitar and hardcore metal fan
  • 4. Agenda ● Introduction to Machine Learning ● What is AutoML (Automated Machine Learning) ? ● AutoML versus Conventional ML practices ● Intro to Azure Automated Machine Learning ● Hands-on demo ● Learning resources ● Conclusion
  • 6. What is Machine Learning? Machine learning (ML) is the process of using mathematical models of data to help a computer learn without direct instruction. It’s considered a subset of artificial intelligence (AI). Machine learning uses algorithms to identify patterns within data, and those patterns are then used to create a data model that can make predictions.
  • 7. What is Machine Learning? To be put into simple words,
  • 8. Machine Learning Techniques Supervised learning (Input - Target pairs) Addressing datasets with labels or structure, data acts as a teacher and “trains” the machine, increasing in its ability to make a prediction or decision. Unsupervised learning (Input data only) Addressing datasets without any labels or structure, finding patterns and relationships by grouping data into clusters. Reinforcement learning (Reward/Penalty based learning) Replacing the human operator, an agent—a computer program acting on behalf of someone or something—helps determine outcome based upon a feedback loop.
  • 9. Benefits of Machine Learning ● Uncover insight ● Improve data integrity ● Enhance user experience ● Reduce risk ● Anticipate customer behavior ● Lower costs
  • 10. Overview of Stages in Machine Learning Data Collection & Preprocessing ● Identify data source ● Data collection ● Data Transformation ● Anomaly Detection ● Cleaning the data ● Domain understanding Train the model ● Splitting the data ● Selecting the model ● Training ● Hyper-parameter tuning Validate the model ● Validating on test dataset ● Evaluating results ● Finalising the data model Interpret the results ● Prediction ● Model monitoring ● Visualizations
  • 11. What is AutoML? (Automated Machine Learning)
  • 12. What is AutoML? Automated machine learning, also referred to as automated ML or AutoML, is the process of automating the time consuming, iterative tasks of machine learning model development. It allows data scientists, analysts, and developers to build ML models with high scale, efficiency, and productivity all while sustaining model quality.
  • 15. Benefits of AutoML ● Implement ML solutions without extensive programming knowledge ● Save time and resources ● Leverage data science best practices ● Provide agile problem-solving
  • 16. When to use AutoML? ● A non-programmer or non-professional data scientist wants to leverage the power of ML ● Handling too complex data ● Lack of data domain knowledge ● Quick Implementation ● Building complex model with huge number of parameters to finetune
  • 18. How Azure AutoML works? During training, Azure Machine Learning creates a number of pipelines in parallel that try different algorithms and parameters for you. The service iterates through ML algorithms paired with feature selections, where each iteration produces a model with a training score. The higher the score, the better the model is considered to "fit" your data. It will stop once it hits the exit criteria defined in the experiment.
  • 20. Identify ML problem and Platform ML problem: classification, forecasting, or regression Platform: Azure ML Studio (limited code) Python SDK Data and Compute source Data Source: Numpy arrays or Pandas dataframe Compute Source: local computer, Azure Machine Learning Computes, remote VMs, or Azure Databricks dictumst. Mauri s nec convallis quam dolor at. Morbi iaculis Config AutoML parameters Iterations over different models, hyperparameter settings, advanced preprocessing/featuri zation, metrics dictumst. Mauris nec convallis quam dolor at. Morbi iaculis nec dolor lorem dapibus. convallis quam dolor at. Morbi iaculis nec dolor lorem dapibus. Submit the run Logged run information contains metrics The training run produces a Python serialized object (.pkl file) that contains the model and data preprocessing. dictumst. Mauris nec convallis quam dolor at. Morbi iaculis nec dolor lorem dapibus. Steps to design Azure AutoML
  • 21. Feature Engineering by Azure AutoML Feature engineering is the process of using domain knowledge of the data by eliminating overfitting and imbalanced data to create features that help ML algorithms learn better Automated machine learning featurization steps (feature normalization, handling missing data, converting text to numeric, etc.) become part of the underlying model. When using the model for predictions, the same featurization steps applied during training are applied to your input data automatically. You can also add your own feature engineering technique
  • 24. Learning Resources Basics of Machine Learning: https://medium.com/@vivekraja98/machine- learning-for-beginners-187178d1326d https://azure.microsoft.com/en-us/overview/what-is-machine-learning- platform/#:~:text=Machine%20learning%20(ML)%20is%20the,computer%20learn% 20without%20direct%20instruction.&text=Machine%20learning%20uses%20algorit hms%20to,model%20that%20can%20make%20predictions. Azure free account: https://azure.microsoft.com/en-in/free/ Automated Machine Learning: https://docs.microsoft.com/en-in/azure/machine-learning/concept-automated- ml#how-automl-works
  • 26. Let’s connect Email ID: vivekraja98@gmail.com Linkedin: @Vivek Raja P S GitHub: @Vivek0712 Twitter: @vivekraja007