SlideShare a Scribd company logo
Pune Microsoft Azure Developers Meetup
 What , Why , & When of machine Learning?
 Types of Algorithms
 Tools & Technologies.
 What Azure ML has to offer?
 The Data Science Process.
 Demos
◦ Demos on R .
◦ Demos on Azure ML.
 Difference b/w classification & clustering
 Throwing algorithms at you .
 (Authur Samuel 1959). Field of study that gives computer
ability to learn without being explicitly programmed.
 (Tom Mitchell 1998 ). A Computer program is said to learn
from experience E with respected to task T and some
performance measure P , if its performance on T , as
measured by P , improves with Experience E.
 Watches user action as he/she marks a mail as spam or not
spam and then classifies the mail to the same categories.
 Here
 E :Watching a mail label as spam or not spam .
 T: Classifying emails is spam or not spam
 P: Fraction of mails correctly classified as spam or not
 Supervised Learning
◦ Most Common
◦ Right answers are already given.
◦ Regression problem : output Continuous value
 e.g..: Given a set of House size (in sq. ft) to Price , predict the price of a house
of x sq.ft.
 Given a large inventory to sales history , predict how many items will be sold
over the last 3 months
◦ Classification problem : output Discrete values
 e.g.: Given a set of tumor size to Malignant or benign cancer , predict if a
patient has cancer given the tumor size
 e.g.: Given a set of user account and history of user activities , predict if the
account is hacked or not .
◦ Can have many dimensions.
 Un-Supervised Learning
◦ Right answers are not given.
◦ Given a dataset , determine a structure in the data set.
◦ Clustering algorithms.
◦ http://news.google.co.in/
◦ Gnome problem
◦ Social network analysis.
◦ Customer Segmentation.
◦ Astronomical data analysis .
 Statistical tools
◦ R ( http://www.r-project.org/)
◦ Octave/MATLAB
◦ SAS
◦ Excel
◦ Weka
 Languages
◦ Python:
numpy/scipy/scikits-learn: http://scikit-learn.org/stable/
Orange :-http://www.ailab.si/orange/
MLPY :-https://mlpy.fbk.eu/
◦ Java:
Apache Mahout:- http://mahout.apache.org/
Weka:- http://www.cs.waikato.ac.nz/ml/w...
Malet:- http://mallet.cs.umass.edu
 Comparison of various languages being used in machine leaning
 Reference : Machine Learning Mastery
 A cloud based solution to all Machine learning requirements
for predictive analytics.
 All major algorithms available as drag and drop components.
 Built in R support
 Easy to deploy
 Publish your model as service.
 Azure ML market place.
Define a business problem
Acquire & Prepare data
Develop a Model
Train & Evaluate the
model
Deploy the Model
Relearn & Reevaluate the
Model
70-80% of work
is done here.
ML applies here
Get the data Data is Analyzed
Data is prepared for modelling
. Data Transformation (e.g.
Replace missing values, Data
Normalization ,etc.
Determine Relationship b/w
variables & Dimension
Reduction
Co-relation Analytics
,Principal Component
Analysis etc.
Identify the right variables
Database, CRM Systems,
Web Log files, etc.)
 Demos on R .
◦ Iris Dataset (UCI Machine Learning Repository)K-means clustering .
◦ Air quality (R dataset)  Liner & multiple Regression .
 Demos on Azure ML.
◦ News Recommendation System  K-means clustering .
◦ Linear Regression  Liner Regression .
 Problem Statement : Similar as google news.
◦ Fetch data from various news sites via RSS feeds , and try to group the news
item and suggest recommended posts for each news articles .
◦ http://rssnewsfeeds.azurewebsites.net/
◦ The meet up is about Azure , isn’t it ?
◦ Uses Azure Mobile Service for API & Web job support
◦ Uses Azure Table Storage for Data storage
◦ Uses Azure Machine learning to suggest recommended post.
◦ Uses Azure websites for the HTML client .
News Websites /
Blog posts , etc.
Azure Mobile
Services
Azure Table
Azure Machine
Learning
RSS Feeds
Html Client
Job
API
 Feature Hashing.
 Principal Component analysis.
 K-means Clustering.
 Classification :
◦ Supervised learning
◦ Used to define pre-defined tag to the instance on basis of features
◦ Required to train data
◦ Classify new instances
 Clustering :
◦ Unsupervised learning
◦ Used to group similar instances on basis of some features
◦ No data training required
◦ No predefined label to each & every group.
 Just visit Wikipedia .
 Classification
 Clustering
 Regression
 Simulation
 Content Analysis
 Recommendation Systems
Classification
Binary Classification
Logistic Regression
Neural Networks
Decision Trees
Boosted Decision trees
Clustering
K-means
Self organizing Maps
Adaptive Resonance theory
Regression
Gradient Descent
Linear Regression
Neural Networks
Decision Trees
Boosted Decision trees
Simulation
Markov Chain Analysis
Linear Programming
Monte Carlo simulation
Content Analysis
Recommendation Systems
Collaborative filtering
Market basket Analysis
Naïve Bayes
Microsoft Association Rules
Text mining
Natural Language
processing
Pattern Recognition
Neural Networks
 Machine Learning By Andrew Ng : Video Lectures
 Important Links
◦ http://machinelearningmastery.com/
◦ https://www.kaggle.com/
Thank You …

More Related Content

What's hot

Basics of Machine Learning
Basics of Machine LearningBasics of Machine Learning
Basics of Machine Learningbutest
 
Machine learning
Machine learningMachine learning
Machine learning
ADARSHMISHRA126
 
Machine learning
Machine learningMachine learning
Machine learning
eonx_32
 
An introduction to Machine Learning
An introduction to Machine LearningAn introduction to Machine Learning
An introduction to Machine Learningbutest
 
Intro/Overview on Machine Learning Presentation
Intro/Overview on Machine Learning PresentationIntro/Overview on Machine Learning Presentation
Intro/Overview on Machine Learning Presentation
Ankit Gupta
 
Machine Learning presentation.
Machine Learning presentation.Machine Learning presentation.
Machine Learning presentation.butest
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
Rabab Munawar
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
Rahul Kumar
 
Machine learning overview
Machine learning overviewMachine learning overview
Machine learning overview
prih_yah
 
Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...
Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...
Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...
Simplilearn
 
Machine learning ppt
Machine learning ppt Machine learning ppt
Machine learning ppt
Poojamanic
 
Machine Learning Basics
Machine Learning BasicsMachine Learning Basics
Machine Learning Basics
Suresh Arora
 
AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...
AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...
AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...
Edureka!
 
Types of Machine Learning
Types of Machine LearningTypes of Machine Learning
Types of Machine Learning
Samra Shahzadi
 
Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...
Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...
Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...
SlideTeam
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
Darshan Ambhaikar
 
Deep Learning With Neural Networks
Deep Learning With Neural NetworksDeep Learning With Neural Networks
Deep Learning With Neural Networks
Aniket Maurya
 
Deep learning
Deep learningDeep learning
Deep learning
Ratnakar Pandey
 
AI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete Deck
AI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete DeckAI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete Deck
AI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete Deck
SlideTeam
 
Introduction to ML (Machine Learning)
Introduction to ML (Machine Learning)Introduction to ML (Machine Learning)
Introduction to ML (Machine Learning)
SwatiTripathi44
 

What's hot (20)

Basics of Machine Learning
Basics of Machine LearningBasics of Machine Learning
Basics of Machine Learning
 
Machine learning
Machine learningMachine learning
Machine learning
 
Machine learning
Machine learningMachine learning
Machine learning
 
An introduction to Machine Learning
An introduction to Machine LearningAn introduction to Machine Learning
An introduction to Machine Learning
 
Intro/Overview on Machine Learning Presentation
Intro/Overview on Machine Learning PresentationIntro/Overview on Machine Learning Presentation
Intro/Overview on Machine Learning Presentation
 
Machine Learning presentation.
Machine Learning presentation.Machine Learning presentation.
Machine Learning presentation.
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Machine learning overview
Machine learning overviewMachine learning overview
Machine learning overview
 
Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...
Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...
Supervised and Unsupervised Learning In Machine Learning | Machine Learning T...
 
Machine learning ppt
Machine learning ppt Machine learning ppt
Machine learning ppt
 
Machine Learning Basics
Machine Learning BasicsMachine Learning Basics
Machine Learning Basics
 
AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...
AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...
AI vs Machine Learning vs Deep Learning | Machine Learning Training with Pyth...
 
Types of Machine Learning
Types of Machine LearningTypes of Machine Learning
Types of Machine Learning
 
Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...
Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...
Artificial Intelligence Machine Learning Deep Learning Ppt Powerpoint Present...
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Deep Learning With Neural Networks
Deep Learning With Neural NetworksDeep Learning With Neural Networks
Deep Learning With Neural Networks
 
Deep learning
Deep learningDeep learning
Deep learning
 
AI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete Deck
AI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete DeckAI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete Deck
AI Vs ML Vs DL PowerPoint Presentation Slide Templates Complete Deck
 
Introduction to ML (Machine Learning)
Introduction to ML (Machine Learning)Introduction to ML (Machine Learning)
Introduction to ML (Machine Learning)
 

Similar to Machine learning

Azure Machine Learning Dotnet Campus 2015
Azure Machine Learning Dotnet Campus 2015 Azure Machine Learning Dotnet Campus 2015
Azure Machine Learning Dotnet Campus 2015
antimo musone
 
PREDICT THE FUTURE , MACHINE LEARNING & BIG DATA
PREDICT THE FUTURE , MACHINE LEARNING & BIG DATAPREDICT THE FUTURE , MACHINE LEARNING & BIG DATA
PREDICT THE FUTURE , MACHINE LEARNING & BIG DATA
DotNetCampus
 
Net campus2015 antimomusone
Net campus2015 antimomusoneNet campus2015 antimomusone
Net campus2015 antimomusoneDotNetCampus
 
Nose Dive into Apache Spark ML
Nose Dive into Apache Spark MLNose Dive into Apache Spark ML
Nose Dive into Apache Spark ML
Ahmet Bulut
 
Identifying and classifying unknown Network Disruption
Identifying and classifying unknown Network DisruptionIdentifying and classifying unknown Network Disruption
Identifying and classifying unknown Network Disruption
jagan477830
 
Classification and Clustering
Classification and ClusteringClassification and Clustering
Classification and Clustering
Eng Teong Cheah
 
Datascience and Azure(v1.0)
Datascience and Azure(v1.0)Datascience and Azure(v1.0)
Datascience and Azure(v1.0)
Zenodia Charpy
 
Predicting Tweet Sentiment
Predicting Tweet SentimentPredicting Tweet Sentiment
Predicting Tweet Sentiment
Lucinda Linde
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Bhakthi Liyanage
 
Collab365 Empower-Your-Applications-With-Azure-Machine-Learning
Collab365 Empower-Your-Applications-With-Azure-Machine-LearningCollab365 Empower-Your-Applications-With-Azure-Machine-Learning
Collab365 Empower-Your-Applications-With-Azure-Machine-Learning
David Walker, CSM,CSD,MCP,MCAD,MCSD,MVP
 
Continuous delivery for machine learning
Continuous delivery for machine learningContinuous delivery for machine learning
Continuous delivery for machine learning
Rajesh Muppalla
 
Making Netflix Machine Learning Algorithms Reliable
Making Netflix Machine Learning Algorithms ReliableMaking Netflix Machine Learning Algorithms Reliable
Making Netflix Machine Learning Algorithms Reliable
Justin Basilico
 
Data ops: Machine Learning in production
Data ops: Machine Learning in productionData ops: Machine Learning in production
Data ops: Machine Learning in production
Stepan Pushkarev
 
Denver Dev Day - Smart Apps with Azure ML
Denver Dev Day - Smart Apps with Azure MLDenver Dev Day - Smart Apps with Azure ML
Denver Dev Day - Smart Apps with Azure ML
Chris McHenry
 
Data Science on Azure
Data Science on Azure Data Science on Azure
Data Science on Azure
Zenodia Charpy
 
introduction to machine learning
introduction to machine learningintroduction to machine learning
introduction to machine learning
Johnson Ubah
 
[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...
[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...
[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...
Amazon Web Services Korea
 
Ml ops on AWS
Ml ops on AWSMl ops on AWS
Ml ops on AWS
PhilipBasford
 
When We Spark and When We Don’t: Developing Data and ML Pipelines
When We Spark and When We Don’t: Developing Data and ML PipelinesWhen We Spark and When We Don’t: Developing Data and ML Pipelines
When We Spark and When We Don’t: Developing Data and ML Pipelines
Stitch Fix Algorithms
 
B4UConference_machine learning_deeplearning
B4UConference_machine learning_deeplearningB4UConference_machine learning_deeplearning
B4UConference_machine learning_deeplearning
Hoa Le
 

Similar to Machine learning (20)

Azure Machine Learning Dotnet Campus 2015
Azure Machine Learning Dotnet Campus 2015 Azure Machine Learning Dotnet Campus 2015
Azure Machine Learning Dotnet Campus 2015
 
PREDICT THE FUTURE , MACHINE LEARNING & BIG DATA
PREDICT THE FUTURE , MACHINE LEARNING & BIG DATAPREDICT THE FUTURE , MACHINE LEARNING & BIG DATA
PREDICT THE FUTURE , MACHINE LEARNING & BIG DATA
 
Net campus2015 antimomusone
Net campus2015 antimomusoneNet campus2015 antimomusone
Net campus2015 antimomusone
 
Nose Dive into Apache Spark ML
Nose Dive into Apache Spark MLNose Dive into Apache Spark ML
Nose Dive into Apache Spark ML
 
Identifying and classifying unknown Network Disruption
Identifying and classifying unknown Network DisruptionIdentifying and classifying unknown Network Disruption
Identifying and classifying unknown Network Disruption
 
Classification and Clustering
Classification and ClusteringClassification and Clustering
Classification and Clustering
 
Datascience and Azure(v1.0)
Datascience and Azure(v1.0)Datascience and Azure(v1.0)
Datascience and Azure(v1.0)
 
Predicting Tweet Sentiment
Predicting Tweet SentimentPredicting Tweet Sentiment
Predicting Tweet Sentiment
 
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
Integrating Azure Machine Learning and Predictive Analytics with SharePoint O...
 
Collab365 Empower-Your-Applications-With-Azure-Machine-Learning
Collab365 Empower-Your-Applications-With-Azure-Machine-LearningCollab365 Empower-Your-Applications-With-Azure-Machine-Learning
Collab365 Empower-Your-Applications-With-Azure-Machine-Learning
 
Continuous delivery for machine learning
Continuous delivery for machine learningContinuous delivery for machine learning
Continuous delivery for machine learning
 
Making Netflix Machine Learning Algorithms Reliable
Making Netflix Machine Learning Algorithms ReliableMaking Netflix Machine Learning Algorithms Reliable
Making Netflix Machine Learning Algorithms Reliable
 
Data ops: Machine Learning in production
Data ops: Machine Learning in productionData ops: Machine Learning in production
Data ops: Machine Learning in production
 
Denver Dev Day - Smart Apps with Azure ML
Denver Dev Day - Smart Apps with Azure MLDenver Dev Day - Smart Apps with Azure ML
Denver Dev Day - Smart Apps with Azure ML
 
Data Science on Azure
Data Science on Azure Data Science on Azure
Data Science on Azure
 
introduction to machine learning
introduction to machine learningintroduction to machine learning
introduction to machine learning
 
[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...
[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...
[AWS Innovate 온라인 컨퍼런스] 간단한 Python 코드만으로 높은 성능의 기계 학습 모델 만들기 - 김무현, AWS Sr.데이...
 
Ml ops on AWS
Ml ops on AWSMl ops on AWS
Ml ops on AWS
 
When We Spark and When We Don’t: Developing Data and ML Pipelines
When We Spark and When We Don’t: Developing Data and ML PipelinesWhen We Spark and When We Don’t: Developing Data and ML Pipelines
When We Spark and When We Don’t: Developing Data and ML Pipelines
 
B4UConference_machine learning_deeplearning
B4UConference_machine learning_deeplearningB4UConference_machine learning_deeplearning
B4UConference_machine learning_deeplearning
 

Recently uploaded

Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
Globus
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
vrstrong314
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
Globus
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
Peter Caitens
 
De mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FMEDe mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FME
Jelle | Nordend
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
Visitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.appVisitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.app
NaapbooksPrivateLimi
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Natan Silnitsky
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
abdulrafaychaudhry
 
Designing for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web ServicesDesigning for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web Services
KrzysztofKkol1
 
Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdf
Cyanic lab
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Globus
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
varshanayak241
 

Recently uploaded (20)

Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
 
De mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FMEDe mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FME
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Visitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.appVisitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.app
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBroker
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
 
Designing for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web ServicesDesigning for Privacy in Amazon Web Services
Designing for Privacy in Amazon Web Services
 
Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdf
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
 

Machine learning

  • 1. Pune Microsoft Azure Developers Meetup
  • 2.  What , Why , & When of machine Learning?  Types of Algorithms  Tools & Technologies.  What Azure ML has to offer?  The Data Science Process.  Demos ◦ Demos on R . ◦ Demos on Azure ML.  Difference b/w classification & clustering  Throwing algorithms at you .
  • 3.  (Authur Samuel 1959). Field of study that gives computer ability to learn without being explicitly programmed.  (Tom Mitchell 1998 ). A Computer program is said to learn from experience E with respected to task T and some performance measure P , if its performance on T , as measured by P , improves with Experience E.
  • 4.  Watches user action as he/she marks a mail as spam or not spam and then classifies the mail to the same categories.  Here  E :Watching a mail label as spam or not spam .  T: Classifying emails is spam or not spam  P: Fraction of mails correctly classified as spam or not
  • 5.  Supervised Learning ◦ Most Common ◦ Right answers are already given. ◦ Regression problem : output Continuous value  e.g..: Given a set of House size (in sq. ft) to Price , predict the price of a house of x sq.ft.  Given a large inventory to sales history , predict how many items will be sold over the last 3 months ◦ Classification problem : output Discrete values  e.g.: Given a set of tumor size to Malignant or benign cancer , predict if a patient has cancer given the tumor size  e.g.: Given a set of user account and history of user activities , predict if the account is hacked or not . ◦ Can have many dimensions.
  • 6.  Un-Supervised Learning ◦ Right answers are not given. ◦ Given a dataset , determine a structure in the data set. ◦ Clustering algorithms. ◦ http://news.google.co.in/ ◦ Gnome problem ◦ Social network analysis. ◦ Customer Segmentation. ◦ Astronomical data analysis .
  • 7.  Statistical tools ◦ R ( http://www.r-project.org/) ◦ Octave/MATLAB ◦ SAS ◦ Excel ◦ Weka  Languages ◦ Python: numpy/scipy/scikits-learn: http://scikit-learn.org/stable/ Orange :-http://www.ailab.si/orange/ MLPY :-https://mlpy.fbk.eu/ ◦ Java: Apache Mahout:- http://mahout.apache.org/ Weka:- http://www.cs.waikato.ac.nz/ml/w... Malet:- http://mallet.cs.umass.edu
  • 8.  Comparison of various languages being used in machine leaning  Reference : Machine Learning Mastery
  • 9.  A cloud based solution to all Machine learning requirements for predictive analytics.  All major algorithms available as drag and drop components.  Built in R support  Easy to deploy  Publish your model as service.  Azure ML market place.
  • 10. Define a business problem Acquire & Prepare data Develop a Model Train & Evaluate the model Deploy the Model Relearn & Reevaluate the Model 70-80% of work is done here. ML applies here
  • 11. Get the data Data is Analyzed Data is prepared for modelling . Data Transformation (e.g. Replace missing values, Data Normalization ,etc. Determine Relationship b/w variables & Dimension Reduction Co-relation Analytics ,Principal Component Analysis etc. Identify the right variables Database, CRM Systems, Web Log files, etc.)
  • 12.  Demos on R . ◦ Iris Dataset (UCI Machine Learning Repository)K-means clustering . ◦ Air quality (R dataset)  Liner & multiple Regression .  Demos on Azure ML. ◦ News Recommendation System  K-means clustering . ◦ Linear Regression  Liner Regression .
  • 13.  Problem Statement : Similar as google news. ◦ Fetch data from various news sites via RSS feeds , and try to group the news item and suggest recommended posts for each news articles . ◦ http://rssnewsfeeds.azurewebsites.net/ ◦ The meet up is about Azure , isn’t it ? ◦ Uses Azure Mobile Service for API & Web job support ◦ Uses Azure Table Storage for Data storage ◦ Uses Azure Machine learning to suggest recommended post. ◦ Uses Azure websites for the HTML client .
  • 14. News Websites / Blog posts , etc. Azure Mobile Services Azure Table Azure Machine Learning RSS Feeds Html Client Job API
  • 15.  Feature Hashing.  Principal Component analysis.  K-means Clustering.
  • 16.  Classification : ◦ Supervised learning ◦ Used to define pre-defined tag to the instance on basis of features ◦ Required to train data ◦ Classify new instances  Clustering : ◦ Unsupervised learning ◦ Used to group similar instances on basis of some features ◦ No data training required ◦ No predefined label to each & every group.
  • 17.  Just visit Wikipedia .  Classification  Clustering  Regression  Simulation  Content Analysis  Recommendation Systems
  • 18. Classification Binary Classification Logistic Regression Neural Networks Decision Trees Boosted Decision trees Clustering K-means Self organizing Maps Adaptive Resonance theory Regression Gradient Descent Linear Regression Neural Networks Decision Trees Boosted Decision trees Simulation Markov Chain Analysis Linear Programming Monte Carlo simulation Content Analysis Recommendation Systems Collaborative filtering Market basket Analysis Naïve Bayes Microsoft Association Rules Text mining Natural Language processing Pattern Recognition Neural Networks
  • 19.  Machine Learning By Andrew Ng : Video Lectures  Important Links ◦ http://machinelearningmastery.com/ ◦ https://www.kaggle.com/

Editor's Notes

  1. Auther Samuel :- Prepared a Checkers game program for determine a optimal game position over time. An email program watches a mail being marked as a spam or not a spam by the user .
  2. Cocktail party problem Two people counting numbers from 1 to 10 in two different languages simultaneously . Our job is to separate the two voices from each other . We would use clustering to solve this problem .