• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Introduction to Machine Learning
 

Introduction to Machine Learning

on

  • 1,293 views

Tiberio Caetano, NICTA

Tiberio Caetano, NICTA
Meetup #1, 23 Feb 2012 - http://sydney.bigdataaustralia.com.au/events/49103992/

Statistics

Views

Total Views
1,293
Views on SlideShare
1,293
Embed Views
0

Actions

Likes
2
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Introduction to Machine Learning Introduction to Machine Learning Presentation Transcript

    • Introduction to Machine Learning Tiberio Caetano NICTA and Australian National UniversityFriday, 24 February 2012
    • Friday, 24 February 2012
    • Quick calibration:Friday, 24 February 2012
    • Quick calibration: Who has heard of Machine Learning?Friday, 24 February 2012
    • Quick calibration: Who has heard of Machine Learning? Who has used Machine Learning?Friday, 24 February 2012
    • Quick calibration: Who has heard of Machine Learning? Who has used Machine Learning? Who has built new Machine Learning tools?Friday, 24 February 2012
    • PROBLEM: DATA ACTIONABLE KNOWLEDGE That’s roughly the problem Machine Learning addressesFriday, 24 February 2012
    • BLUE: DATA RED: KNOWLEDGE - Is this email spam or not spam? - Is there a face in this picture? - Should I lend money to this customer given his spending behaviour?Friday, 24 February 2012
    • Knowledge is not concrete “Face” is an abstraction “Spam” is an abstraction “Who to lend to” is an abstraction You don’t find faces, spam or financial advice in datasets you just find bitsFriday, 24 February 2012
    • ? We have data But we want abstractionsFriday, 24 February 2012
    • What is an abstraction anyway? • Anything whose description does not depend exclusively on the bits you have • Notion of generalisation is fundamental • Abstraction always involves assumptionsFriday, 24 February 2012
    • Ready to define Machine Learning: • Machine Learning is the science of automating the process of abstraction from raw data and assumptions Raw Data Machine Learning Abstraction AssumptionsFriday, 24 February 2012
    • Data: (painted image) + (dataset of normal images) + Assumption: the non-painted parts of the painted image behave as the images in the datasetFriday, 24 February 2012
    • Data: (painted image) + (dataset of normal images) + Assumption: the non-painted parts of the painted image behave as the images in the dataset Abstraction: corrected imageFriday, 24 February 2012
    • Several forms of abstraction Cluster data Classify data Predict from data Summarise data Decide based on data etc...Friday, 24 February 2012
    • (e) Ground Truth Clustering (i) Ground Truth Figure 2: Resulting motion based algorithms. 2(a)-2(d) [10] S. M. Goldfeld and R http://home.dei.polimi.it/matteucc/ Holland Publishing C Clustering/tutorial_html/ [11] D. W. Hosmer. Maxim lines. In CommunicatiFriday, 24 February 2012
    • Dimensionality Reduction and Visualization http://isomap.stanford.edu/datasets.htmlFriday, 24 February 2012
    • RegressionFriday, 24 February 2012
    • Classification {spam; not spam} {0,1,2,3,4,5,6,7,8,9}Friday, 24 February 2012
    • Structured Prediction Image Understanding Protein Structure Prediction Machine Translation Image credit: S. GouldFriday, 24 February 2012
    • Structured Prediction Chess, NY, Kasparov, WTC Kangaroo, Sun, Sea, AustraliaFriday, 24 February 2012
    • What Machine Learning IS NOTFriday, 24 February 2012
    • What Machine Learning IS NOT Find 01001000:Friday, 24 February 2012
    • What Machine Learning IS NOT Find 01001000: Machine Learning is not exact pattern matchingFriday, 24 February 2012
    • What Machine Learning IS NOT Find 01001000: Machine Learning is not exact pattern matching This is “just” classical computer science classical “database query”, deductionFriday, 24 February 2012
    • What Machine Learning IS NOT Find 01001000: Machine Learning is not exact pattern matching This is “just” classical computer science classical “database query”, deduction Machine Learning involves inductionFriday, 24 February 2012
    • But Machine Learning IS NOT classical statistics eitherFriday, 24 February 2012
    • But Machine Learning IS NOT classical statistics either - Complex rather than simple models (forget Gaussianity, forget linearity) - Numerical rather than analytical solution (forget pencil-and-paper: need hardcore numerical optimization) - VERY High rather than low dimensional (p>>n rather than n>>p)Friday, 24 February 2012
    • Some popular technologies driven by Machine Learning Recommender SystemsFriday, 24 February 2012
    • Some popular technologies driven by Machine Learning Social mediaFriday, 24 February 2012
    • Big Data and Machine Learning Parallelism is crucial - Linear algebraic approaches favoured (matrix multiplication-based) - Much of Feature Extraction can be parallelised - Model Training is another story: usually needs syncingFriday, 24 February 2012
    • Machine Learning and Data Mining Data Mining is a buzzword and in that sense it includes Machine Learning In a more strict sense, Data Mining is often associated to data analysis without necessarily doing predictive analytics (which is the hallmark of Machine Learning)Friday, 24 February 2012
    • When is Machine Learning helpful? DATA ACTIONABLE KNOWLEDGE When you don’t really know how to find an explicit (at the bit-level) description for your abstraction or “actionable knowledge”Friday, 24 February 2012
    • When is Machine Learning helpful? DATA ACTIONABLE KNOWLEDGE When you don’t really know how to find an explicit (at the bit-level) description for your abstraction or “actionable knowledge” And this is common!!Friday, 24 February 2012
    • http://tiberiocaetano.com http://www.nicta.com.au/research/machine_learningFriday, 24 February 2012