0
Machine Learning for Data Mining
Data Mining and Text Mining (UIC 583 @ Politecnico)
Lecture outline                           2



  What is Machine Learning?
  What are the paradigm?
    Unsupervised Learn...
What is
Machine Learning?
What is Machine Learning?                        4



  “The field of machine learning is concerned with the question
  of...
Example: checkers                             5



  Task T: playing checkers

  Artificial Intelligence
     Design and i...
Examples                                      6



  A checker learning problem
     Task T: playing checkers
     Perform...
Example                                        7



  A robot driving learning problem
     Task T: driving on public four...
Unsupervised
Learning
9




Prof. Pier Luca Lanzi
What is unsupervised learning?                    10



  Task T: finding interesting groups into data,
  learning “what n...
Supervised
Learning
What is an apple?                           12




                    Prof. Pier Luca Lanzi
What is an apple?                           13




                    Prof. Pier Luca Lanzi
Are these apples?                           14




                    Prof. Pier Luca Lanzi
What is supervised learning?                   15



  Training experience E: examples labeled by a supervisor

  Task T: ...
Reinforcement
Learning
What is Reinforcement Learning?                         17




                                     Agent

               ...
What is reinforcement learning?                 18



  Training experience E: online interactions with the
  environment
...
Machine Learning
& Data Mining
Algorithms, Paradigms, Applications                     20




 Applications
      Agents                                P...
Machine Learning and Data Mining              21



  Machine learning algorithms acquire structural
  descriptions from e...
Upcoming SlideShare
Loading in...5
×

Lecture 02 Machine Learning For Data Mining

3,547

Published on

Course Data Mining and Text Mining

2007/2008
Prof. Pier Luca Lanzi
Politecnico di Milano

Machine Learning for Data Mining

Published in: Technology, Education
0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,547
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
304
Comments
0
Likes
5
Embeds 0
No embeds

No notes for slide

Transcript of "Lecture 02 Machine Learning For Data Mining"

  1. 1. Machine Learning for Data Mining Data Mining and Text Mining (UIC 583 @ Politecnico)
  2. 2. Lecture outline 2 What is Machine Learning? What are the paradigm? Unsupervised Learning Supervised Learning Reinforcement Learning Prof. Pier Luca Lanzi
  3. 3. What is Machine Learning?
  4. 4. What is Machine Learning? 4 “The field of machine learning is concerned with the question of how to construct computer programs that automatically improve with experience.” Tom Mitchell (1997) A program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E. A well-defined learning task is defined by P, T, and E. Prof. Pier Luca Lanzi
  5. 5. Example: checkers 5 Task T: playing checkers Artificial Intelligence Design and implement a computer-based system that exhibit intelligent action Machine Learning Write a program that can learn how to play It can learn from examples of previous games, by playing against another opponent, by playing against itself Prof. Pier Luca Lanzi
  6. 6. Examples 6 A checker learning problem Task T: playing checkers Performance P: percent of games won against opponents Training experience E: playing practice games A handwriting recognition learning problem Task T: recognizing and classifying handwritten words withing images Performance P: percent of words correctly classified Training experience E: a database of handwritten words with given classification Prof. Pier Luca Lanzi
  7. 7. Example 7 A robot driving learning problem Task T: driving on public four-lane highways using vision Performance P: average distance traveled before an error Training experience E: a sequence of images and steering commands recorded while observing a human driver Prof. Pier Luca Lanzi
  8. 8. Unsupervised Learning
  9. 9. 9 Prof. Pier Luca Lanzi
  10. 10. What is unsupervised learning? 10 Task T: finding interesting groups into data, learning “what normally happens” Performance P: how good, how interesting the groups are Training experience E: raw data Example applications Customer segmentation in CRM Color quantization for image compression, Bioinformatics Prof. Pier Luca Lanzi
  11. 11. Supervised Learning
  12. 12. What is an apple? 12 Prof. Pier Luca Lanzi
  13. 13. What is an apple? 13 Prof. Pier Luca Lanzi
  14. 14. Are these apples? 14 Prof. Pier Luca Lanzi
  15. 15. What is supervised learning? 15 Training experience E: examples labeled by a supervisor Task T: to extract a description of a concept from the data. Use the description to predict the output for future examples Performance P: how accurate the description is Example applications Credit approval Target marketing Medical diagnosis Fraud detection Prof. Pier Luca Lanzi
  16. 16. Reinforcement Learning
  17. 17. What is Reinforcement Learning? 17 Agent stt+1 rt+1 at Environment The agent learn through trial-and-error interactions The goal is to maximize the amount of reward received from the environment Compute a value function Q(st,at) mapping state-action pairs into expected future payoffs Prof. Pier Luca Lanzi
  18. 18. What is reinforcement learning? 18 Training experience E: online interactions with the environment Task T: collect as much reward as possible Performance P: the amount of reward Example applications Robot learning Games Multiagent learning Prof. Pier Luca Lanzi
  19. 19. Machine Learning & Data Mining
  20. 20. Algorithms, Paradigms, Applications 20 Applications Agents Paradigms Data Mining Unsupervised Learning Robotics Supervised Learning … Reinforcement Learning … Algorithms Clustering Association Rules Decision trees … Prof. Pier Luca Lanzi
  21. 21. Machine Learning and Data Mining 21 Machine learning algorithms acquire structural descriptions from examples Structural descriptions represent patterns explicitly They can be used to predict outcome in new situations They can be used to understand and explain how prediction is derived Unsupervised learning Clustering Association rules Supervised learning Decision trees Decision rules Bayesian classifiers Prof. Pier Luca Lanzi
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×