Project MLExAI Machine Learning Experiences in AI   http://uhaweb.hartford.edu/compsci/ccli Ingrid Russell, University of ...
Project Goal <ul><li>The project goal is to develop a framework for teaching core AI topics with a unifying theme of machi...
Project Objectives <ul><li>Enhance the student learning experience in the AI course by implementing a unifying theme of ma...
Features of MLExAI Projects <ul><li>Teaching AI with hands-on experiments. </li></ul><ul><li>Common features in different ...
MLExAI Projects <ul><li>Web Document Classification : Investigates the process of tagging web pages using a topic director...
MLExAI Projects <ul><li>Explanation-Based Learning and the N-Puzzle Problem : Involves the application of explanation-base...
Sample Project:  Web Document Classification <ul><li>Goal </li></ul><ul><li>To investigate the process of tagging web page...
Web Document Classification <ul><li>Project Phases </li></ul><ul><li>Data collection – collecting a set of 100 web documen...
Phase I: Data Collection <ul><li>Topic 1 Topic 2 Topic 3 </li></ul><ul><li>Computers:  Artificial Intelligence :  Machine ...
Phase II: Feature Extraction and  Data Collection
Phase III: Machine Learning
Phase III: Machine Learning ===== Stratified Cross-Validation ===== Correctly Classified Inst.(101)  87.069  % Incorrectly...
Preliminary Experiences <ul><li>Preliminary results were positive and showed that students had good experiences in the cla...
Preliminary Experiences: Student Quotes <ul><li>Working on the project was a great experience.  I was able to see how vari...
Acknowledgement <ul><li>This work is supported in part by National Science Foundation grant DUE CCLI-A&I Award Number 0409...
Upcoming SlideShare
Loading in...5
×

Project MLExAI: Machine Learning Experiences in AI

272

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
272
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Project MLExAI: Machine Learning Experiences in AI

  1. 1. Project MLExAI Machine Learning Experiences in AI http://uhaweb.hartford.edu/compsci/ccli Ingrid Russell, University of Hartford Zdravko Markov, Central Connecticut State University Todd Neller, Gettysburg College
  2. 2. Project Goal <ul><li>The project goal is to develop a framework for teaching core AI topics with a unifying theme of machine learning. A suite of hands-on term-long projects are developed, each involving the design and implementation of a learning system that enhances a commonly-deployed application. </li></ul>
  3. 3. Project Objectives <ul><li>Enhance the student learning experience in the AI course by implementing a unifying theme of machine learning to tie together the diverse topics in the AI course. </li></ul><ul><li>Increase student interest and motivation to learn AI by providing a framework for the presentation of the major AI topics that emphasizes the strong connection between AI and computer science. </li></ul><ul><li>Highlight the bridge that machine learning provides between AI technology and modern software engineering. </li></ul><ul><li>Introduce students to an increasingly important research area, thus motivating them to pursue more advanced courses in machine learning and to pursue undergraduate research projects in this area. </li></ul>
  4. 4. Features of MLExAI Projects <ul><li>Teaching AI with hands-on experiments. </li></ul><ul><li>Common features in different AI fields are unified through the theme of machine learning. </li></ul><ul><li>Emphasis on application of ideas through implementation. </li></ul><ul><li>Varying levels of mathematical sophistication with implementation of concepts being central to the learning process. </li></ul><ul><li>Design and implementation of learning systems. </li></ul><ul><li>Practical approach that includes real-world applications. </li></ul><ul><li>Easily adaptable and customizable. </li></ul><ul><li>Various emphases, backgrounds and prerequisites that can serve different goals within the general framework of teaching AI. </li></ul>
  5. 5. MLExAI Projects <ul><li>Web Document Classification : Investigates the process of tagging web pages using a topic directory structure and applies machine learning techniques for automatic tagging. </li></ul><ul><li>Data Mining for Web User Profiling Using Decision Tree Learning : Focuses on the use of decision tree learning to create models of web users. </li></ul><ul><li>Character Recognition Using Neural Networks : Involves the development of a character recognition system based on a neural network model. </li></ul>
  6. 6. MLExAI Projects <ul><li>Explanation-Based Learning and the N-Puzzle Problem : Involves the application of explanation-based learning to improve the performance of uninformed search algorithms when solving the N-Puzzle problem. </li></ul><ul><li>Reinforcement Learning for the jeopardy Dice Game “Pig” : Students model the game and several variants, implementing dynamic programming and value iteration algorithms to compute optimal play. </li></ul><ul><li>Getting a Clue with Boolean Satisfiability : We use SAT solvers to deduce card locations in the popular board game Clue, illustrating principles of knowledge representation and reasoning, including resolution theorem proving. </li></ul>
  7. 7. Sample Project: Web Document Classification <ul><li>Goal </li></ul><ul><li>To investigate the process of tagging web pages using the topic directory structure and apply machine learning techniques for automatic tagging. </li></ul>
  8. 8. Web Document Classification <ul><li>Project Phases </li></ul><ul><li>Data collection – collecting a set of 100 web documents grouped by topic. Will serve as our training set. </li></ul><ul><li>Feature extraction and data preparation – web documents will be represented by feature vectors, which in turn are used to form a training data set for the Machine Learning stage. </li></ul><ul><li>Machine learning – applying learning algorithms to create models of the data sets. Using these models the accuracy of the initial topic structure is evaluated and new web documents are classified into existing topics. </li></ul><ul><li>Analysis – identifying relations between approaches used in the project and AI areas of search and knowledge representation and reasoning (KR&R) </li></ul>
  9. 9. Phase I: Data Collection <ul><li>Topic 1 Topic 2 Topic 3 </li></ul><ul><li>Computers: Artificial Intelligence : Machine Learning </li></ul><ul><li>Topic 1 Topic 2 Topic 4 </li></ul><ul><li>Computers: Artificial Intelligence : Agents </li></ul><ul><li>Topic 1 Topic 5 Topic 6 </li></ul><ul><li>Computers: Algorithms : Sorting and Searching </li></ul><ul><li>Topic 1 Topic 7 Topic 8 </li></ul><ul><li>Computers: Multimedia : MPEG </li></ul><ul><li>Topic 1 Topic 9 </li></ul><ul><li>Computers : History </li></ul>
  10. 10. Phase II: Feature Extraction and Data Collection
  11. 11. Phase III: Machine Learning
  12. 12. Phase III: Machine Learning ===== Stratified Cross-Validation ===== Correctly Classified Inst.(101) 87.069 % Incorrectly Classified Inst.(15) 12.931 % Kappa statistic 0.8379 Mean absolute error 0.0633 Root mean squared error 0.2245 Relative absolute error 19.7946 % Root relative squared error 56.1278 % Total Number of Instances 116 ===== Stratified Cross-Validation ===== Correctly Classified Inst.(101) 87.069 % Incorrectly Classified Inst.(15) 12.931 % Kappa statistic 0.8379 Mean absolute error 0.0633 Root mean squared error 0.2245 Relative absolute error 19.7946 % Root relative squared error 56.1278 % Total Number of Instances 116 Error Analysis Plot Results Actual Page Classification Predicted Page Classification Actual Page Classification Predicted Page Classification
  13. 13. Preliminary Experiences <ul><li>Preliminary results were positive and showed that students had good experiences in the classes. </li></ul><ul><li>While covering the main AI topics, the course provided students with an introduction to and an appreciation of an increasingly important area in AI, Machine Learning. </li></ul><ul><li>Using a unified theme proved to be helpful and motivating for the students. Students saw how simple search programs evolve into more interesting ones, and finally into a learning framework with interesting theoretical and practical properties. </li></ul>
  14. 14. Preliminary Experiences: Student Quotes <ul><li>Working on the project was a great experience. I was able to see how various AI concepts tie together in developing a machine learning system. I was amazed by the wide range of applications of machine learning in various aspects of our lives. </li></ul><ul><li>I liked acquiring knowledge about machine learning techniques and being able to implement a system and see it work. This gave me a concrete understanding of the concepts. </li></ul><ul><li>The project was really neat. I was challenged to strengthen my deductive reasoning skills by formalizing the process by which I derive solutions. The problems associated with “satisfiability” are fun to work out, but they also provide me with an intellectual challenge. </li></ul><ul><li>I liked the fact that the project I worked on pertained to the Internet and web document classification. It presented a useful real world application of machine learning. Often, examples in the book or other projects lack real world usefulness. </li></ul>
  15. 15. Acknowledgement <ul><li>This work is supported in part by National Science Foundation grant DUE CCLI-A&I Award Number 0409497. </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×