Núria Macià, Jaume Bacardit, and Ester Bernadó-Mansilla                                 nmacia@salle.url.edu              ...
Methodology for learners’ assessment
The UCI repository. 134 classification problemsSource: GECCO’11 Proceedings
Algorithm refinement        Knowledge extraction              Behind the experiments
Standard comparisonSource: Jaume Bacardit, Edmund K. Burke, and Natalio Krasnogor. Improving the scalability of rule-based...
Taxonomy of problems
Complexity coverage
• How many data sets should we use in the experiments?• Which ones? Synthetic data sets? Real-world problems?  Both?• Is t...
Núria Macià, Jaume Bacardit, and Ester Bernadó-Mansilla                                 nmacia@salle.url.edu              ...
Testing learning classifier systems
Upcoming SlideShare
Loading in …5
×

Testing learning classifier systems

990 views

Published on

Nuria Macia, Jaume Bacardit, Ester Bernadó-Mansilla "Testing learning classifier systems", IWLCS, 2011

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
990
On SlideShare
0
From Embeds
0
Number of Embeds
54
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Testing learning classifier systems

  1. 1. Núria Macià, Jaume Bacardit, and Ester Bernadó-Mansilla nmacia@salle.url.edu jaume.bacardit@nottingham.ac.uk esterb@salle.url.edu
  2. 2. Methodology for learners’ assessment
  3. 3. The UCI repository. 134 classification problemsSource: GECCO’11 Proceedings
  4. 4. Algorithm refinement Knowledge extraction Behind the experiments
  5. 5. Standard comparisonSource: Jaume Bacardit, Edmund K. Burke, and Natalio Krasnogor. Improving the scalability of rule-based evolutionary learning. (2009)
  6. 6. Taxonomy of problems
  7. 7. Complexity coverage
  8. 8. • How many data sets should we use in the experiments?• Which ones? Synthetic data sets? Real-world problems? Both?• Is the UCI our best sample?• How should we select our referenced learners?• Should we keep performing comparisons over an arbitrary set of problems?• How can we characterise problems?• More coverage? Benchmarks?• Should we tackle one problem at a time?• … Questions. Answers?
  9. 9. Núria Macià, Jaume Bacardit, and Ester Bernadó-Mansilla nmacia@salle.url.edu jaume.bacardit@nottingham.ac.uk esterb@salle.url.edu

×