SlideShare a Scribd company logo
Fuzzy-UCS: Preliminary Results


                         Albert Orriols-Puig1,2
                                Orriols Puig
                             Jorge Casillas2
                       Ester Bernadó-Mansilla1

                1Research  Group in Intelligent Systems
       Enginyeria i Arquitectura La Salle, Ramon Llull University

          2Dept.   Computer Science and Artificial Intelligence
                         University of Granada
Motivation


       Michigan-style LCSs for supervised learning. Eg. XCS and UCS
       – Evolve online highly accurate models
       – Competitive to the most-used machine learning techniques
           • (Bernadó et al, 02; Wilson, 02; Bacardit & Butz, 04; Butz, 06; Orriols & Bernadó, 07)



       Main drawback: Intepretability of the rule sets
       – Number of rules or classifiers
           • Reduction schemes (Wilson, 02; Fu & Davis, 02; Dixon et al., 03)
       – Intervalar representation of continuous attributes: [li, ui] .
         Semantic-free variables



                                      Enginyeria i Arquitectura la Salle                        Slide 2
GRSI
Framework


       Genetic Fuzzy Systems
       – Change the rule representation to fuzzy rules
       – Provide a robust, flexible, and powerful methodology to deal with
         noisy imprecise and incomplete data
                                           data.
         noisy, imprecise,
       Michigan-style Learning Fuzzy-Classifier Systems (LFCS)
       – (Valenzuela-Radón, 91 & 98)
       – (Parodi & Bonelli, 93)
       – (Furuhashi, Nakaoka & Uchikawa, 94)
       – (Velasco, 98)
       – (Ishibuchi, Nakashima & Murata, 99 & 05): First LFCS for pattern classification
       – (Casillas, Carse & Bull, 07)        Fuzzy-XCS



                                        Enginyeria i Arquitectura la Salle                 Slide 3
GRSI
Aim


       Propose Fuzzy-UCS
       – Accuracy based Michigan-style LFCS
         Accuracy-based Michigan style
       – Supervised learning scheme
       – Derived from UCS (Bernado & Garrell, 2003)
           • Introduction of a linguistic fuzzy representation
           • Modification of all operators that deal with rules
       – We expect:
           • Achieve similar performance than UCS
           • Higher interpretability since we would deal with linguistic rules
           • Lower number of fuzzy rules in the final population


                                  Enginyeria i Arquitectura la Salle             Slide 4
GRSI
Outline



        1. Description of Fuzzy-UCS
        1D      ii      fF      UCS

        2.
        2 Experimental Methodology

        3. Results

        4. Conclusions




                           Enginyeria i Arquitectura la Salle   Slide 5
GRSI
1. Description of Fuzzy-UCS
                                                                                     2. Experimental Methodology
       Description of UCS
             p                                                                       3. Results
                                                                                     4. Conclusions
                                                                                     4C     li




        Rule representation:
         – Binary variables: {0 1 #}
                             {0, 1,
         – Continuous variables: [li, ui]
         –E
          Eg:
                         IF x1 Є [l1, u1] ^ x2 Є [l2, u2] … ^ xn Є[ln, nn] THEN class1


         – Matching instance e: for all ei: li ≤ ei ≤ ui
         – Set of parameters:
             • Accuracy
             • Fitness
             • Numerosity
             • Experience
             • Correct set size



                                          Enginyeria i Arquitectura la Salle                                Slide 6
GRSI
1. Description of Fuzzy-UCS
                                                                                                                 2. Experimental Methodology
       Description of UCS
             p                                                                                                   3. Results
                                                                                                                 4. Conclusions
                                                                                                                 4C     li




                                                                                                               Stream of
                                         Environment                                                           examples

                                                                                 Match Set
                                                                                 M t h S t [M]
                                             Problem instance
                                             P bl    it
                                                    +
                                               output class                              acc F num cs ts exp
                                                                              1C     A
                                                                                         acc F num cs ts exp
                                                                              3C     A
         Population [P]                                                                  acc F num cs ts exp
                                                                              5C     A
                                                                                         acc F num cs ts exp
                                                                              6C     A
                                                                                             …
                 acc F num cs ts exp
        1C   A
                 acc F num cs ts exp
        2C   A
                 acc F num cs ts exp
        3C   A
                 acc F num cs ts exp                                                            correct set
        4C   A                                                                                                   Classifier
                 acc F num cs ts exp                                                            generation
        5C   A
                                                                                                                Parameters
                 acc F num cs ts exp    Match set
        6C   A
                                                                                                                  Update
                                        generation
                     …


                                                                                Correct Set [C]
                                                                              3 C A acc F num cs ts exp
                                                                                                                        # Correct
                            Deletion         Selection, Reproduction,
                                                                                                               acc =
                                                                              6 C A acc F num cs ts exp
                                                     mutation
                                                                                                                       Experience
                                                                                                                          p
                                                                                        …
                                                                              If there are no classfiers in
                                                                                                                Fitness = accν
                                 Genetic Algorithm                             [C], covering is triggered




                                                       Enginyeria i Arquitectura la Salle                                               Slide 7
GRSI
Description of Fuzzy-UCS
             p            y



         Describe the different components
         1. Rule representation and matching
         2. Learning interaction
         3. Discovery component
         3 Di                 t
         4. Fuzzy-UCS in test mode




                               Enginyeria i Arquitectura la Salle   Slide 8
GRSI
1. Description of Fuzzy-UCS
                                                                             2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                                  3. Results
                                                                             4C     li
                                                                             4. Conclusions




        Rule representation
         – Linguistic fuzzy rules
         – E.g.:           IF x1 is A1 and x2 is A2 … and xn is An THEN class1

                       Disjunction of linguistic
                             fuzzy terms



         – All variables share th same semantics
                  i bl    h    the          ti
         – Example: Ai = {small, medium, large}

                   IF x1 is small and x2 is medium or large THEN class1


         – Codification:
                                 IF [100 | 011] THEN class1

                                        Enginyeria i Arquitectura la Salle                          Slide 9
GRSI
1. Description of Fuzzy-UCS
                                                                                                    2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                                                         3. Results
                                                                                                    4C     li
                                                                                                    4. Conclusions




       How do we know if a given input is small, medium or large?
                           g       p           ,              g
        – Each linguistic term defined by a membership function




                                                                              Belongs to medium with a degree of 0 8
                                                                                                                 0.8



                                                                          Belongs to small with a degree of 0 2
                                                                                                            0.2

                          ei
                       Attribute value                                                     Triangular-shaped
                                                                                          membership functions




                                         Enginyeria i Arquitectura la Salle                                               Slide 10
GRSI
1. Description of Fuzzy-UCS
                                                                                    2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                                         3. Results
                                                                                    4C     li
                                                                                    4. Conclusions




        Matching degree uAk(e)
               gg          ()                    [,]
                                                 [0,1]
             k: IF x1 is small and x2 is medium or large THEN class1
             Example: (e1, e2)




                                                                                         0.8
                                                                                         08


                     0.2                                                                 0.2


              e1                                                         e2

                                                                              T-conorm: bounded sum
                                                                                max ( 1, 0.8 + 0.2) = 1


                                   T-norm: product
                                  uAk(e) = 1 * 0.2 = 0.2


                                    Enginyeria i Arquitectura la Salle                                    Slide 11
GRSI
1. Description of Fuzzy-UCS
                                                                         2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                              3. Results
                                                                         4. Conclusions
                                                                         4C     li




         The role of matching changes:
             • UCS: A rule matches or not an example (binary function)
             • Fuzzy-UCS: A rule matches an example with a certain degree




                                    Enginyeria i Arquitectura la Salle                         Slide 12
GRSI
1. Description of Fuzzy-UCS
                                                                          2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                               3. Results
                                                                          4. Conclusions
                                                                          4C     li




       Each classifier has the following parameters:
        1.
        1 Weight per class wj
           •   Soundness with which the rule predicts the class j.
           •   The class value is dynamic and corresponds to the class j with higher wj

        2. Fitness:
           • Quality of the rule
        3. Other parameters directly inherited from UCS:
           • numerosity
           • correct set size
           • experience



                                     Enginyeria i Arquitectura la Salle                         Slide 13
GRSI
Description of Fuzzy-UCS
             p            y



         Describe the different components
         1. Rule representation and matching
         2. Learning interaction
         3. Discovery component
         3 Di                 t
         4. Fuzzy-UCS in test mode




                               Enginyeria i Arquitectura la Salle   Slide 14
GRSI
1. Description of Fuzzy-UCS
                                                                                    2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                                         3. Results
                                                                                    4C     li
                                                                                    4. Conclusions




        Learning interaction:
         – The environment provides an example e and its class c
         – Match set creation: all classifiers that match with uAk(x) > 0
         – Correct set creation: all classifiers that advocate c
         – Covering: if there is not a classifier that maximally matches e
             • Create the classifier that match the input example with maximum
               degree.
             • Generalize the condition with probability P#

                     For each variable:
                                                    A1          A2             A3




                                          Enginyeria i Arquitectura la Salle                              Slide 15
GRSI
1. Description of Fuzzy-UCS
                                                                      2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                           3. Results
                                                                      4. Conclusions
                                                                      4C     li




        Parameters’ Update
         – Experience:




         – Sum of correct matching per class j cmj:




                                 Enginyeria i Arquitectura la Salle                         Slide 16
GRSI
1. Description of Fuzzy-UCS
                                                                                                    2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                                                         3. Results
                                                                                                    4. Conclusions
                                                                                                    4C     li




        Parameters’ Update
         – Use cm to update of the weights per each class:

                                                            • Rule that only matches instances of class c:
                                                                        • wc = 1
                                                                        • For all the other classes j: wj = 0



         – Calculate the fitness


                                                                                        Pressuring toward rules that
                                                                                        correctly match instances of
                                                                                               only one class




                                   Enginyeria i Arquitectura la Salle                                                     Slide 17
GRSI
Description of Fuzzy-UCS
             p            y



         Describe the different components
         1. Rule representation and matching
         2. Learning interaction
         3. Discovery component
         3 Di                 t
         4. Fuzzy-UCS in test mode




                               Enginyeria i Arquitectura la Salle   Slide 18
GRSI
1. Description of Fuzzy-UCS
                                                                                          2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                                               3. Results
                                                                                          4. Conclusions
                                                                                          4C     li




        Discovery component
         – Steady state niched GA
           Steady-state
         – Roulette wheel selection
                                                                 Instances that have a higher
                                                                                         g
                                                                 matching degree have more
                                                                opportunities of being selected




                                Enginyeria i Arquitectura la Salle                                              Slide 19
GRSI
1. Description of Fuzzy-UCS
                                                                                     2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                                          3. Results
                                                                                     4. Conclusions
                                                                                     4C     li




        Discovery component
         – Crossover and mutation applied on the antecedent
            • 2 point crossover
                                       IF [100 | 011] THEN class1
                                       IF [101 | 100] THEN class1


            • Mutation:

                – Expansion
                    p                                                    IF [101 | 011] THEN class1
                                                                            [         ]
                                  IF [100 | 011] THEN class1
                                     [         ]

                – Contraction                                            IF [100 | 001] THEN class1
                                  IF [100 | 011] THEN class1

                – Shift                                                  IF [010 | 011] THEN class1
                                  IF [100 | 011] THEN class1




                                    Enginyeria i Arquitectura la Salle                                     Slide 20
GRSI
Description of Fuzzy-UCS
             p            y



         Describe the different components
         1. Rule representation and matching
         2. Learning interaction
         3. Discovery component
         3 Di                 t
         4. Fuzzy-UCS in test mode




                               Enginyeria i Arquitectura la Salle   Slide 21
GRSI
1. Description of Fuzzy-UCS
                                                                        2. Experimental Methodology
       Description of Fuzzy-UCS
             p            y                                             3. Results
                                                                        4. Conclusions
                                                                        4C     li




        Class inference of a test example e
         – Winner rule
            • Inference: Select the rule that maximizes uAk(e) · Fk
            • Reduction: Only keep in the final population that rules that maximize
              uAk(e) · Fk at least for one training example


         – Average vote
            • Inference: All experienced rules vote for the class they predict. The
              most voted class is returned.
              Reduction: O l k
                          Only keep experienced rules with positive fit
                                         i    dl       ith    iti fitness i th
            • R d ti                                                      in the
              final population



                                   Enginyeria i Arquitectura la Salle                         Slide 22
GRSI
1. Description of Fuzzy-UCS
                                                                                             2. Experimental Methodology
       Experimental Methodology
         p                   gy                                                              3. Results
                                                                                             4. Conclusions
                                                                                             4C     li




        Methodology
         – Compare Fuzzy-UCS to UCS, C4.5, and SMO.
         – 10-fold cross-validation
         – Averages over 10 runs
         – 5 linguistic labels

                  #Inst   #Fea   #Re          #In          #No           #Cl   %Min   %Max       %MisAtt

                  625       4         4         0            0            3    7,8    46,1                0
        bal
                  345       6         6         0            0            2     42     58                 0
        bpa
         p
                  303       13        6         0            7            2    45,5   54,5          15,4
        h-c
                  150       4         4         0            0            3    33,3   33,3                0
        irs
                  768       8         8         0            0            2    34,9   65,1                0
        pim
                  215       5         5         0            0            3     14     60                 0
        thy
                  699       9         0         9            0            2    34,5
                                                                                 ,    65,5
                                                                                        ,           11,1
                                                                                                      ,
        wbcd
                  178       13     13           0            0            3     27    39,9                0
        wne

                                          Enginyeria i Arquitectura la Salle                                       Slide 23
GRSI
1. Description of Fuzzy-UCS
                                                                                     2. Experimental Methodology
       Results                                                                       3. Results
                                                                                     4. Conclusions
                                                                                     4C     li




 • 1st objective: Competitive in terms of performance




                 Significant difference of Fuzzy-UCS with winner rule:
                 Significant difference of Fuzzy-UCS with average vote:
                 Parameters:
                   iter = 100,000, N = 6,400, F0 = 0.99, v=10, {θGA, θdel, θsub} = 50,
                   x =0.8, u=0.04, P#=0.6, 5 linguistic labels



                                      Enginyeria i Arquitectura la Salle                                   Slide 24
GRSI
1. Description of Fuzzy-UCS
                                                                         2. Experimental Methodology
       Results                                                           3. Results
                                                                         4. Conclusions
                                                                         4C     li




 • 2nd objective: Improve the interpretability


        Example of rules evolved by UCS for iris




        Example of rules evolved by Fuzzy-UCS for iris
         – Linguistic terms: {XS, S, M, L, XL}




                                    Enginyeria i Arquitectura la Salle                         Slide 25
GRSI
1. Description of Fuzzy-UCS
                                                                                    2. Experimental Methodology
       Results                                                                      3. Results
                                                                                    4. Conclusions
                                                                                    4C     li




        Number of rules


                          WRule                Avote                   UCS

                              80                         1293                1392
                 bal
                 bl
                              60                         1849                2075
                 bpa
                             145                         4441                2265
                 hc
                 h-c
                              18                            477              624
                 irs
                             166                         3344                2908
                 pim
                              32                          1142               856
                 thy
                             136                         3018                1111
                 wbcd
                             101                         3984                3618
                 wne




                                  Enginyeria i Arquitectura la Salle                                      Slide 26
GRSI
1. Description of Fuzzy-UCS
                                                                      2. Experimental Methodology
       Conclusions and Further Work                                   3. Results
                                                                      4. Conclusions
                                                                      4C     li




        Conclusions
         – We proposed a Michigan-style LFCS for supervised learning
         – Competitive with respect to UCS, SMO, and C4.5
         –I
          Improvement in terms of interpretability with respect t UCS
                    ti t        fi t      t bilit ith         t to


        Further work
         – Evolve more reduced populations
                               pp
         – Enhance the comparison with new real-world problems
         – Compare to other LFCS
         – Exploit the incremental learning approach to dig large datasets


                                 Enginyeria i Arquitectura la Salle                         Slide 27
GRSI
Fuzzy-UCS: Preliminary Results


                         Albert Orriols-Puig1,2
                                Orriols Puig
                             Jorge Casillas2
                       Ester Bernadó-Mansilla1

                1Research   Group in Intelligent Systems
       Enginyeria i Arquitectura La Salle, Ramon Llull University

          2Dept.   Computer Science and Artificial Intelligence
                         University of Granada

More Related Content

Viewers also liked

CCIA'2008: On the dimensions of data complexity through synthetic data sets
CCIA'2008: On the dimensions of data complexity through synthetic data setsCCIA'2008: On the dimensions of data complexity through synthetic data sets
CCIA'2008: On the dimensions of data complexity through synthetic data setsAlbert Orriols-Puig
 
HIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCS
HIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCSHIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCS
HIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCSAlbert Orriols-Puig
 
GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...
GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...
GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...Albert Orriols-Puig
 
HAIS09-BeyondHomemadeArtificialDatasets
HAIS09-BeyondHomemadeArtificialDatasetsHAIS09-BeyondHomemadeArtificialDatasets
HAIS09-BeyondHomemadeArtificialDatasetsAlbert Orriols-Puig
 
Lecture1 AI1 Introduction to artificial intelligence
Lecture1 AI1 Introduction to artificial intelligenceLecture1 AI1 Introduction to artificial intelligence
Lecture1 AI1 Introduction to artificial intelligenceAlbert Orriols-Puig
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentationlpaviglianiti
 
Artificial inteligence
Artificial inteligenceArtificial inteligence
Artificial inteligence
Intekhab Alam Khan
 

Viewers also liked (10)

CCIA'2008: On the dimensions of data complexity through synthetic data sets
CCIA'2008: On the dimensions of data complexity through synthetic data setsCCIA'2008: On the dimensions of data complexity through synthetic data sets
CCIA'2008: On the dimensions of data complexity through synthetic data sets
 
HIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCS
HIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCSHIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCS
HIS'2008: New Crossover Operator for Evolutionary Rule Discovery in XCS
 
GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...
GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...
GECCO'2007: Modeling Selection Pressure in XCS for Proportionate and Tourname...
 
Lecture7 - IBk
Lecture7 - IBkLecture7 - IBk
Lecture7 - IBk
 
Lecture24
Lecture24Lecture24
Lecture24
 
Lecture23
Lecture23Lecture23
Lecture23
 
HAIS09-BeyondHomemadeArtificialDatasets
HAIS09-BeyondHomemadeArtificialDatasetsHAIS09-BeyondHomemadeArtificialDatasets
HAIS09-BeyondHomemadeArtificialDatasets
 
Lecture1 AI1 Introduction to artificial intelligence
Lecture1 AI1 Introduction to artificial intelligenceLecture1 AI1 Introduction to artificial intelligence
Lecture1 AI1 Introduction to artificial intelligence
 
Artificial Intelligence Presentation
Artificial Intelligence PresentationArtificial Intelligence Presentation
Artificial Intelligence Presentation
 
Artificial inteligence
Artificial inteligenceArtificial inteligence
Artificial inteligence
 

Similar to IWLCS'2007: Fuzzy-UCS: Preliminary Results

GECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced DatasetsGECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced DatasetsAlbert Orriols-Puig
 
CEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness Adaptation
CEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness AdaptationCEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness Adaptation
CEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness AdaptationAlbert Orriols-Puig
 
IWLCS'2006: A Further Look at UCS Classifier System
IWLCS'2006: A Further Look at UCS Classifier SystemIWLCS'2006: A Further Look at UCS Classifier System
IWLCS'2006: A Further Look at UCS Classifier SystemAlbert Orriols-Puig
 
GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...
GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...
GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...Albert Orriols-Puig
 
CSC446: Pattern Recognition (LN6)
CSC446: Pattern Recognition (LN6)CSC446: Pattern Recognition (LN6)
CSC446: Pattern Recognition (LN6)
Mostafa G. M. Mostafa
 
Csc446: Pattern Recognition
Csc446: Pattern Recognition Csc446: Pattern Recognition
Csc446: Pattern Recognition
Mostafa G. M. Mostafa
 
8th Semester (June; July-2014) Computer Science and Information Science Engin...
8th Semester (June; July-2014) Computer Science and Information Science Engin...8th Semester (June; July-2014) Computer Science and Information Science Engin...
8th Semester (June; July-2014) Computer Science and Information Science Engin...
BGS Institute of Technology, Adichunchanagiri University (ACU)
 
3rd Semester (June; July-2014) Civil Engineering Question Papers
3rd Semester (June; July-2014) Civil Engineering Question Papers3rd Semester (June; July-2014) Civil Engineering Question Papers
3rd Semester (June; July-2014) Civil Engineering Question Papers
BGS Institute of Technology, Adichunchanagiri University (ACU)
 
IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...
IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...
IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...Albert Orriols-Puig
 
Kk2518251830
Kk2518251830Kk2518251830
Kk2518251830
IJERA Editor
 
Kk2518251830
Kk2518251830Kk2518251830
Kk2518251830
IJERA Editor
 
Photoacoustic tomography based on the application of virtual detectors
Photoacoustic tomography based on the application of virtual detectorsPhotoacoustic tomography based on the application of virtual detectors
Photoacoustic tomography based on the application of virtual detectors
IAEME Publication
 
Lab manual uoh_ee370
Lab manual uoh_ee370Lab manual uoh_ee370
Lab manual uoh_ee370slatano
 
Neural Networks: Principal Component Analysis (PCA)
Neural Networks: Principal Component Analysis (PCA)Neural Networks: Principal Component Analysis (PCA)
Neural Networks: Principal Component Analysis (PCA)
Mostafa G. M. Mostafa
 
On Selection of Periodic Kernels Parameters in Time Series Prediction
On Selection of Periodic Kernels Parameters in Time Series Prediction On Selection of Periodic Kernels Parameters in Time Series Prediction
On Selection of Periodic Kernels Parameters in Time Series Prediction
cscpconf
 
ON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTION
ON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTIONON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTION
ON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTION
cscpconf
 
Developing fast low-rank tensor methods for solving PDEs with uncertain coef...
Developing fast  low-rank tensor methods for solving PDEs with uncertain coef...Developing fast  low-rank tensor methods for solving PDEs with uncertain coef...
Developing fast low-rank tensor methods for solving PDEs with uncertain coef...
Alexander Litvinenko
 
Investigation of repeated blasts at Aitik mine using waveform cross correlation
Investigation of repeated blasts at Aitik mine using waveform cross correlationInvestigation of repeated blasts at Aitik mine using waveform cross correlation
Investigation of repeated blasts at Aitik mine using waveform cross correlation
Ivan Kitov
 

Similar to IWLCS'2007: Fuzzy-UCS: Preliminary Results (20)

GECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced DatasetsGECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
GECCO'2006: Bounding XCS’s Parameters for Unbalanced Datasets
 
CEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness Adaptation
CEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness AdaptationCEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness Adaptation
CEC'2005: Class Imbalance Problem in UCS Classifier System: Fitness Adaptation
 
IWLCS'2006: A Further Look at UCS Classifier System
IWLCS'2006: A Further Look at UCS Classifier SystemIWLCS'2006: A Further Look at UCS Classifier System
IWLCS'2006: A Further Look at UCS Classifier System
 
GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...
GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...
GECCO'2007: Modeling XCS in Class Imbalances: Population Size and Parameter S...
 
CSC446: Pattern Recognition (LN6)
CSC446: Pattern Recognition (LN6)CSC446: Pattern Recognition (LN6)
CSC446: Pattern Recognition (LN6)
 
Csc446: Pattern Recognition
Csc446: Pattern Recognition Csc446: Pattern Recognition
Csc446: Pattern Recognition
 
presentation
presentationpresentation
presentation
 
8th Semester (June; July-2014) Computer Science and Information Science Engin...
8th Semester (June; July-2014) Computer Science and Information Science Engin...8th Semester (June; July-2014) Computer Science and Information Science Engin...
8th Semester (June; July-2014) Computer Science and Information Science Engin...
 
3rd Semester (June; July-2014) Civil Engineering Question Papers
3rd Semester (June; July-2014) Civil Engineering Question Papers3rd Semester (June; July-2014) Civil Engineering Question Papers
3rd Semester (June; July-2014) Civil Engineering Question Papers
 
IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...
IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...
IWLCS'05: The Class Imbalance Problem in Learning Classifier Systems: A Prel...
 
Kk2518251830
Kk2518251830Kk2518251830
Kk2518251830
 
Kk2518251830
Kk2518251830Kk2518251830
Kk2518251830
 
Photoacoustic tomography based on the application of virtual detectors
Photoacoustic tomography based on the application of virtual detectorsPhotoacoustic tomography based on the application of virtual detectors
Photoacoustic tomography based on the application of virtual detectors
 
Lab manual uoh_ee370
Lab manual uoh_ee370Lab manual uoh_ee370
Lab manual uoh_ee370
 
Neural Networks: Principal Component Analysis (PCA)
Neural Networks: Principal Component Analysis (PCA)Neural Networks: Principal Component Analysis (PCA)
Neural Networks: Principal Component Analysis (PCA)
 
On Selection of Periodic Kernels Parameters in Time Series Prediction
On Selection of Periodic Kernels Parameters in Time Series Prediction On Selection of Periodic Kernels Parameters in Time Series Prediction
On Selection of Periodic Kernels Parameters in Time Series Prediction
 
ON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTION
ON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTIONON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTION
ON SELECTION OF PERIODIC KERNELS PARAMETERS IN TIME SERIES PREDICTION
 
Bca
BcaBca
Bca
 
Developing fast low-rank tensor methods for solving PDEs with uncertain coef...
Developing fast  low-rank tensor methods for solving PDEs with uncertain coef...Developing fast  low-rank tensor methods for solving PDEs with uncertain coef...
Developing fast low-rank tensor methods for solving PDEs with uncertain coef...
 
Investigation of repeated blasts at Aitik mine using waveform cross correlation
Investigation of repeated blasts at Aitik mine using waveform cross correlationInvestigation of repeated blasts at Aitik mine using waveform cross correlation
Investigation of repeated blasts at Aitik mine using waveform cross correlation
 

More from Albert Orriols-Puig (20)

Lecture22
Lecture22Lecture22
Lecture22
 
Lecture21
Lecture21Lecture21
Lecture21
 
Lecture20
Lecture20Lecture20
Lecture20
 
Lecture19
Lecture19Lecture19
Lecture19
 
Lecture18
Lecture18Lecture18
Lecture18
 
Lecture17
Lecture17Lecture17
Lecture17
 
Lecture16 - Advances topics on association rules PART III
Lecture16 - Advances topics on association rules PART IIILecture16 - Advances topics on association rules PART III
Lecture16 - Advances topics on association rules PART III
 
Lecture15 - Advances topics on association rules PART II
Lecture15 - Advances topics on association rules PART IILecture15 - Advances topics on association rules PART II
Lecture15 - Advances topics on association rules PART II
 
Lecture14 - Advanced topics in association rules
Lecture14 - Advanced topics in association rulesLecture14 - Advanced topics in association rules
Lecture14 - Advanced topics in association rules
 
Lecture13 - Association Rules
Lecture13 - Association RulesLecture13 - Association Rules
Lecture13 - Association Rules
 
Lecture12 - SVM
Lecture12 - SVMLecture12 - SVM
Lecture12 - SVM
 
Lecture11 - neural networks
Lecture11 - neural networksLecture11 - neural networks
Lecture11 - neural networks
 
Lecture10 - Naïve Bayes
Lecture10 - Naïve BayesLecture10 - Naïve Bayes
Lecture10 - Naïve Bayes
 
Lecture9 - Bayesian-Decision-Theory
Lecture9 - Bayesian-Decision-TheoryLecture9 - Bayesian-Decision-Theory
Lecture9 - Bayesian-Decision-Theory
 
Lecture8 - From CBR to IBk
Lecture8 - From CBR to IBkLecture8 - From CBR to IBk
Lecture8 - From CBR to IBk
 
Lecture6 - C4.5
Lecture6 - C4.5Lecture6 - C4.5
Lecture6 - C4.5
 
Lecture5 - C4.5
Lecture5 - C4.5Lecture5 - C4.5
Lecture5 - C4.5
 
Lecture4 - Machine Learning
Lecture4 - Machine LearningLecture4 - Machine Learning
Lecture4 - Machine Learning
 
Lecture3 - Machine Learning
Lecture3 - Machine LearningLecture3 - Machine Learning
Lecture3 - Machine Learning
 
Lecture2 - Machine Learning
Lecture2 - Machine LearningLecture2 - Machine Learning
Lecture2 - Machine Learning
 

Recently uploaded

Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
timhan337
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
SACHIN R KONDAGURI
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
CarlosHernanMontoyab2
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
Peter Windle
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Po-Chuan Chen
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
Vikramjit Singh
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
TechSoup
 
Acetabularia Information For Class 9 .docx
Acetabularia Information For Class 9  .docxAcetabularia Information For Class 9  .docx
Acetabularia Information For Class 9 .docx
vaibhavrinwa19
 

Recently uploaded (20)

Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Honest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptxHonest Reviews of Tim Han LMA Course Program.pptx
Honest Reviews of Tim Han LMA Course Program.pptx
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
Embracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic ImperativeEmbracing GenAI - A Strategic Imperative
Embracing GenAI - A Strategic Imperative
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
Acetabularia Information For Class 9 .docx
Acetabularia Information For Class 9  .docxAcetabularia Information For Class 9  .docx
Acetabularia Information For Class 9 .docx
 

IWLCS'2007: Fuzzy-UCS: Preliminary Results

  • 1. Fuzzy-UCS: Preliminary Results Albert Orriols-Puig1,2 Orriols Puig Jorge Casillas2 Ester Bernadó-Mansilla1 1Research Group in Intelligent Systems Enginyeria i Arquitectura La Salle, Ramon Llull University 2Dept. Computer Science and Artificial Intelligence University of Granada
  • 2. Motivation Michigan-style LCSs for supervised learning. Eg. XCS and UCS – Evolve online highly accurate models – Competitive to the most-used machine learning techniques • (Bernadó et al, 02; Wilson, 02; Bacardit & Butz, 04; Butz, 06; Orriols & Bernadó, 07) Main drawback: Intepretability of the rule sets – Number of rules or classifiers • Reduction schemes (Wilson, 02; Fu & Davis, 02; Dixon et al., 03) – Intervalar representation of continuous attributes: [li, ui] . Semantic-free variables Enginyeria i Arquitectura la Salle Slide 2 GRSI
  • 3. Framework Genetic Fuzzy Systems – Change the rule representation to fuzzy rules – Provide a robust, flexible, and powerful methodology to deal with noisy imprecise and incomplete data data. noisy, imprecise, Michigan-style Learning Fuzzy-Classifier Systems (LFCS) – (Valenzuela-Radón, 91 & 98) – (Parodi & Bonelli, 93) – (Furuhashi, Nakaoka & Uchikawa, 94) – (Velasco, 98) – (Ishibuchi, Nakashima & Murata, 99 & 05): First LFCS for pattern classification – (Casillas, Carse & Bull, 07) Fuzzy-XCS Enginyeria i Arquitectura la Salle Slide 3 GRSI
  • 4. Aim Propose Fuzzy-UCS – Accuracy based Michigan-style LFCS Accuracy-based Michigan style – Supervised learning scheme – Derived from UCS (Bernado & Garrell, 2003) • Introduction of a linguistic fuzzy representation • Modification of all operators that deal with rules – We expect: • Achieve similar performance than UCS • Higher interpretability since we would deal with linguistic rules • Lower number of fuzzy rules in the final population Enginyeria i Arquitectura la Salle Slide 4 GRSI
  • 5. Outline 1. Description of Fuzzy-UCS 1D ii fF UCS 2. 2 Experimental Methodology 3. Results 4. Conclusions Enginyeria i Arquitectura la Salle Slide 5 GRSI
  • 6. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of UCS p 3. Results 4. Conclusions 4C li Rule representation: – Binary variables: {0 1 #} {0, 1, – Continuous variables: [li, ui] –E Eg: IF x1 Є [l1, u1] ^ x2 Є [l2, u2] … ^ xn Є[ln, nn] THEN class1 – Matching instance e: for all ei: li ≤ ei ≤ ui – Set of parameters: • Accuracy • Fitness • Numerosity • Experience • Correct set size Enginyeria i Arquitectura la Salle Slide 6 GRSI
  • 7. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of UCS p 3. Results 4. Conclusions 4C li Stream of Environment examples Match Set M t h S t [M] Problem instance P bl it + output class acc F num cs ts exp 1C A acc F num cs ts exp 3C A Population [P] acc F num cs ts exp 5C A acc F num cs ts exp 6C A … acc F num cs ts exp 1C A acc F num cs ts exp 2C A acc F num cs ts exp 3C A acc F num cs ts exp correct set 4C A Classifier acc F num cs ts exp generation 5C A Parameters acc F num cs ts exp Match set 6C A Update generation … Correct Set [C] 3 C A acc F num cs ts exp # Correct Deletion Selection, Reproduction, acc = 6 C A acc F num cs ts exp mutation Experience p … If there are no classfiers in Fitness = accν Genetic Algorithm [C], covering is triggered Enginyeria i Arquitectura la Salle Slide 7 GRSI
  • 8. Description of Fuzzy-UCS p y Describe the different components 1. Rule representation and matching 2. Learning interaction 3. Discovery component 3 Di t 4. Fuzzy-UCS in test mode Enginyeria i Arquitectura la Salle Slide 8 GRSI
  • 9. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4C li 4. Conclusions Rule representation – Linguistic fuzzy rules – E.g.: IF x1 is A1 and x2 is A2 … and xn is An THEN class1 Disjunction of linguistic fuzzy terms – All variables share th same semantics i bl h the ti – Example: Ai = {small, medium, large} IF x1 is small and x2 is medium or large THEN class1 – Codification: IF [100 | 011] THEN class1 Enginyeria i Arquitectura la Salle Slide 9 GRSI
  • 10. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4C li 4. Conclusions How do we know if a given input is small, medium or large? g p , g – Each linguistic term defined by a membership function Belongs to medium with a degree of 0 8 0.8 Belongs to small with a degree of 0 2 0.2 ei Attribute value Triangular-shaped membership functions Enginyeria i Arquitectura la Salle Slide 10 GRSI
  • 11. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4C li 4. Conclusions Matching degree uAk(e) gg () [,] [0,1] k: IF x1 is small and x2 is medium or large THEN class1 Example: (e1, e2) 0.8 08 0.2 0.2 e1 e2 T-conorm: bounded sum max ( 1, 0.8 + 0.2) = 1 T-norm: product uAk(e) = 1 * 0.2 = 0.2 Enginyeria i Arquitectura la Salle Slide 11 GRSI
  • 12. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4. Conclusions 4C li The role of matching changes: • UCS: A rule matches or not an example (binary function) • Fuzzy-UCS: A rule matches an example with a certain degree Enginyeria i Arquitectura la Salle Slide 12 GRSI
  • 13. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4. Conclusions 4C li Each classifier has the following parameters: 1. 1 Weight per class wj • Soundness with which the rule predicts the class j. • The class value is dynamic and corresponds to the class j with higher wj 2. Fitness: • Quality of the rule 3. Other parameters directly inherited from UCS: • numerosity • correct set size • experience Enginyeria i Arquitectura la Salle Slide 13 GRSI
  • 14. Description of Fuzzy-UCS p y Describe the different components 1. Rule representation and matching 2. Learning interaction 3. Discovery component 3 Di t 4. Fuzzy-UCS in test mode Enginyeria i Arquitectura la Salle Slide 14 GRSI
  • 15. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4C li 4. Conclusions Learning interaction: – The environment provides an example e and its class c – Match set creation: all classifiers that match with uAk(x) > 0 – Correct set creation: all classifiers that advocate c – Covering: if there is not a classifier that maximally matches e • Create the classifier that match the input example with maximum degree. • Generalize the condition with probability P# For each variable: A1 A2 A3 Enginyeria i Arquitectura la Salle Slide 15 GRSI
  • 16. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4. Conclusions 4C li Parameters’ Update – Experience: – Sum of correct matching per class j cmj: Enginyeria i Arquitectura la Salle Slide 16 GRSI
  • 17. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4. Conclusions 4C li Parameters’ Update – Use cm to update of the weights per each class: • Rule that only matches instances of class c: • wc = 1 • For all the other classes j: wj = 0 – Calculate the fitness Pressuring toward rules that correctly match instances of only one class Enginyeria i Arquitectura la Salle Slide 17 GRSI
  • 18. Description of Fuzzy-UCS p y Describe the different components 1. Rule representation and matching 2. Learning interaction 3. Discovery component 3 Di t 4. Fuzzy-UCS in test mode Enginyeria i Arquitectura la Salle Slide 18 GRSI
  • 19. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4. Conclusions 4C li Discovery component – Steady state niched GA Steady-state – Roulette wheel selection Instances that have a higher g matching degree have more opportunities of being selected Enginyeria i Arquitectura la Salle Slide 19 GRSI
  • 20. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4. Conclusions 4C li Discovery component – Crossover and mutation applied on the antecedent • 2 point crossover IF [100 | 011] THEN class1 IF [101 | 100] THEN class1 • Mutation: – Expansion p IF [101 | 011] THEN class1 [ ] IF [100 | 011] THEN class1 [ ] – Contraction IF [100 | 001] THEN class1 IF [100 | 011] THEN class1 – Shift IF [010 | 011] THEN class1 IF [100 | 011] THEN class1 Enginyeria i Arquitectura la Salle Slide 20 GRSI
  • 21. Description of Fuzzy-UCS p y Describe the different components 1. Rule representation and matching 2. Learning interaction 3. Discovery component 3 Di t 4. Fuzzy-UCS in test mode Enginyeria i Arquitectura la Salle Slide 21 GRSI
  • 22. 1. Description of Fuzzy-UCS 2. Experimental Methodology Description of Fuzzy-UCS p y 3. Results 4. Conclusions 4C li Class inference of a test example e – Winner rule • Inference: Select the rule that maximizes uAk(e) · Fk • Reduction: Only keep in the final population that rules that maximize uAk(e) · Fk at least for one training example – Average vote • Inference: All experienced rules vote for the class they predict. The most voted class is returned. Reduction: O l k Only keep experienced rules with positive fit i dl ith iti fitness i th • R d ti in the final population Enginyeria i Arquitectura la Salle Slide 22 GRSI
  • 23. 1. Description of Fuzzy-UCS 2. Experimental Methodology Experimental Methodology p gy 3. Results 4. Conclusions 4C li Methodology – Compare Fuzzy-UCS to UCS, C4.5, and SMO. – 10-fold cross-validation – Averages over 10 runs – 5 linguistic labels #Inst #Fea #Re #In #No #Cl %Min %Max %MisAtt 625 4 4 0 0 3 7,8 46,1 0 bal 345 6 6 0 0 2 42 58 0 bpa p 303 13 6 0 7 2 45,5 54,5 15,4 h-c 150 4 4 0 0 3 33,3 33,3 0 irs 768 8 8 0 0 2 34,9 65,1 0 pim 215 5 5 0 0 3 14 60 0 thy 699 9 0 9 0 2 34,5 , 65,5 , 11,1 , wbcd 178 13 13 0 0 3 27 39,9 0 wne Enginyeria i Arquitectura la Salle Slide 23 GRSI
  • 24. 1. Description of Fuzzy-UCS 2. Experimental Methodology Results 3. Results 4. Conclusions 4C li • 1st objective: Competitive in terms of performance Significant difference of Fuzzy-UCS with winner rule: Significant difference of Fuzzy-UCS with average vote: Parameters: iter = 100,000, N = 6,400, F0 = 0.99, v=10, {θGA, θdel, θsub} = 50, x =0.8, u=0.04, P#=0.6, 5 linguistic labels Enginyeria i Arquitectura la Salle Slide 24 GRSI
  • 25. 1. Description of Fuzzy-UCS 2. Experimental Methodology Results 3. Results 4. Conclusions 4C li • 2nd objective: Improve the interpretability Example of rules evolved by UCS for iris Example of rules evolved by Fuzzy-UCS for iris – Linguistic terms: {XS, S, M, L, XL} Enginyeria i Arquitectura la Salle Slide 25 GRSI
  • 26. 1. Description of Fuzzy-UCS 2. Experimental Methodology Results 3. Results 4. Conclusions 4C li Number of rules WRule Avote UCS 80 1293 1392 bal bl 60 1849 2075 bpa 145 4441 2265 hc h-c 18 477 624 irs 166 3344 2908 pim 32 1142 856 thy 136 3018 1111 wbcd 101 3984 3618 wne Enginyeria i Arquitectura la Salle Slide 26 GRSI
  • 27. 1. Description of Fuzzy-UCS 2. Experimental Methodology Conclusions and Further Work 3. Results 4. Conclusions 4C li Conclusions – We proposed a Michigan-style LFCS for supervised learning – Competitive with respect to UCS, SMO, and C4.5 –I Improvement in terms of interpretability with respect t UCS ti t fi t t bilit ith t to Further work – Evolve more reduced populations pp – Enhance the comparison with new real-world problems – Compare to other LFCS – Exploit the incremental learning approach to dig large datasets Enginyeria i Arquitectura la Salle Slide 27 GRSI
  • 28. Fuzzy-UCS: Preliminary Results Albert Orriols-Puig1,2 Orriols Puig Jorge Casillas2 Ester Bernadó-Mansilla1 1Research Group in Intelligent Systems Enginyeria i Arquitectura La Salle, Ramon Llull University 2Dept. Computer Science and Artificial Intelligence University of Granada