• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Population sizing for entropy-based model buliding In genetic algorithms
 

Population sizing for entropy-based model buliding In genetic algorithms

on

  • 2,159 views

This paper presents a population-sizing model for the entropy-based model building in genetic algorithms. Specifically, the population size required for building an accurate model is investigated. The ...

This paper presents a population-sizing model for the entropy-based model building in genetic algorithms. Specifically, the population size required for building an accurate model is investigated. The effect of the selection pressure on population sizing is also incorporated. The proposed model indicates that the population size
required for building an accurate model scales as Θ(m log m), where m is the number of substructures and proportional to the problem size. Experiments are conducted to verify the derivations, and the results agree with the proposed model.

Statistics

Views

Total Views
2,159
Views on SlideShare
2,140
Embed Views
19

Actions

Likes
0
Downloads
117
Comments
0

3 Embeds 19

http://www.illigal.uiuc.edu 12
http://www.kumarasastry.com 5
http://www.slideshare.net 2

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-NoDerivs LicenseCC Attribution-NonCommercial-NoDerivs LicenseCC Attribution-NonCommercial-NoDerivs License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Population sizing for entropy-based model buliding In genetic algorithms Population sizing for entropy-based model buliding In genetic algorithms Presentation Transcript

    • Population Sizing for Entropy-based Model Building in Genetic Algorithms T.-L. Yu1, K. Sastry2, D. E. Goldberg2, & M. Pelikan3 1Department of Electrical Engineering National Taiwan University, Taiwan 2Illinois Genetic Algorithms Laboratory University of Illinois at Urbana-Champaign, IL, USA 3Missouri Estimation of Distribution Algorithms Laboratory University of Missouri at St. Louis, MO, USA Supported by AFOSR FA9550-06-1-0096, NSF DMR 03-25939, and CAREER ECS-0547013.
    • Motivation • Facetwise population sizing in GEC – Initial supply [Goldberg et al. 2001] – Decision-making [Goldberg et al. 1992] – Gambler’s ruin [Harik et al. 1997] • EDA—Model building is essential. • Population sizing for model building [Pelikan et al. 2003] • Better explanation and modeling are needed.
    • Roadmap • Entropy-based model building • Mutual information • The effect of selection • Distribution of mutual information under limited sampling • Building an accurate model • The effect of selection pressure • Conclusion
    • Entropy-based model building & Mutual information • Entropy: measurement of uncertainty. • Loss of entropy Gain in certainty Mutual information • Bivariate: MIMIC, BMDA • Multivariate: eCGA, BOA, EBNA, DSMGA • Most multivariate model building start from bivariate dependency detection.
    • Mutual information • Definition • Some facts: – –
    • Base: Bipolar Royal Road • Additively separable bipolar Royal road u 0 k • Given the minimal signal , the most difficult for model building. • Analytical simplicity, no gene-wise bias.
    • The effect of selection • 00******** and 11******** increase: • 10******** and 01******** decrease: • Define – – •
    • Growth of schemata and M.I. • • • Growth in mutual information
    • Limited sampling • In GAs, finite population limited sampling • Define two random variables: – :Signal of mutual information between two independent genes under n random samples. – :Signal of mutual information between two dependent genes under n random samples. • Ideally:
    • Distribution of mutual information [Hutter and Zaffalon, 2004] • •
    • Empirical verification
    • Building an accurate model • Define • Decision error • Building an accurate model • Finally
    • Verification of O(22k) DSMGA, m=10
    • Verification of O(mlogm) eCGA DSMGA
    • Effect of selection pressure • Quantitative, order statistics • Qualitative, consider truncation selection • Higher s – More growth of Hopt – Fewer number of effective samples
    • Empirical results on selection pressure Future work: Empirically, larger k larger s*
    • Summary and Conclusions • Refine the required population sizing for model building – From – To • Correct to • Preliminarily incorporate selection pressure into population-sizing model. – Qualitatively show the existence of s*