GE498-ECI, Lecture 2: Creativity and innovation

More from Xavier Llorà

Soaring the Clouds with Meandre

One hundred and fifty years have passed since the publication of Darwin's world-changing manuscript "The Origins of Species by Means of Natural Selection". Darwin's ideas have proven their power to reach beyond the biology realm, and their ability to define a conceptual framework which allows us to model and understand complex systems. In the mid 1950s and 60s the efforts of a scattered group of engineers proved the benefits of adopting an evolutionary paradigm to solve complex real-world problems. In the 70s, the emerging presence of computers brought us a new collection of artificial evolution paradigms, among which genetic algorithms rapidly gained widespread adoption. Currently, the Internet has propitiated an exponential growth of information and computational resources that are clearly disrupting our perception and forcing us to reevaluate the boundaries between technology and social interaction. Darwin's ideas can, once again, help us understand such disruptive change. In this talk, I will review the origin of artificial evolution ideas and techniques. I will also show how these techniques are, nowadays, helping to solve a wide range of applications, from life science problems to twitter puzzles, and how high performance computing can make Darwin ideas a routinary tool to help us model and understand complex systems.

From Galapagos to Twitter: Darwin, Natural Selection, and Web 2.0

Xavier Llorà

We are living in the peta-byte era.We have larger and larger data to analyze, process and transform into useful answers for the domain experts. Robust data mining tools, able to cope with petascale volumes and/or high dimensionality producing human-understandable solutions are key on several domain areas. Genetics-based machine learning (GBML) techniques are perfect candidates for this task, among others, due to the recent advances in representations, learning paradigms, and theoretical modeling. If evolutionary learning techniques aspire to be a relevant player in this context, they need to have the capacity of processing these vast amounts of data and they need to process this data within reasonable time. Moreover, massive computation cycles are getting cheaper and cheaper every day, allowing researchers to have access to unprecedented parallelization degrees. Several topics are interlaced in these two requirements: (1) having the proper learning paradigms and knowledge representations, (2) understanding them and knowing when are they suitable for the problem at hand, (3) using efficiency enhancement techniques, and (4) transforming and visualizing the produced solutions to give back as much insight as possible to the domain experts are few of them. This tutorial will try to answer this question, following a roadmap that starts with the questions of what large means, and why large is a challenge for GBML methods. Afterwards, we will discuss different facets in which we can overcome this challenge: Efficiency enhancement techniques, representations able to cope with large dimensionality spaces, scalability of learning paradigms. We will also review a topic interlaced with all of them: how can we model the scalability of the components of our GBML systems to better engineer them to get the best performance out of them for large datasets. The roadmap continues with examples of real applications of GBML systems and finishes with an analysis of further directions.

Large Scale Data Mining using Genetics-Based Machine Learning

Xavier Llorà

Data-intensive computing has positioned itself as a valuable programming paradigm to efficiently approach problems requiring processing very large volumes of data. This paper presents a pilot study about how to apply the data-intensive computing paradigm to evolutionary computation algorithms. Two representative cases (selectorecombinative genetic algorithms and estimation of distribution algorithms) are presented, analyzed, and discussed. This study shows that equivalent data-intensive computing evolutionary computation algorithms can be easily developed, providing robust and scalable algorithms for the multicore-computing era. Experimental results show how such algorithms scale with the number of available cores without further modification.

Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study us...

Xavier Llorà

Scalabiltity in GBML, Accuracy-based Michigan Fuzzy LCS, and new Trends

Xavier Llorà

Pittsburgh Learning Classifier Systems for Protein Structure Prediction: Sca...

Xavier Llorà

Towards a Theoretical Towards a Theoretical Framework for LCS Framework fo...

Xavier Llorà

Learning Classifier Systems for Class Imbalance Problems

Xavier Llorà

A Retrospective Look at A Retrospective Look at Classiﬁer System ResearchCl...

Xavier Llorà

XCS: Current capabilities and future challenges

Xavier Llorà

Negative Selection for Algorithm for Anomaly Detection

Xavier Llorà

Searle, Intentionality, and the Future of Classifier Systems

Xavier Llorà

Computed Prediction: So far, so good. What now?

Xavier Llorà

NIGEL 2006 welcome

Xavier Llorà

Linkage Learning for Pittsburgh LCS: Making Problems Tractable

Xavier Llorà

Meandre: Semantic-Driven Data-Intensive Flows in the Clouds

Xavier Llorà

ZigZag: The Meandring Language

Xavier Llorà

HUMIES 2007 Bronze Winner: Towards Better than Human Capability in Diagnosing...

Xavier Llorà

A byproduct benefit of using probabilistic model-building genetic algorithms is the creation of cheap and accurate surrogate models. Learning classifier systems---and genetics-based machine learning in general---can greatly benefit from such surrogates which may replace the costly matching procedure of a rule against large data sets. In this paper we investigate the accuracy of such surrogate fitness functions when coupled with the probabilistic models evolved by the x-ary extended compact classifier system (xeCCS). To achieve such a goal, we show the need that the probabilistic models should be able to represent all the accurate basis functions required for creating an accurate surrogate. We also introduce a procedure to transform populations of rules based into dependency structure matrices (DSMs) which allows building accurate models of overlapping building blocks---a necessary condition to accurately estimate the fitness of the evolved rules.

Do not Match, Inherit: Fitness Surrogates for Genetics-Based Machine Learning...

Xavier Llorà

Cancer diagnosis is essentially a human task. Almost universally, the process requires the extraction of tissue (biopsy) and examination of its microstructure by a human. To improve diagnoses based on limited and inconsistent morphologic knowledge, a new approach has recently been proposed that uses molecular spectroscopic imaging to utilize microscopic chemical composition for diagnoses. In contrast to visible imaging, the approach results in very large data sets as each pixel contains the entire molecular vibrational spectroscopy data from all chemical species. Here, we propose data handling and analysis strategies to allow computer-based diagnosis of human prostate cancer by applying a novel genetics-based machine learning technique ({\tt NAX}). We apply this technique to demonstrate both fast learning and accurate classification that, additionally, scales well with parallelization. Preliminary results demonstrate that this approach can improve current clinical practice in diagnosing prostate cancer.

Towards Better than Human Capability in Diagnosing Prostate Cancer Using Infr...

Xavier Llorà

More from Xavier Llorà (20)

Soaring the Clouds with Meandre

From Galapagos to Twitter: Darwin, Natural Selection, and Web 2.0

Large Scale Data Mining using Genetics-Based Machine Learning

Data-Intensive Computing for Competent Genetic Algorithms: A Pilot Study us...

Scalabiltity in GBML, Accuracy-based Michigan Fuzzy LCS, and new Trends

Pittsburgh Learning Classifier Systems for Protein Structure Prediction: Sca...

Towards a Theoretical Towards a Theoretical Framework for LCS Framework fo...

Learning Classifier Systems for Class Imbalance Problems

A Retrospective Look at A Retrospective Look at Classiﬁer System ResearchCl...

XCS: Current capabilities and future challenges

Negative Selection for Algorithm for Anomaly Detection

Searle, Intentionality, and the Future of Classifier Systems

Computed Prediction: So far, so good. What now?

NIGEL 2006 welcome

Linkage Learning for Pittsburgh LCS: Making Problems Tractable

Meandre: Semantic-Driven Data-Intensive Flows in the Clouds

ZigZag: The Meandring Language

HUMIES 2007 Bronze Winner: Towards Better than Human Capability in Diagnosing...

Do not Match, Inherit: Fitness Surrogates for Genetics-Based Machine Learning...

Towards Better than Human Capability in Diagnosing Prostate Cancer Using Infr...

GE498-ECI, Lecture 2: Creativity and innovation

Recommended

Recommended

More Related Content

More from Xavier Llorà

More from Xavier Llorà (20)

Recently uploaded

Recently uploaded (20)