SlideShare a Scribd company logo
1 of 87
Download to read offline
VUB AI-Lab / ULB IRIDIA, Winter 2012
“Current Trends in Artificial Intelligence” Course Series
Fall 2011
Complex Systems, Bio-Inspiration
and Morphogenetic Engineering:
New Avenues Toward Self-Organized Architecture
René Doursat
Research Group in Biomimetics, Universidad de Malaga, Spain
Complex Systems Institute Paris, CNRS / CREA, Ecole Polytechnique
Project “GroCyPhy”: Growing Cyber-Physical Systems (S. Stepney, J. Miller et al., York)
Artist’s impression of a garden of fully grown, growing, and pruned skyscrapers
“Skyscraper Garden” © David A. Hardy/www.astroart.org 2012
SWARMORPH: Morphogenesis with Self-Assembling Robots
(M. Dorigo, R. O’Grady et al., IRIDIA, ULB)
SYMBRION: Symbiotic Evolutionary Robot Organisms
(S. Kernbach, T. Schmickl, A. Winfield et al.)
ARCHITECTURE & SELF-ORGANIZATION
planned actitivities: civil engineering, mechanical engineering,
electrical engineering, computer engineering, companies,
(building) architecture, enterprise architecture, urbanism
collective motion, swarm intelligence, pattern formation,
complex (social) networks, spatial communities
biological development,
insect construction...
... robotic swarms,
distributed software
ARCHITECTURE & SELF-ORGANIZATION
1. What are Complex Systems?
• Decentralization
• Emergence
• Self-organization
 Any ideas?
The School of Rock (2003)
Jack Black, Paramount Pictures
1. What are Complex Systems?
“simple”
few simple
Emergent
Behavior
Agents /
Parts
Local Rules
Category
A "Complex
System"?
complex
few simple
“simple”
many simple
complex
“complex”
many
many
complicated
simple
deterministic/
centralized
many complicated
 A simplified classification of complex systems
1. What are Complex Systems?
 Few agents, “simple” emergent behavior
Two bodies with similar mass
Wikimedia Commons
Two bodies with different mass
Wikimedia Commons
→ ex: two-body problem
 fully solvable and regular trajectories for inverse-square force laws
(e.g., gravitational or electrostatic)
1. What are Complex Systems?
 Few agents, complex emergent behavior
NetLogo model: /Chemistry & Physics/Mechanics/Unverified Transit orbit of the planar circular restricted problem
Scholarpedia: Three Body Problem & Joachim Köppen Kiel’s applet
→ ex: three-body problem
 generally no exact mathematical solution (even in “restricted” case
m1 〈〈 m2 ≈ m3): must be solved numerically → chaotic trajectories
1. What are Complex Systems?
 Few agents, complex emergent behavior
Logistic map
Baker’s transformation
Craig L. Zirbel, Bowling Green State University, OH
→ ex: more chaos (baker’s/horseshoe maps, logistic map, etc.)
 chaos generally means a bounded, deterministic process that is
aperiodic and sensitive on initial conditions → small fluctuations
create large variations (“butterfly effect”)
 even one-variable iterative functions: xn+1 = f(xn) can be “complex”
1. What are Complex Systems?
 Many agents, simple rules, “simple” emergent behavior
Diamond crystal structure
Tonci Balic-Zunic, University of Copenhagen
NetLogo model: /Chemistry & Physics/GasLab Isothermal Piston
→ ex: crystal and gas (covalent bonds or electrostatic forces)
 either highly ordered, regular states (crystal)
 or disordered, random, statistically homogeneous states (gas):
a few global variables (P, V, T) suffice to describe the system
1. What are Complex Systems?
 Many agents, simple rules, complex emergent behavior
→ ex: cellular automata, pattern formation, swarm intelligence (insect
colonies, neural networks), complex networks, spatial communities
 the “clichés” of complex systems: a major part of this course and
NetLogo models
1. What are Complex Systems?
 Many agents, complicated rules, complex emergent behavior
→ natural ex: organisms (cells), societies (individuals + techniques)
 agent rules become more “complicated”, e.g., heterogeneous
depending on the element’s type and/or position in the system
 behavior is also complex but, paradoxically, can become more
controllable, e.g., reproducible and programmable
termite mounds companies techno-networks cities
biological development & evolution
1. What are Complex Systems?
 Many agents, complicated rules, complex emergent behavior
Swarm chemistry
Hiroki Sayama, Binghamton University SUNY
→ ex: self-organized “artificial life”: swarm chemistry, morphogenesis
 in swarm chemistry (Sayama 2007), mixed self-propelled particles with
different flocking parameters create nontrivial formations
 in embryomorphic engineering (Doursat 2006), cells contain the same
genetic program, but differentiate and self-assemble into specific shapes
SA
PF
SA4
PF4
SA6
PF6
Embryomorphic engineering
René Doursat, Insitut des Systèmes Complexes, Paris
1. What are Complex Systems?
 Many agents, complicated rules, “deterministic” behavior
 artifacts composed of a
immense number of parts
 yet still designed globally
to behave in a limited and
predictable (reliable,
controllable) number of
ways  "I don’t want my aircraft to be
creatively emergent in mid-air"
 not "complex" systems in
the sense of:
 little decentralization
 no emergence
 no self-organization
Systems engineering
Wikimedia Commons, http://en.wikipedia.org/wiki/Systems_engineering
→ classical engineering: electronics, machinery, aviation, civil construction
1. What are Complex Systems?
 Many agents, complicated rules, “centralized” behavior
→ spectators, orchestras, military, administrations
 people reacting similarly and/or simultaneously to cues/orders
coming from a central cause: event, leader, plan
 hardly "complex" systems: little decentralization, little
emergence, little self-organization
1. What are Complex Systems?
“simple”
few simple
2-body problem NO
Emergent
Behavior
Agents /
Parts
Local Rules
Category
A "Complex
System"?
complex
few simple
3-body problem,
low-D chaos
NO – too small
“simple”
many simple
crystal, gas NO – few params
suffice to describe it
complex
“complex”
many
many
complicated
simple
structured
morphogenesis
patterns, swarms,
complex networks
YES – reproducible
and heterogeneous
YES – but mostly
random and uniform
deterministic/
centralized
many complicated
machines, crowds
with leaders
COMPLICATED
– not self-organized
 Recap: complex systems in this course
1. What are Complex Systems?
“simple”
few simple
2-body problem NO
Emergent
Behavior
Agents /
Parts
Local Rules
Category
A "Complex
System"?
complex
few simple
3-body problem,
low-D chaos
NO – too small
“simple”
many simple
crystal, gas NO – few params
suffice to describe it
complex
“complex”
many
many
complicated
simple
structured
morphogenesis
patterns, swarms,
complex networks
YES – reproducible
and heterogeneous
YES – but mostly
random and uniform
deterministic/
centralized
many complicated
machines, crowds
with leaders
COMPLICATED
– not self-organized
 Recap: complex systems in this course
1. What are Complex Systems?
 large number of elementary agents interacting locally
 (more or less) simple individual agent behaviors creating
a complex emergent, self-organized behavior
 decentralized dynamics: no master blueprint or grand
architect
 Complex systems in this course
Internet
& Web
= host/page
insect
colonies
= ant
 physical, biological, technical, social systems (natural or artificial)
pattern
formation
= matter
biological
development
= cell
social
networks
= person
the brain
& cognition
= neuron
1. What are Complex Systems?
Convection cells in liquid (detail)
(Manuel Velarde, Universidad Complutense, Madrid)
Sand dunes
(Scott Camazine, http://www.scottcamazine.com)
Solar magnetoconvection
(Steven R. Lantz, Cornell Theory Center, NY)
Rayleigh-Bénard convection cells
in liquid heated uniformly from below
(Scott Camazine, http://www.scottcamazine.com)
Physical pattern formation: Convection cells
WHAT?
Hexagonal arrangement of sand dunes
(Solé and Goodwin, “Signs of Life”, Perseus Books)
Schematic convection dynamics
(Arunn Narasimhan, Southern Methodist University, TX)
∆T HOW?
 thermal convection, due to temperature gradients, creates stripes and tilings at multiple
scales, from tea cups to geo- and astrophysics
1. What are Complex Systems?
Mammal fur, seashells, and insect wings
(Scott Camazine, http://www.scottcamazine.com)
Biological pattern formation: Animal colors
WHAT? ctivator
nhibitor
NetLogo fur coat simulation, after
David Young’s model of fur spots and stripes
(Michael Frame & Benoit Mandelbrot, Yale University)
 animal patterns (for warning, mimicry, attraction) can be caused by pigment cells trying to copy
their nearest neighbors but differentiating from farther cells
HOW?
1. What are Complex Systems?
Animation of a functional MRI study
(J. Ellermann, J. Strupp, K. Ugurbil, U Minnesota)
WHAT?
 the brain constantly
generates patterns of
activity (“the mind”)
 they emerge from 100
billion neurons that
exchange electrical signals
via a dense network of
contacts
Spatiotemporal synchronization: Neural networks
Pyramidal neurons & interneurons
(Ramón y Cajal 1900)
Cortical layers
HOW?
Schematic neural network
1. What are Complex Systems?
Swarm intelligence: Insect colonies (ant trails, termite mounds)
Termite mound
(J. McLaughlin, Penn State University)
http://cas.bellarmine.edu/tietjen/
TermiteMound%20CS.gif
Termite stigmergy
(after Paul Grassé; from Solé and Goodwin,
“Signs of Life”, Perseus Books)
 termite colonies
build complex
mounds by
“stigmergy”
Harvester ant
(Deborah Gordon, Stanford University)
http://taos-telecommunity.org/epow/epow-archive/
archive_2003/EPOW-030811_files/matabele_ants.jpg
http://picasaweb.google.com/
tridentoriginal/Ghana
HOW?
WHAT?
 ants form trails by
following and
reinforcing each
other’s pheromone
path
1. What are Complex Systems?
Bison herd
(Center for Bison Studies, Montana State University, Bozeman)
Fish school
(Eric T. Schultz, University of Connecticut)
Collective motion: flocking, schooling, herding
WHAT?
Separation, alignment and cohesion
(“Boids” model, Craig Reynolds, http://www.red3d.com/cwr/boids)
S A C
 each individual adjusts its
position, orientation and
speed according to its
nearest neighbors
HOW?
 coordinated collective
movement of dozens or
1000s of individuals
(confuse predators, close in
on prey, improve motion
efficiency, etc.)
1. What are Complex Systems?
Complex networks and morphodynamics: human organizations
SimCity (http://simcitysocieties.ea.com)
organizations urban dynamics
(Thomas Thü Hürlimann, http://ecliptic.ch)
NSFNet Internet (w2.eff.org)
techno-social
networks
global connectivity
WHAT?
NetLogo urban sprawl simulation
NetLogo preferential attachment simulation
cellular automata model
“scale-free” network model
HOW?
1. What are Complex Systems?
1. What Are Complex Systems?
the brain
organisms
ant trails
termite
mounds
animal
flocks
cities,
populations
social networks
markets,
economy
Internet,
Web
physical
patterns
living cell
biological
patterns
animals
humans
& tech
molecules
cells
 All agent types: molecules, cells, animals, humans & tech
Categories of complex systems by range of interactions
the brain
organisms
ant trails
termite
mounds
animal
flocks
physical
patterns
living cell
biological
patterns
2D, 3D spatial
range
non-spatial,
hybrid range cities,
populations
social networks
markets,
economy
Internet,
Web
1. What Are Complex Systems?
the brain
organisms
ant trails
termite
mounds
animal
flocks
physical
patterns
living cell
biological
patterns
cities,
populations
social networks
markets,
economy
Internet,
Web
Natural and human-caused categories of complex systems
 ... yet, even human-caused
systems are “natural” in the
sense of their unplanned,
spontaneous emergence
1. What Are Complex Systems?
 Emergence on multiple levels of self-organization
1. What Are Complex Systems?
complex systems:
a) a large number of elementary agents
interacting locally
b) simple individual behaviors creating a
complex emergent collective behavior
c) decentralized dynamics: no master
blueprint or grand architect
 From genotype to phenotype, via development
1. What Are Complex Systems?
× ×
→ →
1. What Are Complex Systems?
.
.
.
.
.
.
Ramón y
Cajal 1900
 From neurons to brain, via neural development (anatomy)
1. What Are Complex Systems?
ctivator
nhibitor
 From pigment cells to coat patterns, via reaction-diffusion
 From social insects to swarm intelligence, via stigmergy
1. What Are Complex Systems?
 From birds to flocks, via flocking
1. What Are Complex Systems?
separation alignment cohesion
 there are a lot of theories and results in related disciplines (“systems
theory”, “computational complexity”, etc.), yet
 such generic names often come from one researcher with one particular view
 there is no unified viewpoint on complex systems, especially autonomous
 in fact, there is not even any agreement on their definition
 So, there is no general “complex systems science” or
“complexity theory”...
 we are currently dealing with an intuitive set of criteria, more or less
shared by researchers, but still hard to formalize and quantify:
 complexity
 emergence
 self-organization
 multitude / decentralization
 adaptation, etc.
1. What Are Complex Systems?
Paris Ile-de-France
Lyon
Rhône-Alpes
National
4th French Complex Systems
Summer School, 2010
38
mathematical neuroscience
artificial life / neural computing
statistical mechanics / collective motion
structural genomics
computational evolution / development
social networks
peer-to-peer networks
high performance computing
complex networks / cellular automata
embryogenesis
web mining / social intelligence
spiking neural dynamics
spatial networks / swarm intelligence
active matter / complex networks
Resident
Researchers
urban systems / innovation networks
nonlinear dynamics / oceanography
39
Visualization of Research Networks
(from D. Chavalarias)
1. What are Complex Systems?
dynamics: behavior and activity of a
system over time multitude, statistics: large-scale
properties of systems
adaptation: change in typical
functional regime of a system
systems sciences: holistic (non-
reductionist) view on interacting parts
complexity: measuring the length to describe,
time to build, or resources to run, a system
A vast archipelago of precursor and neighboring disciplines
 different families of disciplines focus on different aspects
 (naturally, they intersect a lot: don’t take this taxonomy too seriously)
dynamics: behavior and activity of a
system over time multitude, statistics: large-scale
properties of systems
adaptation: change in typical
functional regime of a system
complexity: measuring the length to describe,
time to build, or resources to run, a system
dynamics: behavior and activity of a
system over time
 nonlinear dynamics & chaos
 stochastic processes
 systems dynamics (macro variables)
adaptation: change in typical
functional regime of a system
 evolutionary methods
 genetic algorithms
 machine learning
complexity: measuring the length to describe,
time to build, or resources to run, a system
 information theory (Shannon; entropy)
 computational complexity (P, NP)
 Turing machines & cellular automata
systems sciences: holistic (non-
reductionist) view on interacting parts
systems sciences: holistic (non-
reductionist) view on interacting parts
 systems theory (von Bertalanffy)
 systems engineering(design)
 cybernetics (Wiener; goals & feedback)
 control theory (negative feedback)
→ Toward a unified “complex
systems” science and
engineering?
multitude, statistics: large-scale
properties of systems
 graph theory & networks
 statistical physics
 agent-based modeling
 distributed AI systems
1. What are Complex Systems?
A vast archipelago of precursor and neighboring disciplines
1. What are Complex Systems?
• Decentralization
• Emergence
• Self-organization
5. Bio-Inspiration and
Artificial Evo-Devo
Or how to control
spontaneity
ARCHITECTURE & SELF-ORGANIZATION
 Between natural and engineered emergence
CS engineering: creating and programming
a new "artificial" emergence
→ Multi-Agent Systems (MAS)
CS science: observing and understanding "natural",
spontaneous emergence (including human-caused)
→ Agent-Based Modeling (ABM)
CS computation: fostering and guiding
complex systems at the level of their elements
5. Bio-Inspiration and Artificial Evo-Devo
But CS computation is
not without paradoxes:
• Can we plan
autonomy?
• Can we control
decentralization?
• Can we program
adaptation?
ex: genes & evolution
laws of genetics
genetic program,
binary code, mutation
genetic algorithms (GAs),
evolutionary computation
for search & optimization
ex: neurons & brain
biological neural models
binary neuron,
linear synapse
artificial neural networks
(ANNs) applied to machine
learning & classification
ex: ant colonies
trail formation, swarming
agents that move, deposit
& follow “pheromone”
ant colony optimization (ACO)
applied to graph theoretic
& networking problems
 Exporting models of natural complex systems to ICT
 already a tradition, but mostly in offline search and optimization
TODAY: simulated in a Turing machine / von Neumann architecture
ABM
MAS
5. Bio-Inspiration and Artificial Evo-Devo
 Exporting natural complex systems to ICT
 ... looping back onto unconventional physical implementation
genetic algorithms (GAs),
evolutionary computation
for search & optimization
artificial neural networks
(ANNs) applied to machine
learning & classification
ant colony optimization (ACO)
applied to graph theoretic
& networking problems
DNA computing
synthetic biology
chemical, wave-based
computing
TOMORROW: implemented in bioware, nanoware, etc.
5. Bio-Inspiration and Artificial Evo-Devo
... or bioware, nanoware, etc.
whether Turing machine...
genetics evolution
Nadine
Peyriéras,
Paul
Bourgine
et
al.
(Embryomics
&
BioEmergences)
evolution
Ulieru
&
Doursat
(2010)
ACM
TAAS
simulation
by
Adam
MacDonald,
UNB
Doursat (2008)
ALIFE XI, WInchester
 A new line of bio-inspiration: biological morphogenesis
 designing multi-agent models for decentralized systems engineering
Morphogenetic
Engineering
5. Bio-Inspiration and Artificial Evo-Devo
development
1. What are Complex Systems?
• Decentralization
• Emergence
• Self-organization
2. Architects Overtaken
by their Architecture
Designed systems that
became suddenly complex
Complex systems seem so different from architected systems, and yet...
5. Bio-Inspiration and
Artificial Evo-Devo
Or how to control
spontaneity
3. Architecture Without
Architects
Self-organized systems that
look like they were designed
ARCHITECTURE & SELF-ORGANIZATION
cities,
populations
Internet,
Web social networks
markets,
economy
companies,
institutions
address
books
houses,
buildings
computers,
routers
2. Architects Overtaken by their Architecture
 At large scales, human superstructures are "natural" CS
... arising from a multitude of
traditionally designed artifacts
houses, buildings
address books
companies, institutions
computers, routers
large-scale
emergence
small to mid-
scale artifacts
by their unplanned, spontaneous
emergence and adaptivity...
geography: cities, populations
people: social networks
wealth: markets, economy
technology: Internet, Web
2. Architects Overtaken by their Architecture
 At mid-scales, human artifacts are classically architected
 a goal-oriented, top-down process toward
one solution behaving in a limited # of ways
 specification & design: hierarchical view of
the entire system, exact placement of elts
 testing & validation: controllability, reliability,
predictability, optimality
ArchiMate
EA
example
 the (very) "complicated" systems of classical
engineering and social centralization
 electronics, machinery, aviation, civil
construction, etc.
 spectators, orchestras, administrations,
military (reacting to external cues/leader/plan)
 not "complex" systems:
 little/no decentralization, little/no emergence,
little/no self-organization
 New inflation: artifacts/orgs made of a huge number of parts
Systems
engineering
Wikimedia
Commons
... and enterprise architecture?
number of transistors/year
in hardware, software,
agents, objects, services
number of O/S lines of code/year
networks...
number of network hosts/year
 Burst to large scale: de facto complexification of ICT systems
 ineluctable breakup into, and proliferation of, modules/components
2. Architects Overtaken by their Architecture
→ trying to keep the lid on complexity won’t work in these systems:
 cannot place every part anymore
 cannot foresee every event anymore
 cannot control every process anymore ... but do we still want to?
 Large-scale: de facto complexification of organizations, via
techno-social networks
 ubiquitous ICT capabilities connect people and infrastructure in
unprecedented ways
 giving rise to complex techno-social "ecosystems" composed of a
multitude of human users and computing devices
2. Architects Overtaken by their Architecture
→ in this context, impossible to assign every single participant a predetermined role
 healthcare  energy & environment
 education  defense & security
 business  finance
 from a centralized oligarchy of providers of
data, knowledge, management, information, energy
 to a dense heterarchy of proactive participants:
patients, students, employees, users, consumers, etc.
 explosion in size and complexity in all domains of society:
3. Architecture Without
Architects
Self-organized systems that
look like they were designed
1. What are Complex Systems?
• Decentralization
• Emergence
• Self-organization
2. Architects Overtaken
by their Architecture
Designed systems that
became suddenly complex
but were not
Complex systems seem so different from architected systems, and yet...
5. Bio-Inspiration and
Artificial Evo-Devo
Or how to control
spontaneity
ARCHITECTURE & SELF-ORGANIZATION
 ... yet, even human-caused
systems are "natural" in the
sense of their unplanned,
spontaneous emergence
the brain organisms ant trails
termite
mounds
animal
flocks
physical
patterns
living cell
biological
patterns
 biology strikingly demonstrates
the possibility of combining
pure self-organization and
elaborate architecture, i.e.:
 a non-trivial, sophisticated morphology
 hierarchical (multi-scale): regions, parts, details
 modular: reuse of parts, quasi-repetition
 heterogeneous: differentiation, division of labor
 random at agent level, reproducible at system level
3. Architecture Without Architects
 "Simple"/random vs. architectured complex systems
 Ex: Morphogenesis – Biological development
 cells build
sophisticated
organisms by
division, genetic
differentiation and
biomechanical self-
assembly
Nadine Peyriéras, Paul Bourgine et al.
(Embryomics & BioEmergences)
www.infovisual.info
architecture
Termite mound
(J. McLaughlin, Penn State University)
http://cas.bellarmine.edu/tietjen/
TermiteMound%20CS.gif
Termite stigmergy
(after Paul Grassé; from Solé and Goodwin,
"Signs of Life", Perseus Books)
 termite colonies
build sophisticated
mounds by
"stigmergy" = loop
between modifying
the environment
and reacting
differently to these
modifications
 Ex: Swarm intelligence – Termite mounds
architecture
3. Architecture Without Architects
 Complex systems can possess a strong architecture, too
 "complex" doesn’t imply "flat"...
→ modular, hierarchical, detailed architecture
 "complex" doesn’t imply "random"...
→ reproducible patterns relying on programmable agents
 "complex" doesn’t imply "homogeneous"...
→ heterogeneous agents and diverse patterns, via positions
→ cells and social insects have successfully "aligned business and
infrastructure" for millions of years without any architect telling them how to
transport
royal
chamber
fungus
gardens
reproduce
defend
queen
ventilation shaft
worker
soldier
nursery galleries
build
(mockup) EA-style diagram of a termite mound
architecture
but then what does it
mean for a module to
be an "emergence" of
many fine-grain agents?
3. Architecture Without Architects
Pattern Formation → Morphogenesis
“I have the stripes, but where is the zebra?” OR
“The stripes are easy, it’s the horse part that troubles me”
—attributed to A. Turing, after his 1952 paper on morphogenesis
3. Architecture Without Architects
more
self-organization
more
architecture
gap to fill
 Many self-organized systems exhibit random patterns...
... while "complicated" architecture is designed by humans
(a) "simple"/random self-organization
(d) direct
design
(top-down)
NetLogo simulations: Fur, Slime, BZ Reaction, Flocking, Termite, Preferential Attachment
3. Architecture Without Architects
artificial
natural
(b) natural
self-organized
architecture
(c) engineered
self-organization
(bottom-up)
. . . .
. . . .
more
self-organization
more
architecture
 Many self-organized systems exhibit random patterns...
 Can we transfer some of their principles to human-made
systems and organizations?
 The only natural emergent and structured CS are biological
 self-forming robot swarm
 self-programming software
 self-connecting micro-components
 self-reconfiguring manufacturing plant
 self-stabilizing energy grid
 self-deploying emergency taskforce
 self-architecting enterprise
SYMBRION
Project
3. Architecture Without Architects
3. Architecture Without
Architects
Self-organized systems that
look like they were designed
1. What are Complex Systems?
• Decentralization
• Emergence
• Self-organization
2. Architects Overtaken
by their Architecture
Designed systems that
became suddenly complex
4. Morphogenetic
Engineering
From cells and insects to
robots and networks
but were not
5. Bio-Inspiration and
Artificial Evo-Devo
Or how to control
spontaneity
ARCHITECTURE & SELF-ORGANIZATION
 Sculpture → forms
 Painting → colors
 the forms are
“sculpted” by the self-
assembly of the
elements, whose
behavior is triggered
by the colors
 new color regions
appear (domains of
genetic expression)
triggered by
deformations
“patterns from shaping”
“shape from patterning”
Ádám
Szabó,
The
chicken
or
the
egg
(2005)
http://www.szaboadam.hu
A closer look at morphogenesis: it couples assembly and patterning
4. Morphogenetic Engineering
 Genetic regulation
PROT A PROT B
GENE I
PROT C
"key"
"lock"
schema after Carroll, S. B. (2005)
“Endless Forms Most Beautiful”, p117
GENE A
GENE B
GENE C
A
B
X
Y
I
Tensional
integrity
Donald
Ingber,
Harvard
Cellular
Potts
model
Graner,
Glazier,
Hogeweg
http://www.compucell3d.org
GENE I
Drosophila
embryo
GENE C
GENE A
GENE B
Deformable
volume
Doursat,
simul.
by
Delile
A closer look at morphogenesis: ⇔ it couples mechanics and genetics
Spring-mass
model
Doursat
(2009)
ALIFE
XI
 Cellular mechanics
 adhesion
 deformation / reformation
 migration (motility)
 division / death
4. Morphogenetic Engineering
grad1
div1
patt1
div2
grad2
patt2
div3
grad3
patt3
...
 Alternation of self-
positioning (div)
and self-
identifying
(grad/patt)
genotype
Capturing the essence of morphogenesis in an Artificial Life agent model
each agent
follows the same set
of self-architecting rules (the "genotype")
but reacts differently depending on its neighbors
4. Morphogenetic Engineering
Doursat (2009)
18th GECCO
4. Morphogenetic Engineering
63
p
A
B
V
r
r0
re
rc
div
GSA: rc < re = 1 << r0
p = 0.05
4. Morphogenetic Engineering
p
A
B
V
r
r0
re
rc
div
GSA: rc < re = 1 << r0
p = 0.05
.
1 0 cd
cd
cd
cd r
k
m r
r
r
r 

 η
−








−
−
=
.
1
2
2
0 cd
cd
cd
d
c r
k
r
r
r
r
r








−
−
=
∆
=
∆
−
=
∆
η
⇓
grad
E
W
S
N
E
W
WE WE
NS
4. Morphogenetic Engineering
I4 I6
B4
B3
patt
X Y
. . . I3 I4 I5 . . .
B1 B2 B4
B3
wix,iy
GPF : {w }
wki
WE NS
4. Morphogenetic Engineering
I9
I1
(a) (b)
(c)
. . . . . .
WE = X NS = Y
B1 B2 B3 B4
I3 I4 I5
X Y
. . . I3 I4 I5 . . .
B1 B2 B4
B3
wiX,Y
GPF
wki
 Programmed patterning (patt): the hidden embryo atlas
a) same swarm in different colormaps to visualize the agents’ internal
patterning variables X, Y, Bi and Ik (virtual in situ hybridization)
b) consolidated view of all identity regions Ik for k = 1...9
c) gene regulatory network used by each agent to calculate its expression
levels, here: B1 = σ(1/3 − X), B3 = σ(2/3 − Y), I4 = B1B3(1 − B4), etc.
4. Morphogenetic Engineering
p
A
B
V
r
r0
re
rc
div
GSA : rc < re = 1 << r0
p = 0.05
I4 I6
B4
B3
grad patt
E
W
S
N
E
W
WE WE
NS
X Y
. . . I3 I4 I5 . . .
B1 B2 B4
B3
wix,iy
GPF : {w }
wki
WE NS
Doursat (2008)
ALIFE XI
GSA ∪ GPF
 details are not created in one shot, but gradually added. . .
 . . . while, at the same time, the canvas grows
from Coen, E. (2000)
The Art of Genes, pp131-135
4. Morphogenetic Engineering
 Morphological refinement by iterative growth
I4 I6
E(4)
W(6)
I5
I4
I1
N(4)
S(4)
W(4) E(4)
rc = .8, re = 1, r0 = ∞
r'e= r'0=1, p =.01
GSA
SA
PF
SA4
PF4
SA6
PF6
4. Morphogenetic Engineering: Devo
SA
PF
SA4
PF4
SA6
PF6
all cells have same GRN, but execute different
expression paths → determination / differentiation
microscopic (cell) randomness, but
mesoscopic (region) predictability
Doursat (2008)
ALIFE XI, WInchester
4. Morphogenetic Engineering: Devo
 Derivative projects
ME: Devo-Evo
ME: Devo-MecaGen
ME: Devo-Bots
ME: ProgNet
ME: Devo-SynBioTIC
ME: ProgNet-Ecstasy
 Quantitative mutations: limb thickness
GPF
GSA
3×3
1, 1
p = .05
g = 15
4 6
disc
GPF
GSA
1×1
tip p’= .05
g’= 15
GPF
GSA
1×1
tip p’= .05
g’= 15
GPF
GSA
3×3
2, 1 4 6
disc
p = .05
g = 15
GPF
GSA
1×1
tip p’= .05
g’= 15
GPF
GSA
3×3
0.5, 1 4 6
disc
p = .05
g = 15
(a) (b) (c)
wild type thin-limb thick-limb
body plan
module
limb
module
4 6
4. Morphogenetic Engineering: Devo-Evo
(a) (b) (c)
antennapedia duplication
(three-limb)
divergence
(short & long-limb)
PF
SA
1×1
tip p’= .05
GPF
GSA
3×3
p = .05
4 2
disc
6
PF
SA
1×1
tip p’= .1
PF
SA
1×1
tip p’= .03
GPF
GSA
3×3
p = .05
4 2
disc
6
GPF
GSA
1×1
p’= .05
tip
GPF
GSA
3×3
p = .05
4 2
disc
GPF
GSA
1×1
p’= .05
tip
4
2
6
 Qualitative mutations: limb position and differentiation
antennapedia homology by duplication divergence of the homology
4. Morphogenetic Engineering: Devo-Evo
production
of structural
innovation
Changing the agents’ self-architecting rules through evolution
by tinkering with the genotype, new architectures (phenotypes) can be obtained
Doursat (2009)
18th GECCO, Montreal
4. Morphogenetic Engineering: Devo-Evo
75
(Delile,
Doursat,
Peyrieras)
 More accurate mechanics
 3-D
 individual cell shapes
 collective motion, migration
 adhesion
 Better gene regulation
 recurrent links
 gene reuse
 kinetic reaction ODEs
 attractor dynamics
switch
combo 1
switch
combo 2
after
David
Kingsley,
in
Carroll,
S.
B.
(2005)
Endless
Forms
Most
Beautiful,
p125
4. Morphogenetic Engineering: Devo-MecaGen
 3D particle-based mechanics
 kinetic-based gene regulation
simulations by
Julien Delile
PhD student: Julien Delile (FdV, DGA), co-supervised by
• Nadine Peyriéras, CNRS Gif s/Yvette
• (Stéphane Doncieux, LIP6)
 Multi-agent embryogenesis
4. Morphogenetic Engineering: Devo-MecaGen
4. Morphogenetic Engineering: Devo-Bots
 Morphogenetic swarm robotics: toward structured robot
flocking
 using “e-pucks”
Current collaboration with
• Alan Winfield, Bristol Robotics Lab, UWE
• Wenguo Liu, Bristol Robotics Lab, UWE
La prise en compte du spatial
[Même] si pour l'instant la biologie synthétique se focalise sur la «
programmation d'une seule bactérie », le développement de biosystèmes un
tant soit peu complexe reposera sur le fonctionnement intégré de colonies
bactériennes et donc sur la prise en compte d'interactions spatiales au sein
d'une population de cellules différenciées. [...]
La maîtrise des interactions spatiales ouvre la voie à une ingénierie du
développement [biologique], ce qui permet de rêver à des applications qui
vont bien au-delà de la conception de la cellule comme « usine chimique ».
Projet SynBioTIC, 2010
ANR Project with (among others)
• Jean-Louis Giavitto, ex-IBISC, Evry
• Oliver Michel, A. Spicher, LACL, Creteil
• Franck Delaplace, Evry ... et al.
 Synthetic Biological SysTems: from DesIgn to Compilation
PROTO
 ex: spatial computing languages: PROTO (Beal) and MGS (Giavitto)
4. Morphogenetic Engineering: Devo-SynBioTIC
79
Generalizing morphogenesis to self-building networks by
programmable attachment of nodes
single-node
composite branching
clustered
composite branching
iterative lattice pile-up
Doursat & Ulieru (2008)
Autonomics 2008, Turin
4. Morphogenetic Engineering: ProgNet
Order
influenced (not
imposed) by the
environment
4. Morphogenetic Engineering: ProgNet
with Mihalea Ulieru
and Adam MacDonald
freely growing
structure
 Evolution: inventing new architectures
"wildtype"
ruleset A
ruleset A
(b) (b)
ruleset A’
ruleset A"
 Polymorphism: reacting and adapting to the environment
 Development: growing an intrinsic architecture
Ulieru
&
Doursat
(2010)
ACM
TAAS
simulation
by
Adam
MacDonald,
UNB
Afer 20 mutations :
New set of rules :
open left port
if a rock is on the left then open top port
if a rock is on the right then close top port
Starting rules :
open left port, open right port
Mutations of the rules
 Creation
 Deletion
 Modification
 Order change
 Constants’ change
4. Morphogenetic Engineering: ProgNet
with David Fourquet
N=0
N = 100 mutations
N = 300 mutations
if top gradient = 0 mod (width) open right port
if right gradient = 0 modulo (periodicity) open top port
if rock on the left open top port
if rock on the right open left port
width = 8, periodicity = 5
if top gradient = 0 mod (width) open right port
if right gradient = 0 modulo (periodicity) open top port
if top gradient = width close top port
if right gradient = length close right port
if rock on top open left port
if bottom gradient > new_cst and rock at right open left port
length = 20 , width = 8, periodicity = 5, new_cst = 9
if left gradient = 0 open right port
if right gradient = 0 modulo (periodicity) open top port
if top gradient > 0 close right port
if top gradient = width open right port
if right gradient >= length close right port
if top gradient >= width close top port
length = 20 , width = 10, periodicity = 5
 Engineering Complex Socio-
Technical Adaptive SYstems
Submitted FET-ICT Open Project with
• Jeremy Pitt, Imperial College, London
• Andrzej Nowak, U Warsaw
• Mihaela Ulieru, Canada Research Chair
The ECSTASY project is about the science of socio-technical combinatorics
underpinning the ICT for engineering such scenarios.
We define socio-technical combinatorics as the study of the potentially infinite
number of discrete and reconfigurable physical, behavioural and
organisational structures which characterise socio-technical systems
comprising humans, sensors, and agents.
It is also the study of how these structures interact with each other and their
environment – how they assemble, evolve, dis-assemble, and re-assemble,
and how they can be engineered.
Projet ECSTASY, 2011
4. Morphogenetic Engineering: ECSTASY
4. Morphogenetic Engineering (ME)
a) Giving agents self-identifying and self-positioning abilities
 agents possess the same set of rules but execute different subsets
depending on their position = "differentiation" in cells, "stigmergy" in insects
b) ME brings a new focus on "complex systems engineering"
 exploring the artificial design and implementation of autonomous systems
capable of developing sophisticated, heterogeneous morphologies or
architectures without central planning or external lead
Summary: ME is about programming the agents of emergence
 swarm robotics,
modular/reconfigurable robotics
 mobile ad hoc networks,
sensor-actuator networks
 synthetic biology, etc.
c) Related emerging ICT disciplines and application domains
 amorphous/spatial computing (MIT)
 organic computing (DFG, Germany)
 pervasive adaptation (FET, EU)
 ubiquitous computing (PARC)
 programmable matter (CMU)
http://iscpif.fr/MEW2009
1st “Morphogenetic Engineering” Workshop, ISC,Paris 2009
http://iridia.ulb.ac.be/ants2010
2nd “Morphogenetic Engineering” Session, ANTS 2010, Brussels
“Morphogenetic Engineering” Book, 2012, Springer
R. Doursat, H. Sayama & O. Michel, eds.
http://ecal11.org/workshops#mew
3rd “Morphogenetic Engineering” Workshop, ECAL 2011, Paris
4. Morphogenetic Engineering (ME)
4. Morphogenetic
Engineering
From cells and insects to
robots and networks
5. Bio-Inspiration and
Artificial Evo-Devo
Or how to control
spontaneity
3. Architecture Without
Architects
Self-organized systems that
look like they were designed
1. What are Complex Systems?
• Decentralization
• Emergence
• Self-organization
2. Architects Overtaken
by their Architecture
Designed systems that
became suddenly complex
but were not
ARCHITECTURE & SELF-ORGANIZATION

More Related Content

Similar to IRIDIA_S12_Morphogenetic_Engineering_slides.pdf

From Circuit Theory to System Theory
From Circuit Theory to System Theory From Circuit Theory to System Theory
From Circuit Theory to System Theory Sporsho
 
Rzevsky agent models of large systems
Rzevsky  agent models of large systemsRzevsky  agent models of large systems
Rzevsky agent models of large systemsMasha Rudnichenko
 
Shape of Sound: Sound is Energy.waves.hMa
Shape of Sound: Sound is Energy.waves.hMaShape of Sound: Sound is Energy.waves.hMa
Shape of Sound: Sound is Energy.waves.hMavictoria meyers
 
hMa: architecture is energy waves
hMa:  architecture is energy waveshMa:  architecture is energy waves
hMa: architecture is energy wavesvictoria meyers
 
Meaning of system
Meaning of systemMeaning of system
Meaning of systemAafaq Malik
 
Discovering the World of Complexity
Discovering the World of ComplexityDiscovering the World of Complexity
Discovering the World of ComplexityTathagat Varma
 
Complexity Número especial da Nature Physics Insight sobre complexidade
Complexity  Número especial da Nature Physics Insight sobre complexidadeComplexity  Número especial da Nature Physics Insight sobre complexidade
Complexity Número especial da Nature Physics Insight sobre complexidadeaugustodefranco .
 
Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...
Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...
Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...Bruce Damer
 
NG2S: A Study of Pro-Environmental Tipping Point via ABMs
NG2S: A Study of Pro-Environmental Tipping Point via ABMsNG2S: A Study of Pro-Environmental Tipping Point via ABMs
NG2S: A Study of Pro-Environmental Tipping Point via ABMsKan Yuenyong
 
Toward a theory of chaos
Toward a theory of chaosToward a theory of chaos
Toward a theory of chaosSergio Zaina
 
Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...
Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...
Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...Bruce Damer
 
The Quantum Mindset
The Quantum MindsetThe Quantum Mindset
The Quantum MindsetMelanie Swan
 
Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...
Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...
Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...ArchiLab 7
 
Antoniou: complex systems and web
Antoniou: complex systems and webAntoniou: complex systems and web
Antoniou: complex systems and webOKFN-GR
 
Week 12 future computing 2014 tr2
Week 12 future computing 2014 tr2Week 12 future computing 2014 tr2
Week 12 future computing 2014 tr2karenmclaughlin1961
 
Linguistics models for system analysis- Chuluundorj.B
Linguistics models for system analysis- Chuluundorj.BLinguistics models for system analysis- Chuluundorj.B
Linguistics models for system analysis- Chuluundorj.BKhulan Jugder
 
Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)
Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)
Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)Bruce Damer
 

Similar to IRIDIA_S12_Morphogenetic_Engineering_slides.pdf (20)

Cyberinfrastructure for Einstein's Equations and Beyond
Cyberinfrastructure for Einstein's Equations and BeyondCyberinfrastructure for Einstein's Equations and Beyond
Cyberinfrastructure for Einstein's Equations and Beyond
 
From Circuit Theory to System Theory
From Circuit Theory to System Theory From Circuit Theory to System Theory
From Circuit Theory to System Theory
 
Rzevsky agent models of large systems
Rzevsky  agent models of large systemsRzevsky  agent models of large systems
Rzevsky agent models of large systems
 
Shape of Sound: Sound is Energy.waves.hMa
Shape of Sound: Sound is Energy.waves.hMaShape of Sound: Sound is Energy.waves.hMa
Shape of Sound: Sound is Energy.waves.hMa
 
hMa: architecture is energy waves
hMa:  architecture is energy waveshMa:  architecture is energy waves
hMa: architecture is energy waves
 
Meaning of system
Meaning of systemMeaning of system
Meaning of system
 
Academic Course: 02 Self-organization and emergence in networked systems
Academic Course: 02 Self-organization and emergence in networked systemsAcademic Course: 02 Self-organization and emergence in networked systems
Academic Course: 02 Self-organization and emergence in networked systems
 
Discovering the World of Complexity
Discovering the World of ComplexityDiscovering the World of Complexity
Discovering the World of Complexity
 
Complexity Número especial da Nature Physics Insight sobre complexidade
Complexity  Número especial da Nature Physics Insight sobre complexidadeComplexity  Número especial da Nature Physics Insight sobre complexidade
Complexity Número especial da Nature Physics Insight sobre complexidade
 
Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...
Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...
Bruce Damer's talk on the Von Neumann Bottleneck to the Singularity Universit...
 
NG2S: A Study of Pro-Environmental Tipping Point via ABMs
NG2S: A Study of Pro-Environmental Tipping Point via ABMsNG2S: A Study of Pro-Environmental Tipping Point via ABMs
NG2S: A Study of Pro-Environmental Tipping Point via ABMs
 
Toward a theory of chaos
Toward a theory of chaosToward a theory of chaos
Toward a theory of chaos
 
Datalife
DatalifeDatalife
Datalife
 
Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...
Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...
Bruce Damer's talk at EE380, the Stanford University Computer Systems Colloqu...
 
The Quantum Mindset
The Quantum MindsetThe Quantum Mindset
The Quantum Mindset
 
Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...
Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...
Miranda p 2000: swarm modelling_the use of swarm intelligence to generate arc...
 
Antoniou: complex systems and web
Antoniou: complex systems and webAntoniou: complex systems and web
Antoniou: complex systems and web
 
Week 12 future computing 2014 tr2
Week 12 future computing 2014 tr2Week 12 future computing 2014 tr2
Week 12 future computing 2014 tr2
 
Linguistics models for system analysis- Chuluundorj.B
Linguistics models for system analysis- Chuluundorj.BLinguistics models for system analysis- Chuluundorj.B
Linguistics models for system analysis- Chuluundorj.B
 
Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)
Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)
Bruce Damer's talk at the CONTACT2012 conference (March 30, 2012)
 

Recently uploaded

Call Girl Service In Dubai #$# O56521286O #$# Dubai Call Girls
Call Girl Service In Dubai #$# O56521286O #$# Dubai Call GirlsCall Girl Service In Dubai #$# O56521286O #$# Dubai Call Girls
Call Girl Service In Dubai #$# O56521286O #$# Dubai Call Girlsparisharma5056
 
FULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | DelhiFULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | DelhiMalviyaNagarCallGirl
 
Bridge Fight Board by Daniel Johnson dtjohnsonart.com
Bridge Fight Board by Daniel Johnson dtjohnsonart.comBridge Fight Board by Daniel Johnson dtjohnsonart.com
Bridge Fight Board by Daniel Johnson dtjohnsonart.comthephillipta
 
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...anilsa9823
 
Akola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service AkolaAkola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service Akolasrsj9000
 
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad EscortsCall girls in Ahmedabad High profile
 
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...anilsa9823
 
Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...
Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...
Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...dajasot375
 
Patrakarpuram ) Cheap Call Girls In Lucknow (Adult Only) 🧈 8923113531 𓀓 Esco...
Patrakarpuram ) Cheap Call Girls In Lucknow  (Adult Only) 🧈 8923113531 𓀓 Esco...Patrakarpuram ) Cheap Call Girls In Lucknow  (Adult Only) 🧈 8923113531 𓀓 Esco...
Patrakarpuram ) Cheap Call Girls In Lucknow (Adult Only) 🧈 8923113531 𓀓 Esco...akbard9823
 
FULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | DelhiFULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | DelhiMalviyaNagarCallGirl
 
FULL ENJOY - 9953040155 Call Girls in Indirapuram | Delhi
FULL ENJOY - 9953040155 Call Girls in Indirapuram | DelhiFULL ENJOY - 9953040155 Call Girls in Indirapuram | Delhi
FULL ENJOY - 9953040155 Call Girls in Indirapuram | DelhiMalviyaNagarCallGirl
 
exhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptxexhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptxKurikulumPenilaian
 
RAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAKRAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAKedwardsara83
 
Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...
Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...
Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...anilsa9823
 
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...wdefrd
 
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...akbard9823
 
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service HisarVip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisarsrsj9000
 
FULL ENJOY - 9953040155 Call Girls in Mahipalpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Mahipalpur | DelhiFULL ENJOY - 9953040155 Call Girls in Mahipalpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Mahipalpur | DelhiMalviyaNagarCallGirl
 
FULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | DelhiFULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | DelhiMalviyaNagarCallGirl
 

Recently uploaded (20)

Call Girl Service In Dubai #$# O56521286O #$# Dubai Call Girls
Call Girl Service In Dubai #$# O56521286O #$# Dubai Call GirlsCall Girl Service In Dubai #$# O56521286O #$# Dubai Call Girls
Call Girl Service In Dubai #$# O56521286O #$# Dubai Call Girls
 
FULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | DelhiFULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in Laxmi Nagar | Delhi
 
Bridge Fight Board by Daniel Johnson dtjohnsonart.com
Bridge Fight Board by Daniel Johnson dtjohnsonart.comBridge Fight Board by Daniel Johnson dtjohnsonart.com
Bridge Fight Board by Daniel Johnson dtjohnsonart.com
 
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
Lucknow 💋 Virgin Call Girls Lucknow | Book 8923113531 Extreme Naughty Call Gi...
 
Akola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service AkolaAkola Call Girls #9907093804 Contact Number Escorts Service Akola
Akola Call Girls #9907093804 Contact Number Escorts Service Akola
 
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
(NEHA) Call Girls Ahmedabad Booking Open 8617697112 Ahmedabad Escorts
 
Dxb Call Girls # +971529501107 # Call Girls In Dxb Dubai || (UAE)
Dxb Call Girls # +971529501107 # Call Girls In Dxb Dubai || (UAE)Dxb Call Girls # +971529501107 # Call Girls In Dxb Dubai || (UAE)
Dxb Call Girls # +971529501107 # Call Girls In Dxb Dubai || (UAE)
 
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
Lucknow 💋 Escorts Service Lucknow Phone No 8923113531 Elite Escort Service Av...
 
Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...
Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...
Call Girl in Bur Dubai O5286O4116 Indian Call Girls in Bur Dubai By VIP Bur D...
 
Patrakarpuram ) Cheap Call Girls In Lucknow (Adult Only) 🧈 8923113531 𓀓 Esco...
Patrakarpuram ) Cheap Call Girls In Lucknow  (Adult Only) 🧈 8923113531 𓀓 Esco...Patrakarpuram ) Cheap Call Girls In Lucknow  (Adult Only) 🧈 8923113531 𓀓 Esco...
Patrakarpuram ) Cheap Call Girls In Lucknow (Adult Only) 🧈 8923113531 𓀓 Esco...
 
FULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | DelhiFULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | Delhi
FULL ENJOY - 9953040155 Call Girls in New Ashok Nagar | Delhi
 
FULL ENJOY - 9953040155 Call Girls in Indirapuram | Delhi
FULL ENJOY - 9953040155 Call Girls in Indirapuram | DelhiFULL ENJOY - 9953040155 Call Girls in Indirapuram | Delhi
FULL ENJOY - 9953040155 Call Girls in Indirapuram | Delhi
 
exhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptxexhuma plot and synopsis from the exhuma movie.pptx
exhuma plot and synopsis from the exhuma movie.pptx
 
RAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAKRAK Call Girls Service # 971559085003 # Call Girl Service In RAK
RAK Call Girls Service # 971559085003 # Call Girl Service In RAK
 
Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...
Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...
Lucknow 💋 Cheap Call Girls In Lucknow Finest Escorts Service 8923113531 Avail...
 
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
Islamabad Escorts # 03080115551 # Escorts in Islamabad || Call Girls in Islam...
 
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
Hazratganj / Call Girl in Lucknow - Phone 🫗 8923113531 ☛ Escorts Service at 6...
 
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service HisarVip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
Vip Hisar Call Girls #9907093804 Contact Number Escorts Service Hisar
 
FULL ENJOY - 9953040155 Call Girls in Mahipalpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Mahipalpur | DelhiFULL ENJOY - 9953040155 Call Girls in Mahipalpur | Delhi
FULL ENJOY - 9953040155 Call Girls in Mahipalpur | Delhi
 
FULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | DelhiFULL ENJOY - 9953040155 Call Girls in Burari | Delhi
FULL ENJOY - 9953040155 Call Girls in Burari | Delhi
 

IRIDIA_S12_Morphogenetic_Engineering_slides.pdf

  • 1. VUB AI-Lab / ULB IRIDIA, Winter 2012 “Current Trends in Artificial Intelligence” Course Series Fall 2011 Complex Systems, Bio-Inspiration and Morphogenetic Engineering: New Avenues Toward Self-Organized Architecture René Doursat Research Group in Biomimetics, Universidad de Malaga, Spain Complex Systems Institute Paris, CNRS / CREA, Ecole Polytechnique
  • 2.
  • 3. Project “GroCyPhy”: Growing Cyber-Physical Systems (S. Stepney, J. Miller et al., York) Artist’s impression of a garden of fully grown, growing, and pruned skyscrapers “Skyscraper Garden” © David A. Hardy/www.astroart.org 2012
  • 4. SWARMORPH: Morphogenesis with Self-Assembling Robots (M. Dorigo, R. O’Grady et al., IRIDIA, ULB) SYMBRION: Symbiotic Evolutionary Robot Organisms (S. Kernbach, T. Schmickl, A. Winfield et al.)
  • 5. ARCHITECTURE & SELF-ORGANIZATION planned actitivities: civil engineering, mechanical engineering, electrical engineering, computer engineering, companies, (building) architecture, enterprise architecture, urbanism collective motion, swarm intelligence, pattern formation, complex (social) networks, spatial communities biological development, insect construction... ... robotic swarms, distributed software
  • 6. ARCHITECTURE & SELF-ORGANIZATION 1. What are Complex Systems? • Decentralization • Emergence • Self-organization
  • 7.  Any ideas? The School of Rock (2003) Jack Black, Paramount Pictures 1. What are Complex Systems?
  • 8. “simple” few simple Emergent Behavior Agents / Parts Local Rules Category A "Complex System"? complex few simple “simple” many simple complex “complex” many many complicated simple deterministic/ centralized many complicated  A simplified classification of complex systems 1. What are Complex Systems?
  • 9.  Few agents, “simple” emergent behavior Two bodies with similar mass Wikimedia Commons Two bodies with different mass Wikimedia Commons → ex: two-body problem  fully solvable and regular trajectories for inverse-square force laws (e.g., gravitational or electrostatic) 1. What are Complex Systems?
  • 10.  Few agents, complex emergent behavior NetLogo model: /Chemistry & Physics/Mechanics/Unverified Transit orbit of the planar circular restricted problem Scholarpedia: Three Body Problem & Joachim Köppen Kiel’s applet → ex: three-body problem  generally no exact mathematical solution (even in “restricted” case m1 〈〈 m2 ≈ m3): must be solved numerically → chaotic trajectories 1. What are Complex Systems?
  • 11.  Few agents, complex emergent behavior Logistic map Baker’s transformation Craig L. Zirbel, Bowling Green State University, OH → ex: more chaos (baker’s/horseshoe maps, logistic map, etc.)  chaos generally means a bounded, deterministic process that is aperiodic and sensitive on initial conditions → small fluctuations create large variations (“butterfly effect”)  even one-variable iterative functions: xn+1 = f(xn) can be “complex” 1. What are Complex Systems?
  • 12.  Many agents, simple rules, “simple” emergent behavior Diamond crystal structure Tonci Balic-Zunic, University of Copenhagen NetLogo model: /Chemistry & Physics/GasLab Isothermal Piston → ex: crystal and gas (covalent bonds or electrostatic forces)  either highly ordered, regular states (crystal)  or disordered, random, statistically homogeneous states (gas): a few global variables (P, V, T) suffice to describe the system 1. What are Complex Systems?
  • 13.  Many agents, simple rules, complex emergent behavior → ex: cellular automata, pattern formation, swarm intelligence (insect colonies, neural networks), complex networks, spatial communities  the “clichés” of complex systems: a major part of this course and NetLogo models 1. What are Complex Systems?
  • 14.  Many agents, complicated rules, complex emergent behavior → natural ex: organisms (cells), societies (individuals + techniques)  agent rules become more “complicated”, e.g., heterogeneous depending on the element’s type and/or position in the system  behavior is also complex but, paradoxically, can become more controllable, e.g., reproducible and programmable termite mounds companies techno-networks cities biological development & evolution 1. What are Complex Systems?
  • 15.  Many agents, complicated rules, complex emergent behavior Swarm chemistry Hiroki Sayama, Binghamton University SUNY → ex: self-organized “artificial life”: swarm chemistry, morphogenesis  in swarm chemistry (Sayama 2007), mixed self-propelled particles with different flocking parameters create nontrivial formations  in embryomorphic engineering (Doursat 2006), cells contain the same genetic program, but differentiate and self-assemble into specific shapes SA PF SA4 PF4 SA6 PF6 Embryomorphic engineering René Doursat, Insitut des Systèmes Complexes, Paris 1. What are Complex Systems?
  • 16.  Many agents, complicated rules, “deterministic” behavior  artifacts composed of a immense number of parts  yet still designed globally to behave in a limited and predictable (reliable, controllable) number of ways  "I don’t want my aircraft to be creatively emergent in mid-air"  not "complex" systems in the sense of:  little decentralization  no emergence  no self-organization Systems engineering Wikimedia Commons, http://en.wikipedia.org/wiki/Systems_engineering → classical engineering: electronics, machinery, aviation, civil construction 1. What are Complex Systems?
  • 17.  Many agents, complicated rules, “centralized” behavior → spectators, orchestras, military, administrations  people reacting similarly and/or simultaneously to cues/orders coming from a central cause: event, leader, plan  hardly "complex" systems: little decentralization, little emergence, little self-organization 1. What are Complex Systems?
  • 18. “simple” few simple 2-body problem NO Emergent Behavior Agents / Parts Local Rules Category A "Complex System"? complex few simple 3-body problem, low-D chaos NO – too small “simple” many simple crystal, gas NO – few params suffice to describe it complex “complex” many many complicated simple structured morphogenesis patterns, swarms, complex networks YES – reproducible and heterogeneous YES – but mostly random and uniform deterministic/ centralized many complicated machines, crowds with leaders COMPLICATED – not self-organized  Recap: complex systems in this course 1. What are Complex Systems?
  • 19. “simple” few simple 2-body problem NO Emergent Behavior Agents / Parts Local Rules Category A "Complex System"? complex few simple 3-body problem, low-D chaos NO – too small “simple” many simple crystal, gas NO – few params suffice to describe it complex “complex” many many complicated simple structured morphogenesis patterns, swarms, complex networks YES – reproducible and heterogeneous YES – but mostly random and uniform deterministic/ centralized many complicated machines, crowds with leaders COMPLICATED – not self-organized  Recap: complex systems in this course 1. What are Complex Systems?
  • 20.  large number of elementary agents interacting locally  (more or less) simple individual agent behaviors creating a complex emergent, self-organized behavior  decentralized dynamics: no master blueprint or grand architect  Complex systems in this course Internet & Web = host/page insect colonies = ant  physical, biological, technical, social systems (natural or artificial) pattern formation = matter biological development = cell social networks = person the brain & cognition = neuron 1. What are Complex Systems?
  • 21. Convection cells in liquid (detail) (Manuel Velarde, Universidad Complutense, Madrid) Sand dunes (Scott Camazine, http://www.scottcamazine.com) Solar magnetoconvection (Steven R. Lantz, Cornell Theory Center, NY) Rayleigh-Bénard convection cells in liquid heated uniformly from below (Scott Camazine, http://www.scottcamazine.com) Physical pattern formation: Convection cells WHAT? Hexagonal arrangement of sand dunes (Solé and Goodwin, “Signs of Life”, Perseus Books) Schematic convection dynamics (Arunn Narasimhan, Southern Methodist University, TX) ∆T HOW?  thermal convection, due to temperature gradients, creates stripes and tilings at multiple scales, from tea cups to geo- and astrophysics 1. What are Complex Systems?
  • 22. Mammal fur, seashells, and insect wings (Scott Camazine, http://www.scottcamazine.com) Biological pattern formation: Animal colors WHAT? ctivator nhibitor NetLogo fur coat simulation, after David Young’s model of fur spots and stripes (Michael Frame & Benoit Mandelbrot, Yale University)  animal patterns (for warning, mimicry, attraction) can be caused by pigment cells trying to copy their nearest neighbors but differentiating from farther cells HOW? 1. What are Complex Systems?
  • 23. Animation of a functional MRI study (J. Ellermann, J. Strupp, K. Ugurbil, U Minnesota) WHAT?  the brain constantly generates patterns of activity (“the mind”)  they emerge from 100 billion neurons that exchange electrical signals via a dense network of contacts Spatiotemporal synchronization: Neural networks Pyramidal neurons & interneurons (Ramón y Cajal 1900) Cortical layers HOW? Schematic neural network 1. What are Complex Systems?
  • 24. Swarm intelligence: Insect colonies (ant trails, termite mounds) Termite mound (J. McLaughlin, Penn State University) http://cas.bellarmine.edu/tietjen/ TermiteMound%20CS.gif Termite stigmergy (after Paul Grassé; from Solé and Goodwin, “Signs of Life”, Perseus Books)  termite colonies build complex mounds by “stigmergy” Harvester ant (Deborah Gordon, Stanford University) http://taos-telecommunity.org/epow/epow-archive/ archive_2003/EPOW-030811_files/matabele_ants.jpg http://picasaweb.google.com/ tridentoriginal/Ghana HOW? WHAT?  ants form trails by following and reinforcing each other’s pheromone path 1. What are Complex Systems?
  • 25. Bison herd (Center for Bison Studies, Montana State University, Bozeman) Fish school (Eric T. Schultz, University of Connecticut) Collective motion: flocking, schooling, herding WHAT? Separation, alignment and cohesion (“Boids” model, Craig Reynolds, http://www.red3d.com/cwr/boids) S A C  each individual adjusts its position, orientation and speed according to its nearest neighbors HOW?  coordinated collective movement of dozens or 1000s of individuals (confuse predators, close in on prey, improve motion efficiency, etc.) 1. What are Complex Systems?
  • 26. Complex networks and morphodynamics: human organizations SimCity (http://simcitysocieties.ea.com) organizations urban dynamics (Thomas Thü Hürlimann, http://ecliptic.ch) NSFNet Internet (w2.eff.org) techno-social networks global connectivity WHAT? NetLogo urban sprawl simulation NetLogo preferential attachment simulation cellular automata model “scale-free” network model HOW? 1. What are Complex Systems?
  • 27. 1. What Are Complex Systems? the brain organisms ant trails termite mounds animal flocks cities, populations social networks markets, economy Internet, Web physical patterns living cell biological patterns animals humans & tech molecules cells  All agent types: molecules, cells, animals, humans & tech
  • 28. Categories of complex systems by range of interactions the brain organisms ant trails termite mounds animal flocks physical patterns living cell biological patterns 2D, 3D spatial range non-spatial, hybrid range cities, populations social networks markets, economy Internet, Web 1. What Are Complex Systems?
  • 29. the brain organisms ant trails termite mounds animal flocks physical patterns living cell biological patterns cities, populations social networks markets, economy Internet, Web Natural and human-caused categories of complex systems  ... yet, even human-caused systems are “natural” in the sense of their unplanned, spontaneous emergence 1. What Are Complex Systems?
  • 30.  Emergence on multiple levels of self-organization 1. What Are Complex Systems? complex systems: a) a large number of elementary agents interacting locally b) simple individual behaviors creating a complex emergent collective behavior c) decentralized dynamics: no master blueprint or grand architect
  • 31.  From genotype to phenotype, via development 1. What Are Complex Systems? × × → →
  • 32. 1. What Are Complex Systems? . . . . . . Ramón y Cajal 1900  From neurons to brain, via neural development (anatomy)
  • 33. 1. What Are Complex Systems? ctivator nhibitor  From pigment cells to coat patterns, via reaction-diffusion
  • 34.  From social insects to swarm intelligence, via stigmergy 1. What Are Complex Systems?
  • 35.  From birds to flocks, via flocking 1. What Are Complex Systems? separation alignment cohesion
  • 36.  there are a lot of theories and results in related disciplines (“systems theory”, “computational complexity”, etc.), yet  such generic names often come from one researcher with one particular view  there is no unified viewpoint on complex systems, especially autonomous  in fact, there is not even any agreement on their definition  So, there is no general “complex systems science” or “complexity theory”...  we are currently dealing with an intuitive set of criteria, more or less shared by researchers, but still hard to formalize and quantify:  complexity  emergence  self-organization  multitude / decentralization  adaptation, etc. 1. What Are Complex Systems?
  • 37. Paris Ile-de-France Lyon Rhône-Alpes National 4th French Complex Systems Summer School, 2010
  • 38. 38 mathematical neuroscience artificial life / neural computing statistical mechanics / collective motion structural genomics computational evolution / development social networks peer-to-peer networks high performance computing complex networks / cellular automata embryogenesis web mining / social intelligence spiking neural dynamics spatial networks / swarm intelligence active matter / complex networks Resident Researchers urban systems / innovation networks nonlinear dynamics / oceanography
  • 39. 39 Visualization of Research Networks (from D. Chavalarias)
  • 40. 1. What are Complex Systems? dynamics: behavior and activity of a system over time multitude, statistics: large-scale properties of systems adaptation: change in typical functional regime of a system systems sciences: holistic (non- reductionist) view on interacting parts complexity: measuring the length to describe, time to build, or resources to run, a system A vast archipelago of precursor and neighboring disciplines  different families of disciplines focus on different aspects  (naturally, they intersect a lot: don’t take this taxonomy too seriously)
  • 41. dynamics: behavior and activity of a system over time multitude, statistics: large-scale properties of systems adaptation: change in typical functional regime of a system complexity: measuring the length to describe, time to build, or resources to run, a system dynamics: behavior and activity of a system over time  nonlinear dynamics & chaos  stochastic processes  systems dynamics (macro variables) adaptation: change in typical functional regime of a system  evolutionary methods  genetic algorithms  machine learning complexity: measuring the length to describe, time to build, or resources to run, a system  information theory (Shannon; entropy)  computational complexity (P, NP)  Turing machines & cellular automata systems sciences: holistic (non- reductionist) view on interacting parts systems sciences: holistic (non- reductionist) view on interacting parts  systems theory (von Bertalanffy)  systems engineering(design)  cybernetics (Wiener; goals & feedback)  control theory (negative feedback) → Toward a unified “complex systems” science and engineering? multitude, statistics: large-scale properties of systems  graph theory & networks  statistical physics  agent-based modeling  distributed AI systems 1. What are Complex Systems? A vast archipelago of precursor and neighboring disciplines
  • 42. 1. What are Complex Systems? • Decentralization • Emergence • Self-organization 5. Bio-Inspiration and Artificial Evo-Devo Or how to control spontaneity ARCHITECTURE & SELF-ORGANIZATION
  • 43.  Between natural and engineered emergence CS engineering: creating and programming a new "artificial" emergence → Multi-Agent Systems (MAS) CS science: observing and understanding "natural", spontaneous emergence (including human-caused) → Agent-Based Modeling (ABM) CS computation: fostering and guiding complex systems at the level of their elements 5. Bio-Inspiration and Artificial Evo-Devo But CS computation is not without paradoxes: • Can we plan autonomy? • Can we control decentralization? • Can we program adaptation?
  • 44. ex: genes & evolution laws of genetics genetic program, binary code, mutation genetic algorithms (GAs), evolutionary computation for search & optimization ex: neurons & brain biological neural models binary neuron, linear synapse artificial neural networks (ANNs) applied to machine learning & classification ex: ant colonies trail formation, swarming agents that move, deposit & follow “pheromone” ant colony optimization (ACO) applied to graph theoretic & networking problems  Exporting models of natural complex systems to ICT  already a tradition, but mostly in offline search and optimization TODAY: simulated in a Turing machine / von Neumann architecture ABM MAS 5. Bio-Inspiration and Artificial Evo-Devo
  • 45.  Exporting natural complex systems to ICT  ... looping back onto unconventional physical implementation genetic algorithms (GAs), evolutionary computation for search & optimization artificial neural networks (ANNs) applied to machine learning & classification ant colony optimization (ACO) applied to graph theoretic & networking problems DNA computing synthetic biology chemical, wave-based computing TOMORROW: implemented in bioware, nanoware, etc. 5. Bio-Inspiration and Artificial Evo-Devo
  • 46. ... or bioware, nanoware, etc. whether Turing machine... genetics evolution Nadine Peyriéras, Paul Bourgine et al. (Embryomics & BioEmergences) evolution Ulieru & Doursat (2010) ACM TAAS simulation by Adam MacDonald, UNB Doursat (2008) ALIFE XI, WInchester  A new line of bio-inspiration: biological morphogenesis  designing multi-agent models for decentralized systems engineering Morphogenetic Engineering 5. Bio-Inspiration and Artificial Evo-Devo development
  • 47. 1. What are Complex Systems? • Decentralization • Emergence • Self-organization 2. Architects Overtaken by their Architecture Designed systems that became suddenly complex Complex systems seem so different from architected systems, and yet... 5. Bio-Inspiration and Artificial Evo-Devo Or how to control spontaneity 3. Architecture Without Architects Self-organized systems that look like they were designed ARCHITECTURE & SELF-ORGANIZATION
  • 48. cities, populations Internet, Web social networks markets, economy companies, institutions address books houses, buildings computers, routers 2. Architects Overtaken by their Architecture  At large scales, human superstructures are "natural" CS ... arising from a multitude of traditionally designed artifacts houses, buildings address books companies, institutions computers, routers large-scale emergence small to mid- scale artifacts by their unplanned, spontaneous emergence and adaptivity... geography: cities, populations people: social networks wealth: markets, economy technology: Internet, Web
  • 49. 2. Architects Overtaken by their Architecture  At mid-scales, human artifacts are classically architected  a goal-oriented, top-down process toward one solution behaving in a limited # of ways  specification & design: hierarchical view of the entire system, exact placement of elts  testing & validation: controllability, reliability, predictability, optimality ArchiMate EA example  the (very) "complicated" systems of classical engineering and social centralization  electronics, machinery, aviation, civil construction, etc.  spectators, orchestras, administrations, military (reacting to external cues/leader/plan)  not "complex" systems:  little/no decentralization, little/no emergence, little/no self-organization  New inflation: artifacts/orgs made of a huge number of parts Systems engineering Wikimedia Commons
  • 50. ... and enterprise architecture? number of transistors/year in hardware, software, agents, objects, services number of O/S lines of code/year networks... number of network hosts/year  Burst to large scale: de facto complexification of ICT systems  ineluctable breakup into, and proliferation of, modules/components 2. Architects Overtaken by their Architecture → trying to keep the lid on complexity won’t work in these systems:  cannot place every part anymore  cannot foresee every event anymore  cannot control every process anymore ... but do we still want to?
  • 51.  Large-scale: de facto complexification of organizations, via techno-social networks  ubiquitous ICT capabilities connect people and infrastructure in unprecedented ways  giving rise to complex techno-social "ecosystems" composed of a multitude of human users and computing devices 2. Architects Overtaken by their Architecture → in this context, impossible to assign every single participant a predetermined role  healthcare  energy & environment  education  defense & security  business  finance  from a centralized oligarchy of providers of data, knowledge, management, information, energy  to a dense heterarchy of proactive participants: patients, students, employees, users, consumers, etc.  explosion in size and complexity in all domains of society:
  • 52. 3. Architecture Without Architects Self-organized systems that look like they were designed 1. What are Complex Systems? • Decentralization • Emergence • Self-organization 2. Architects Overtaken by their Architecture Designed systems that became suddenly complex but were not Complex systems seem so different from architected systems, and yet... 5. Bio-Inspiration and Artificial Evo-Devo Or how to control spontaneity ARCHITECTURE & SELF-ORGANIZATION
  • 53.  ... yet, even human-caused systems are "natural" in the sense of their unplanned, spontaneous emergence the brain organisms ant trails termite mounds animal flocks physical patterns living cell biological patterns  biology strikingly demonstrates the possibility of combining pure self-organization and elaborate architecture, i.e.:  a non-trivial, sophisticated morphology  hierarchical (multi-scale): regions, parts, details  modular: reuse of parts, quasi-repetition  heterogeneous: differentiation, division of labor  random at agent level, reproducible at system level 3. Architecture Without Architects  "Simple"/random vs. architectured complex systems
  • 54.  Ex: Morphogenesis – Biological development  cells build sophisticated organisms by division, genetic differentiation and biomechanical self- assembly Nadine Peyriéras, Paul Bourgine et al. (Embryomics & BioEmergences) www.infovisual.info architecture Termite mound (J. McLaughlin, Penn State University) http://cas.bellarmine.edu/tietjen/ TermiteMound%20CS.gif Termite stigmergy (after Paul Grassé; from Solé and Goodwin, "Signs of Life", Perseus Books)  termite colonies build sophisticated mounds by "stigmergy" = loop between modifying the environment and reacting differently to these modifications  Ex: Swarm intelligence – Termite mounds architecture 3. Architecture Without Architects
  • 55.  Complex systems can possess a strong architecture, too  "complex" doesn’t imply "flat"... → modular, hierarchical, detailed architecture  "complex" doesn’t imply "random"... → reproducible patterns relying on programmable agents  "complex" doesn’t imply "homogeneous"... → heterogeneous agents and diverse patterns, via positions → cells and social insects have successfully "aligned business and infrastructure" for millions of years without any architect telling them how to transport royal chamber fungus gardens reproduce defend queen ventilation shaft worker soldier nursery galleries build (mockup) EA-style diagram of a termite mound architecture but then what does it mean for a module to be an "emergence" of many fine-grain agents? 3. Architecture Without Architects
  • 56. Pattern Formation → Morphogenesis “I have the stripes, but where is the zebra?” OR “The stripes are easy, it’s the horse part that troubles me” —attributed to A. Turing, after his 1952 paper on morphogenesis 3. Architecture Without Architects
  • 57. more self-organization more architecture gap to fill  Many self-organized systems exhibit random patterns... ... while "complicated" architecture is designed by humans (a) "simple"/random self-organization (d) direct design (top-down) NetLogo simulations: Fur, Slime, BZ Reaction, Flocking, Termite, Preferential Attachment 3. Architecture Without Architects
  • 58. artificial natural (b) natural self-organized architecture (c) engineered self-organization (bottom-up) . . . . . . . . more self-organization more architecture  Many self-organized systems exhibit random patterns...  Can we transfer some of their principles to human-made systems and organizations?  The only natural emergent and structured CS are biological  self-forming robot swarm  self-programming software  self-connecting micro-components  self-reconfiguring manufacturing plant  self-stabilizing energy grid  self-deploying emergency taskforce  self-architecting enterprise SYMBRION Project 3. Architecture Without Architects
  • 59. 3. Architecture Without Architects Self-organized systems that look like they were designed 1. What are Complex Systems? • Decentralization • Emergence • Self-organization 2. Architects Overtaken by their Architecture Designed systems that became suddenly complex 4. Morphogenetic Engineering From cells and insects to robots and networks but were not 5. Bio-Inspiration and Artificial Evo-Devo Or how to control spontaneity ARCHITECTURE & SELF-ORGANIZATION
  • 60.  Sculpture → forms  Painting → colors  the forms are “sculpted” by the self- assembly of the elements, whose behavior is triggered by the colors  new color regions appear (domains of genetic expression) triggered by deformations “patterns from shaping” “shape from patterning” Ádám Szabó, The chicken or the egg (2005) http://www.szaboadam.hu A closer look at morphogenesis: it couples assembly and patterning 4. Morphogenetic Engineering
  • 61.  Genetic regulation PROT A PROT B GENE I PROT C "key" "lock" schema after Carroll, S. B. (2005) “Endless Forms Most Beautiful”, p117 GENE A GENE B GENE C A B X Y I Tensional integrity Donald Ingber, Harvard Cellular Potts model Graner, Glazier, Hogeweg http://www.compucell3d.org GENE I Drosophila embryo GENE C GENE A GENE B Deformable volume Doursat, simul. by Delile A closer look at morphogenesis: ⇔ it couples mechanics and genetics Spring-mass model Doursat (2009) ALIFE XI  Cellular mechanics  adhesion  deformation / reformation  migration (motility)  division / death 4. Morphogenetic Engineering
  • 62. grad1 div1 patt1 div2 grad2 patt2 div3 grad3 patt3 ...  Alternation of self- positioning (div) and self- identifying (grad/patt) genotype Capturing the essence of morphogenesis in an Artificial Life agent model each agent follows the same set of self-architecting rules (the "genotype") but reacts differently depending on its neighbors 4. Morphogenetic Engineering Doursat (2009) 18th GECCO
  • 64. 4. Morphogenetic Engineering p A B V r r0 re rc div GSA: rc < re = 1 << r0 p = 0.05 . 1 0 cd cd cd cd r k m r r r r    η −         − − = . 1 2 2 0 cd cd cd d c r k r r r r r         − − = ∆ = ∆ − = ∆ η ⇓
  • 66. I4 I6 B4 B3 patt X Y . . . I3 I4 I5 . . . B1 B2 B4 B3 wix,iy GPF : {w } wki WE NS 4. Morphogenetic Engineering
  • 67. I9 I1 (a) (b) (c) . . . . . . WE = X NS = Y B1 B2 B3 B4 I3 I4 I5 X Y . . . I3 I4 I5 . . . B1 B2 B4 B3 wiX,Y GPF wki  Programmed patterning (patt): the hidden embryo atlas a) same swarm in different colormaps to visualize the agents’ internal patterning variables X, Y, Bi and Ik (virtual in situ hybridization) b) consolidated view of all identity regions Ik for k = 1...9 c) gene regulatory network used by each agent to calculate its expression levels, here: B1 = σ(1/3 − X), B3 = σ(2/3 − Y), I4 = B1B3(1 − B4), etc. 4. Morphogenetic Engineering
  • 68. p A B V r r0 re rc div GSA : rc < re = 1 << r0 p = 0.05 I4 I6 B4 B3 grad patt E W S N E W WE WE NS X Y . . . I3 I4 I5 . . . B1 B2 B4 B3 wix,iy GPF : {w } wki WE NS Doursat (2008) ALIFE XI GSA ∪ GPF
  • 69.  details are not created in one shot, but gradually added. . .  . . . while, at the same time, the canvas grows from Coen, E. (2000) The Art of Genes, pp131-135 4. Morphogenetic Engineering  Morphological refinement by iterative growth
  • 70. I4 I6 E(4) W(6) I5 I4 I1 N(4) S(4) W(4) E(4) rc = .8, re = 1, r0 = ∞ r'e= r'0=1, p =.01 GSA SA PF SA4 PF4 SA6 PF6 4. Morphogenetic Engineering: Devo SA PF SA4 PF4 SA6 PF6 all cells have same GRN, but execute different expression paths → determination / differentiation microscopic (cell) randomness, but mesoscopic (region) predictability Doursat (2008) ALIFE XI, WInchester
  • 71. 4. Morphogenetic Engineering: Devo  Derivative projects ME: Devo-Evo ME: Devo-MecaGen ME: Devo-Bots ME: ProgNet ME: Devo-SynBioTIC ME: ProgNet-Ecstasy
  • 72.  Quantitative mutations: limb thickness GPF GSA 3×3 1, 1 p = .05 g = 15 4 6 disc GPF GSA 1×1 tip p’= .05 g’= 15 GPF GSA 1×1 tip p’= .05 g’= 15 GPF GSA 3×3 2, 1 4 6 disc p = .05 g = 15 GPF GSA 1×1 tip p’= .05 g’= 15 GPF GSA 3×3 0.5, 1 4 6 disc p = .05 g = 15 (a) (b) (c) wild type thin-limb thick-limb body plan module limb module 4 6 4. Morphogenetic Engineering: Devo-Evo
  • 73. (a) (b) (c) antennapedia duplication (three-limb) divergence (short & long-limb) PF SA 1×1 tip p’= .05 GPF GSA 3×3 p = .05 4 2 disc 6 PF SA 1×1 tip p’= .1 PF SA 1×1 tip p’= .03 GPF GSA 3×3 p = .05 4 2 disc 6 GPF GSA 1×1 p’= .05 tip GPF GSA 3×3 p = .05 4 2 disc GPF GSA 1×1 p’= .05 tip 4 2 6  Qualitative mutations: limb position and differentiation antennapedia homology by duplication divergence of the homology 4. Morphogenetic Engineering: Devo-Evo
  • 74. production of structural innovation Changing the agents’ self-architecting rules through evolution by tinkering with the genotype, new architectures (phenotypes) can be obtained Doursat (2009) 18th GECCO, Montreal 4. Morphogenetic Engineering: Devo-Evo
  • 75. 75 (Delile, Doursat, Peyrieras)  More accurate mechanics  3-D  individual cell shapes  collective motion, migration  adhesion  Better gene regulation  recurrent links  gene reuse  kinetic reaction ODEs  attractor dynamics switch combo 1 switch combo 2 after David Kingsley, in Carroll, S. B. (2005) Endless Forms Most Beautiful, p125 4. Morphogenetic Engineering: Devo-MecaGen
  • 76.  3D particle-based mechanics  kinetic-based gene regulation simulations by Julien Delile PhD student: Julien Delile (FdV, DGA), co-supervised by • Nadine Peyriéras, CNRS Gif s/Yvette • (Stéphane Doncieux, LIP6)  Multi-agent embryogenesis 4. Morphogenetic Engineering: Devo-MecaGen
  • 77. 4. Morphogenetic Engineering: Devo-Bots  Morphogenetic swarm robotics: toward structured robot flocking  using “e-pucks” Current collaboration with • Alan Winfield, Bristol Robotics Lab, UWE • Wenguo Liu, Bristol Robotics Lab, UWE
  • 78. La prise en compte du spatial [Même] si pour l'instant la biologie synthétique se focalise sur la « programmation d'une seule bactérie », le développement de biosystèmes un tant soit peu complexe reposera sur le fonctionnement intégré de colonies bactériennes et donc sur la prise en compte d'interactions spatiales au sein d'une population de cellules différenciées. [...] La maîtrise des interactions spatiales ouvre la voie à une ingénierie du développement [biologique], ce qui permet de rêver à des applications qui vont bien au-delà de la conception de la cellule comme « usine chimique ». Projet SynBioTIC, 2010 ANR Project with (among others) • Jean-Louis Giavitto, ex-IBISC, Evry • Oliver Michel, A. Spicher, LACL, Creteil • Franck Delaplace, Evry ... et al.  Synthetic Biological SysTems: from DesIgn to Compilation PROTO  ex: spatial computing languages: PROTO (Beal) and MGS (Giavitto) 4. Morphogenetic Engineering: Devo-SynBioTIC
  • 79. 79 Generalizing morphogenesis to self-building networks by programmable attachment of nodes single-node composite branching clustered composite branching iterative lattice pile-up Doursat & Ulieru (2008) Autonomics 2008, Turin 4. Morphogenetic Engineering: ProgNet
  • 80. Order influenced (not imposed) by the environment 4. Morphogenetic Engineering: ProgNet with Mihalea Ulieru and Adam MacDonald
  • 81. freely growing structure  Evolution: inventing new architectures "wildtype" ruleset A ruleset A (b) (b) ruleset A’ ruleset A"  Polymorphism: reacting and adapting to the environment  Development: growing an intrinsic architecture Ulieru & Doursat (2010) ACM TAAS simulation by Adam MacDonald, UNB
  • 82. Afer 20 mutations : New set of rules : open left port if a rock is on the left then open top port if a rock is on the right then close top port Starting rules : open left port, open right port Mutations of the rules  Creation  Deletion  Modification  Order change  Constants’ change 4. Morphogenetic Engineering: ProgNet with David Fourquet
  • 83. N=0 N = 100 mutations N = 300 mutations if top gradient = 0 mod (width) open right port if right gradient = 0 modulo (periodicity) open top port if rock on the left open top port if rock on the right open left port width = 8, periodicity = 5 if top gradient = 0 mod (width) open right port if right gradient = 0 modulo (periodicity) open top port if top gradient = width close top port if right gradient = length close right port if rock on top open left port if bottom gradient > new_cst and rock at right open left port length = 20 , width = 8, periodicity = 5, new_cst = 9 if left gradient = 0 open right port if right gradient = 0 modulo (periodicity) open top port if top gradient > 0 close right port if top gradient = width open right port if right gradient >= length close right port if top gradient >= width close top port length = 20 , width = 10, periodicity = 5
  • 84.  Engineering Complex Socio- Technical Adaptive SYstems Submitted FET-ICT Open Project with • Jeremy Pitt, Imperial College, London • Andrzej Nowak, U Warsaw • Mihaela Ulieru, Canada Research Chair The ECSTASY project is about the science of socio-technical combinatorics underpinning the ICT for engineering such scenarios. We define socio-technical combinatorics as the study of the potentially infinite number of discrete and reconfigurable physical, behavioural and organisational structures which characterise socio-technical systems comprising humans, sensors, and agents. It is also the study of how these structures interact with each other and their environment – how they assemble, evolve, dis-assemble, and re-assemble, and how they can be engineered. Projet ECSTASY, 2011 4. Morphogenetic Engineering: ECSTASY
  • 85. 4. Morphogenetic Engineering (ME) a) Giving agents self-identifying and self-positioning abilities  agents possess the same set of rules but execute different subsets depending on their position = "differentiation" in cells, "stigmergy" in insects b) ME brings a new focus on "complex systems engineering"  exploring the artificial design and implementation of autonomous systems capable of developing sophisticated, heterogeneous morphologies or architectures without central planning or external lead Summary: ME is about programming the agents of emergence  swarm robotics, modular/reconfigurable robotics  mobile ad hoc networks, sensor-actuator networks  synthetic biology, etc. c) Related emerging ICT disciplines and application domains  amorphous/spatial computing (MIT)  organic computing (DFG, Germany)  pervasive adaptation (FET, EU)  ubiquitous computing (PARC)  programmable matter (CMU)
  • 86. http://iscpif.fr/MEW2009 1st “Morphogenetic Engineering” Workshop, ISC,Paris 2009 http://iridia.ulb.ac.be/ants2010 2nd “Morphogenetic Engineering” Session, ANTS 2010, Brussels “Morphogenetic Engineering” Book, 2012, Springer R. Doursat, H. Sayama & O. Michel, eds. http://ecal11.org/workshops#mew 3rd “Morphogenetic Engineering” Workshop, ECAL 2011, Paris 4. Morphogenetic Engineering (ME)
  • 87. 4. Morphogenetic Engineering From cells and insects to robots and networks 5. Bio-Inspiration and Artificial Evo-Devo Or how to control spontaneity 3. Architecture Without Architects Self-organized systems that look like they were designed 1. What are Complex Systems? • Decentralization • Emergence • Self-organization 2. Architects Overtaken by their Architecture Designed systems that became suddenly complex but were not ARCHITECTURE & SELF-ORGANIZATION