You are on page 1of 8

DOI: http://dx.doi.org/10.

7551/978-0-262-31050-5-ch046

Brainless Bodies: Controlling the Development and Behavior of


Multicellular Animats by Gene Regulation and Diffusive Signals
M. Joachimczak1 , T. Kowaliw2 , R. Doursat2,3 , and B. Wrobel1,4,5
1
Systems Modeling Laboratory, IO PAN, Sopot, Poland
2
Institut des Systemes Complexes Paris Ile-de-France (ISC-PIF), CNRS, Paris, France
3
Research Group in Biomimetics (GEB), Universidad de Malaga, Spain
4
Evolutionary Systems Laboratory, Uniwersytet im. Adama Mickiewicza, Poznan, Poland
5
Institut fur Neuroinformatik, Universitat & ETH Zurich, Switzerland
Abstract assumption that knowledge about complex biological sys-
tems can be gained by first studying simpler organisms has
We present a model of parallel co-evolution of development proven tremendously successful. We share this view and, in
and motion control in soft-bodied, multicellular animats with- the present work, propose that in order to study body-brain
out neural networks. Development is guided by an artificial
gene regulatory network (GRN), with real-valued expression co-development more effectively, it is helpful to consider the
levels, contained in every cell. Embryos develop within a basic case of a body devoid of any nervous system. Our ap-
simulated physics environment and are converted into ani- proach is related to the investigation of minimal sets of be-
mat structures by connecting neighboring cells through elas- haviors that can still exhibit interesting cognitive abilities
tic springs. Outer cells, which form the external envelope, (minimal cognition; Beer, 1996). In this context, animats ca-
are affected by drag forces in a fluid-like environment. Both
the developmental program and locomotion controller are en- pable of executing non-trivial tasks are generated and tested
coded into a single genomic sequence, which consists of reg- on some cognitive challenge. For example, Dale and Hus-
ulatory regions and genes expressed into transcription factors bands (2009) describe a 1D animat that can perform shape
and morphogens. We apply a genetic algorithm to evolve in- discrimination with limited memory, using only a reaction-
dividuals able to swim in the simulated fluid, where the fitness diffusion system. Such systems are known to model many
depends on distance traveled during the evaluation phase.
We obtain various emergent morphologies and types of lo- developmental processes (Yamada et al., 2007; Lefevre and
comotion, some of them showing the use of rudimentary ap- Mangin, 2010), hence this choice is consistent with the view
pendages. An analysis of the selected evolved controllers is that regulation of development and regulation of behavior
provided. have mechanisms in common.

The present work brings several new aspects to the dis-


Introduction cussion of the relations between behavior and development,
The raison detre of the nervous systems is to allow for con- minimal cognition, and brain-body co-evolution. First,
trollable and adaptable movement, but adaptive locomotive we achieve an important step towards minimal cognition,
behavior exists in the absence of neurons as well. For exam- namely the coordinated behavior of multiple cells, based
ple, there is evidence that the movement of the multicellular on a biologically plausible model of gene regulatory net-
body of certain slime molds, such as Dictyostelium (social works (GRNs). Second, we utilize the same instance of
amoeba), results from a difference in activity between the GRN for both developmental and behavioral control. Our
anterior and posterior cells (Bonner, 2008). Dictyostelium experiments rely on a modeling and simulation platform
can respond to minute variations of light, temperature, and called GReaNs (for Genetic Regulatory evolving artificial
concentrations of ammonia and oxygen. In many cases it is Networks), which is dedicated to the study of GRN evo-
known that these stimuli affect the relative location of so- lution and evolutionary development based on a linear ge-
called organizer cells, which release a diffusive chemical nomic representation of GRNs. Two of us (Joachimczak
signal, the same signal used during the aggregation of single and Wrobel, 2011) have shown previously that GReaNs was
cells into the body (reviewed in Kessin, 2001). The relative successful at evolving asymmetrical multicellular structures
location of these organizers controls the activity level of the displaying asymmetrical patterning. We then applied the
cells across the body, which in turn controls the direction of same model of GRNs to signal processing (Joachimczak
motion. This impressive capacity of Dictyostelium for effec- and Wrobel, 2010b) and to directing the motion of uni-
tive and reactive behavior occurs without any nerve cells. cellular animats (Joachimczak and Wrobel, 2010a). In the
Dictyostelium is one of the most important model organ- present work, we rely on another recent extension of GRe-
isms in biology for the study of development because its aNs (Joachimczak and Wrobel, 2012) to model soft-bodied
structure is simple and the number of cell types limited. The multicellular animats in motion.

2012 Massachusetts Institute of Technology Artificial Life 13: 349356


Brainless Bodies: Controlling the Development and Behavior of Multicellular Animats by Gene Regulation and Diffusive Signals

On the spectrum of available developmental and genera- transcription factors and diffusive products; P elements are
tive systems, the GReaNs platform belongs to a relatively regulatory regions that control (promote or repress) the ex-
small family of models that attempt to retain some degree pression of G elements; and S elements are used as inputs
of biological realism (e.g., among others, Mjolsness et al., into, and outputs from, the network.
1991; Hogeweg, 2000; Salazar-Ciudad and Jernvall, 2002; A linear genome is parsed sequentially to build a GRN
Doursat, 2008). From the viewpoint of artificial life, these in which nodes correspond to regulatory units. A regula-
models belong to the cell chemistry approaches identified tory unit is a contiguous series of P elements followed by a
by Stanley and Miikkulainen (2003) in their taxonomic re- contiguous series of G elements in the genome. The factors
view of artificial embryogeny research. They all attempt to coded by G elements belonging to one unit have the same
combine the essential chemical and physical principles of concentration. As for S elements, they are each mapped
both genetic regulation and cellular mechanics, and to form to a separate node: when the S element corresponds to an
fine-grained agent-based modeling rules based on these prin- inputto a node with only one regulatory factor (an in-
ciples. In such models, the final shape and behavior of an put factor), when it corresponds to an outputto a node
organism are the result of complex interactions taking place with one regulatory region and one product (an output fac-
at several scales of abstraction. Generally, at the smallest tor). Output factors determine the actions performed by the
scale, each cell contains a genome that codes for gene prod- cell but do not have affinity to regulatory regions. Products
ucts and regulatory sites, and whose interactions (based on coded by G elements can have affinity to P elements or reg-
sequence-matching in GReaNs) can be mapped to a GRN. ulatory regions in output nodes. Factors coded by input S
On a mesoscopic level, the continuous, dynamic update of elements can only have affinity to P elements.
product concentrations in the cells leads to various types of The internal structure of each genetic element is com-
cell behavior, such as division and differentiation, as prod- posed of several fields (Fig. 1): a type field, which speci-
ucts in the genome build up or degrade over time. Finally, fies the exact type of the element (subtype of G, P or S);
the macroscopic shape and action of the organism emerges a sign field; and coordinate fields which specify a point in
from the physical interactions between neighboring cells, RN space (here N = 2). The affinity between a regulatory
which move in space during growth and motion. factor and a regulatory region is a decreasing exponential
In this study, we introduce in the GReaNs model the pos- function of the Euclidean distance between their 2D points
sibility that global patterns of cell activitythemselves the (weight reaches maximum 10 when points overlap), with a
product of interactions between controller cells, the physical cutoff value to prevent full connectivity (weight is 0 when
structure of the individual, and the properties of the simu- points are too far apart). The sign of the weight (and thus
lated environmentgive rise to the movement of developed if it contributes to inhibition or excitation) is determined by
multicellular bodies. We show that the control and coordi- multiplying the sign fields of the respective elements. Since
nation of this movement do not require an artificial nervous one regulatory unit of the GRN can be composed of multiple
system, but can merely be achieved by decentralized GRN P and G elements, any two nodes in the graph can be con-
activity in every cell and signal diffusion. nected together through multiple edges. There is no limit on
the size of the GRN (number of nodes) in GReaNs.
A model of development, behavior and The concentrations of factors are updated in discrete time
evolution of soft-bodied animats steps. First, the activation level of each regulatory region of
a node is defined as the weighted sum of the concentrations
Genome and GRN of all factors (possibly from other units) that have a non-zero
The integrated model of genome, GRN, development and affinity to it. If the node corresponds to a regulatory unit,
evolution presented in this paper is essentially the same as the activation of all P elements of a unit is summed. The
our recent extension of GReaNs that modeled soft-bodied rate at which the concentration of factors of a node change
multicellular animats in motion (Joachimczak and Wrobel, is determined using the following update rule:
2012). For the sake of completeness, however, we provide A
L = (tanh L)t (1)
here a full description of the model. The main difference 2
is that, in the experiments shown here, the GRN continues where t (the integration time step) determines how fast
to function during animat movement, while in the previous the factors accumulate or degrade in relation to the simula-
version the GRN dynamics stopped at the end of develop- tion time step (the value 0.05 is used in this paper), L is the
ment and its final outputs specified the oscillatory behavior current concentration of the factors in the node (if there is
of the cells. more than one, all have the same concentration), restricted
A genome in GReaNs is composed of genetic modules to the interval [0, 1), and A is the summed activation of all P
or elements, which are ordered sets of numbers and be- elements in the unit (the effect of a product on a promoter is
long to three different classes (Fig. 1): G elements code for calculated by multiplying the products concentration by the
regulatory products/factors, an abstraction of the biological weight).

350 Artificial Life 13


Brainless Bodies: Controlling the Development and Behavior of Multicellular Animats by Gene Regulation and Diffusive Signals
reg. unit #1 reg. unit #2 reg. unit #3
type 0..4
G S G P P G P G S G P G P sign -1 or 1
x1 position in
co-regulated genes
(a) (b) (c) (d) t=185 (e) t=187
x2 R2 space
t=0 t=90 t=139
a special element: a promoter (2) a gene:
maternal factor (0) or transcription factor (3)
cellular function (1) or morphogene (4)

Figure 1: Genome and structure of a single genetic element.


Each element consists of a type field, which specifies the (f) t=231 (g) t=400 (h) final shape
class of the element (G, P or S), a sign field, and a sequence
of N abstract coordinates in RN space (N = 2 here), which Figure 2: Example of the developmental mechanics. Cells
determine its affinity to other elements. are represented as circles. In (e), cells have just divided
but elastic forces have not yet pushed them apart. This was
The S elements of the genome are used to code for GRN achieved in (f). (h) shows the final structure after cells were
inputs and outputs, which provide to a cell certain external connected with springs, see Fig. 4a for the same animat in
signals and the ability to perform certain actions. The con- motion.
centration of input factors is determined outside of the cell
and they diffuse in the physical space of the developmental
Mechanical-chemical coupling: We describe the first
process (here, in 2D). They can be seen as playing the role of
four output functions mentioned above. Cell division is trig-
maternal morphogens. We used here four different input
gered when the concentration buildup of a specific division
factors, three of which were produced by sources at specific
factor (coded by one of the S elements) reaches a threshold
locations. The fourth factor had a uniform concentration of
of 0.9. Should this element become disconnected from the
1 across the entire space.
GRN (due to mutation) or lost (due to deletion), the indi-
Outputs correspond here to six possible cellular actions.
vidual would consist of a single cell and have zero fitness.
The first four actionscell division, change in cell orien-
The division is asymmetric: a new daughter cell is formed
tation (rotation to the left and to the right), and change
from a given mother cell. In this paper, there is no asym-
in cell sizeaffect only development, while the other two
metry in the distribution of gene products (the daughter in-
actionscoding for cell contraction and expansionaffect
herits all the concentrations from the mother), but rather in
only the physical motion of the multicellular animat.
the cells size and orientation angle. This angle is an abstrac-
Developmental process tion of the cells polarization axis and/or cleavage plane and
determines where the daughter cell is placed with respect
The developmental process starts from a single cell. Each
to the mother. The orientation of the mother cell remains
cell contains a copy of the genome, which encodes the GRN
the same after division, while cell rotation factors change
and whose activity controls the cells developmental behav-
the daughter cells angle proportionally to their concentra-
ior. This behavior comprises mechanical rules and chemical
tion. A right rotation factor causes an increase of the an-
rules, which are coupled and influence each other.
gle, while a left rotation factor causes its decrease (a 2
Mechanical rules: Cells occupy real-valued positions in
rotation corresponds to the maximum concentration 1 of the
2D space (Fig. 2). An embryo develops in a simulated fluid-
right/left factor). Finally, size increase determines the radius
like environment, in which cells behave as soft (non-rigid)
of the daughter cell at division, which may be up to 1.5 times
physical objects. The overall structure of the embryo is
the default radius when the concentration of the correspond-
maintained by elastic forces between nearest-neighbor cells.
ing size factor is at the maximum of 1.
Forces are repulsive when cells are too close and attractive
otherwise, reaching an optimal distance at equilibrium. Af-
Final structure
ter each division of a mother cell, the two daughter cells
partially overlap (see rotation action below), so they imme- The developmental phase is followed by a transformation
diately repel each other. of the obtained morphology into the actual structure of the
Chemical rules: Exogenous maternal morphogens lo- animat (Fig. 3). In principle, this transformation restricts the
cated in the environment allow differentiation based on set of evolvable structures, but it is also a way to keep the
cells location in space. Cells also produce endogenous dif- evolutionary search focused, provided that such restriction is
fusive factors that affect morphogenesis (morphogens). In still able to produce individuals that are diverse and relevant
the simplified, grid-less diffusion model used here, the con- to the challenge at hand.
centration of these regulatory factors in a cell at a given loca- The first step of the transformation process consists of
tion is a function of the distance from the source and (for en- outlining a tight, but not necessarily convex, hull that en-
dogenous factors) the historical concentration in the source closes all the cells. This requires identifying the outer
cells. cells and connecting the centers of adjacent cells with edges,

351 Artificial Life 13


Brainless Bodies: Controlling the Development and Behavior of Multicellular Animats by Gene Regulation and Diffusive Signals

additively:

L = (1 + Amax (e1 + e2 c1 c2 )) L0 (2)

where e1 , e2 (respectively, c1 , c2 ) are the concentration lev-


els of the expansion (respectively, contraction) factors in the
(a) (b) (c) two cells, and Amax is a parameter of the system represent-
ing the maximum actuation amplitude (set to 0.2 here).
Figure 3: Algorithmic transformation of a set of points into Additionally, a mechanism of pressurized chambers is in-
an animat structure: (a) cell centers at the end of the devel- troduced in the body to oppose excessive compression and
opmental phase, (b) Delaunay triangulation of the set, (c) prevent collisions of internal nodes with springs. These
Gabriel graph of the set (final structure). chambers play the role of a hydrostatic skeleton for the
animat. At the time of the transformation to the final struc-
while preserving concave regions. The resulting hull cor- ture, the area of each chamber is computed and defined as
responds to the external surface or skin of the animats its equilibrium area. Then, as a chamber shrinks or expands
body, which in a simulated fluid-like environment is the only during movement, pressure forces react along the normal of
source of drag forces. In a second step, the animats inter- each one of its edges:
nal structure is completed by connecting all the remaining
neighboring cells through elastic edges modeled as damped S
Fp = cp L (1 ) (3)
springs. This structural graph is calculated on the basis of S0
cells centers only. Cells radii affect the final structure only
where Fp is the pressure force acting outward along the nor-
implicitly, by determining the equilibrium positions of the
mal of the edge that is considered, L is the length of this
cells during development.
edge, S and S0 represent the current and equilibrium areas
To calculate connectivity, we use a particular notion of
of the chamber, and cp is a global pressure coefficient con-
spatial proximity defined by the Gabriel graph (Gabriel and
trolling the resistance to compression.
Sokal, 1969), which is different from nearest neighbors: any
To simulate the fluid-like environment, we apply the sim-
two points will be connected by an edge if and only if there
plified model of fluid drag described by Sfakiotakis and
are no other points inside the circle whose diameter is that
Tsakiris (2006) and previously used in a work about devel-
edge. The Gabriel graph is a convenient way to obtain non-
oping spring-mass animats by Schramm et al. (2011). This
convex hulls: it is non-parameterized, scale invariant, and
model assumes that the fluid is stationary and that the force
relatively straightforward to compute. Because it is a sub-
acting on a single edge of the skin is a sum of tangential
graph of the Delaunay triangulation, it can be derived from
and normal drag components, vT and vN , with respect to
the latter in linear time by removing all the edges that do not
the motion of this edge:
fulfill the above proximity criterion.
FT = dT L sign(vT ) (vT )2 (4)
Motion generation
2
FN = dN L sign(vN ) (vN ) (5)
The final structure of the animat defines a soft body consist-
ing of springs (the edges of the Gabriel graph), masses (the where dT and dN are the fluid drag coefficients (here, dN =
cells, vertices of the graph), and pressurized chambers (the 200dT ). Since animats are soft-bodied, the lengths of the
polygons formed by the edges). We employed the Bullet li- springs change dynamically and the direction of motion of a
brary (2011), but since it was originally created to simulate given edge is defined as the direction of its center.
rigid-body objects, forces affecting the soft-bodied animats
were calculated by custom GReaNs code while the Bullet Genetic algorithm and fitness evaluation
library was only used to integrate the motion of cell centers. We use here essentially the same genetic algorithm as in
All cells have the same mass, and all edges have the same our previous work (Joachimczak and Wrobel, 2012), with
elasticity and damping coefficients (Hooks coefficients). constant population size (300), elitism, tournament selection
Actuation is achieved by varying the resting lengths of the and multipoint crossover for sexual reproduction (concern-
springs in the structural graph. Each cell-vertex can con- ing 20% of the individuals at each generation). In GReaNs,
tract or expand the elastic edges that are connected to it, pro- genetic operators act at the level of the genomic elements
voking the shrinkage or dilation of the regions around that (affecting element types, sign bits, and coordinates) and
cell. A cell can control this process using two outputs of its multiple elements (duplications, deletions, and crossover).
GRN: one output for the contraction of the resting lengths, To assess the fitness, the genome is first transformed into a
the other output for their expansion. Together, two cells con- GRN. If the GRN does not contain a directed path (sequence
nected by an edge modify the resting length L of that edge of connected nodes) from at least one input element to the

352 Artificial Life 13


Brainless Bodies: Controlling the Development and Behavior of Multicellular Animats by Gene Regulation and Diffusive Signals

output elements corresponding to cell division and animat that could control both a developing animat morphology and
actuation, the individual is assigned a zero fitness (it would its functional motion via coordinated contractions and ex-
be motionless). The development is allowed to proceed for pansions. In some evolutionary runs, structures that looked
400 simulation steps. Cell division is terminated when the like appendages have emerged. Motion was caused by
size of the embryo reaches 32 cells. Individuals contain- emergent oscillations and other periodic patterns controlled
ing less than three cells and individuals whose development by the GRN in each individual cell of the animat. The re-
process includes a cell division in the last 100 simulation sults obtained here are consistent with our previous exper-
steps of their development are assigned a zero fitness. The iments in which motion was not dynamically controlled by
purpose of the latter criterion is to allow time for the mor- the GRN in real time, but rather the equilibrium length of the
phology to equilibrate after the last cell division. springs and the phase and frequency of oscillations were de-
After the transformation into a soft-bodied animat, the termined and fixed at the end of development (Joachimczak
multicellular body is immersed in the simulated physical and Wrobel, 2012).
world and allowed to equilibrate for 200 simulation steps To analyze the behavior of the animats, we describe them
while the GRN is stopped. This equilibration step is nec- over two axes: the main body axis (front-back) and the left-
essary because the levels of expansion and contraction fac- right axis. These were determined by computing the direc-
tors in each cell at the end of development can be non-zero. tion of motion of the animat, and declaring the resulting vec-
Then, the GRN is started again and the animat is allowed tor (extending from the center of mass of the animat) as the
to move for 6000 simulation steps, at the end of which the main body axis, then the orthogonal direction as the left-
distance traveled by its center of mass is converted into a right axis. The activity of each cell was defined as the abso-
fitness value. Since absolute distance is rewarded, it is ben- lute change in contraction or expansion of the resting length
eficial for individuals to be bigger. Indeed, we observe that from the previous time step (|(ei ci )| from equation 2).
the best evolved animats almost always have the maximum The average activity along an axis was computed by project-
possible cell size and number (32 cells). The rules of physics ing all cells onto this axis, and calculating the mean over the
in the environment used for development and assessment of area before and after the center of mass. We will thus discuss
mobility are different, but the cells can still communicate the average cell activity of the front of the animat compared
through diffusive factors during motion. This diffusion pro- to the back, and the left compared to the right. We also show
cess takes into account distances between cells at the end of the concentrations of the expansion and contraction factors
development. in a few selected cells of the animats, to explain how over-
The initial population is generated randomly, by creating all animat motion is generated by the collective behavior of
positive-fitness individuals with 10 regulatory units, each several GRNs.
unit containing one P and one G element. Most random We identified several distinct strategies through which lo-
genomes created in this fashion have a zero fitness, so it comotion was achieved. We informally describe four such
is necessary to generate a few hundred of them before a strategies here, calling them turtle, shark, worm, and jel-
positive-fitness individual can be placed in the initial pop- lyfish.1 Naturally, these metaphors only refer to the vi-
ulation. sual appearance of motion, not the actual mechanism by
which these real-world, nerve-endowed animals operate. In-
Results and Analysis deed, the difficulty of finding nerve-free organisms for such
We have simulated evolution in several independent runs un- metaphors highlights the fact that the biological organisms
der various environmental conditions (the physics parame- that we are familiar with control their motion using nervous
ters for the simulation of motion, see below). We avoided systems. The worms and turtles are similar to individuals
settings in which the mass of the cells was so high that it seen in our previous work (Joachimczak and Wrobel, 2012).
could result in exaggerated stretch to the body, or in which The jellyfish strategy, however, is new in our present control
spring constants were so high that they would lead to in- model, and the shark is either new or, perhaps, an extreme
stability or unnatural motions. Unnatural motions exploit version of a worm-like behavior.
unwanted artifacts, such as collisions of internal nodes with The turtle strategy is based on the use of approximately
each other or interpenetration of body fragments (the latter symmetric protrusions on the left and right of the animat,
could always be reduced by decreasing the time step). Un- which move in more or less regular oscillatory patterns. Av-
der these constraints, we were still able to obtain effective erage cell activity oscillate symmetrically over the left-right
patterns of locomotion over two orders of magnitude of the axis, with changes in phase and amplitude over the front-
fluid drag coefficient dN , and across a range of Hooks elas- back axis. Similar individuals constituted the majority of
tic coefficients and hydrostatic skeleton pressure values cp . the best individuals obtained in independent runs under low
Evolution was successful at finding animats capable of lo- fluid drag. In most of these individuals, the motion stemmed
comotion. In nearly all runs, using a variety of parameters 1
Supplementary videos of animat behaviors are available at:
for the local physics, our genetic algorithm produced GRNs http://evosys.org/grnanimats

353 Artificial Life 13


Systems
1
SystemsModeling
1 Systems
ModelingLaboratory,
Modeling
Laboratory,IOIOPAN,
Laboratory, Sopot,
IO PAN,
PAN, Poland
Sopot,
Sopot, Poland
Poland
Systems Modeling Laboratory, IO PAN, Sopot, Poland

Brainless Bodies: Controlling the Development and Behavior of Multicellular Animats by Gene Regulation and Diffusive Signals

(4.a) Turtle (4.b) Shark (4.c) Worm (4.d) Jellyfish

   
     
 
00 0 00 0
00 0 00 0 0 0
0 0

3535 35 6060 60
2525 25 2525 25 35 60
25 25

6060 60 5555 55 7070 70 140


140 140
60 55 70 140

145
145 145 Cell 6 9090 90 175 175 625
625 625
Cell 6 145 90 175 625

 175

 Cell 31 Cell 2

 
Cell 29 
  210
210 800 800
 230
230 230  155
155 155  210
210
800800
Cell 15 230 Cell 26 155
(a) (a) (b) (b)
(4.1) A(a) (a)
snapshot of motion cycles of (b)(b)
the individuals. Node color indicates whether the cell is contracting or
expanding its of
springs (a)(a) (a) indicate the time (b) (b)(b)(b)
Figure
Figure 1:
Figure Snapshots
1: 1: Snapshots
Snapshots ofa asingle a(red:
ofsingle singleexpansion,
motion
motion cycle
motioncycle
blue:
of
cycle
of
contraction,
individual green: neutral). Numbers
individual
of
individual (a) steps in the
Figure 1: Snapshots
cycle. The arrow of
is a single
an motion cycle
approximation of theofdistance
individual traveled by the center of mass in one cycle for each animat.
employing employing
employing appendages
appendages to propel itself itself
to propel (a) and (a)anand individ-
an individ- Figure 2:2:Snapshots
Figure 2: Snapshots ofofa asingle motion
of a single cycle
motion ofofananof
cycle individ-
an individ-
employingappendages appendagesto topropel propelitselfitself(a)(a)andandananindivid-
individ- Figure
Figure 2:Snapshots
Snapshots of single
a single motion
motion cycle
cycle of an individ-
individ-
ual propelling
ualual ual
propelling itself
propelling itselfusing
itself
using rapid
using
rapid tail
rapid
tail n
tail
n movements.
n movements.
movements. Node
Node Node ual ual employing
ual undulatory
employing
employing undulatory
undulatory movements
movements
movements totopropel
to itself
propel
propel itself(a)
(a)and
itself (a) and
and
propelling itself using rapid tail n movements. Node back ual employing undulatory movementsback to propel itself (a) and
0.08

0.08

0.08

0.08
color
color indicates
color
indicates whether
indicates whether the
whetherthe celltheiscell
cell contracting
is contracting ororexpanding
is contracting or expanding
expanding front
an an individual
an employing
individual
individual employing
employing asymmetric
asymmetric
asymmetric front
contraction-expansion
contraction-expansion
contraction-expansion
color indicates whether the cell is contracting or expanding an individual employing asymmetric contraction-expansion
itsitssprings (red: (red:
its springs expansion,
expansion,blue: contraction,
blue: green:green:
contraction, neu- neu- speed. Node Node
speed. color indicates
color whether
indicates the
whether cell
theiscell
iscontracting
is contracting
itssprings
springs(red: (red:expansion, blue:
blue:contraction,
contraction,green: green:neu- speed.
speed.Node color indicates whether thethecell contracting
0.04

0.04

0.04

0.04
expansion, neu- Node color indicates whether cell is contracting
tral).
tral). Numbers
tral). Numbers
Numbers indicate
indicate the
indicatebacktime
the the steps
time in
stepsthe
front time steps in the cycle.
in cycle.
the The
cycle.The The ororexpanding
or expanding
expanding its springs
its its
springs (red:
springs
back
expansion,
(red:
(red: expansion,
expansion, blue:
blue: contraction,
blue: contraction,
contraction,
tral). Numbers indicate the time steps in the cycle. The or expanding its
front
springs (red: expansion, blue: contraction,
0.00

0.00

0.00

0.00
direction
direction
4000 ofofmovement
direction movement 5000 is upwards
4500 of movement
is is upwards
upwards
5500 (a)
4000and
(a) (a)rightwards
and and
rightwards
4500 (b).
rightwards
5000
(b). (b).
5500
green:
4000
green: neutral).
green:
4500
neutral). Numbers
neutral).
5000
Numbers
Numbers
5500
indicate
4000
indicate the
indicate the time
the
4500
time steps
time 5000
steps in
steps
inthe in
the cy-
5500
the cy-
cy-
direction of movement is upwards (a) and rightwards (b). right green: neutral). Numbers indicate right the time steps in the cy-
0.08

0.08

0.08

0.08

left cle.
cle. The
cle.
The direction
The
direction ofofmovement
direction of movement
movement isisrightwards.
left is rightwards.
rightwards.
cle. The direction of movement is rightwards.
Results and and
Results Analysis
Analysis
0.04

0.04

0.04

0.04

Results
Resultsand
andAnalysis
Analysis
right right
left left
0.00

0.00

0.00

0.00

4000 4500 5000 5500 4000 4500 5000 5500 4000 4500 5000 5500 4000 4500 5000 5500

(4.2) Plots of the average activity of cells (y-axis) over time (x-axis) along the front-back and left-right axes of the
animats.
Behavior of cell 6 (top) and 15 (bottom) Behavior of cell 6 (top) and 26 (bottom) Behavior of cell 29 (top) and 31 (bottom) Behavior of cell 2
1

expand expand expand expand


contract contract contract contract
0.5

0.5

0.5

0.5
0

4000 4500 5000 5500 4000 4500 5000 5500 4000 4500 5000 5500 4000 4500 5000 5500
1

expand expand expand


contract contract contract
0.5

0.5

0.5
0

4000 4500 5000 5500 4000 4500 5000 5500 4000 4500 5000 5500

(4.3) Plots of pattern of actuation (y-axis) for one or two particular cells over time (x-axis), where the red line
indicates the concentration of the expansion factor and the blue line corresponds to the contraction factor.
Figure 4: Visualization of exemplars of the four strategies of behavior discovered by evolution.

354 Artificial Life 13


Brainless Bodies: Controlling the Development and Behavior of Multicellular Animats by Gene Regulation and Diffusive Signals

from a wave of expansions and contractions continuously time. Because fluid drag generated by an edge was propor-
traveling from the back towards the front of the animat. The tional to the square of its velocity, slower expansion resulted
analysis of one such individual (Fig. 4.a) revealed that cells in a smaller drag. Animats with a pointy front contracted
shared the same overall evolved pattern of activity. The con- slowly and expanded very rapidly, while animats with a
centration of the factors that caused expansion and contrac- pointy back expanded slowly and then contracted rapidly. In
tion remained antisynchronized inside each individual cell, the individual of the latter type analyzed in detail (Fig. 4.2d),
while there was another phase shift (almost at antiphase) the compacted state was sustained and the body moved by
when comparing the same product between different cells in inertia for some time, slowed down by the fluid drag, and
the front and the back of the animat (Fig. 4.3a). Thus con- then the cycle repeated itself. The overall impression was
tractions in the front practically corresponded to expansions that of a propelling motion similar to a jellyfish. The ob-
in the back, and vice-versa (Fig. 4.2a, top), in a manner con- served pattern of cell activity resulted from the fact that the
sistent with a traveling wave of contraction-expansion across expansion factors concentration decreased much faster than
the body. it increased (Fig. 4.3d), and from a matching dynamics of
In the shark strategy, there was a protrusion at the back of the contraction factor. The levels of both factors in the cell
the animat, which oscillated at a relatively high frequency were stable when the body traveled by inertia.
with a larger displacement than the remainder of the body. Throughout, we noted that evolution found synchronized
The average cell activity over the front-back axis oscillated actuators for contraction and expansion to great effect. How-
symmetrically, while there was a change in phase over the ever, it seemed to avoid using the full amplitude of actua-
left-right axis (Fig. 4.2b). Multiple individuals of this type tion possible. Rather, it explored a trade-off between ampli-
have been observed, even though they clearly did not ex- tude and frequency: increasing the rate of activity buildup
hibit an aerodynamic shape. For the individual shown in required more products binding at high levels to a given reg-
Fig. 4b, the motion was driven by a wave of expansion that ulatory unit.
traveled in the direction perpendicular to the motion, from
the left to the right. However, a cell located at the tip of the Summary
motion-generating protrusion was excluded from this wave In this work, we have re-approached the development and
pattern and maintained a constant maximum concentration control of virtual soft-bodied robots in GReaNs. In contrast
of the expansion factor, thereby sustaining the length of pro- to our previous study (Joachimczak and Wrobel, 2012) and
trusion. Furthermore, a bulge located on the left, next to the other models (Schramm et al., 2011), the simulations de-
back protrusion, collided during its own expansion with the scribed here relied on gene regulation for both the devel-
tail in every cycle, passing on its kinetic energy and mak- opmental process and behavioral control. Evolution was
ing the tail quickly reverse its direction of motion. Interest- successful at generating moving animats and discovering
ingly, the concentration of the contraction factor remained several functional locomotion strategies. Motion was con-
constant (although not uniform) in all cells, so it only pro- trolled via coordinated cell actions, where individual cells
vided a bias for the resting lengths of the springs. The anal- displayed emergent periodic patterns of expansion and con-
ysis of two particular cells located at the back of the indi- traction. Moreover, a previously unseen form of behav-
vidual (Fig. 4.3b) revealed sinusoidal oscillations of the ex- ior, one characterized by rapid contraction or expansion of
pansion factor. They had the highest oscillation frequency a largely symmetric animat, was discovered. This behav-
among all individuals investigated in this paper. ior was made possible by the GRNs fine-grained control
The worm strategy involved an elongated body driven by over the contraction and expansion speeds, instead of a sine-
the propagation of synchronized waves of contraction and driven actuation as in our previous work.
expansion, which traveled in the direction perpendicular to The reliance of the evolved locomotion mechanisms upon
the motion, from the left side of the body to the right, re- oscillatory changes in product concentrations is reminiscent
sulting in undulatory movement. Cell activity here was not of the rhythmic motor patterns of biological animals. By
symmetric, neither over the front-back nor over the left-right contrast, the movement of our animats is not based on a
axis, and the average activity was less regular than in other central pattern generator but a distributed collective effect.
strategies (Fig. 4.2c). Only a few such individuals were ob- All cells of these soft-bodied, brainless animats can be po-
served. Comparing the activity of the expansion and con- tentially involved in actuation and control. It was demon-
traction factors in cells located symmetrically on the left strated previously that a GRN could easily evolve toward
and right sides of the body (Fig. 4.3c) revealed sinusoidal an oscillatory behavior (e.g., Banzhaf, 2003; Joachimczak
oscillations in antiphase and shifted approximately by half a and Wrobel, 2010b). Our results show that, while motion
period between the sides of the body. relies on periodic changes of product concentration, devel-
Finally, animats using the fourth strategy, jellyfish, were opment results in the differentiation of cells along the body
bilaterally symmetric with one blunt end and one pointed axes in terms of phase and amplitude of these oscillations. In
end. The whole body expanded or contracted at the same other terms, high evolvability stems from the relative ease of

355 Artificial Life 13


Brainless Bodies: Controlling the Development and Behavior of Multicellular Animats by Gene Regulation and Diffusive Signals

evolving oscillatory GRNs, while a natural outcome of the Artificial Life XI: Eleventh International Conference on the
developmental process is that neighboring cells have similar, Simulation and Synthesis of Living Systems, pages 181188.
though not identical dynamic properties. Gabriel, K. R. and Sokal, R. R. (1969). A new statistical ap-
The animat model used in this paper, a collection of proach to geographic variation analysis. Systematic Zoology,
springs modifying their resting length, is similar to a model 18(3):259278.
of a soft-bodied robot. We expect that altering the physical
Hogeweg, P. (2000). Evolving mechanisms of morphogenesis: on
part of the model to accommodate other types of actuation the interplay between differential adhesion and cell differen-
should yield similar results. In particular, the present sys- tiation. Journal of Theoretical Biology, 203(4):317333.
tem could be adjusted to generate designs for realistic soft-
bodied robots. One of the possible directions for future work Joachimczak, M. and Wrobel, B. (2010a). Evolving gene regu-
latory networks for real time control of foraging behaviours.
is to incorporate a notion of energy efficiency into the fit- In Artificial Life XII: Twelfth International Conference on the
ness function by assuming the use of a given type of existing Simulation and Synthesis of Living Systems, pages 348355.
hardware actuators.
Joachimczak, M. and Wrobel, B. (2010b). Processing signals with
Another direction for future work is to allow active guid-
evolving artificial gene regulatory networks. In Artificial Life
ance without a nervous system. This could be achieved for XII: Twelfth International Conference on the Simulation and
example by allowing surface cells to sense chemical gradi- Synthesis of Living Systems, pages 203210.
ents and modify their pattern of activity accordingly, as well
Joachimczak, M. and Wrobel, B. (2011). Evolution of the mor-
as to pass information to internal cells through the use of
phology and patterning of artificial embryos: scaling the tri-
diffusing morphogens. colour problem to the third dimension. In ECAL 2009: 10th
One of the features of artificial life is the liberty to make European Conference on Artificial Life, pages 3341.
counterfactual assumptions. Amongst other things, we view
Joachimczak, M. and Wrobel, B. (2012). Co-evolution of mor-
this work as a challenge to like-minded practitioners: qual-
phology and control of soft-bodied multicellular animats. In
itatively describe the role of neural machinery, and from GECCO 12: Proceedings of the 14th Annual Conference on
there, refine our understanding of the role of a neural sys- Genetic and Evolutionary Computation. ACM. (in print).
tem.
Kessin, R. (2001). Dictyostelium: Evolution, Cell Biology, and
the Development of Multicellularity. Cambridge University
Acknowledgments Press.
This work was supported by a PAN-CNRS collaborative
Lefevre, J. and Mangin, J.-F. (2010). A reaction-diffusion model
project, IO PAN (task IV.3), and a scholarship from the of human brain development. PLoS Computational Biology,
French government to BW. TKs and RDs positions at the 6(4):e1000749+.
ISC-PIF were funded by Region Ile-de-France. Computa-
tional resources were provided by the Polish Ministry of Sci- Mjolsness, E., Sharp, D. H., and Reinitz, J. (1991). A connection-
ist model of development. Journal of Theoretical Biology,
ence and Education (project N519 384236, N303 291234), 152(4):429453.
the Tri-City Academic Computer Centre (TASK), and the
Interdisciplinary Centre for Molecular and Mathematical Salazar-Ciudad, I. and Jernvall, J. (2002). A gene network model
Modeling (ICM, University of Warsaw; project G33-8). accounting for development and evolution of mammalian
teeth. Proceedings of the National Academy of Sciences,
99(12):81168120.
References
Banzhaf, W. (2003). On the dynamics of an artificial regulatory Schramm, L., Jin, Y., and Sendhoff, B. (2011). Emerged coupling
network advances in artificial life. In ECAL 2003: 7th Euro- of motor control and morphological development in evolution
pean Conference on Artificial Life, pages 217227. of multi-cellular animats. In ECAL 2009: 10th European
Conference on Artificial Life, pages 1826.
Beer, R. (1996). Toward the evolution of dynamical neural net-
works for minimally cognitive behavior. In From animals to Schramm, L. and Sendhoff, B. (2011). An animats cell doctrine.
animats 4: International Conference on Simulation of Adap- In ECAL 2011: 11th European Conference on the Synthesis
tive Behavior, pages 421429. and Simulation of Living Systems, pages 739746.

Bonner, J. T. (2008). The Social Amoebae: The Biology of Cellular Sfakiotakis, M. and Tsakiris, D. P. (2006). SIMUUN : A simu-
Slime Molds. Princeton University Press. lation environment for undulatory locomotion. International
Journal of Modelling and Simulation, 26:350358.
Bullet Physics library 2.79 (2011). http://www.bulletphysics.org.
Stanley, K. O. and Miikkulainen, R. (2003). A taxonomy for artifi-
Dale, K. and Husbands, P. (2009). The evolution of reaction- cial embryogeny. Artificial Life, 9(2):93130.
diffusion controllers for minimally cognitive agents. Artifi-
cial Life, 16(1):119. Yamada, H., Nakagaki, T., Baker, R. E., and Maini, P. K. (2007).
Dispersion relation in oscillatory reaction-diffusion systems
Doursat, R. (2008). Programmable architectures that are complex with self-consistent flow in true slime mold. Journal of Math-
and self-organized: From morphogenesis to engineering. In ematical Biology, 54(6):745760.

356 Artificial Life 13

You might also like