You are on page 1of 86

EJTP 4, No.

16(II) (2007) 11–96 Electronic Journal of Theoretical Physics

Physics of Life from First Principles

Michail Zak∗
Jet Propulsion Laboratory California Institute of Technology,
Pasadena, CA 91109 USA

Received 25 January 2007, Accepted 15 May 2007, Published 20 December 2007

Abstract: The objective of this work is to extend the First Principles of Newtonian mechanics to include modeling of behavior of
Livings. One of the most fundamental problems associated with modeling life is to understand a mechanism of progressive evolution of
complexity typical for living systems. It has been recently recognized that the evolution of living systems is progressive in a sense that it is
directed to the highest levels of complexity if the complexity is measured by an irreducible number of different parts that interact in a well-
regulated fashion. Such a property is not consistent with the behavior of isolated Newtonian systems that cannot increase their complexity
without external forces. Indeed, the solutions to the models based upon dissipative Newtonian dynamics eventually approach attractors
where the evolution stops, while these attractors dwell on the subspaces of lower dimensionality, and therefore, of the lower complexity. If
thermal forces are added to mechanical ones, the Newtonian dynamics is extended to the Langevin dynamics combining both mechanics
and thermodynamics effects; it is represented by stochastic differential equations that can be utilized for more advanced models in which
randomness stands for multi-choice patterns of behavior typical for living systems. However, even those models do not capture the main
property of living systems, i.e. their ability to evolve towards increase of complexity without external forces. Indeed, the Langevin dynamics
is complemented by the corresponding diffusion equation that describes the evolution of the distribution of the probability density over the
state variables; in case of an isolated system, the entropy of the probability density cannot decrease, and that expresses the second law of
thermodynamics. From the viewpoint of complexity, this means that the state variables of the underlying system eventually start behaving
in a uniform fashion with lesser distinguished features, i.e. with lower complexity. Reconciliation of evolution of life with the second law of
thermodynamics is the central problem addressed in this paper. It is solved via introduction of the First Principle for modeling behavior of living
systems. The structure of the model is quantum-inspired: it acquires the topology of the Madelung equation in which the quantum potential
is replaced with the information potential. As a result, the model captures the most fundamental property of life: the progressive evolution,
i.e. the ability to evolve from disorder to order without any external interference. The mathematical structure of the model can be obtained
from the Newtonian equations of motion (representing the motor dynamics) coupled with the corresponding Liouville equation (representing
the mental dynamics) via information forces. The unlimited capacity for increase of complexity is provided by interaction of the system with
its mental images via chains of reflections: What do you think I think you think. . . ?. All these specific non-Newtonian properties equip the
model with the levels of complexity that match the complexity of life, and that makes the model applicable for description of behaviors of
ecological, social and economics systems.


c Electronic Journal of Theoretical Physics. All rights reserved.

Keywords: Physics of life, Biophysics, Complex Systems


PACS (2006): 87.10.+e, 89.75.k, 89.75.Fb, 87.16.Ac

“Life is to create order in the disordered environment against the second law of thermodynamics”. E. Schrödinger, 1945.

1. Introduction
It does not take much knowledge or experience to distinguish a living matter from
inanimate in day-to-day situations. Paradoxically, there is no formal definition of life that
would be free of exceptions and counter-examples. There are at least two reasons for that.

Michail.Zak@jpl.nasa.gov
12 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Firstly, many complex physical and chemical phenomena can mimic prints of life so closely
that special methods are required to make the distinction. Secondly, extraterrestrial life,
in principle, can be composed of components which are fundamentally different from
those known on Earth. Therefore, the main objective of this paper is to formulate some
invariants of life in terms of phenomenology of behavior.
Modeling of life can be performed on many different levels of description. While there
is no universal agreement on the definition of life, scientists generally accept that the
biological manifestation of life exhibits the following phenomena (Wikipedia): Orga-
nization - Living things are composed of one or more cells, which are the basic units
of life. Metabolism - Metabolism produces energy by converting nonliving material
into cellular components (synthesis) and decomposing organic matter (catalysis). Living
things require energy to maintain internal organization (homeostasis) and to produce the
other phenomena associated with life. Growth - Growth results from a higher rate of
synthesis than catalysis. A growing organism increases in size in all of its parts, rather
than simply accumulating matter. The particular species begins to multiply and expand
as the evolution continues to flourish. Adaptation - Adaptation is the accommodation
of a living organism to its environment. It is fundamental to the process of evolution and
is determined by the organism’s heredity as well as the composition of metabolized sub-
stances, and external factors present. Response to stimuli - A response can take many
forms, from the contraction of a unicellular organism when touched to complex reactions
involving all the senses of higher animals. A response is often expressed by motion: the
leaves of a plant turning toward the sun or an animal chasing its prey. Reproduction
- The division of one cell to form two new cells is reproduction. Usually the term is
applied to the production of a new individual (asexually, from a single parent organism,
or sexually, from at least two differing parent organisms), although strictly speaking it
also describes the production of new cells in the process of growth.
In this paper, we will address only one aspect of Life: a biosignature, i.e. mechan-
ical invariants of Life, and in particular, the geometry and kinematics of behavior
of Livings disregarding other aspects of Life. By narrowing the problem in this way, we
will be able to extend the mathematical formalism of physics’ First Principles to include
description of behavior of Livings. In order to illustrate the last statement, consider the
following situation. Suppose that we are observing trajectories of several particles: some
or them physical (for instance, performing a Brownian motion), and others are biological
(for instance, bacteria), Figure 1. Is it possible, based only upon the kinematics of the
observed trajectories, to find out which particle is alive? The test for the proposed model
is to produce the correct answer.
Thus, the objective of this paper is to introduce a dynamical formalism describing
the behavior of Livings. All the previous attempts to develop models for so called ac-
tive systems (i.e., systems that possess certain degree of autonomy from the environment
that allows them to perform motions that are not directly controlled from outside) have
been based upon the principles of Newtonian and statistical mechanics, (A. S. Mikhailov,
1990). These models appear to be so general that they predict not only physical, but also
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 13

some biological and economical, as well as social patterns of behavior exploiting such fun-
damental properties of nonlinear dynamics as attractors. Not withstanding indisputable
successes of that approach (neural networks, distributed active systems, etc.) there is still
a fundamental limitation that characterizes these models on a dynamical level of descrip-
tion: they propose no difference between a solar system, a swarm of insects, and a stock
market. Such a phenomenological reductionism is incompatible with the first principle
of progressive biological evolution associated with Darwin (I. Prigogine, 1980, H. Haken,
1988). According to this principle, the evolution of living systems is directed toward the
highest levels of complexity if the complexity is measured by an irreducible number of dif-
ferent parts which interact in a well-regulated fashion (although in some particular cases
deviations from this general tendency are possible). At the same time, the solutions to
the models based upon dissipative Newtonian dynamics eventually approach attractors
where the evolution stops while these attractors dwell on the subspaces of lower dimen-
sionality, and therefore, of the lower complexity (until a “master” reprograms the model).
Therefore, such models fail to provide an autonomous progressive evolution of living sys-
tems (i.e. evolution leading to increase of complexity), Figure 2. Let us now extend
the dynamical picture to include thermal forces. That will correspond to the stochastic
extension of Newtonian models, while the Liouville equation will extend to the so called
Fokker-Planck equation that includes thermal force effects through the diffusion term.
Actually, it is a well-established fact that evolution of life has a diffusion-based stochastic
nature as a result of the multi-choice character of behavior of living systems. Such an
extended thermodynamics-based approach is more relevant to model of living systems,
and therefore, the simplest living species must obey the second law of thermodynamics
as physical particles do. However, then the evolution of living systems (during periods
of their isolation) will be regressive since their entropy will increase (I. Prigogine, 1961),
Figure 3. As pointed out by R. Gordon (1999), a stochastic motion describing physical
systems does not have a sense of direction, and therefore, it cannot describe a progressive
evolution. As an escape from this paradox, Gordon proposed a concept of differentiating
waves (represented by traveling waves of chemical concentration or mechanical defor-
mation) which are asymmetric by their nature, and this asymmetry creates a sense of
direction toward progressive evolution. Although the concept of differentiating waves
itself seems convincing, it raises several questions to be answered: Who or what arranges
the asymmetry of the differentiating waves in the “right” direction? How to incorporate
their formalism into statistical mechanics providing progressive evolution without a vio-
lation of the second law of thermodynamics? Thus, although the stochastic extension of
Newtonian models can be arranged in many different ways (for instance, via relaxation
of the Lipschitz conditions, (M. Zak, 1992), or by means of opening escape-routes from
the attractors), the progressive evolution of living systems cannot be provided.
The limitations discussed above have been addressed in several publications in which
the authors were seeking a “border line” between living and non-living systems. It is
worth noticing that one of the “most obvious” distinctive properties of the living systems,
namely, their intentionality, can be formally disqualified by simple counter-examples; in-
14 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

deed, any mechanical (non-living) system has an “objective” to minimize action (the
Hamilton principle) as well as any isolated diffusion-based stochastic (non-living) sys-
tem has an “objective” to maximize the entropy production (“The Jaynes Principle,”
H. Haken, 1988). The departure from Newtonian models via introduction of dynamics
with expectations and feedback from future has been proposed by B. Huberman and his
associates (B. Huberman, 1988). However, despite the fact that the non-Newtonian na-
ture of living systems in these works was captured correctly, there is no global analytical
model that would unify the evolution of the agent’s state variables and their probabilistic
characteristics such as expectations, self-images etc.
Remaining within the framework of dynamical formalism, and based only upon kine-
matics of the particle, we will associate life with the inequality that holds during, at least,
some time interval
dH
<0 (1)
dt
where 
H(t) = − ρ(V, t) ln ρ(V, t)dV (1a)
V
Here H is entropy of the particle, V is the particle velocity, and ρ is the probability density
characterizing the velocity distribution. Obviously, the condition (1) is only sufficient,
but not necessary since even a living particle may choose not to exercise its privilege to
decrease disorder.
It seems unreasonable to introduce completely new principles for Living’s behavior
since Livings belong to the Newtonian world: they obey the First Principles of Newto-
nian mechanics, although these Principles are necessary, but not sufficient: they should
be complemented by additional statements linked to the Second Law of thermodynam-
ics and enforcing Eq. (1). One of the main objectives of this paper is to extend the
First Principles of classical physics to include phenomenological behavior on living sys-
tems, i.e. to develop a new mathematical formalism within the framework of classical
dynamics that would allow one to capture the specific properties of natural or artificial
living systems such as formation of the collective mind based upon abstract images of
the selves and non-selves, exploitation of this collective mind for communications and
predictions of future expected characteristics of evolution, as well as for making decisions
and implementing the corresponding corrections if the expected scenario is different from
the originally planned one. The approach is based upon our previous publications (M.
Zak, 1999a, 2003, 2004, 2005a, 2006a, 2007a, 2007b and 2007c) that postulate that even
a primitive living species possesses additional non-Newtonian properties which are not
included in the laws of Newtonian or statistical mechanics. These properties follow from
a privileged ability of living systems to possess a self-image (a concept introduced in
psychology) and to interact with it. The proposed mathematical formalism is quantum-
inspired: it is based upon coupling the classical dynamical system representing the motor
dynamics with the corresponding Liouville equation describing the evolution of initial
uncertainties in terms of the probability density and representing the mental dynamics.
(Compare with the Madelung equation that couples the Hamilton-Jacobi and Liouville
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 15

equations via the quantum potential.)The coupling is implemented by the information-


based supervising forces that can be associated with the self-awareness. These forces
fundamentally change the pattern of the probability evolution, and therefore, leading to
a major departure of the behavior of living systems from the patterns of both Newtonian
and statistical mechanics. Further extension, analysis, interpretation, and application of
this approach to complexity in Livings and emergent intelligence will be addressed in this
paper. It should be stressed that the proposed model is supposed to capture the signa-
ture of life on the phenomenological level, i.e., based only upon the observable behavior,
and therefore, it will not include a bio-chemical machinery of metabolism. Such a limi-
tation will not prevent one from using this model for developing artificial living systems
as well as for studying some general properties of behavior of natural living systems.
Although the proposed model is supposed to be applicable to both open and isolated
autonomous systems, the attention will be concentrated upon the latter since such prop-
erties of Livings as free will, prediction of future, decision making abilities, and especially,
the phenomenology of mind, become more transparent there. It should be emphasized
that the objective of the proposed approach is not to overperform alternative approaches
to each particular problem (such approaches not only exist, but they may be even more
advanced and efficient), but rather to develop a general strategy (by extending the First
Principles of physics) that would be the starting point for any particular problem. The
impotence of the general strategy can be illustrated by the following example-puzzle:
Suppose that a picture is broken into many small pieces that are being mixed up; in or-
der to efficiently reconstruct this picture, one has to know how this picture should look;
otherwise the problem becomes combinatorial, and practically, unsolvable. This puzzle
is directly related to the top-down approach to Physics of Life.
The paper presents a review of the author’s publications (M. Zak, 1999a, 2003, 2004,
2005a, 2006a, 2006b, and 2006c).

2. Dynamics with Liouville Feedback

2.1 Destabilizing Effect of Liouville Feedback


We will start with derivation of an auxiliary result that illuminates departure from
Newtonian dynamics. For mathematical clarity, we will consider here a one-dimensional
motion of a unit mass under action of a force f depending upon the velocity v and time t
v̇ = f (v, t), (2)
If initial conditions are not deterministic, and their probability density is given in the
form
∞
ρ0 = ρ0 (V ), where ρ ≥ 0, and ρdV = 1 (3)
−∞
while ρ is a single- valued function, then the evolution of this density is expressed by the
corresponding Liouville equation
16 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

∂ρ ∂
+ (ρf ) = 0 (4)
∂t ∂v
The solution of this equation subject to initial conditions and normalization constraints
(3) determines probability density as a function of V andt : ρ = ρ(V, t).
In order to deal with the constraint (3), let us integrate Eq. (4) over the whole space
assuming that ρ → 0 at |V | → ∞ and |f | < ∞ . Then

∞ ∞

ρdV = 0, ρdV = const, (5)
∂t
−∞ −∞

Hence, the constraint (3) is satisfied for t > 0 if it is satisfied for t = 0.


Let us now specify the force f as a feedback from the Liouville equation

f (v, t) = ϕ[ρ(v, t)] (6)

and analyze the motion after substituting the force (6) into Eq.(2)

v̇ = ϕ[ρ(v, t)], (7)

This is a fundamental step in our approach. Although the theory of ODE does not impose
any restrictions upon the force as a function of space coordinates, the Newtonian physics
does: equations of motion are never coupled with the corresponding Liouville equation.
Moreover, it can be shown that such a coupling leads to non-Newtonian properties of the
underlying model. Indeed, substituting the force f from Eq. (6) into Eq. (5), one arrives
at the nonlinear equation for evolution of the probability density

∂ρ ∂
+ {ρϕ[ρ(V, t)]} = 0 (8)
∂t ∂V

Let us now demonstrate the destabilizing effect of the feedback (6). For that purpose, it
should be noted that the derivative ∂ρ/∂vmust change its sign, at least once, within the
interval−∞ < v < ∞, in order to satisfy the normalization constraint (3).
But since
∂ v̇ dϕ ∂ρ
Sign = Sign Sign (9)
∂v dρ ∂v
there will be regions of v where the motion is unstable, and this instability generates
randomness with the probability distribution guided by the Liouville equation (8). It
should be noticed that the condition (9) may lead to exponential or polynomial growth
of v (in the last case the motion is called neutrally stable, however, as will be shown
below, it causes the emergence of randomness as well if prior to the polynomial growth,
the Lipcshitz condition is violated).
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 17

2.2 Emergence of Randomness


In order to illustrate mathematical aspects of the concepts of Liouville feedback, as well
as associated with it instability and randomness let us take the feedback (6) in the form

f = −σ 2 ln ρ (10)
∂v
to obtain the following equation of motion

v̇ = −σ 2 ln ρ, (11)
∂v
This equation should be complemented by the corresponding Liouville equation (in this
particular case, the Liouville equation takes the form of the Fokker-Planck equation)

∂ρ ∂ 2ρ
= σ2 (12)
∂t ∂V 2
Here v stands for a particle velocity, and σ 2 is the constant diffusion coefficient.
The solution of Eq. (12) subject to the sharp initial condition is

1 V2
ρ= √ exp(− ) (13)
2σ πt 4σ 2 t
Substituting this solution into Eq. (11) at V = v one arrives at the differential equation
with respect to v(t)
v
v̇ = (14)
2t
and therefore, √
v=C t (15)
where C is an arbitrary constant. Since v = 0 at t = 0 for any value of C, the solution (15)
is consistent with the sharp initial condition for the solution (13) of the corresponding
Liouvile equation (12). The solution (15) describes the simplest irreversible motion: it is
characterized by the “beginning of time” where all the trajectories intersect (that results
from the violation of Lipschitz condition at t = 0, Fig.4), while the backward motion
obtained by replacement of t with (−t) leads to imaginary values of velocities. One can
notice that the probability density (13) possesses the same properties.
For a fixed C, the solution (15) is unstable since
dv̇ 1
= >0 (16)
dv 2t
and therefore, an initial error always grows generating randomness. Initially, at t = 0,
this growth is of infinite rate since the Lipschitz condition at this point is violated
dv̇
→ ∞ at t → 0 (17)
dv
This type of instability has been introduced and analyzed by (Zak, M., 1992).
18 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Considering first Eq. (15) at fixed C as a sample of the underlying stochastic process
(13), and then varying C, one arrives at the whole ensemble characterizing that process,
(see Fig. 4). One can verify that, as follows from Eq. (13), (Risken., 1989) that the
expectation and the variance of this process are, respectively

M V = 0, DV = 2σ 2 t (18)

The same results follow from the ensemble (15) at −∞ ≤ C ≤ ∞. Indeed, the first
equality in (18) results from symmetry of the ensemble with respect to v = 0; the second
one follows from the fact that
DV ∝ v 2 ∝ t (19)
It is interesting to notice that the stochastic process (15) is an alternative to the following
Langevin equation, (Risken., 1989)

v̇ = Γ(t), M Γ = 0, DΓ = σ (20)

that corresponds to the same Fokker-Planck equation (12). Here Γ(t) is the Langevin
(random) force with zero mean and constant varianceσ.
The results described in this sub-section can be generalized to n-dimensional case,
(Zak, M, 2007b)

2.3 Emergence of Entanglement


In order to introduce and illuminate a fundamentally new non-Newtonian phenomenon
similar to quantum entanglement, let us assume that the function ϕ(ρ) in Eq. (6) is
invertible, i.e. ρ = ϕ−1 (f ). Then Eqs. (7) and (8) take the form, respectively

v̇ = ρ, (7a)
∂ρ ∂ 2
+ (ρ ) = 0 (7b)
∂t ∂V
As follows from Eq. (7) with reference to the normalization constraint (3)

∞
ϕ−1 [v̇(V, t)]dV = 1 (21)
−∞

It should be mentioned that non-Newtonian properties of solution to Eq. (8a) such as


shock waves in probability space have been studied in (Zak, M., 2004, 2006c), Fig. 24.
Thus, the motions of the particles emerged from instability of Eq. (7a) are entangled:
they must satisfy the global kinematical constraint (20). It is instructive to notice that
quantum entanglement was discovered in a special class of quantum states that become
entangled in the course of their simultaneous creation.
Similar result can be obtained for the feedback (10). Indeed, let us rewrite Eq. (11)
in the form

v̇(t, C) = −σ 2 ln ρ, (22)
∂C
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 19

where
1 C2
ρ= √ exp(− ) (23)
2σ πt 4σ 2 t
Integrating Eq. (21) over the whole region −∞ ≤ C ≤ ∞, one arrives at the following
global constraint in the form
∞
v̇(t, C)dC = −σ 2 [ln ρ(C = ∞) − ln ρ(C = −∞)] = 0 (24)
−∞

that entangles accelerations of different samples of the same stochastic process. The same
result follows from symmetry of the acceleration field plotted in Fig. 5. It is important
to notice that the Fokker-Planck equation (12) does not impose any constraints upon
the corresponding Langevin equation (20), i.e. upon the accelerations v̇. In order to
demonstrate it, consider two particles driven by the same Langevin force Γ(t)

v̇1 = Γ(t), v̇2 = Γ(t), M Γ = 0, DΓ = σ (25)

Obviously, the difference between the particles accelerations, in general, is not zero: it
represents a stationary stochastic process with the zero mean and the variance 2σ.That
confirms the fact that entanglement is a fundamental non-Newtonian effect: it requires
a feedback from the Liouville equation to the equations of motion. Indeed, unlike the
Langevin equation, the solution to Eq. (11) has a well-organized structure: as follows
from Eq. (15) and Figs. 4 and 5, the initial “explosion” of instability driven by the
violation of the Lipschitz condition at t = 0 distributes the motion over the family of
smooth trajectories with the probability expressed by Eq. (22). Therefore, as follows
from Eq.(23), the entanglement effect correlates different samples of the same stochas-
tic process. As a result of that, each entangled particle can predict motion of another
entangled particle in a fully deterministic manner as soon as it detects the velocity or
acceleration of that particle at least at one point; moreover, since Eqs. (11) and (12) are
invariant with respect to position of the particles, the distance between these particles
will not play any role in their entanglement.
It should be emphasized that the concept of a global constraint is one of the main
attribute of Newtonian mechanics. It includes such idealizations as a rigid body, an
incompressible fluid, an inextensible string and a membrane, a non-slip rolling of a rigid
ball over a rigid body, etc. All of those idealizations introduce geometrical or kinematical
restrictions to positions or velocities of particles and provides “instantaneous” speed of
propagation of disturbances. However, the global constraint
∞
ρdV = 1 (26)
−∞

is fundamentally different from those listed above for two reasons. Firstly, this constraint
is not an idealization, and therefore, it cannot be removed by taking into account more
20 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

subtle properties of matter such as elasticity, compressibility, etc. Secondly, it imposes


restrictions not upon positions or velocities of particles, but upon the probabilities of their
positions or velocities, and that is where the entanglement comes from.
Continuing this brief review of global constraints, let us discuss the role of the reac-
tions to these constraints, and in particular, let us find the analog of reactions of global
constraints in quantum mechanics. One should recall that in an incompressible fluid,
the reaction to the global constraint ∇ · v ≥ 0 (expressing non-negative divergence of
the velocity v) is a non-negative pressure p ≥ 0; in inextensible flexible (one- or two-
dimensional) bodies, the reaction of the global constraint gij ≤ gij0 , i, j =1,2 (expressing
that the components of the metric tensor cannot exceed their initial values) is a non-
negative stress tensor σij ≥ 0, i, j=1,2. Turning to quantum mechanics and considering
the uncertainty inequality

ΔxΔp ≥ (27)
2
in which Δx and Δp are the standard deviation of coordinate and impulse, √
respectively
2 ∇2 ρ
as a global constraint, one arrives at the quantum potential 2m√ρ as a “reaction” of
this constraint in the Madelung equations

∂ρ ρ
+ ∇ • ( ∇S) = 0 (28)
∂t m

∂S 2  2 ∇2 ρ
+ (∇S) + V − √ =0 (29)
∂t 2m ρ

Here ρ and S are the components of the wave functionϕ = ρeiS/h , and  is the Planck
constant divided by 2π. But since Eq. (27) is actually the Liouville equation, the quantum
potential represents a Liouville feedback similar to those introduced above via Eqs. (6)
and (10. Due to this topological similarity with quantum mechanics, the models that
belong to the same class as those represented by the system (7), (8) are expected to
display properties that are closer to quantum rather than to classical ones.

2.4 Summary
A new kind of dynamics that displays non-Newtonian properties such as self-generated
randomness and entanglement of different samples of the same stochastic process has been
introduced. These novel phenomena result from a feedback from the Liouville equation to
the equation of motion that is similar (but not identical) to those in quantum mechanics.

3. From Disorder to Order

3.1 Information Potential


Before introducing the model of Livings, we have to discuss another non-trivial prop-
erty of systems with the Liouville feedback. For that purpose, consider a Newtonian
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 21

particle of mass comparable to the mass of the molecules. Such a particle is subjected to
a fluctuating (thermal) force qL(t) called the Langevin force. The Brownian motion (in
terms of the velocity v) of that particle is described by a stochastic differential equation

v̇ = qL(t), < L(t) >= 0, < L(t)L(t ) >= 2δ(t − t ). (30)

Here q = const is the strength of fluctuations. The probability density ρ(V,t) of the
velocity distribution is described by the corresponding Fokker-Planck equation

∂ρ ∂ 2ρ
= q2 (31)
∂t ∂V 2
The solution to this equation that starts with the sharp initial value at V = 0

1 V2
ρ= √ exp(− ) (32)
2q πt 4q 2 t

demonstrates monotonous increase of entropy as a measure of disorder. Another property


of this solution is its irreversibility: replacement of t with (-t) leads to imaginary values
of density ρ.
It should be emphasized that Eqs. (29) and (30) are not coupled; in other words, the
particle “does not know” about its own probability distribution. This fact represents a
general property of Newtonian dynamics: the equations of motion (for instance, the
Hamilton-Jacobi equation) are not coupled with the corresponding Liouville equation
as well as the Langevin equations are not coupled with the corresponding Fokker-Planck
equation. However, in quantum mechanics, the Hamilton-Jacobi equation is coupled with
the Liouville equation via the quantum potential, and that constitutes the fundamental
difference between the Newtonian and quantum worlds.
Following quantum formalism, let us couple Eqs. (29) and (30). For that purpose,
introduce a function
Π = −α ln ρ(v, t) (33)
This function can be called “the information potential” since its expected value [-M ln
ρ] is equal to the Shannon information capacity H. (However, this potential cannot
be identified with a potential energy since it depends upon velocities rather than upon
positions). The gradient of this potential taken with the opposite sign can represent an
information-based force F = -grad Π per unit mass.

α ∂ρ
v̇ = qL(t) + . (34)
ρ ∂v

3.2 Negative Diffusion


Let us apply this force to the particle in Eq. (29) and present this equation in a dimen-
sionless form assuming that the parameter α absorbs the characteristic velocity and the
characteristic time
22 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

If one chooses α = q2 , then the corresponding Liouville equation (that takes the form
of the Fokker-Planck equation) will change from (30) to the following

∂ρ ∂ 2ρ ∂ q 2 ∂ρ
= q2 − [ρ ] = 0, ρ = ρ0 (V ) = const (35)
∂t ∂V 2 ∂V ρ ∂V
Thus, the information force stops the diffusion. However, the information force can be
even more effective: it can reverse the diffusion process and push the probability density
back to the sharp value in finite time. Indeed, suppose that in the information potential

√ ∞
α = q 2 exp D., where D(t) = ρV 2 dV. (36)
−∞

Then the Fokker-Planck equation takes the form


∂ρ √ ∂ 2ρ
= [q 2 (1 − exp D)] 2 . (37)
∂t ∂V
Multiplying Eq.(36) by V2 , then integrating it with respect to V over the whole space,
one arrives at ODE for the variance D(t)

Ḋ = 2q 2 (1 − exp D), i.e. Ḋ ≤ 0 if D ≥ 0 (38)

Thus, as a result of negative diffusion, the variance D monotonously vanishes regardless


of the initial value D(0). It is interesting to note that the time T of approaching D = 0
is finite
0 ∞
1 dD 1 dD π
T = 2 √ ≤ 2 √ = 2 (39)
q 1 − exp D q exp D − 1 3q
D(0) 0

This terminal effect is due to violation of the Lipchitz condition, (Zak, M.,1992) at D = 0

dḊ q2 √
= − √ exp D → ∞ at D → 0 (40)
dD D
Let us turn to a linear version of Eq. (36)

∂ρ ∂ 2ρ
= −q 2 . (41)
∂t ∂V 2
and discuss a negative diffusion in more details. As follows from the linear equivalent of
Eq. ((39)
dḊ
= −q 2 , i.e. D = D0 − q 2 t < 0 at t > D0 /q 2 (42)
dD
Thus, eventually the variance becomes negative, and that disqualifies Eq. (40) from being
meaningful. It has been shown (Zak, M., 2005) that the initial value problem for this
equation is ill-posed: its solution is not differentiable at any point. (Such an ill-posedness
expresses the Hadamard instability studied in (Zak, M., 1994)). Therefore, a negative
diffusion must be nonlinear in order to protect the variance from becoming negative, (see
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 23

Fig. 6.). One of possible realization of this condition is placing a terminal attractor (Zak,
M., 1992) at D = 0 as it was done in Eq. (36).
It should be emphasized that negative diffusion represents a major departure from
both Newtonian mechanics and classical thermodynamics by providing a progressive evo-
lution of complexity against the Second Law of thermodynamics, Fig. 7.

3.3 Drift
One notes that Eq. (36) is driftless, i.e. its solution preserves the initial mean value of
the state variable. Obviously, the drift can be easily introduced via both Newtonian or
information forces. In our approach we will follow the “Law of Parsimony”, or “Occam’s
Razor”: Pluritas non est ponenda sine necessitate, i.e. if a drift can be generated by
classical forces, it is not necessary to duplicate it with the information forces since that
would divert attention from a unique capability of information forces, namely, from their
role in progressive evolution of complexity.

3.4 Summary
A progressive evolution of complexity has been achieved via information potential that im-
plements the Liouville feedback and leads to a fundamentally new nonlinear phenomenon-
negative diffusion- that evolves “against the Second Law of thermodynamics”.

4. Model of Livings

4.1 General Model


Consider a system of n particles as intelligent agents that interact via the information
potential in the fashion described above. Then, as a direct generalization of Eqs. (33)
and (36), one obtains


n

v̇i = −ζ αij ln ρ(v1 , ...vn , t), i = 1, 2, ...n. (43)
j=1
∂vj

where αij are function of the correlation moments Dks

αij = αij (D11 , ...Dks , ...Dnn ),


∞ ∞ ∞ (44)
Dks = (vk − ξk )(vs − ξs )ρdvk dvs , ξj = vj ρdvj
−∞ −∞ −∞

and
∂ρ  n
∂ 2ρ
=ζ αij (45)
∂t j=1
∂Vj2
24 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Here ζ is a positive constant that relates Newtonian and information forces. It is intro-
duced in order to keep the functions αij dimensionless.
The solution to Eqs. (42) and (45)

vi = vi (t), ρ = ρ(V1 ...Vn , t), i = 1, 2, ...n (46)

must satisfy the constraint that is an n-dimensional generalization of the constraint D ≥


0, namely, a non-negativity of the matrix |Dij |, i.e. a non-negativity of all the left-corner
determinants

Det|Dij | ≤ 0, i, j = 1, i, j = 1, 2; ...i, l = 1, 2, ...n. (47)

4.2 Simplified Model


Since enforcement of the constraints (47) is impractical, we will propose a simpler model
on the expense of its generality assuming that the tensors αij and Dij are co-axial, and
therefore, the functions (43) can be reduced to the following

αii = αii (D11 , ...Dnn ), i = 1, 2, ...n, (48)

where αii and Dii are the eigenvalues of the corresponding tensors.
Referring Eqs. (42) and (45) to the principal coordinates, one obtains


v̇i = −ζαii ln ρ(v1 , ...vn , t), i = 1, 2, ...n. (49)
∂vi

∂ρ ∂2ρ
= ζαii (50)
∂t ∂Vi2
Since Egs. (49) and (50) have tensor structure, they can be rewritten in arbitrary system
of coordinates using standard rules of tensor transformations.
Let us express Eq. (50) in terms of the correlation moments: multiplying it byVi2 ,
then using partial integration, one arrives at an n-dimensional analog of Eq. (37)

Ḋii = 2ζαii (D11 , ...Dnn ), n = 1, 2, ...n, (51)

The last step is to choose such a structure of the functions (48) that would enforce the
constraints (47), i.e.
Dii ≥ 0, i = 1, 2, ...n, (52)
The simplest (but still sufficiently general) form of the functions (48) is a neural network
with terminal attractors

1 Dii
αii = (wij tanh D̃jj − ci D̃ii ), i = 1, 2, ...n, D̃ii = 0 (53)
2 D
that reduces Eqs.(51) to the following system (Zak, M., 2006a)

˙
D̃ii = ζ(wij tanh D̃jj − ci D̃ii ), i = 1, 2, ...n, (54)
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 25

Here D0 is a constant scaling coefficient of the same dimensionality as the correlation


coefficientsDii , and wij are dimensionless constants representing the identity of the sys-
tem.
Let us now analyze the effect of terminal attractor and, turning to Eq.(54), start with
the matrix | ∂∂D
Ḋii
ii
|. Its diagonal elements, i.e. eigenvalues, become infinitely negative when
the variances vanish since

∂ Dii 1
= √ → ∞ when Dii → 0 (55)
∂Dii 2 Dii
while the rest terms are bounded. Therefore, due to the terminal attractor, Eq. ((54)
linearized with respect to zero variances has infinitely negative characteristic roots, i.e.
it is infinitely stable regardless of the parameters wij . Therefore the principal variances
cannot overcome zero if their initial values are positive. This provides the well-posedness
of the initial value problem.

4.3 Invariant Formulation


Eqs. (49) and (50) can be presented in the following invariant form

v̇ = −ζα • ∇v ln ρ, (56)

ρ̇ = ζ∇2V ρ • •α, (57)

4.4 Variation Principle


Let us concentrate upon the capability of Livings to decrease entropy (see Eq. (1)) with-
out external forces. This privileged motion is carried out through negative diffusion that
requires negativity of the eigenvalues of the tensor α in Eqs. (56) and (57). Redefining
the concept of information potential for n-dimensional case (see Eq. (32))

Π = ζ ln ρ (32a)

one can rewrite Eq. (56) as


v̇ = −α • ∇Π (56a)
Then, along the trajectory defined by Eq. (56a) the following inequality holds

Π̇ = ∇Π • v̇ = −∇Π • (α • ∇Π) > 0 (58)

Thus, the privileged motion of Livings monotonously maximizes the information potential
along a chosen trajectory. This means that if the initial densityρ0 < 1, and therefore, Π0 <
0 at the chosen trajectory, the density would monotonously decrease along this trajectory,
i.e. ρ̇ < 0. Conversely, ifρ0 > 1, and therefore,Π0 > 0, the density would monotonously
increase, i.e. ρ̇ > 0. Hence, the privileged motion of Livings driven by negative diffusion
monotonously decreases the flatness of the initial density distribution. Obviously, the
26 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

initial choice of the trajectory is determined by Eq. (57). But the most likely trajectory
is those that pass through maxima of density distributions. Since that trajectory has also
maxima of the information potential (32a) (compare to other trajectories), one arrive at
the following principle: The most likely privileged motion of Livings delivers the global
maximum to the information potential (32a), (M. Zak, 2005a)

4.5 Remark
Strictly speaking, the formulated variation principle is necessary, but not sufficient for
derivation of the governing equations (56) and (57): this principle should be considered
only as a complement to the Hamiltonian principle taken in its non-variation formulation
(since the information “potential” depends upon velocities rather than upon coordinates):

t1

δ R = δS + δ  Πdt = 0. (58a)
t0

Here S- is action, and δ  Π is an elementary work of the non-conservative information force


∇ • Π. It is obvious that the Hamiltonian principle in the form (58a) leads to equation of
motion (56), while the inequality (58) (along with the continuity equation (57)) specifies
the information force.

4.6 Summary
A closed system of dynamical equations governing behavior of Livings has been introduced
and discussed.

5. Interpretation of the Model

5.1 Mathematical Viewpoint


The model is represented by a system of nonlinear ODE (56) and a nonlinear
parabolic PDE (57) coupled in a master-slave fashion: Eq. (57) is to be solved inde-
pendently, prior to solving Eq. (56). The coupling is implemented by a feedback that
includes the first gradient of the probability density, and that converts the first order
PDE (the Liouville equation) to the second order PDE (the Fokker-Planck equation).
Its solution, in addition to positive diffusion, can display negative diffusion as well, and
that is the major departure from the classical Fokker-Planck equation. Fig. 7. It has
been demonstrated that negative diffusion must be nonlinear with an attractor at zero
variances to guarantee well-posedness of the initial value problem, and that imposes addi-
tional constraints upon the mathematical structure of the model, (see Eqs. (47) and (52)).
The nonlinearity is generated by a feedback from the PDE (57) to the ODE (56), (that
is the same feedback that is responsible for parabolicity of the PDE (57)). As a result of
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 27

the nonlinearity, the solutions to PDE can have attractors (static, periodic, or chaotic)
in probability space(see Eqs. (51). The multi-attractor limit sets allow one to introduce
an extension of neural nets that can converge to a prescribed type of a stochastic process
in the same way in which a regular neural net converges to a prescribed deterministic
attractor. The solution to ODE (56) represents another major departure from classical
ODE: due to violation of Lipchitz conditions at states where the probability density has
a sharp value, the solution loses its uniqueness and becomes random. However, this ran-
domness is controlled by the PDE (57) in such a way that each random sample occurs
with the corresponding probability, (see Fig.4).

5.2 Physical Viewpoint

The model represents a fundamental departure from both Newtonian and statistical me-
chanics. In particular, negative diffusion cannot occur in isolated systems without help
of the Maxwell sorting demon that is strictly forbidden in statistical mechanics. The only
conclusion to be made is that the model is non-Newtonian, although it is fully consistent
with the theory of differential equations and stochastic processes. Strictly speaking, it is a
matter of definition weather the model represents an isolated or an open system since the
additional energy applied via the information potential is generated by the system “it-
self” out of components of the probability density. In terms of a topology of its dynamical
structure, the proposed model links to quantum mechanics: if the information potential
is replaced by the quantum potential, the model turns into the Madelung equations that
are equivalent to the Schrödinger equation (Takabayasi, T., 1953), Fig. 8.It should be
noticed that the information potential is introduced via the dimensionless parameter α
that is equal to the rate of decrease of the disorder (-dD/dt), (see Eq. (51)) and a new
physical parameter ζ of dimension [ζ] = m2 /sec3 describing a new physical quantity that
relates the rate of decrease of disorder to the specific (information-based) force. For-
mally the parameter ζ introduces the information potential in the same way in which the
Planck constant  introduces quantum potential. The system of ODE (56) characterized
by velocities vi describes a mechanical motion of the system driven by information forces.
Due to specific properties of these forces discussed above, this motion acquires properties
similar to those of quantum mechanics. These properties are discussed below.
α.Superposition. In quantum mechanics, any observable quantity corresponds to an
eigenstate of a Hermitian linear operator. The linear combination of two or more eigen-
states results in quantum superposition of two or more values of the quantity. If the
quantity is measured, the projection postulate states that the state will be randomly
collapsed onto one of the values in the superposition (with a probability proportional
to the square of the amplitude of that eigenstate in the linear combination). Let us
compare the behavior of the model of Livings from that viewpoint. As follows from Eq.
(15), all the particular solutions intersect at the same point x = 0 at t = 0,and that
leads to non-uniqueness of the solution due to violation of the Lipcshitz condition (see
Eq. (17)). Therefore, the same initial conditionx = 0 at t = 0yields infinite number
28 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

of different solutions forming a family (15); each solution of this family appears with a
certain probability guided by the corresponding Fokker-Planck equation. For instance,
in case of Eq. (15), the “winner” solution is x ≡ 0since it passes through the maxima
of the probability density (13). However, with lower probabilities, other solutions of the
family (15) can appear as well. Obviously, this is a non-classical effect. Qualitatively,
this property is similar to those of quantum mechanics: the system keeps all the solutions
simultaneously and displays each of them “by a chance”, while that chance is controlled
by the evolution of probability density (12). It should be emphasized that the choice of
displaying a certain solution is made by the Livings model only once, at t = 0, i.e. when
it departs from the deterministic to a random state; since than, it stays with this solution
as long as the Liouville feedback is present.
β. Entanglement. Quantum entanglement is a phenomenon in which the quantum
states of two or more objects have to be described with reference to each other, even
though the individual objects may be spatially separated. This leads to correlations
between observable physical properties of the systems. For example, it is possible to
prepare two particles in a single quantum state such that when one is observed to be
spin-up, the other one will always be observed to be spin-down and vice versa, this
despite the fact that it is impossible to predict, according to quantum mechanics, which
set of measurements will be observed. As a result, measurements performed on one
system seem to be instantaneously influencing other systems entangled with it.
Qualitatively similar effect has been found in the proposed model of Livings (see
Eqs. (21)-(23)) that demonstrate that different realizations of motion emerged from
instability of Eq. (15) are entangled: they must satisfy the global kinematical constraint
(23). Therefore, as follows from Eq. (23), the entanglement effect correlates different
samples of the same stochastic process. It is instructive to notice again that quantum
entanglement was discovered in a special class of quantum states that become entangled
in the course of their simultaneous creation.
γ. Decoherence. In quantum mechanics, decoherence is the process by which quantum
systems in complex environments exhibit classical behavior. It occurs when a system
interacts with its environment in such a way that different portions of its wavefunction
can no longer interfere with each other.
Qualitatively similar effects are displayed by the proposed model of Livings. In order
to illustrate that, let us turn to Eqs. (11), (12), and notice that this system makes a
choice of the particular solution only once i.e. when it departs from the deterministic to
a random state; since then, it stays with this solution as long as the Liouville feedback
is present,(σ = 0). However, as soon as this feedback disappears,(σ = 0), the system be-
comes classical, i.e. fully deterministic, while the deterministic solution is a continuation
of the corresponding “chosen” random solution, (see Fig.9).
δ. Uncertainty Principle. In quantum physics, the Heisenberg uncertainty principle
states that one cannot measure values (with arbitrary precision) of certain conjugate
quantities which are pairs of observables of a single elementary particle. These pairs
include the position and momentum. Similar (but not identical) relationship follows
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 29

from Eq. (15): v v̇ = C 2 /2, i.e. the product of the velocity and the acceleration is
constant along a fixed trajectory. In particular, at t = 0, v and v̇ can not be defined
separately.

5.3 Biological Viewpoint

The proposed model illuminates the “border line” between living and non-living systems.
The model introduces a biological particle that, in addition to Newtonian properties,
possesses the ability to process information. The probability density can be associated
with the self-image of the biological particle as a member of the class to which this par-
ticle belongs, while its ability to convert the density into the information force - with
the self-awareness (both these concepts are adopted from psychology). Continuing this
line of associations, the equation of motion (such as Eqs (56)) can be identified with a
motor dynamics, while the evolution of density (see Eqs. (57) –with a mental dynamics.
Actually the mental dynamics plays the role of the Maxwell sorting demon: it rearranges
the probability distribution by creating the information potential and converting it into
a force that is applied to the particle. One should notice that mental dynamics describes
evolution of the whole class of state variables (differed from each other only by initial
conditions), and that can be associated with the ability to generalize that is a privilege of
living systems. Continuing our biologically inspired interpretation, it should be recalled
that the second law of thermodynamics states that the entropy of an isolated system can
only increase, Eig.3. This law has a clear probabilistic interpretation: increase of entropy
corresponds to the passage of the system from less probable to more probable states, while
the highest probability of the most disordered state (that is the state with the highest
entropy) follows from a simple combinatorial analysis. However, this statement is correct
only if there is no Maxwell’ sorting demon, i.e., nobody inside the system is rearranging
the probability distributions. But this is precisely what the Liouville feedback is doing:
it takes the probability density ρ from Equation (57), creates functionals and functions
of this density, converts them into a force and applies this force to the equation of motion
(56). As already mentioned above, because of that property of the model, the evolution
of the probability density becomes nonlinear, and the entropy may decrease “against the
second law of thermodynamics”, Fig.7. Obviously the last statement should not be taken
literary; indeed, the proposed model captures only those aspects of the living systems that
are associated with their behavior, and in particular, with their motor-mental dynamics,
since other properties are beyond the dynamical formalism. Therefore, such physiologi-
cal processes that are needed for the metabolism are not included into the model. That
is why this model is in a formal disagreement with the second law of thermodynamics
while the living systems are not. In order to further illustrate the connection between
the life-nonlife discrimination and the second law of thermodynamics, consider a small
physical particle in a state of random migration due to thermal energy, and compare
its diffusion i.e. physical random walk, with a biological random walk performed by a
bacterium. The fundamental difference between these two types of motions (that may be
30 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

indistinguishable in physical space) can be detected in probability space: the probability


density evolution of the physical particle is always linear and it has only one attractor:
a stationary stochastic process where the motion is trapped. On the contrary, a typical
probability density evolution of a biological particle is nonlinear: it can have many dif-
ferent attractors, but eventually each attractor can be departed from without any “help”
from outside.
That is how H. Berg, 1983, describes the random walk of an E. coli bacterium:” If a cell
can diffuse this well by working at the limit imposed by rotational Brownian movement,
why does it bother to tumble? The answer is that the tumble provides the cell with a
mechanism for biasing its random walk. When it swims in a spatial gradient of a chemical
attractant or repellent and it happens to run in a favorable direction, the probability of
tumbling is reduced. As a result, favorable runs are extended, and the cell diffuses with
drift”. Berg argues that the cell analyzes its sensory cue and generates the bias internally,
by changing the way in which it rotates its flagella. This description demonstrates that
actually a bacterium interacts with the medium, i.e., it is not isolated, and that reconciles
its behavior with the second law of thermodynamics. However, since these interactions are
beyond the dynamical world, they are incorporated into the proposed model via the self-
supervised forces that result from the interactions of a biological particle with “itself,”
and that formally “violates” the second law of thermodynamics. Thus, the proposed
model offers a unified description of the progressive evolution of living systems. Based
upon this model, one can formulate and implement the principle of maximum increase
of complexity that governs the large-time-scale evolution of living systems. It should
be noticed that at this stage, our interpretation is based upon logical extension of the
proposed mathematical formalism, and is not yet corroborated by experiments.

5.4 Psychological Viewpoint

The proposed model can be interpreted as representing interactions of the agent with
the self-image and the images of other agents via the mechanisms of self-awareness. In
order to associate these basic concepts of psychology with our mathematical formalism,
we have to recall that living systems can be studied in many different spaces such as
physical (or geographical) space as well as abstract (or conceptual) spaces. The latter
category includes, for instance, social class space, sociometric space, social distance space,
semantic space e.t.c.Turning to our model, one can identify two spaces: the physical space
x, t in which the agent state variables vi = ẋi evolve,(see Eqs.(56)), and an abstract space
in which the probability density of the agent’ state variables evolve (see Eq.(57)).The
connection with these spaces have been already described earlier: if Eqs. (56) are run
many times starting with the same initial conditions, one will arrive at an ensemble of
different random solutions, while Eq. (57) will show what is the probability for each of
these solutions to appear. Thus, Eq. (57) describes the general picture of evolution of the
communicating agents that does not depend upon particular initial conditions. Therefore,
the solution to this equation can be interpreted as the evolution of the self- and non-self
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 31

images of the agents that jointly constitutes the collective mind in the probability space,
Fig. (10). Based upon that, one can propose the following interpretation of the model
of communicating agents: considering the agents as intelligent subjects, one can identify
Eqs. (56) as a model simulating their motor dynamics, i.e. actual motions in physical
space, while Eq.(57) as the collective mind composed of mental dynamics of the agents.
Such an interpretation is evoked by the concept of reflection in psychology, (V. Lefebvre,
2001). Reflection is traditionally understood as the human ability to take the position
of an observer in relation to one’s own thoughts. In other words, the reflection is the
self-awareness via the interaction with the image of the self. Hence, in terms of the
phenomenological formalism proposed above, a non-living system may possess the self-
image, but it is not equipped with the self-awareness, and therefore, this self-image is
not in use. On the contrary, in living systems the self-awareness is represented by the
information forces that send information from the self-image (57) to the motor dynamics
(56). Due to this property that is well-pronounced in the proposed model, an intelligent
agent can run its mental dynamics ahead of real time, (since the mental dynamics is fully
deterministic, and it does not depend explicitly upon the motor dynamics) and thereby, it
can predict future expected values of its state variables; then, by interacting with the self-
image via the information forces, it can change the expectations if they are not consistent
with the objective. Such a self-supervised dynamics provides a major advantage for
the corresponding intelligent agents, and especially, for biological species: due to the
ability to predict future, they are better equipped for dealing with uncertainties, and
that improves their survivability. It should be emphasized that the proposed model,
strictly speaking, does not discriminate living systems of different kind in a sense that all
of them are characterized by a self-awareness-based feedback from mental (57) to motor
(56) dynamics. However, in primitive living systems (such as bacteria or viruses) the self-
awareness is reduced to the simplest form that is the self-nonself discrimination; in other
words, the difference between the living systems is represented by the level of complexity
of that feedback.

5.5 Neuro-science Viewpoint


The proposed model represents a special type of neural net. Indeed, turning to Eqs.
(54) and reinterpreting the principal correlation moments Dii as neurons’ mean soma
potentials, one arrives at a conventional neural net formalism.
α. Classical neural nets. We will start with a brief review of the classical version of
this kind of dynamical models in order to outline some of its advantages and limitations.
The standard form of recurrent neural networks (NN) is

ẋi = wij tanh xj − ci xi (59)

where xi are state variables, wij are synaptic interconnection, or weights (associated with
the NN topology). The system (59) is nonlinear and dissipative due to the sigmoid func-
tion tanh. The nonlinearity and dispassivity are necessary (but not sufficient) conditions
32 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

that the system (59) has attractors. The locations of the attractors and their basins in
phase (or configuration) space are prescribed by an appropriate choice of the synaptic
interconnections wij which can be found by solving the inverse problem (followed by
the stability analysis), or by learning (that is a dynamical relaxation procedure based
upon iterative adjustments of wij as a result of comparison of the net output with known
correct answers). In both cases, wij are constants, and that is the first limitation of
recurrent NN. Indeed, although the NN architecture (59) is perfectly suitable for such
tasks as optimization, pattern recognition, associative memory, i.e., when fixed topology
is an advantage, it cannot be exploited for simulation of a complex dynamical behavior
that is presumably comprised of a chain of self-organizing patterns (like, for instance, in
genome) since for that kind of tasks, variable topology is essential. However, there is no
general analytical approach to the synthesis of such NN. And now we are coming to the
second limitation of NN (1): their architecture does not have a tensor structure. Indeed,
the state variables and the interconnections wij cannot be considered as a vector and a
tensor, respectively, since their invariants are not preserved under linear transformations
of the state variables. Obviously, the cause of that is the nonlinearity in the form of
the sigmoid function. That is why the dynamical system (59) (even with a fixed topol-
ogy) cannot be decoupled and written in a canonical form; as a result of that, the main
mathematical tools for NN synthesis are based upon numerical runs.
β. Mystery of mirror neuron. The proposed model represents a special type of neural
net. Indeed, turning to Eqs. (54) and reinterpreting the principal correlation moments
Dii as neurons’ mean soma potentials, one arrives at a conventional neural net formalism.
The analysis of Eq. (59) can be linked to the concept of a mirror neuron. The discovery
of mirror neurons in the frontal lobes of macaques and their implications for human brain
evolution is one of the most important findings of neuroscience in the last decade. Mirror
neurons are active when the monkeys perform certain tasks, but they also fire when the
monkeys watch someone else perform the same specific task. There is evidence that a
similar observation/action matching system exists in humans. In the case of humans, this
phenomenon represents the concept of imitation learning, and this faculty is at the basis
of human culture. Hence, a mirror neuron representing an agent A can be activated by
an expected (or observed) action of an agent B which may not be in a direct contact with
the agent A at all. Quoting the discoverer of the mirror neuron, Dr. Giacomo Rizzolatti,
“the fundamental mechanism that allows us a direct grasp of the mind of others is not
conceptual reasoning, but direct simulation of the observed event through the mirror
mechanism.” In other words, we do not need to think and analyze, we know immediately
the intensions of other people. In terms of the mathematical formalism, such a direct
grasp of the mind of others represents a typical non-locality, i.e. an “invisible” influence
on a distance that is similar to quantum entanglement.
γ. Mirror neural nets. In order to capture this fundamentally new phenomenon, we
will apply the approximated version of dynamical formalism developed in the Section
3, and modify Eq. (49) and (53). In the simplest case when αij = const., the solution
describing the transition from initial (sharp) to current density in Eq. (50) is given by
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 33

the Gaussian distribution, (Risken,H., 1989),

ρ({V }, t|{V  }, t ) = (2π)n/2 [DetD̃(t − t )]−1/2 exp{− 12 [D̃−1 (t − t )]ij [Vi − Gik (t − t )Vk ]

×[Vj − Gjl (t − t)Vl ]}


(60)
Here the Green function in matrix notation is
1
G(t) = exp(−at) = I − at + a2 t2 ± ... (61)
2
where the matrix elements of a and G are given by aij and Gij , respectively.
If αij are not constants, for instance, if they are defined by Eqs. (53), the solution
(60) are valid only for small times. (Actually such an approximation follows from ex-
pansion of a probability density in Gram-Charlier series with keeping only the first term
of that series.) Nevertheless, for better physical interpretation, we will stay with this
approximation in our further discussions. Substituting the solution (60) into Eq.(49),
one obtains 
v̇i = ζ{(wij tanh D̃jj − cii D̃ii )}{[D̃−1 ]ij (vj − Gjl vl )} (62)
Eqs. (62) are to be complemented with Eq. (54). (In both equations, the summation
is with respect to the index j.) Formally Eq.(54) represents a classical neural net with
terminal attractors where the principle variances Dii play the role of state variables.
Depending upon the chosen values of constant synaptic interconnections wij , the variances
D̃ii can converge to static, periodic or chaotic attractors. In particular, if wij = wji , the
net has only static attractors. However, regardless of synaptic interconnections, the state
D̃ii = 0 (i = 1,2,. . . n), is always a terminal attractor that protects the variances from
crossing zeros. Eqs.(62) represent a stochastic neural net driven by its own principle
variances that, in turn, is governed by the neural net (54). The connection between the
nets (54) and (62) is the following: if Eqs (62) are run many times, one will arrive at an
ensemble of different random solutions, while Eq. (54) will show what is the probability
for each of these solutions to appear. Thus, Eq. (54) describes the general picture of
evolution that does not depend upon particular initial conditions. Therefore, the solution
to this equation can be interpreted as the evolution of the self- and non-self images of the
neurons that jointly constitutes the collective mind in the probability space. Let us recall
that in classical neural nets (59), each neuron receives fully deterministic information
about itself and other neurons, and as a result of that, the whole net eventually approaches
an attractor. In contradistinction to that, in the neural net (62), each neuron receives the
image of the self and the images of other neurons that are stored in the joint probability
distribution of the collective mind, Fig. 10. These images are not deterministic: they
are characterized by uncertainties described by the probability distribution, while that
distribution is skewed toward the expected value of the soma potential, with variances
controlled by Eq. (54). In our view, such a performance can be associated with the
mirror neurons. Indeed, as mentioned above, a mirror neuron fires both when performing
an action and when observing the same action performed by another subject. The way
34 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

in which this neuron works is the following. It is assumed that all the communicating
neurons belong to the same class in a sense that they share the same general properties
and habits. It means that although each neuron may not know the exact values of soma
potentials of the rest of the neurons, it, nevertheless, knows at least such characteristics
as their initial values (to accuracy of initial joint probability density, or, at least, initial
expected values and initial variances). This preliminary experience allows a neuron to
reconstruct the evolution of expected values of the rest of the neurons using the collective
mind as a knowledge base. Hence, the neuron representing an agent A can be activated by
an expected action of an agent B that may not be in a direct contact with the agent A at
all, and that can be associated with the mirror properties of the neuron. The qualitative
behavior of the solution to the mirror-neuron-based net (62) and (54) is illustrated in
Fig. 11. The collective properties of mirror neurons, i.e. the mirror neural nets, have
a significant advantage over the regular neural nets: they possess a fundamentally new
type of attractor –the stochastic attractor that is a very powerful generalization tool.
Indeed, it includes a much broader class of motions than static or periodic attractors. In
other words, it provides the highest level of abstraction. In addition to that, a stochastic
attractor represents the most complex patterns of behavior if the mirror net describes a
set of interacting agents. Indeed, consider a swarm of insects approaching some attracting
pattern. If this pattern is represented by a static or periodic attractor, the motion of the
swarm is locked up in a rigid pattern of behavior that may decrease its survivability.
On the contrary, if that pattern is represented by a stochastic attractor, the swarm still
has a lot of freedom, and only the statistics invariants of the swarm motion is locked
up in a certain pattern of behavior. Fig. 12. It should be emphasized that, due to
the multi-attractor structure, the proposed model provides the following property: if the
system starts from different initial conditions, it may be trapped in a different stochastic
pattern. Such a property, in principle, cannot be provided by regular neural nets or
cellular automata since they can have only one stochastic attractor, Fig. 13.
δ. Link to quantum entanglement. Continuing the discussion about a formal similar-
ity between the concept of mirror neuron and quantum entanglement, we will emphasize
again that both of these phenomena result from the global constraint originated from
the Liouville feedback, namely, the quantum potential (see Eqs. ( 27) and (28)), and the
information potential (see Eqs. (56) and (57)). In the both cases, the probability density
ρ enters the equation of motion imposing the global constraint upon the state variables
via the normalization condition (see Eq. (23)). However, it should be emphasized the
difference between the status of these models. The model of quantum entanglement is
well-established (at least, within the Schrödinger formalism), being corroborated by enor-
mous number of experiments. On the other hand, the model of mirror neuron nets has
been proposed in this paper. It is based upon two principles that complement classical
mechanics. First principle requires the system capability to decrease entropy by internal
effort to be “alive”; the second principle is supposed to provide global constraint upon
the motions of mirror neurons. Both of these principles are implemented via a specially
selected feedback from the Liouville equation. This feedback is different from those in
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 35

quantum mechanics; however the topologies of quantum and mirror neuron systems are
similar. Now we are ready to address the fundamental question: how Nature implements
global constraints via probability? Does it mean that there exists some sort of “univer-
sal mind”? The point is that the concept of probability does not belong to objective
physical world; it rather belongs to a human interpretation of this world. Indeed, we can
observe and measure a random process, but we cannot measure directly the associated
probabilities: that would require a special data processing, i.e. a “human touch”. As
far as quantum mechanics is concerned, this question is still unanswered. However, for
Livings, the global constraint via probability can be associated with the concept of col-
lective mind. Indeed, based upon the assumption that all Livings which belong to the
same class possess the identical abstract image of the external world, and recalling that,
in terms of the proposed formalism, such an image is represented by the joint probability,
one concludes that in Livings, the global constraint is implemented by the mechanism of
“general knowledge” stored in the collective mind and delivered to the mirror neurons
via the information forces. Several paradigms of self-organization (such as transmission
of conditional information, decentralized coordination, cooperative computing, and com-
petitive games in active systems) based upon entanglement effects, have been proposed
in (Zak, M., 2002a).

5.6 Social and Economic Viewpoint

One of the basic problem of social theory is to understand “how, with the richness of
language and the diversity of artifacts, people can create a dazzlingly rich variety of
new yet relatively stable social structures”, (M.Arbib, 1986). Within the framework of
the dynamical formalism, the proposed model provides some explanations to this puz-
zle. Indeed, social events are driven by two factors: the individual objectives and social
constraints. The first factor is captured by the motor dynamics (56), while the social con-
straint is created by the collective mind (57). A balance between these factors (expressed
by stochastic attractors) leads to stable social structures, while a misbalance (expressed
by stochastic repellers) causes sharp transitions from one social structure to another (rev-
olutions) or to wandering between different repellers (chaos, anarchy). For an artificial
“society” of communicating agents, one can assign individual objectives for each agent as
well as the collective constrains imposed upon them and study the corresponding social
events by analyzing the governing equations (56) and (57). However, the same strategy
is too naı̈ve to be applied to a human society. Indeed, most human as members of a
society, do not have rational objectives: they are driven by emotions, inflated ambitions,
envy, distorted self- and nonself images, etc. At least some of these concepts can be
formalized and incorporated into the model. For instance, one can consider emotions to
be proportional to the differences between the state variables v and their expectations χ

Em = c(v̄ − v). (63)


36 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Eq.(63) easily discriminates positive and negative emotions. Many associated concepts
(anger, depression, happiness, indifference, aggressiveness. and ambitions) can be derived
from this definition (possibly, in combination with distorted self- and nonself images).
But the most accurate characteristic of the human nature was captured by cellular au-
tomata where each agent copies the behaviors of his closest neighbors (which in turn,
copy their neighbors, etc.). As a result, the whole “society” spontaneously moves toward
an unknown emerging“objective”. Although this global objective is uniquely defined by
a local operator that determines how an agent processes the data coming from his neigh-
bors, there is not known any explicit connection between this local operator and the
corresponding global objective: only actual numerical runs can detect such a connection.
Notwithstanding the ingenuity of his model, one can see its major limitation: the model
is not equipped with a collective mind (or by any other type of a knowledge base), and
therefore, its usefulness is significantly diminished in case of incompleteness of informa-
tion. At the same time, the proposed model (56) and (57) can be easily transformed
into cellular automata with the collective mind. In order to do that one has to turn to
Eqs.(56), replace the sigmoid function by a local operator, and the time derivative -by
the time difference. Then the corresponding Fokker-Planck equation (57) reduces to its
discrete version that is Markov chains,( Zak, M., 2000). On the conceptual level, the
model remains the same as discussed in the previous sections. The Fig.14 illustrates a
possible approach to the social dynamics based upon the proposed model.

5.7 Language Communications Viewpoint

Language represents the best example of a communication tool with incomplete informa-
tion since any message, in general, can be interpreted in many different ways depending
upon the context i.e. upon the global information sheared by the sender and the receiver.
Therefore, the proposed model is supposed to be relevant for some language-oriented
interpretations. Indeed, turning to Eqs.(56), one can associate the weighted sum of the
state variables with the individual interpretations of the collective message made by the
agents. The sigmoid functions of these sums form the individual responses of the agents
to this message. These responses are completed by the information forces that compen-
sate the lack of information in the message by exploiting the global sheared information
stored in the collective mind, (see Eq. (57)). The agent’s responses converted into the
new values of their state variables are transformed into the next message using the same
rules, etc. These rules determined by the structure of Eqs. (56) and (57) can be associ-
ated with the grammar of the underlying language. In particular, they are responsible for
the convergence to- or the divergence from the expected objective. It should be noticed
that the language structure of the proposed model is invariant with respect to semantics.
Hence, in terms of the linguistics terminology that considers three universal structural
levels: sound, meaning and grammatical arrangement, (Yaguello, M.,1998), we are deal-
ing here with the last one. To our opinion, the independence of the proposed model upon
the semantics is an advantage rather than a limitation: it allows one to study invariant
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 37

properties of the language evolution in the same way in which the Shannon information
(that represents rather an information capacity) allows one to study the evolution of
information regardless of a particular meaning of the transmitted messages.
Let us now try to predict the evolution of language communications based upon the
proposed model. As mentioned earlier, the evolution of the living systems is always
directed toward the increase of their complexity. In a human society, such a progres-
sive evolution is effectively implemented by increase or the number of reflections in a
chain”What do you think I think you think, etc.” The society may be stratified into
several levels or “clubs” so that inside each club the people will shear more and more
global information. This means that the language communications between the members
of the same club will be characterized by the increased capacity of the collective mind
(see Eq.(57)), and decreased information transmitted by the messages (see Eqs.(56)). In
the theoretical limit, these messages will degenerate into a string of symbols, that can
be easily decoded by the enormously large collective mind The language communications
across the stratified levels will evolve in a different way: as long as the different clubs
are drifting apart, the collective mind capacity will be decreasing while the messages will
become longer and longer. However, the process of diffusion between these two streams
(not included in our model) is very likely, see Fig.14.

5.8 Summary
Interpretation of the proposed dynamical model of Livings has been introduced and
discussed from viewpoints of mathematics, physics, biology, neurosciences, etc.

6. Complexity for Survival of Livings

6.1 Measure of Survivability


In this sub-section, we will apply the proposed model to establish a connection
between complexity and survivability of Livings. We will introduce, as a measure of
survivability, the strength of the random force that, being applied to a particle, nullifies
the inequality (1). For better physical interpretation, it will be more convenient to
represent the inequality (1) in terms of the variance D

Ḋ < 0 (64)

remembering that for normal probability density distribution



H = log2 2πeD2 (65)

while the normal density is the first term in the Gram-Charlier series for representation
of an arbitrary probability distribution.
Thus, the ability to survive (in terms of preserving the property (1) under action of a
random force) can be achieved only with help of increased complexity. However, physical
38 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

complexity is irrelevant: no matter how complex is Newtonian or Langevin dynamics, the


second law of thermodynamics will convert the inequality (1) into the opposite one. The
only complexity that counts is those associated with mental dynamics. Consequently,
increase of complexity of mental dynamics, and therefore, complexity of the information
potential, is the only way to maximize the survivability of Livings. This conclusion will
be reinforced by further evidence to be discussed in the following section.

6.2 Mental Complexity via Reflection of Information


In this sub-section, we will show that communication between living particles via infor-
mation potential increases their survivability. For that purpose, consider a system of two
living particles (or intelligent agents) that interact via the simplest linear information
potential in the fashion described above. We will start with the case when each particle
interacts only with its own image. The motor dynamics of the system is the following


v̇1 = −ζ(q 2 − β1 D1 ) ln ρ1 (v1 , t), (66)
∂v1


v̇2 = −ζ(q 2 − β2 D2 ) ln ρ2 (v2 , t), (67)
∂v2
Then the mental dynamics in terms of the variance is described by two uncoupled equa-
tions
Ḋ1 = ζ(q 2 − β1 D1 ) (68)
Ḋ2 = ζ(q 2 − β2 D2 ) (69)
The solutions to these equations subject to zero initial conditions asymptotically approach
the stationary values q 2 /β1 and q 2 /β2 , respectively, while

Ḋ1 > 0, and Ḋ2 > 0 (70)

Thus, non-communicating agents (66) and (67) do not expose the property of living
systems (64) and behave as a physical non-living system.
Let us now increase the complexity by allowing the agents to communicate:


v̇1 = −ζ(q 2 − βD2 ) ln ρ1 (v1 , t), (71)
∂v1


v̇2 = −ζ(q 2 + βD1 ) ln ρ2 (v2 , t), (72)
∂v2
In this case, each agent interacts with the image of another agent. Then the mental
dynamics is represented by two coupled equations

Ḋ1 = ζ(q 2 − βD2 ) (73)

Ḋ2 = ζ(q 2 + βD1 ) (74)


Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 39

This system describes harmonic oscillations induced by a step-function-force originated


from noise of the strength q 2 , (Zak, M., 2007a).
Obviously, there are periods when

Ḋ1 < 0, or Ḋ2 < 0 (75)

i.e. the communicating agents expose the property of life (64). It should be emphasized
that no isolated physical system can oscillate in probability space since that is forbidden
by the second law of thermodynamics, Figure 13.
Oscillation of variances described by Eqs. (73) and (74), represents an exchange of
information between the agents, and it can be interpreted as a special type of communica-
tions: conversation. During such a conversation, information is reflected from one agent
to another, back and forth. Obviously, we are dealing here with Shannon information
capacity that does not include semantics.
This paradigm can be generalized to the case of n communicating agents

v̇i = −ζ(q 2 − βij Dj ) ln ρi (vi , t), βij = −βji (76)
∂vi

Ḋi = ζ(q 2 − βij Dj ) (77)


Since the matrix of the coefficients βij is skew-symmetric, its characteristic roots are pure
imaginary, and therefore, the solution to Eq. (77) is a linear combination of weighted
harmonic oscillations of different frequencies. The interpretation of this solution is similar
to those of the case of two agents: it describes a conversation between n agents. Indeed,
the information from the ith agent is distributed among all the rest agents, then reflected
and distributed again, etc. Obviously, that solution possesses the property of life in the
sense of the inequalities (75), Fig. 16.

6.3 Image Dynamics: What do you think I think you think


In this sub-section we will discuss a special case when additional information is needed
to compensate incomplete information of agents about each other. We will start with
the simplest model of two interacting agents assuming that each agent is represented
by an inertionless classical point evolving in physical space. That allows us to consider
positions x (instead of velocities v) as state variables. We will also assume that the
next future position of each agent depends only upon its own present position and the
present position of his opponent. Then their evolutionary model can be represented by
the following system of differential equations

ẋ1 = f1 (x1 , x2 ) (78)

ẋ2 = f2 (x1 , x2 ) (79)


We will start with the assumption that these agents belong to the same class, and there-
fore, they know the structure of the whole system (78), (79). However, each of the agents
40 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

may not know the initial condition of the other one, and therefore, he cannot calculate
the current value of his opponent’s state variable. As a result of that, the agents try to
reconstruct these values using the images of their opponents This process can be associ-
ated with the concept of reflection; in psychology reflection is defined as the ability of a
person to create a self-nonself images and interact with them.
Let us turn first to the agent 1. In his view, the system (78), (79) looks as following

ẋ11 = f1 (x11 , x21 ) (80)

ẋ21 = f2 (x21 , x121 ) (81)

where x11 is the self-image of the agent 1, x21 is the agent’s 1 image of the agent 2, and
x121 is the agent’s 1 image of the agent’s 2 image of the agent 1. This system is not closed
since it includes an additional 3-index variable x121 . In order to find the corresponding
equation for this variable, one has to rewrite Eqs.(30),(31) in the 3-index form. However,
it is easily verifiable that such form will include 4-index variables, etc., i.e. this chain
of equations will never be closed. By interchanging the indices 1 and 2 in Eqs.(78) and
(79), one arrives at the system describing the view of the agent 2. The situation can be
generalized from two- to n – dimensional systems. It is easy to calculate that the total
number of equations for the m-th level of reflection, i.e. for the m-index variables, is

Nm = nm . (82)

The chain of reflections illustrating the paradigm: “what do you think I think you
think. . . ” is presented in Figure 17.
Thus, as follows from Eq. (82), the number of equations grows exponentially with
the number of the levels of reflections, and it grows linearly with the dimensionality n
of the original system. It should be noticed that for each m-th level of reflection, the
corresponding system of equations always includes (m + 1)-index variables, and therefore,
it is always open. Hence, for any quantitative results, this system must be supplemented
by a closure, i.e. by additional equations with respect to extra-variables. In order to
illustrate how it can be done, let us first reduce Eqs.(78) and (79) to the linear form

ẋ1 = a11 x1 + a12 x2 , (83)

ẋ2 = a21 x1 + a22 x2 (84)

Taking a position of the agent 1, we can rewrite Eqs.(83) and (84) in the form of a chain
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 41

of reflections describing interactions between his images:

ẋ1 = a11 x1 + a12 x12

ẋ12 = a22 x12 + a21 x121

ẋ121 = a11 x121 + a12 x1212

ẋ1212 = a22 x1212 + a21 x12121 (85)

......................................................................................

ẋ1212...121 = a11 x1212...121 + a12 x1212...1212

ẋ1212...1212 = a22 x1212...1212 + a21 x1212...12121

Here the agent 1 starts with Eq. (83) and transforms it into the first equation in the
system (85) by replacing the unknown agent’s 2 state variable x2 with the predicted
value x12 that describes the agent 2 in view of the agent 1. In order to get the governing
equation for the new variable x2 , the agent 1 transforms Eq. (84) into the second equation
in the system (85) by replacing x2 with x12 and x1 with x121 that describes the agent
1 view on the agent 2 view on the agent 1. This process is endless: each new equation
includes a new variable that requires another governing equation, etc. Hence, for any
quantitative results, this system must be supplemented by a closure, i.e. by additional
equations with respect to extra-variables. However, before discussing the closure, we will
simplify the indexing of the variables in Eqs. (85) in the following way:

x1 = y 1 , x12 = y2 , x121 = y3 , x1212 = y4 , etc. (86)

Obviously, the variableyi describes prediction after i number of reflections. Here we as-
sumed that the agent 1 has complete information about himself, i.e. x11 = x1 . Therefore,
in our future discussions, any repeated indices (following one another) will be compressed
into one index.
In the new notations, Eqs. (85) can be presented in a more compact form

ẏ1 = a11 y1 + a12 y2

ẏ2 = a22 y2 + a21 y3

ẏ3 = a11 y3 + a12 y4

ẏ4 = a22 y4 + a21 y5


(87)
......................................................................................

ẏn−1 = a11 yn−1 + a12 yn

ẏn = a22 yn + a21 yn+1


42 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

It should be noticed that a simple two-dimensional system (83), (84) gave rise to an
n-dimensional system of reflection chain (87). Although the system (87) is also linear,
the structure of its coefficients is different; for instance, if the matrix of coefficients in
Eqs. (83), (84) is symmetric, i.e. a12 = a21 , the matrix of the coefficients in Eqs. (87) is
not symmetric, and therefore, the corresponding properties of symmetric systems, such
as real characteristic roots, are not preserved.
For the purpose of closure, it is reasonable to assume that after certain level of reflec-
tion, the image does not have significant change; for instance

x12121212 ≈ x121212 , i.e yn ≈ yn−2 (88)

This equation complements the system (87).


So far, we were dealing with a physical (non-living) system. Let us apply the same
strategy to mental dynamics (73) (74) presenting this system in the form of interaction
of the first agent with its own images

Ḋ1 = ζ(q 2 − βD12 )


Ḋ12 = ζ(q 2 − βD121 )
Ḋ121 = ζ(q 2 − βD1212 )
. . .. . .. . .. . .. . .. . ...etc (89)

or, adopting the notations (86)

ẏ1 = ζ(q 2 − βy2 )

ẏ2 = ζ(q 2 + βy3 0

............................. (90)

ẏn−1 = ζ(q 2 + βyn )

yn = yn−2

The system (90) is closed, and the matrix of its coefficients has the following characteristic
roots
λ1 = λ2 = ...λn−2 = 0, λn−1,n =+
− iβ (91)
Hence, the general solution of Eqs. (90) has the following structure

y1 = C0 q 2 + C1 t + C2 t2 + ...Cn−2 tn−2 + Cn−1 sin βt + Cn cos βt (92)

The arbitrary constants C1 , C2 . . . Cn are supposed to be found from initial conditions,


and actually they represent the degree of incompleteness of information that distinguishes
the images from reality. These constants can be specified if actual values of y2 are known
at least at n different instants of time to be compared with the corresponding images of
y12 .
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 43

Obviously, the solution (92) satisfies the condition (64), since, due to the presence of
harmonic oscillations, there are periods when

ẏ1 = Ḋ1 < 0 (93)

By interchanging indices 1 and 2 in Eqs. (89)- (93), one arrives at dynamics of interaction
of the agent 2 with its images.
It is worth emphasizing that in this section we are dealing with complex mental
dynamics created by a single agent that communicates with its own images, images of
images, etc.
Thus, we came to the following conclusion: the survivability of Livings, i.e. their
ability to preserve the inequality (2), is proportional to reflection-based complexity of
mental dynamics that is, to complexity of information potential.

6.4 Chain of Abstractions


In view of importance of mental complexity for survival of Livings, we will take a closer
look into cognitive aspects of information potential. It should be recalled that classical
methods of information processing are effective in a deterministic and repetative world,
but faced with the uncertainties and unpredictabilities, they fail. At the same time, many
natural and social phenomena exhibit some degree of regularity only on a higher level of
abstraction, i.e.in terms of some invariants. Indeed, it is easier to predict the state of the
solar system in a billion years ahead than to predict a price of a stock of a single company
tomorrow. In this sub-section we will discuss a new type of attractors and associated with
them a new chain of abstraction that is provided by complexity of mental dynamics.
α. Attractors in motor dynamics. We will start with neural nets that, in our terminol-
ogy, represent motor dynamics without mental dynamics. The standard form of classical
neural nets is is given by Eqs. (59). Due to the sigmoid functiontanh xi , the system (59) is
nonlinear and dissipative, and these two conditions are necessary for existence of several
attractors that can be static, periodic, or chaotic; their type, location, and basins depend
upon the choice of the synaptic weights. For instance, if these weights are symmetric

wij = wji , (94)

then the solution of Eqs. (59) can have only static attractors. As illustrated in Figure
18, static attractors perform generalization: they draw a general rule via abstraction, i.e.
via removal of insignificant details.
β. Attractors in mental dynamics. Significant expansion of the concept of an attractor
as well as associated with it generalization via abstraction is provided by mental dynamics.
We will start with mental neural nets based upon mirror neurons being discussed in
Section 5. First, we will reformulate the motor dynamics (49) by changing notations of
the state variables from v to x to be consistent with the notations of this section
1/2 ∂
ẋi = (−xii + wij tanh xjj ) ln ρ(x1 , ...xn ) (95)
∂xj
44 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Here, for further convenience, we have introduced new compressed notations


∞ ∞
x̄i = xi ρdxi , xii = Dii = (xi − x̄i )2 ρdxi ,
−∞ −∞
∞ (96)
2
xiiii = (xii − x̄ii ) ρdxii ...etc
−∞

The corresponding mental dynamics in the new notations follows from Eq. (50)
∂ρ 1/2 ∂ 2ρ
= (xii − wij tanh xjj ) (97)
∂t ∂Xj2

In the same way, the mental (mirror) neural nets can be obtained from Eqs. (54)
1/2
ẋii = (−xii + wij tanh xjj ) (98)

where the state variables xii represent variances of ρ.


Obviously, the discussion of the performance of the neural net (54) can be repeated
for the performance of the neural net (98).

6.5 Hierarchy of Higher Mental Abstractions


Following the same pattern as those discussed in the previous sub-section, and keeping
the same notations, one can introduce the next generation of mental neural nets starting
with the motor dynamics
1/2 ∂ ∂
ẋi = [(−xiiii + wij tanh xjjjj ) ln ρ (x11 , ...xnn )] ln ρ(x1 , ...xn ) (99)
∂xii ∂xi
Here, in addition to the original random state variables xi , new random variables xii are
included into the structure of information potential. They represent invariants (variances)
of the original variables that are assumed to be random too, while their randomness is
described by the secondary joint probability densityρ (x11 , ...xnn ). The corresponding
Fokker-Planck equation governing the mental part of the neural net is
∂ρ 1/2 ∂ ∂2ρ
= [(xjjjj − wij tanh xjjjj ) ln ρ (x11 , ...xnn )] 2
(100)
∂t ∂xii ∂Xjj

Then, following the same pattern as in Eqs. (95), (97), and (98), one obtains

1/2 ∂
ẋii = (−xjjjj + wij tanh xjjjj ) ln ρ (x11 , ...xnn ) (101)
∂xii
∂ρ 1/2 ∂ 2 ρ
= [(xjjjj − wij tanh xjjjj ) 2
(102)
∂t ∂Xjj
1/2
ẋiiii = (−xjjjj + wij tanh xjjjj ). (103)
Here Eqs. (101) and (103) describe dynamics of the variances xii and variances of vari-
ances xiiii respectively, while Eq. (102) governs the evolution of the secondary joint
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 45

probability density ρ (x11 , ..xnn ). As follows from Eqs. (99)- (103), the only variables
that have attractors are the variances of variances; these attractors are controlled by Eq.
(103) that has the same structure as Eq. (98). The stationary values of these variables
do not depend upon the initial conditions: they depend only upon the basins where the
initial conditions belong, and that specifies a particular attractor out of the whole set of
possible attractors. On the contrary, no other variables have attractors, and their values
depend upon the initial conditions. Thus, the attractors have broad membership in terms
of the variables xiiii , and that represents a high level of generalization. At the same time,
such “details” as values of xi and xii at the attractors are not defined being omitted as
insignificant, and that represent a high level of abstraction.
It should be noticed that the chain of abstractions was built upon only principal vari-
ances, while co-variances were not included. There are no obstacles to such an inclusion;
however, the conditions for preserving the positivity of the tensors xij andxijkq are too
cumbersome while they do not bring any significant novelty into cognitive aspects of the
problem other than increase of the number of attractors, (see Eqs. (42), (43), and (45)).
It is interesting to note that Eqs.(101) and (102) have the same structure as Eqs. (11)
and (12), and therefore, the velocities of variances ẋii are entangled in the same way as the
accelerations v̇ are, (see Eq. (23) ). That means that the chain of abstractions considered
above, gives rise to an associated chain of entanglements of the variables ẋii , ẋiiii , ...etc.

6.6 Abstraction and Survivability


In this sub-section, we will demonstrate that each new level of abstraction in mental
dynamics increases survivability of the system in terms of its capability to increase order
(see the condition (64)) regardless of action of random force. For easier physical inter-
pretation, we will investigate a one-dimensional linear case by starting with Eq. (66).
This equation describes an agent that interacts with its own image in the simple linear
form. As shown in the previous section, such an agent does not expose the property of
living systems (64) and behaves as a physical non-living particle. Let us introduce now
the second level of mental complexity when the same agent interacts with its image and
the image of this image. The dynamical model describing such an agent follows from a
one-dimensional version of Eqs. (99)- (103) in which the neural net structure is replaced
by a linear term and to which noise of the strength q2 is added
∂ ∂
ẋ1 = qL(t) + x1111 ln ρ (x11 ) ln ρ(x1 ) (104)
∂x11 ∂xi

∂ρ ∂ ∂ 2ρ
= [q 2 − x1111 ln ρ (x11 )] 2
(105)
∂t ∂x11 ∂X11

ẋ11 = (2q 2 − 2x1111 ) ln ρ (x11 ) (106)
∂x11
∂ρ ∂ 2 ρ
= (−2q 2 + 2x1111 ) 2
(107)
∂t ∂X11
46 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

ẋ1111 = 4q 2 − 4x1111 (108)


In order to prove our point, we have to show that there exists such a set of initial
conditions that provides the inequality (64)

ẋ11 < 0 (109)

under the action of random force of a strength q2 . Let us concentrate on Eqs. (106) and
(108) and choose the following initial conditions

2 X2
x1111 = 0, ρ = √ exp(− 112 ) at t = 0 (110)
σ 2π 2σ

where
σ = const, and 0 ≤ X11 < ∞ (111)
Now as follows from Eqs. (106) and (108)

0 < x1111 < q 2 at t > 0, and


(112)
∂ 
∂x11
ln ρ (x11 ) < 0 at x11 > 0, t>0

Therefore
ẋ11 < 0 at t > 0 (113)
Thus, an additional layer of mental complexity that allows an agent to interact not only
with its image, but also with the image of that image, makes the agent capable to increase
order under action of a random force, i.e. increase its survivability.

6.7 Activation of New Levels of Abstractions


A slight modification of the model of motor-mental dynamics discussed above leads to a
new phenomenon: the capability to activate new levels of abstraction needed to preserve
the inequality (64). The activation is triggered by the growth of variance caused by
applied random force. In order to demonstrate this, let us turn to Eq. (33) and rewrite
it in the following form
α ∂ρ
ẋ = qL(t) + λ (114)
ρ ∂x
Then Eq. (36), and (37) are modified to

∂ρ √ ∂2ρ
= [q 2 (−λ exp D)] (115)
∂t ∂X 2

Ḋ = [2q 2 (−λ exp D)] (116)
respectively. Here λ is a new variable defined by the following differential equation

λ̇ = λ(1 − λ)Ḋ (117)
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 47

One can verify that Eq. (117) implements the following logic:

λ = 0 if Ḋ ≤ 0, and λ = 1 if Ḋ > 0, (118)

Indeed, Eq. (117) has two static attractors:λ = 1 and λ = 0; when Ḋ > 0, the first
attractor is stable; when Ḋ < 0 , it becomes unstable, and the solution switches to
the second one that becomes stable. The transition time is finite since the Lipchitz
condition at the attractors does not hold, and therefore, the attractors are terminal,
(Zak, M., 2005a). Hence, when there is no random force applied, i.e. q=0, the first
level of abstraction does not need to be activated, since thenḊ = 0, and therefore.λ is
zero. However, when random force is applied, i.e. q = 0, the variance D starts growing,
i.e. Ḋ > 0. Then the first level of abstraction becomes activated, λ switches to 1, and,
according to Eq. (116), the growth of dispersion is eliminated. If the first level of
abstraction is not sufficient, the next levels of abstractions considered in the previous
sub-sections, can be activated in a similar way.

6.8 Summary
A connection between survivability of Livings and complexity of their behavior is es-
tablished. New physical paradigms – exchange of information via reflections, and chain
of abstractions- explaining and describing progressive evolution of complexity in living
(active) systems are introduced. A biological origin of these paradigms is associated with
a recently discovered mirror neuron that is able to learn by imitation. As a result, an ac-
tive element possesses the self-nonself images and interacts with them creating the world
of mental dynamics. Three fundamental types of complexity of mental dynamics that
contribute to survivability are identified.

7. Intelligence in Livings

7.1 Definition and General Remarks


The concept of intelligence has many different definitions depending upon the context
in which it is used. In this paper we will link intelligence to the proposed model of
Livings, namely, associating it with a capability of Livings to increase their survivability
via successful interaction with their collective mind, i.e. with self- image and images of
others. For an illustration of this definition, one can turn to the sub-section g of the
section 5, where the preservation of survival (in terms of inequality (64)) is achieved due
to activation of new level of abstraction, (see Eqs. (114)- (118)).

7.2 Intelligent Control in Livings


In this sub-section we will discuss the ability of Livings to controls their own behavior
using information force as an actuator. These dynamical paradigm links to reflective
48 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

control being performed by living systems for changing their behavior by “internal effort”
with the purpose to increase survivability. In this sub-section we will modify the model
of Livings’ formalism subject to intelligent control. We will start with the linear version
of the Langevin equations known as the Ornstein-Uhlenbeck system

v̇i = −aij vj + Li (t),


(119)
 
< Li (t) >= 0, < Li (t)Lj (t ) >= qij δ(t − t ), qij = qji , i = 1, 2, ...n

subject to initial conditions presented in the form

vi (0) = vi0 , (120)

Err(Vi0 ) = ρ(V10 , ...Vn0 ) = ρ0 . (121)


∞
vi0 =< Vi0 >= Vi ρ0 dVi ...dVn , i = 1, 2, ...n (122)
−∞

Our attention will be concentrated on control of uncertainties represented by non-sharp


initial conditions, Langevin forces Li (t) and errors in values of parameters ai . All these
uncertainties will be measured by expected deviations of the state variables from their
mean values (i.e. variances)

Dij =< (vi − < vi >)(vj − < vj >) > (123)

Now we will introduce the following information-based control



v̇i = −aij vj + Li (t) + ζαij ln ρ (124)
∂vj

The associated Liouville-Fokker-Planck equation describing evolution of the probability


density ρ reads
∂ρ ∂ ∂ 2ρ
= aij (Vj ρ) + (qij − ζαij ) 2 (125)
∂t ∂Vi ∂Vj
while
ρ(t = 0) = ρ0 (126)
(Multiplying Eq.(125) by Vi , then using partial integration, one obtains for expecta-
tions
d
< vi >= −aij < vj >, (127)
dt
Similarly one obtains for variances

Ḋij = −ail Dlj − ajl Dli + 2qij − 2ζαij (128)

Thus, as follows from Eqs.(125) and (128), the control force ζαij does not affect the
expected values of the state variables ¡v¿: it affects only the variances.
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 49

Before formulating the control strategy, we will discuss the solution to Eq.(125). In
the simplest case when αij = const., the solution describing the transition from initial
density (126) to current density is given by the following equation (compare with Eq.
(60))

ρ({V }, t|{V  }, t ) = (2π)n/2 [DetD(t − t )]−1/2 exp{− 12 [D−1 (t − t )]ij [Vi − Gik (t − t )Vk ]

×[Vj − Gjl (t − t)Vl ]}


(129)
Here the Green function in matrix notation is expressed by Eq. (61). Substituting the
solution (129) into Eq.(124), one obtains the Langevin equation in the form

v̇i = −aij vj + Li (t) + ζ[ασ −1 ]ij (vj − Gjl vl ) (130)

If the control forces αij are not constants, for instance, if they depend upon variances

αij = αij ({Dkl }) (131)

the solution (129) as well as the simplified form (130) of the original Langevin equation
are valid only for small times. Nevertheless, for better physical interpretation, we will stay
with this approximation in our future discussions. First we have to justify the nonlinear
form for the control forces (131). For that purpose, let us turn to Eq. (128). As
follows from this equation, the variances Dij are not “protected” from crossing zeros and
becoming negative, and that would not have any physical meaning. To be more precise,
the non-negativity of all the variances, regardless of possible coordinate transformations,
can be guaranteed only by non-negativity of the matrix |D| that, in turn, requires non-
negativity of all its left-corner determinants

Det|Dij | ≥ 0, i, j = 1; i, j = 1, 2; ...i, j = 1, 2, ...n (132)

In terms of the Fokker-Planck equation (125), negative variances would lead to negative
diffusion, and that is associated with ill-posedness of initial-value problems for parabolic
PDE. Mathematical aspects of that phenomenon are discussed in (Zak, M.,2005a).
In order to enforce the inequalities (132), we will specify the control forces (131) as
linear functions of variances with one nonlinear term as terminal attractor

αij = bil Dlj + bjl Dli + [cD1/2 ]ij , bij = 0, cij > 0 (133)

Then, as follows from Eq.(128), for small variances

Dij ∼
= qij t at Dij −→ 0 (134)

But the strength-of-noise matrix qij is always non-negative, and therefore, the constraints
(132) are satisfied. The role of the terminal attractor will be discussed below. Now the
original dynamical system (124) with intelligent control (133) reads

v̇i = −aij vj + Li (t) + ζ(bil Dlj + bjl Dli + [cD1/2 ]ij ) ln ρ (135)
∂vj
50 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

or, applying the approximation (129)

v̇i = −aij vj + Li (t) + ζ[αD−1 ]ij (vj − Gjl vl ) (136)

where αij is expressed by Eq. (133).


Eqs. (135) and (136) must be complemented by the additional controller that imple-
ments the dynamics of variances

Ḋij = −ail Dlj − ajl Dli + 2qij − 2ζ(bil Dlj + bjl Dli + [cD1/2 ]ij ) (137)

As follows from Eq. (137), the dynamics of the controller depends only upon the design
parameters {a}, but not on the state variables {v} of the underlying dynamical system,
and therefore, the control strategy can be developed in advance. This strategy may
include classical lead-lag compensation for optimization of transient response or large
steady-state errors, while the role of the classical compensation system is played by the
controlling dynamics (137) in which the design parameters {b} can be modified for appro-
priate change of root locus, noise suppression, etc. Fig.19. However, in contradistinction
to classical control, here the compensation system is composed of the statistical invariants
produced by the underlying dynamical system “itself ” via the corresponding Liouville or
Fokker-Planck equations.
Let us now analyze the effect of terminal attractor and, turning to Eq.(133), start
with the matrix [∂ Ḋij /∂Dlk ]. Its diagonal elements become infinitely negative when the
variances vanish
∂ Ḋij 1 −1/2
= −2aii − ζ(4bii − cij σij ) → −∞ at Dij → 0 (138)
∂Dij 3

while the rest elements ∂ Ḋij /∂Dij atij = lk are bounded, (compare with Eqs. (54)
and (55)). Therefore, due to the terminal attractor, the controller (53) linearized with
respect to zero variances has infinitely negative characteristic roots, i.e. it is infinitely
stable regardless of the parameters {a} of the original dynamical system as well as of the
chosen parameters {b} of the controller. This effect has been exploited in (Zak, M.,2006a)
for suppression of chaos. Another effect of the terminal attractor is in minimization of
residual noise. A simplified example of such a minimization has been discussed in the
Section 2, (see Eqs. (33-37)) where, for the purpose of illustration, it was assumed that the
noise strength q in known in advance and that allowed us to eliminate noise completely.
In reality, the noise strength is not known exactly, and it can only be minimized using
the proposed controller. Let us turn to Eq.(137) at equilibrium, i.e. when Ḋij = 0, and
find the ratio of residual noise and variance
∂qij 1 1/2 1 −1/2
= 2aii + ζ(4bii + cij Dij → cij Dij ) → ∞ at Dij → 0 (139)
∂Dij 3 3

As follows from Eq. (137), without the terminal attractor, i.e. when cij = 0, this ratio
is finite; but with the terminal attractor it is unbounded. This means that the terminal
attractor almost completely suppresses noise, (see Fig. 20).
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 51

It should be recalled that a non-living system may possess the self-image, but it is
not equipped with the self-awareness, and therefore, this self-image is not in use. On
the contrary, in living systems the self-awareness is represented by the expectation-based
forces that send information from the self-image to the motor dynamics, and these forces
can be exploited by Livings as actuators implementing control. Due to this property
that is well-pronounced in the proposed model, an intelligent agent can run its mental
dynamics ahead of real time, (since the mental dynamics is fully deterministic, and it
does not depend explicitly upon the motor dynamics) and thereby, it can predict future
expected values of its state variables; then, by interacting with the self-image via the
supervising forces, it can change the expectations if they are not consistent with the
objective. Such a self-supervised, or intelligent control provides a major advantage for
the corresponding intelligent agents, and especially, for biological species: due to the
ability to predict future, they are better equipped for dealing with uncertainties, and
that improves their survivability.

7.3 Modeling Common Sense

α. General remarks. A human common sense has always been a mystery for physicists,
and an obstacle for artificial intelligence. It was well understood that human behavior,
and in particular, the decision making process, is governed by feedbacks from the external
world, and this part of the problem was successfully simulated in the most sophisticated
way by control systems. However, in addition to that, when the external world does not
provide sufficient information, a human turns for “advise” to his experience and intuition,
and that is associated with a common sense. The simplest representation of human
experience is by if-then rules. However, in real world situations, the number of rules
grows exponentially with the dimensionality of external factors, and implementation of
this strategy is hardly realistic. One of the ways to fight such a combinatorial explosion is
to represent rules in a more abstract and more generalized form by removing insignificant
details and making the rules more inclusive. This procedure is usually accompanied by
coercion, i.e. by reducing uncertainties about the world via forcing it into a known state
regardless of the initial state. Indeed, many natural and social phenomena exhibit some
degree of regularity only on a higher level of abstraction, i.e. in terms of some invariants.
Within the mathematical formalism of the model of mental dynamics, this means that
only variables of the highest level of abstraction are capable to classify changes in the
external world and send them to the corresponding attractor. Based upon that, the model
reacts to these changes, and that can be associated with common-sense-based decision.
Collaboration, competition and games are examples of those types of human activities
that require common sense for prediction of intentions of a collaborator or a competitor
in order to make a right decision when objective information for a rational decision in
incomplete.
β. The model. In this paper, by common sense we will understand a feedback from
the self-image (a concept adapted from psychology), and based upon that, we will pro-
52 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

pose a physical model of common sense in connection with the decision making process.
This model grew out of the model of Livings proposed and discussed in the previous
sections. Previously similar model in quantum implementation has been introduced and
discussed in (Zak, M., 2000b) We will start with the one-dimensional case based upon
the augmented version of Eq. (11)

v̇ = −yζσ 2 ln ρ, (140)
∂v
∂ρ ∂2ρ
= yζσ 2 (141)
∂t ∂V 2
where 
ẏ = −a y(1 − y), a = const > 0 (142)
Eq. (142) has two equilibrium points: y = 0 and y = 1. At both these points, the
Lipschitz condition does not hold since
∂ ẏ 1 − 2y
=a  (143)
∂y 2 y(1 − y)

and therefore
∂ ẏ/∂y → ∞ if y → 0,
(144)
∂ ẏ/∂ y → 0 if y→1
Hence, y = 1 is a terminal attractor, and y = 0 is a terminal repeller, (Zak,M.,1989). Re-
gardless of these “abnormality”, the closed form solution is easily obtained by separation
of variables

2 1−y
t = arctan + C, C = 0 if y = 0 at t = 0 (145)
a y
However, this “abnormality” becomes crucial for providing a finite time T of transition
from the repeller y = 0 to the attractor y = 1
π
T = , (146)
a
It should be recalled that in classical theory of ODE, when the Lipschitz condition is
preserved, an attractor is always approached asymptotically, and the transition period is
theoretically unbounded. Hence, this limitation is removed due to a special form of the
governing equation (142). Qualitatively, the result (146) holds even if a = a (t). Then
the solution to Eq.(142) is

t  T
1−y
a(t)dt =2 arctan , and a(t)dt = π, i.e. T < ∞, (147)
y
0 0

Similar results can be obtained for a < 0: then the attractor becomes a repeller and
wise versa. When the function a(t) changes its sign sequentially, the solution switches
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 53

from 0 to 1 and back, respectively, while the transition time is always finite. Selecting,
for instance,
a = cos ωt (148)
one arrives at periodical switches (with the frequency ω) from a decision mode to a passive
(pre-decision) mode and back, since, in the context of this sub-section, the state y=0 and
y=1 can be identified with the passive mode and the decision mode, respectively. As
shown in Fig. 21, after each switch to the decision mode, the system may select different
solutions from the same family (15), i.e. a different decision, so that the entire solution
will include jumps from one branch of the family (15) to another. In order to preserve
the autonomy of the dynamical model (141), (142), one can present Eq. (148) as a
limit-cycle-solution to the following autonomous non-linear ODE

ä − ξ1 ȧ + ξ2 ȧ3 + ξ3 a = 0 (149)

The periodic solution (148) to this oscillator is usually associated with modeling brain
rhythms, while the frequency ω is found to be a monotonic function of a stimulus intensity.
The model we propose for common sense simulation is based upon augmented n-
dimensional version of Eqs.(140) and (141)

v̇i = ζ[(y − 1)fi + y(βi + αii ln ρ)], i = 1, 2, ...n, (150)
∂Vi
∂ρ n ∂ρ ∂ 2ρ
= − ζΣ{[(y − 1)fi + yβi ] − yαii } (151)
∂t i=1 ∂Vi ∂Vi2
Here
fi = fi (v̄1 , ...v̄n ), αii = αii (ρ), βi = βi (ρ) (152)
where v̄i is expected value of vi ,yis defined by Eqs. (142) and (149), while the functions
f and β provide non-zero mean and non-zero drift of the underlying stochastic process.
The solution to Eq. (151) has the same fundamental properties as the solution to its
simplified one-dimensional version (12). Indeed, starting with the initial conditions

vi = 0, ρ = δ(Vi → 0) at t = 0 (153)

and looking first for the solution within an infinitesimal initial time interval ε, one reduces
Eq. (151) to the form
∂ρ n ∂ 2ρ
= − Σ αii (154)
∂t i=1 ∂Vi2
since
∂ρ
= 0, at t = 0 (155)
∂Vi
and therefore, all the drift terms can be ignored within the interval ε.
The solution to Eq. (154) is a multi-dimensional version of Eq. (13). Substitution of
this solution to Eqs. (150) yields
vi vi
v̇i = ζ[fi + yβi + ] → ζ[ ] at t → 0 (156)
2t 2t
54 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

since the functions fi are considered to be bounded. The solution to Eqs. (156) is of the
form (13) √
vi = Ci t at t → 0 (157)
and this can be illustrated by the same Fig.4 with the only difference that here the solu-
tion is valid only within an infinitesimal initial time interval ε. But the most important
phenomenon- phase transition- occurs exactly in this interval: due to violation of the
Lipchitz condition, the solution splits into ensemble of different samples, while the prob-
ability of the solution to represent certain sample is controlled by the density following
from Eq. (154). Thus, the solution to Eqs. (150) and (151) within the infinitesimal initial
interval captures instability-based randomization effect.
γ. Decision making process. Decision making is the cognitive process of selecting
a course of action from among multiple alternatives. We will distinguish two types of
decision making processes. The first type is associated with the concept of a rational
agent; the models of this type are largely quantitative and are based on the assumptions
of rationality and near perfect knowledge. They are composed of agent’s believe on the
basis of evidence followed by construction and maximization of utility function. The
main limitation of these models is in their exponential complexity: on the level of believe
nets, the exponential complexity is caused by the fact that encoding a joint probability
as a function of n propositional variables requires a table with 2n entries, (Perl,J.,1986);
the same rate complexity occurs in rule-based decision trees. The second type of a
decision making process is based upon psychological models; these models concentrate
on psychological and cognitive aspects such as motivation, need reduction, and common
sense. They are qualitative rather than quantitative and build on sociological factors
like cultural influences, personal experience, etc. The model proposed in this paper is
better structured for the second type of decision making process that exploits interaction
between motor and mental dynamics in which the mental dynamic plays the role of a
knowledge base replacing unavailable external information. In order to demonstrate the
proposed approach to decision making, we will augment the model (150), (151) by two
additional devices. The first one, a sensor device, measures the difference between the
actual and expected values of the state variables


n ∞ ∞ ∞
Δ= (vi − v̄i )2 , v̄i = ... Vi ρdV1 dV2 ...dVn , (158)
i=1 −∞ −∞ −∞

The second one, the logical device, is based upon Eq. (142) with

a=A−Δ (159)

where A¿0 is a sensitivity threshold specified for the decision making process.
We will start the analysis of the model performance from its pre-decision mode when
Δ = 0, and therefore, y = 0 and

v̇i = ζfi (v1 , ...vn ) i = 1, 2, ...n, (160)


Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 55

∂ρ n ∂ρ
= − ζΣ fi (161)
∂t i=1 ∂Vi
At this mode, the motor dynamics (150), and the mental dynamics (151) are not coupled.
The performance starts with mental dynamics that runs ahead of actual time, calculates
expected values of the state variables as well as the difference Δ at the end of a selected
lead time T, (see Eq. (158), and sends this information to the sensor device (159). As
soon as Δbecomes large, it changes the sign of the control parameter a (see Eqs. (142)
and (159)), the value of y changes from zero to one, and the system (160), (161) switches
to the decision mode taking the form (150), (151). After this switch, a deterministic
trajectory defined by the solution to Eq. (160) splits into a family of the solution to the
coupled system (150), (151) (see Eq. (157), and Fig. 21). But, as discussed above, the
system selects only one trajectory of this family at random with the probability defined
by the information forces αi (ρ) and βi (ρ). Thus, the topology of the proposed model
demonstrates how a decision is made, while the structure of the information forces defines
what decision is made. This structure will be discussed in the following sub-section.
δ. Decision via choice of attractors. Let us return to the system (150), (151) in the
decision mode

v̇i = ζ(βi + αii ln ρ), i = 1, 2, ...n, (162)
∂Vi
∂ρ n ∂ρ ∂ 2ρ
= − ζΣ (βi + αii ) (163)
∂t i=1‘ ∂Vi ∂Vi2
and assume that αii and βi in Eq. (152) depend only upon two first invariants of the
probability density ρ, namely, upon the means v̄i and principle variances Dii

αii = αii (v̄1 , ...v̄n , D1 1, ...Dn n), βi = βi (v̄1 , ...v̄1 , D1 1, ...Dn n) (164)

As follows from Eqs. (150) and (151), the means v̄i and the variances Dii must satisfy
the following ODE, (Compare with Eqs. (127) and (128))

v̄˙ i = ζβi (v̄1 , ...v̄n , D1 1, ...Dn n), (165)

Ḋi i = −ζαi (v̄1 , ...v̄1 , D1 1, ...Dn n) (166)


Thus, although the state variables vi are statistically independent, i.e. Dij ≡ 0if i = j,
the time evolution of their statistical invariants is coupled via Eqs. (165) and (166).
It should be noticed that Eqs. (165) and (166) can be considered as an ODE-based
approximation to the mental dynamics (163).
Next we will introduce the following structure into the functions (164)

βi = (v̄i − γi1 )(v̄i − γi2 )...(v̄i − γin )(Σwij Δj ), Δj = (v̄i − vi )2 , (167)

αii = (Dii − ηi1 )(Dii − ηi2 )...(Dii − ηin )(Σvij Δj ), i = 1, 2, ...n, (168)
where γij , ηij , wij , vij are constants, and rewrite the system (165), (166) as follows


n
v̄˙ i = ζ
[ (v̄i − γij )](Σwij Δj ), i = 1, 2, ...n, (169)
j=1
56 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96



n
Ḋii = −ζ
(Dii − ηij )(Σuij Δj ), i = 1, 2, ...n, (170)
j=1

We will start our analysis with Eqs. (169). First of all, in that particular setting, these
equations do not depend upon Eqs. (170). Moreover, each equation in the system (169) is
coupled to other equations of the same systems only via the signs of the sums Σwij Δj that
include contribution from all the equations. Indeed, if Σwij Δj > 0, the ith equation has
the terminal attractors,

v̄i0 = γi2 , γi4 , ...γim , i = 1, 2, ...n (171)

and terminal repellers


v̄i∗ = γi1 , γi3 , ...γik , i = 1, 2, ...n (172)
where m = n , k = n − 1 if n is even, and m = n-1, k =n if n is odd.
The n2 /2 attractors (171) can be pre-stored using n2 weights wij . These attractors
are the limit values of the means of the stochastic process that occurs as a result of switch
from the pre-decision to the decision making mode, and these attractors are approached
in finite time, (see eq. (146).
Turning to Eqs. (170) and noticing that they have the same structure as Eqs. (169),
one concludes that the principle variances Dii of the same stochastic process approach
their limiting values
Dii0 = ηi2 , ηi4 , ...ηim , i = 1, 2, ...n, (173)
that can be pre-stored using weights uij . Thus, when the system switches to the decision
making mode, it chooses a sample of the corresponding stochastic process, and this sample
represents the decision. The choice of the sample is controlled by the normal probability
density with means and principle variances approaching their limit values (171) and (173).
The choice of a particular attractor out of the set of (171) and (173) depends upon the
initial values of means and variances at the end of the pre-decision period: if these values
fall into the basin of attraction of a certain attractor, they will eventually approach that
attractor, Fig. 22.
ε. Decision via phase transition. In the previous sub-section, we consider the case
when pre- and post-decision states are not totally disconnected: they belong to the same
basin of attraction. However, in general, decision may require fundamental change of the
dynamical structure, and that can be achieved via phase transition. The distinguishing
characteristic of a phase transition is an abrupt sudden change in one or more physical
properties of a dynamical system. In physics, a phase transition is the transformation
of a thermodynamic system from one phase to another (evaporation, boiling, melting,
freezing, sublimation, etc). In engineering, such transitions occur because of change of
system configuration (new load, new open valve, new switch or a logic device in control
systems with variable structure, etc.). In living systems, dynamics includes the concept
of “discrete events”, i.e. special critical states that give rise to branching solutions, or
transitions from deterministic to random states and vice versa (for instant, life-non-life
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 57

transitions). First mathematical indication of a phase transition is discontinuities in some


of the state variables as functions of time. In classical approach, these discontinuities are
incorporated through a set of inequalities imposing unilateral constraints upon the state
variables and the corresponding parameters of the governing differential equations. The
most severe changes in dynamics are caused by vanishing coefficients at the highest space
or time derivatives. The best example to that is the transition from the Navier-Stokes
to the Euler equations in fluid dynamics where due to vanishing viscosity, the tangential
velocity on the rigid boundary jumps from zero (the non-slip condition) to a final value
(the slip condition). In this sub-section, we will modify the proposed model by introducing
phase transitions that are accompanied by finite jumps of the state variables.
Let us modify Eq. (150), in the following way

(1 − yi )v̇i = ζ[fi + (βi + αi ln ρ)], i = 1, 2, ...n, (174)
∂Vi
where yi is defined as following

ẏi = −ai yi (1 − yi ),ai = Ai − Δi , Δi = (vi − v̄i )2 (175)

and assume that Δn becomes large; that changes the sign of the control parameter an ,
the value of yn changes from zero to one, and the system (160), (161) switches to the
decision mode in the form

(1 − yi )v̇i = ζ[fi + (βi + αi ln ρ)], i = 1, 2, ...n − 1, (176)
∂Vi

0 = fn + (βn + α.n ln ρ), (177)
∂Vn
∂ρ n ∂ρ ∂ 2ρ
= − ζΣ[(fi + βi ) − αi ], i = 1, 2, ...n − 1, (178)
∂t i=1 ∂Vi ∂Vi2
Since Eq. (177) is stationary, one of the state variables, for instance,xn can be expressed
via the rest of the variables. Hence, formally the decision making mode is described by
Eqs, (162)-(170), but the dimensionality of the system drops from n to n−1; obviously, the
functions fi (v1 , ...vn−1 ), αi (D11 , ...Dn−1,n−1 ), βi (v̄i , ...v̄n−1 ), become different from their n-
dimensional origins, and therefore, the location of the attractors (171) and (173) becomes
different as well , and this difference may be significant. The number of decision making
modes associated with phase transitions is equal to the number of possible sub-spaces,
and it grows exponentially with a linear growth of the original dimensionality of the
model.

7.4 Emergent Intelligence


In many cases, in order to simulate the ability of living systems to make decisions, it is
more convenient to introduced Boolean model of motion, or Boolean net. Boolean net
consists of N vertices that are characterized by Boolean variables taking values 0 or 1.
58 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Each vertex receives input from other vertices and updates its value according to a certain
rule. Such a model can be associated via a master-slave relationship with the continuous
behavior of the model of Livings discussed above. Indeed, let us turn to Eqs. (56),(57)
and introduce the following Boolean functions:

Yi (t) = 0 if vi (t) < 0, otherwise Yi = 1 (179)


1
P (Y1 , ...Yn ) = 0 if ρ(X1 , ..Xn ) < , and P (Y1 , ...Yn ) = 1 otherwise (180)
2n
The conditions (179), (180) extract topological invariants of the solution to Eqs. (56), (57)
disregarding all the metrical properties. In terms of logic, Yi can be identified with the
statements variable; then P describes the Boolean truth functions as a set of compound
statements in these variables, and it can be represented in disjunctive normal form as
well as in the form of the corresponding logic circuit. It should be noticed that changes in
statements as well as in the structure of the truth functions are driven by the solution to
the original model (56), (57). Therefore, for non-living systems when there is no feedback
information potential Π is applied, in accordance with the second law of thermodynamics,
the truth function P (as well as its master counterpart ρ) will eventually approach zero,
i.e. the lowest level of logical complexity. On the contrary, as demonstrated above, living
systems can depart from any initial distribution toward decrease of entropy; it means
that the corresponding truth function P can depart from zero toward the higher logical
complexity without external interactions.
The logics constraints Eqs.(179), (180) can be represented by terminal dynamics
(Zak,M., 1992) via relaxing the Lipschitz conditions:

Ẏ = k Y (1 − Y )v(t), (181)
 1
Ṗ = m P (1 − P )[ρ(t) − ] (182)
2
where
k=const, m=const. sign[v(t)]=const, sign[ρ (t)]=const.
Indeed, Eq. (181) has two static attractors: Y = 0 and Y = 1; when v >0, the first
attractor is stable; when v <0, it becomes unstable, and the solution switches to the
second one that becomes stable. The transition time is finite since the Lipschitz condition
at the attractors does not hold, and therefore, the attractors are terminal. The same is
true for Eq. (182). In both cases the transition time can be controlled by the constants
k and m to guarantee that the signs of v(t) and ρ(t) do not change during the transition
period.
Thus, any dynamical process described by the system (56), (57) can be “translated”
into a temporal sequence of logical statements via Boolean dynamics (181), (182) while
the complexity of the truth function can increase spontaneously, and that represents
emergent intelligence. One can introduce two (or several) systems of the type (56), (57)
with respect to variables vi and v∗i which are coupled only via Boolean dynamics, for
instance  
Ẏi = k Yi (1 − Yi )(vi − v∗i ), Ẏi ∗ = k ∗ Yi (1 − Yi )(v ∗i −vi ) (183)
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 59

In this case, the dynamical systems will interact through a logic-based “conversation”.
It should be noticed that, in general, decisions made by a living system may affect
its behavior, i.e. the Boolean functions Y and P can enter Eqs. (56), (57) as feedback-
forces. That would couple Eqs. (56), (57) and Eqs. (181), (182) thereby introducing the
next level of complexity into the living system behavior. However, that case deserves a
special analysis, here we will confine ourselves only by a trivial example. For that purpose
consider the simplest case of Eqs. (56), (57), (181), and (182) and couple these equations
as following
1 ∂
v̇ = 2(Y − )D ln ρ(v, t), (184)
2 ∂v
∂ρ 1 ∂ 2ρ
= −2(Y − )D 2 (185)
∂t 2 ∂V
where
1
β = 2(Y − ) (186)
2

Ẏ = k Y (1 − Y )[v(t − τ ) − 1] (187)
 1
Ṗ = m P (1 − P )[ρ(t) − ] (188)
2
Here τ is a constant time delay. For the initial conditions

v = 0 at τ ≤ t ≤ 0, ρ = δ(t → 0), Y (0) = 0, P (0) = 1,

the solution is approximated by the following expressions

v = v0 e1−exp(−βt) (189)

During the initial period v(t − τ ) > 1 : β = −1, Y = 0, P = 1. After that, the solution
switches to: β = 1, Y=1, and P = 0. According to the new solution, x(t) starts decreas-
ing, and ρ(t) starts increasing. When v(t-τ ) <1, and ρ(t)>1/2, the solution switches
back to the first pattern etc. Thus, the solution is represented by periodical switches
from the first pattern to the second one and back, Figure 23. From the logical viewpoint,
the dynamics simulates the operation of negation: P(0) =1, P(1) =0.

7.5 Summary
Intelligence in Livings is linked to the proposed model by associating it with a capability of
Livings to increase their survivability via successful interaction with their collective mind,
i.e. with self- image and images of others. The concept is illustrated by intelligent control,
common-sense-based decision making, and Boolean-net-based emergent intelligence.

8. Data-driven Model Discovery


The models of Livings introduced and discussed above are based upon extension of
the First Principles of Newtonian mechanics that define the main dynamical topology of
60 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

these models. However, the First Principles are insufficient for detecting specific prop-
erties of a particular living system represented by the parameters wij as well as by the
universal constant ζ: these parameters must be found from experiments. Hence, we arrive
at the following inverse problem: given experimental data describing the performance of
a living system discover the underlying dynamical model, i.e. find its parameters. The
model will be sought in the form of Eqs. (42) and (45)

n

v̇i = −ζ αij ln ρ(v1 , ...vn , t), i = 1, 2, ...n. (190)
j=1
∂vj

∂ρ  n
∂ 2ρ
=ζ αij (191)
∂t j=1
∂Vj2
where αij are function of the correlation momentsDks

αij = − 12 (wijks tanh D̃ks − cij D̃ij ), i = 1, 2, ...n,
(192)
Dij
D̃ij = D0
, c11 = 1,

With reference to Eq. (192), Eq. (191) can be replaced by its simplified version (compare
to Eq. (51))

Ḋij = − 12 ζ(wijks tanh D̃ks − cij D̃ij ), i = 1, 2, ...n, (193)
Then the inverse problem is reduced to finding the best-fit-weights wijks , cij and ζ. It
should be noticed that all the sought parameters enter Eq. (193) linearly.
We will assume that the experimental data are available in the form of time series for
the state variables in the form

vi = vi (t, Ci ), Ci = 1, 2, ...mi , (194)

Here each function at a fixed Ci describes a sample of the stochastic process associated
with the variable vi , while the family of these curves at Ci = 1, 2, ...mi , approximates the
whole ith ensemble, (see Figs. 4 and 9). Omitting details of extracting the correlation
moments
Dij = Dij (t) (195)
from the functions (194), we assume that these moments as well as their time derivatives
are reconstructed in the form of time series. Then, substituting Dij , and Ḋij into Eq.
(193) for times t1 , ...tq , one arrives at a linear system of algebraic equation with respect
to the constant parameters wijks , cij and ζ that, for compression, can be denoted and
enumerated as Wi

m
Ai Wi = B i = 1, 2, ...m = 22n + 2n (196)
i=1

where m is the number of the parameters defining the model, and

Ai = Ai (Dks , Ḋks ), B = B(Dks , Ḋks ), (197)


Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 61

are the coefficients at the parameters Wi and the free term, respectively. Introducing
values of Ai and B at the points t = tj , j = 1, ...q, and denoting them as Aij , and Bj ,
one obtains a linear system of 2n q algebraic equations

m
Aij Wi = Bj , j = 1, 2, ...q , (198)
i=1

with respect to m unknown parameters. It is reasonable to assume that

2n q ≥ m, i.e. q ≥ 2n + 1 (199)

so the system becomes overdetermined. The best-fit solution is found via pseudo-inverse
of the matrix
A = {Aij } , i.e. W = A ∗ B̄ (200)
Here
A∗ = (AT A)−1 AT , and B̄ = {Bj } (201)
As soon as the parameters W are found, the model is fully reconstructed.
Remark. It is assumed that the correlation moments found from the experiment must
automatically satisfy the inequalities (47) (by the definition of variances), and therefore,
the enforcement of these inequalities is not needed.

9. Discussion and Conclusion

9.1 General Remarks


We will start this section with the discussion of the test-question posed in the Intro-
duction: Suppose that we are observing trajectories of several particles: some or them
physical (for instance, performing a Brownian motion), and others are biological (for
instance, bacteria), Figure 1. Is it possible, based only upon the kinematics of the ob-
served trajectories, to find out which particle is alive? Now we are in a better position
to answer this question. First of all, represent the observed trajectories in the form of
time series. Then, using the proposed methodology for data-driven model reconstruction
introduced in Section 7 find the mental dynamics for both particles in the form (193).
Finally, calculate the entropy evolution

H(t) = − ρ(V, t) ln ρ(V, t)dV (202)
V

Now the sufficient condition for the particle to be “alive” is the inequality
dH
<0 (203)
dt
that holds during, at least, some time interval, Figure 3. (Although this condition is
sufficient, it is not necessary since even a living particle may choose not to exercise its
privilege to decrease disorder).
62 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

It should be noticed that the condition (203) is applicable not only to natural, but
to artificial living systems as well. Indeed, the system (190)-(191) can be simulated
by analog devices (such as VLSI chips, (Mead,C,1989)) or quantum neural nets, (Zak,
M.,1999)) that will capture the property (203), and that justifies the phenomenological
approach to the modeling of living systems.
The condition (203) needs to be clarified from the viewpoint of the second law of
thermodynamics. Formally it contradicts this law; however, this contradiction is appar-
ent. Indeed, we are dealing here with an idealized phenomenological model which does
not include such bio-chemical processes as metabolism, breezing, food consumption, etc.
Therefore, the concept of an open or an isolated system becomes a subject to interpre-
tation: even if the phenomenological model of a living system is isolated, the underlying
living system is open.
From biological viewpoint, the existence of the information potential that couples
mental and motor dynamics is based upon the assumption that a living system possesses
self-image and self-awareness. (Indeed, even such a primitive living system as a virus
can discriminate the self from non-selves). The concepts of self-image and self-awareness
can be linked to a recently discovered “mirror” properties of neurons according to which
a neuron representing an agent A can be activated by observing action of an agent B
that may not be in a direct contact with the agent A at all. Due to these privileged
properties, living systems are better equipped for dealing with future uncertainties since
their present motion is “correlated with future” in terms of the probability invariants.
Such a remarkable property that increases survivability could be acquired accidentally
and then be strengthening in the process of natural selection.
The ability of living systems to decrease their entropy by internal effort allows one
to make connection between survivability and complexity and to introduce a model of
emergent intelligence that is represented by intelligent control and common sense decision
making. In this connection, it is interesting to pose the following problem. What is
a more effective way for Livings to promote Life: through a simple multiplication, i.e.
through increase of the number of “primitives” n, or through individual self-perfection, i.e.
through increase of the number m of the levels of reflections (“What do you think I think
you think. . . ”)? The solution to this problem may have fundamental social, economical
and geo-political interpretations. But the answer immediately follows from Eq. (82)
demonstrating that the complexity grows exponentially with the number of the levels of
reflections m, but it grows only linearly with the dimensionality n of the original system.
Thus, in contradistinction to Darwinism, a more effective way for Livings to promote Life
is through higher individual complexity (due to mutually beneficial interactions) rather
than trough a simple multiplication of “primitives”. This statement can be associated
with recent consensus among biologists that the symbiosis, or collaboration of Livings, is
even more powerful factor in their progressive evolution than a natural selection.
Before summarizing the results of our discussion, we would like to bring up the concept
of time perception. Time perception by a living system is not necessarily objective: it can
differ from actual physical time depending upon the total life time of a particular living
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 63

system, as well as upon the complexity and novelty of an observed event. In general, one
can approximate the subjective time as

T = T (t, v, H, Ḣ, ...) (204)

In the simplest case, Eq. (204) can be reduced to a Logtime hypothesis used in psychology
(Weber-Fechner law)
T = ln t + Const (205)
However, our point here is not to discuss different modifications of Eq. (204), but rather
to emphasize that any time perceptions that are different from physical time lead to
different motions of the living systems in actual physical space due to coupling of motor
and mental dynamics through the information potential

Π = ζ ln ρ(v, t) (206)

9.2 Model Extension


The proposed model of Livings is based upon a particular type of the Liouville feedback
implemented via the information potential Eq.(206). However, as shown in (Zak, M.,
2004, 2005b, 2006a, 2006c, 2007), there are other types of feedbacks that lead to different
models useful for information processing. For instance, if the information force is chosen
as
∂ α3 ∂ 2 ρ α4 ∂ 3 ρ
F = α1 ρ + α2 ln v + + (207)
∂v ρ ∂v 2 ρ ∂v 3
(that includes the information force in the second term), then the corresponding Liouville
equation can describe shock waves, solitons and chaos in probability space, Fig. 24,
(Zak,M., 2004). Let us concentrate upon a particular case of Eq. (207) considered in
the Section 2 (see Eqs. (7a) and (8a). The solution of Eq. (8a) subject to the initial
conditions and the normalization constraint
∞
ρ0 = ρ0 (V ), where ρ ≥ 0, and ρdV = 1 (208)
−∞

is given in the following implicit form (Whitham, G., 1974)

ρ = ρ0 (ξ), V = ξ + ρ0 (ξ)t (209)

This solution describes propagation of initial distribution of the density ρ0 (V ) with the
speed V that is proportional to the values of this density, i.e. the higher values of
ρpropagate faster than lower ones. As a result, any “compressive” part of the wave,
where the propagation velocity is a decreasing function of V , ultimately “breaks” to give
a triple-valued (but still continuous) solution forρ(V, t). Eventually, this process leads
to the formation of strong discontinuities that are related to propagating jumps of the
probability density. In the theory of nonlinear waves, this phenomenon is known as the
64 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

formation of a shock wave, Fig. 24. Thus, as follows from the solution (209), a single-
valued continuous probability density spontaneously transforms into a triple-valued, and
then, into discontinuous distribution. In aerodynamical application of Eq. (8a), when
ρstands for the gas density, these phenomena are eliminated through the model correction:
at the small neighborhood of shocks, the gas viscosity ν cannot be ignored, and the model
must include the term describing dissipation of mechanical energy. The corrected model
is represented by the Burgers’ equation

∂ρ ∂ 2 ∂2ρ
+ (ρ ) = ν (210)
∂t ∂V ∂V 2
This equation has a continuous single-valued solution (no matter how small is the viscosity
ν), and that provides a perfect explanation of abnormal behavior of the solution to Eq.
(8a). Similar correction can be applied to the case when ρ stands for the probability
density if one includes Langevin forces L(t)) into Eq. (7a)

v̇ = ρ + νL(t), < L(t) >= 0, < L(t)L(t ) >= 2δ(t − t ) (211)

Then the corresponding Fokker-Planck equation takes the form (210).



It is reasonable to assume that small random forces of strength ν << 1 are always
present, and that protects the mathematical model Eqs. (7a), and (8a) from singularities
and multi-valuedness in the same way as it does in the case of aerodynamics. It is
interesting to notice that Eq. (210) can be obtained from Eq. (211) in which random
force is replaced by additional Liouville feedback

v̇ = ρ − ν ln ρ, ν > 0, (211a)
∂V
As noticed above, the phenomenological criterion of life is the ability to decrease entropy
by internal effort. This ability is provided by the feedback implemented in Eqs. (7a) and
(8a). Indeed, starting with Eq. (1a) and invoking Eq. (8a), one obtains

∂H ∂
∞ ∞ ∞ ∂
∂t
= − ∂t ρ ln ρdV = − ρ̇(ln ρ + 1)dV = ∂V
(ρ2 ) ln(ρ + 1)dV
−∞ −∞ −∞
∞ ∞ (212)
2
= | ρ (ln ρ + 1) − ρdV = −1 < 0
−∞ −∞

Obviously, presence of small diffusion, when ν << 1, does not change the inequality (212)
during certain period of time. (However, eventually, for large times, diffusion takes over,
and the inequality (212) is reversed). As shown in (Zak, M., 2006c) the model Eqs. (210),
and (211a) exhibits the same mechanism of emergence of randomness as those described
by Eqs. (14) and (15).
If the information force has the following integral form
v
γ
F = [ρ(ζ, t) − ρ∗ (ζ)]dζ (213)
ρ(v, t)
−∞
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 65

leading to the governing equations


x
1
v̇ = [ρ(ζ, t) − ρ∗ (ζ)]dζ (214)
ρ(v, t)
−∞

∂ρ
+ ρ(t) − ρ∗ = 0 (215)
∂t
then the solution to the corresponding Liouville equation (215) converges to an arbitrarily
prescribed probability density ρ ∗ (V ). This result can be applied to one of the oldest
(and still unsolved) problems in optimization theory: find a global maximum of a multi-
dimensional function. Almost all the optimization problems, one way or another, can be
reduced to this particular one. However, even under severe restrictions imposed upon
the function to be maximized (such as existence of the second derivatives), the classical
methods cannot overcome the problem of local maxima. The situation becomes even
worse if the function is not differentiable since then the concept of gradient ascend cannot
be applied. The idea of the quantum-inspired algorithm based upon the Liouville feedback
Eq. (213) is very simple: represent a positive function ψ(v1 , v2 , ...vn ) to be maximized
as the probability density ρ∗ (v1 , v2 , ...vn ) to which the solution of the Liouville equation
is attracted. Then the larger value of this function will have the higher probability to
appear as a result of running Eq. (214). If an arbitrary prescribed probability density is
chosen as a power law

Γ( ν+1 ) V 2 −(ν+1)/2
ρ∗ (V ) = √ 2 ν (1 + ) ,
νπΓ( 2 ) ν

then the system (214), (215) simulates the underlying dynamics that leads to the cor-
responding power low statistics ρ ∗ (V ). Such a system can be applied to analysis and
predictions of physical and social catastrophes, (Zak, M., 2007).
Finally, introduction of the terminal Liouville feedback (Zak, M.,2004, 2005b, 2006a)

Fi = γi (vi − v̄i )1/3 (216)

applied to a system of ODE


v̇i = fi ({v}, t) (217)
v̇i = fi ({v}, t) + γi (v̄i − vi )1/3 , i = 1, 2, ...n. (218)
and leading to the governing equations

∂ρ  ∂ n
=− {ρ[fi + γi (v̄i − Vi )1/3 ]}. (219)
∂t i=1
∂V i

has been motivated by the fundamental limitation of the theory of ODE that does not dis-
criminate between stable and unstable motions in advance, and therefore, an additional
stability analysis is required for that. However, such an analysis is not constructive: in
case of instability, it does not suggest any model modifications to efficiently describe
66 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

postinstability motions. The most important type of instability, that necessitates postin-
stability description, is associated with positive Lyapunov exponents leading to expo-
nential growth of small errors in initial conditions (chaos, turbulence). The approach
proposed in (Zak,M., 2005b) is based upon the removal of positive Lyapunov exponents
by introducing special Liouville feedback represented by terminal attractors and imple-
mented by the force Eq. (216) . The role of this feedback is to suppress the divergence of
the trajectories corresponding to initial conditions that are different from the prescribed
ones without affecting the “target” trajectory that starts with the prescribed initial con-
ditions. Since the terminal attractors include expected values of the state variables as
new unknowns (see Eqs. (218)), the corresponding Liouville equation should be invoked
for the closure (see Eq. (219)). This equation is different from its classical version by ad-
ditional nonlinear sinks of the probability represented by terminal attractors. The forces
(216) possess the following properties: firstly, they vanish at vi → v̄i , and therefore,
they do not affect the target trajectory vi = vi (t); secondly, their derivatives become
unbounded at the target trajectory:
∂Fi γ
| | = | (v̄i − vi )−2/3 | → ∞ at vi → v̄i . (220)
∂vi 3
and that makes the target trajectory infinitely stable thereby suppressing chaos. The
same property has been exploited for representation of chaotic systems via stochastic
invariants, (Zak, M., 2005b), Fig. 25. Such a representation was linked to the stabilization
principle formulated in (Zak, M., 1994) for the closure in turbulence.
So far the extension of the model of Livings discussed above was implemented through
different Liouville feedbacks. Now we will return to the original feedback, i.e. to the
gradient of the information potential Eq. (32), while extending the model through a
departure from its autonomy. The justification for considering non-autonomous living
systems is based upon the following argument: in many cases, a performance of Livings
include so called “discrete events”, i.e. special critical states that give rise to branching
solutions, or to bifurcations. To attain this property, such system must contain a “clock”-
a dynamical device that generates a global rhythm. During the first part of the “clock’s”
period, a critical point is stable, and therefore, it attracts the solution; during the second
half of this period, the “clock” destabilizes the critical point, and the solution escapes it in
one of possible several directions. Thus, driven by alternating stabilities and instabilities,
such a system performs a random walk-like behavior. In order to illustrate it, start with
the following system (compare to Eq. (11))

∂ √ 1/3 ω√
v̇ = α ln ρ(v, t), α = −2γ D sin D sin ωt, (221)
∂v β
where β, γ, and ω are constants. Then one arrives at the following ODE with respect
to the square root of the variance D (compare to Eq. (37))
√ √
d D 1/3 ω√
= γ sin D sin ωt. (222)
dt β
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 67

This equation was studied in (Zak, M., 1990, 2005a). It has been shown that at the
equilibrium points
√ √
D = πmβ/ ω, m = ... − 2, −1, 0, 1, 2, etc (223)
the Lipschitz condition is violated, and the solution represents a symmetric unrestricted
random walk on the points Eq. (223). The probability ρ∗ that the solution approaches a
point y after n steps is

ρ ∗ (y, n) = Cnm 2−n , m = 0.5(n + y), y = D,n = ingr(2ωt/π) (224)
Here the binomial coefficient should be interpreted as 0 whenever m is not an integer in
the interval [0, n], and n is the total number of steps. Obviously, the variance D = y 2
performs asymmetric random walk restricted by the condition that D is not-negative,
while Eq. (224) is to be replaced by the following
ρ∗ = Cnm 21−n . m = 0.5(n + D), D ≥ 0. (225)
Thus, the probability density of the velocity v described by the ODE (221) jumps ran-
domly from flatter to sharper distributions, and vice versa, so that increase and decrease
of the entropy randomly alternate, and that makes the system “alive”.
Finally, the model (56), (57) can be further generalized by introduction of delay or
advanced time
v̇ = −ζα • ∇v ln ρ(t + τ ), (226)
ρ̇ = ζ∇2V ρ(t + τ ) • •α, (227)
When τ < 0, the dynamics is driven by a feedback from the past (memories); when τ > 0,
the dynamics is driven by a feedback from the future (predictions). Although little is
known about the structure of the solution to Eqs. (226), (227), (including existence,
uniqueness, stability, etc), the usefulness of such a model extension is obvious for inverse
problems when the solution is given, and the model parameters are to be determined,
(see Section 8, Eqs. (190)- (201)).

9.3 Summary
Thus, we have introduced the First Principle for modeling behavior of living systems.
The structure of the model is quantum-inspired: it is obtained from quantum mechanics
by replacing the quantum potential with the information potential, Figure 8. As a result,
the model captures the most fundamental property of life: the progressive evolution,
i.e. the ability to evolve from disorder to order without any external interference. The
mathematical structure of the model can be obtained from the Newtonian equations of
motion coupled with the corresponding Liouville equation via information forces. The
unlimited capacity for increase of complexity is provided by interaction of the system
with it’s images via chains of reflections: what do you think I think you think. . . .All
these specific non-Newtonian properties equip the model with the levels of complexity
that match the complexity of life, and that makes the model applicable for description of
behaviors of ecological, social and economics systems.
68 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Acknowledgment
The research described in this paper was performed at Jet Propulsion Laboratory
California Institute of Technology under contract with National Aeronautics and Space
Administration.
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 69

References
[1] Arbib,M., and Hesse, M.,1986,The Construction of Reality, Cambridge University
press.
[2] Berg,H., 1983, Random walks in biology, Princeton Univercity Press, New Jersey.
[3] Gordon,R., 1999, The Hierarchical Genome and Differential Waves, World Scientific,
[4] Haken,H.,1988, Information and Self-organization, Springer, N.Y.
[5] Huberman,B., 1988, The ecology of Computation, North-Holland, Amsterdam.
[6] Lefebvre,V.,2001, Algebra of Conscience, Kluwer Acad. Publ.
[7] Mead,C,1989, Analog VLSI and Neural Systems,Addison Wesley.
[8] Mikhailov,A., 1990, Foundations of Synergetics, Springer, N.Y.
[9] Risken,H., 1989, The Fokker-Planck Equation, Springer, N.Y.
[10] Perl, J., Probabilistic reasoning in intelligent systems, Morgan Kaufmann Inc. San
Mateo, 1986
[11] Prigogine,I., 1961, Thermodynamics of Irreversible Processes, John Wiley,N.Y.
[12] Prigogine,I., 1980, From being to becoming, Freeman and co., San Francisco.
[13] Whitham, G., Linear and nonlinear waves, Wily-Interscience Publ.;1974.
[14] Yaguello,M,.1998, Language through the looking glass, Oxf. Univ. Press.
[15] Zak, M., ”Terminal Attractors for Associative Memory in Neural Networks,” Physics
Letters A, Vol. 133, No. 1-2, pp. 18-22. 1989
[16] Zak, M., 1990, Creative dynamics approach to neural intelligence, Biological
Cybernetics, 64, 15-23.
[17] Zak,M.,1992, Terminal Model of Newtonian dynamics, Int. J. of Theor. Phys. 32,
159-190.
[18] Zak, M., 1994, Postinstability models in Dynamics, Int. J. of Theor. Phys.vol. 33,
No. 11, 2215-2280.
[19] Zak,M., 1999a, Physical invariants of biosignature, Phys. Letters A, 255, 110-118.
[20] Zak, M.,1999b, Quantum analog computing, Chaos ,Solitons &fractals, Vol.10, No.
10, 1583-1620.
[21] Zak,M., 2000a, Dynamics of intelligent systems, Int. J. of Theor. Phys.vol. 39, No.8.
2107-2140.
[22] Zak,M., 2000b, Quantum decision-maker, Information Sciences, 128, 199-215.
[23] Zak, M.,2002a) Entanglement-based self-organization, Chaos ,Solitons &fractals, 14,
745-758.
[24] Zak,M.,2002b, Quantum evolution as a nonlinear Markov Process, Foundations of
Physics L,vol.15, No.3, 229-243.
[25] Zak, M., 2003, From collective mind to communications, Complex Systems, 14, 335-
361,
[26] Zak,M.,2004, Self-supervised dynamical systems, Chaos ,Solitons &fractals, 19, 645-
666,
70 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

[27] Zak, M. 2005a, From Reversible Thermodynamics to Life. Chaos, Solitons &Fractals,
1019-1033,
[28] Zak, M., 2005b, Stochastic representation of chaos using terminal attractors, Chaos,
Solitons &Fractals, 24, 863-868
[29] Zak, M., 2006a Expectation-based intelligent control, Chaos, Solitons&Fractals, 28,
5. 616-626,
[30] Zak, M., 2007a, Complexity for Survival of Livings, Chaos, Solitons &Fractals, 32,3
, 1154-1167
[31] Zak, M., 2007b, From quantum entanglement to mirror neuron, Chaos, Solitons
&Fractals, 34, 344-359.
[32] Zak, M., 2007c, “Quantum-Classical Hybrid for Computing and Simulations”,
Mathematical Methods, Physical Models and Simulation in Science & Technology (in
press).
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 71
72 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 73
74 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 75
76 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 77
78 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 79
80 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 81
82 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 83
84 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 85
86 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Non-communicating agents: Communicating agents:


From order to disorder. From order to disorder to order etc. . .
Figure 16. Complexity and survivability
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 87

Figure 17. Chain of reflections


88 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Figure 18. Two levels of abstruction.


Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 89

Figura 19. Block-diagram of intelligent control.


90 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 91
92 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96
Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 93
94 Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96

Figure 24. Shock wave and soliton in probability space


Electronic Journal of Theoretical Physics 4, No. 16(II) (2007) 11–96 95

You might also like