See

discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/221632574

Neuro Fuzzy Modeling of Control Systems.

Conference Paper January 2006

DOI: 10.1109/CONIELECOMP.2006.42 Source: DBLP

CITATIONS READS

3 47

2 authors, including:

Jesus Carlos Pedraza Ortega

Autonomous University of Queretaro
98 PUBLICATIONS 268 CITATIONS

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Intelligent Surveillance Technologies for Activity Interpretation View project

All content following this page was uploaded by Jesus Carlos Pedraza Ortega on 03 February 2015.

The user has requested enhancement of the downloaded file.

 NEURO FUZZY MODELING OF CONTROL SYSTEMS
Efrn Gorrostieta, Carlos Pedraza
Centro de Ingeniera y Desarrollo Industrial CIDESI, Av Pie de La Cuesta 702. Des. San Pablo.
Quertaro, Qro, Mxico
gorrostieta@iteso.mx jpedraza@cidesi.mx
Abstract
The analysis of the models is carried out starting
from experimental data of a multivariable system
MISO (Many Input Single Output). The models
implementation was made using fuzzy logic. In fuzzy
logic, the cluster technique was used to decrease the
number of rules to use in the identification. This
technique is opposed to the conventional method which
requires a considerable number of fuzzy inference
rules to approach the model. In the consequence of
fuzzy model, different techniques are used to
implement Takagi-Sugeno type rules. By other hand,
we implemented the Neuro-fuzzy modeling methods,
which let represent the non-linear system and at the
same time a system with some learning degree using
different topologies. By comparison the goodness of
each method is obtained.
1. Introduction
INSIDE the control of engineering systems, one of
y (k )
the most important tasks is the control systems
modeling. At the present time, there are many forms to
do this modeling. During the past years, the
improvement of the expert systems has allowed to
incorporate new methods to conventional techniques,
such like the neural networks, fuzzy logic and genetic
algorithms. In the year of 1965 Lofti Zadeh in the
University of California makes the first publication on
fuzzy logic in the Journal of Information and Control,
titled Fuzzy Set [1]. This publication was the
beginning of many later works related to the
application of the fuzzy logic in the control systems.
Without a doubt, one of the most relevant works was
the one of the Takagi-Sugeno, whom drew up the
directive of the fuzzy systems modeling [2].
Proceedings of the 16th IEEE International Conference on Electronics, Communications and Computers (CONIELECOMP 2006)
0-7695-2505-9/06 $20.00 2006 IEEE
Most of the time when we face the modeling of a
system, we counted only with the input-output data
that describes the system. Hence, we must consider a
black box with several inputs and outputs.
In order to obtain the fuzzy modeling of dynamical
systems, we must remember that these systems are
generally modeled by a state function, like in eq. 1
y (k ) f ( y (k  n), u (k )) (1)
where f is denominated the transition state function.
This function is used by the fuzzy dynamic model. The
most common function utilized in this case is the ARX
(Auto Regressive eXogenous), which is shown in eq.
2; where y(k) is the system output, u(k) represents the
system inputs, e(k) represents a white noise signal, and
n is the models order [3].
n n (2)
a
j 1
j y ( k  j )  b j u ( k  j )  e( k )
j 0
The Takagi-Sugeno model has a very particular
structure, mainly in the consequent part; therefore this
structure can be represented by:
If X is Ai then yi=Fi(x)
The left part corresponds to the antecedent, and for this
particular case it is evaluated if the input variable X has
the value assigned by the diffuse variable A, which can
be a linguistic variable that is used in the fuzzy
systems. However, the value of the Y variables cant
be a linguistic value. Function F which corresponds to
the consequent has a defined structure, as can be seen
 in eq. 3, which is very similar for all the rules and the
only one changing values are in the input vector X.
Also, the F value can be simply a constant.
F ( x) aT x  b (3)
As we can see, the structure of the consequent could
correspond to eq. 2, and this similarity is an advantage
to relate the ARX model with the Takagi-Sugeno
technique.
An inconvenience of using ARX is that this model
represents a linear relationship, and for the particular
case of a system that represents a non-linear
relationship it is necessary to built many ARX
structures. Finally, in the last part of this paper a
Neuro-fuzzy model is proposed by using a Neural
Network to approximate the results of the model to the
real system.
2. Fuzzy Model
The fuzzy system of the type Takagi- Sugeno[2] is
represented by the eq. 4
k
Pi (aiT x  bi )
y i 1
k
i 1
Pi
Another way to express this equation is by
separating the membership functions of the
denominator and leave the corresponding for each
numerator, remember that in this structure the changes
are due to the variables that represent the present
inputs, the outputs and the previous inputs. On
equation 5, the same fuzzy function is represented with
this new order.
P i ( x ) ai 0 P i ( x ) ai1 x1 P ( x) a x
y k
 k    i k in n
i 1 P i ( x ) i 1 P i ( x ) i 1 P i ( x )
By other hand we define a part of the eq. 5 that does
not include the constants and the variables, as shown in
eq. 6. By simplifying the original fuzzy function into a
more simple expression we could define the values of
the constants to their corresponding rules.
Pi ( x) (6)
[i n
i 1 Pi ( x)
Proceedings of the 16th IEEE International Conference on Electronics, Communications and Computers (CONIELECOMP 2006)
0-7695-2505-9/06 $20.00 2006 IEEE
Then, the fuzzy function expressed with the new
assignment is represented by the vector multiplying as
shown in eq. 7
y T T [ n (x) (7)
Where Tis defined by eq. 8 and [n(x) is defined by
eq. 9
T [a11, a12  , a1n ] (8)
n
[ n ( x) [[1 , [ 2 x,[ n x ] (9)
To know the values of the constants from the T
vectorthe least squares method is used due to the
form the function adopts [4][5][6].
Once the structure is defined, we face the problem
of defining the number of necessary rules to obtain the
system model. The number of necessary rules is a
function of the number of fuzzy partitions made in
each linguistic variables. This number of rules can be
obtained from eq. 10. [7]
Kr nf v (10)
(4)
Where Kr is the number of rules, nf is the number
of linguistic terms or partitions from the fuzzy variable
and v is the number of the variables from the system.
For instance, if we consider a system with 3 partitions
or fuzzy subsets and 2 variables, the number of rules
will be Kr=9, by increasing a fuzzy partition in each
variable, the number of rules will increase until 16. If
we want our model to have a better approximation to
the real system, we have to increase the fuzzy
partitions in each variable and consequently the
number of the rules will increase exponentially
(5) according to eq. 10.
To optimize the number of rules, we must group the
data obtained in the regions where the elements show
some similar characteristics. The theory groups
(cluster) help us to prepare the data, and it determines
the number of c partitions to use in the model, which
must be less than the calculated by eq. 10.
The algorithm required to find the c partitions
from the set of data corresponding to the number of
rules is shown in the next 7 steps:
 1) Select the number of partitions from the sample weight required to multiply in the next layers of the
universe A. The possible values of the partition are net.
between two and the maxim number of data contained
in the sample. The value of c is defined.
2) Initialize the Mfc matrix with random data.
3) Choose the allowed limit of the error e between
the matrix Mfc(0) and Mfc( r). A value between 0.01 and
0.001 is desirable.
4) Select the m value starting from 1. We consider a
value of m=2.
5) Calculate the centers {vi ( 0)} for each group defined
in the step 1).
6) Generate matrix Mfc( r) using the next information
and the eq. 11
Figure. 1 Neural network applied in the first part of
1
the fuzzy system.
c ( 0 ) 2 m 1
d ik

(r )
P ik (r ) (11)
j 1 d jk The data required to train the net was obtained from
the fuzzy group in the Mfc array, where the data
corresponds to each exit value of the network.
7) If the comparison between Mfc(0) and Mfc( r) is less
than the stipulated error on step 3, then we have found The second Neuro-fuzzy model consider a Neural
the groups that belongs to the given data; otherwise, it Network in the next level. To train this network, the
is necessary to update the matrix Mfc(0) and go back to elements belongings only to one group were used; to
step 5). do this model three Neural Networks were trained in
accordance with the model showed in [5]. The fuzzy
With the above described algorithm, we can find process was the same than in the previous section. The
the c partitions of the set; but this lead us to the next structure is shown in equation 13.
question: which one of all the partitions is the best
one to carry out the model?. On eq. 12, the selected If x1, x2, x3 and x4 belongs to S, Y=NN(x1,x2,x3)
criteria is shown on [8] and [9], to find the number of
necessary rules to build our fuzzy model. To analyze In this structure, the data group required to train the
this value, it is necessary to review; the m weight network does not require a similar treatment, due to the
(initially considered m=2), the centers of the group v, short size of it; this is the reason why it is possible to
the membership degree P the data and the average apply a more simple neural network than the one
value of the data.
applied in a neural model.
n c 2
2 In the third procedure (neuralfuzzy procedure),
S (c ) ( Pik ) m ( xk  vi  vi  x ) (12)
k 1 i 1
the structure applies the bias of a fuzzy model, where it
is possible to find the three components of a fuzzy
Therefore, we must find the minimum value of eq. system. The corresponding parameters to every
12 varying m to know which is the best number of function into the structure are the unknown variable,
rules [9][10]. and the same condition exists to the corresponding
constants to each one of the next values; under this
3. Neuro- Fuzzy Model Application. condition a lineal relationship between input and exit
values can be structured. First, we do a treatment to
Three possibilities are available to build the Neuro- the whole fuzzy system in a similar way to a Neural
fuzzy model, in order to join the fuzzy system with the Network, using some method to train the net and
neural network. In any case, the main objective is to define the function parameters 13]. Next, a back
find an advantage according to the problem propagation method was applied [12] to find the center
and size of the membership functions. The most used
The first Neuro-fuzzy method uses a Neural function was the Gauss function.[5].
Network in the first part of the structure to get the

Proceedings of the 16th IEEE International Conference on Electronics, Communications and Computers (CONIELECOMP 2006)
0-7695-2505-9/06 $20.00 2006 IEEE
 4. Study Case
To prove the structure using several cases, a
combustion system is proposed. Here we have 7
variables at the enter and given that the nature of the
burner element, we can easily note that it has a non-
linear behavior

Figure2 Neuro-fuzzy model 3 structure

It is preferable to assign short training values in the

calculator layer in order to avoid the system
divergence.

The training of this fuzzy system is done in a

similar way that the training of a Neural Network
under supervisory conditions. This condition implies
that the input data in the first layer of the net must be Figure 3 The Neuro-fuzzy2 model
shown, and the output data will be assigned to
evaluate the parameters along the Neuro-fuzzy layers

Equation 13 bring us the output function, which

have the Takagi-Sugeno structure:

i
R n 1 uj  cj 2
b (u ) j 1 exp(  (
i 1 i
2 Vj i
) )
(13)
f (u / T ) y' i
R n 1 uj  cj 2
i 1 j 1
exp(  (
2 V ij
) )

where bi can take two types of conditions; the first

one can be a constant and the second one a lineal
relationship between the variables at real time and the
previous moments. In this condition bi adopts the form
used in the eq. 2.
The criteria to minimize the error was expressed in
equation 6; this is the reason why em is expressed for
14 [3][12] as next:
Figure 4 The Neuro-fuzzy2 error.
The Neuro-fuzzy model 2 and their respective error
plots are shown on figures 3 and 4; in this case a
variation of r 10 degrees is maintained respect to the
900 or 1000 from the burner operation.

1
em [ f (u m / T )  y m ]2 (14)
2

Proceedings of the 16th IEEE International Conference on Electronics, Communications and Computers (CONIELECOMP 2006)
0-7695-2505-9/06 $20.00 2006 IEEE

Figure 5 The Neuro-fuzzy3 model.
Figure 5 The Neuro-fuzzy3 error.
In figure 4, the Neuro-fuzzy 3 output is shown. In
this graph a data -different from the ones used to build
the model- is used to build the model. The goal is to
validate the model performance. In figure 5, the error
in the output data is shown.
5. Results
The performance of the w models is calculated
according to eq. 15 [5] where y* is the data from the
real output, y is the data from the output of the model
and n is the number of total data.
*
1 n yi  yi
w y * *100
ni1
(15)
i Principles, Ed. IEEE press, U.S.A, 1996. pp. 83-131.
The comparison that was made is about the
performance of each one model respect to the w
variable. On table 1, the values for w are shown for
each Neuro-fuzzy model; the used model in the first
technique described was called Fuzzy1, for the second
Proceedings of the 16th IEEE International Conference on Electronics, Communications and Computers (CONIELECOMP 2006)
0-7695-2505-9/06 $20.00 2006 IEEE
case, was called Fuzzy2, also the result obtained for an
identification model using the traditional least mean
squares (lms) method was included.
Model W
Neuro-fuzzy1 7.1
Neuro-fuzzy2 5.9
Neuro-fuzzy3 7.2
lms 12.8
Table 1 Comparison of the models
.
6. Conclusions
On section 5, we have some results from the system
modeling using different modeling techniques. It can
be observed that a first order classic model presents a
bigger error than the fuzzy models. The fuzzy
modeling by cluster reduces in great number the rules
of inference which are used in the system modeling.
By other hand, the fuzzy logic model in combination
with the neural networks could represent a very good
option in the case of non-linear systems.
The w value was calculated for the first order models
with similar characteristics. Considering the reported
values, the most recommendable model is the Neuro-
fuzzy2 with the smallest value in the performance,
which means that in general has a better approximation
to the real system.
One good conclusion is the inference of the most
relevant variable, which corresponds to the previous
values of temperature. Also the models where all the
variables were included with the model were
compared, later it was constructed from this variable
and the results were identical.
7. References
[1] Tanaka K., An introduction to Fuzzy Logic for Practical
Applications, Ed. Springer, U.S.A, 1991, pp. 1-13.
[2] Berkan R. and Trubatch S.. Fuzzy System Design
[3] Aguado B. Alberto, Temas de Identificacin y
Control Adaptable. Instituto de Ciberntica,
Matemticas y Fsica. La Habana,2000.
 [4] Gorrostieta, E, Pedraza, C and Rosete J. Fuzzy
Modeling of Systems, Methos and Models in Robotics
29 Agust 1 September 2005, Miedzyzdroje, Poland.
pp.100

[5] Passino K. and Yurkovich S. Fuzzy Control, Ed.

Addison-Wesley, U.S.A., 1998 pp.221-286

[7] Bortolet P, Dpassaquay, S. A Titli. Interactive

Fuzzy Modeling and Control of no linear System
Using Multidimensional Fuzzy Set Laboratoire
Danalyse et Darchitectura des Systemes LASS,
Francia. , 1998

[6] Wolkenhauser O, Fuzzy System Identification

Takagi-Sugeno Modelling and Identification.
www.csc.umist.ac.uk.

[8] Cao S.G. Rees, N.W y Feng G, Proceedings of the

Fifth IEEE International Conference Fuzzy Systems,
Vol 1, 1996, pp. 640-646.

[9] Sugeno M. and Yasukawa T., IEEE Transactions

on Fuzzy System, Vol1, 1993.1-31.

[10] Nguyen H. and Sugeno M.. Fuzzy System

Modeling and Control, Ed. Kluwer Academic
Publishers, U.S.A, 1998.pp. 74-75

[11] Tsoukalas L. and Rober E., Fuzzy and Neural

Approaches in Engineering, Ed. Wiley and Son,
U.S.A., 1998. pp. 449-467

[12] Gorrostieta E., y Vargas E., A Neuro PD

Control Applied for Free Gait on a Six Legged Robot
, 3er. WSEAS International Conference on Signal
Processing, Robotics and Automation (ISPRA 2004)
ISBN 960-8052-95-5, 2004,February 13-15, Salzburg,
Austria,

[13] Zhang J. and Morris J, Recurrent Neuro Fuzzy

Networks for Nolinear Process Modeling
Transactions on Neural Networks, vol 10 No 2 March.
IEEE, 1999

Proceedings of the 16th IEEE International Conference on Electronics, Communications and Computers (CONIELECOMP 2006)
0-7695-2505-9/06 $20.00 2006 IEEE
View publication stats