Professional Documents
Culture Documents
Research Article
Linear Simultaneous Equations Neural Solution
and Its Application to Convex Quadratic Programming
with Equality-Constraint
Yuhuan Chen,1 Chenfu Yi,2,3 and Jian Zhong1
1
Center for Educational Technology, Gannan Normal University, Ganzhou 341000, China
Research Center for Biomedical and Information Technology, Shenzhen Institutes of Advanced Technology,
Chinese Academy of Sciences, Shenzhen 518055, China
3
School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou, Jiangxi 341000, China
2
1. Introduction
A variety of scientific research and practical applications can
be finalized as a matrix equation solving problem [16]. For
example, the analysis of stability and perturbation for a control system could be viewed as the solution of Sylvester matrix
equation [1, 2]; the stability and/or robustness properties of
a control system could be obtained by the Lyapunov matrix
equations solving [46]. Therefore, the real-time solution to
matrix equation plays a fundamental role in numerous fields
of science, engineering, and business.
As for the solution of matrix equations, many numerical
algorithms have been proposed. In general, the minimal
arithmetic operations of numerical algorithms are usually
proportional to the cube of the dimension of the coefficient
matrix, that is, (3 ) [7]. In order to be satisfied with the low
complexity and real-time requirements, recently, numerous
novel neural networks have been exploited based on the
hardware implementation [2, 4, 5, 813]. For example, Tank
and Hopfield solved the linear programming problems by
using their proposed Hopfield neural networks (HNN) [9],
(1)
(4)
=1
=1
, {1, 2, 3, . . . , } .
(5)
V ()
= ( ( ))
=
=1
=1
= ( ( )) ( ( )) = () ,
=1
=1
(6)
(2)
= ()
,
= ( ( )) ,
(3)
if > 0,
if = 0,
if < 0.
(7)
3. Problem Formulation on
Quadratic Programming
An optimization problem characterized by a quadratic objection function and linear constraints is named as a quadratic
programming (QP) problem [1618]. In this paper, we consider the following quadratic programming problem with
equality-constraints:
minimize
+ ,
2
subject to = ,
(8)
2
2
2
2
2
2
2
2
() = 0, {1, 2, 3, . . . , } .
(9)
(, ) = () + () = () + () ,
=1
(10)
(, )
= = 0.
(11)
(12)
T
P
F()
(t)
x
1
0.5
0
0.5
1
(13)
1.5
(14)
1.5
2
2.5
3
10
15
Time t (s)
(16)
(15)
1 1 1
],
2 1 1
0
= [0] ,
[1]
2
= [ ].
4
5
and theoretical solution . We thus
the neural state ()
generally use power-sigmoid activation function to achieve
the superior convergence performance, as shown in Figure 3.
12
x +
||P
10
q||2F
8
1.5
1
0.5
0
0.5
6
4
2
0
6. Conclusions
11
12
13
10
15
Time t (s)
Sigmoid
Power-sigmoid
Linear
Power
1
10
100
GNNlin
1.74 102
1.89 103
7.24 104
GNNpower
0.267
8.93 102
2.65 102
GNNsig
2.07 102
2.56 103
9.12 104
GNNps
3.68 103
1.03 103
3.32 104
Conflict of Interests
The authors declare that there is no conflict of interests
regarding the publication of this paper.
Acknowledgments
This work is supported by the National Natural Science Foundation of China under Grant 61363076 and the Programs
for Foundations of Jiangxi Province of China (GJJ13649,
GJJ12367, GJJ13435, and 20122BAB211019) and partially supported by the Shenzhen Programs (JC201005270257A and
JC201104220255A).
References
[1] P. Liu, S. Zhang, and Q. Li, On the positive definite solutions of
a nonlinear matrix equation, Journal of Applied Mathematics,
vol. 2013, Article ID 676978, 6 pages, 2013.
[2] Y. Zhang, D. Jiang, and J. Wang, A recurrent neural network for
solving sylvester equation with time-varying coefficients, IEEE
Transactions on Neural Networks, vol. 13, no. 5, pp. 10531063,
2002.
[3] Y. Li, M. Reisslein, and C. Chakrabarti, Energy-efficient video
transmission over a wireless link, IEEE Transactions on Vehicular Technology, vol. 58, no. 3, pp. 12291244, 2009.
[4] C. Yi, Y. Chen, and X. Lan, Comparison on neural solvers for
the Lyapunov matrix equation with stationary & nonstationary
coefficients, Applied Mathematical Modelling, vol. 37, no. 4, pp.
24952502, 2013.
[5] F. Ding and T. Chen, Gradient based iterative algorithms
for solving a class of matrix equations, IEEE Transactions on
Automatic Control, vol. 50, no. 8, pp. 12161221, 2005.
[6] M. A. Ghorbani, O. Kisi, and M. Aalinezhad, A probe into the
chaotic nature of daily streamflow time series by correlation
dimension and largest Lyapunov methods, Applied Mathematical Modelling, vol. 34, no. 12, pp. 40504057, 2010.
[7] Y. Zhang and W. E. Leithead, Exploiting Hessian matrix
and trust-region algorithm in hyperparameters estimation of
Gaussian process, Applied Mathematics and Computation, vol.
171, no. 2, pp. 12641281, 2005.
[8] X. Zou, Y. Tang, S. Bu, Z. Luo, and S. Zhong, Neural-networkbased approach for extracting eigenvectors and eigenvalues of
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
Advances in
Operations Research
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Advances in
Decision Sciences
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Journal of
Applied Mathematics
Algebra
Volume 2014
Journal of
The Scientific
World Journal
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
International Journal of
Differential Equations
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Volume 2014
Advances in
Combinatorics
Hindawi Publishing Corporation
http://www.hindawi.com
Mathematical Physics
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Journal of
Complex Analysis
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
International
Journal of
Mathematics and
Mathematical
Sciences
Mathematical Problems
in Engineering
Journal of
Mathematics
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Volume 2014
Volume 2014
Volume 2014
Discrete Mathematics
Journal of
Volume 2014
Discrete Dynamics in
Nature and Society
Journal of
Function Spaces
Hindawi Publishing Corporation
http://www.hindawi.com
Abstract and
Applied Analysis
Volume 2014
Volume 2014
Volume 2014
International Journal of
Journal of
Stochastic Analysis
Optimization
Volume 2014
Volume 2014