Professional Documents
Culture Documents
Research Article
On the Kronecker Products and Their Applications
Huamin Zhang1,2 and Feng Ding1
1
Key Laboratory of Advanced Process Control for Light Industry of Ministry of Education, Jiangnan University,
Wuxi 214122, China
2
Department of Mathematics and Physics, Bengbu College, Bengbu 233030, China
Correspondence should be addressed to Feng Ding; fding@jiangnan.edu.cn
Received 10 March 2013; Accepted 6 June 2013
Academic Editor: Song Cen
Copyright 2013 H. Zhang and F. Ding. This is an open access article distributed under the Creative Commons Attribution
License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly
cited.
This paper studies the properties of the Kronecker product related to the mixed matrix products, the vector operator, and the vecpermutation matrix and gives several theorems and their proofs. In addition, we establish the relations between the singular values
of two matrices and their Kronecker product and the relations between the determinant, the trace, the rank, and the polynomial
matrix of the Kronecker products.
1. Introduction
The Kronecker product, named after German mathematician
Leopold Kronecker (December 7, 1823December 29, 1891), is
very important in the areas of linear algebra and signal processing. In fact, the Kronecker product should be called the
Zehfuss product because Johann Georg Zehfuss published a
paper in 1858 which contained the well-known determinant
conclusion |A B| = |A| |B| , for square matrices A and B
with order and [1].
The Kronecker product has wide applications in system
theory [25], matrix calculus [69], matrix equations [10, 11],
system identification [1215], and other special fields [16
19]. Steeba and Wilhelm extended the exponential functions
formulas and the trace formulas of the exponential functions
of the Kronecker products [20]. For estimating the upper and
lower dimensions of the ranges of the two well-known linear
transformations T1 (X) = X AXB and T2 (X) = AX
XB, Chuai and Tian established some rank equalities and
inequalities for the Kronecker products [21]. Corresponding
to two different kinds of matrix partition, Koning, Neudecker,
and Wansbeek developed two generalizations of the Kronecker product and two related generalizations of the vector
operator [22]. The Kronecker product has an important role
in the linear matrix equation theory. The solution of the
Sylvester and the Sylvester-like equations is a hotspot research
area. Recently, the innovational and computationally efficient
11 B 12 B 1 B
[ 21 B 22 B 2 B ]
]
[
A B = [ ..
..
.. ]
[ .
.
. ]
[1 B 2 B B]
A B = [ B]
11 B 12 B 1 B
[ 21 B 22 B 2 B ]
[
]
()()
= [ ..
.
..
.. ] F
[ .
]
.
.
[1 B 2 B B]
(1)
11 I 12 I 1 I
B 0
[ 21 I 22 I 2 I ] [ 0 B
][
[
=[ .
..
.. ] [ .. ..
[ ..
.
. ][. .
[1 I 2 I I ] [ 0 0
0
0]
]
.. ]
d .]
B]
= (A I ) (I B) ,
11 B 12 B 1 B
[ 21 B 22 B 2 B ]
[
]
A B = [ ..
..
.. ]
[ .
.
. ]
[1 B 2 B B]
B
[0
[
= [ ..
[.
[0
0
B
..
. d
0
11 I 12 I 1 I
0
[ 21 I 22 I 2 I ]
0]
]
][
.. ] [ ..
..
.. ]
]
[
.
.
.
. ]
B] [1 I 2 I I ]
= (I B) (A I ) .
(3)
From Theorem 1, we have the following corollary.
(5) (A + B) C = A C + B C,
A B = (A I ) (I B) = (I B) (A I ) .
(6) A (B + C) = A B + A C,
(4)
(7) A (B C) = (A B) C = A B C,
(8) (A B) = A B ,
(9) (A B) = A B.
Theorem 3. Let A = [ ] F , C = [ ] F , B F ,
and D F . Then
(A B) (C D) = (AC) (BD) .
Proof. According to Theorem 1, we have
(A B) (C D)
= (A I ) (I B) (C I ) (I D)
= (A I ) [(I B) (C I )] (I D)
= (A I ) (C B) (I D)
A B = (A I ) (I B) = (I B) (A I ) .
(2)
= (A I ) [(C I ) (I B)] (I D)
(5)
= [ (AC) I )] [I (BD)]
= (AC) (BD) .
(6)
= 1, 2, . . . .
(7)
= (U W)
0
] V,
0 0
B=[
0
] Q,
0 0
0
0
] V} {W [
] Q}
0 0
0 0
= (U W) {[
A B = {U [
(8)
0
0
][
]} (V Q)
0 0
0 0
(9)
0
] 0]
0 0
(V Q)
0
0]
[ [
[
= (U W) [
0
] (V Q) .
0 0
(10)
0
A
..
. d
0
(B)1
0
[ (B)2 ]
0]
]
][
.. ] [ .. ]
]
[
. ]
.
A] [(B) ]
A(B)1
(AB)1
[ A(B)2 ] [ (AB)2 ]
] [
]
[
= [ .. ] = [ .. ] = col [AB] .
[ . ] [ . ]
[A(B) ]
[(AB) ]
(11)
Similarly, we have
(A I ) col [C]
11 I 12 I 1 I
(C)1
[ 21 I 22 I 2 I ] [(C)2 ]
][
]
[
=[ .
..
.. ] [ .. ]
]
[ ..
[
. ]
.
.
[1 I 2 I I ] [(C) ]
[
[
=[
[
=1 =1
]
]
]
]
(e e ) (e e )
=1 =1
C(A )1
(CA )1
[ C(A ) ] [ (CA ) ]
[
[
2]
2]
]=[
] = col [CA ] .
=[
..
..
] [
]
[
] [
]
[
.
.
C(A
(CA
)
)
[
[
]
]
=1 =1
(12)
(13)
=1 =1
=1 =1
=1 =1
= (C I ) col [AB]
(19)
= [e (e e ) e ]
=1
=1
[
]
= (C I ) (I A) col [B]
= [(C I ) (I A)] col [B]
= [e I e ]
= (C A) col [B] .
=1
(14)
Theorem 10 plays an important role in solving the matrix
equations [25, 3537], system identification [3854], and
control theory [5558].
Let e denote an -dimensional column vector which has
1 in the th position and 0s elsewhere; that is,
e := [0, 0, . . . , 0, 1, 0, . . . , 0] .
e1
]
e2 ]
]
I
[
[I
:= [
,
]R
[ ..
]
[ .
[I e ]
I e1
]
[
]
[
[I e2 ]
=[
]
]
[ ..
]
[ .
[I e ]
= P .
(15)
(2) P P = P P = I .
(e e ) (e e ) .
=1 =1
= (e e ) (e e )
= [e (e e ) e ]
= (e e ) (e e )
= (e e ) (e e )
(18)
(e e ) (e e ) = P .
(17)
5
I e1
P P
]
[
]
[
[I e2 ]
=[
]
]
[ ..
]
[ .
[I e ]
= I [e e ]
=1
= I I
= [I e1 , I e2 , . . . , I e ]
= I .
e1 e1 e1 e2 e1 e
(22)
]
[
]
[
[ e2 e1 e2 e2 e2 e ]
=[
]
]
[
..
..
..
]
[
.
.
.
[e e1 e e2 e e ]
e1 e1 e2 e1 e e1
]
[
]
[
[ e1 e2 e2 e2 e e2 ]
=[
]
]
[
..
..
..
]
[
.
.
.
e
e
e
e
[ 1
2
B1
B2
I e1
P (A B) P
]
[
]
[
[ I e2 ]
=[
]
]
[
..
]
[
.
[I e ]
= P ,
(20)
I e1
[
]
[
]
[ I e ]
[
]
..
[
]
.
[
]
[I e ]
(A)1 B1 (A)2 B1 (A) B1
[ (A)1 B2 (A)2 B2 (A) B2 ]
]
[
=[
] P
..
..
..
]
[
.
.
.
P P
I e1
]
[
]
[
[I e2 ]
=[
] [I e1 , I e2 , . . . , I e ]
]
[ ..
]
[ .
e
I
[
]
I (e1 e1 ) I (e1 e2 ) I (e1 e )
[
]
[
]
[I (e e ) I (e e ) I (e e )]
2 1
2 2
2 ]
=[
[
]
..
..
..
[
]
.
.
.
[
]
(e
e
)
I
(e
e
)
(e
e
)
1
2
]
[
I 0
[ 0 I
[
= [ .. ..
[. . d
[ 0 0
[
]
[
]
[I e2 ]
= [I e1 , I e2 , . . . , I e ] [
]
[ ..
]
[ .
]
[I e ]
0
0]
]
.. ]
.]
A B1
[ A B2 ]
]
[
= [ . ] [I e1 , I e2 , . . . , I e ]
[ .. ]
[A B ]
A11 A12 A1
[ A21 A22 A2 ]
]
[
=[ .
..
.. ]
[ ..
.
. ]
[A1 A2 A ]
= B A.
(23)
I ]
= I ,
(21)
and B, D F
(25)
(, ) = ,
,=1
(A, B) = A B .
(34)
(I A) = I (A),
(A I ) = (A) I .
(27)
(28)
6. Conclusions
(29)
(33)
. Then
, , F,
(26)
1
|B| .
(A, B) = |A|
(32)
,=1
= 1, 2, . . . , .
=1
= tr [CA] tr [DB] .
and B F
( ) = ,
( , ) = ,
(1) Let A F
are
= |AC| |BD| .
= tr [AC] tr [BD]
(31)
=1
. Then
(A) = A
,=1
If [A] = { 1 , 2 , . . . , } and () = =1 is a
polynomial, then the eigenvalues of
(30)
Acknowledgments
This work was supported by the National Natural Science
Foundation of China (no. 61273194), the 111 Project (B12018),
and the PAPD of Jiangsu Higher Education Institutions.
References
[1] H. V. Jemderson, F. Pukelsheim, and S. R. Searle, On the history
of the Kronecker product, Linear and Multilinear Algebra, vol.
14, no. 2, pp. 113120, 1983.
[2] X. L. Xiong, W. Fan, and R. Ding, Least-squares parameter
estimation algorithm for a class of input nonlinear systems,
Journal of Applied Mathematics, vol. 2007, Article ID 684074,
14 pages, 2007.
[3] F. Ding, Transformations between some special matrices,
Computers & Mathematics with Applications, vol. 59, no. 8, pp.
26762695, 2010.
[4] Y. Shi and B. Yu, Output feedback stabilization of networked
control systems with random delays modeled by Markov
chains, IEEE Transactions on Automatic Control, vol. 54, no. 7,
pp. 16681674, 2009.
[5] Y. Shi, H. Fang, and M. Yan, Kalman filter-based adaptive
control for networked systems with unknown parameters and
randomly missing outputs, International Journal of Robust and
Nonlinear Control, vol. 19, no. 18, pp. 19761992, 2009.
[6] A. Graham, Kronecker Products and Matrix Calculus: With
Applications, John Wiley & Sons, New York, NY, USA, 1982.
[7] W.-H. Steeb and Y. Hardy, Matrix Calculus and Kronecker
Product: A Practical Approach to Linear and Multilinear Algebra,
World Scientific, River Edge, NJ, USA, 2011.
[8] P. M. Bentler and S. Y. Lee, Matrix derivatives with chain
rule and rules for simple, Hadamard, and Kronecker products,
Journal of Mathematical Psychology, vol. 17, no. 3, pp. 255262,
1978.
[9] J. R. Magnus and H. Neudecker, Matrix differential calculus
with applications to simple, Hadamard, and Kronecker products, Journal of Mathematical Psychology, vol. 29, no. 4, pp. 474
492, 1985.
[10] F. Ding and T. Chen, Iterative least-squares solutions of
coupled Sylvester matrix equations, Systems & Control Letters,
vol. 54, no. 2, pp. 95107, 2005.
[11] F. Ding and T. Chen, On iterative solutions of general coupled
matrix equations, SIAM Journal on Control and Optimization,
vol. 44, no. 6, pp. 22692284, 2006.
[12] L. Jodar and H. Abou-Kandil, Kronecker products and coupled
matrix Riccati differential systems, Linear Algebra and its
Applications, vol. 121, no. 2-3, pp. 3951, 1989.
[13] D. Bahuguna, A. Ujlayan, and D. N. Pandey, Advanced type
coupled matrix Riccati differential equation systems with Kronecker product, Applied Mathematics and Computation, vol.
194, no. 1, pp. 4653, 2007.
[14] M. Dehghan and M. Hajarian, An iterative algorithm for
solving a pair of matrix equations = , =
over generalized centro-symmetric matrices, Computers &
Mathematics with Applications, vol. 56, no. 12, pp. 32463260,
2008.
[15] M. Dehghan and M. Hajarian, An iterative algorithm for the
reflexive solutions of the generalized coupled Sylvester matrix
equations and its optimal approximation, Applied Mathematics
and Computation, vol. 202, no. 2, pp. 571588, 2008.
7
[16] C. F. van Loan, The ubiquitous Kronecker product, Journal of
Computational and Applied Mathematics, vol. 123, no. 1-2, pp.
85100, 2000.
[17] M. Huhtanen, Real linear Kronecker product operations,
Linear Algebra and its Applications, vol. 418, no. 1, pp. 347361,
2006.
[18] S. Delvaux and M. van Barel, Rank-deficient submatrices of
Kronecker products of Fourier matrices, Linear Algebra and its
Applications, vol. 426, no. 2-3, pp. 349367, 2007.
[19] S. G. Deo, K. N. Murty, and J. Turner, Qualitative properties of
adjoint Kronecker product boundary value problems, Applied
Mathematics and Computation, vol. 133, no. 2-3, pp. 287295,
2002.
[20] W.-H. Steeb and F. Wilhelm, Exponential functions of Kronecker products and trace calculation, Linear and Multilinear
Algebra, vol. 9, no. 4, pp. 345346, 1981.
[21] J. Chuai and Y. Tian, Rank equalities and inequalities for
Kronecker products of matrices with applications, Applied
Mathematics and Computation, vol. 150, no. 1, pp. 129137, 2004.
[22] R. H. Koning, H. Neudecker, and T. Wansbeek, Block Kronecker products and the vecb operator, Linear Algebra and its
Applications, vol. 149, pp. 165184, 1991.
[23] F. Ding, P. X. Liu, and J. Ding, Iterative solutions of the
generalized Sylvester matrix equations by using the hierarchical
identification principle, Applied Mathematics and Computation, vol. 197, no. 1, pp. 4150, 2008.
[24] L. Xie, Y. Liu, and H. Yang, Gradient based and least squares
based iterative algorithms for matrix equations + T =
, Applied Mathematics and Computation, vol. 217, no. 5, pp.
21912199, 2010.
[25] F. Ding and T. Chen, Gradient based iterative algorithms
for solving a class of matrix equations, IEEE Transactions on
Automatic Control, vol. 50, no. 8, pp. 12161221, 2005.
[26] J. Ding, Y. Liu, and F. Ding, Iterative solutions to matrix
equations of the form = , Computers & Mathematics
with Applications, vol. 59, no. 11, pp. 35003507, 2010.
[27] A.-G. Wu, L. Lv, and G.-R. Duan, Iterative algorithms for
solving a class of complex conjugate and transpose matrix
equations, Applied Mathematics and Computation, vol. 217, no.
21, pp. 83438353, 2011.
[28] A.-G. Wu, X. Zeng, G.-R. Duan, and W.-J. Wu, Iterative solutions to the extended Sylvester-conjugate matrix equations,
Applied Mathematics and Computation, vol. 217, no. 1, pp. 130
142, 2010.
[29] F. Zhang, Y. Li, W. Guo, and J. Zhao, Least squares solutions
with special structure to the linear matrix equation =
, Applied Mathematics and Computation, vol. 217, no. 24, pp.
1004910057, 2011.
[30] M. Dehghan and M. Hajarian, SSHI methods for solving general linear matrix equations, Engineering Computations, vol. 28,
no. 8, pp. 10281043, 2011.
[31] E. Erkmen and M. A. Bradford, Coupling of finite element
and meshfree methods be for locking-free analysis of sheardeformable beams and plates, Engineering Computations, vol.
28, no. 8, pp. 10031027, 2011.
[32] A. Kaveh and B. Alinejad, Eigensolution of Laplacian matrices
for graph partitioning and domain decomposition approximate
algebraic method, Engineering Computations, vol. 26, no. 7, pp.
828842, 2009.
[33] X. Z. Zhan, The Theory of Matrces, Higher Education Press, Beijing, China, 2008 (Chinese).
8
[34] P. Lancaster and M. Tismenetsky, The Theory of Matrices: with
Applications, Academic Press, New York, NY, USA, 1985.
[35] M. Dehghan and M. Hajarian, An iterative method for solving
the generalized coupled Sylvester matrix equations over generalized bisymmetric matrices, Applied Mathematical Modelling,
vol. 34, no. 3, pp. 639654, 2010.
[36] M. Dehghan and M. Hajarian, An efficient algorithm for solving general coupled matrix equations and its application,
Mathematical and Computer Modelling, vol. 51, no. 9-10, pp.
11181134, 2010.
[37] N. J. Higham, Accuracy and Stability of Numerical Algorithms,
Society for Industrial and Applied Mathematics, Philadelphia,
Pa, USA, 1996.
[38] F. Ding, Decomposition based fast least squares algorithm for
output error systems, Signal Processing, vol. 93, no. 5, pp. 1235
1242, 2013.
[39] F. Ding, Coupled-least-squares identification for multivariable
systems, IET Control Theory and Applications, vol. 7, no. 1, pp.
6879, 2013.
[40] F. Ding, X. G. Liu, and J. Chu, Gradient-based and leastsquares-based iterative algorithms for Hammerstein systems
using the hierarchical identification principle, IET Control
Theory and Applications, vol. 7, pp. 176184, 2013.
[41] F. Ding, Hierarchical multi-innovation stochastic gradient
algorithm for Hammerstein nonlinear system modeling,
Applied Mathematical Modelling, vol. 37, no. 4, pp. 16941704,
2013.
[42] F. Ding, Two-stage least squares based iterative estimation algorithm for CARARMA system modeling, Applied
Mathemat- Ical Modelling, vol. 37, no. 7, pp. 47984808, 2013.
[43] Y. J. Liu, Y. S. Xiao, and X. L. Zhao, Multi-innovation stochastic
gradient algorithm for multiple-input single-output systems
using the auxiliary model, Applied Mathematics and Computation, vol. 215, no. 4, pp. 14771483, 2009.
[44] Y. J. Liu, J. Sheng, and R. F. Ding, Convergence of stochastic
gradient estimation algorithm for multivariable ARX-like systems, Computers & Mathematics with Applications, vol. 59, no.
8, pp. 26152627, 2010.
[45] J. H. Li, Parameter estimation for Hammerstein CARARMA
systems based on the Newton iteration, Applied Mathematics
Letters, vol. 26, no. 1, pp. 9196, 2013.
[46] J. H. Li, R. F. Ding, and Y. Yang, Iterative parameter identification methods for nonlinear functions, Applied Mathematical
Modelling, vol. 36, no. 6, pp. 27392750, 2012.
[47] J. Ding, F. Ding, X. P. Liu, and G. Liu, Hierarchical least squares
identification for linear SISO systems with dual-rate sampleddata, IEEE Transactions on Automatic Control, vol. 56, no. 11,
pp. 26772683, 2011.
[48] J. Ding and F. Ding, Bias compensation-based parameter estimation for output error moving average systems, International
Journal of Adaptive Control and Signal Processing, vol. 25, no. 12,
pp. 11001111, 2011.
[49] J. Ding, L. L. Han, and X. M. Chen, Time series AR modeling
with missing observations based on the polynomial transformation, Mathematical and Computer Modelling, vol. 51, no. 5-6, pp.
527536, 2010.
[50] F. Ding, Y. J. Liu, and B. Bao, Gradient-based and least-squaresbased iterative estimation algorithms for multi-input multioutput systems, Proceedings of the Institution of Mechanical
Engineers I, vol. 226, no. 1, pp. 4355, 2012.
Advances in
Operations Research
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Advances in
Decision Sciences
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Mathematical Problems
in Engineering
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Journal of
Algebra
Hindawi Publishing Corporation
http://www.hindawi.com
The Scientific
World Journal
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
International Journal of
Differential Equations
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Volume 2014
Advances in
Combinatorics
Hindawi Publishing Corporation
http://www.hindawi.com
Mathematical Physics
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Journal of
Complex Analysis
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
International
Journal of
Mathematics and
Mathematical
Sciences
Journal of
Stochastic Analysis
Abstract and
Applied Analysis
International Journal of
Mathematics
Volume 2014
Volume 2014
Discrete Dynamics in
Nature and Society
Volume 2014
Volume 2014
Journal of
Journal of
Discrete Mathematics
Journal of
Volume 2014
Applied Mathematics
Journal of
Function Spaces
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Volume 2014
Volume 2014
Optimization
Hindawi Publishing Corporation
http://www.hindawi.com
Volume 2014
Volume 2014