Professional Documents
Culture Documents
09 – Introduction to Tensors- 1
Topic IV: Tensors
1. What is a … tensor?
2. Basic Operations
3. Tensor Decompositions and Rank
3.1. CP Decomposition
3.2. Tensor Rank
3.3. Tucker Decomposition
Albert Einstein
in a letter to Tullio Levi-Civita
(a) Mode-1 (column) fibers: x:jk (b) Mode-2 (row) fibers: xi:k (c) Mode-3 (tube) fibers: xij:
slice of a third-order tensor, X::k , may be denoted more compactly as Xk .
Slices are two-dimensional sections of a tensor, defined by fixing all but two
indices. Figure 2.2 shows the horizontal, lateral, and frontal slides of a third-order
tensor X, denoted by Xi:: , X:j: , and X::k , respectively. Alternatively, the kth frontal
3 Insome fields, the order of the tensor is referred to as the rank of the tensor. In much of the
literature and this review, however, the term rank means something quite di↵erent; see §3.1.
(a) Horizontal slices: Xi:: (b) Lateral slices: X:j: (c) Frontal slices: X::k (or Xk )
✓ ◆✓ ◆
1 0 0 1
X=
0 1 -1 0
✓ ◆✓ ◆
1 0 0 1
X=
0 1 -1 0
✓ ◆
1 0 0 1
X(1) =
0 1 1 0
✓ ◆✓ ◆
1 0 0 1
X=
0 1 -1 0
✓ ◆
1 0 1 0
X(1) =
0 1 0 1
✓ ◆
1 0 0 1
X(2) =
0 1 1 0
✓ ◆
1 0 0 1
X(3) =
0 -1 1 0
0 1
a1,1 B a1,2 B ··· a1,m B
B a2,1 B a2,2 B ··· a2,m B C
B C
A B=B . .. .. .. C
@ .. . . . A
an,1 B an,2 B ··· an,m B
0 1
a1,1 b1 a1,2 b2 ··· a1,m bm
B a2,1 b1 a2,2 b2 ··· a2,m bm C
B C
A B=B . .. .. .. C
@ .. . . . A
an,1 b1 an,2 b2 ··· an,m bm
0 1
a1,1 b1,1 a1,2 b1,2 ··· a1,m b1,m
B a2,1 b2,1 a2,2 b2,2 ··· a2,m b2,m C
B C
A B=B .. .. .. .. C
@ . . . . A
an,1 bn,1 an,2 bn,2 ··· an,m bn,m
(A ⌦ B)(C ⌦ D) = AC ⌦ BD
† † †
(A ⌦ B) = A ⌦ B
A B C = (A B) C=A (B C)
(A B)T (A B) = AT A ⇤ BT B
† T T † T
(A B) = (A A) ⇤ (B B) (A B)
X =
a
X=a b
= b
X
a
X =a b c
c1 c2 cR
X ⇡ b1 + b2 +···+ bR
a1 a2 aR
R
X
xijk ⇡ air bjr ckr
r=1
Name Proposed by
Polyadic Form of a Tensor Hitchcock, 1927 [105]
PARAFAC (Parallel Factors) Harshman, 1970 [90]
CANDECOMP or CAND (Canonical decomposition) Carroll and Chang, 1970 [38]
Topographic Components Model Möcks, 1988 [166]
CP (CANDECOMP/PARAFAC) Kiers, 2000 [122]
R
⇤
xijk ⇧ air bjr ckr , for i = 1, . . . , I, j = 1, . . . , J, k =Kolda
1, . .&. ,Bader
K. 2009
Data Min. & Matr., SS 13 r=1 19 June 2013 09 – Introduction to Tensors- 21
Another View on the CP
• Using matricization, we can re-write the CP
decomposition
– One equation per mode
T
X(1) = A(C B)
T
X(2) = B(C A)
T
X(3) = C(B A)
T †
A = X(1) (C B)
T †
A = X(1) (C B)
T T †
A = X(1) (C B)(C C ⇤ B B)
T †
A = X(1) (C B)
T T †
A = X(1) (C B)(C C ⇤ B B)
R-by-R matrix
c1 c2 cR
X = b1 + b2 +···+ bR
a1 a2 aR
✓ ◆
1 0 1
A= ,
0 1 1
✓✓ ◆ ✓ ◆◆ ✓ ◆
1 0 0 1 1 0 1
X= , B= ,
0 1 1 0 0 1 1
✓ ◆
1 1 0
C=
1 1 1
B
X ⇡ A G
P Q
XXX R
xijk ⇡ gpqr aip bjq ckr
p=1 q=1 r=1