Professional Documents
Culture Documents
Chapter 8: Orthogonality
Keywords: Dot product, norm (length) of a vector, orthogonal, orthogonal vectors, orthogonal complement,
orthogonal set, orthogonal basis, orthogonal projection onto a vector, orthogonal projection onto a subspace,
Gram-Schmidt process, orthonormal set, orthonormal basis, normalizing.
Define what it means for the set {v1 , . . . , vk } of vectors in Rn to be orthogonal. Define what it means
for the set to be an orthogonal basis for a subspace W of Rn . What is the difference between an
orthogonal basis and an orthonormal basis?
Does every subspace of Rn have an orthonormal basis? What about the zero subspace? Given a basis
for a subspace W of Rn , how do you find an orthonormal basis? Describe the Gram-Schmidt procedure.
What are the essential properties of a projection onto a subspace W of Rn . How do you calculate
projW (x) for any x Rn ? What is projW (x) if x W ? What is projW (x) if x W ?
Practice Problems
x1
1
2
n x1
o
1(a) Consider the subspace W = x2 | x2 0 = 0 of R3 . Express the vector x = 1 as the
x3
x3
1
3
sum of a vector in W and a vector in W .
(b) Let W be a subspace of Rn and let x Rn . Prove that x = projW (x) + projW (x).
1 of 4
(
2. Let =
2
1
1
1 )
1 3 1 2
, , , .
1 3 0 3
1
4
1
1
(c) Let x =
1. Find [x] - the coordinate vector of x with respect to - and show that ||x|| = ||[x] ||.
3
n
(d) Prove a more general version fo part (c): Let {v
p1 , . . . , vk } be an orthonormal set of vectors in R and
2
2
let x = x1 v1 + + xk vk . Prove that ||x|| = x1 + . . . xk .
1
1
1
1
2
1
4
3(a) Let x1 =
1, x2 = 1 , and x3 = 1 . Show that {x1 , x2 , x3 } is an orthogonal subset of R and
3
0
1
4
find a fourth vector x4 such
that
{x
,
x
1
2 , x3 , x4 } is an orthogonal basis for R . To what extent is x4
x
y
3 )
0 )
1
( 1
1 13
2 1
, , and S2 = , . Note that 1 and 2 are orthogonal subsets
2 4
1 1
4
1
1
2
(
4. Let S1 =
of R4 .
(a) Show that S1 and S2 both span the same subspace W of R4 . In other words show that W = Span(S1 )
iff W = Span(S2 ).
1
1
2 of 4
x1
x2
. Taking W = Span(S1 ), find projW (x) and a matrix A such that projW (x) = Ax.
(d) Let x =
x3
x4
x1
x2
(e) Let x =
x3 . Taking W = Span(S2 ), find projW (x) and a matrix A such that projW (x) = Ax. You
x4
should get the same matrix A as in part (d). Why?
(f ) Show that the matrix A from part (d) satisfies A2 = A. Explain this result geometrically.
5. Let x Rn and let p be the orthogonal projection of x onto W where W is a subspace of Rn . Prove
that for all y W ,
||x (p + y)||2 = ||x p||2 + ||y||2 .
It follows that p is the closest point in W to y. It may help to draw a picture and interpret the result
geometrically.
V is not a vector space. List one of the properties from the definition of vector space that fails to hold
for V . Justify your answer.
3 of 4
(b) Find a basis for R22 (the vector space of all 2 2 matrices) that contains the set S.
12. Suppose that W is a subspace of a vector space V , and let y V be a fixed vector. Show the set
S = {x V | x = y + w for some w W } is a subspace of V if and only if y W .
4 of 4