Professional Documents
Culture Documents
to
Applied Analysis
Definitions, Theorems and Problems
SUBRATA PAUL
FALL - 2014
1
Contents
1. Real Number System 1
2. Basic Topology 3
3. Problems on Basic Topology 5
3.1. Rudin’s Solution 5
4. Metric Space 7
5. Problems on Metric Space 11
6. Numerical Sequences and Series 46
6.1. Sequences 46
6.2. Series 47
7. Rudin’s Solution: 49
7.1. Problems from other sources 55
8. Compactness 57
8.1. Problems 58
9. Continuity 73
9.1. Completing a Metric Space with an Isometry 74
9.2. Continuous Function on Compact Sets 74
9.3. Proofs of the Theorems 76
9.4. Problems: 77
10. Differentiation of Single Variable 93
10.1. Some Problems 94
11. Sequences and Spaces of Continuous Functions 95
11.1. Space of Continuous Functions 95
11.2. Compact Subset of Continuous Function Space 95
11.3. Proof of the Theorems: 97
11.4. Problems on Sequence of Functions 98
12. Differential Calculus and Banach Space 127
13. Problems on Differentiation 130
14. List of Problems 147
14.1. Problems in Norm and Metric 147
14.2. Cauchy and Compactness 148
14.3. Compactness 150
14.4. Continuity 151
14.5. Sequence of Functions 153
14.6. Differentiation 156
1. Real Number System
Definition 1.1. Let S be a set. An order on S is a relation, denoted by <, with the
following two properties
(i) If x ∈ S and y ∈ S then one and only one of the statements
x < y, x = y, y<x
is true.
(ii) If x, y, z ∈ S, if x < y and y < z then x < z
An order set is a set S in which an order is defined.
α = sup E
The greatest lower bound, or infimum, of aset E which is bounded below is defined
in the same manner: The statement
α = inf E
means that α is a lower bound of E and that no β with β > α is a lower bound
of E.
Definition 1.4. An ordered set S is said to have the least-upper-bound property if the
following is true:
α = sup L
Theorem 1.2. There exists an ordered field R which has the least-upper-bound property.
Moreover, R contains Q as a subfield.
1
Theorem 1.3. (a) Archimedean property: If x ∈ R, y ∈ R and x > 0, then there is
a positive integer n such that
nx > y
(b) If x ∈ R, y ∈ R, and x < y, then there exists a p ∈ Q such that x < p < y
Theorem 1.4. For every real x > 0 and every integer n > 0 there is one and only one
real y such that y n = x.
2
2. Basic Topology
Definition 2.1. If there exists a 1-1 mapping of A onto B, we say that A and B can be
put in 1-1 correspondence, or that A and B have the same cardinal number, or briefly,
that A and B are equivalent, and we write A ∼ B. This relation clearly has the following
properties
• It is reflexive: A ∼ A
• It is symmetric: If A ∼ B, then B ∼ A
• It is transitive: If A ∼ B and B ∼ C, then A ∼ C.
Any relation with these properties is called an equivalent relation.
Definition 2.2. For any positive integer n let Jn be the set whose elements are integers
1, 2, . . . . . . , n; let J be the set consisting of all positive integers. For any set A, we say:
(a) A is finite if A ∼ Jn for some n (the empty set is also considered to be finite).
(b) A is infinite if A is not finite.
(c) A is uncountable if A is neither finite nor countable.
(d) A is at most countable if A is finite or countable.
Countable sets are sometimes called enumerable, or denumerable.
Definition 2.3. By a sequence, we mean a function f defined on the set J of all positive
integers. If f (n) = xn , for n ∈ J, it is customary to denote the sequence f by the symbol
{xn } or sometimes by x1 , x2 , . . . . . . The values of f , that is , the elements xn are called
the terms of the sequence. If A is a set and if xn ∈ A for all n ∈ J, then {xn } is said to
be a sequence in A, or a sequence of elements of A.
Then S is countable.
Theorem 2.3. Let A be a countable set, and let Bn be the set of all n−tuples (a1 , . . . . . . , an )
where ak ∈ A(k = 1, . . . . . . , n), and the elements a1 , . . . . . . , an need not be distinct. Then
Bn is countable.
4
3. Problems on Basic Topology
Problem 3.1. Prove that the set of all algebraic numbers is countable.
Solution.
a0 z n + a1 z n−1 + . . . · · · + an−1 z + an = 0.
Let AN be the set of all complex numbers satisfying one of the equation just listed
with
n + |a0 | + |a1 | + . . . · · · + |an | = N
which means the absolute sum of the coefficient is less than N . The set AN is finite
because each equation has only a finite set of solutions and there are only finitely many
equations satisfying this condition since for each coefficient can take only a finite different
values (< N ). Since all the set AN are finite, they are countable and therefore ∞
S
N =1 AN is
either finite or countable. Since all the rational numbers are algebraic the set of algebraic
numbers are countable.
Solution. No. If it were, the set of all real numbers, being the union of the rational and
irrational numbers, would be countable.
Problem 3.3. Construct a bounded set of real numbers with exactly three limit points.
Solution.
1 1 1
A = { } ∪ {1 + } + {2 + }
n n n
The set A is bounded. The only limit points are 0, 1, 2. 0 is a limit point because any
neighborhood of 0 contains a real number and by Archimedean property there is N such
that 1/n 6= 0 is in the neighborhood. Similarly 1 and 2 are also limit points. Now we
claim that any other point can not be a limit point. Take any point a + m1 in A where
a = 0, 1 or 2. Take r = m1 − m+11
and observe that the neighborhood Br (a + m1 ) does
not contain any point from A other than itself and hence a + m1 can not be a limit point.
Since the point was chosen arbitrarily, we can conclude that the only three limit points
of A are 0,1,2.
Problem 3.4. Let E 0 be the set of all limit points of a set E. Prove that E 0 is closed.
Prove that E and E have the same limit points. Do E and E 0 always have the same limit
points?
(b) If B = ∞
S S∞
i=1 Ai , prove that B ⊃ i=1 Ai
Show by example, that the inclusion can be proper.
Solution. (a) Fist we will show that if E, F are subsets of a metric space then
E ∪ F = E ∪ F . Assume x ∈ A ∪ B. If x ∈ A or x ∈ B then it is obvious that
x ∈ A∪B ⊂ A ∪ B. Now take x ∈ A0 \A. So B (x)∩A\{x} = 6 ∅ for any neighbor-
hood B (x). Therefore B ∩ (A ∪ B \ {x}) 6= ∅ and therefore x ∈ (A ∪ B)0 ⊂ A ∪ B.
Same argument applies if x ∈ B 0 . Therefore A ∪ B ⊂ A ∪ B.
6
4. Metric Space
d:X ×X →R
Definition 4.2. Let (X, dX ) be a metric space and Y ⊂ X. The metric subspace (Y, dY )
or (X, dX ) is defined by setting dY to be the restriction of dX to the points in Y .
Definition 4.3. If X and Y are sets then the Cartesian product X × Y is the set of
ordered pairs (x, y) with x ∈ X and y ∈ Y . If dX and dY are metrics on X and Y
respectively, then the product metric dX×Y on X × Y is defined by
Definition 4.4. A norm on a linear space X (over a scalar field F) is a function k.k :
X → R with the following properties:
(a) kxk ≥ 0 for all x ∈ X;
(b) kλxk = |λ| kxk for all x ∈ X and scalar λ ∈ F
(c) kx + yk ≤ kxk + kyk for all x, y ∈ X
(d) kxk = 0 implies x = 0
Theorem 4.1. A normed linear space (X, k.k) is a metric space (X, d) with the norm-
induced metric
d(x, y) = kx − yk
for x, y ∈ X. Moreover, the metric is translation invariant and homogeneous i.e. for any
x, y, z ∈ X, d(x + z, y + z) = d(x, y) and for any scalar λ ∈ F, d(λx, λy) = |λ| d(x, y)
Definition 4.5. A sequence (xn ) in metric space (X, d) converges to x ∈ X if for every
> 0 there is an N ∈ N such that d(xn , x) < for all n ≥ N . The sequence is Cauchy if
for every > 0 there is an N ∈ N such that d(xm , xn ) < for all m, n ≥ N
Definition 4.6. A metric space (x, d) is complete if every Cauchy sequence in X con-
verges to a limit in X. A subset Y of X is complete if the metric subspace (Y, d) is
complete. A normed linear space that is complete with respect to the norm-induced
metric is called a Banach space.
7
Definition 4.7. Let X be a normed linear space. If (xn ) is a sequence in X, then the
∞
P n
P
series converges to x ∈ X if the sequence of partial sum (sn ) given by sn = xk
n=1 k=1
converges to x.
Definition 4.8. Let A be a nonempty subset of metric space (X, d). The diameter of A
is
diamA = sup{d(x, y) : x, y ∈ A}.
The set A is bounded if its diameter is finite. The distance (x, A) of a point x ∈ X from
the set A is d(x, A) = inf{d(x, y) : y ∈ A}
Definition 4.10. A subset A of (X, T ) is a closed set if and only if its complement,
AC = X \ A, is open.
Definition 4.11. Let (X, d) be a metric space. The open ball, Br (a), of radius r > 0
and center a ∈ X is the set
Definition 4.12. A subset G of a metric space X is open if for every x ∈ G there exists
an r > 0 such that Br (x) ⊂ G. A subset F of X is closed if its complement F c = X \ F
is open.
Theorem 4.2. Let (X, d) be a metric space. The set of all open sets is a topology on X
called the metric topology.
Definition 4.15. Let (X, T ) be a topological space. All points and sets below are
elements and subsets of X.
(a) A point x is a limit point of the set A is every neighborhood of p contains a point
y 6= x such that y ∈ A.
(b) If x ∈ A and x is not a limit point of A, then x is an isolated point of A.
(c) A point x is an interior point of A if there is a neighborhood U of x such that
U ⊂ A.
(d) A is perfect if A is closed and if every point of A is a limit point of A.
Theorem 4.4. A subset F of a topological space (X, T ) is closed if and only if every
convergent sequence of elements in F converges to a limit in F . In other words, if
xn → x ∈ X and xn ∈ F for all n, then x ∈ F .
Theorem 4.5. A subset of a complete metric space is complete if and only if it is closed.
Definition 4.23. A Hamel basis (or algebraic basis ) B of a linear space X is maximal
linearly independent set of vectors such that every x ∈ X can be written uniquely as a
finite linear combinition of vectors from B.
9
Definition 4.24. Let X be a separable Banach space. A sequence (xn ) is a Schauder
basis of X is for every x ∈ X there exists a unique sequence of scalars (cn ) such that
∞
P
x= cn x n .
n=1
10
5. Problems on Metric Space
Problem 5.1. Show that d(x, y) = kx − yk is a metric on Rn where k·k is the standard
Euclidean norm on Rn .
11
Problem 5.2. Determine which of the following define metrics on R.
(a) d1 (x, y) = (x − y)2 ,
p
(b) d2 (x, y) = |x − y|,
(c) d3 (x, y) = |x2 − y 2 |,
(d) d4 (x, y) = |x − 2y|,
(e) d5 (x, y) = |x − y| /[1 + |x − y|].
d1 (x, y) = (5 + 5)2 = 25 and , d1 (x, z) = d1 (y, z) = 25, and d1 (x, y) d1 (x, z) + d1 (y, z)
p p
Commutativity is trivial because d2 (x, y) = |x − y| = |y − x| = d2 (y, x)
The triangle inequality comes from the triangle inequality of the absolute value
function,
|x − y| ≤ |x − z| + |y − z|
p p
⇒ |x − y| ≤ |x − z| + |y − z| + 2 |x − z| |y − z|
p p p 2
⇒ |x − y| ≤ |x − z| + |y − z|
12
Problem 5.3. For f, g : [0, 1] → R, let d1 (f, g) = supx∈[0,1] {x2 |f (x) − g(x)|}, d2 (f, g) =
R1
supx∈[0,1] |f (x) − g(x)|, and d3 (f, g) = 0 |f (x) − g(x)| dx. Prove that d1 , d2 , and d3 de-
fine metrics on the linear space of C([0, 1]) of continuous functions f : [0, 1] → R.
Let h(x) = |f (x) − g(x)| and so, h(x) ≥ 0 for all x ∈ [0, 1]. If d3 (f, g) ≥ 0 then
R1
0
h(x)dc = 0. If h(x) 6= 0 for at least one point by the continuity of h in [0, 1] and the
R1
property of Riemann Integral 0 h(x)dc > 0 and hence h(x) = 0 for all x ∈ [0, 1] which
implies f = g.
Commutativity is obvious because of commutativity of real numbers with usual metric.
Let h ∈ C([0, 1]). By the triangle inequality of real numbers under usual metric we know,
for all x ∈ [0, 1]
|f (x) − g(x)| ≤ |f (x) − h(x)| + |h(x) − g(x)| .
13
Therefore,
Z 1 Z 1 Z 1
|f (x) − g(x)| dx ≤ |f (x) − h(x)| dx + |h(x) − g(x)| dx.
0 0 0
14
Problem 5.4. Show that Rn with d(x, y) = kx − yk∞ is a metric space, where kxk∞ =
supxi |xi | for i = 1, 2, . . . , n.
Solution. Since |xi | ≥ 0 the supremum is also greater than or equal to 0 and hence
d(x, y) ≥ 0.
If d(x, y) = 0 then sup i = 1, . . . n |xi − yi | = 0. Since |xi − yi | ≥ 0 for all i = 1, 2, . . . . . . n
we have xi − yi = 0 and so xi = yi for all i. Therefore x = y. |xi − yi | = |yi − xi | implies
d(x, y) = d(y, x)
≥ |xi − zi | + |zi − yi | , ∀i = 1, 2, . . . . . . n
≥ |xi − yi | , ∀i = 1, 2, . . . . . . n
So, a is upper bound of |xi − gi | and hence supi |xi − yi | ≤ a. Therefore,
for some z ∈ Rn .
15
Problem 5.5. Consider the convergence of sequences (xn ) = (ξn,1 , ξn,2 , ξn,3 , · · · ) to a
point y = (η1 , η2 , η3 , · · · ) in `2 . Show that if xn → y, then ξn,i → ηi for i = 1, 2, 3, · · · .
But, construct an example that shows that ξn,i → ηi for i = 1, 2, 3, · · · does not imply
that xn → y. (This is similar to the idea of pointwise convergence not guaranteeing
metric-convergence for sequences of functions.) Consider the Hilbert Cube subspace of
`2 defined by,
Solution. Solution to 1(a) Let > 0 be given. Since xn → y, there exists N ∈ N such
that d(xn , y) ≤ for all n ≥ N .
d(xn , y) ≤
v
u∞
uX
⇒t |ξn,i − ηi |2 ≤
i=1
∞
X
⇒ |ξn,i − ηi |2 ≤ 2
i=1
⇒ |ξn,i − ηi |2 ≤ 2 , ∀i = 1, 2, 3, . . . . . .
⇒ |ξn,i − ηi | ≤ ∀i = 1, 2, 3, . . . . . .
From above we conclude that, for any given > 0 there is N such that |ξn,i − ηi | ≤
whenever n > N for all i = 1, 2, 3, . . . . . . and hence ξn,i → ηi for i = 1, 2, 3, . . . . . .
Solution to 1(b) Consider the sequence (xn ) such that
1 if n = i
ξn,i =
0 if n 6= i
Fix an i, then ξn,i → 0 because for any , |ξn,i − 0| = 0 < for all n > i. But d(xn , 0) = 1
for all n and hence xn does not converge to 0.
Solution to 1(c) Since Hilbert space is also an `2 space by the proof in 1(a) we know
if xn → y then ξn,i → ηi for all i = 1, 2, 3, . . . . . . .
Lemma 1. If s = ∞
P
P∞ i=1 xi converges then for given > 0 there exists an M such that
i=M +1 xi < .
Proof: The sum convergence if the sequence of partial sum sn = ni=1 xi converges to
P
s that is for given > 0 there is M such that |s − sn | < for all n ≥ M . We take
|s − sM | < which implies ∞
P
i=M +1 si <
16
Now assume that ξn,i → ηi for i = 1, 2, 3, . . . . . . . We have to show that xn → y that is
for given > 0 there exists an N such that d(xn , y) < whenever n ≥ N .
Since |ξn,i | ≤ 1i and ξn,i → ηi by the result from elementary analysis we have |ηi | ≤ 1i .
P∞ 2 P∞ 1 P∞ 2 π2
Observe that j=1 |ηj | ≤ j=1 i2 and by comparison j=1 |ηj | ≤ 6
and hence
y ∈ `2 . Since y ∈ `2 and |ηi | ≤ 1i , y ∈ H.
So, |ξn,i − ηi | ≤ |ξn,i | + |ηi | = 2 1i .
∞
X
2
d(xn , y) = |ξn,i − ηi |2
i=1
P∞
converges by comparison because |ξn,i − ηi |2 ≤ 4
i2
and 4 1
i=1 i2 converges.
P∞ 2
Let > 0 be given. By Lemma 1 there exists an M such that i=M +1 |ξn,i − ηi |2 < 2
.
Hence,
2 2
d(xn , y)2 < + = 2
2 2
which implies d(xn , y) < .
17
Problem 5.6. Let p ≥ 1 be a fixed real number. The real space `p is defined such that
x ∈ `p is a sequence of real numbers x = (ξj ) = (ξ1 , ξ2 , ξ3 , · · · ) such that ∞ p
P
j=1 |ξj | < ∞.
For x, y ∈ `p , where x = (ξj ) and y = (ηj ), let d(x, y) be defined by
∞
!1/p
X
d(x, y) = |ξj − ηj |p .
j=1
P 1/p
∞ p
Show that `p with d defined above is a metric space. (Hint: If j=1 |ξj − ηj | is
finite, then d is a map to R and properties (a) and (b) are clearly satisfied. To show this is
finite, use Minkowski’s inequality, which is also useful in proving the triangle inequality.
You do not need to prove Minkowski’s inequality.)
P∞ p P∞ p
Solution. Since y = (ηi ) ∈ `p , j=1 |ηj | < ∞ and hence j=1 |−ηj | < ∞. Also
x = (ξj ) ∈ `p implies ∞ p
P
j=1 |ξj | < ∞. By Minkowski inequality we get,
∞
!1/p ∞
!1/p ∞
!1/p ∞
!1/p
X p
X p
X p
X p
d(x, y) = |ξj − (−ηj )| = |ξj + ηj | ≤ |ξj | + |ηj | <∞
j=1 j=1 j=1 j=1
P 1/p
∞ p
d(x, y) = 0 implies |ξ
j=1 j − η j | = 0 ⇒ |ξj − ηj | = 0 for all j and hence ξj = ηj
for all j. Therefore x = y.
Commutativity of d follows from commutativity of real numbers under usual metric. Now
we will prove the triangle inequality. To do that let z = (ζj ) ∈ `p
∞
!1/p
X
d(x, y) = |ξj − ηj |p
j=1
∞
!1/p
X
= |ξj − ζj + ζj − ηj |p
j=1
∞
!1/p
X
≤ ||ξj − ζj | + |ζj − ηj ||p
j=1
∞
!1/p ∞
!1/p
X p
X p
≤ |ξj − ζj | + |ζj − ηj |
j=1 j=1
=d(x, z) + d(z, y)
Another way to show this is to prove that
∞
!1/p
X
kxk = |ξj |p
j=1
18
Theorem 1: A normed linear space (X, k.k) is a metric space (X, d) with the norm-induced
metric d(x, y) = kx − yk for x, y ∈ X. Moreover, the metric is translation invariant and
homogeneous, i.e. for any x, y, z ∈ X, d(x + z, y + z) = d(x, y) and for any scalar λ ∈ F,
d(λx, λy) = |λ| d(x, y).
19
Problem 5.7. Let `∞ be the space defined by real-valued bounded sequences, i.e., x ∈ `∞
implies x = (ξi ) = (ξ1 , ξ2 , · · · ) such that |ζi | ≤ cx for all j ∈ N where cx ≥ 0 is some real
number that may depend on x but not on j. For x, y ∈ `∞ , where x = (ξi ) and y = (ηi ),
show that
d(x, y) = sup |ξj − ηj |
j∈N
∞
defines a metric on ` .
20
Problem 5.8. Clearly `1 ⊂ `∞ . Is `1 dense in `∞ ? Is `1 closed in `∞ ? Justify your
answers.
21
Problem 5.9. Prove that if a subsequence of a Cauchy sequence in a metric space
converges, then the full sequence converges to the same limit.
Solution. Consider the Cauchy sequence (xn ) in the metric space (X, d). By definition
there exists an N1 ∈ N such that d(xn , xm ) < 2 for all n, m > N1 . Now suppose the
subsequence (xnk ) of (xn ) converges to x ∈ X and hence for the given there exists an
N2 ∈ N such that for all nk > N2 , d(xnk , x) < 2 . Therefore,
for all n ≥ N = max(N1 , N2 ). Hence the sequence (xn ) converges to the same limit of
the subsequence.
22
Problem 5.10. Let (xn ) and (yn ) be Cauchy sequences in a metric space (X, d). Show
that (d(xn , yn )) converges whether or not (xn ) and (yn ) converge.
Solution. Let > 0 be given, Since (xn ) is a Cauchy sequence, there exists an N1 ∈ N
such that d(xn , xm ) < 2 for all m, n > N1 .
Since (yn ) is a Cauchy sequence, there exists an N2 ∈ N such that d(yn , ym ) < 2 for all
n, m > N2 .
and hence
|d(xn , yn ) − d(xm , ym )| <
for all n, m > N = max(N1 , N2 ) Which implies that d(xn , yn ) is a Cauchy sequence in R
and hence is convergent.
23
Problem 5.11. Let (X1 , d1 ) and (X2 , d2 ) be two complete metric spaces. Is the product
metric space X1 × X2 complete?
Solution. Take a Cauchy sequence ((xn , yn )) in X × Y . For given > 0 there exists an
M such that n, m ≥ M implies
24
Problem 5.12. Prove that a metric space X is complete if and only if the intersection
of every descending sequence of closed balls whose radii approach zero consists of a single
point.
Solution. Let (Bn ) be a descending sequence of closed balls and xn be the center of Bn
for all n ∈ N. Since diam(Bn ) → 0, for given > 0 there exists N such that diam(Bn ) <
for all n ≥ N . For m > n > N , Bm ⊂ Bn and so xm ∈ Bn and hence d(xn , xm ) ≤ .
So, (xn ) is a Cauchy sequence and hence converges to x ∈ X (say) since the space X is
complete.
Now we want to show that x ∈ Bn for all n. If not consider there is an m for which x ∈/ Bm .
Since we are considering a nested sequence of closed balls, xi ∈ Bm , ∀i ≥ m. So the
subsequence (xi , i ≥ m) is contained in Bm . A subsequence of a convergent sequence
converges and since the subsequence is entirely contained in Bm and Bm is closed set, by
definition, the subsequence has to converge to a point in Bm which contradicts the fact
that subsequence of a convergence sequence converges to the same limit point. Hence
x ∈ Bn for all n and therefore x ∈ ∞
T
n=1 Bn .
Suppose there is another point y 6= x in ∞
T
n=1 Bn . But by the definition of descending
sequence of closed balls limn→∞ diam(Bn ) → 0. If x 6= y, d(x, y) > 0 say β = d(x, y) and
hence diam ( ∞
T
n=1 ) ≥ β which contradicts the definition of descending sequence of closed
balls.
Now we consider that intersection of every descending sequence of closed balls whose
radii approach zero consists of a single point and want to prove that X is complete.
Since (xn ) is Cauchy there exists an N1 such that for all m, n1 ≥ N1 , d(xn1 , xm ) < 21 .
Consider a closed ball B1 = B(xn1 , 1) = {y ∈ X : d(y, xn1 ) ≤ 1}. So, xm ∈ B1 for all
m ≥ n1 .
Now take = 41 . So ∃N∗ such that d(xn2 , xm ) < 14 for all m > n2 ≥ N∗ . Take N2 =
max(N1 , N∗ ) and that gives, d(xn1 , xn2 ) < 12 and d(xn2 , xm ) < 41 for all m ≥ N2 . Construct
a closed ball B2 = B(xn2 , 12 ). We claim that B2 ⊂ B1 . Take any point xk ∈ B2 and observe
that,
1 1
d(xn1 , xk ) ≤ d(xn1 , xn2 ) + d(xn2 , xk ) ≤ + < 1
2 4
which implies xk ∈ B1 and hence B2 ⊂ B1 .
By induction we can contract such a sequence of closed balls. Suppose d(xnk , xm ) < 21k
1
for all m > nk ≥ Nk and consider the closed ball Bk = B xnk , 2k−1 and so xm ∈ Bk for
25
all m > Nk . Again since (xn ) is Cauchy there is N∗ so that ∀m > nk+1 ≥ N∗ we have
1
. Take Nk+1 = max(Nk , N∗ ) to assert both d xnk , xnk+1 < 21k and
d(xnk+1 , xm ) < 2k+1
1
d(xnk+1 , xm ) < nk+1 for all m > Nk+1 . Now construct the closed ball Bk+1 = B(xnk+1 , 21k ).
We claim that Bk+1 ⊂ Bk and it is direct consequence of the triangle inequality.
Therefore we have a descending sequence of closed balls Bk whose radii 21k approaches
zero and by the hypothesis the intersection of all the closed balls consists of a single point,
say (x ∈ X). We want to show now that x is the limit point of the subsequence (xnk ).
Since x ∈ Bk for all k and xnk is the center of Bk we can write d(xnk , x) < 21k . By
comparison d(xnk , x) → 0 as k → ∞ and hence xnk converges to x. From elementary
analysis we know if a subsequence of a Cauchy sequence converges then the sequence
itself converges to the same point (Proof as lemma is given bellow)
Since (xn ) is chosen to be arbitrary Cauchy sequence we can assert that any Cauchy
sequence in X converges and hence X is complete.
Proof: Let (xn ) is a Cauchy sequence in the metric space (X, d) and (xnk ) is a subsequence
that converges to x ∈ X. Let > 0 be given. Since the sequence is Cauchy, there exists
an N1 such that d(xn , xm ) < 2 for all m, n ≥ N1 . Also since the subsequence converges
to x, there is K such that d(xnk , x) ≤ 2 for all k ≥ K. Let N = max(N1 , K). By triangle
inequality,
d(xn , x) ≤ d(xn , xnk ) + d(xnk , x) <
since nk ≥ k > N . Therefore (xn ) converges to x.
26
Problem 5.13. For f, g : [0, 1] → R, let d1 (f, g) = supx∈[0,1] {x2 |f (x) − g(x)|}, d2 (f, g) =
R1
supx∈[0,1] |f (x) − g(x)|, and d3 (f, g) = 0 |f (x) − g(x)| dx. Prove that (C([0, 1]), d1 ) is
not complete but (C([0, 1], d2 ) is complete (this requires recalling some useful results from
elementary analysis that we will revisit in more generality in lecture 4). Since these
metrics can be defined by norms, one choice of norm produces a Banach space, while the
other does not (this happens on infinite dimensional spaces where norms are not always
equivalent). If we use d3 is the resulting metric space complete?
Solution. (1) To show that (C([0, 1]), d1 ) is not complete we have to show that there
is a Cauchy sequence that does not converge in C([0, 1]).
Consider the sequence of (fn ) continuous functions
fn = (1 − x)n
Then,
d(fn , fm ) = sup {x2 |(1 − x)n − (1 − x)m |} = sup {x2 |(1 − x)n |} = sup {x2 (1 − x)n }
x∈[0,1] x∈[0,1] x∈[0,1]
sup = sup |fn (x) − f (x)| = lim |fn (x) − fm (x)| ≤ lim inf sup |fn (x) − fm (x)| .
x∈[0,1] x∈[0,1] m→∞ m→∞ x∈[0,1]
28
Problem 5.14. Prove that a discrete metric space X is separable if and only if X is
countable. (A discrete metric space is any set X with the discrete metric d(x, y) = 0 if
x = y and d(x, y) = 1 if x 6= y.)
29
Problem 5.15. Prove that `∞ is not separable, but `p with 1 ≤ p < +∞ is separable.
Prove that `p with 1 ≤ p ≤ +∞ is complete.
Solution. (1) Let y = (ηj ) be a sequence of 0’s and 1’s. Then y ∈ `∞ . With y we
associate the real number ŷ with the decimal expansion of 0’s and 1’s given by
ŷ = 0.η1 η2 η3 . . . . . . . By the previous problem, there are an uncountable number
of such y ∈ `∞ . Furthermore, the metric on `∞ restricted the subset of such y is
the discrete metric, so by one of the examples from class `∞ cannot be separable.
(2) Let A denote the set of all sequences of the form y = (η1 , η2 , . . . . . . , ηn , 0, 0, . . . . . . )
where ηi ∈ Q for each i. By the proposition that Cartesian product of countable
sets is countable we have that A is countable. We want to show that A is dense
in `p . Suppose x = (ξi ) be as sequence in `p . Therefore ∞ p
P
i=1 |ξi | is finite. A
series converges if the sequence of the partial sum sn = nj=1 |ξj |p converges to
P
Therefore for any given , any ball B (x) contains a point y of A and hence A is
dense in `p .
We conclude that `p is separable.
(3) We consider two cases. First we will prove completeness of `p for 1 ≤ p < ∞ and
then we will prove for `∞ .
Which implies,
∞
X
(5.1) |ξn,i − ξm,i |p < p
i=1
Since the sum is finite and true for all m, n ≥ N we can take the limit m → ∞
to get,
k
X
(5.2) |ξn,i − ηi |p < p
i=1
Since the above inequality is true for every k we can take k → ∞ and that
P∞ p p
implies the sequence i=1 |ξn,i − ηi | < ∞ and hence xn − y ∈ ` . Writing
y = (y − xn ) + xn and using Minkowski’s inequality we can write
∞
X
|ηi |p < ∞
i=1
p
and hence y ∈ ` .
Now we want to prove that xn → y. To show that we use the equation (5.2).
∞
!1/p
X
d(xn , y) = |ξn,i − ηi |p <
i=1
Now we will prove `∞ is complete. Let (xn ) be any Cauchy sequence in `∞ where
xn = (ξn,j ). Consider any > 0. There exists N such that n, m > N implies
Thus, for each fixed j ∈ N, and n, m > N , |ξm,j − ξn,j | < , so for fixed j, (ξn,j )
is a Cauchy sequence of real numbers. By the completeness of R, these sequences
converge for each j. Let (ξj ) denote the sequence x defined by the term-wise limit
of each of these Cauchy sequences of real numbers. We show that x ∈ `∞ and
xn → x. For each j, we have the following inequalities
There exists an N such that for n, m > N we have |xij − ξm,j | < 2 and |ξj − ξn,j | <
2
, so |ξj | − |ξn,j | ≤ . Fix any n > N , and observe that xn ∈ `∞ implies there
exists real number cn such that |ξn,j | < cn for each j, so
|ξj | ≤ + cn .
The bound does not depend on j, so x = (ξj ) ∈ `∞ . We also have that d(x, xn ) <
for n > N from the previous inequality since does not depend on j, which shows
xn → x. Since (xn ) was an arbitrary Cauchy sequence, `∞ is complete.
31
Problem 5.16. Let E 0 be the set of all limit points of a set E ⊂ X where (X, d) is a
metric space. Prove that E 0 is closed. Prove that E and Ē have the same limit points.
Do E and E 0 always have the same limit points?
Solution. (1) If the set of limit point of E 0 is empty then we have nothing to prove.
Let x be a limit point of E 0 . For any given > 0 the open ball B (x) contains a
point y 6= x of E 0 . So y is a limit point of E. d(x, y) < and so − d(x, y) > 0.
The ball centered at y and radius − d(x, y) contains a point z ∈ E and so
d(y, z) < − d(x, y). So,
Which implies that for any > 0 the open ball B (x) contains a point of E and
hence x is a limit point of E. Therefore we conclude that x ∈ E 0 and hence E 0 is
closed.
(2) Suppose x is a limit point of E. Then there is a sequence (xn ) ⊂ E such that
xn → x. Since E ⊂ E we have (xn ) ⊂ E and together with the fact that xn → x
in E we conclude that x is a limit point of E.
Now assume x is a limit point of E. For any given > 0 the open ball B (x)
contains a point of y ∈ E. If y ∈ E then we have nothing to prove if not then
y ∈ E 0 . Similarly above we can show that there is a point zıE such that d(x, z) <
and hence B (x) contains a point of E other than itself. Hence x is a limit point
of E. Therefore we conclude that E and E have the same limit points.
(3) NO! Consider X = R with usual metric and E = 1, 21 , . . . . . . n1 . . . then E 0 = {0}.
The limit only limit point of E is 0 and E 0 does not have any limit point.
32
Problem 5.17. Let A1 , A2 , A3 , . . . be subsets of a metric space.
(a) If Bn = ∪ni=1 Ai , prove that B̄n = ∪ni=1 Āi for n = 1, 2, 3, . . ..
(b) If B = ∪∞ ∞
i=1 Ai , prove that ∪i=1 Āi ⊂ B̄. Show, by an example, that this inclusion can
be proper.
Solution.
33
Problem 5.18. Is every point of every open set E ⊂ R2 a limit point of E? Answer the
same question for closed sets in R2 .
Solution: Every point of an open set is a limit point of E because for each x ∈ E and
there exists r > 0 such that Br (x) ⊂ E and each of these balls contains an infinite number
of points on E ∩ R2 .
It is not true for closed set. Consider the singleton set E = {(0, 0)}. It does not have
any limit point that is E 0 = ∅ and clearly E 6= ∅
34
Problem 5.19. Let E o denote the set of all interior points of a set E.
(a) Prove that E o is always open.
(b) Prove that E is open if and only if E o = E.
(c) If G ⊂ E and G is open, prove that G ⊂ E o .
(d) Prove that the complement of E o is the closure of the complement of E.
(e) Do E and Ē always have the same interiors?
35
Problem 5.20. Show that Rk is separable.
Solution. We want to show that there is a countable dense subset of Rk . Consider the
subset Qk .
Claim1: Qk is countable.
Since finite Cartesian product of countable subset is countable we immediately have Qk
is countable.
Claim 2: Qk is dense in Rk .
Let x ∈ Rk be any point of the form x = (x1 , x2 , . . . . . . , xk ). We want to show that every
ball centered at x contains a point of Qk . For any > 0 consider the ball B (x). Since Q
2 2 2
is dense in ≈x≈ there is a rational number ξj in (xi − k , xi + k ) and so |xi − ξi | < k
for all 1 ≤ i ≤ k. Let y = (ξ1 , ξ2 , . . . . . . , ξk ) ∈ Qk . Then,
v
u k r
uX 2
d(x, y) = t (xi − ξi )2 ≤ k = .
i=1
k
This implies there any ball around x contains a point of Qk and hence Qk is dense in
Rk
36
Problem 5.21. Prove that every separable metric space has a countable base.
Solution. Let A = {xi }∞ i=1 denote a countable dense subset of X. For each n ∈ N and
r ∈ Q+ let Vn,r = Br (xn ). Note that {Vn,r } is countable.
Consider any nonempty open set G ⊂ X. For each x ∈ G, there exists x > 0 such
that Bx ⊂ G. The open ball B 2x (x) contains a point xm for some m, and there exists
r ∈ Q+ such that r < 2x implying Br (xm ) ⊂ Bx ⊂ G. Thus, G can be written as the
union of balls of rational radii centered at the points of a countable dense subset. This
implies {Vn,r } is a countable base for the metric-topology.
Problem 13.5 A metric space (X, d) is separable if and only if it is second countable.
Solution: Since a metric space is also a topological space, the above shows that separa-
ble implies second countable. Now we will prove that if X is second countable then it is
separable.
Since X is second countable, by definition, the metric topology has a countable base
S
B = Gα with Gα 6= ∅. Now form a subset E taking one element from each Gα . So E is
countable. Let x ∈ X be any point and for any > 0, B be a neighborhood of x. Since
B (x) is open, by the definition of countable base there is a collection aα ⊂ B such that
S
B (x) = α Gα . Therefore B (x) contains a point of E and hence E is a countable dense
subset of X and therefore X is separable.
37
Problem 5.22. Prove that any uncountable set with the discrete metric is not second
countable.
Solution. Let (X, d) be an uncountable metric space with the discrete metric. Every
point of X is also an open set, so every point is a neighborhood. So the metric topology
is uncountable and hence does not have a countable base implying that it is not second
countable.
38
Problem 5.23. Show that a Schauder basis (fn )∞
n=0 of C([0, 1]) may be constructed from
”tent” functions.
39
Problem 5.24. Let E be the set of all x ∈ [0, 1] whose decimal expansion contains only
the digits 4 and 7. Is E countable? Is E dense in [0, 1]? Is E compact? Is E perfect?
that the element of Br (x) is not an element of E. Therefore x is not a limit point
of E. Therefore E contains all of its limit points and is closed.
Since E ⊂ [0, 1], it is bounded. By Heine-Borel theorem E is compact.
(4) E is not perfect:
The answer to this question kinda depends on how one interpret E. If it is allowed
to have points like 0.4 = 0.4000000 . . . which can be written with or without 0’s
then E is not perfect because 0.4 is not a limit point because B0.1 (0.4) does not
contain any points of E except for 0.4 because every point in (0.39, 0.41) either
has a 3 as its first digit or has a 0 as its second digit and has non-zero digits
following that 0 if it is not exactly 0.4. Therefore E is not perfect.
On the other hand, if you interpret this question such that 0.4000 . . . is not in-
cluded in E and the only elements in E are infinite expansions where all of the
infinite decimal places are either 4 or 7 then every point in E is a limit point
because:
For every > 0 there exists an N such that 101N < . Then for a given x ∈ E we
want to find a y ∈ E such that y ∈ B (x) and y 6= x. We construct such a y by
letting its first N digits be the same in x. Then let the N + 1st digit be different
from x(if x has a 4 then y has a 7 and vice versa) and let all the other digits be
40
same. Then
3 1
|x − y| = < <
10N +1 10N
so y ∈ B (x) so since was arbitrary, x is a limit point of E. So this proves that
all the points of E which are infinite sequence of 4’s and 7’s are limit points of E
so if this is all of E then E is perfect.
41
Problem 5.25. Below, A and B are sets in metric space (X, d).
(a) If A and B are disjoint closed sets prove that they are separated.
(b) Fix p ∈ X, δ > 0, define A = {q ∈ X : d(p, q) < δ} and B = {q ∈ X : d(p, q) > δ}.
Prove that A and B are separated.
(c) Prove that every connected space with at least two points is uncountable.
Solution. (1) Since A and B are closed, A = A and B = B. Also given that
A ∩ B = ∅. So, A ∩ B = A ∩ B = ∅ and A ∩ B = A ∩ B = ∅. Hence A and B are
separated.
(2) Note that A and B are disjoint open sets. Let E = B c = X \ B. Since E is closed
and A ⊂ E, by the definition that closure is the smallest closed subset containing
the set we have A ⊂ E. Since E ∩ B = ∅ we have A ∩ B = ∅. Similarly we can
show that A ∩ B = ∅. Therefore, A and B are separated.
(3) Consider x, y ∈ X with x 6= y, and d(x, y) > 0. For δ ∈ (0, α), since X is
connected there exists z ∈ X such that d(x, z) = δ or else X is separated by (a)
and (b) with point p = x or y. Thus there exists some subset of X that can be put
with one -one correspondent with [0, α] ⊂ R. Which implies X is uncountable.
42
Problem 5.26. Let A and B be separated subsets in Rn , suppose a ∈ A and b ∈ B and
define p(t) = (1 − t)a + tb for t ∈ R. Put A0 = p−1 (A) and B0 = p−1 (B) (thus t ∈ A0 if
and only if p(t) ∈ A).
(1) Prove that A0 and B0 are separated subsets of R.
(2) Prove that there exists t0 ∈ (0, 1) such that p(t0 ) ∈
/ A ∪ B.
(3) Prove that every convex subset of Rk is connected.
Solution. 6 ∅ because 0 ∈ A0
(1) We prove by contradiction. First observe that A0 =
as a ∈ A and also 1 ∈ B0 for b ∈ B implies B0 6= ∅. Assume that A0 and B0 are
not separated then one of the followings is true
A0 ∩ B0 6= ∅
A0 ∩ B0 6= ∅
A0 ∩ B0 6= ∅
First we take that A0 ∩ B0 6= ∅. Let t0 ∈ A0 ∩ B0 which implies t0 ∈ A0 and
t0 ∈ B0 . By the definition of the given function t0 ∈ A0 ⇒ p(t0 ) ∈ A and
t0 ∈ B0 ⇒ p(t0 ) ∈ B. So A ∩ B 6= ∅ which contradicts the fact that A and B are
separated. So, we can draw a conclusion that A0 and B0 are disjoint.
44
Problem 5.27. Give an example of matrix space that is separable but not second count-
able.
Solution. The space R` defined by the topology to be the collection of set of the form
[a, b). R` is first countable because for any element x ∈ R consider the basis [x, n1 ) which
is countable. Also the set of rational number is dense in R` which is countable and hence
R` is separable. But we will show that R` is not second countable.
Let B be a basis for R` . Choose for each x, an element Bx ∈ B such that x ∈ Bx ⊂
[x, x + 1). If x 6= y, then Bx 6= By , since x = inf Bx and y = inf By . Therefore, B must
be uncountable.
Problem 5.28. Any open set in R can be written as countable union of open intervals.
Solution. Suppose O be an open subset of real numbers. For each rational number r,
define the interval Ir to be the largest open interval containing r that is a subset of O (it is
possible of course that if r is not in O then Ir is empty, so in this case we simply ignore this
r). More particularly, if we define ar = inf{x : [x, r] ⊆ O} and br = sup{x : [r, x] ⊆ O},
then Ir = (ar , br ). Since the rationals are a countable set, the collection {Ir : r ∈ Q} is a
countable collection of intervals.
Of course they need not be disjoint. However it is true that if s is rational and x ∈ Ir
then Is = Ir . This follows by noting that since Is is the largest open interval containing
s that is a subset of O, and since s ∈ Ir , an open interval that is a subset of O, Ir ⊂ Is .
Since then we have that r ∈ Is the same argument shows that Is ⊆ Ir . It is also true that
if s and r are rational and s ∈ / Ir then Is ∩ Ir = ∅. To see this suppose that x ∈ Is ∩ Ir .
Since Is and Ir are both open intervals, so is Ir ∪ Is . Since Ir is the largest open interval
containing r and a subset of O, Ir ∪ Is ⊆ Ir . But this implies that s ∈ Ir contradicting
our hypothesis. Therefore, we conclude that Is ∩ Ir = ∅. Together, this implies that given
two intervals Is and Ir that they are either disjoint or identical.
By removing duplicates in {Ir : r ∈ A}, we arrive at a sequence of disjoint intervals
S∞ S∞
{Ik }∞
S
k=1 such that r∈Q Ir = k=1 Ik . It remains only to show that O = k=1 Ik . Since
S∞
by construction, each Ik ⊆ O, k=1 Ik ⊆ O. Now let x ∈ O. Since O is open there is a
natural number n such that (x − n1 , 1 + n1 ) ⊆ O. By the density or the rationals in the
reals, there is a rational number r ∈ (x− n1 , x+ n1 ), and so by construction the largest open
interval containing r that is a subset of O will have to include the interval (x − n1 , x + n1 ).
Hence x ∈ Ir for this r, and so x ∈ ∞
S S∞
k=1 Ik , and we conclude that O = k=1 Ik .
45
6. Numerical Sequences and Series
6.1. Sequences
(1) Suppose {an } and {bn } are sequences of real numbers such that an ≤ bn for all
n ≥ N and some V ∈ N. If an → a and bn → b then a ≤ b
(2) Let {an } be a sequence such that an → a. If a > 0, then an > 0 for all n > N
and some N ∈ N
(3) Suppose an ≤ bn ≤ cn ∀n ≥ N and some n ∈ N. If an → l and cn → l then
bn → l
Theorem 6.1. Let {sn } and {tn } be two sequences of complex number such that sn → s
and tn → t for some complex number s and t. Let z be any complex number. Then,
(1) sn + tn → s + t
(2) zsn → zs
(3) sn tn → st
(4) s1n → 1s
Theorem 6.2. Let {xn } be a monotonic sequence. {xn } is convergent if and only if it is
bounded.
Theorem 6.3. Let {xn } be a sequence of real numbers. Let E be the set of all y in R
such that y is a limit of a subsequence of {xn }. Then,
Theorem 6.5. If {xn } and {yn } are sequences in R such that xn ≤ yn for all n ≥ N
and some N ∈ N, then,
46
(1) lim sup xn ≤ lim inf yn
(2) lim inf xn ≤ lim inf yn
6.2. Series
Definition 6.3. Let {an } be a sequence of complex numbers. The formal sum a1 + a2 +
a3 + . . . · · · + an + . . . . . . which can be written as ∞
P
k=1 ak is called an infinite series or
simply a series.
With the above infinite series we associate another sequence called the sequence of
partial sums of the series denoted by {sn } and defined by sn = nk=1 .
P
Note that this theorem doesn’t day if an → 0 then the sum converges rather the contra-
positive is true that is if an doesn’t tends to zero then the sum doesn’t converge.
Theorem 6.9. A series of non negative terms converges if and only if its sequence of
partial sums is bounded.
Theorem 6.10 (Comperison Test). (1) Let |an | < cn , ∀n ≥ N0 , where N0 is some
P P
fixed integer, and if cn converges, then an converges.
P P
(2) Let an ≥ dn ≥ 0, ∀n ≥ N0 , and, if dn diverges, then an diverges.
Theorem 6.12 (Cauchy Condensation Test). Suppose {an } is a non increasing sequence
of nonnegative terms then ∞ n
P
n=1 an converges if and only if 2 a2n converges.
P 1
Theorem 6.13. np
converges if p > 1 and diverges if p ≤ 1
47
Theorem 6.14. If P > 1,
∞
X 1
n=2
n (log n)p
converges; if p ≤ 1, the series diverges.
P √
Theorem 6.15 (Root Test). Given an , put α = lim sup n an . Then
n→∞
P
(a) if α < 1, an converges;
P
(b) if α > 1, an diverges;
(c) if α = 1, the test gives no information.
P
Theorem 6.16 (Ratio Test). The series an
an+1
(a) converges if lim sup an < 1,
n→∞
(b) diverges if an+1 ≥ 1 for n ≥ n0 , where n0 is some fixed integer.
an
is called a power series. The numbers cn are called the coefficients of the series; z is a
complex number.
cn z n , put
P
Theorem 6.17 (Radius of convergence). Given the power series
p 1
α = lim sup n |cn |, R = ,
n→∞ α
cn z n converges if |z| < R and
P
(If α = 0, R = +∞; if α = +∞, R = o.) Then
diverges if |z| > R
Theorem 6.18 (Summation by Parts). Given two sequences {an } and {bn }, put
n
X
An = ak
k=0
7. Rudin’s Solution:
Problem 7.1. Prove that convergence of {sn } implies convergence of {|sn |}. Is the
converse true?
Solution. Let > 0 be given. Since {sn } converges, it is a Cauchy sequence and so there
exists natural number N such that n, m ≥ N implies |sn − sm | < . We have
for all n, m ≥ N . Hence the sequence {|sn |} is also a Cauchy sequence and therefore
converges in the complete metric R.
√
Problem 7.2. Calculate lim n2 + n − n
n→∞
Solution.
√ n 1
n2 + n − n = √ =q
n2 + n + n 1 + n1 + 1
1
It follows that the limit is 2
√
Problem 7.3. If s1 = 2, and
√
q
sn+1 = 2+ sn , (n = 1, 2, 3, . . . . . . )
√ √
q q
sn = 2 + sn−1 < 2 + sn = sn+1
So by mathematical induction {sn } is an increasing sequence.
{sn } being increasing and bounded sequence of nonnegative terms it converges.
Problem 7.4. Find the upper and lower limits of the sequence {sn } defined by
s2m−1 1
s1 = 0, s2m = , s2m+1 = + s2m .
2 2
Solution. Construction: We compute some of the terms of the sequence
1 3 3 7 7
s1 = 0, s2 = 0, s3 = , s5 = , s6 = , s7 = , s8 = .
4 4 8 8 16
49
We see the sequence have two subsequences corresponding to the even and odd numbered
terms
1 3 7 15 2m + 1 1
0, , , , , . . . · · · ≡ s2m−1 = m
=1− m
2 4 8 16 2 2
1 3 7 15 2m − 1 1 1
0, , , , ≡ s2m = m+1 = − m
4 8 16 32 2 2 2
Solution: We shall prove by induction that
1 1 1
(7.1) s2m = − m, s2m+1 = 1 −
2 2 2m
for m = 1, 2, . . . . . . . Immediate computation shows that s2 = 0 and s3 = 12 . Now assume
that the both formulas hold for m ≤ r. Then
1 1 1 1 1
s2r+2 = s2r+1 = 1 − r = − r+1
2 2 2 2 2
Therefore the first of (7.1) relations is true for all m and to see the second we use the
given equation
1 1 1 1 1
s2m+1 = + s( 2m) = + − m = 1 − m
2 2 2 2 2
1
So the subsequence of even terms converges to 2 and the subsequence of the odd terms
converge to 1.
Now we want to show that there are no other sub-sequential limits. For any x other than
1 and 21 , choose r = 12 min{|x − 1| , |−1/2|}. Note that sn ∈ Br (x) for at most finitely
many n ∈ N. Thus 21 and 1 are the only subsequential limits of {sn }, so therefore,
1
lim sup sn = 1, lim inf sn = .
n→∞ n→∞ 2
Problem 7.5. For any tow real sequences {an } and {bn } prove that
Solution. Since the um of the right hand side is not of the form ∞−∞, if one term is −∞
then both of the term have to be bounded above by M1 (say). Let M be any real number.
Without loss of generality assume that lim sup an = −∞ which implies that there is a
n→∞
subsequence {ank } such that ank → −∞ that is for every M ∈ R there is an integer N1
such that nk ≥ N1 implies ank ≤ M − M1 . Therefore ank + bnk ≤ M − M1 + M1 = M .
Which implies that ank + bnk → −∞ and so lim sup(an + bn ) = −∞.
n→∞
Now suppose one of the term in the right side is ∞ then other term has to be bounded bel-
low by M1 (say). Without loss of generality assume that lim sup an = ∞. So, there exists
n→∞
a subsequence {ank } of {an } such that ank → ∞. Let M be any given real number. There
exists n ∈ N such that ank ≥ M −M1 for all nk ≥ N . Hence ank +bnk ≥ M −M1 +M1 = M .
So there is a subsequence of ank + bnk → ∞ and hence lim sup(an + bn ) = ∞.
n→∞
Now assume that both terms in the right are finite. Suppose lim sup an = α and
n→∞
50
lim sup bn = β. Fix any > 0. There exist natural numbers N1 and N2 such that
n→∞
n ≥ N1 implies an < α + 2
and n ≥ N2 implies bn < β + 2 . Let N := max{N1 , N2 }.
Then n ≥ N implies
an + b n < α + β +
Since > 0 is arbitrary, therefore,
for all but finitely many n. Thus every sub-sequential limit of {an + bn } is bounded above
by lim sup an + lim sup bn , and in particular,
n→∞ n→∞
1
(d) an = 1+z n , for complex values of z.
Solution. (a)
√ √ √ √
( n + 1 − n)( n + 1 + n) 1 1
an = √ √ = √ √ ≥ √
( n + 1 + n) ( n + 1 + n) 2 n+1
P 1
√ diverges and so 1 √ 1 . By the comparison test
P
We know that the series n 2 n+1
P
the given series an diverges.
(b)
1 1 1
|an | = √ √ ≤ √ ≤ 3/2
n( n + 1 + n) n2 n n
P
By comparison test an converges.
√ √ √
(c) We use the root test. n an = n n − 1 and thus lim sup n an = 0 < 1. So by the
n→∞
root test the series converges.
(d) If |z| ≤ 1, then |an | ≥ 12 , so that an does not tend to zero and hence
P
an
1 1 1 1
diverges. If |z| > 1 then |an | = 1+zn ≤ zn = ( z )n . Note that |z| < 1 and so
P 1 n P
z
converges and by the comparison test an converges.
P P √an
Problem 7.7. Prove that the convergence of an implies the convergence of n
, if
an ≥ 0.
√ 2
Solution. Since an − n1 ≥ 0, it follows that
√
an 1 1 1 1
≤
n 2 an + n 2 = 2 an + n 2
P P 1
Since an and n2
both converges we conclude by the comparison test that the series
P √an
n
converges.
51
P
Problem 7.8. If an converges, and if {bn } is a monotonic and bounded, prove that
P
an bn converges.
an z n are integers,
P
Problem 7.9. Suppose that the coefficients of the power series
infinitely many of which are distinct form zero. Prove that the radius of convergence is
at most 1.
√
Solution. Since cn ≥ 1 which implies n cn ≥ 1 for all but finitely many n. So, α =
lim sup ≥ 1 and therefore the radius of convergence R = α1 ≤ 1
n→∞
P
Problem 7.10. Suppose an > o, sn = a + 1 + · · · + an , and an diverges,
P an
(a) Prove that 1+an
diverges.
(b) Prove that sN +1 +. . . · · ·+ asNN+k
aN +1
≥ 1− sNsN+k and hence deduce that
+k
P an
s2n
converges.
an 1 1
P an
(c) Prove that s2 ≤ sn−1 − sn and deduce that s2n
converges.
n
(d) What can be said about
X an X an
, and
1 + nan 1 + n 2 an
P an
Solution. (a) We assume to the contrary that 1+an
converges. That means that
an
1+an
→ 0 which implies 1 +1 → 0 which is possible only if a1n → ∞ ⇔ an → 0.
1
an
So there exists an integer N such that an < 1 for all n ≥ N . Then,
an a2n an
an − = <
1 + an 1 + an 1 + an
which implies
an
0 < an <
.
1 + an
P P an
So, by comparison test an converges which is a contradiction and hence 1+an
does not converge.
52
(b) Since an > 0 we must have sN +k ≥ sN +i for all 1 ≤ i ≤ k and therefore
aN +1 aN +k aN +1 + . . . . . . aN +k
+ ...··· + ≥
sN +1 sN +k sN +k
sN +k − sN
=
sN +k
sN
=1 −
sN +k
Since sn does not converge for a fixed N we can choose k large enough so that
NP+k
sN 1 ak
sN +k
≥ 2
and so the partial sum sk
≥ 12 which is true for any choice of N .
k=N +1
Therefore the sequence of partial sum of { asnn } does not form a Cauchy sequence
and so does not converge.
(c) We observe that for n ≥ 2,
1 1 sn − sn−1 an an
− = = ≥ 2
sn−1 sn sn sn−1 sn sn−1 sn
Also,
∞
X 1 1 1 1 1
− = − = .
n=2
sn−1 sn s1 s∞ a1
By the comparison test since
an
≤ 1 − 1
s2 sn−1 sn
n
P an
and the series of terms in the right side converges s2n
also converges.
P an
(d) The series 1+nan
may be either divergent or convergent.
If the sequence {nan } is bounded above that is if there exists M ∈ R such that
nan ≤ M for all n then
an 1
1 + nan ≥ 1 + M an
P P an
Since an diverges, by comparison test 1+nan
also diverges.
If {nan } is bounded bellow that is if there exists > 0 such that an ≥ for all n,
then,
nan
nan + nan ≥ + nan ⇒ ≥
1 + nan 1+
which implies,
an 1
1 + nan ≥ 1 + n .
53
also for a square integer n,
an 1
=√
1 + nan n + n2
an
in both of the cases 1+na n
≤ n12 and hence by comparison test the series con-
verges.
P
Problem 7.11. Suppose an > 0 and an converges. Put
∞
X
rn = am .
m=n
ak ak
Solution. (a) Obviously rm > rk for all k > m since an > 0. Therefore rk
> rm
.
am an am + · · · + an rm − rn rn
+ ...··· + > = =1− .
rm rn rm rm rm
P P
Since the series an converges and suppose an = s, then the sequence of partial
sum sn converges to s. Fix an m ∈ N, there exists N such that |s − sn−1 | < r2m
for all n > N . But
rm rn 1
|s − sn−1 | < ⇒ < .
2 rm 2
n
an
> 21 . Hence
P P an
Therefore, for any m we can find an n such that rn rn
is not
k=m
convergent.
(b) √
an √ √ rn+1
√ ( rn + rn+1 ) = an + an √ < 2an = 2(rn − rn+1 )
rn rn
Therefore,
an √ √
√ < 2( rn − rn+1 ).
rn
54
P
Since an convergent the sequence of partial sum sn → s and so rn → 0 as
∞ √ √
P √ P an
n → ∞. Therefore ( rn − rn+1 ) = r1 . Hence the series √
rn
converges
n=1
by the comparison test.
Problem 7.12. Suppose {pn } is a Cauchy sequence in a metric space X, and some
subsequence {pn } converges to a point p ∈ X. Prove that the full sequence {pn } converges
to p.
Problem 7.13. Prove that every convergent sequence has a monotone subsequence.
Theorem 7.1 (Leibniz’s Rule for Alternating Series). If {an } is a monotonic decreasing
∞
(−1)n+1 an converges. If S denotes
P
sequence with limit 0, then the alternating series
n=1
its sum and sn denotes its nth partial sum, we also have the inequalities
Observe that,
and so the sequence {s2k } is also bounded above by a1 . Therefore s2k converges. Now
We have,
0 < S − s2k ≤ s2k+1 − s2k = a2k+1 ⇒ |S − s2k | ≤ a2k+1
55
and,
0 < s2k−1 − S ≤ s2k−1 − s2k = a2 k ⇒ |S − s2k−1 | ≤ a2k .
Putting these last two equations together gives the result
|S − sn | ≤ an+1 , ∀n ∈ N.
56
8. Compactness
In this section we define compactness of a subset of a metric space. For subsets of real
number compactness is simply being closed and bounded. We start with definitions and
theorems.
Sequentially Compact: A subset K of a metric space (X, d) is sequentially compact if
every sequence in K has a convergent subsequence whose limit belongs to K. If K = X,
then X is said to be sequentially compact and every sequence in X has convergent sub-
sequence.
Definition 8.1. Let K be a subset of a topological space (X, T ). Let {Gα }α∈Λ denote
S
an arbitrary set of open sets in T . If K ⊂ α∈Λ Gα , then we call {Gα }α∈Λ is an open
cover of A.
Definition 8.2 (Compact Set). If every open cover of K has a finite subcover, then K
is compact.
Definition 8.3 ( − net). Let K be a subset of a metric space (X, d). For a fixed > 0,
we call {xα }α∈A ⊂ X an -net of K if the family of open balls {B (xα )}α∈A is an open
cover of A. If {xα } is finite, then we call {xα } a finite -net of A.
Definition 8.4. The subset K of a metric space (X, d) is totally bounded if it has a finite
-net for every > 0.
Problem 8.1. Let f : A ⊂ R → R have the property that for every x ∈ A there is an
> 0 such that
f (t) > if t ∈ (x − , x + ) ∩ A.
Show that if the set A is compact, then there is some c > 0 such that f (x) > c for all
x ∈ A.
S
Solution. Observe that x∈A (Bx (x)) covers A. Since A is compact there is a finite
subcover, say, ni=1 Bi (xi ). (Here we write xi as i for notational simplicity). In each
S
ball Bi = Bi (xi ) that for each 1 ≤ i ≤ n, we have, f (t) > i if t ∈ (xi − i , xi + i ).
Take c = min{i }ni=1 . Let x be any point in A. x ∈ Bi for some 1 ≤ i ≤ n. Therefore,
f (x) > i ≥ c. So, we conclude that f (x) > c for all x ∈ A.
58
Problem 8.2. Use compactness to show that if a function f : R → R is locally increasing
at every point in R, then f must be increasing. Here, locally increasing at a point x means
there exists δ > 0 such that f (s) < f (x) < f (t) whenever x − δ < s < x < t < x + δ.
Solution.
59
Problem 8.3. Let (X, d) be a metric space. Let {K1 , K2 , . . . , Kn } be a set of compact
subsets of X. Prove that ∪ni=1 Ki is a compact subset of X. Let {Kα } be a set of compact
subsets of X. Prove that ∩α Kα is a compact subset of X.
Since each of Gi is a finite subcover, Gf being a finite union of them is also finite collec-
tion of sets that covers Y .
Sn
Hence Y = i=1 Ki is compact.
60
Problem 8.4. Let (X, d) be a metric space with the discrete metric d. What subsets of
X are compact?
Solution. Only the finite subsets in a discrete metric are compact. A finite subset of
discrete metric is complete and also totally bounded because for any > 0 the − net is
finite and hence compact.
Now we want to prove that a compact set A in discrete metric is finite. If not, let (xn )
be a sequence such that xn 6= xk for any n 6= k, infiniteness of the set A make it possible
to form such sequence. The sequence (xn ) has no convergent subsequence since only con-
vergence subsequence in discrete metric is the constant sequence which is a contradiction.
61
Problem 8.5. Describe an open cover of the open unit square {(x, y) : 0 < x < 1, 0 < y < 1}
that has no finite subcover.
62
Problem 8.6. Let (xn ) be a sequence in a metric space (X, d) that converges to a limit
x. Show the set {x1 , x2 , x3 , · · · } is compact.
Solution.
63
Problem 8.7. Show that the product of two compact metric spaces with the product
metric is a compact metric space.
64
Problem 8.8. Let a, b ∈ R and a < b. Show that any closed ball in C([a, b]) is not com-
pact with the metric d(f, g) = supx∈[a,b] |f (x) − g(x)| for f, g ∈ C([a, b]). Hint: Sequential
compactness and compactness are the same on a metric space (theorem from lecture 2)
and there are some really nice examples of sequences with no convergent subsequence
within the unit ball centered at zero from which we can easily extend these examples to
any closed ball centered at any point (i.e., continuous function) by simply translating and
scaling these examples as necessary. The so-called “tent” functions of Example 2.13 are
one such sequence. The sequence {sin(2n πx/(b − a))} is another (easy) one (you can also
use {sin(nπx)}). Also, the sequence {([x − a]/b)n } works. None of these sequences con-
verge with respect to this metric even though you can find the pointwise limits. Can you
prove this for each one? What this is saying is that a sequence of continuous functions
taken from a closed and bounded subset of continuous functions on a compact space is
not enough to guarantee that this subset is itself compact. Additionally, we can show that
C([a, b]) is complete (lecture 4), so the issue here is that the space is not totally bounded.
Once we show that C([a, b]) is complete, then any of the sequence examples shows the
space is not totally bounded (why? see a specific theorem in lecture 2).
65
Problem 8.9. Prove that every compact metric space K has a countable base, and that
K is therefore separable. Hint: For every positive integer n, there are finitely many
neighborhood of radius 1/n whose union covers K.
66
Problem 8.10. Theorem 2.36 in Rudin
Prove that if {Kα } is a collection of compact subsets of a metric space X such that the
intersection of every finite subcollection of {Kα } is nonempty, then ∩Kα is nonempty.
(Hint: Try a proof by contradiction by assuming there is some member of {Kα }, say
K1 , such that no point in K1 belongs to every Kα , then create an open cover of K1
using complements of Kα . Show that this becomes false (in R, for example) if the word
“compact” is replaced by either “closed” or by “bounded.”
Solution. Fix a member K1 of {Kα } and put Gα = Kαc . Assume that no point of
K1 belongs to every Kα . Then, there are finitely many indices α1 , α2 , . . . , αn such that
K1 ⊂ Gα1 ∪ . . . · · · ∪ Gαn . So for any x ∈ K1 we have x ∈ ∪ni=1 Gαi and therefore
x∈/ ∩ni=1 Gcαi = ∩ni=1 Kαi . But this means that
K 1 ∩ K α1 ∩ · · · ∩ K αn
Consider Kα = [α, ∞). Let Kα1 , . . . . . . , Kαn be a finite sub-collection and let β =
max(α1 , . . . . . . αn ) then [β, ∞) ⊂ Kαi for all i = 1, . . . , n and hence the intersection
of any subcollection is not empty. But ∩Kα = ∅. If not let β ∈ ∩Kα , and let r > β where
r ∈ R. Observe that β ∈ / Kr which is a contradiction. Hence ∩Kα is empty.
Consider the bounded Kn = (0, n1 ). Any finite intersection Kn1 ∩ · · · ∩ Knm is not empty
because it contains Km+1 where m = max{n1 , . . . . . . nm }. Let 0 < x < 1 is in the in-
tersection ∩Kn . There is m such that m1 < x and hence Km does not contain x. Hence
∩Kn = ∅.
67
Problem 8.11. Let E be the set of all x ∈ [0, 1] whose decimal expansion contains only
the digits 4 and 7. Is E compact?
E is compact:
First we claim that E is closed. If x 6= [0, 1] then let r = min{d(x, 0), d(x, 1)} > 0 then
Br (x) ∩ E = ∅. Now suppose x ∈ [0, 1] \ E. Then the decimal expansion of x has some
digit which is not a 4 or a 7. Let d1 , d2 , . . . . . . denote the decimal expansion of x. Let
1
k be the lowest index such that dk 6= 4 or 7. Now let r = 10k+2 . Then Br (x) only
contains elements which either have dk as their k th digit or they have 9 as their n + 1st
digit. Both of these conditions ensure that the element of Br (x) is not an element of E.
Therefore x is not a limit point of E. Therefore E contains all of its limit points and is
closed.
Since E ⊂ [0, 1], it is bounded. By Heine-Borel theorem E is compact.
E is not perfect because B0.01 (0.4) does not contain any point of E other than 0.4 and
hence 0.4 is not a limit point.
68
Problem 8.12. Let X be a metric space in which every infinite subset has a limit point.
Prove that X is separable and compact. Hint: Once we have that X is separable, then
from the lecture 1 examples, we have the existence of a countable base, so any open cover
of X has a countable subcover. Now prove by contradiction assuming that the countable
subcover does not have a finite subcover.
69
Problem 8.13. (a) If X is a compact metric space and if {pn } is a Cauchy sequence
in X, then {pn } converges to some point of X
(b) In Rk every Cauchy sequence converges.
diam E = diam E.
70
Problem 8.14. Let Q be a metric space with metric d(p, q) = |p − q|. Let E be the set
of all p ∈ Q such that 2 < p2 < 3. Show E is closed and bounded in Q but not compact.
Is E open in Q?
Then Br (x) ⊂ Q \ E and therefore Br (x) ∩ E = ∅ and hence x is not a limit point of E.
This proves that E is closed.
√
Fix a point p ∈ E then d(x, p) ≤ 2 3 for all x ∈ E and hence E is bounded.
√
Construct a sequence {xn } in E so that xn → 2. Construction of such sequence is
possible since Q is dense in R. Since any subsequence of a convergent sequence conver-
√ √
gence to the same point, all the convergent subsequence converges in 2 but 2 ∈ / E
and hence E is not sequentially compact and hence not compact.
√
Another way to show that E is not compact could be as follows: 3 is a limit point
√
of E because any neighborhood of it contains a rational less than 3 since Q is dense in
√
R. However 3 ∈ / E since it is irrational. Therefore E as a subset of R is not closed.
Then by the Heine-Borel theorem E is not compact as a subset of R. Then E is not
compact relative to Q ⊂ R by Rudin theorem 2.33.
√ √ √ √
Finally we prove that E is open. For any q ∈ E, either q ∈ ( 2, 3) or (− 3, − 2).
√ √ √ √
Without loss of generality we assume q ∈ ( 2, 3). So, 2 < q < 3 therefore
√ √
r = min{ 3 − q , 2 − q } > 0. Then Br (q) ⊂ E and hence q is an interior point.
Since q was arbitrary, E is open.
71
Problem 8.15. Rudin Theorem 2.33
Suppose K ⊂ Y ⊂ X. Then K is compact reltive to X if and only if K is compact
relative to Y .
Solution. Suppose K is compact relative to X, and let {Vα } be a collection of sets, open
S
relative to Y , such that K ⊂ α Vα . There are sets Gα open relative to X, such that
Vα = Y ∩ Gα , for all α; and since K is compact relative to X, we have
n
[
(8.2) K⊂ Gαi
i=1
for some choice of finitely many indices α1 , . . . , αn . Since K ⊂ Y , from (8.2) we have
n
[
(8.3) K⊂ V αi .
i=1
72
9. Continuity
Continuous Function: Let (X, dX ) and (Y, dY ) be a metric spaces. Any function
f : X → Y is continuous at x0 ∈ X if for every > 0 there is a δ > 0 such that
dX (x, x0 ) < δ implies dY (f (x), f (x0 )) < . The function f is continuous on X if it is
continuous at every point in X. If f is not continuous at x, then we say f is discontinuous
at x.
Continuity in Topological Space: Let (X, T ) and (Y, S) be topological spaces. A
function f : X → Y is continuous at x ∈ X if for each neighborhood W of f (x) there
exists a neighborhood V of x such that f (V ) ⊂ W . We say that f is continuous on X if
it is continuous at every x ∈ X
Sequential continuity in Topology: Let (X, T ) and (Y, S) be topological spaces. A
function f : X → Y is sequentially continuous at x ∈ X if for every sequence (xn ) that
converges to x ∈ X, the sequence (f (xn )) converges to f (x) ∈ Y .
Continuity and Sequential Continuity are same:
Theorem Let (X, dX ) and (Y, dY ) be metric spaces. A function f : X → Y is continuous
at x ∈ X if and only if it is sequentially continuous at x
Another way to state this theorem is same as Theorem 4.2 of Baby Rudin
Definition: Let (X, dX ) and (Y, dY ) be metric spaces; suppose E ⊂ X, f maps E into
Y , and p is a limit point of E. We write f (x) → q as x → p, or
lim f (x) = q
x→p
if there is a point q ∈ Y with the following property: For each > 0 there exists a δ > 0
such that dY (f (x), q) < for all points x ∈ E for which 0 < dX (d, p) < δ.
Theorem: Let (X, dx ) and (Y, dY ) be metric spaces; suppose E ⊂ X, f maps E into Y ,
and p is a limit point of E. Then lim f (x) = q if and only if lim f (pn ) = q for every
x→p n→∞
sequence {pn } in E such that lim pn = p where pn 6= p.
n→∞
Proof: Suppose lim f (x) = q holds. Now choose any sequence {pn } so that pn 6= p
n→∞
that is {pn } is not a constant sequence and pn → p as n → ∞. We want to show that
lim f (pn ) = q.
n→∞
Let > 0 be given. Since lim f (x) = q, there exists a δ > 0 such that dY (f (x), q) <
x→p
if x ∈ E and 0 < dX (x, p) < δ. Also since pn → p, there exists an N ∈ N such that
dX (pn , p) < δ for all n > N . Thus for all n > N , we have dY (f (pn ), q) < , which implies
lim f (pn ) = q.
n→∞
Conversely suppose lim f (fn ) = q for every sequence {pn } in E such that lim pn = p
n→∞ n→∞
where pn 6= p but lim f (x) 6= q. Then there exists some such that for every δ > 0 there
x→p
exists a point x ∈ E (depending on δ), for which dY (f (x), q) ≥ but 0 < dX (x, p) < δ.
Let δn = n1 . Take a point p1 ∈ E such that 0 < dX (p1, p) < δ1 but dY (f (p1 ), q) > 1 and
similarly choose p2 ∈ E such that 0 < d(p2 , p) < δ but dY (f (p1 ), q) > 2 . We construct a
sequence in this way. Note that we guarantee existence of such points pj because p is a
73
limit point of E. Now consider the sequence {pn } and note that pn → p by construction
but d( f (pn ), q) > n for all n which is a contradiction to the fact that lim f (pn ) = q for
n→∞
all {pn }.
Theorem: Let (X, T ) and (Y, S) be two topological spaces and f : X → Y . Then f is
continuous on X if and only if f −1 (G) ∈ T for every G ∈ S.
Corollary: A function f is continuous if and only if the inverse image of closed sets is
closed.
Uniform Continuity: Let (X, dX ) and (Y, dY ) be metric spaces. A function f : X → Y
is uniformly continuous on X if for every > 0 there exists δ > 0 such that, dX (x, y) < δ
implies dY (f (x), f (y)) < for all x, y ∈ X.
Definition: Let (X, dX ) and (Y, dY ) be metric spaces. A map ` : X → Y which satisfies
Theorem: Every metric space has a completion and the completion is unique up to
isomorphism
75
9.3. Proofs of the Theorems
compact.
Theorem: Let f : K → Y be a continuous function on a compact set K. Then f is
uniformly continuous.
Proof: Suppose f is not uniformly continuous. Then there is an > 0 such that for all
δ > 0, there are x, y ∈ K with dK (x, y) < δ and dY (f (x), f (y)) ≥ . Taking δ = n1 for
n ∈ N, we find that there are sequence (xn ) and (yn ) in K such that
1
dK (xn , yn ) < , dY (f (xn ), f (yn )) ≥
n
Since K is compact there are convergent subsequences of (xn ) and (yn ) which we denote
by (xni ) and (ynj ). Since dK (xn , yn ) < n1 the subsequences converges to the same limit
(taking n → ∞, d(x, y) → 0). But the sequence (f (xn )) and (f (yn )) either diverge or
converge to different limits. This contradicts the continuity of f .
76
9.4. Problems:
Problem 9.1. Let X and Y be metric spaces and A ⊂ X. Suppose f maps A into
Y and p is a limit point of A. We say that f has a limit at p and write f (x) → q as
x → p, or limx→p f (x) = q if there is a point q ∈ Y with the property that for every
> 0 there exists a δ > 0 such that for all points x ∈ E with 0 < dX (x, p) < δ implies
dY (f (x), q) < . Prove the following theorems.
(a) limx→p f (x) = q if and only if limn→∞ f (pn ) = q for every sequence (pn ) ⊂ E such
that pn 6= p for all n and pn → p.
(b) If f has a limit at p, then the limit is unique.
(c) The function f is continuous at p if and only if limx→p f (x) = f (p).
Solution. Solution:(a) First assume that lim f (x) = q holds. Now choose any sequence
x→p
{pn } so that pn 6= p that is {pn } is not a constant sequence and pn → p as n → ∞. We
want to show that lim f (pn ) = q.
n→∞
Let > 0 be given. Since lim f (x) = q, there exists a δ > 0 such that dY (f (x), q) <
x→p
if x ∈ E and 0 < dX (x, p) < δ. Also since pn → p, there exists an N ∈ N such that
dX (pn , p) < δ for all n > N . Thus for all n > N , we have dY (f (pn ), q) < , which implies
lim f (pn ) = q.
n→∞
Conversely suppose lim f (fn ) = q for every sequence {pn } in E such that lim pn = p
n→∞ n→∞
where pn 6= p but lim f (x) 6= q. Then there exists some such that for every δ > 0 there
x→p
exists a point x ∈ E (depending on δ), for which dY (f (x), q) ≥ but 0 < dX (x, p) < δ.
Let δn = n1 . Take a point p1 ∈ E such that 0 < dX (p1, p) < δ1 but dY (f (p1 ), q) > 1 and
similarly choose p2 ∈ E such that 0 < d(p2 , p) < δ but dY (f (p1 ), q) > 2 . We construct a
sequence in this way. Note that we guarantee existence of such points pj because p is a
limit point of E. Now consider the sequence {pn } and note that pn → p by construction
but d( f (pn ), q) > n for all n which is a contradiction to the fact that lim f (pn ) = q for
n→∞
all {pn }.
Solution (b): Since f has a limit at p is same as saying every sequence {pn } in X that
converges to p the sequence {f (pn )} converges to some point q ∈ Y . From elementary
analysis we know that limit of a convergent sequence is unique and hence limit of {f (pn )}
is unique and so limit of f at p is unique.
Solution (c): lim f (x) = f (p) holds if and only if for any > 0 there exists a δ > 0 such
x→p
that dX (x, p) < δ implies dY (f (x), f (p)) < and this implies continuity of f at p ∈ E.
77
Problem 9.2. Let f : R2 → R be defined
2
x41 x22 , (x , x ) 6= (0, 0),
1 2
f (x1 , x2 ) = x1 +x2
0, (x1 , x2 ) = (0, 0).
Show that limx→0 f (x, mx) = 0 for every m ∈ R but f is discontinuous at (0, 0). Interpret
this result.
mx 3 mx
Solution. If x 6= 0 then f (x, mx) = x4 +m 2 x2 = x2 +m2 . If m = 0 then f(x,mx)=0. If
However f (x, mx2 ) tells a different story. Assume m 6= 0 and x 6= 0, then (x, mx2 ) →
(0, 0) as x → 0 but
m
f (x, mx2 ) =
1 + m2
and therefore
lim f (x, mx2 ) 6= 0.
x→0
Hence f is not continuous at (0, 0)
78
Problem 9.3. Let C 1 ([a, b]) be the metric space of continuously differentiable functions
on [a, b] with metric
Let D : C 1 ([a, b]) → C([a, b]) be defined by D(f ) = f 0 . Prove that D is continuous.
Therefore taking δ = we can conclude that, for given > 0, there exists a δ > 0 such
that d(f, g) < δ implies d0 (D(f ), D(g)) < . Since f was arbitrary it infers that D is
continuous.
79
Problem 9.4. Let C([a, b]) be the metric space of continuous functions on [a, b] with
metric Z b
d(f, g) = |f (t) − g(t)| dt.
a
Define T : C([a, b]) → R by
Z b
T (f ) = f (t) dt.
a
(a) Prove that T is continuous using sequential definition of continuity.
(b) Prove that T is continuous using δ − definition.
Solution. Solution (a): Let {fn } be any sequence in C([a, b]) so that fn → f and
fn 6= f for all n. Since fn → f , for given > 0 there is N ∈ N such that d(fn , f ) < for
all n > N . Observe that, for all n > N ,
Z b Z b
|T (fn ) − T (f )| =
fn (t) − f (t) ≤ |fn (t) − f (t)| = d(fn , f ) <
a a
Which implies that the sequence T (fn ) converges to T (f ) and by definition, T is sequen-
tially continuous and hence continuous by Theorem 1.
Solution (b): Let f be any continuous function in C([a, b]).Let > 0 be given. Since
|T (f ), T (g)| ≤ d(f, g) taking δ = we can conclude that d(f, g) < δ implies |T (f ), T (g)| <
. So, T is continuous at f ∈ C([a, b]). Since f is arbitrary we conclude that T is contin-
uous in C([a, b])
80
Problem 9.5. Let f and g be continuous maps of a metric space X into a metric space
Y and let E be a dense subset of X.
(a) Prove that f (E) is dense in f (X).
(b) If g(x) = f (x) for all x in a dense subset E of X, prove that g(x) = f (x) for all
x ∈ X.
Solution. Solution (a): Take any y ∈ f (X). For any > 0 the ball B (y) is open in
Y and f −1 (B (y)) is open in X since f is continuous in X. Since E is dense in X there
exists x ∈ f −1 (B (y)) ∩ E. So f (x) ∈ B (y). So f (E) ∩ B (y) 6= ∅ and contains a point
of f (E), for any y ∈ f (X) and hence f (E) is dense in f (X).
Since f (x) = g(x) in E we have h(x) = 0 in E. Take any point y ∈ X \ E. For any
δ > 0, Bδ (y) contains a point z ∈ E since E is dense in X. Assume that h(y) 6= 0 that
is h(y) ≥ y . So, ∀δ we have |h(y) − h(z)| > y which contradicts the fact that h is
continuous. So h(y) = 0 and since y was arbitrary we can conclude that h(x) = 0 for all
x ∈ X and therefore f (x) = g(x) for all x ∈ X.
81
Problem 9.6. Let A be a set and x a point in a metric space (X, d). Define the “distance
from x to A” to be
d(x, A) = inf d(x, y).
y∈A
(a) Show that for fixed A, the function f : X → R (with the usual metric on R) given by
f (x) = d(x, A) is continuous. (b) Show {x : d(x, A) = 0} = Ā.
82
Problem 9.7. Suppose f is a mapping from metric space X to metric space Y . Prove
that a function is continuous if and only if f −1 (A) is closed in X for every closed set
A⊂Y.
Solution. First assume that f is continuous and we want to show that if A is closed
then f −1 (A) is closed. Since A is closed Ac is open and since f is continuous, f −1 (Ac ) is
open. But
c
f −1 (Ac ) = {x ∈ X|f (x) ∈ Ac } = {x ∈ X|f (x) ∈ / A} = {x ∈ X|x ∈ / f −1 (A)} = f −1 (A)
c
shows that (f −1 (A)) is open and hence f −1 (A) is closed.
Now we take that f −1 (A) is closed whenever A is closed in Y and want to show that
f is continuous. Let B be any open set in Y . So B c is closed. By the hypothesis f −1 (B c )
c c
is closed. But we have shown that f −1 (B c ) = (f −1 (B)) and hence (f −1 (B)) is closed
which implies f −1 (B) is open. Since B was arbitrary we conclude that for every open set
B the preimage f −1 (B) is open and hence f is continuous.
83
Problem 9.8. Assume f : R → R is continuous and define A = {x : f (x) = 0}. Show
A is closed.
Solution.
A = {x : f (x) = 0} = f −1 ({0})
But the set {0} being a singleton set is closed and by the above problem A = f −1 ({0})
is closed.
84
Problem 9.9. Suppose f is a continuous bijection of a compact metric space X onto a
metric space Y . Prove that the inverse map f −1 defined on Y by f −1 (f (x)) = x (where
x ∈ X) is a continuous mapping of Y onto X.
Solution. Let A ⊂ X be any closed subset. Since X is compact being a closed subset
A is compact. Since f is continuous it maps a compact set to a compact set and hence
f (A) is compact and therefore is closed. But
−1
f −1 (A) = {y ∈ Y : f −1 (y) ∈ A} = {y ∈ Y : y ∈ f (A)} = f (A)
Since A is arbitrary we conclude that the inverse image of a closed set A under the
function f −1 is closed and hence f −1 is continuous.
85
Problem 9.10. Let (X, d) be a metric space and F, G ⊂ X with F closed, G open,
and F ⊂ G. Show that there is a continuous function f : X → R such that 0 ≤
f (x) ≤ 1, f (x) = 1 for x ∈ F , and f (x) = 0 for x ∈ Gc . Hint: Consider the function
f (x) = d(x, Gc )/[d(x, Gc ) + d(x, F )]. This result is called Urysohn’s lemma and is useful
in showing the existence of partitions of unity.
Solution. First we would see the construction. f (x) = 1 for x ∈ F and f (x) = 0 for
x ∈ Gc . So we can see this as a parallel line to x axis over F and the x axis itself over Gc .
To make it continuous we have to draw a line form (Gc , 0) (thinking Gc to be the corner
c c)
point and) to (F, 1). The equation of the line would look like y = Fx−G−Gc
= d(x,Gd(x,G
c )+d(x,F ) .
Take
d(x, Gc )
f (x) =
d(x, Gc ) + d(x, F )
For all x ∈ F , d(x, F ) = 0 and we claim that d(x, Gc ) > 0. Since x ∈ F ⊂ G and G
is open, there is such that B (x) ⊂ G and so d(x, y) ≥ for all y ∈ Gc and hence
d(x, Gx ) ≥ > 0. Therefore we have
d(x, Gc ) d(x, Gc )
f (x) = = = 1, ∀x ∈ F
d(x, Gc ) + d(x, F ) d(x, Gc )
Now take x ∈ Gc . For any y ∈ F since y ∈ G and G is open using same argument above
we conclude that d(x, y) ≥ and hence d(x, F ) ≥ > 0. Therefore,
0
f (x) = =0
d(x, F )
Now we want to show that f is continuous. (The idea is to use the fact that distance
metric is continuous and composition is also continuous but have to fill up with details
to show the denominator is not equal to zero)
86
Problem 9.11. Let f and g be continuous maps of a metric space X into a metric space
Y and let E be a dense subset of X. (a) Prove that f (E) is dense in f (X). (b) If
g(x) = f (x) for all x in a dense subset E of X, prove that g(x) = f (x) for all x ∈ X.
Explain why these results are important for our everyday experience with functions and
numbers.
87
Problem 9.12. (a) Show that the requirement in the definition of uniform continuity
can be rephrased as follows, in terms of diameters of sets: For every > 0 there exists a
δ > 0 such that diam(f (E)) < for all E ⊂ X with diam(E) < δ. (b) Let E be a dense
subset of a metric space X, and let f be a uniformly continuous function into a complete
metric space Y defined on E. Prove that f has a continuous extension from E to X in
two ways using part (a) and then using Cauchy sequences.
88
Problem 9.13. Let f : R → R be a continuous function that is periodic with period
T > 0. (a) Show that f has a finite maximum and minimum values on R. (b) Show that
f is uniformly continuous on R.
89
Problem 9.14. Let X be a metric space.
(a) Call two Cauchy sequences (pn ), (qn ) in X equivalent if
lim d(pn , qn ) = 0.
n→∞
90
Problem 9.15. Let (X, d) be a metric space and suppose f is uniformly continuous on
the compact subsets E1 , . . . , En of X. (a) Prove that f is uniformly continuous on ∪ni=1 Ei .
(b) Give an example of a function f that is continuous on R and a sequence of compact
intervals E1 , E2 , E3 , . . . on each of which f is uniformly continuous, yet f is not uniformly
continuous on ∪∞ i=1 Ei .
91
Problem 9.16. Prove that if f is a continuous mapping of a metric space X into a
metric space Y and E ⊂ X is connected, then f (E) is connected.
92
10. Differentiation of Single Variable
Definition 10.1. Let f be defined on [a, b]. For any x ∈ [a, b] form the quotient
f (t) − f (x)
φ(t) = (a < t < b, t 6= x)
t−x
and define
f 0 (x) = lim φ(t),
t→x
provided this limit exists.
We thus associate with this function f a function f 0 whose domain is the set of points x
at which the limit exists; f 0 is called the derivative of f .
If f 0 is defined as a point x, we say that f is differentiable at x. If f 0 is defined at every
point of a set E ⊂ [a, b], we say that f is differentiable on E.
Theorem 10.1. Let f is defined on [a, b]. If f is differentiable at a point x ∈ [a, b], then
f is continuous at x.
Theorem 10.2. Suppose f and g are defined on [a, b] and are differentiable at a point
x ∈ [a, b]. Then f + g, f g and f /g are differentiable at x, and
(a) (f + g)0 (x) = f 0 (x) + g 0 (x);
0 0
(b)
(f g)
0 (x) = f (x)g(x) + f (x)g 0 (x);
0 0 (x)f (x)
(c) fg (x) = g(x)f (x)−gg 2 (x)
Theorem 10.3 (Chain Rule). Suppose f is continuous on [a, b], f 0 (x) exists at some
point x ∈ [a, b], g is defined on an interval I which contains the range of f , and g is
differentiable at the point f (x). If
Definition 10.2. Let f be a real function defined on a metric space X. We say that f
has a local maximum at a point p ∈ X if there exists δ > 0 such that f (q) ≤ f (p) for all
q ∈ X with d(p, q) < δ
Theorem 10.4. Let f be defined on [a, b]; if f has a local maximum at a point x ∈ (a, b),
and if f 0 (x) exists, then f 0 (x) = 0.
Theorem 10.5 (Generalized Mean Value Theorem). If f and g are continuous real
functions on [a, b] which are differentiable in (a, b), then there is a point x ∈ (a, b) at
which
[f (b) − f (a)]g 0 (x) = [g(b) − g(a)]f 0 (x).
93
Theorem 10.6. If f is a real continuous function on [a, b] which is differentiable in
(a, b), then there is a point x ∈ (a, b) at which
Theorem 10.8 (Similar to IVT). Suppose f is a real differentiable function on [a, b] and
suppose f 0 (a) < λ < f 0 (b). Then there is a point x ∈ (a, b) such that f 0 (x) = λ
Theorem 10.9 (L’Hospital’s Rule). Suppose f and g are real and differentiable in (a, b),
and g 0 (x) 6= 0 for all x ∈ (a, b), where −∞ ≤ a ≤ b ≤ +∞. Suppose
f 0 (x)
→ A, as x→a
g 0 (x)
If f (x) → 0 and g(x) → 0 as x → a or if g(x) → +∞ as x → a, then
f (x)
→A as x → a.
g(x)
The consequence of the mean value theorem which is also valid for vector valued func-
tion is as follows:
94
11. Sequences and Spaces of Continuous Functions
lim kfn − f k∞ = 0.
n→∞
Definition 11.2. Let (X, d) be a metric space. We define the set of continuous, real-
valued functions f : X → R by C(X). We let Cb (X) denote the space of bounded contin-
uous functions on X.
Theorem 11.2. Let K be a compact subset of a metric space (X, d). The space C(K) is
complete.
We say that f has compact support if supp(f ) is a compact subset of X, and denote
the space of continuous functions on X with compact support by Cc (X). We denote the
closure of Cc (X) by C0 (X).
Theorem 11.3 (Weierstrass Approximation Theorem). Let a < b be real numbers. The
set of polynomials on [a, b] is dense in C([a, b]).
96
11.3. Proof of the Theorems:
Since F is not uniformly equicontinuous, there is an > 0, such that for every n ∈ N
there are points xn , yn ∈ K and a function fn ∈ F with
1
(11.1) d(xn , yn ) < , and d(fn (yn ), fn (xn )) ≥ 2.
n
Since K is compact, the sequence (xn ) has a convergent subsequence, which are also
denoted by (xn ). Suppose that xn → x as n → ∞. Then d(xn , yn ) < n1 implies yn → x as
well. Hence, for all δ > 0, there are points xn , yn such that d(xn , x) < δ and d(yn , x) < δ.
But from (11.1), we must have either d(fn (xn ), fn (x)) ≥ or d(fn (yn ), fn (x)) ≥ , so F
is not equicontinuous at x.
97
11.4. Problems on Sequence of Functions
x
Problem 11.1. Prove the sequence ( n+x2 ) converges uniformly on R with the usual
metric.
x x
Solution. Fix x ∈ R then lim 2 = 0 and so fn = n+x2
converges pointwise to 0.
n→∞ n+x
For given we can find N ∈ N such that 2√1N < by Archimedean property to conclude
x
that n ≥ N implies n+x 2
< for all x ∈ R. Hence the given sequence is uniformly
convergence.
98
Problem 11.2. (a) Define what it means for a sequence of functions to be uniformly
Cauchy and prove that a uniformly convergent sequence of functions is uniformly Cauchy.
(b) Prove that every uniformly convergent sequence of bounded functions is uniformly
bounded. Here, we say that a sequence of real-valued functions (fn ) is uniformly bounded
if there exists M > 0 such that kfn k∞ ≤ M . (c) Show there exists a sequence of functions
that converges pointwise to the function that is identically 0, but each function in the
sequence is unbounded Hint: Consider the sequence {x/n} on [0, ∞).
Solution. (a) A sequence of function (fn (x)) in a subset A of a metric space (X, d)
is called uniformly Cauchy if for any > 0 there exists N ∈ N such that n, m ≥ N
implies d(fn (x), fm (x)) < for all x ∈ A.
The another way of defining the uniform Cauchy criteria is using the natural
norm i.e. the infinity norm. A sequence of real valued function (fn ) on a metric
space (X, d) is said to be uniformly Cauchy if for any > 0 there exists an N ∈ N
such that for all n ≥ N
kfn − f k∞ < .
Let the sequence (fn ) of functions converges to f uniformly. Let > 0 be given.
There exists an N ∈ N such that d(fn (x), f (x)) < 2 for all x ∈ A whenever
n ≥ N . Now take n, m ≥ N , then
d(fn (x), fm (x)) ≤ d(fn (x), f (x)) + d(fm (x), f (x)) < + =
2 2
for all x ∈ A. Therefore (fn ) is uniformly Cauchy.
(b) Since (fn ) is a sequence of bounded functions for each n there is Mn such that
kfn k∞ ≤ M . Since the sequence is uniformly convergence it is uniformly Cauchy
and so for = 1 there is N ∈ N such that d(fm (x), fN (x)) < 1 for all m ≥ N .
Take M = 1 + max{M1 , . . . . . . MN }.
99
Problem 11.3.
(a) Prove that if the sequences of real-valued functions (fn ) and (gn ) converge uniformly
on A ⊂ X, then (fn + gn ) converges uniformly on A. (b) If fn and gn are also bounded for
each n ∈ N, prove that (fn gn ) converges uniformly on A. (c) Show that the boundedness
is necessary in (b) by constructing an example where (fn gn ) does not converge uniformly
(although it must converge pointwise).
Solution. Let > 0 be given. Since (fn ) converges uniformly to f (say), there exists an
N1 ∈ N such that |fn (x) − f (x)| < 2 for all n ≥ N1 and for all x ∈ A.
Also, since (gn ) converges uniformly to g(say), there exists an N2 ∈ N such that |gn (x) − g(x)| <
2
for all n ≥ N2 and for all x ∈ A. Take N = max{N1 , N2 }, then n ≥ N implies
|(fn + gn ) (x) − (f + g)(x)| ≤ |fn (x) − f (x)| + |gn (x) − g(x)| < + =
2 2
for all x ∈ A. Hence (fn + gn ) converges uniformly.
Since the function gn is bounded, there is Mn ∈ R such that |gn | ≤ Mn for all x ∈ A.
Then, |gN2 (x) − g(x)| < implies |g(x)| ≤ |gN2 (x)| + ≤ MN2 + = Q(say). Since (fn ) is
a uniformly convergent sequence of bounded function, the sequence is uniformly bounded
(Rudin Problem 1) by P(say). Now, since fn → f uniformly, there exists N1 ∈ N such
that n ≥ N1 implies |fn (x) − f (x)| < 2Q for all x ∈ A. Similarly, for gn → g uniformly,
there exists N2 ∈ N such that |gn (x) − g(x)| < 2P for all x ∈ A.
|(fn gn )(x) − (f g)(x)| = |fn (x)gn (x) − fn (x)g(x) + fn (x)g(x) − f (x)g(x)|
≤ |fn (x)| |gn (x) − g(x)| + |g(x)| |fn (x) − f (x)|
<P +Q = ,
2P 2Q
for all x ∈ A. Therefore, fn gn converges uniformly.
Let fn (x) = x1 and gn (x) = n1 for each n on the interval (0, 1). Then the sequences (fn )
converges to f (x) = 1/x uniformly because it is a constant sequence. Also (gn ) converges
uniformly to g(x) = 0 uniformly because the functions are independent of x. We claim
1
the the product hn = (fn gn )(x) = xn converges pointwise but not uniformly.
(hn ) converge point wise because for a fixed x and for given > 0 by Archimedean
1
Property we can pick N ≥ x so that for all n ≥ N we have
1 1
|hn (x) − 0| = < <
xn Nx
So the sequence converges to 0 pointwise. However for any given N we can choose
0 < x < N1 so that
1 1
N x − 0 = N x > 1,
101
Problem 11.5. (General Arzelà Ascoli Theorem) If X is a compact metric space, (fn ) ⊂
C(K), (fn ) is pointwise bounded and equicontinuous on X, prove that
(a) (fn ) is uniformly bounded on X, and
(b) f (n) contains a uniformly convergent subsequence.
Hint: For (a) use compactness to get the uniform bound. For (b), use the fact that
a compact set is separable to extract a countable dense subset. Then prove that on the
countable set the sequence has a convergent subsequence. Prove this subsequence converges
uniformly on X.
102
Problem 11.6. Let (X, d) be a metric space and suppose K ⊂ X is compact, fn → f on
K (and all functions are real-valued and continuous), and fn (x) ≥ fn+1 (x) for all x ∈ K
and n ∈ N. Prove that fn → f uniformly on K. Construct an example showing the
necessity of compactness.
Let > 0 be given. Let Kn be the set of all x ∈ K with gn (x) ≥ . The set
Yn = {gn (x) ∈ gn (K) : g(x < )} is open. Take any point g(x0 ) ∈ Yn then there is
a neighborhood Bδ (g(x0 )) with δ < − g(x0 ) > 0 is contained entirely in Yn and hence
the set {gn (x) ∈ gn (K) : g(x ≥ )} is closed. By continuity the inverse image Kn is also
closed. Since Kn is a closed subset of a compact set K, Kn is itself compact.
103
n
∞
Problem 11.7. Is the set of functions x2 + 1+n
x n=1 taking R to R (with the usual
metric) equicontinuous on [0, 1]?
Solution. .
n
Process 1 The set [0, 1] is compact. The sequence of function (fn ) = x2 + n+1 x is point-
wise convergent to f = x2 + x as n → 0. Also for a fixed x, fn is monotonically
decreasing. Hence according to above problem the sequence of function is uni-
formly convergent and hence equicontinuous.
Process 2
2 n 2 n ≤ x − y 2 + n |x − y|
2
x + x − y − y
n+1 n+1 n+1
≤ |x − y| |x + y| + |x − y|
= (|x + y| + 1) |x − y|
≤ 3 |x − y|
Let > 0 be given. Taking δ < 3 we can conclude that, for any x ∈ [0, 1],
|x − y| < δ implies |fn (x) − fn (y)| < for all n. Hence (fn ) is equicontinuous.
104
Problem 11.8. Compute and plot the Bernstein polynomials for 1/(1 + x) on [0, 1] of
degrees 1, 2, and 3.
105
Problem 11.9. Assume that (fn ) is a sequence of functions with fn : [a, b] → R for all
n where we take the usual metric on [a, b] and R.
(a) Assume that {fn } is uniformly Lipschitz continuous on [a, b] with constant L. Prove
that {fn } is equicontinuous on [a, b].
(b) Assume that {fn } is uniformly Lipschitz continuous on [a, b] with constant L and
further that (fn (x)) is a uniformly bounded sequence of numbers for some a ≤ x ≤ b.
(1) Prove that (fn ) has a subsequence that converges uniformly on [a, b]. (2) Prove
the second assumption is needed with an example.
(c) Assume that (fn ) is a bounded subset of C([a, b]). Show that the sequence of functions
(Fn ) from [a, b] into R defined by
Z x
Fn (x) = fn (x) ds
a
contains a subsequence that converges uniformly on [a, b]. (This is quite a remark-
able result when considering the sequence of functions (sin(nx)) as an example of a
bounded sequence in C([a, b]) that fails to have any convergent subsequence.)
Solution. Definition: A function f : X → R on a metric space (X, d) is Lipschitz
continuous on X if there is a constant C ≥ 0 such that
(a) Since (fn ) is uniformly Lipschitz continuous there is a constant L ≥ 0 such that
So, if L = 0 then the functions are the constant functions and there is nothing to
prove. So we consider more interesting case L > 0.
Let > 0 be given. Taking 0 < δ < L we can conclude that, for any x ∈ [a, b],
d(x, y) < δ implies |fn (x) − fn (y)| ≤ L L = for all n. Therefore (fn ) is equicon-
tinuous.
(b) Since (fn ) is bounded equicontinuous family of functions, (fn ) is precompact and
hence has a convergent subsequence. The simple constant sequence (fn ) = (n)
has uniform Lipschitz constant 0, but clearly fails to converge even pointwise.
(c) Let M be the uniform bound for the set {fn }.
Z x Z x
|Fn (x)| = fn (s)ds ≤ |fn (s)| ds ≤ M (x − a) ≤ M (b − a)
a a
So, {Fn } is equicontinuous. Now by part (b), (Fn ) has a subsequence that con-
verges uniformly.
106
Problem 11.10. Suppose K = {x1 , . . . , xn } is a finite space with the discrete metric d.
Show C(K) is linearly isomorphic to the finite-dimensional space Rn with the ∞-norm
(which is just the maximum norm in finite dimensions). Hint: Any function f : K → R
is just a mapping of each xi to some point yi ∈ R, so the function can be identified with
a point y = (y1 , . . . , yn ) ∈ Rn where f (xi ) = yi . This is a linear isometry that is also a
metric space isomorphism with the metric induced by the ∞-norm.
107
Problem 11.11. Suppose f is a real-valued continuous function with dom(f ) = R. Let
fn (x) = f (nx) for n ∈ N and any x ∈ R. If {fn } is equicontinuous, prove that f must be
a constant function on [0, ∞).
Solution. Suppose f is not constant then there are x, y ∈ [0, ∞) with x 6= y and f (x) 6=
f (y). Let = |f (x) − f (y)| > 0. Then |fn (x/n) − fn (y/n)| = for all n ∈ N. When n
is large enough x/n, y/n ∈ [0, 1] and |x/n − y/n| → 0. So for any δ > 0 there is N such
that |x/n − y/n| < δ for all n ≥ N but |fn (x/n) − fn (y/n)| = which is contradiction
to the fact that {fn } is equicontinuous.
108
Problem 11.12. Suppose that (fn ) is an equicontinuous sequence of functions on a
compact set K and (fn ) converges pointwise on K. Prove that (fn ) converges uniformly
on K.
109
Problem 11.13. Let X and Y be two metric spaces and A ⊂ X. Let (fn ) be a sequence of
functions from A to Y that converges to f pointwise on A. Prove the following theorems.
(a) Let Mn = supx∈A dY (fn (x), f (x)). Prove that fn → f uniformly if and only if Mn →
0.
(b) If fn is continuous on A for each n, then f is continuous on A. This is a generalization
of the theorem in the notes.
(c) Suppose Y is complete, then fn converges uniformly on A if and only if for every > 0
there exists an integer N such that m ≥ N , n ≥ N , x ∈ E implies dY (fn (x), fm (x)) <
. Construct an example showing the necessity of Y being complete.
(d) Suppose Y is complete, and fn converges uniformly on A. Let x be a limit point of A
and suppose that limt→x fn (t) = yn for each n. Then (yn ) converges and limt→x f (t) =
limn→∞ yn . In other words, prove limt→x limn→∞ fn (t) = limn→∞ limt→x fn (t). Con-
struct an example showing the necessity of Y being complete.
110
R1
Problem 11.14. Prove that if f ∈ C([0, 1]) and 0 f (x)xn dx = 0 for all n ∈ N, then
R1
f (x) = 0 on [0, 1]. Hint: If 0 f 2 (x) dx = 0, then a result from elementary real analysis
states that f ≡ 0. Consider a sequence of polynomials that converge uniformly to f and
take the product with f to get a uniformly convergent sequence to f 2 .
111
Problem 11.15. Let (X, d) be a metric space and pick any fixed but arbitrary a ∈ X.
Define the real-valued function fp for each p ∈ X by
where x ∈ X.
(a) Prove that kfp k∞ ≤ d(a, p) and fp ∈ C(X).
(b) Prove that
kfp − fq k∞ = d(p, q)
for all p, q ∈ X.
(c) Let Φ(p) = f (p), so that Φ is an isometry of X onto Φ(X) ⊂ C(X). Let Y be the
closure of Φ(X) in C(X). Show that Y is complete which implies X is isometric to a
dense subset of a complete metric space Y . Note: This is a different proof of what we
previously showed in lecture 3 examples about defining the closure of a metric space.
112
n
Problem 11.16. Let fn (x) = (−1)n xn .
∞
P
(a) Show that fn (x) converges uniformly on [0, 1].
n=1
P∞
(b) Show that |fn (x)| converges uniformly on [0, 1).
n=1
P∞
(1) Show that |fn (x)| does not converge uniformly on [0, 1).
n=1
Solution.
Theorem 11.7 (Leibniz’s Rule for Alternating Series). If {an } is a monotonic decreasing
∞
(−1)n+1 an converges. If S denotes
P
sequence with limit 0, then the alternating series
n=1
its sum and sn denotes its nth partial sum, we also have the inequalities
|fn (x)| = |fn (x) − fN (x) + fN (x)| ≤ |fn (x) − fN (x)| + |fN (x)| < 1 + MN .
114
Problem 11.18 (Rudin 2). If {fn } and {gn } converge uniformly on a set E, prove that
{fn + gn } converges uniformly on E. If in addition, {fn } and {gn } are sequences of
bounded functions, prove that {fn gn } converges uniformly on E.
Problem 11.19. Construct sequences {fn } and {gn } which converges uniformly on some
set E, but such that {fn gn } does not converge uniformly on E.
115
Problem 11.20. Consider ∞
X 1
f (x) =
n=1
1 + n2 x
For what values of x does the series converge absolutely? On what intervals does it
converge uniformly? On what intervals does it fail to converge uniformly? Is f continuous
whatever the series converges? Is f bounded?
Solution. • Where it converges: This series converges for all x except 0 and
∞
x = − n12 , n = 1, 2, . . . . . . . For x = 0, f (x) = 1 = ∞. For x = − n12 the nth
P
n=1
term is not defined. For all other values of x the series converges.
116
Problem 11.21. Rudin Chapter 7, Problem 5:
Let
1
0 x < n+1
fn (x) = sin2 πx n+1 1
≤x≤ 1
n
1
0 < x.
n
P
Show that {fn } converges to a continuous function, but not uniformly. Use the series fn
to show that absolute convergence, even for all x, does not imply uniform convergence.
Solution. The limit of fn (x) is zero. If x ≤ 0 or x ≥ 1, then fn (x) = 0 for all n, and so
this assertion is obvious. If 0 < x < 1, then fn (x) = 0 for all n ≥ x1 , and so once again
the assertion is obvious.
The convergence is not uniform, since, no matter how large n is taken, there is a point
1
x, namely x = 2n+ 1 , for which fn (x) = 1.
2
The series converges to 0 for x ≤ 0 and x ≥ 1 and to sin2 πx for 0 < x < 1. Since the
terms are nonnegative, the series obviously converges absolutely. Since the sum is not
continuous at 0, the series does not converge uniformly on any interval containing 0.
117
Problem 11.22. Rudin Chapter 7, Problem 6:
Prove that the series ∞
X x2 + n
(−1)n
n=1
n2
converges uniformly in every bounded interval, but does not converge absolutely for any
value of x.
The first of these converges both uniformly and absolutely on any bounded interval [a, b]
because by Weierstrass M test
2 (−1)n M 2
x ≤
n2 n2
∞
M2
P
where M = max(|a| , |b|) and n2
converges.
n=1
118
Problem 11.23. Rudin Chapter 7, Problem 7:
For n = 1, 2, 3, . . . . . . , x real, put
x
fn (x) =
1 + nx2
Show that {fn } converges uniformly to a function f , and that the equation f 0 (x) =
lim fn0 (x) is correct if x 6= 0, but false if x = 0.
n→∞
√ √
Solution. Since (1 − nx)2 ≥ 0 implies 1 + nx2 ≥ 2 nx (Schwarz inequality) we have
≤ √|x| = √
x 1
|fn (x)| ≤ 2
1 + nx 2 n |x| 2 n
if x 6= 0. Also note that fn (0) = 0 for all n. Therefore fn (x) tends to uniformly to 0.
1−nx2
Now fn0 (x) = (1+nx 0
2 )2 , which tends to 0 if x 6= 0, though fn (0) = 1 for all n
119
Problem 11.24. Rudin Chapter 7, Problem 8: If
0 x ≤ 0
I(x) =
1 x > 0
P
if {xn } is a sequence of distinct points of (a, b), and if |cn | converges, prove that the
series ∞
X
f (x) = cn I(x − xn ) (a ≤ x ≤ b)
n=1
converges uniformly, and that f is continuous for every x 6= xn .
P
Solution. If |cn | converges then for any m ≥ n,
n
Xm X m
cj I(x − xj ) ≤ |cj | , ∀x ∈ [a, b]
j=n j=n
Thus, f is continuous at x.
120
Problem 11.25. Rudin Chapter 7, Problem 9
Let {fn } be a sequence of continuous functions which converges uniformly to a function
f on a set E. Prove that
lim fn (xn ) = f (x)
n→∞
for every sequence of point xn ∈ E such that xn → x and x ∈ E. Is the converse of this
true?
|fn (xn ) − f (x)| ≤ |fn (xn ) − fn (x)| + |fn (x) − f (x)| <
121
1
Problem 11.26. Let fn (x) = (1 + xn ) n for x ≥ 0. Does the sequence converge pointwise
on E = [0, ∞)? If so, find the limit function. Check whether or not the convergence is
uniform on E.
Solution. If 0 ≤ x ≤ 1 then
1 n1
(1 + xn+1 ) 1+n 1 + xn+1
fn+1 (x)
= ≤ ≤ 11/n = 1
fn (x) (1 + xn )1/n 1 + xn
Therefore {fn (x)} is monotonically decreasing for 0 ≤ x ≤ 1. Now if x > 1 then we write
n 1
fn (x) = x(1 + n1 ) n . Since 0 < x1 < 1 we conclude that
1
1
fn+1 x(1 + xn+1 ) n+1
= 1 ≤1
fn x(1 + x1n ) n
Therefore, the for x ∈ [0, ∞) fn is monotonically decreasing and bounded bellow by x
because 1 + xn ≥ xn ⇒ (1 + xn )1/n ≥ x for all x ≥ 0. Hence the sequence converges
pointwise for each x ∈ [0, ∞).
For x > 1,
1
lim (1 + xn )1/n = x lim (1 + n )1/n = x.
n→∞ n→∞ x
For x < 1,
lim (1 + xn )1/n = 1.
n→∞
Now to determine uniform convergence. First consider the case x > 1
d (1 + xn )1/n xn
(1 + xn )1/n − x = (1 + xn )1/n−1 xn−1 − 1 = −1
dx x(1 + xn )
Observe that,
n n n2 n
(1 + x ) = x + (xn )n−1 + . . . · · · + 1
1
2
(1 + xn )n ≥ xn + (xn )n−1
2
xn (1 + xn )n ≥ xn (xn + (xn )n−1 )
2
xn (1 + xn )n ≥ xn (xn + 1)
x(1 + xn ) ≥ xn (1 + xn )1/n
xn (1 + xn )1/n
≤1
x(1 + xn )
xn (1 + xn )1/n
−1<0
x(1 + xn )
Therefore the function is decreasing and hence its maximum occurs at x = 1. Therefore
Mn = 21/n − 1 → 0 and so fn → x uniformly.
122
Now consider the case when x ≤ 1
123
Problem 11.27. Let {fn } be a sequence of continuous real functions on R, and that
fn → f uniformly on R. Let gn (x) = fn (x + n1 ) for all n = 1, 2, . . . . . . , and x ∈ R. Show
that {gn } converges uniformly to f on any bounded interval [a, b].
Solution. Since fn is continuous on a compact set [a, b], we can assert that fn is uniformly
continuous on [a, b]. Hence for given > 0 there is δ > 0 such that
124
Problem 11.28. Consider the series
∞
X 1
f (x) = .
n=1
1 + n2 |x|
Solution.
(a) For x = 0 the given series diverges.
For x 6= 0 we get
∞ ∞
X 1 1 X 1
2
= 1
n=1
1 + n |x| |x| n=1 n +
2
|x|
1 1
Since 1
n2 + |x|
< n2
by comparison test we can say that the given series converges.
(b) For any intervals of the form [a, b] with either a > 0 or b < 0 we get,
1 1 1
| 2
|≤ 2
≤ 2 forc = max(|a|, |b|)
1 + n |x| 1+n c nc
Since ∞ 1
P
n=1 n2 c < ∞ by Weierstrass M test the series convergence uniformly.
Now consider the interval (0, b]
Suppose the series converges uniformly in (0, b]. Then the sequence of partial sum sn =
Pn 1
n=1 1+n2 |x| converges uniformly. By Cauchy criterion of uniform convergence there
exists N ∈ N such that
n
1 X 1 1
|sn − sm | < ⇒ | 2
|< for ∀n > m ≥ N, ∀x ∈ (0, b]
3 k=m+1
1 + n |x| 3
But this is not true for x = N12 . Hence the series is not uniformly convergent on the
interval of the form (0, b].
(c) 1+n12 |x| is a sequence of continuous functions. So (by the corollary after the theorem
of uniform convergence and continuity) f is continuous on the intervals where the series
uniformly converges to f .
(d) The function f is not bounded. For example lim f (x) = ∞.
x→0
125
n
Problem 11.29. For each positive integer n, let fn (x) = n2 +xn
. Show that the sequence
{fn } converges uniformly to f (x) ≡ 0 on E = [0, ∞)
126
12. Differential Calculus and Banach Space
Definition 12.1. A linear map or linear operator T between real (or complex) linear
spaces X, Y is a function T : X → Y such that
Definition 12.2. Let X and Y be two normed linear spaces with norms k·kX and k·kY ,
respectively. A linear map T : X → Y is bounded if there exists a constant M ≥ 0 such
that
kT xkY ≤ M kxkX , ∀ x ∈ X.
If no such constant exists, then we say that T is unbounded. If T : X → Y is a bounded
linear map, then we define the operator norm kT k of T by
We denote the set of all linear maps T : X → Y by L(X, Y ), and the set of all bounded
linear maps T : X → Y by B(X, Y ). When the domain and range spaces are the same,
we write L(X) and B(X).
Theorem 12.2 (Bounded linear transformation). Let X be a normed linear space and Y
a Banach space. If M is a dense linear subspace of X and T : M ⊂ X → Y is a bounded
linear map, then there exists a unique bounded linear map T̄ : X → Y such that T̄ x = T x
for all x ∈ M and
T̄
= kT k.
Definition 12.3. Two linear spaces X and Y are linearly isomorphic if there is a one-
to-one, onto linear map T : X → Y . If X and Y are normed linear spaces and T, T −1
are bounded linear maps, then X and Y are topologically isomorphic. If T also preserves
norms, meaning kT xkY = kxkX for all x ∈ X, then X and Y are isometrically isomorphic.
Theorem 12.3. If X is a normed linear space and Y is a Banach space, then B(X, Y )
is a Banach space with respect to the operator norm.
Definition 12.5. A function f : (a, b) → X from an open interval (a, b) of real numbers
into a Banach space X is differentiable at t ∈ (a, b) with derivative f 0 (t) ∈ X if the
following limit exists in X:
f (t + h) − f (t)
f 0 (t) = lim .
h→0 h
The function f is continuously differentiable in (a, b) if f 0 : (a, b) → X is continuous.
Theorem 12.9 (Chain Rule). Suppose that X, Y, and Z are Banach spaces, and f : U ⊂
X → Y and g : V ⊂ Y → Z, where U and V are open subsets of X and Y , respectively. If
f is differentiable at x ∈ U and g is differentiable at f (x) ∈ V , then g ◦ f is differentiable
at x and
(g ◦ f )0 (x) = g 0 (f (x))f 0 (x).
f (x + h, y + k) = f (x, y) + Ah + Bk + o(h, k)
(f −1 )0 (f (x)) = [f 0 (x)]−1 .
Theorem 12.11 (Implicit function theorem). Suppose that X, Y , and Z are Banach
spaces, and F : U ⊂ X × Y → Z is a continuously differentiable map defined on an open
subset U of X × Y . If (x0 , y0 ) ∈ U is a point such that F (x0 , y0 ) = 0, and Dy F (x0 , y0 ) :
Y → Z is a one-to-one, onto, bounded linear map, then there is an open neighborhood
V ⊂ X of x0 , an open neighborhood W ⊂ Y of y0 , and a unique function f : V → W
such that
F (x, f (x)) = 0 ∀ x ∈ V.
The function f is continuously differentiable, and
129
13. Problems on Differentiation
prove that (the Gateaux derivatives) Dx f (x, y) and Dy f (x, y) exist everywhere in R2 even
though f is discontinuous at (0, 0).
Solution. For (x, y) 6= (0, 0), the existence of the derivative follows from the standard
rules of differentiation. By symmetry, we can easily determine both partial derivatives
with one computation.
f (t, 0) − f (0, 0) 0
Dx f (0, 0) = lim = lim = Dy f (0, 0).
t→0 t t→0 t
Thuse Gateaux derivatives Dx f and Dy f exists everywhere even though f is clearly not
continuous at (0, 0) because the limit lim f (x, y) along x axis is 0 but the same limit
(x,y)→(0,0)
1
along x = y line is 2
.
130
Problem 13.2. Suppose that f : A ⊂ Rn → R where A is an open set and the partial
derivatives D1 f, . . . , Dn f are bounded in A. Prove that f is continuous in A.
By the Mean Value Theorem for 1-D functions, we have that there exists ci in the
interval defined by xi and yi such that
f y (i) − f (y i−1 ) = |f (y1 , . . . , yi−1 , xi , . . . , xn ) − f (y1 , . . . , yi , xi+1 , . . . , xn )| = |Di f (ci )(xi − yi )| < M δ
131
Problem 13.3. Suppose that f : A ⊂ Rn → R is differentiable, where A is an open set
and that f has a local maximum at a point x ∈ A. Prove f 0 (x) = 0.
132
Problem 13.4. Suppose that f : A ⊂ Rn → R is differentiable, where A is an open
connected set and f 0 (x) = 0 for every x ∈ A. Prove that f is constant in A.
So, hi (yi ) = f (y (i) ) and hi (xi ) = f (y (i−1) ) Since f is differentiable in A it is obvious that
hi is differentiable in the interval defined by xi and yi .
133
Problem 13.5. Rudin Exercise 9.17
Let f : R2 → R2 be defined by
! !
f1 (x, y) ex cos y
f (x, y) = = .
f2 (x, y) ex sin y
(a) Show that the range of f is R2 \ {(0, 0)}.
(b) Show that the Jacobian of f is non-zero on R2 . Thus, every point of R2 has a
neighborhood in which f is 1-1, but f is not 1-1 on R2 .
(c) Let (x̄, ȳ) = (0, π/3) and (ū, v̄) = f (x̄, ȳ). Let g = f −1 denote the continuous inverse
of f defined in a neighborhood of (ū, v̄) such that g(ū, v̄) = (x̄, ȳ). Find an explicit
formula for g, compute f 0 (x̄, ȳ), g 0 (ū, v̄) and show that g 0 (f (x))f 0 (x) = IR2 .
(d) What are the images under f of lines parallel to the coordinate axes?
√
Solution. (a) If (u, v) 6= (0, 0), chose x = ln u2 + v 2 . Notice that √u2u+v2 ≤ 1 and
so it is possible to choose y so that
u
cos y = √
u + v2
2
then
v
sin y = √ .
u2
+ v2
It is obvious from the equations defining x and y that u = ex cos y and v = ex sin y.
Hence every point except (0, 0) is the range of f . The point (0, 0) is not in the
range since
u2 + v 2 = e2x > 0
for any point (u, v) = f (x, y).
(b) The Jacobian of f (x, y) is
" #
x x
e cos y −e sin y
x x
= e2x 6= 0.
e sin y e cos y
However, since f (x, y) = f (x, y + 2π), follows that f is not one-one in R2 .
√it
(c) By our definition, b = f (0, π/3) = 12 , 23 . We can therefore take y = arctan v
u
near b, the arctangent being between −π/2 to π/2. Thus we have
√ v
g(u, v) = ln u2 + v 2 , arctan .
u
We then have, " #
u v
g 0 (u, v) = u2 +v 2
−v
u2 +v 2
u
u2 +v 2 u2 +v 2
When we take u = ex cos y and v = e sin y, we find that
x
" #
−x −x
e cos y e sin y
g 0 (f (x, y)) =
−e−x sin y e−x cos y
134
Therefore " #
1 0
g 0 (f (x, y))f 0 (x, y) =
0 1
(d) The family of lines x = c parallel to y-axis maps to the family of concentric circles
centered at origin with radius ec . The lines y = c parallel to the x axis maps to
rays starting from origin with the angle c − 2nπ for n = 0, 1, . . . . . . with positive
horizontal axis.
135
Problem 13.6. If X = Y = Z = R in the implicit function theorem, interpret the
theorem and its proof graphically.
136
Problem 13.7. Define f : R3 → R by f (x, y, z) = x2 y+ex +z. Show that f (0, 1, −1) = 0,
Dx f (0, 1, −1) 6= 0, and that there exists a differentiable function g in some neighborhood
of (1, −1) in R2 such that g(1, −1) = 0 and f (g(y, z), y, z) = 0. Find Dy g(1, −1) and
Dz g(1, −1).
137
Rb
Problem 13.8. Suppose f ≥ 0, f is continuous on [a, b], and a
f (x) dx = 0. Prove that
f (x) = 0 for all x ∈ [a, b].
138
Problem 13.9. Let p and q be positive real numbers such that 1/p + 1/q = 1. Prove
the following statements.
(a) If u ≥ 0 and v ≥ 0, then
up v q
uv ≤ + ,
p q
p q
and equality holds if and only if u = v .
Rb Rb Rb
(b) If f, g ∈ R([a, b]), f, g ≥ 0, and a f p = 1 = a g q , then a f g ≤ 1.
(c) If f, g, ∈ R([a, b]), then
Z b Z b 1/p Z b 1/q
p q
f g ≤
|f | |g| .
a a a
139
hR i1/2
b 2
(1) For f ∈ R([a, b]) define kf k2 = a
|f | . Suppose f, g, h ∈ R([a, b]). Prove the
triangle inequality
140
(2) Show that for any f ∈ R([a, b]) and > 0 that there exists g ∈ C([a, b]) such that
kf − gk2 < .
141
Problem 13.10. Rudin Exercise 9.7
Suppose that f is a real valued function defined in an open set E ⊂ Rn , and that the
partial derivatives D1 f, . . . . . . , Dn f are bounded in E. Prove that f is continuous in E.
Solution. Fix x ∈ E and > 0. Since E is open, there is an open ball S0 ⊂ E, with
center at x and radius r. Let M = max{D1 f (x), . . . . . . , Dn f (x)}. Choose
x∈E
δ = min{r, }.
(n + 1)M
P
The open ball S ⊂ E centered at x and radius δ. Suppose y − x = hj ej with |h| < δ.
Put v0 = 0 and vk = h1 e1 + . . . · · · + hk ek , for 1 ≤ k ≤ n. Then
n
X
f (y) − f (x) = [f (x + vj ) − f (x + vj−1 )] .
j=1
Since vk < δ for 1 ≤ k ≤ n and since S is convex, the segments with end points x + vj−1
and x + vj lie in S. Since vj = vj−1 + ej hj , the mean value theorem shows that the jth
summand is equal to
jj (Dj f )(x + vj−1 + θj hj ej )
for some θj ∈ (0, 1).
n
X n
X
|f (y) − f (x)| ≤ M |hj | ≤ M δ < .
j=1 j=1
Which shows that |y − x| < δ implies |f (y) − f (x)| < and hence f is continuous.
142
Problem 13.11. Rudin Exercise 9.8
Suppose f is differentiable real function in an open set E ⊂ Rn , and that f has a local
maximum at a point x ∈ E. Prove that f 0 (x) = 0.
Definition 13.1. Let f be a real function defined on a metric space X. We say that f
has a local maximum at a point p ∈ X if there exists δ > 0 such that f (q) ≤ f (p) for all
q ∈ X with d(p, q) < δ.
Let u be any vector in Rn . Consider the real valued function φ(t) = f (x + tu) defined
near t = 0. The function φ(t) is differentiable by the Chain rule, and has a maximum
at t = 0. Therefore φ0 (0) = 0 which implies, by chain rule, f 0 (x)(u) = 0. Since u is
arbitrary, it follows by the definition of zero linear transformation that f 0 (x) = 0.
143
Problem 13.12. Rudin Exercise 9.9
If f is differentiable mapping of a connected open set E ∈ Rn into Rm , and if f 0 (x) = 0
for every x ∈ E, prove that f is constant in E.
C is open.
Let x ∈ C. Then f (x) = f (x0 ). Since x ∈ E and E is an open set, there is a neighborhood
B (x) ⊂ E for some > 0. Let y ∈ B (x). So, [x, y] ⊂ E and hence by Mean Value
Theorem,
|f (x) − f (y)| ≤ kf 0 (z)k |x − y|
for some z ∈ [x, y]. By the given hypothesis, |f (x) − f (y)| ≤ 0 ⇒ f (x) = f (y) = f (x0 )
and hence y ∈ C. Therefore B (x) ⊂ C and hence C is open.
C is closed.
Let x ∈ E \ C. Therefore f (x) 6= f (x0 ). Since E is open B (x) ⊂ C for some > 0.
Let y ∈ B (x). So, [x, e] ⊂ E and using Mean Value Theorem we can show that f (x) =
f (y) 6= f (x0 ) and therefore y ∈ E \ C. Hence B (x) ∩ C = ∅ which implies that x can
not be a limit point of C. Since x is arbitrarily chosen we conclude that C is closed.
Since E is connected the only subset of E that is open and closed is the set E itself.
Hence C = E and therefore f (x) = f (x0 ) for all x ∈ E and therefore f is constant.
Solution.
|f (t)| = 1 ⇒ f (t).f (t) = 1
Differentiating and using product rule
f 0 (t).f (t) = 0
144
Problem 13.14. Rudin Exercise 9.14
Define f (0, 0) = 0 and
x3
f (x, y) = 2 , if (x, y) 6= (0, 0).
x + y2
(a) Prove that D1 f and D2 f are bounded function in R2 .
(b) Let u be any unit vector in R2 . Show that the directional derivative (Du f )(0, 0)
exists, and that its absolute value is at most 1.
(c) Let γ be a differentiable mapping of R1 into R2 , with γ(0) = (0, 0) and |γ 0 (0)| > 0.
Put g(t) = f (γ(t)) and prove that g is differentiable for every t ∈ R1 . If γ ∈ C 1 ,
prove that g ∈ C 1 .
(1) In spite of this, prove that f is not differentiable at (0, 0).
Du f (0, 0) = a3
and
|Du f (0, 0)| = a3 ≤ 1
Since both the partial derivatives are continuous in R2 possibly at origin, the function
f is differentiable every where except possibly at origin. and So by the chain rule g is
differentiable everywhere except possib
145
Problem 13.15. Rudin Exercise 9.19
Show that the system of equations
3x + y − z + u2 = 0
x − y + 2z + u = 0
2x + 2y − 3z + 2u = 0
can be solved for x, y, u in terms of z; for x, z, u in terms of y; for y, z, u in terms of x;
but not for x, y, z in terms of u.
2 2 −3 2
And the matrices to consider are, for x, y, u in terms of z,
3 1 2u
1 −1 1
2 2 2
which has determinant 8u − 12. As points we invert around have values u = 0 or u = 3,
this is invertible on both cases and so we may solve for x, y, u in terms of z. For solving
for x, z, u in terms of y, the matrix to consider is
3 −1 2u
1 2 1
2 −3 2
which has determinant 21 − 14u. As before, this is invertible for u = 0 or u = 3. Lastly,
for solving for y, z, u in terms of x, the matrix to consider is
1 −1 2u
−1 2 1
2 −3 2
with determinant 3 − 2u. As before, this is invertible for u = 0 or u = 3.
146
14. List of Problems
Problem 3 For f, g : [0, 1] → R, let d1 (f, g) = supx∈[0,1] {x2 |f (x) − g(x)|}, d2 (f, g) =
R1
supx∈[0,1] |f (x) − g(x)|, and d3 (f, g) = 0 |f (x) − g(x)| dx. Prove that d1 , d2 , and d3 de-
fine metrics on the linear space of C([0, 1]) of continuous functions f : [0, 1] → R.
Problem 4 Show that Rn with d(x, y) = kx − yk∞ is a metric space, where kxk∞ =
supxi |xi | for i = 1, 2, . . . , n.
Problem 5 Consider the convergence of sequences (xn ) = (ξn,1 , ξn,2 , ξn,3 , · · · ) to a point
y = (η1 , η2 , η3 , · · · ) in `2 . Show that if xn → y, then ξn,i → ηi for i = 1, 2, 3, · · · . But,
construct an example that shows that ξn,i → ηi for i = 1, 2, 3, · · · does not imply that
xn → y. (This is similar to the idea of pointwise convergence not guaranteeing metric-
convergence for sequences of functions.) Consider the Hilbert Cube subspace of `2 defined
by,
H = x = (ξ1 , ξ2 , ξ3 , · · · ) : x ∈ `2 and |ξi | ≤ 1/i, i = 1, 2, 3, · · · .
Problem 6 Let p ≥ 1 be a fixed real number. The real space `p is defined such that
x ∈ `p is a sequence of real numbers x = (ξj ) = (ξ1 , ξ2 , ξ3 , · · · ) such that ∞ p
P
j=1 |ξj | < ∞.
For x, y ∈ `p , where x = (ξj ) and y = (ηj ), let d(x, y) be defined by
∞
!1/p
X
d(x, y) = |ξj − ηj |p .
j=1
Problem 10 Let (xn ) and (yn ) be Cauchy sequences in a metric space (X, d). Show
that (d(xn , yn )) converges whether or not (xn ) and (yn ) converge.
Problem 11 Let (X1 , d1 ) and (X2 , d2 ) be two complete metric spaces. Is the product
metric space X1 × X2 complete?
Problem 12 Prove that a metric space X is complete if and only if the intersection
of every descending sequence of closed balls whose radii approach zero consists of a single
point.
Problem 13 For f, g : [0, 1] → R, let d1 (f, g) = supx∈[0,1] {x2 |f (x) − g(x)|}, d2 (f, g) =
R1
supx∈[0,1] |f (x) − g(x)|, and d3 (f, g) = 0 |f (x) − g(x)| dx. Prove that (C([0, 1]), d1 ) is
not complete but (C([0, 1], d2 ) is complete (this requires recalling some useful results from
elementary analysis that we will revisit in more generality in lecture 4). Since these met-
rics can be defined by norms, one choice of norm produces a Banach space, while the
other does not (this happens on infinite dimensional spaces where norms are not always
equivalent). If we use d3 is the resulting metric space complete?
Problem 14 Prove that a discrete metric space X is separable if and only if X is count-
able. (A discrete metric space is any set X with the discrete metric d(x, y) = 0 if x = y
and d(x, y) = 1 if x 6= y.)
Problem 16 Let E 0 be the set of all limit points of a set E ⊂ X where (X, d) is a
metric space. Prove that E 0 is closed. Prove that E and Ē have the same limit points.
Do E and E 0 always have the same limit points?
148
Problem 17 Let A1 , A2 , A3 , . . . be subsets of a metric space.
(a) If Bn = ∪ni=1 Ai , prove that B̄n = ∪ni=1 Āi for n = 1, 2, 3, . . ..
(b) If B = ∪∞ ∞
i=1 Ai , prove that ∪i=1 Āi ⊂ B̄. Show, by an example, that this inclusion can
be proper.
Problem 18 Is every point of every open set E ⊂ R2 a limit point of E? Answer the same
question for closed sets in R2 .
Problem 21 Prove that every separable metric space has a countable base.
Problem 22 Prove that any uncountable set with the discrete metric is not second count-
able.
Problem 24 Let E be the set of all x ∈ [0, 1] whose decimal expansion contains only
the digits 4 and 7. Is E countable? Is E dense in [0, 1]? Is E compact? Is E perfect?
14.3. Compactness
Problem 1 Let f : A ⊂ R → R have the property that for every x ∈ A there is an > 0
such that
f (t) > if t ∈ (x − , x + ) ∩ A.
Show that if the set A is compact, then there is some c > 0 such that f (x) > c for all
x ∈ A.
Problem 2
Use compactness to show that if a function f : R → R is locally increasing at every
point in R, then f must be increasing. Here, locally increasing at a point x means there
exists δ > 0 such that f (s) < f (x) < f (t) whenever x − δ < s < x < t < x + δ.
Problem 4 Let (X, d) be a metric space with the discrete metric d. What subsets of
X are compact?
Problem 5 Describe an open cover of the open unit square {(x, y) : 0 < x < 1, 0 < y < 1}
that has no finite subcover.
Problem 6 Let (xn ) be a sequence in a metric space (X, d) that converges to a limit
x. Show the set {x1 , x2 , x3 , · · · } is compact.
Problem 7 Show that the product of two compact metric spaces with the product metric
is a compact metric space.
Problem 8 Let a, b ∈ R and a < b. Show that any closed ball in C([a, b]) is not compact
with the metric d(f, g) = supx∈[a,b] |f (x) − g(x)| for f, g ∈ C([a, b]).
Problem 9 Prove that every compact metric space K has a countable base, and that
K is therefore separable.
Problem 11 Let E be the set of all x ∈ [0, 1] whose decimal expansion contains only
the digits 4 and 7. Is E compact?
Problem 12 Let X be a metric space in which every infinite subset has a limit point.
Prove that X is separable and compact.
Problem 13
14.4. Continuity
Problem 1 Let X and Y be metric spaces and A ⊂ X. Suppose f maps A into Y and p
is a limit point of A. We say that f has a limit at p and write f (x) → q as x → p, or
limx→p f (x) = q if there is a point q ∈ Y with the property that for every > 0 there
exists a δ > 0 such that for all points x ∈ E with 0 < dX (x, p) < δ implies dY (f (x), q) < .
Prove the following theorems.
(a) limx→p f (x) = q if and only if limn→∞ f (pn ) = q for every sequence (pn ) ⊂ E such
that pn 6= p for all n and pn → p.
(b) If f has a limit at p, then the limit is unique.
(c) The function f is continuous at p if and only if limx→p f (x) = f (p).
Problem 2 Let f : R2 → R be defined
x421 x22 , (x , x ) 6= (0, 0),
1 2
f (x1 , x2 ) = x1 +x2
0, (x1 , x2 ) = (0, 0).
Show that limx→0 f (x, mx) = 0 for every m ∈ R but f is discontinuous at (0, 0). Interpret
this result.
Problem 3 Let C 1 ([a, b]) be the metric space of continuously differentiable functions on
[a, b] with metric
Let D : C 1 ([a, b]) → C([a, b]) be defined by D(f ) = f 0 . Prove that D is continuous.
Problem 4 Let C([a, b]) be the metric space of continuous functions on [a, b] with metric
Z b
d(f, g) = |f (t) − g(t)| dt.
a
Problem 5 Let f and g be continuous maps of a metric space X into a metric space Y
and let E be a dense subset of X.
Problem 6 Let A be a set and x a point in a metric space (X, d). Define the “distance
from x to A” to be
d(x, A) = inf d(x, y).
y∈A
(a) Show that for fixed A, the function f : X → R (with the usual metric on R) given by
f (x) = d(x, A) is continuous. (b) Show {x : d(x, A) = 0} = Ā.
Problem 10 Let (X, d) be a metric space and F, G ⊂ X with F closed, G open, and
F ⊂ G. Show that there is a continuous function f : X → R such that 0 ≤ f (x) ≤ 1,
f (x) = 1 for x ∈ F , and f (x) = 0 for x ∈ Gc .
Problem 11 Let f and g be continuous maps of a metric space X into a metric space
Y and let E be a dense subset of X. (a) Prove that f (E) is dense in f (X). (b) If
g(x) = f (x) for all x in a dense subset E of X, prove that g(x) = f (x) for all x ∈ X.
Explain why these results are important for our everyday experience with functions and
numbers.
Problem 12 (a) Show that the requirement in the definition of uniform continuity can be
rephrased as follows, in terms of diameters of sets: For every > 0 there exists a δ > 0
such that diam(f (E)) < for all E ⊂ X with diam(E) < δ. (b) Let E be a dense subset
of a metric space X, and let f be a uniformly continuous function into a complete metric
space Y defined on E. Prove that f has a continuous extension from E to X in two ways
152
using part (a) and then using Cauchy sequences.
lim d(pn , qn ) = 0.
n→∞
Problem 2 (a) Define what it means for a sequence of functions to be uniformly Cauchy
and prove that a uniformly convergent sequence of functions is uniformly Cauchy. (b)
Prove that every uniformly convergent sequence of bounded functions is uniformly bounded.
153
Here, we say that a sequence of real-valued functions (fn ) is uniformly bounded if there
exists M > 0 such that kfn k∞ ≤ M . (c) Show there exists a sequence of functions that
converges pointwise to the function that is identically 0, but each function in the sequence
is unbounded Hint: Consider the sequence {x/n} on [0, ∞).
Problem 3 (a) Prove that if the sequences of real-valued functions (fn ) and (gn ) converge
uniformly on A ⊂ X, then (fn + gn ) converges uniformly on A. (b) If fn and gn are also
bounded for each n ∈ N, prove that (fn gn ) converges uniformly on A. (c) Show that
the boundedness is necessary in (b) by constructing an example where (fn gn ) does not
converge uniformly (although it must converge pointwise).
Problem 4 Let (X, dX ) and (Y, dY ) be metric spaces, A ⊂ X, and (fn ) a sequence of
continuous functions from A to Y that converges to a function f : A → Y uniformly on
A. Given any x ∈ A, prove that limn→∞ fn (xn ) = f (x) for every sequence (xn ) in A with
xn → x. Construct an example showing the converse is not true, but if A is compact,
then the converse is true.
Problem 5 (General Arzelà Ascoli Theorem) If X is a compact metric space, (fn ) ⊂ C(K),
(fn ) is pointwise bounded and equicontinuous on X, prove that
n
∞
Problem 7 Is the set of functions x2 + 1+n
x n=1
taking R to R (with the usual metric)
equicontinuous on [0, 1]?
Problem 8 Compute and plot the Bernstein polynomials for 1/(1 + x) on [0, 1] of de-
grees 1, 2, and 3.
Problem 9 Assume that (fn ) is a sequence of functions with fn : [a, b] → R for all n
where we take the usual metric on [a, b] and R.
(a) Assume that {fn } is uniformly Lipschitz continuous on [a, b] with constant L. Prove
that {fn } is equicontinuous on [a, b].
(b) Assume that {fn } is uniformly Lipschitz continuous on [a, b] with constant L and
further that (fn (x)) is a uniformly bounded sequence of numbers for some a ≤ x ≤ b.
(1) Prove that (fn ) has a subsequence that converges uniformly on [a, b]. (2) Prove
the second assumption is needed with an example.
154
(c) Assume that (fn ) is a bounded subset of C([a, b]). Show that the sequence of functions
(Fn ) from [a, b] into R defined by
Z x
Fn (x) = fn (x) ds
a
contains a subsequence that converges uniformly on [a, b]. (This is quite a remark-
able result when considering the sequence of functions (sin(nx)) as an example of a
bounded sequence in C([a, b]) that fails to have any convergent subsequence.)
Problem 10 Suppose K = {x1 , . . . , xn } is a finite space with the discrete metric d. Show
C(K) is linearly isomorphic to the finite-dimensional space Rn with the ∞-norm (which
is just the maximum norm in finite dimensions).
Problem 13 Let X and Y be two metric spaces and A ⊂ X. Let (fn ) be a sequence
of functions from A to Y that converges to f pointwise on A. Prove the following theo-
rems.
(a) Let Mn = supx∈A dY (fn (x), f (x)). Prove that fn → f uniformly if and only if Mn →
0.
(b) If fn is continuous on A for each n, then f is continuous on A. This is a generalization
of the theorem in the notes.
(c) Suppose Y is complete, then fn converges uniformly on A if and only if for every > 0
there exists an integer N such that m ≥ N , n ≥ N , x ∈ E implies dY (fn (x), fm (x)) <
. Construct an example showing the necessity of Y being complete.
(d) Suppose Y is complete, and fn converges uniformly on A. Let x be a limit point of A
and suppose that limt→x fn (t) = yn for each n. Then (yn ) converges and limt→x f (t) =
limn→∞ yn . In other words, prove limt→x limn→∞ fn (t) = limn→∞ limt→x fn (t). Con-
struct an example showing the necessity of Y being complete.
R1
Problem 14 Prove that if f ∈ C([0, 1]) and 0 f (x)xn dx = 0 for all n ∈ N, then f (x) = 0
R1
on [0, 1]. Hint: If 0 f 2 (x) dx = 0, then a result from elementary real analysis states that
f ≡ 0. Consider a sequence of polynomials that converge uniformly to f and take the
product with f to get a uniformly convergent sequence to f 2 .
Problem 15 Let (X, d) be a metric space and pick any fixed but arbitrary a ∈ X. Define
155
the real-valued function fp for each p ∈ X by
where x ∈ X.
14.6. Differentiation
prove that (the Gateaux derivatives) Dx f (x, y) and Dy f (x, y) exist everywhere in R2 even
though f is discontinuous at (0, 0).
Rb
Problem 8 Suppose f ≥ 0, f is continuous on [a, b], and a
f (x) dx = 0. Prove that
f (x) = 0 for all x ∈ [a, b].
Problem 9 Let p and q be positive real numbers such that 1/p + 1/q = 1. Prove the
following statements.
(a) If u ≥ 0 and v ≥ 0, then
up v q
uv ≤ + ,
p q
p q
and equality holds if and only if u = v .
Rb Rb Rb
(b) If f, g ∈ R([a, b]), f, g ≥ 0, and a f p = 1 = a g q , then a f g ≤ 1.
(c) If f, g, ∈ R([a, b]), then
Z b Z b 1/p Z b 1/q
p q
f g ≤
|f | |g| .
a a a
157