Professional Documents
Culture Documents
Cesar E. Tamayo
Department of Economics, Rutgers University
ctamayo@econ.rutgers.edu
I Deterministic models 4
1 The Solow Model 5
1.1 Dynamics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.2 Balanced growth . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.3 The golden rule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.4 Quantitative implications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.5 Solow growth accounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2 Optimal growth 9
2.1 Optimal growth in discrete time . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.2 Assumptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.3 The sequential method: Lagrange . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
2.4 The recursive method: dynamic programming . . . . . . . . . . . . . . . . . . . . 10
2.4.1 The Envelope Theorem approach . . . . . . . . . . . . . . . . . . . . . . . 13
2.5 Balanced growth and steady state . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.6 Linearization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.7 Equilibrium growth and welfare theorems . . . . . . . . . . . . . . . . . . . . . . 16
2.8 Extensions to the optimal growth model . . . . . . . . . . . . . . . . . . . . . . . 18
2.8.1 Assets in the OGM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
2.8.2 The role of government in OGM . . . . . . . . . . . . . . . . . . . . . . . 19
2.9 Optimal Growth in continuous time . . . . . . . . . . . . . . . . . . . . . . . . . 21
2.9.1 Steady State . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
2.9.2 Tobins q . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
1
II Stochastic models 41
4 Stochastic Optimal growth 42
4.1 Uncertainty in the neoclassical OGM . . . . . . . . . . . . . . . . . . . . . . . . . 42
4.1.1 Non-stochastic steady state . . . . . . . . . . . . . . . . . . . . . . . . . . 43
4.1.2 Stationary distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
4.1.3 Log-linear approximation . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.2 Solution method 1: Blanchard-Khan . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.3 Impulse response functions (IRF) . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
5 RBC models 46
5.1 The baseline RBC model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
5.1.1 The general case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
5.1.2 CRRA utility and Cobb-Douglas production . . . . . . . . . . . . . . . . 47
5.1.3 The log-linear system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
5.2 Labor productivity (King, Plosser & Rebelo, 1988) . . . . . . . . . . . . . . . . . 48
5.3 Solution method 2: Sims GENSYS . . . . . . . . . . . . . . . . . . . . . . . . . . 50
5.4 Varieties of RBC models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
5.4.1 Asset pricing models (Lucas, Shiller) . . . . . . . . . . . . . . . . . . . . . 51
5.5 Calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
5.6 Estimation methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
5.6.1 Generalized method of moments (GMM) . . . . . . . . . . . . . . . . . . . 52
III Appendixes 56
A The dynamic programming method 57
A.1 Guess and verify . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
A.2 Value function iteration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
A.3 Solving for the policy functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
A.4 Properties of the BFE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
A.5 The Envelope Theorem: an application . . . . . . . . . . . . . . . . . . . . . . . . 62
2
Summary
These notes summarize the material of a rst semester graduate course in Macroeconomic
theory. The rst sections focus on deterministic growth models and models of overlapping
generations (OLG). Later sections are dedicated to stochastic models, including neoclassical
growth and real business cycles models. The appendixes cover some mathematical material
required for solving simple macro models. The notes are freely based on: Acemoglu (2008),
Romer (2001), Stokey and Lucas (1989), Ljungqvist and Sargent (2004), Dave and De Jong
(2011), Dixit (1990), Levy (1992) and lecture notes from Professor Roberto Chang from Rutgers
University. Naturally, all errors and omissions are my own.
A word on notation: Throughout these notes, x will be used to denote a specic solution
(optima), x will be used for steady states in dierence (dierential) equations and x ^ will be
used for ln (x=x). When applicable, upper cases will stand for economy-wide values of variables,
while lower cases will stand for per-capita (per-eective labor) variables. Finally, in stochastic
models E0 or simply E will denote unconditional expectations while Et will stand for expectations
conditional on information available at t:
3
Part I
Deterministic models
4
Chapter 1
In the original Solow model, time is continuous and the horizon is innite. Without loss of
generality (WLOG) assume that time is indexed t 2 (0; 1). At each point in time, there is only
one fnal good Y (t).
Assumption 1 The nal good is produced with Harrod-neutral or labour augmenting technology:
Assumption 2 F ( ) is twice di erentiable and F ( K; AL) = F (K; AL). This implies con-
stant returns to scale or no gains from specialization and that one can write the production
function in intensive form:
K
y = f (k) = F ;1
AL
Assumption 3 f (0) = 0; f 0 (k) > 0; f 00 (k) < 0, lim f 0 (k) = 0 and lim f 0 (k) = 1
k!1 k!0
Example 1 The Cobb-Douglas production function satises assumptions 1-3. To see this con-
sider:
and note that f ( k) = k = f (k). Also note that f 0 (k) = k 1 > 0 since > 0 and k 1 >
0: Likewise, f 00 (k) = ( 1) k 2 < 0 Furthermore lim k 1 = 1 and lim k 1 = 0 since
k!0 k!1
1 < 0:
1 K 1
Remark 1 Notice that: FK (K; AL) = K (AL)1 = AL = k 1
= fk (k)
5
1.1 Dynamics
Suppose that inputs grow as follows:
_
Labor: L(t) = nL(t) so that eln L(t) = L(t) = L(0)ent
_
Technology: A(t) = gA(t) so that eln A(t) = A(t) = A(0)egt
_
Capital law of motion: K(t) = sY (t) K(t)
To derive the last expression in intensive form apply the quotient rule and the product rule
to the expression:
d (K=AL) _
K(t) K(t) h i
= _
A(t)L(t) _
+ A(t)L(t)
dt A(t)L(t) 2
[A(t)L(t)]
sY (t) K(t)
= k(t)n k(t)g
A(t)L(t)
_
k(t) = sf (k(t)) k(t) [n + g + ]
_ Y_ (t)
k(t) = 0 ) y(t)
_ =0) =n+g
Y (t)
_ _
nally, note that K(t) Y (t)
L(t) = g = L(t) . That is, the economy reaches a Balanced Growth Path (BGP),
where each variable fY; K; A; Lg is growing at a constant rate.
c (t) = (1 s) f (k(t))
1 The generic notion of balanced growth path is a situation in which all variables growth at a constant rate
over time (though this rate need not be the same across variables). A special case of a balanced growth path is
a steady state, in which the growth rate of all variables is equal to zero.
6
To see what happens when the economy reaches the new BGP:
c = (1 s) f (k(t))
= f (k(t)) sf (k(t))
= f (k(t)) k(t) [n + g + ] by denition of BGP
f 0 (k(s; n; g; )) = (n + g + )
@c
so that @s = 0 (BGP-consumption is at its maximum) is called the golden rule level of capital,
kGold : Therefore, if k > kGold one has that f 0 (k) < f 0 (kGold ) = (n + g + ) and therefore the
economy can increase c by dis-saving.
Exercise 2 Suppose that f (k(t)) = k(t) . Show that for some , the Solow model can predict
overaccumulation of capital in the sense that k > kGold :
@c h i @ k(s; n; g; )
1
(s; n; g; ) = k (n + g + ) (1.3)
@s @s
1
so one needs to show that k (n + g + ) < 0 (and therefore @c=@s < 0). Using (1.1)
one has 1
s 1
k=
n+g+
and replacing k in the golden rule condition, it can be seen that < s ) k > kGold and the
Solow model predicts overaccumulation of capital.
@y @ k(s; n; g; )
= f 0 (k)
@s @s
@ k(s;n;g; )
to "quantify" @s it su ces to dierentiate implicitly the (BGP) equation of k_ = 0:
ds df (k) d (n + g + ) dk(s; n; g; )
f (k) + s = k(s; n; g; ) + (n + g + )
ds ds ds ds
@k dk(s; n; g; )
s f 0 (k) + f (k) = (n + g + )
@s ds
@k f (k)
=
@s (n + g + ) sf 0 (k)
substituting:
@y f 0 (k)f (k)
=
@s (n + g + ) sf 0 (k)
7
k[n+g+ ]
simplify multiplying by s
y and using y = f (k) and s = f (k)
from the equation k_ = 0 to
obtain:
s @y kf 0 (k)=f (k)
=
y @s 1 kf 0 (k)=f (k)
s @y k
=
y @s 1 k
Y_ = Fk K_ + Fk L_ + FA A_
Y_ Fk K_ Fk L_ FA A_
= + +
Y Y Y Y
Y_ KFk K _ LFk L AFA A_
_
= + +
Y Y K Y L Y A
Y_ K_ L_ A_
= "k + "L + "A
Y K L | {zA}
Y_ L_ K_ L_
= "k + ( "L 1) + X
Y L K L
_
Note that this equation cannot be estimated with data for K K and obtaining the residual as X
since the residual is correlated (by construction) with capital per worker. Instead, rearrange:
!
y_ K_ L_
X= "k
y K L
and now one has everything measurable in the RHS. This is the key equation of growth account-
ing used to measure Solows residual. Usually "k is the share of capital on the economy and in
a Cobb-Douglas like the example above, "k = :
8
Chapter 2
Optimal growth
2.2 Assumptions
Assumption 6 Assumptions 1-3 about f ( ) from section 1.1 hold.
Assumption 7 The objective function u( ) is continuous, twice di erentiable and satises the
Inada conditions: u(0) = 0; u0 (k) > 0; u00 (k) < 0; lim u0 (k) = 0 and lim u0 (k) = 1
k!1 k!0
Assumption 8 The constraint set fkt+1 j kt+1 f (kt ) + (1 )kt ct g is compact, convex.
Under these assumptions any organization of markets and production will yield the same
competitive equilibrium allocation. Hence the competitive equilibrium is unique and the rst
and second welfare theorems hold. That is, the competitive equilibrium will be Pareto e cient
and the planners problem can be descentralized as the outcome of a competitive equilibrium as
will be shown below.
9
2.3 The sequential method: Lagrange
The problem above can be approached by the innite-horizon Lagrange method:
1
X
t
L= fu(ct ) + t [f (kt ) + (1 )kt ct + kt+1 ]g
t=0
with F.O.C.:
@L t 0
= 0 =) u (ct ) = t (2.2a)
@ct
@L
= 0 =) t = t+1 (f 0 (kt ) + 1 ) (2.2b)
@kt+1
@L
= 0 =) ct + kt+1 = f (kt ) + (1 )kt (2.2c)
@ t+1
t+1 0
replacing t and using the fact that t+1 = u (ct+1 ) one obtains the Euler Equation:
Along with the resource constraint (F.O.C. (2.2c)) these two dierence equations fully charac-
terize the solution to the optimal plan. The boundary condition required for the solution to
(2.2c)-(2.3) to exist is the transversality condition:
t 0
lim t kt+1 = lim u (ct )kt+1 = 0
t!1 t!1
In fact, this problem can be seen to have only one control variable since choosing ct is
equivalent to choosing kt+1 given the combination of the resource constraint and the capital
accumulation equation. To be more precise notice that the problem is (2.4) is equivalent to:
10
Under familiar assumptions (see Appendix A), the solution to the Bellman equation, will yield
time-invariant, sate-dependent rules for consumtion and capital accumulation, i.e., policy func-
tions:
ct = h(kt ) (2.8)
kt+1 = g(kt ; ct ) = g(kt ; h(kt )) (2.9)
and notice that g( ) is precisely the state-transition function that results after consolidating the
two restrictions in (2.4); that is:
However, since (2.4) is a functional equation, one needs to solve for V ( ) in order to obtain
(2.8)-(2.9). There are mainly three approaches to solve for V ( ):
These three approaches are developed in Appendixes A.1-A.3, and some examples are pro-
vided. The main conditions for the existence of a unique solution, V ( ); to the BFE (2.4) are:
Condition 2 The control space and the state space are convex, compact sets,
Condition 3 The operator V 7! T (V ) in (2.4) maps the set of continuous, bounded, real-valued
functions M into itself.1
Condition 3 requires in turn that u ( ) ; f ( ) are continuous and bounded and that the corre-
spondence (kt ) = fct jct (1 )kt + f (kt ) kt+1 g is UHC, LHC, non-? and compact-valued.
Appendix A.4 provides the relevant proofs and also proves some additional properties of the oper-
ator T ( ) : Condition (iv) requires a contraction mapping; recall that a contraction is a mapping,
'; on a metric space (W; d) that satises d (' (f ) ; ' (g)) d (f; g) for all f; g 2 M and some
< 1: Since M above is a complete metric space, conditions (i)-(iv) would su ce for a unique
solution to the BFE since the Banach xed point theorem asserts that every contraction mapping
on a complete m.s. has a unique xed point, i.e., 9 V such that V = T (V ). Moreover, the
sequence dened by Vi+1 = T (Vi ) converges to the unique xed point V : Now, the Blackwell
conditions for an operator to be a contraction mapping are:
Monotonicity: ' > (w.r.t. box metric)) T (') > T ( ) whenever '; 2 M.
Discounting: for any constant function A = h( ), and ' 2 M one has T ('+A) T (')+ A
for some < 1:
1 In this case the assumption that V is bounded is redundand since the compactness of the control space
11
Both conditions are easily seen to hold in this case: Assuming that one obtains V ( ) by any
of the abovementioned methods, it is easy to obtain the F.O.C. for the problem (2.6):
V (kt ) = max [u(ct ) + V ((1 )kt + f (kt ) ct )]
ct
s:t: (2.12)
ct + kt+1 = kt
k0 given
the F.O.C is therefore:
1
= V 0 (kt+1 )
ct
1
= V 0 (kt+1 )
kt kt+1
If one guesses the form of V ( ) as:
V (kt ) = F + G log kt
so that one replaces for V 0 (kt+1 ) in the F.O.C.:
1 G
=
kt kt+1 kt+1
and using the resource constraint arrives to the policy functions (with undetermined coe cient
G):
G
kt+1 = k
1+G t
G
ct = 1 kt
1+G
now using this in the BFE:
G G
V (kt ) = F + G log kt = log 1 kt + F + G log k
1+G 1+G t
which solving for the undetermined coe cients F,G yields:
G =
1
log (1 )+ (1 ) log( )
F =
1
12
1
so that nally one can generate optimal plans fct ; kt+1 gt=1 from the fully specied policy func-
tions:
ct = (1 ) kt
kt+1 = ( ) kt
t+1 t+1
lim V 0 (kt+1 )kt+1 = lim =0
t!1 t!1 1
ct = h (kt )
kt+1 = g(kt ; ct )
= (1 )kt + f (kt ) h (kt )
dierentiating w.r.t. kt :
@u(h (kt ))
= u0 (ct ) = V 0 (kt+1 )
@h (kt )
and therefore:
@f (kt )
V 0 (kt ) = V 0 (kt+1 ) (1 +
@kt
@f (kt )
= u0 (ct ) (1 +
@kt
13
replacing in the F.O.C. one obtains once more the system of dierence equations that (under
the assumptions above) will characterize the solution to the RH problem:
Alternatively, one can use the policy functions (2.8)-(2.9) to express the Euler equation in terms
of kt :
u0 (g(kt )) = u0 (g(h(kt ))) [f 0 (h(kt )) + (1 )]
Finally, note that V 0 (kt+1 ) is something similar to a shadow price associated with the resource
constraint.
Remark 2 Note that in this problem it is the case that 6= 1 and therefore, f 0 (kt ) + 1 = Rt .
If one was to consider the case where = 1, as will be the case in some sections below then one
would have: f 0 (kt ) = rt = Rt :
Example 4 Consider the so-called AK model.under CRRA utility and full depreciation. The
social planners problem is:
1
X
t c1t
max
t=0
1
s:t: yt ct + it
yt = f (kt ) = Akt
it = kt+1
with F.O.C.:
u0 (ct ) + V 0 (kt+1 ) = 0
and envelope condition:
V 0 (kt+1 ) = u0 (ct+1 ) A
so the Euler equation becomes:
u0 (ct ) = u0 (ct+1 ) A
or, using the functional form for u (ct ) :
ct+1
= A
ct
14
A second order di erence equation that, without a (on k) that, without a terminal condition has
multiple solutions for any given k0 : The interest is in that which satises the TVC (2.7) which
in this case becomes (using the EC):
t+1 t+1 0
lim V 0 (kt+t ) kt+1 = lim u (ct+1 ) Akt+1
t!1 t!1
Now to nd conditions that ensure holding of the TVC note that in a BGP capital and consump-
tion grow at the same constant rate so kt+1 = kt and ct+1 = ct for some : Thus:
( ct ) 1=
= A) = ( A)
ct
which brings positive growth iif > 1=A. Next, rewrite u0 (ct+1 ) = ct = A and kt+1 = t+1
k0
in the TVC:
1= 1
then the TVC holds iif < 1 )if ( A) < 1: Hence by assuming that <A 1+ one can
ensure that there is balanced growth and the TVC holds.
A special case of a balanced growth path is a steady state, in which the growth rate of all
variables is equal to zero. From (2.13)-(2.14) one can compute the steady state by noting that
in the SS, xt = xt+1 = x for x = fc; k; yg. Hence:
c k = f (k) = y
2.6 Linearization
Next it is possible to study the behavior of the model around the steady state (SS). Recall that
in the SS, xt = xt+1 = x for x = [c; k]0 and x^t = (xt x)=x . So, linearize the system around
the SS. Recall that to linearize G(x; y) = 0 around the SS (x; y):
@G @G
(x; y)x x
^t + (x; y)y y^t = 0
@xt @yt
Linearizing (2.13):
c^t = c^t+1 + k^t+1 (2.15)
where division by u0 (c) on both sides has been used and the fact that 1= = f 0 (k) + (1 ) from
the SS and ; are the elasticities of u0 ( ) and f 0 ( ), respectively. Finally, the linear constraint
is linearized as:
ct + k k^t+1
c^ = f (k) + (1 ) k k^t
ct + k^t+1
!^ = [ +!+ 1] k^t (2.16)
15
where ! = yc , = ky and is the elasticity of f ( ):Now one can suppose that the linearized policy
functions are of the form:
c^t = ^
1 kt
k^t+1 = ^
2 kt
1 = +1 2 2
! 1 + 2 = [ +!+ 1]
and one can solve for the undetermined coe cients 1 ; 2 as functions of parameters of
the model ( ; !; ). Note that the rst of these equations will be a cuadratic one so one has
two solutions, from which one selects 2 < 1 since this is the only solution that satises the
transversality condition. With this log-linear policy functions and the "true" coe cients as
ct ; k^t+1 g1
functions of the parameters of the model, one can generate optimal sequences f^ t=0 , that
is sequences of the variables in deviation from SS form.
Households
The representative household maximizes lifetime discounted utility subject to its resource con-
straint. Households own the factors of production k; l and own the rms. For simplicity, suppose
there is full depreciation ( = 1). At each period, the RH receives income from renting all of its
available capital, working all its endowed labor and earning prots from the rms.2 With this
income, the RH and decides how much to consume and how much to invest (save):
1
X
t
max u(ct )
ct
t=0
s:t:
h
ct + kt+1 rt kth + wt lth + t = yth
Firms
Firms produce a single good by renting production factors from the RH and maximize prots
subject to their production technology:
1
X 1
X
max t = max pt ytf wt ltf rt ktf
t=0 t=0
s:t:
ytf F (ktf ; ltf )
where F ( ) is continuous, dierentiable, strictly increasing and homogeneous of degree one. Since
there is only one good in the economy, there are no relative prices and one can set pt = 1. Also,
2 The assumption that households work their entire endowment of labor reects the fact that there is no
disutility of labor in this model. The RBC models surveyed in the sections below relax this assumption so that
labor becomes in fact a choice variable.
16
since there is no discounting, lifetime prots are maximized , prots are maximized at every
period t:3
Equilibrium
For simplicity suppose that lth = 1: Then a competitive equilibrium consists of a set of prices
1 1
fpt = 1; wt ; rt gt=0 and allocations fkt ; lt = 1; yt ; ct gt=0 such that 8 t :
1. The rm maximizes prots. To do so, note that since F ( ) is strictly increasing, the
technology constraint will hold with equality ytf = F (ktf ; ltf ) . Thus, the F.O.C.s of the
rm are:
@ (ktf ; ltf )
= 0 =) wt = Fl (ktf ; ltf )
@ltf
@ (ktf ; ltf )
= 0 =) rt = Fk (ktf ; ltf )
@ktf
Next, replace the F.O.C.s for the rm in the prot function at t and recalling that lt = 1:
17
2.8 Extensions to the optimal growth model
2.8.1 Assets in the OGM
Recall the budget constraint for the RH is, in general:
kt+1 = (1 + rt )kt + wt lt + t ct
kt+1 = (1 + rt ) kt + wt ct + t (2.17)
| {z }
Rt = gross return
Now, allow for assest at that HH carry from previous periods. Note that in aggregate at = kt +bt
where we may have bt < 0 at some t. So we can re-write the ow budget constraint as:
ct + at+1 = Rt at + wt + t
ct at+1
+ = at + wt + t
Rt Rt
At this point one carries out forward substitution of at+1 from the equation for at+2 , then sub-
stitute the latter from the equation for at+3 and so on. For some nite T 1; the intertemporal
budget constraint (IBC) is given by:
XT XT
1 aT +1 1
ct + = (1 + r0 )a0 + (wt + t) (2.18)
t=0
R t RT t=0
R t
where:
t
Y t
Y
Rt = Rj = (1 + rj )
j=1 j=1
But since were assuming an innite horizon, we must prevent aRT T+1 ! 1 as T ! 1 (build
P1
debt forever) which would result in t=0 R1t ct ! 1: So we impose the additional no Ponzi
games condition:
aT +1
lim =0
T !1 RT
so that when the horizon is innite, taking limits on both sides of (2.18) and using the no-Ponzi
condition, the IBC can be expressed as:
X1 X1
1 1
ct = (1 + r0 )a0 + (wt + t) (2.19)
t=0
R t | {z } t=0
R t
| {z } | {z }
P V consumption = initial asset income + PV non-asset income
Note that a stream of consumption that satises the (IBC) also satises the ow constraint at
1
each t. To see this, consider a consumption plan f^ct gt=0 that satises the IBC. At some , by
(2.18) the household will have accumulated assets:
a +1 X 1
= (1 + r0 )a0 + (wt + t c^t )
R t=0
Rt
X1 1 1
= (1 + r0 )a0 + (wt + t c^t ) + (w + c^ ) (2.20)
t=0
Rt R
18
obviously since:
a X1 1
= (1 + r0 )a0 + (wt + t c^t )
R 1 t=0
Rt
X1 1 a
) (wt + t c^t ) = (1 + r0 )a0 +
t=0
Rt R 1
19
so that the IBC for the government is:
1
X t gt
(1 + r0 )b0
t=0
Rt Rt
X1 X1
wt + t gt
= (1 + r0 )k0 + (2.21)
t=0
Rt t=0
R t
where the denition of assets a0 = b0 + k0 has been used. This is a crucial result, for, it shows
that only the (PV) level of government spending matters and not the means through which it
is nanced (debt or taxes). This is naturally a Ricardian Equivalence statement.
The new IBC for the HH (2.21) can be used again in the Lagrangian as above to derive the
system of equilibrium conditions for the optimal growth problem. Furthermore, one can see that
for a given initial stock a0 , at any t :
kt + bt = at
= Rt a0
and since a0 is constant, " bt )# kt and/or " Rt which are both ways of crowding out.
Example 5 (OGM with assets and government) The problem can be stated as:
1
X
t
max u(ct )
ct
t=0
s:t:
at+1 = (1 + r)at + wt ct
so that the state variable is at and the control variable again ct : Note that this problem is not
well dened even with the transversality condition:
t+1
lim V 0 (at+1 )at+1 = 0
t!1
since it may happen that at+1 ! 1. Therefore, one needs the no-Ponzi condition introduced
above:
aT+1
lim =0
RT
T !1
so that the TVC holds. With the problem well specied, the solution can be found by solving:
with F.O.C.:
20
and envelope condition:
The continuous time problem is actually easier to solve using the tools of optimal control; a
review of The Maximum Principle and the Hamiltonian approach is presented in Appendix B.
Set up the (present-value) Hamiltonian:
t
H = u(c(t))e + (t) [f (k(t)) k(t) c(t)] (2.24)
where (t) is the co-state variable. The condition for c(t) to maximize the Hamiltonian is:
@H
i) = 0 =) u0 (c(t))e t
= (t) (2.25)
@c(t)
solving this yelds c (t) as a function of the co-state and parameters. Next, we can replace c (t)
in (2.24) to obtain the maximum value function of the Hamiltonian, H , dierentiate w.r.t. state
and co-state variables. Alternatively, simply state the Pontryagin conditions similar to those
derived in the Appendix B (B.8)-(B.9):
@H
ii) _ (t) = = (t) [f 0 (k(t)) ] (2.26)
@k(t)
_ @H
iii) k(t) = = f (k(t)) k(t) c(t) (2.27)
@ (t)
lim (t)k(t) = 0
t!1
are the three dierential equations (and terminal condition) that characterize the solution to
the HH problem.
21
so that replacing in (2.27) we get the two di erential equations on k and that characterize the
solution:
t
_ e
k(t) = f (k(t)) k(t)
(t)
0
_ (t) = (t) [f (k(t)) ]
Alternatively, one can solve the system in terms of dierential equations in c and k, which is
more consistent with the idea of policy rules described in previous sections. To do so, dierentiate
(2.25) w.r.t. time:
u00 (c(t))e t c(t)
_ e t u0 (c(t)) = _ (t) (2.28)
and replace in (2.26) to obtain:
u00 (c(t))e t
c(t)
_ e t 0
u (c(t)) = (t) [f 0 (k(t)) ]
u00 (c(t))e t
c(t)
_ e t 0
u (c(t)) = t 0 0
e u (c(t)) [f (k(t)) ]
lim (t)k(t) = 0
t!1
t 0
lim e u (c(t))k(t) = 0
t!1
Remark 3 Note that (t) is the shadow price of capital, i.e., it measures the impact of a small
increase in kt on the optimal value of the program. By comparison, V (kt ) is the value of of the
optimal program from t given the level of capital kt : Therefore, we have that:
(t) = V 0 (kt )
and note that _ (t) represents the appreciation of capital since its the change in the value of a
unit of the state variable.
Exercise 7 In order to make meaningful comparisons with the Solow model, reintroduce techni-
cal change and poppulation growth. (i) Write the equilibrium conditions of the OGM considerng
these features and (ii) Show that along the balanced growth path, k < kGold where kGold is the
Golden Rule level of (per-e ective-labor) capital in the Solow model.
22
Solution. (i) First, derive the analogue to (2.30) after reintroducing poppulation growth and
technological progress. To do so, write the constraints in absolute levels:
and thus:
_ K_ (t)
k(t) = k (t) (g + n)
A (t) L (t)
I (t) K(t)
= K (t) (g + n)
A (t) L (t)
= i (t) ( + g + n) k (t)
_
replace with i (t) = f (k(t)) c (t) so that k(t) = f (k(t)) c (t) ( + g + n) k (t) : Therefore
conditions (2.26) and (2.29) become:
@H
_ (t) = = (t) [f 0 (k(t)) g n]
@k(t)
c(t)
_ f 0 (k(t)) g n
=
c(t)
f 0 (k) = + +g+n
> +g+n
= kGold
2.9.2 Tobins q
Consider the following model of investment under adjustment costs. Assumptions 2 and 3 in
section 1.1 are satised. Theres a single nal good and therefore one can normalize its price
to 1. The problem is that of a RH which must decide how much to consume and how much
to invest in the representative rm at each given t. However, installing capital is costly. When
there are quadratic investment adjustment costs the problem can be stated as (for simplicity
ignore depreciation):
Z1
t
max e u(c(t))dt (2.31)
fc(t);I(t)g1
t=0
0
_
s:t. k(t) = I(t)
I 2 (t)
c(t) + I(t) = f (k(t))
2 k(t)
23
Note that in this problem, the control variables are c(t) and I(t) (or kt+1 in the OGM), while
the state variable is k(t). On what follows, the present-value optimization problem is solved
and then it is expressed in current value terms since the latter form lends itself to intuitive
interpretation. First, we get rid of c(t) by using the second constraint. Notice that we can do
this only because the constraint is specied with equality. Notice also that after eliminating this
constraint, the Lagrangian and the Hamiltonian are obviously the same so that in the language
of Appendix B, G ( ) dissapears and LI = HI : Thus, set up the present-value Hamiltonian:
I 2 (t)
H pv = e t
u f (k(t)) I(t) + (t)I(t)
2 k(t)
The F.O.C. w.r.t. the control is simply obtained:
t 0 I(t)
(t) = e u (c (t)) 1 + (2.32)
k(t)
Next, using the Pontryagin conditions corresponding to the present-value problem (B.8)-
(B.9):
" #
2
t 0 0 I(t)
_ (t) = e u (c (t)) f (k(t)) + (2.33)
2 k(t)
_
k(t) = I(t) (2.34)
Or, using the F.O.C. to solve for I (t) we can rewrite (2.34) as:
_ k (t) e t (t)
k(t) = 1
u0 (c (t))
And just as in the discrete time problem, the TVC is given by: limt!1 (t)k(t): Naturally,
with an explicit functional form for u, we could solve for c (t) ; I (t) using the F.O.C. (2.32)
and the constraint, replace this in (2.33)-(2.34) to obtain a pair of dierential equations on (t)
and k(t) that would characterize the solution to the problem.
An interesting avenue to take in this problem is to express the equilibrium conditions in
current-value terms. To do so, multiply (2.33) by e t on both sides (the other conditions do
not involve (t)) and dene q(t) = e t (t). Then, since q(t) _ = _ (t)e t + (t)e t , one has that
_ (t)e t = q(t)
_ q(t) and therefore the Pontryagin conditions can be written:
" #
2
I(t)
q(t)
_ q(t) = u0 (c (t)) f 0 (k(t)) + (2.35)
2 k(t)
_ k (t) q(t)
k(t) = 1 (2.36)
u0 (c (t))
Finally, using (2.35) we can arrive at:
" #
2
0 0 I(t)
q(t)
_ q(t) = u (c (t)) f (k(t)) +
2 k(t)
2 3
Z 1 2
I(t)
q(t) = e u (c(s)) 4f 0 (k(t)) +
(s t) 0 5 ds
t | {z } 2 k(t)
| {z }
disc. marg. util of output marg. prod. of k - marg. adj cost (2.37)
that is, Tobins q summarizes the informarion of the discounted social benet of installing an
additional unit of capital.
24
Chapter 3
Production is carried out by the use of capital, technology and "young" agents as the labor force
with Harrod-neutral production function:
F (Kt ; At Lt )
Moreover, production technology satises assumptions 1)-3) in section 1.1 and utility satises
assumptions 2)-4) in section 2.2. Technology follows an exogenous growth process:
At = (1 + g)At 1
Hence, there are three markets; nal goods, capital goods and labor. Markets are competitive
and for simplicity, there is full depreciation ( = 1). Acordingly, t = 0, FK = 1 + rt = Rt and
FL = wt : In period t, each HH from generation t works, receives (technology-enhanced) labor
income, consumes and saves1 :
At wt = c1;t + st
Generation ts savings are rented in the form of capital for production at t + 1 so that capital
available is:
Kt+1 = Lt st = St (3.1)
1 Since only "youngs" save on each period, there is no s
2;t ("olds" dont save), to simplify notation st =
s1;t =total savings of the economy at t:
25
and are returned with the corresponding rental income. Generation t (i.e. agent type 2 in period
t + 1) then consumes the proceedings:
c2;t+1 = Rt+1 st
= (1 + rt+1 )st
= (1 + rt+1 ) (At wt c1;t )
which is analogous to the one found in the OGM. Equations (3.3)-(3.4) are the pair of dierence
equations describing the solution to the typical generation t HH problem. Next, note that the
Euler equation can be expressed as:
u0 1
(c1;t ) = u0 1
(c2;t+1 ) 1
( ; u0 (c2;t+1 ); Rt+1 )
c1;t = u0 1
(c2;t+1 ) 1
( ; u0 (c2;t+1 ); Rt+1 )
At wt = c1;t + st
st = At wt u0 1 (c2;t+1 ) 1
( ; u0 (c2;t+1 ); Rt+1 )
st = (At wt ; Rt+1 )
(+) (?)
where is called the savings function. Consider a rise in labor income At wt , then, everything
else constant, the properties of u ( ) imply that consumption in both periods would rise, which
implies that st increases; thus the sign of @st =@At wt is unambiguous. However, consider a rise
in Rt+1 . There are two eects to consider. First, since the opportunity cost of consumption
in t rises, the HH may want to substitute current for future consumption (substitution eect).
Second, a rise in Rt+1 has an income eect since each unit saved yields higher return so the
HH will want to consume more on both periods. The total eect is ambiguous as is the sign of
@st =@Rt+1 :
Next, to derive the law of motion of capital come back to (3.1):
Kt+1 = Lt st = St
Kt+1 = Lt (At wt ; Rt+1 )
= Lt (At wt ; FK )
26
or in per-eective worker terms (i.e., dividing by At+1 Lt+1 since were deriving t + 1 capital):
at this point one needs to specify some functional form for utility and production since kt+1
shows up in both sides of the above equation and cannot be solved for explicitely.
At wt = c1;t + st
At wt
st = At wt
1+
st = At wt
1+
1 1
= k k
1+
27
that is, as in the growth models of the sections above, savings are a constant fraction of HH
income. Next, using the equation for capital:
st
(1 + n)kt+1 =
At+1
1
= At wt
At+1 1+
= wt
(1 + ) (1 + g)
= (kt kt )
(1 + ) (1 + g)
(1 )
kt+1 = k (3.7)
(1 + ) (1 + g)(1 + n) t
a policy function for capital accumulation. Equation (3.7) is the key equation of Diamonds
model unde log-utility and Cobb-Douglas production.
(1 )
k = k
(1 + ) (1 + g)(1 + n)
1
(1 ) 1
k = (3.8)
(1 + ) (1 + g)(1 + n)
y = k
(1 ) 1
=
(1 + ) (1 + g)(1 + n)
To obtain SS consumption rst note that cit is the amount consumed by one typical household
of generation i in its rst year of life. Since now the poppulation size is not normalized to 1 as
in the growth models of previous sections, in order to nd economy-wide consumption at t one
must compute:
Ct = Lt c1t + Lt 1 c2t
so that total consumption per (eective) worker in period t:
c2t
ct = c1t +
(1 + n)
now, using:
Ct = Yt St
ct = yt st
c = k (1 + n)k
so that: 1
(1 ) 1
(1 ) 1
c= (1 + n)
(1 + ) (1 + g)(1 + n) (1 + ) (1 + g)(1 + n)
28
3.1.3 Golden rule and dynamic ine ciency
As before, the golden rule for capital accumulation will follow:
f 0 (kGold ) = 1 + n
R = 1+n
r = n
that is, only when the interest rate equals the rate of poppulation growth, capital is at its golden
rule level.2
The possibility of dynamic ine ciency arises by comparing (3.8) with (3.9):
?
k = kGold
1 1
(1 ) 1
? 1+n 1
=
(1 + ) (1 + g)(1 + n)
therefore, if k 6= kGold the current allocation of resources would be Pareto ine cient and the
planner could make every one else by rising/lowering investment (savings)
(1 )
kt+1 = [kt Gt ]
(1 + ) (1 + g)(1 + n)
which unambiguously leads to a lower k: The intuition is as follows: since the taxes are only on t,
then generation t is taxed only on its rst year of life. The HH would have to reduce consumption
in its rst period but since it wants to smooth consumption (under CRRA) it would have to
reduce its savings too, so that consumption in period t falls less than the full amount of taxes.
Consequently, savings fall and the economy moves towards kGold (which maximizes the SS level
of consumption). The Government in turn can reallocate the taxes as Gt to increase consumption
of those hurt and therefore increase economy-wide consumption.
Claim 8 In the OLG presented above, the Ricardian equivalence result does not hold in general.
2 Note that if 6= 1 then this condition becomes (1 + r ) = 1 + n or r = n:
29
To se why, suppose that in period t; Government purchases Gt are introduced and funded by
issuing one-period bonds bt = Gt . In turn, in period t + 1 the government levies a tax in order to
repay for the bonds, so t+1 = (1 + rt+1 )bt : In the OGM the RH would then save whatever the
government spends Gt , so that it yields reutrn (1 + rt+1 )Gt = t+1 . Therefore, the consumption
plan operates as if the government was funding its purchases via taxes in period t: Hence, the
irrelevance of distinguishing between taxes and bonds. On the other hand, in the OLG model,
at period t only the young agents care about future taxes; therefore, introducing Gt has real
eects on the consumption plan of generation t 1:
s:t:
c1;t + st + d At wt (3.11)
c2;t+1 Rt+1 (d + st ) (3.12)
Claim 9 Under the above assumptions and denitions, the HH problem with fully funded social
security is equivalent to the simple HH problem (3.2)-(3.3) of section 3.1
c1;t + st + d = At wt
c2;t+1
c1;t + d +d = At wt
Rt+1
c2;t+1
c1;t + = At wt
Rt+1
which is exactly the resource constraint (3.3). Hence, the problem is identical to that presented
in section 3.1
The intuition for this result is simple: if contributions are invested at market rates, then
they are simply a dierent way of saving. Therefore, the HH only needs to choose how much
it wants to save at t, then pay d as contributions and invest the remaining as st : Note that,
depending on the size of d; it may be optimal for the HH to set st = 0: Also notice that now the
amount invested (which matches exactly the amounf of capital available at t + 1 since = 1) is
st + d = (1 + n)kt+1
3 In this set up it is assumed that each HH of all generations make the same contribution, i.e., the case where
dt 6= dt+1 is ruled out. This possibility is explored in Acemoglu (2008) and in fact the case where dt is a choice
variable is discussed.
30
Pay-as-you-go social security. In this case, a HH from generation t contributes d in its
rst period of life. This amount is transfered in the same period to generation t 1 (the olds
at t) in the form of benets bt . In its second period of life, each HH of generation t receives the
contributions of generation t + 1 HH: bt+1 = (1 + n)d: Therefore, the (generation t) HH problem
is:
s:t:
c1;t + st + d At wt (3.14)
c2;t+1 Rt+1 st + (1 + n)d (3.15)
c2;t+1 (1 + n)
c1;t + d +d At wt
Rt+1 Rt+1
therefore, since the return on contributions is now (1 + n) rather than Rt+1 the problem is
equivalent to the simple model of 3.1 only if Rt+1 = (1 + n). Also notice that only st goes
into capital accumulation, rather than st + d as before. However, if the economy faces dynamic
ine ciency and overaccumulation of capital (i.e., Rt+1 < 1 + n) then PAYGO social security
results in capital accumulation that is lower by d, hence steering the economy again towards
the golden rule level of capital. Likewise, if d was not xed but a choice of the HH (or at least
a fraction of it), HH would prefer d to st as long as Rt+1 < 1 + n. This in turn would reduce
capital until rates of return again equalize.
s:t: (3.16)
ct + bt+1 yt At wt + Rt bt
where, as before:
wt = f (kt ) f 0 (kt )kt
and:
Rt = f 0 (kt )
moreover, assuming = 1, capital available for production in period t + 1 equals generation ts
wealth in that period, which was bequested to him by its parent HH bt :
31
where, Kt+1 =Lt+1 is the capital per-worker. Note that the constraint in (3.16) could be re-
written as:
ct + bt+1 At (wt + Rt kt )
Therefore, a HH from generation t 2 loosens its osprings resource constraint by bequesting
bt . Under this set-up, in each time period, only one type of HH decides how much to consume
and how much to save as bequest for its ospring. In turn, what the parent HH leaves as bequest
is used for production in t + 1 which constraints consumption of its ospring in that period.
Therefore, the model is akin that of the OGM of chapter 2, more specically, to that presented
in example 3. The generation t HHs problem can be summarized by the following BFE:
or:
V (bt ) = max fu(At (wt + Rt kt ) bt+1 ) + V (bt+1 )g
bt+1
with F.O.C.:
u0 (ct ) = V 0 (bt+1 )
u0 (ct ) = u0 (ct+1 )Rt+1
Therefore, all the results form chapter 2 apply, and, in particular, since the parent HH cares
about the osprings consumption, Ricardian equivalence is restored.
Lt + Lt 1 =1+1=2
Furthermormore, assume for now that there is no poppulation growth nor there is any produc-
tion. Instead, each agent is endowed with ! 1 when young and ! 2 when old. At the begining of
time (t = 0) generation 0 is already alive; it only lives one period and only consumes its endow-
ment. Assumptions 1)-4) in section 2.2 are satised. In an economy with borrowing/lending or
where endowments are either storable or denominated in money, agents could consume and save
at each period, thus facing the problem:
s:t:
c1;t + st ! 1
c2;t+1 ! 2 + Rt+1 st
s:t:
c2;t+1 !2
c1;t + !1 +
Rt+1 Rt+1
32
the Lagrangean for this problem would be:
c2;t+1 !2
L = u(c1;t ) + u(c2;t+1 ) c1;t + !1
Rt+1 Rt+1
u0 (c1;t )
= Rt+1
u0 (c2;t+1 )
Now, suppose that endowments are not storable and there exists no storable asset such as money
and just for simplicity let = 1. Under this set-up there would be no trade, borrowing/lending
or savings. To see why, rst notice that there would be no trade between generations. At any
given t, "olds" will never want to consume less but more so they would only be interested in
borrowing; on the other hand they would not be around in the next period to honor their debts
so "youngs" will not engage in any lending or temporary exchange in endowments with old
agents. Finally, there could not exist trade or borrowing/lending within generations since all
agents belonging to the same generation are identical. Therefore, an autarky equilibrium must
arise:
c1;t = !1
c2;t+1 = !2
that is, each agent must consume its entire endowment at every period. This is a trivial example
of a stationary equilibrium, i.e., that in which young agents from every generation have the
same level of consumption and old agents from every generation aslo have a constant level of
consumption. Naturally it is not necessarily the case that c1;t = c2;t+1 . Now, to support this
equilibrium, the autarky interest rate must satisfy:
u0 (c1;t ) u0 (! 1 )
RA = 0
= 0
u (c2;t+1 ) u (! 2 )
33
3.2.2 The role of money
Suppose now that the economy nds itself in a place where RA < Rt+1 . An agent in generation
f0g has endowment (! 2 ; M ) where M is the total supply of money, which is constant. In turn,
agent from generation t 1 faces the (free-trade) problem (with = 1):
s:t:
c1;t + st ! 1
c2;t+1 ! 2 + Rt+1 st
Now, the unit price of a nal good is Pt and the price of money in terms of goods (i.e. the
relative price of money) is qt = 1=Pt : Notice that as Pt ! 1, the value of money qt ! 0: Real
money balances are denoted mt = qt M = M=Pt : As usual, the return on money is the inverse
of ination, and since interest rates equalize:
qt+1 Pt
Rt+1 = =
qt Pt+1
and therefore:
mt+1
Rt+1 =
mt
Under this set up, in period 1 agents from generation f0g can exchange their endowment of
money for goods and generation f1g can save part of its endowment in the form of money. In
period 2 agents form generation f1g again exchange their saved money for goods with agents
from generation f2g and so on. The resource constraints are now:
M
c1;t + !1
Pt
M M
c2;t+1 ! 2 + Rt+1 ) c2;t+1 !2 +
Pt Pt+1
mt+1 M
St (Rt+1 ) = St = = qt M
mt Pt
or, using the fact that Rt+1 = qt+1 =qt one has:
qt+1
St = qt M
qt
which is a FODE that can be expressed as:
qt+1 = (qt )
34
Example 10 Consider the problem for generation t agent:
s:t:
M
c1;t + !1
Pt
M
c2;t+1 !2 +
Pt+1
Pt
= Rt+1
Pt+1
M 1 !2
St (Rt+1 ) = = !1
Pt 2 Rt+1
M 1 ! 2 Pt+1
= !1
Pt 2 Pt
!2 2M
Pt = Pt+1 +
!1 !1
notice that for this FODE to have a unique bounded solution (i.e., non-explosive/hyperination)
it is required that !
! 1 < 1: To solve forward rst:
2
!2 2M
Pt+1 = Pt+2 +
!1 !1
replace in the equation for Pt :
!2 !2 2M 2M
Pt = Pt+2 + +
!1 !1 !1 !1
2
!2 ! 2 2M 2M
= Pt+1 + +
!1 !1 !1 !1
35
so the solution to the di erence equation that determines the price level is:
T 1
X k
!2 !2 2M
Pt = lim Pt+T +
T !1 !1 !1 !1
k=0
1
X k
!2 2M !2
Pt = (assuming < 1)
!1 !1 !1
k=0
2M 2M ! 2
Pt = =
!1 1 !2 ! 1 ! 2 ! 21
!1
mt G
Rt =
mt 1
mt G
S (Rt+1 ) = S = mt
mt 1
so that G simply shifts the savings function. However, this may induce more than one non-trivial
SS (if, e.g., the savings function intersects the ordinate above 0). Now, in any steady state where
mt = mt 1 = m:
G m G
S (R) = S 1 = m and R =
m m
so that:
G = m (1 R)
G
G = S 1 (1 R)
m
This is a classical Laer curve equation. Since G is in both sides of this equation, and S 0 ( ) > 0,
G will have opposite eects, hence the bell shape of the Laer curve.
36
3.2.4 Monetary equilibria with money growth
Recall the equilibrium in an economy without at money was:
u1 (! 1 ; ! 2 )
St (Rt+1 ) = 0 and RA =
u2 (! 1 ; ! 2 )
mt+1
St = mt ) mt+1 = (mt )
mt
M M
Mt = arg max u ! 1 + u !2 + (HH optimize)
M 0 Pt Pt+1
and:
Mt Mt 1 = Pt Gt (Gvts constraint is satised)
37
problem:
where sjt (Rt+1 ) is the savings function for any type j agent from generation t. Thus, total
savings from type j agents would be Lj sjt (Rt+1 ) = Stj (Rt+1 ).
Example 11 Suppose log-utility and two types of generation t agents j = 1; 2.with mass Lj
each. Endowments ! 1t ; ! 1t+1 = ( ; 0) and ! 2t ; ! 2t+1 = (0; ) with ; positive constants.
Then in period t; type 1 agents will be lenders and type 2 agents will be borrowers. In period 1
savings functions are:
Next, introduce money through generation zero old agents (as before). For simplicity assume
that, unlike generations t 1; these agents are identical and each of them is endowed with M
units of at currency. Then:
n 3 A monetary
Denition o equilibrium for the economy summarized in (3.17) consists of se-
j
quences Pt ; Rt ; st such that 8t:
0 < Pt < 1
Pt
Rt =
Pt+1
!
1 ! j2
sjt (Rt+1 ) = ! j1 +
2 Rt+1
38
and:
N
X M
Lj sjt (Rt+1 ) =
j=1
Pt
In this economy, a monetary steady state implies P = Pt = Pt+1 which in turn implies
Rt+1 = 1. Thus a monetary equilibrium requires (as was seen before) positive savings at an
interest rate of 1.
Example 12 Continuiung with the previous example, allow for money. Then savings functions
remain:
s2t (Rt+1 ) =
2Rt+1
s1t (Rt+1 ) =
2
but the equilibrium (market clearing) condition is now:
M
= +
2
|{z} Pt 2Rt+1
|{z} | {z }
dem and for assets m on ey supply IO U s supply
Naturally, it is required that agents are indiferent between holding money and holding IOUs (i.e.,
lending) which implies that:
Pt
Rt+1 =
| {z } Pt + 1
return on IO U s
| {z }
return on m oney
:
39
and using Rt = Pt 1 =Pt ;replacing in constraint for Dt :
Mt Mt 2
Dt = Dt 2 Rt 1 Rt +
Pt
iterating back this procedure and assuming L0 = 0 one arrives at:
Mt M
Dt =
Pt
where M is the initial stock of money that would have prevailed if no OMO had been carried
out. Thus. (3.18) becomes:
XN
M
Lj sjt (Rt+1 ) =
j=1
Pt
which is the same expression found when there wese no IOUs purchases. Thus, the irrelevance
of open market operations.
40
Part II
Stochastic models
41
Chapter 4
with:
state at t : st = (kt ; At )
control at t : (ct ; kt+1 )
and:
s:t:
ct + kt+1 At f (kt ) + (1 )kt
where: X
Et V (kt+1 ; At+1 ) = V (kt+1 ; At+1 ) Pr(st+1 jst )
st+1 jst
42
and Pr(st+1 jst ) is the probability of st+1 conditional on having observed st : Assuming At has
the Markov property:
since the only source of uncertainty stems from At : The solution to this problem will yield again
time-invariant (i.e. stationary) state-dependent policy functions:
ct = h(At ; kt )
kt+1 = (At ; kt )
or:
Et Vk (kt+1 ; At+1 ) = Et fu0 (ct+1 ) [f 0 (kt+1 ) + (1 )]g
thus, the Euler equation and accumulation constraint:
are the pair of rst order stochastic dierence equation that characterize the solution to the
1
social planners problem. That is, a sequence fct ; kt+1 gt=0 that satises equations (4.5)-(4.6)
and the transversality condition:
t 0
lim E0 u (ct )kt+1 = 0
t!1
(kt ; A) kt+1 kt ; A
That is, if the non-stochastic steady state level for capital is locally asymptotically stable, there
will exist such starionary limiting distribution under the presence of small shocks.
43
4.1.3 Log-linear approximation
Approximating the dynamic system (4.5)-(4.6) along with the low of motion of technology yields:
where:
cu00 (c) kf 00 (k) kf 0 (k)
= = and =
u0 (c) f 0 (k) f (k)
Xt+1 = M X t + N at (4.10)
in this case there are two endogenous variables (c; k) and one exogenous a. Of the two endogenous
variables, one is pre-determined (k) and one is forward-looking (c) : Following Blanchard-Khan,
the existence of a unique bounded solution f^ ct ; k^t g1
t=0 to the system above requires that the
number of eigenvalues of M outside the unit circle equal the number of forward-looking variables.
In this case one requires j 1 j < 1 and j 2 j > 1 where 1 ; 2 are the eigenvalues of M:
Remark 5 If the number of eigenvalues lying outside the unit circle is greater than the number
of forward-looking variables, then the system has no bounded solution. On the other hand, if the
number of eigenvalues lying outside the unit circle is less than the number of forward-looking
variables the system may have many bounded solutions.
Remark 6 In larger systems the B-K cannonical representation can be expressed as:
k^t k^t
c^t = st = = 1 2 (4.11)
at at
k^t k^t
kt+1 = st = = 1 2 (4.12)
at at
44
for some matrices and . Furthermore note that:
k^t k^t 1 0
s^t = = 1 2
+ "
at 0 at 1 1 t
s^t = P st 1 + Q"t
0 st s^0t
= E^
0
= E (P s^t 1 + Q"t ) (P s^t 1 + Q"t )
0 2
0 = P 0P +Q Q0
where 2 = V ["t ] = E ["t "0t ]. That is, one can solve this discrete Lyapunov equation to obtain
the contemporaneous variance-covariance matrix of the state vector. From here it is possible to
obtain any two-period var-cov matrix:
j st s^0t+j = P j
= E^ 0
and:
ct c^0t =
E^ 0
0
Et st+1 = P s0
Et st+2 = P 2 s0
.. .
. = ..
Et st+1 = P j s0
From here it is straightforward to generate sequences for f^ct ; k^t+1 gTt=0 by the use of the policy
functions. Moreover, one could generate a series of histories of the variables in the system and
compute "empirical" variances and covariances that can be compared to those found analitically
in the previous section.
45
Chapter 5
RBC models
the F.O.C. for this problem now include the optimal intra-temporal allocation of labor-consumption
as well as the inter-temporal allocation of consumption-investment. The Lagrangian for this
problem is
1
X
t
L = E0 fU (Ct ; 1 Nt ) t [Ct + Kt+1 At F (Kt ; Nt ) (1 )Kt ]g
t=0
so that:
UC (Ct ; 1 Nt )
Et = Et fAt+1 FK (Kt+1 ; Nt+1 )g (Euler equation)
UC (Ct+1 ; 1 Nt+1 )
UC (Ct ; 1 Nt )
= At FN (Kt ; Nt ) (Labor supply)
UN (Ct ; 1 Nt )
Ct + Kt+1 = At F (Kt ; Nt ) + (1 )Kt (Constraint)
is the dynamical system that characterizes the solution to the social planners problem.
46
5.1.2 CRRA utility and Cobb-Douglas production
Consider the following explicit choice of functional forms:
1
X
t Ct1 N 1+'
max E0 (5.5)
ct ;kt+1
t=0
1 1+'
s:t:
Ct + Kt+1 Yt + (1 )Kt (5.6)
Yt = At Kt Nt1 (5.7)
At = At 1 e"t ; "t iid(0; 2
") (5.8)
k0 given
A = 1
1
K 1 1
= =
N
Y K
= =
N N
C
=
N
1. Euler equation:
( 1 1 1
)
K K K
c^t + ct+1 = Et ( 1) k^t+1 ( 1) n
^ t+1 + at+1
N N N
but since: 1 1
K 1 1
K
= ) =
N N
replace in the log-linear Euler:
n o
c^t + Et ct+1 = Et ( 1) k^t+1 + (1 )n
^ t+1 + at+1 (5.9)
2. To log-linearize the labor supply one can proceed in two ways. The approach that is most
useful for solving the model computationally would yield:
47
but note, in steady state:
K
C = (1 )A N' W
N
where W is the SS real wage. Thus, the log-linear equation for labor supply becomes:
which lends itself to a nice interpretation of the cyclical character of the real wage.
3. Resource constraint:
ct + K k^t+1 = Y a
C^ ^t + K N1 + (1 ) K k^t + (1 ) K N1 n
^t
C K K
c^t + k^t+1 = + (1 ) k^t + (1 )n
^t + a
^t (5.10)
Y Y Y
or, equivalently:
where:
1
1 K
#= =
N
4. Technology process:
at+1 = at + "t+1
Suppose that labor productivity is trended. There are two cases to consider. In the rst case,
labor productivity follows a deterministic trend and technology shocks aect overall production.
A typical household then faces the problem:
1
X h i
max E0 t
log C~t + log (1 Nt )
~t ;Nt
C
t=0
s:t:
Ct + I~t = Y~t
~
Y~t = At K~ t (Nt Xt )1
I~t = K~ t+1 (1 )K~t
"t
At = At 1e ; "t iid(0; 1)
where all variables are dened as before, and labor productivity Xt follows:
Xt
=1+
Xt 1
48
~ K;
The rst thing to note from the above formulation, is that in any balanced growth path C; ~ Y~ ; I~
will be trended (and as will be the real wage). Therefore, we rst proceed to de-trend these
variables, by:
Z~t ~ K;
~ Y~ ; I~
Zt = for Z = C;
Xt
The only visible changes are in the production function equation:
Yt = At Kt Nt 1
~ t+1 =Xt+1 we require:
and in the capital accumulation equation; since Kt+1 = K
I~t ~ t+1
K ~t
K
= (1 )
Xt Xt Xt
Xt+1
It = Kt+1 (1 ) Kt
Xt
= Kt+1 (1 + ) (1 ) Kt
From this point the analysis is just as before. The social planners problem is to choose
Ct ; Nt ; Kt+1 taken as given the state of capital (Kt ) and the technology (At ): The equilibrium
conditions can be found to be:
" #
At+1 Kt+11 Nt+1 1 1+
Et = (5.11)
Ct+1 Ct
1 Ct
(1 ) At Kt Nt = (5.12)
Nt
At Kt Nt 1 + (1 ) Kt = Ct + (1 + )Kt+1 (5.13)
as required, there are three equilibrium conditions and three variables whose path are endoge-
nously determined.
Suppose instead that the level of technology is static (A is a constant), but labor productivity
is subject to shocks:
Xt
= (1 + ) (1 + t )
Xt 1
where t is an iid productivity shock with zero mean stationary process. One can rst derive
the equilibrium conditions for the original system:
2 ! 1 3
K~ t+1 1 Et C~t+1
Et 4 A Xt+1 5 =
Nt+1 C~t
!
K~t ~
t Ct
(1 )A Xt1 =
Nt Nt
~ t Nt 1
AK + (1 ~t
)K = C~t + K
~ t+1
and de-trend these conditions. First, multimply both sides of Euler equation by Xt =Xt+1 :
2 ! 13
X K~ t+1 ~
Et 4
t
A 5 = Et Ct+1 Xt
Xt+1 Xt+1 Nt+1 C~t Et Xt+1
49
note that by assumption Et [Xt+1 ] = (1 + ) Xt :
2 ! 3
1
1 K~ t+1 Et Ct+1
Et 4 A 5 =
1+ Xt+1 Nt+1 Ct
" #
1
Kt+1 (1 + ) Et Ct+1
Et At+1 =
Nt+1 Ct
At Kt Nt 1 + (1 ) Kt = Ct + (1 + )Kt+1
Notice that the assumptions on the stochastic process t lead to the same equilibrium conditions
as those found for the case of deterministic trended labor productivity.
ct (1 )n
^t at = c^t 1 c;t +( 1) k^t + (1 ) n;t + a;t
0 xt = 1 xt 1 + zt + t (5.14)
h i0
^ t k^t+1 at , t = [ c;t
In this particular case xt = c^t n n;t 0 a;t ]
0
and zt = ["t ]:Therefore,
the input matrices for the numerical solution are:
2 3 2 3
(1 ) 0 1 0 ( 1) 0
6 (' ) 0 0 7 60 0 07
6 7 6 7
0 := 4 C 5 1 := 6 7
Y
(1 ) K
Y
1 40 0 + (1 )K
Y
05
1 0 0 0 0 0 0
2 3 2 3
0 (1 ) 0 1
607 6 0 0 0 07
=6 7
405 := 6
4 0
7
0 0 05
1 0 0 0 0
50
with this system at hand, one can proceed to implement Sims routine GENSYS (in Matlab)
as described in Sims (2002), and then obtain a solution for the model in the form:
1
X
xt = xt 1 + zt + AM s BEt zt+s+1 (5.15)
s 0
h i
^ t k^t+1 at as functions of the states.
which gives, as usual, a system of policy rules for c^t n
Again, one can proceed to either obtain moments analytically using the output matrices or
generate series to compute "empirical" moments.
Campbells mechanism
Hansens indivisible labor
The household choice variables at t are fCt ; tg while the states are f t 1 ; dt ; ! t g : The F.O.C
for this problem are:
U 0 (Ct+1 )
Pt = Et (dt+1 + Pt+1 )
U 0 (Ct )
Ct + Pt ( t t 1) = dt t 1 + !t
so that for given sequences of f t 1 ; dt ; ! t g ; a feasible allocation fCt ; t g and price system fPt g
that satises the FOC and TVC for the HH and clear markets will solve the planners problem.
51
Multi-asset enviroment.
Consider a simple extension of the above model in which households can hold shares from k
dierent risky assets and a riskless asset, B. The planners problem now becomes:
1
X
t
max E0 U (Ct )
t=0
s:t:
k
X k
X
Ct + Pjt ( jt jt 1 ) + Bt djt jt 1 + (1 + rt ) Bt 1 + !t
j=1 j=1
5.5 Calibration
A calibration exercise is best understood in an example. Consider the RBC model of section
5.1.2. The parameters to be calibrated in this model are:
52
can be expressed as (5.16) by:
( " # )
1
o At+1 Kt+1
o
Nt+1 1 o
1+ o
E =0
Ct+1 Ct
E Ct2 2
C ( o) = 0
E Nt2 2
N ( o) = 0
E Kt2 2
K ( o) = 0
E A2t 2
A ( o) = 0
to obtain the sample analogs of (5.16) suppose that a sample of T observation is at hand so that
one has Z = (Z1 ; Z2 ; :::ZT ) for Z = fC; N; K; Ag. Then since the sample mean of Z converges
in probability to its expectation, the analogue of (5.16) would be:
T
1X
g (Z; ) = f (Zt ; )
T t=1
since E [f (Zt ; 0 )] = 0, the objective becomes to choose so as to minimize the expression above.
Now, assuming for simplicity that = 1, in this particular problem there are exactly as many
parameters as there are moment conditions. Thus using sample averages in this case looks a lot
like a calibration exercise with the only advantage that in this case one obtains standard errors
for the parameters as well. In general, however, this exact identication will not occur. More
often, there would be more moment conditions than parameters to estimate and therefore the
problem becomes:
0
min g (Z; ) g (Z; ) (5.17)
where g (Z; ) is a vector of sample conditions.and is a weighting matrix that, ideally, woudl
give less weight to those moments with higher variance compared to the true parameters. How-
ever, since these true values are unknown, one can proceed recursively:
Hansen (1982) pointed out that in this enviroment central limit theorems apply and therefore:
p d 1
T ^GM M o !W N 0; [D D0 ]
so that for a given parameter vector, this procedure will yield variances for each component
of Z:.It is important to point out that, as in other empirical procedures and solution methods
presented before, it is required that the data for the components of Z is stationary. This can
be achieved by obtaining the "detrended" moment conditions as was done in section 5.2 (in
which case or + must be estimated) and then using detrended data (e.g. applying a
Hodrick-Prescott lter or any other cycle-trend lter).
With the resutls from this estimation procedure hypothesis testing can be carried out as
in any estimation exercise. For instance, t-statistics can be used to evaluate the statistical
53
signi cance of the dierence between a hypothesized value of a given parameter and its sample
estimate counterpart. Likeweise restrictions such as the mapping from one parameter to another
can be tested using chi-square statistics. As an example, note that equation (5.11) implies that:
K
(1 + ) =
Y
a familiar condition. Finally, one can test the stability of a given parameter over the sample
analyzed. .
Full information maximum likelihood...
54
Bibliography
N. Stokey and R. Lucas. Recursive Methods in Economic Dynamics. Harvard University Press,
1989.
55
Part III
Appendixes
56
Appendix A
This appendix presents the various approaches to solving for the value function in a stationary
dynamic programming problem along with an explicit derivation of the envelope condition.
A typical dynamic programming problem includes:
A state space S Rm
A control space A Rn
Instantaneous objective function: u : A S!R
State transition function: g : A S!S
Feasible control correspondence: :S A
Discount factor:
Initial state: K0 2 S
Example 13 Suppose that S = A = R: Then the simplest "Cake-Eating" version of the Ramsey
problem is therefore:
1
X p
t
max Ct (A.1)
t=0
s:t:
g(Kt ; Ct ) = Kt Ct
Ct 2 [0; Kt ]
K0 =
57
A.1 Guess and verify
One method to solve the BFE is to try to guess the value function V ( ). In order to come up
with a guess, solve the problem rst as if it was a sigle-period maximization one:
p
max C
s:t: C 2 [0; ]
where a; b are undetermined coe cients. Now solve for a; b using the BFE:
p h p i
V( C) = C + a C +b
so that: p np h p io
V( )=a + b = max C+ a C +b (A.2)
C2[0; ]
at this point one can actually maximize the RHS since under the assumed value function. To
do so, dierentiate w.r.t. C and set equal to zero. Since the term inside the braces is a concave
function, this would be in fact a maximizer. The result of this maximization is:
C= 2
1 + (a )
b = b
b = 0
so that nally one is ready to verify the initial guess. To do so, one must show that:
1 p hp i
p = max C+ V ( C) = V ( )
2 C2[0; ]
1
" p !#
p C
= max C+ p =V( )
C2[0; ] 2
1
58
2
so, maximizing the RHS again, one obtains Cmax = 1 . Plugging it in the equation
above one obtains:
p s
q 1 2
2
p = 1 + 2 =V( )
2 1
1
p p
p = p =V( )
2 2
1 1
so that the guessed solution the BFE is veried. Now to actually generate an optimal sequence
1
fKt+1 ; Ct gt=0 one uses the system of dierence equations:
Ct = h(Kt )
2
= 1 Kt
Kt+1 = Kt Ct
2
= Kt
K0 =
2 2
which yields Ct = (1 )Kt = (1 ) 2t and Kt+1 = 2t : Finally, note that the transver-
sality condition is satised. To see this recall that the value function is:
p
Kt+1
V (Kt+1 ) = p 2
1
so that:
1
V 0 (Kt+1 ) = p 2
p
2 1 Kt+1
and the transversality condition is:
t+1 p
t+1 0 t+1 Kt+1
lim V (Kt+1 )Kt+1 = lim p p = lim p =0
t!1 t!1 2 t!1 2
2 1 Kt+1 2 1
59
Suppose that S = A = [0; K] for some K > 0 and that the problem is the same cake-eating
as the example above. Then the method of successive approximation requires to generate a
1
sequence of functions fV n gn=0 so that V n ! V , the solution to the BFE. As a starting point
for the sequence, let V 0 = 0 :
n = 0)V0 =0 hp i p
n = 1 ) V 1 ( ) = max C+ V0 =0 =
C2[0; ]
hp i q p
n = 2 ) V 2 ( ) = max C + V 1( C) = 1 + 2
C2[0; ]
hp i q p
n = 3 ) V 3 ( ) = max C + V 2( C) = 1 + 2 2
C2[0; ]
.. .. .. ..
. . . s .
P
1
2t
p
n = n ) V n( ) = =
n=1
p
n ! 1 ) V n( ) ! p 2
1
60
which are of course, the same policy functions found in Example 2 of section 2.3 in the main
text.
is a contraction.
Proof (Blackwell conditions). First, to prove monotonicity: Let (x) ' (x) for
every x, then for every f ( ) is continuous and (x) closed-graph:
= (T ) (x) + c
(T ) (x) + c whenever 2 [0; 1]
61
(step 1: continuity and boundedness) First, note that f ( ) ; u ( ) bounded ( ) ) T
bounded. Next, continuity of f ( ) ; ( ) ; u ( ), linearity of E ( ) and the assumptions
on ( ) ) T continuous by Berges theorem (or the Continuous Maximum Theo-
rem).
(step 2: increasingness) Let ( ) be an increasing function. Next, suppose that x0 >
x00 .and that a0 = arg max0 ( ) and a00 = arg max00 ( ) :Then:
a2 (x ) a2 (x )
(T ) (x00 ) = max (f ( ) ; ( ) ; u ( ))
a2 (x00 )
= (T ) (x0 )
so that:
x0 > x00 ) (T ) (x0 ) (T ) (x00 )
so that T ( ) is an increasing operator.
(step 3: concavity) Now, if ( ) is concave, the concavity of f ( ) ; u ( ) imply that the
objective function:
u (x; a) + E [f (x; a; ")]
is concave. Furthermore, since ( ) is convex-valued, we can invoke the Concave
Maximum Theorem1 and conclude that T is concave.
Proof. Because the spaces of strictly increasing and of strictly concave functions are not
complete, this proof requires a 2-step procedure. TBC
62
where, as in a shopping time or MIU model, only cash provides direct utility. In this case, zt is
a technology process with (for simplicity) deterministic constant growth:
zt = (1 + ) zt 1
The state variables for this problem are fkt ; bt 1 ; mt 1 ; zt g or simply fkt ; at ; zt g while the choice
variables are fct ; nt ; bt ; mt ; kt+1 g. As usual, the BFE can be written as:
s:t:
mt 1
ct + kt+1 (1 )kt + mt + bt = zt f (kt ; nt ) + + R t bt 1
1+ t
Now, recall that, at the optimum ( ) one will have policy functions for all the choice variables,
so fct ; nt ; mt ; bt g are all functions of the state variables fkt ; at ; zt g : To save on notation, let
uj (ct ; 1 nt ; mt ) = uj (t) and Va (kt+1 ; at+1 ; zt+1 ) = Va (t + 1) : To derive explicitely the enve-
lope condition totally dierentiate the value function:
@c @n @m @kt+1 @a
Vk (kt ; at ; zt ) = uc (t) + un (t) + um (t) + + Va (t + 1) t+1 Vk (t + 1)
@kt @kt @kt @kt @kt
(A.4)
and note that a depends on kt through mt and bt , but the exogenous technology process zt
@z
does not (i.e. @kt
= 0). Next, note:
mt 1
kt+1 = zt f (kt ; nt ) + (1 )kt + + R t bt 1 mt bt ct
1+ t
so:
@kt+1 @n @c @m @b
= zt fk (kt ; nt ) + zt fn (kt ; nt ) + (1 ) (A.5)
@kt @kt @kt @kt @kt
while:
mt
at+1 = + Rt+1 bt
1 + t+1
so:
@at+1 1 @m @b
= + Rt+1 (A.6)
@kt 1+ @kt @kt
63
combining (A.6)-(A.5) into (A.4):
2 3 2 3
uc (t) @c zt fk (kt ; nt ) + (1 ) " #
@kt 1
@m
6 7
Vk (kt ; at ; zt ) = 4 +un (t) @kt 5+ Vk (t + 1) zt fn (kt ; nt ) @n
@n 4 @kt
@c
@kt
@m
@kt
5+ Va (t + 1) 1+ @kt
t+1
@m @b +Rt+1 @b
@kt
+um (t) @kt @kt
rearranging:
8 9
> @c >
>
> @kt [uc (t) Vk (t + 1)] + >
>
>
< + @n [un (t) >
=
@kt h Vk (t + 1) zt fn (kt ; nt ]i
Vk (kt ; at ; zt ) = Vk (t + 1) (zt fk (kt ; nt ) + (1 ))+ @m Va (t+1)
>
> + @kt um (t) Vk (t + 1) + 1+ >
>
>
> t+1 >
>
: + @b [ V (t + 1) R V (t + 1)] ;
@kt a t+1 k
now, the F.O.C.s tell that each one of the terms in brackets is zero, so that the whole term in
braces vanishes:
Vk (kt ; at ; zt ) = Vk (t + 1) [zt fk (kt ; nt ) + (1 )]
but at the optimum (using the F.O.C.s again) uc (t) = Vk (t + 1) so replacing one nally arrives
at the rst envelope condition:
updating it one period and replacing in the F.O.C. for consumption, one arrives at the Euler
equation:
uc (ct ; 1 nt ; mt )
= [zt+1 fk (kt+1 ; nt+1 ) + (1 )] (A.7)
uc (ct+1 ; 1 nt+1 ; mt+1 )
next, replacing on the F.O.C. for labor:
un (ct ; 1 nt ; mt )
= [zt+1 fk (kt+1 ; nt+1 ) + (1 )] zt fn (kt ; nt ) (A.8)
uc (ct+1 ; 1 nt+1 ; mt+1 )
uc (ct ; 1 nt ; mt )
uc (ct+1 ; 1 nt+1 ; mt+1 ) =
[zt+1 fk (kt+1 ; nt+1 ) + (1 )]
un (ct ; 1 nt ; m t )
= zt fn (kt ; nt )
uc (ct ; 1 nt ; m t )
which, if one regards zt fn (kt ; nt ) as the real wage is a labor supply equation. Next, as a shortcut
to the the second envelope condition, use the F.O.C. w.r.t bonds to obtain:
uc (t + 1) [zt+1 fk (t + 1) + (1 )]
Va (kt+1 ; at+1 ; zt+1 ) =
Rt+1
64
Now using this condition in the F.O.C. for money:
uc (t + 1) [zt+1 fk (t + 1) + (1 )]
um (t) + = uc (t + 1) [zt+1 fk (t + 1) + (1 )]
Rt+1 (1 + t+1 )
1
um (t) = uc (t + 1) [zt+1 fk (t + 1) + (1 )] 1
Rt+1 (1 + t+1 )
um (t) it+1
=
uc (t + 1) [zt+1 fk (t + 1) + (1 )] 1 + it+1
um (t) it+1
=
uc (t) 1 + it+1
65
Appendix B
The Maximum Principle gives an approach to dynamic optimization that is alternative to the Dy-
namic Programming approach. It also exploits the concepts of states, controls, state-transition
functions and the Envelope Theorem. This section follows closely Dixit (1990).
where t+1 and t are the multipliers associated with each constraint. The F.O.C. for the control
variable is easy to obtain:
@L
= 0 =) Fz (yt ; zt ) + t+1 Qz (yt ; zt ) + t Gz (yt ; zt ) (B.1)
@zt
66
but the condition for the state variable is not so straightforward since each yt appears in two
terms of the innite sum. To circumvent this issue, re-write the relevant part of the Lagrangean
as:
T
X
t+1 [yt yt+1 ] = 1 [y0 y1 ] + 2 [y1 y2 ] + ::: + T +1 [yT yT +1 ]
t=0
= 1 y0 1 y1 + 2 y1 2 y2 ::: T +1 yT T +1 yT +1
T
X
= yt ( t+1 t) + y0 1 yT +1 T +1
t=1
and note that the terms in braces pertain to t = 0; T + 1 whose values are given by initial and
terminal conditions so no need to worry about them. From this formulation, it is clear why t+1
is given the name "co-state". Now, the F.O.C. for the state variable can be derived more easily:
@L
= 0 =) t+1 t + [Fy (yt ; zt ) + t+1 Qy (yt ; zt ) + t Gy (yt ; zt )] = 0 8 t 6= 0; T + 1 (B.2)
@yt
This optimality condition states that, at the optimum, the overall marginal return from increas-
ing yt is zero; that is, the shadow prices prevent pure or excess return from holding yt : Now,
rearranging:
t+1 t = [Fy (yt ; zt ) + t+1 Qy (yt ; zt ) + t Gy (yt ; zt )] (B.3)
next dene the Hamiltonian:
and note that the optimization problem does not consist simply in maximizing the instantaneous
reward function F ( ) since future reward depends upon future values of the state variable, which
in tunr is related to its current value and the choice variable via the state-transition function
Q( ): Next, dene the Lagrangian, L; for the single-period problem:
and here, H(yt ; zt ; t ) is the objective function of this single-period problem. Following F.O.C.
(B.1), it is clear that zt is chosen so as to maximize (B.4), so let H(yt ; zt ; t+1 ) = H (yt ; t+1 ):
Next, notice that:
@L
= Fy (yt ; zt ) + t+1 Qy (yt ; zt ) + t Gy (yt ; zt )
@yt
so we can replace this in (B.3):
@L
t+1 t = = Ly
@yt
But notice, in the static problem (B.5) the Envelope Theorem applies and thus Ly = Hy so:
67
and a similar envelope condition for the co-state variable gives L = H (yt ; t) = Q(yt ; zt )
which replaced in the denition of the state-transition equation yields:
so the Maximum Principle states that rst order necessary and su cient conditions for the
optimization problem above are:
1. For each t, zt maximizes the Hamiltonian H(yt ; zt ; t) subject to the single preiod con-
straint(s) G(yt ; zt ):
2. The changes in yt ; t over time are governed by the pair of dierence equations (B.6)-(B.7).
ZT
max F (y(t); z(t))dt
0
s:t:
Q(y(t); z(t)) = y(t)
_
G(y(t); z(t)) 0
ZT
L = [F (y(t); z(t)) + (t)Q(y(t); z(t)) + y(t)( _ (t)) + (t)G(y(t); z(t))]
0
+ F (y(0); z(0)) + 1 Q(y(0); z(0)) + y(0) (0) y(T ) (T )
@L
= 0 =) Fz (y(t); z(t)) + (t)Qz (y(t); z(t)) + (t)Gz (y(t); z(t)) = 0
@z(t)
and the pair of dierential equations (Pontryagin conditions) governing the behavior of the state
and co-state variables:
y(t)
_ = H (y(t); (t)) (B.8)
_ (t) = Hy (y(t); (t)) (B.9)
68
so that the underlying objective function is the present-discounted value of the stream of instan-
taneous utility functions f (y(t); z(t)): Then the present value hamiltonian above can be written
as:
H pv (y; z; ) = e t f (y(t); z(t)) + (t)Q(y(t); z(t))
Now suppose that it is desirable to state the problem in current value terms; the Hamiltonian
would be:
H cv (y; z; ) = f (y(t); z(t)) + q(t)Q(y(t); z(t))
where:
t
q(t) = (t)e (B.10)
is the current-value shadow multiplier. Now revisit the Pontryagin conditions for the present
value problem:
@H pv
= 0 =) e t fz (y(t); z(t)) + (t)Qz (y(t); z(t)) = 0
@z(t)
y(t)
_ = H pv (y; z; ) = Q(y(t); z(t))
_ (t) = Hypv (y; z; ) = e t fy (y(t); z(t)) + (t)Qy (y(t); z(t))
Only the rst and last of these conditions involve discounting so, rewrite the rst in current-value
terms:
q(t)
_ = _ (t)e t + (t)e t
= _ (t)e t + q(t)
t
_ (t)e = q(t)
_ q(t)
q(t)
_ q(t) = fy (y(t); z(t)) + (t)e t Qy (y(t); z(t))
q(t)
_ q(t) = fy (y(t); z(t)) + q(t)Qy (y(t); z(t)) (B.13)
is the Pontryagin condition for the costate variable corresponding to the current-value optimiza-
tion problem.
69
Appendix C
70
that is, the innite-order MA representation of the AR(1) process, saying that the AR(1) process
can be written as an innite sum of past shocks. If j'j = 1 we have a unit root or say that zt
has innite memory.
since j'j < 1 and each "t j N (0; 1). Likewise we could compute the unconditional mean as:
so that solving:
71
The unconditional variance is:
2 3
1
X
V ar [zt ] = V ar 4 + 'j " t j
5
j=0
2 3
1
X
= V ar 4 'j " t j
5
j=0
0 1
1
X
= @ 2
'2j A V ar ["t j]
j=0
2
=
1 '2
note that in the last step the following expansion is used:
1
X 1
('1 1) if :' 2 f 1; 1g
'2j = '2 1
1 if ' 2 f 1; 1g
j=0
Ntaurally, as long as 0 < j'j < 1 the unconditional variance is greater than the conditional
variance.
x1 = x0 + b
x2 = x1 + b = ( x0 + b) + b = 2 x0 + b + b
x3 = x2 + b = ( ( x0 + b) + b) + b = 3 x0 + 2
b+ b+b
.. .. .. ..
. = . . .
t t 1 t 2
xt = x0 + b+ b + ::: + 2 b + b + b
t 1
X
t k
= x0 + b
k=0
72
we obtain:
t
t 1
xt = x0 + b
1
so the solution to the LFODE takes the form:
t b b
xt = x0 + +
1 1
73
C.2.3 Asymptotic Stability
The above solution can be expressed as:
t b b
f (x0 ) = x0 +
1 1
b
which has, as xed point, x0 = 1 , i.e.:
b b
f =
1 1
so 1 b can be interpreted as a stationary point ("steady-state"). We say that the above FODE
is asymptotically stable if:
lim (xt x) = 0
t!1
Example 17 A version of the Cagan (1956) model. Suppose that supply is based on expected
prices while demand is based on actual prices:
d
yt+1 = + pt+1
s
yt+1 = + Et pt+1
+ pt+1 = + Et pt+1
Et pt+1 Et 1 pt = (pt Et 1 pt )
pt
+ pt+1 = +
[1 (1 )L]
+ pt+1 (1 )pt = + pt
( ) 1
pt+1 = + 1 pt
74
and now we have a FODE without expectation terms which we
h can solve using
i the abovementioned
techniques. Using the 5 step method. Let ( )
= and 1 1
= then:
1) : Sty Sate =) p =
1
t
2) : Ph;t+1 = =) t 1 ( )=0
: =) ph;t+1 = t
t
3) : Gral:Sol: =) pt+1 = +a
1
0
4) : F ind coef =) p0 = +a
1
: =) a = p0
1
t
5) : Replace =) pt+1 = + p0
1 1
so that the solution to the price equation is:
t
1
pt+1 = + p0 1
1 1
with stationary price level equal to p = 1 and asymptotic stability condition:
1
1 <1
75
Again, this equaton will have two solutions. However, we are only interested in the non-
trivial solution so A 6= 0 which in turn implies that (M I) must be singular, i.e.:
det(M I) = 0
m11 m12
det = 0
m21 m22
the roots of this equation are called characteristic roots or eigenvalues. The two solutions
to this equation are:
1h p i
1; 2 = tr(M ) tr(M )2 4 det(M )
2
and substituting 1; 2 in (C.3) results in the two eigenvectors of A :
1
A1 = m11 1
m12
and:
1
A2 = m11 2
m12
and the solution to the homogeneous system is given by the linear combination:
Xh;t = c1 A1 t
1 + c2 A2 t
2
Xt = X + Xh;t
Xt = (I M ) 1 B + c1 A1 t
1 + c2 A2 t
2 (C.4)
4. As before, solve for the undetermined coe cients using some initial value vector X0 :
1
X0 = (I M) B + c1 A1 0
1 + c2 A2 0
2
this is a system of linear equations from which the coe cients c1 ; c2 can be determined.
Then substituting into (C.4) gives the solution to the VDE.
76