Professional Documents
Culture Documents
Local Perfection *
LEO K. SIMON
This paper investigates solution concepts for games with large strategy
spaces. Seltens [S] notion of trembling hand perfection (THP) is
extended to games with compact metric strategy sets. Loosely, a Nash
equilibrium is THP if it is the limit of equilibria in which agents face
vanishingly small uncertainty. We introduce a refinement of THP, called
local perfection: some structure is imposed on the kind of uncertainty that
agents face. Informally, a THP equilibrium is locally perfect (LP) if the
uncertainty agents face is predominantly local in nature, i.e., if agents
probability assessments assign, in the limit, an overwhelmingly large
proportion of the total probability mass to events in the vicinity of the
truth.
To fix ideas, let S= (S,, S2) be a pure-strategy Nash equilibrium for some
two-person game. Let Pi denote player ?s payoff function. Suppose that
there exists an alternative strategy for player 1, s;, and a neighborhood,
U,, of S,, such that P,(s;, .) $ Pi@,, .) on U2.2 Also assume that for
some t, far away from S2, P,(S,, t2)> Pi(s;, t2). (Thus, S1 is not weakly
dominated by s;, but, one might say, it is locally weakly dominated.)
Agent # 1 will be indifferent between S1 and s; if he is absolutely certain
that player # 2 will choose precisely S2. He will choose s; over S, if he is
virtually sure that # 2 will choose an action in the vicinity of S;, but
cannot predict his decision with aboslute precision. If, on the other hand,
he is almost sure that if S, is not played, then t, wiZ1be played, then he will
choose S, over s;. For this game, S will be a THP equilibrium but not a LP
equilibrium.
The paper is organized as follows. Section I begins with an example. We
then introduce the formal definitions. Section II contains the formal model.
In Section III we focus on finite games, and compare local perfection to
established solution concepts. Existence results are presented in Section IV.
I. INTR~OUCTION
P,(s) = 2 - s1
(Example 1)
~2CW~/s2)~ - bI/s213 - 2(s1/s2)1 if s2 >+~r
if s,<$s,
The set of pure strategy equilibria for this game is: { (0, s2): s2 E [0, I]}.
This plethora of equilibria is a consequence of the perfect information
assumption underlying the Nash solution concept: player #2 has no basis
for preferring any particular one of his strategies, only because he is
presumed to be absolutely certain that player # 1 will select precisely 0.
* For two functions f and g on A, we will write f $ g if f(x) 2 g(x), for all XE A, with
strict inequality holding for some x.
136 LEO K. SIMON
FIGURE 1
This leads to the question: What if players perceptions are less finely
honed than the Nash hypothesis presumes? To answer this question, we
develop a model of slightly fuzzy or blurry perceptions and explore the
consequences of viewing perfect information games as the limits of games
played by agents whose perceptions are not absolutely precise. Viewed
from this perspective, the game described above has only one valid
equilibrium, the profile (0,O).
What strategy will player #2 choose if he is almost but not absolutely
certain that # 1 will choose s1 = O? Unless some restrictions are imposed
on the structure of admissible beliefs, virtually any answer is possible. For
example, s2 z 1 will be a best response for player #2 if, conditional on the
event s, # 0, he assigns a sufficiently high probability to the event s, z 3/2.
Such beliefs might seem implausible on a priori grounds; they are certainly
antithetical to the spirit of fuzzy perceptions. The example suggests a
natural restriction on beliefs: agents must assign relatively high probability
to events in the vicinity of the truth.
Given any 6 > 0, if player # 2 is not completely certain that player # 1
will play s1 = 0, but is almost completely certain he will choose some
strategy in [0, S], he will reject any s2 > 6, since such a strategy would
yield a negative expected payoff (see Fig. 1). Without a further specification
of #2s precise beliefs, however, we cannot pin down his best action more
precisely than this. Now consider a sequence of probability assessments for
player #2, with the property that uncertainty becomes increasingly more
heavily concentrated in the vicinity of 0. Specifically, suppose that:
Note that we do not require that the set 0, contain 0. In Example 1, the
player #2s sequence of beliefs satisfies condition (*), and if s; is a
sequence of best responses to these beliefs, then (3;) must necessarily
converge to zero. To see this, observe that for any 6 > 0, inequality (1.1)
below must eventually be satisfied:
<o if s,<56
PAS, >S,) = i < -6 if s, E (6, 3 6).
<6 if s, E [5 6, 21
3 We could also have motivated the uncertainty with a story about trembles, a la Selten.
See Section III.
138 LEO K. SIMON
Pure Strategies
Let I denote a finite set of players, with generic element i. Player is pure
strategies will be represented by S;, with generic element s;. We assume
that Si is a compact metric space. Let d;Fbe a metric for S;. Let S = ni,, Sj
and let dS = maxit I d,S. The set S will frequently be written as Si x Sj,
where ,S_; = nj,i S,. (We will use the notation ( i, -) frequently below,
without further comment.) An element s = (si, spi) E S will be called a pure
strategy profile.
A payoff function P: S + R#, assigns to each strategy profile a vector of
payoffs, one for each agent. We assume P is continuous w.r.t. dS. A game is
a pair (S, P). A pure strategy Nash equilibrium for (S, P) is a profile s E S
such that for all iEI and all s:cSi, P,(s)> Pi(s,!, sei).
Let M(S,) denote the set of Bore1 probability measures on playerjs pure
strategies. Let M(S,) denote the Bore1 product probability measures on
S-i.5 A point pin M(Si) will be called a conjecture by i. The conjecture pLi
represents is beliefs about the strategies other agents will choose. That is,
for the Bore1 subset Tei of S,, $(TAi) is the probability assigned by i to
the event that other agents will choose pure strategies in Tei. Let dp
denote the Prohorov metric on M(S,) and let dP, = maxIf, d, denote the
product Prohorov metric on M(S-i).6 A conjecture profile, p = (P~)~~,, is a
list of conjectures, one for each agent, i.e., an element of nis, M(S,). We
for any open set 0 -i c Si, 317s.t. Vn > ti, #(Obi) > 0. (2.1)
For sj ES,, let 6, E M(S,) denote the Dirac measure at sj, that is, the
measure defined by: ds,( {s,}) = 1. Define 6,-, and 6, analogously. The con-
jecture pi = 6,-, represents certainty by i that other players will choose SLY.
A sequence of (conjecture profile)-(pure strategy profile) pairs, (p, s),
will be said to validate a strategy profile S if for each i: (a) for each n, s: is
a best reply against ~2; (b) the sequence (#) converges weakly to 6,-,;
(c) the sequence (3;) converges to Si. Formally, a sequence (pLn,s) in
JJis,M(S-,)x S validates SES if for all i,
(2.3a)
It would be more conventional to require that for all n, supp(~~)= S-,. Our weaker
requirement is easier to work with when S-, is an infinite dimensional space.
LOCAL PERFECTION 141
0-i
FIGURE 2
(2.5)
(Here and elsewhere, we denote Lebesgue measure on R by I.) Now fix
SEi E Si and let sTi be a sequence in Sei such that sYi +,, SVi. For n E N,
let ~Lij denote the distribution of f,( ., sTi), (that is, for any Bore1 set
TeicSi, ~~(T_j)=~,_,~(r_,,sj)d~#~(r_i)). Alsopickasequence
(pi) in M(S,) such that supp(&)-+, ~3~~. Finally, let (~1) be an
arbitrary sequence in (0, l] and set $.n = cP~Y + (1 - a) pp. We have:
exp{ -(n/2)(1/k-@)
exp{-(n/2)(l/k-28)j00.
Mixed Strategies
A mixed strategy for i is a Bore1 probability measure on Si, i.e., an
element of M(S,). Let vi denote the generic mixed strategy for i. A mixed
strategy profile is a Bore1 product probability measure, i.e., a point in
M(S). A Nash equilibrium for (S, P) is a profile v E M(S) such that for all
ieZ and all s: E Si, Is P,(t) du>J,_, P,(s:, tei) du_i.
As before, a conjecture by i is a point in M(S,). A sequence (pL, vn), will
be said to validate a mixed-strategy profile 17if for each i: (a) for each n, v;
is a best reply against P*~; (b) (pi* converges weakly to VPi; (c) (~7) con-
LOCAL PERFECTION 143
n-l
u;=-6,+~c3,;
n
where f*,( ., sl) is defined by (2.5) above. Clearly, the sequence (~~3) is
not S-ordered about zero. The conjectures do, however, represent
predominantly local uncertainty about the u;s, and so should be
admissible, according to our intuitive criterion. It is inappropriate,
therefore, to define S-ordering in terms of the limit profile alone: the
sequence of validating best responses must enter explicitly into the
6421431.IO
144 LEO K. SIMON
(2.3a)
(S-i N U?:) _) 0
tlk, for any open set 0 -; c U,k.0 (2.3b)
gyo-j) .
For example, consider the sequence, (v;, ps), defined above (expression
(2.6)). Since Ls(supp(vq)) = (0, 1 }, the conjecture sequence (~~3) satisfies
condition (2.3): take Ukk = [0, l/k) and U$ = [0, l/k) u ((k - 1)/k, 11.
More generally, we establish below (Proposition Ib) that a sequence of v:,-
weighted combinations of truncated normals will be S-ordered about (vyi).
A mixed strategy profile, 17,is a locally perfect (LP) equilibrium if there
exists a sequence (p, u) satisfying:
Since condition (2.3) is clearly weaker than (2.3), there exist singleton
support LP equilibria which are not pure-strategy LP equilibria. For exam-
ple, consider the two-person game, (S, P), where S, = [0, 11, S, = (f, r}
and P is defined by
P,(s,,1)=P,(s,,r)=s:-s,.
(Example 2)
s1-s: if s2=1
P,(S,? s2)= i $3, if s2 = r.
Stronger Variants
An LP equilibrium may be validated by idiosyncratic beliefs. That is, two
agents conjectures about a third agents actions may differ. In some
contexts, it may be appropriate to impose the stronger requirement that
conjectures are consistent, i.e., that any two agents must have the same
beliefs about what any third agent is likely to do. (Discussion of the
consistency issue is deferred until Section III.) Accordingly, we define a
sequence of conjecture profiles, ($) = (P,~);~ ,, to be consistent if
9 This fact can be proved by manipulating Rockafellar [ll, Theorem 22.1. p. 1981,
146 LEO K. SIMON
ViEI, VEER, k>O and any open set O-icB(S-i, l/k), (2.3b)
/li'"(Sp; - B(Ci, ilk)) _) 0
/i.i'n(O-i) n '
(BH( Tpi, 6) is the Hausdorff ball about the set T_ ;, i.e., BH( T-i, 6) =
(SLi E sei 3 tci E spi s.t. d:,(t-,, sxi) < S}.,
At first sight, metric ordering appears much more stringent, and less
defensible, than its topological counterpart. On the other hand, if the
variance-covariance matrix Cei described earlier is the the identity matrix,
the ~~3sin Proposition Ia will be metrically S-ordered about SKi. We will
say that an pure strategy LP equilibrium, S, is a metric locally perfect
(MLP) equilibrium if it can be validated by a sequence, (p, s), such that
for each i, pLnis metrically S-ordered about S- ;. (The mixed strategy notion
is defined analogously.)
The following game illustrates the difference between LP and MLP in
finite games. Consider the following modification of Example 2. S; is a
finite subset of [0, l] containing 0 and 1. S; = (I, r}, Pi = P2,s and Pi is
defined by, for s E S:
P;(s,,I)=P;(s,,r)=(l-&)S:--SI, (Example 2)
where EE (0, 1). The Nash equilibria for the game (S, P) are: player # 1
plays zero, and #2 plays any mixed strategy. The unique metric locally
perfect equilibrium is a,,, (since once p2* assigns sufficient probability mass
to the interval (0, t), player #2 must choose I). On the other hand, all of
the Nash equilibria for this game are both trembling hand perfect and
locally perfect in our weaker sense. For example, the pure strategy
equilibrium (0, r) can be validated if player #2s conjecture are given by:
~2~n({0})=1-~~1-~-2,~2~n((1})=~~1,withtheremainingmass,(n~2),
being distributed uniformly over (0, 1). For any finite subset of [O, l],
(~~3) satisfies the S-ordering condition (2.3b): set Ut = {0), for all k.
LOCAL PERFECTION 147
Proof of Proposition Ib. Pick an arbitrary open set Oei E Sei. We first
check that for n sufficiently large, ~~(0~~) > 0. Pick Ci E O-j. Since
Un Si is dense in Spi, there exists a sequence (t: J such that for all n,
t, E Sri and Pi -+ iCi. Pick ii sufficiently large and E > 0 such that for any
n > ii, B(P, E) c O-,. Since the density of g, is strictly positive on
cYi(s ;), we have
Now pick C sufficiently large that for all n > t? (i) v:,(B(iCi, 6)) > E and (ii)
inf{dsi(s-;, t-,): (s-,, tLi)E(Spi- CT?:) x supp(v:,)} l/k - 6. For n > ti,
we have
nz p()(&(s;- uy))
> P~(ai(B(i_;, 6) n s,))
The first weak inequality uses the fact that for (rei, t pi) E
B(tl,,6)~B(i-~,6), dTi(rdi,tpi)<l/k-26.
Since pi(n) <n, for all j, we have: AP-(B(i_i, 6) n Fe,)) 2 (d/n).
Therefore,
This proves that the sequence (cl) is metrically S-ordered about (v~). 1
For a = ~(0, 1) we have: log(na) = n((log n)/n + log a). But (log n)/n -t 0, and log G( < 0,
so that for n suffkiently large, ((log n)/n + log 61) -C 0. Therefore, n((log n)/n + log c() --+ - co,
i.e., @(~a) -+n 0.
LOCAL PERFECTION 149
then
local perfection. On the other hand, one might argue that if the differences
between the payoffs to different strategies is very large, agents might be
very careful to err in the direction of least payoff loss. Obviously, there is
no categorical answer.
111.4. Other Related Concepts
Two other solution concepts are somewhat related to ours: Kreps and
Wilsons [6] sequential equilibrium and Andrew Weisss [lo] strong
robust expectations equilibrium (SREE). Kreps and Wilson also omit
consistency from their definition. However, sequential equilibrium is a
strictly weaker concept than THP and has no bite in normal form games.
Weisss criterion, like ours, has a local flavor, but apart from this, has
little in common with local perfection. SREE is a solution concept for
incomplete information games. It involves an order restriction on the
inferences that can be drawn from zero-probability events: if an off-the-
equilibrium-path action c( is observed, and player-type is equilibrium
action is closer to a than player-type Js, then SREE requires that agents
priors over types are updated in favor of type i. Local perfection, on the
other hand, is a complete information concept: it orders the relative
likelihoods that different off-the-equilibrium-path actions will be chosen by
the same player.
Our first result is an existence theorem for the strongest of our local per-
fection concepts, consistent metric local perfection. An immediate corollary
is that THP exist under the same conditions. Next, we investigate sufficient
conditions for existence of a pure-strategy LP equilibrium. It is instructive
to observe that the standard conditions for existence of a pure strategy
Nash equilibria-continuity and quasi-concavity in agents own
strategies-do not suffice. This is established by a counter-example. We
then prove that to guarantee existence of a pure-strategy LP equilibrium, it
is sufficient to replace quasi-concavity by concavity. Finally, we observe
that if at a pure-strategy equilibrium, each agents payoff attains a strict
maximum, then the equilibrium is also locally perfect. An immediate
corollary is that if payoffs are strictly quasi-concave in agents own
strategies, then every Nash equilibrium is an LP equilibrium.
Existence of Consistent Metric Perfect Equilibrium
) Pi(Si,
p:(s) = jgL,(9w ~li(~-i)) gi(y_l, s-i) dAp-8(y-i). (4-I)
IS
s, s-t
P;(t;, tpi) dpis(t~i) dv;(tJ
= i p:(t) dv( t)
s,
=I s s-, u,Cs-,,
pi(Sj, (aYi)p (Y-i)) g(Y-iv t-i)
x dAm(y-i) dvIi(t-i)
=s s-s
Pi(~j, t-;)dpisn(t-i).
FIGURE 3
I
s2, SE L-0,; (1 +sz)l x [O, 11
4(s, -+1-s,, SE(5(1 +s,), 11x co, 11
PI(s)= s -4s
2 1, SE [o,; (s2 - 111x Cl,21
3E(4-72, 11 x (421
otherwise.
(Example 3)
Note that Pi is quasi-concave in si.
154 LEO K. SIMON
The profile (f, 1) is the unique pure-strategy Nash equilibrium for this
game. There is also a mixed strategy equilibrium, V, where Vi = 4 6, + 4 6,
and V, = 16, + 4 6,. The payoffs are the same in each of the two equilibria:
each players payoff, or expected payoff, is 1.
The profile (4, 1) is clearly not an THP equilibrium and hence cannot be
an LP equilibrium. Player #ls strategy $ is weakly dominated both by
0 and by 1. Indeed, given any conjecture, pl, by player # 1, si will be a
best response to this conjecture only if si E (0, l}. Therefore, there exists
no sequence of conjecture profiles that validates (&, 1). On the other hand,
V is locally perfect. It is validated by the sequence ($, vn), where v = V and
p, and p2. are, respectively, the distributions of [f f.( ., 0) + + f,( ., I)]
and l-4 f2,( ., 0) + t f2.( ., 2)]. (As usual, the fs are defined by (2.5).)
There is a modification of the above game that has a unique pure-
strategy THP equilibrium that is not locally perfect. The modification
involves replacing P, by Pi, defined as follows: let EE (0, 4) be arbi-
trarily small and let P, be continuous, quasi-concave in s,, agree with
P, except on {.YES:S~ E(;-s, f+e)} and satisfy, for all si #$,
P,(s,, 5) < P,(i, f) = $. We can support (4, 1) as a THP equilibrium for the
game (S, (P, , P2)), by choosing conjectures for player # 1 that assign an
overwhelming proportion of the residual probability mass to some
appropriately small neighborhood of s2 = t.
What outcome would we expect to observe if Example 3, or the above
modification of it, were played in practice? In either case, we find it
implausible that agents would arrive at the pure-strategy equilibrium. The
locally perfect mixed-strategy equilibrium yields the same payoffs and is
clearly much more robust. We conclude from this that Local Perfection
may provide a useful criterion by which to eliminate even a unique pure-
strategy equilibrium.
REFERENCES
1. G. DEBRELJ, A social existence theorem, Proc. Nut. Acad. Sci. 38 (1952), 886-893.
2. G. DEBRELJ, Theory of Value, Wiley, New York, 1959.
3. K. FAN, Fixed point and minimax theorems in locally convex topological linear spaces,
Proc. Nut. Acad. Sci. 38 (1952), 121-126.
4. I. L. GLICKSBERG, A further generalization of the Kakutani fixed point theorem with
applications to Nash equilibrium points, Proc. Nat. Acad. Sci. 38 (1952), 17&174.
5. W. HILDENBRAND, Core and Equilibrium of a Large Economy, Princeton Univ. Press.
Princeton, NJ, 1974.
156 LEO K. SIMON