You are on page 1of 14

VOL. 88, No.

2 SEPTEMBER 1980

Psychological Bulletin

A Critique of Cross-Lagged Correlation


David Rogosa
Department of Education, University of Chicago

Cross-lagged correlation is not a useful procedure for the analysis of longitudinal


panel data. In particular, the difference between the cross-lagged correlations is
not a sound basis for causal inference. Demonstrations of the failure of cross-
lagged correlation are based mainly on results for the two-wave, two-variable
longitudinal panel design. Extensions of these results to panels with multiple
waves and multiple measures reveal additional problems.

The topic of this article is the analysis of topics such as these has resulted in the collec-
reciprocal causal effects. Often, questions about tion and analysis of large amounts of longi-
reciprocal causal effects have been phrased, tudinal panel data.
Does X cause F or does Y cause X? More Data from a longitudinal panel consist of
formally, many have spoken of a determination observations on n cases at T (I = 1, . . . , T)
of causal predominance or of a preponderant time points or waves. At each time point, ob-
causal effect. Examples of such research ques- servations on one or more variables are ob-
tions in developmental psychology include the tained. Much attention is given to the simplest
reciprocal influences in mother-child interac- relevant panel design : the two-wave, two-vari-
tion (Clarke-Stewart, 1973) and relationships able (2W2V) longitudinal panel. For 2W2V
between infant intelligence and infant behavior panels the two variables are labeled X and Y.
(Crano, 1977). Examples from educational re- These variables are subscripted to indicate the
search include the relationship between teacher time of measurement. Thus for each individual
expectation and student achievement (Crano case, measures X\, Y\, X%, and Y^ are available.
& Mellon, 1978; Humphreys & Stubbs, 1977; Cross-lagged correlation (CLC) is currently
West & Anderson, 1976) and the relationship the most popular procedure in many areas of
between self-concept and achievement (Bach- psychological and educational research for
man & O'Malley, 1977; Calsyn & Kenny, identifying causal effects from longitudinal
1977; Purkey, 1970). Empirical research on panel data. Most often CLC is used to deter-
mine a predominant causal influence—the
causal winner.
This research was supported by a seed grant from the
Spencer Foundation. The assistance of David Brandt Users of CLC often make enthusiastic claims.
and Michele Zimowski in this research is gratefully For example, Crano and Mellon (1978) as-
acknowledged. serted,
Requests for reprints should be sent to David Rogosa, i
who is now at the School of Education, Stanford Uni- With the introduction of the cross-lagged panel correla-
versity, Stanford, California 94305. tional method. . ., causal inferences based on correla-

Copyright 1980 by the American Psychological Association, Inc. 0033-2009/80/8802-0245S00.7S

245
246 DAVID ROGOSA

tional data obtained in longitudinal panel studies can purpose is to identify the parameters in models
be made and enjoy the same logical status as those de- for longitudinal panel data that represent re-
rived in the more standard experimental settings,
(p. 41) ciprocal causal effects. To simplify the exposi-
tion, models for 2W2V data are emphasized;
Although technical deficiencies in CLC have extensions to panel data with additional waves
been noted (Bohrnstedt, 1969; Duncan, 1969; or variables are straightforward in most cases.
Goldberger, 1971; Heisc, 1970), CLC is widely Definitions of causal effects obtained from con-
recommended (e.g., Calsyn, 1976; Calsyn & sideration of structural regression models,
Kenny, 1977; Clarke-Stewart, 1973; Crano, continuous-time models, and multiple time-
1974, 1977; Humphreys & Stubbs, 1977; series models are identical.
Kenny, 1975).
I find that CLC does not provide sound in-
Structural Regression Models
formation about casual effects. CLC may in-
dicate the absence of direct causal influence A structural regression model for longitudinal
when important causal influences, balanced panel data is one plausible model from which
or unbalanced, are present. Also, CLC may the longitudinal panel data could have been
indicate a causal predominance when no causal generated. For two variables, X and Y, the
effects are present. Moreover, CLC may indi- causal influences are represented by the regres-
cate a causal predominance opposite to that of sion parameters of the path from a prior X to a
the actual structure of the data; that is, CLC later Y and from a prior Y to a later X. This
ma)r indicate that X causes F when the reverse representation can be formulated for two-wave
is true. or multiwave panel data. (When the regression
A basic deficiency in CLC is the lack of an model is formulated in terms of latent variables
explicit definition of a causal effect. Without a having multiple indicators at each time point,
clearly defined quantity to be estimated, it is the causal effects are represented by the re-
not surprising that CLC fails to provide sound gression parameters for the structural regres-
information about causal effects. The assess- sion equations that relate the latent variables.)
ment of causal effects should be based on a Previous formulations of regression models
model for the data in which causal effects are for panel data with reciprocal causal effects
identified. In the next section definitions of have focused on models for 2 W2V data (Duncan,
causal effects derived from three different 1969, 1972, 1975; Goldberger, 1971; Heise,
models for longitudinal data are presented. 1970). For this simple configuration, the
Also, the emphasis in CLC on the determi- structural regression model is equivalent to a
nation of a causal winner is unwise. Causal pre- path analysis model. Figure 1 is a representa-
dominance is not the only important question. tion of a specific structural regression model
The reciprocal nature of many social and de- for 2W2V data. This configuration can also be
velopmental processes makes determination represented by the structural regression
only of causal predominance an oversimplifi- equations:
cation of the research problem. Measures of
X, = 7,7!
the strength and duration of the reciprocal
relationship and of the specific causal effects
are more informative than the determination
The parameters /3i and 71 represent the influ-
of a causal winner.
ence of a variable on itself over time. The
parameters fo and 72 represent the lagged,
Causal Effects in Longitudinal Panel Data reciprocal causal effects between X and F.
Thus /32 and 72 are key quantities in the in-
To evaluate the usefulness of CLC, it is vestigation of reciprocal causal effects in
necessary to develop operational definitions of 2W2V panels.
causal effects in longitudinal panel data. Defini- Restrictions on the nature of the causal in-
tions of causal effects are based on models for fluences between X and Y are built into Figure
the panel data. No complete treatment of 1 and Equation 1. Most important is the as-
causality is attempted or claimed; the primary sumption that all causal influences are lagged;
CROSS-LAGGED CORRELATION 247

simultaneous causal influences between X2 and of variables over time (Coleman, 1968; Han-
F2 are not included. Also, assumptions of lin- nan & Tuma, 1979). A simple two-variable
earity and additivity of causal influences are model for rates of change that incorporates
built into this model. reciprocal influences between X and F is
The absence of a causal effect between vari-
ables is represented by a zero value of the rele- dX(f)
vant model parameter. In particular, in
Equation 1 the absence of any direct causal dY(t)
effects between X and F is represented by (2)
dl
/32 = Y2 = 0. (Definitions of the absence of any
causal effects between X and F will prove to be Equation 2 is a system of coupled differential
importantin the examination of "spuriousness" equations which stipulates that the rates of
in CLC.) Also, a causal predominance of X over change of X and F at any time depend linearly
F would be represented by a zero (or negligi- on the levels of X and F. The parameters 62
ble) value of 72 and a large value of fa. A causal and ca represent the cross-effects or couplings
predominance of F over X is represented in between X and F. Note that Equation 2 is
the same manner. deterministic; for my purposes this limitation
Standardized versions of the structural is not crucial.
parameters in Equation 1 also may be used to Although rates of change are not directly
define causal effects. Standardized parameters observable, the solution of the system of dif-
are denoted by an asterisk. Explicitly, ferential equations in Equation 2 yields equa-
tions in terms of the observable variables of
Pi a 1 —l I)
ft* = Pi the same form as in Equation 1. The param-
eters fa and 72 are monotone increasing func-
tions of b'2 and c2 and depend on the time be-
= 7i 72 =
72
tween waves and the parameters of Equation 2
Similar representations of reciprocal causal (Kaufman, 1976). Thus the representation of
effects can be made in structural regression reciprocal effects in the structural regression
models for data from longitudinal panel de- model in Equation 1 is consistent with that of
signs that are far more complex than a 2W2V the model for rates of change in Equation 2.
design. For example, multiple indicators of Also, instead of only corresponding to the ex-
latent variables £ and t\ may be available at perimental lag between waves, regression
each time of measurement. In the structural models for panel data can be thought of as
regression model for these data, the role of fa reflecting a process in which causal influences
and 72 is unchanged; these parameters repre- and resulting adjustments are continuous in
sent the lagged reciprocal causal influences be- time (Coleman, 1968; Hannan & Tuma, 1979).
tween the latent variables £ and j;.
Multiple Time-Series Models
Continuous-Time Models
In econometrics the detection of reciprocal
Another approach to modeling panel data is
causal effects from time-series data has at-
to formulate equations for the rate of change
tracted considerable interest. The analysis by
Sims (1972) of the reciprocal causal influences
of mone}' stock and income is the best known
example of this work. Definitions of reciprocal
causal effects in multiple time-series data were
formulated by Granger (1969). Subsequent
work (Pierce, 1977; Pierce & Haugh, 1977)
has interpreted and extended these definitions.
The definitions of causality are based on
Figure 1. Structural regression model for 2W2V panel predictability criteria. Loosely speaking, one
data. time series, for example, X ( l ) , causes another
248 DAVID ROGOSA

time series Y(t), if present Y can be predicted


better using past values of X than by not using
past values of X, other relevant information
(including past values of F) being used in both
cases. These definitions have been translated
into explicit conditions on the structures and
parameters of multiple time-series models (see
Pierce & Haugh, 1977). Figure 2. Population correlations for a 2W2V panel.
Definitions of causal effects in panel data
also can be formulated using the predictability
criteria. The longitudinal panel data can be relations are pxtYt and pylx.r The within-time-
viewed as a collection of many short time series. period, between-variables correlations, pXly1
The conditions are particularly simple for and pxtyt, are the synchronous correlations.
2W2V data. For example, the condition for X The between-time-periods correlations of the
causes Y for the 2W2V model in Figure 1 can same variable, pXlxt and pF,r 2 , are the stabilities
be stated in terms of linear prediction with no of the variables.
simultaneous causation as a relation between The attribution of causal predominance1 in
the population multiple correlations : CLC is based on the difference between the
cross-lagged correlations, px^v^ — PY^X^ If the
data indicate that Pxlvi — Pv^x^ is positive, the
This inequality is satisfied when causal predominance is concluded to be that of
X causing Y. If the data indicate that PX^Y^
Pv,(Xr y,) > 0 • — PI^A'J is negative, the causal predominance
That condition is satisfied if and only if /32 ^ 0. is concluded to be that of Y causing X (Camp-
Also, the condition for Y causes X is that bell, 1963). Usually, attributions of causal pre-
72 T* 0. And the condition for feedback is that dominance are made only when the null hy-
both /32 and y2 are nonzero. Although much of pothesis of equal cross-lagged correlations
the sophistication of the time-series formula- (Ho: pXlyt = py^xj is rejected.
tion is lost when these definitions of causality CLC discards much information. A statis-
are adapted to longitudinal panel data, it is tically significant difference between the sample
cross-lagged correlations is given the same in-
useful to show that these definitions are con-
sistent with the other representations of causal
effects. 1
In the literature on CLC, the recognition of both a
source and a direction of a predominant causal influence
has generated much discussion (Rozelle & Campbell,
Method of Cross-Lagged Correlation 1969; Yee & Gage, 1968). Source is the variable that is
causally predominant, and direction is whether the
In this section the procedures and assump- causally predominant variable causes an increase or a
tions of CLC are described and discussed. decrease in the other variable. In terms of the model in
Procedures for both two-wave and multiwave Equation 1, source is related to the relative magnitudes
panel data are considered. This material pro- of /32 and 72, and direction is determined by the sign of
the parameter. Causal predominance in this article
vides the groundwork for the results in the refers to an identification of both source and direction.
next two sections. The discussion in this section 2
Pelz and Andrews (1964) proposed that causal at-
is restricted to variables measured without tributions be based on the partial cross-lagged correla-
error; complications that result from fallible tions, rxpi-x-L an(l rytxrYr I do not consider this pro-
measurement are not crucial in this analysis. posal further for two reasons. First, this proposal has
been ignored in applications and technical development
of CLC. Second, and more important, the partial corre-
Procedures for Two-Wave Panels lation strategy fundamentally differs from CLC because
the partial correlation strategy is not in any way based
Figure 2 is the diagram that accompanies on the model in Figure 3 that is the basis for the use of
zero-order correlations. In fact the partial correlation
expositions of CLC. Figure 2 presents the pop- strategy is best thought of as an incomplete structural
ulation correlations among the variables in a regression strategy based on Figure 1 (see, also, Heise,
2W2V panel. The population cross-lagged cor- 1970).
CROSS-LAGGED CORRELATION 249

terpretation regardless of the magnitude of the is, only the parameter h can be estimated from
difference and regardless of the magnitudes of the 2W2V data. 3
the individual correlations. Also, no distinction The strategy of investigating the tenability
is made between large and equal cross-lagged of a null hypothesis of a spurious association
correlations and small and equal cross-lagged between X and F is not without merit. How-
correlations. ever, Kenny's (1975) model of spurious associ-
Kenny (1975) interpreted the null hypothe- ation is just one of several models in which
sis of equal cross-lagged correlations as a null direct causal influences between X and F are
hypothesis that the relationship of X and F is absent. The term spuriousness is better con-
a result of the common influence of an unmea- sidered as a generic term for the absence of
sured third variable and not a result of direct direct causal influences between X and F.
influences between X and F. Kenny termed Many alternative models for 2W2V data
this a null hypothesis of spuriousness. Rejection can be constructed that are true to this broad-
of this null hypothesis (under certain assump- ened notion of spuriousness. Two examples are
tions) leads to a conclusion of direct causal the common factor model with lagged effects
effects between X and F. Although Kenny em- considered in Duncan (1972, Figure 12) and a
phasized this test for spuriousness over an at- restricted version of the 2W2V model in Figure
tribution of causal predominance, all applica- 1 in which /32 = 0 and 72 = 0. As /32 and y2
tions of CLC seek an attribution of causal represent the magnitudes of the lagged causal
predominance. effects between X and F, it follows from the
Kenny (1975) posited a very specific model definition of causal effects that the absence of
for his null hypothesis of spuriousness, which direct causal effects between X and F be
is depicted in Figure 3. This 2W2V model with represented by the model in Figure 1, with
one evolving common factor (F) is also ana- & = 72 = 0.
lyzed from the standpoint of path analysis by Rarely is it recognized that the objectives of
Duncan (1972, especially pp. 63-74). Duncan CLC are modest and limited. In its most com-
plete form, CLC purports to distinguish only
showed that this model is underidentified; that
between spuriousness and a causal predomi-
nance for one of the variables. Even if CLC were
valid for its stated objectives, it falls short of
providing an adequate description of causal
influence in panel data. The failure of CLC to
achieve even these limited objectives makes the
status of CLC as the primary analysis method
for panel data in education and psychology
very unfortunate.

3
From examination of the models in Figures 1 and 3,
it might appear that the model in Figure 1 contains the
restriction that the autocorrelations among the residuals
in Figure 3 (denoted by the parameters s and t) are zero.
This is not the case, as nonzero values of these param-
eters are incorporated into the parameters /5i and 71.
That the parameters of the model in Figure 1 do reflect
nonzero values of s and / can he seen from the result that
the restriction s = I — 0 requires that /3m = /Sj-n-
Also, the model in Figure 3 does not require that u and
v in Equation 1 be uncorrelated.
The restrictions that /( (a correlation) not be greater
than one in magnitude requires that Pxtf<fY\Xv <• Px\f\'
Px.2Yr Kenny (1975) stated that a violation of this re-
striction in sample data is indicative of a causal effect.
Figure 3. Model for 2W2V panel data used to represent Also, if J and (are both positive, then the model requires
spuriousness in CLC. that PxiV^Cv^x, < Pjrjjfjpy^j-
250 DAVID ROGOSA

Assumptions in CLC stationarity, the cross-lagged correlations may


be unequal when the synchronous correlations
Articles on CLC often contain complex non- are equal and the representation of spurious-
mathematical discussions of the assumptions ness in Figure 3 is valid/' Kenny had previously
deemed necessary for the interpretation of the noted problems with verifying stationarity in
difference between the cross-lagged correla- two-wave data and had indicated ways
tions. Taken together, these assumptions are (Kenny, 1973) to verify stationarity in
very restrictive. Not all expositions of CLC multiwave data.
include all assumptions, and most empirical A second key assumption is synchronicity,
applications of CLC ignore the assumptions. that the measures at each wave are obtained at
Kenny (1973, 1975) formulated the assump- the same time. This assumption is implicit in
tions of CLC with regard to his model for our description of the longitudinal panel data
spuriousness (Figure 3). The major assumption and will not be considered further.
of CLC is stationarity, that is, that the causal Kenny (1975) introduced an assumption
structures for X and Y do not change over- termed homogeneous stability that is invoked to
time. For the parameters in Figure 3, station- help distinguish between the alternative hy-
arity requires that a\ = »•> and b\ = &•>. potheses that X causes an increase in Y and
(Weaker assumptions, called proportional sta- that Y causes a decrease in X (or vice versa)
tionarity and quasi stationarity are also con- once the null hypothesis of spuriousness has
sidered in Kenny, 1975.) Because the syn- been rejected. Homogeneous stability- is not
chronous correlations, pxly1 and pxty2, are equal used to determine whether spuriousness should
if aj)\ = aj)z, stationarity implies equality of be rejected. Nor is homogeneous stability used
the synchronous correlations. 4 Equality of the to decide between X causes an increase in Y
synchronous correlations is a necessary but not and Y causes an increase in X. The assumption
sufficient condition for stationarity. is not stated explicitly in terms of parameters
The assumption of stationarity is far from in Figure 3, but Kenny did state that equal
innocent. The assumption that the causal stabilities for X and Y (measured without
parameters do not change over time (or, less error) are consistent with this assumption. In,
restrictively, that the synchronous correlations recent applications of CLC (Calsyn & Kenny,
do not change over time) is closely linked to an 1977; Crano, 1977; Crano & Mellon, 1978;
assumption that the system (composed of the Humphreys & Stubbs, 1977), this assumption
relations between X and Y) is in equilibrium has not been used or discussed.
(see Coleman, 1968). This assumption of
equilibrium is often invoked to justify the use Exlejision of CLC to Multiwave Panels
of cross-sectional data as a proxy for longitu-
dinal data. The analysis of longitudinal panel The extension of CLC to multiwave panel
data should not depend on a restrictive assump- data consists of comparisons of cross-lagged
tion closely linked to cross-sectional research.
Restrictive assumptions are necessary in * The restriction that the synchronous correlations be
CLC because the model in Figure 3 is under- equal has no special interpretation in terms of the
parameters of the model in Figure 1. The restriction in
identified. Dependence on the stationarity terms of the standardized versions of the structural
assumption appears to limit applications of parameters is
CLC. However, in many well-known applica-
tions, substantial violations of stationarity are PX1Y1 =
present (e.g., Clarke-Stewart, 1973; Eron, 5
- 017* - 0272
From Figure 3
Huesmann, Lefkowitz, & Walder, 1972).
Given stationarity, unequal cross-lagged = li(aibi —
correlations are inconsistent with the model in Equality of the synchronous correlations requires that
Figure 3. Consequently, in CLC unequal cross- a\bi = aj}-i. Substituting this into the difference be-
lagged correlations indicate rejection of spuri- tween the cross-lagged correlations yields
ousness. Because equal synchronous correla-
tions are not a sufficient condition for PX,Y, — PY -Jf).
CROSS-LAGGED CORRELATION

correlations from all possible two-wave com- the parameters of Equation 1 :


binations (see Calsyn, 1976; Calsyn & Kenny,
1977; Crano, 1977). Multiple waves of data are f AY
Px,yt - PrlXt = (1 - P.l.jO ^(-—
used to replicate 2W2V patterns. For example, L. \ ^2/
for three-wave, two-variable (3W2V) panel
data, three pairs of cross-lagged correlations - 72 ~-M + PX^PYiY, - PA-jA'j). (3)
would be examined: cross-lagged correlations xt/ j
between Waves 1 and 2, between Waves 2 and The difference between the cross-lagged corre-
3, and between Waves 1 and 3. lations can also be expressed in terms of the
m
The analysis of T waves of data as I - I two- standardized versions of the structural
W parameters :
wave pieces represents a short-sighted view of
the value of multiwave data. Many patterns
of causal influence cannot be detected from a iY^PYiYi ~ Pjr,Xj), (4)
series of two-wave snapshots. Using multiple
waves to replicate two-wave patterns depends
on a static pattern of causal influence over + Pxlrl(vl-fi). (5)
time. This strategy rules out investigation of
change over time in patterns of causal influ- The difference between the cross-lagged corre-
ence and is not an effective use of multiple lations does not have a direct correspondence
waves of data. to measures of causal effects.
When T is large or when many indicators of The expressions above are used to demon-
each variable are available, the number of strate that the difference between the cross-
comparisons of cross-lagged correlations be- lagged correlations does not provide a sound
comes large. (With px measures of £ and pY basis for a determination of spuriousness or
measures of t\ at each of the T time points, causal predominance, even when the assump-
tions of CLC are satisfied.6 Equal cross-lagged

•G)
pxpy { 9 1 comparisons of cross-lagged correla-
tions can be made.) The usual practice in CLC
correlations do not support a conclusion of
the absence of direct causal effects, and un-
equal cross-lagged correlations do not support
analyses of such data (Calsyn, 1976; Crano, a conclusion of causal predominance. The ex-
1977) is to tally the statistically significant amples and generalizations based on Equations
differences between the cross-lagged correla- 3, 4, and 5 almost always incorporate the as-
tions in both directions; the causal winner is sumption that the structural parameters and
the variable with the greater number of sig- the correlations are nonnegative. This assump-
nificant differences in the appropriate direction.
tion is not limiting, but in some cases negative
values would require changes in wording.
Results for Two-Wave Panels Equal cross-lagged correlations. In CLC,
equal cross-lagged correlations indicate a con-
In this section I demonstrate that the differ- clusion of a spurious (or nonexistent) pattern
ence between the cross-lagged correlations is of causal influence between X and Y. This
not a sound basis for causal inference. Neither conclusion is unsound because equal cross-
determinations of causal predominance nor lagged correlations are consistent with many
spuriousness are defensible. Complications re- patterns of direct causal influence. Equal cross-
sulting from measurement error, specification
error, and multiple indicators are also discussed.
All results are presented in terms of population 8
The assumption of stationarity can be partially
parameters. represented in Equations 3, 4, and 5 by incorporating
the restriction of equal synchronous correlations, using
the expression given in Footnote 4. Substitution of this
Difference Between the Cross-Lagged Correlations equality has no effect on the interpretations and on con-
clusions that are based on Equations 3, 4, and 5.
The difference between the population cross- Consequently, this complication is not considered in
lagged correlations can be written in terms of the text.
252 DAVID ROGOSA

(a) B* - .30 Y * = .30

.70

Y^ = . 4 0

B* - . 3 0 Yj = .55

(e) a* = .3i .50

B* - .28

Figure 4. Numerical examples of misleading cross-lagged correlations in 2W2V panels. (Standardized


structural parameters are listed above each of the diagrams that display the correlations.)

lagged correlations require only that and F are equal, the cross-lagged correlations
are equal. Panel a in Figure 4 is one of many
~ * ' -
possible illustrations that a zero difference be-
tween the cross-lagged correlations is consistent
with nonnegligible and equal direct causal in-
0 ~ 72 = ftr.K.J - T ) . fluences. Equal cross-lagged correlations are
In particular, equal cross-lagged correlations
are consistent with (a) large and equal causal 7
In the numerical examples displayed in Figures 4
effects, (b) large and unequal causal effects, and S, stationarity is not grossly violated. In each of
and (c) the absence of causal effects between these examples, the correlations were generated under
X and F. These cases are considered below, the assumption that <ruv = 0. A nonzero,value of a-uo
and numerical examples are displayed in could have been specified in each of these examples that
would make the synchronous correlations identical;
Figure 4.7 however, it was felt that the slight discrepancies among
As can be seen from Equation 4, if fi*z and y*z synchronous correlations did not justify the complica-
are large and equal and if the stabilities of X tion of an additional specification.
CROSS-LAGGED CORRELATION 253

also consistent with unequal causal effects, the Similarly, a causal predominance will be in-
difference between the stabilities offsetting the dicated by CLC when $\ = y* ^ 0 and the
difference between fi\ and y%. Panel b in Figure stabilities are unequal. Causal predominance is
4 presents an example in which &\ is twice as attributed to the variable with the lower stabil-
large as -yj anc^ in which the cross-lagged corre- ity because, as in the previously mentioned
lations are equal. Equal cross-lagged correla- expression, pxlYl—PYIX^ = PXIYI(PYIY^—PXIX^-
tions are consistent with the absence of causal Panel c in Figure 4 presents a numerical
effects—ft\ — y'z — 0—only when the stabilities example in which /3g = y%, and the cross-
of X and Y are equal. lagged correlations indicate a causal predomi-
All of the difficulties with the interpretation nance for X, the variable with the lower
of equal cross-lagged correlations persist when stability.
causal effects are defined in terms of unstan- In addition to indicating a causal predomi-
dardized structural parameters. Because the nance when there is none, CLC may indicate a
difference between the cross-lagged correlations causal predominance opposite to that indicated
increases as ox^xjay^v^ increases (all other by the structural parameters. Whenever px,y2
parameters constant), changes in variances — pytxt and /32 — 7 2 (or 0J — -yj) differ in sign,
over time make equal cross-lagged correlations the direction of causal predominance indicated
consistent with an even wider variety of con- by the cross-lagged correlations is antipodal to
figurations of unstandardized causal param- that determined by the structural parameters,
eters than were indicated previously for fn Panels d and e in Figure 4, the stronger
standardized parameters. causal effect, defined by the standardized
The evidence used in CLC to reach a deter- structural parameters, is from Y to X. How-
mination of spuriousness is equal cross-lagged ever, in each example the cross-lagged correla-
correlations (and equal synchronous correla- tions indicate that the predominant causal in-
tions to satisfy stability). Because this evidence fluence is from X to Y. In each example CLC
is consistent with many patterns of direct picks the wrong causal winner,
causal influence, the determination of spurious- When causal effects are expressed in terms
ness in CLC is unsound. of the unstandardized structural parameters,
Unequal cross-lagged correlations. Unequal changes in variances over time further compli-
cross-lagged correlations indicate a causal pre- cate the interpretation of unequal cross-lagged
dominance in CLC. However, a nonzero differ- correlations. As noted previously, the difference
ence between the cross-lagged correlations is no between the cross-lagged correlations increases
more dependable than a zero difference for as ax^xJffY^ffv^ increases. As a result, CLC
determining the pattern of causal influence. (other parameters constant) favors the attribu-
Unequal cross-lagged correlations are consis- tion of causal predominance to the variable
tent with (a) the absence of causal effects be- with increasing variance over time. One way of
tween the variables, (b) equal causal effects, highlighting the role of changing variances over
and (c) unequal causal effects. Moreover, the time is to rewrite Equation 3 as
predominant cause indicated by the unequal
cross-lagged correlations may be opposite to PXfY, — PYtX, = —
Yn
that denned by the structural parameters; for
example, the cross-lagged correlations indicate
that X is causally predominant, when the re-
verse is true.
For example a relatively large <r,v2 tends to
As before, the shortcomings of CLC are seen
from Equations 3, 4, and 5. First, in the absence make PX,YS — Pvixi positive, thus favoring the
attribution of causal predominance to X,
of causal effects (ft = 72 = 0), pXlvt — pvlxt
= PX^^PY^ — PJ^A-J). Unequal cross-lagged
correlations result whenever px^xt ^ pi^y,. Measurement Error
CLC will assign causal predominance to the In the preceding discussion X and Y were
variable with the lower stability, even though assumed to be measured without error. A num-
causal effects are not present, ber of techniques, both standard psychometric
DAVID ROGOSA

methods and special methods peculiar to CLC, arise in the interpretation of the zero-order
have been used in CLC analyses to deal with correlations in the determination of causal
measurement error. It is not vital to consider effects, specifically from the effects of specifica-
these correction techniques explicitly because tion error on the definitions of causal effects
any scheme for disattenuation can at best re- and on the model underlying CLC. When the
produce a situation with perfect measurement. model in Equation 1 is misspecified because of
But CLC is unsound even when measurement the omission of important causal variables, the
is perfect, and better performance cannot be structural parameters in Equation 1 are not
expected when measurement error is present. valid representations of the causal influences.
Equations 3, 4, and 5 are valid both for fallible The cross-lagged correlations are functions of
and for perfectly measured variables. these structural parameters, and thus their
The presence of measurement error is cited interpretation is also affected. For example,
in discussions of CLC as invalidating alterna- when Ay = Pi-i-,
tive regression-based analyses (see Kenny,
197S). If this claim were sound, it would justify
some despair but would not justify the use of
CLC. The argument in support of CLC is that The causal interpretation of the zero-order
partial regression slopes are more severely af- correlations is based on specific assumptions
fected by measurement error than are zero- about causal structures. The model (Figure 3)
order correlations. With only one fallible mea- underlying CLC includes assumptions about
sure of each variable at each time point, it is unmeasured variables that are unlikely to be
not possible in general to obtain acceptable satisfied when important causal variables are
estimates of the parameters of a regression omitted. For example, the requirements that
model for the panel data. However, additional U'2 and F2 be uncorrelated with each other and
measures of each variable can be used to con- that £/i and V\ be similarly uncorrelated are
sistently estimate the regression parameters. susceptible to violations resulting from speci-
The problem of measurement error can be fication error. Figure 15 in Duncan (1972) con-
viewed as a problem of inadequate research tains some forms of specification errors for
design; a research design that incorporates Figure 3.
multiple indicators of the underlying variables
is not as easily invalidated by fallible measure- Multiple Indicators
ment.
A CLC analysis of panel data with multiple
Specification Error indicators of each variable consists of the com-
Sometimes claims are made that CLC is not parison of all possible 2W2V cross-lagged cor-
affected by omitted causal variables or by relations. In a two-wave panel with px mea-
other forms of specification error, whereas re- sures of the latent variable £ ( and with pv
gression analyses are destroyed by specification measures of the latent variable r/, at each time,
error. A fervent argument of this type was pxpv differences between cross-lagged correla-
made by Humphreys and Stubbs (1977), who tions are computed. Multiple indicators are
asserted that considered to be an opportunity for replications
across different operationalizations of the same
the comparison of correlations among the same set of construct (Kenny, 1975, p. 894).
measures obtained at two or more intervals of time
(cross-lagged correlations) either avoids completely or
The pxpv differences between the cross-
minimizes the difficulties involved in the interpretation lagged correlations obtained from a 2W2V
of regression weights, (p. 262) design with multiple indicators can be written
as
The claim is specious. CLC is not immune to
specification error.
The effects of specification error on CLC are
opaque because a zero-order correlation does
not depend on additional variables, whether
they be measured or omitted. The problems i = \,...,px\ j = 1 , . - . , PY. (6)
CROSS-LAGGED CORRELATION 255

The latent variables £ and •>; are related by the of Equation 7, the differences between the
structural equations, cross-lagged correlations are
£•2 = /3o + / + u, - 72 + Pxjfyl
172 = To + + "• ~ PFsx3 = - 7* + PxtYt(yl
The observed indicators are related to the la-
tent variables by the measurement model,
Xu = &nt;t -f- fit,
Yjt = Xj-,7j, + Vjt
* = 1,..., #*; j = l , . - . , ^ ; 1=1,2. . (8)

Equation 6 shows the additional problems CLC analyses for 2W2V data were shown not
with CLC resulting from the use of multiple to be a sound basis for causal inference. The
indicators for replication. The relations in collection of 2W2V analyses produced by CLC
Equations 3, 4, and 5 can be thought of as re- with multiwave data is no more dependable as
lations for the latent variables £ and r\. Even a basis for causal inference than a single 2W2V
if measures of £ and -q were available, the dif- analysis. In fact, the way CLC uses multiwave
ference between their cross-lagged correlations data is likely to increase the difficulties; each
is not a sound basis for causal inference. two-wave snapshot does not yield dependable
Equation 6 shows that these shortcomings are results, and taken together the two-wave analy-
likely to be compounded by the CLC strategy ses will often be contradictory and misleading.
for using multiple indicators. The difference Equation 8 indicates that the differences be-
between cross-lagged correlations of the multi- tween the cross-lagged correlations may be in-
ple indicators depends on the specific relations consistent in causal attribution, even when
(the loadings 5 and X) of each indicator to the causal influences are pronounced and consistent
latent variable it represents. This dependence across waves. Figure 5 displays one of many
is likely to produce inconsistency and con- possible patterns of inconsistency in the cross-
fusion, not replication, lagged correlations. In Figure 5 the stronger
causal effect, as defined by the standardized
Results for Multiwave Panels structural parameters, is from Y to X consis-
tently across the three waves. The cross-lagged
The analysis of CLC for multiwave data is correlations do not indicate this causal pattern;
based on a 3W2Vpanel design. The representa- Waves 1 and 2 indicate a causal predominance
tion of causal effects for the 3W2V design is a for X; Waves 2 and 3 indicate a causal predomi-
simple extension of Equation 1 (intercepts nance for Y, and Waves 1 and 3 indicate
omitted) : spuriousness.
X* = Unfortunately, inconsistencies in the cross-
lagged correlations over waves generate clever
F2 = substantive interpretations. For example,
X, = Clarke-Stewart (1973) conducted a CLC analy-
F3 = j84Xi + 73F5 + ft,Xi + TsFi + »,. (7) sis on the relationship between maternal at-
tention and infant attachment using three
In this model, causal effects between X and F waves of data. Waves 1 and 2 indicated a causal
may span two waves; both between-variables predominance for maternal attention, and
and within-variable effects are so represented Waves 2 and 3 indicated a causal predomi-
in Equation 7. nance for infant attachment (Wave 1-Wave 3
Three separate comparisons of cross-lagged comparison not reported). Clarke-Stewart sug-
correlations are made in CLC for the 3W2V gested that "as mother and child search for
data : comparisons between Waves 1 and 2, be- harmonious, balanced interaction over the
tween Waves 2 and 3, and between Waves 1 course of development, first one then the other
and 3. In terms of the standardized parameters assumes the 'causal role' " (p. 91).
256 DAVID ROGOSA

vr- 55
3* = .28 |3* = .31 8* = .25 0* = .10 8* = .05 g* = .06

.68 Y* = .40 Y* = .65 y-* = .40 y* = . 10 y* = .10


/ j 4 j b

.500 .543

.550

.851 .829

.504

.550

.741

p - p = .130 P P Pv Y - PY v = - 0 0 3
X Y Y X
X Y - Y X X Y Y X
1 2 1X2 2Y3 X
2 3 1 3 1 3

Figure 5. A numerical example of inconsistent cross-lagged correlations in a 3W2V panel. (Standardized


structural parameters are listed above the diagrams that display the correlations.)

Statistical Inference in CLC power test" (p. 887) and that even with moder-
ate sample sizes (defined as 75 to 300), statis-
In the preceding sections relations among tically significant differences are difficult to
population parameters were used to demon- obtain. With large enough samples, trivial de-
strate the failure of CLC. In this section addi- viations from the null hypothesis lead to re-
tional problems with the application and inter- jection. For example, Crano, Kenny, and
pretation of statistical inference procedures in Campbell (1972) found significant differences
CLC are noted. between cross-lagged correlations of .65 and .67
Rejection of the null hypothesis of equal because the sample size was 5,495. Other
cross-lagged correlations (H 0 : px^ = PivO authors ignore sampling variation and with
often is interpreted with little regard for the small sample sizes interpret differences between
power of the statistical test. Users of CLC are the sample cross-lagged correlations as if these
advised to use large samples; Kenny (1975) sample estimates were population values. The
advises that "cross-lagged analysis is a low- use of interval estimates for px^j ~ pr^ would
CROSS-LAGGED CORRELATION 257

be an improvement over current practice in straightforward and explicit formulation of


CLC; the construction of the interval estimate causal effects in panel data showed that CLC is
can be found in Olkin (1966). not a sound basis for causal inference over a
Also, significant differences between the wide range of plausible situations. Possibly,
cross-lagged correlations are interpreted with- CLC could be patched up, primarily through
out regard for the assumptions of CLC. Rarely additional restrictive assumptions, in response
is any assessment of stationarity made in ap- to the deficiencies demonstrated in this article.
plications of CLC. In many sets of longitudinal This article is not intended to stimulate such
data, the difference between the synchronous activities. CLC should be set aside as a dead
correlations is about as large as the difference end.
between the cross-lagged correlations (e.g., In some sense this article is a flight of fan-
Humphreys & Stubbs, 1977, Table 4; Kenny, tasy. The fantasy is the notion of a closed two-
1975, Tables 3 and 5). In a few applications a variable causal system on which the exposition
test of the null hypothesis—Hoipj^y, = P,v2r2— and results are based. This simple formulation
is performed. However, nonrejection does not serves well for investigating the worth of CLC.
prove the null hypothesis true, and in addition Also, almost all applications and technical de-
this null hypothesis is only a necessary condi- velopment of CLC have been limited to two-
tion for stationarit}'. The statistical test of variable causal systems. CLC fails even in this
equal cross-lagged correlations ignores the as- idealized situation, and no grounds for optimism
sumptions and the use of a preliminary test for exist for better performance in more complex
stationarity. The complete null hypothesis causal systems.
should be that the cross-lagged correlations are In his articles on longitudinal panel data,
equal, conditional on stationarity. That is, the Duncan (1969, 1972, 1975) stressed that the
conditional null hypothesis of interest is analysis of panel data cannot be reduced to a
Ho: PXIYI = PY^Z \ PX.Y, = PXjiY No exact statis- mechanical procedure that yields trustworthy
tical test is available for this conditional null inferences about causal structures. A minimal
hypothesis, although methods such as covari- requirement for success is the careful formula-
ance structure analysis (Joreskog & So'rbom, tion of explicit (and often specialized) models
1979) could be used to form a large-sample, for the substantive processes. An intent of this
normal-theory test. Of course, no improvement article is to emphasize this message. Trying to
in the use of statistical inference procedures answer a causal question from a set of (longi-
can offset the basic deficiencies of CLC. tudinal) data is asking a lot from those data.
Minimal requirements are that the right vari-
ables be measured well. Often the state of theo-
Summary and Discussion
retical and empirical knowledge in a substan-
No justification was found for the use of tive area is not sufficiently advanced that the
CLC. In CLC both determinations of spurious- relevant variables have been identified or that
ness and attributions of causal predominance sufficient measurement techniques have been
are unsound. The results for 2W2V panels dem- developed.
onstrate that when reciprocal causal effects are Alternative methods for analyzing panel
absent, the difference between the cross-lagged data were not endorsed or discussed in detail.
correlations may be either small or large, and This omission reflects the fact that methods for
when reciprocal causal effects are present, the detecting patterns of causal influence from
difference between the cross-lagged correlations panel data are far from fully developed. The
may be either small or large. Also, the practice contribution of this article is to demonstrate
in CLC of reducing the analysis of data with that CLC certainly is not the method to rel}'
multiple waves and multiple measures to a col- on for the analysis of panel data. It is hoped
lection of 2W2V analyses produces additional that this article will direct efforts away from
problems. CLC is best forgotten. further development and application of CLC
It should be stressed that this article is not and toward the development and evaluation of
devoted to identifying perverse situations in productive approaches for the analysis of
which CLC might break down. Rather, a panel data.
258 DAVID ROGOSA

References Goldberger, A. S. Econometrics and psychometrics: A


survey of communalities. Psychometrika, 1971, 36,
Bachman, J. G., & O'Malley, P. M. Self-esteem in 83-105.
young men: A longitudinal analysis of the impact of Granger, C. W. J. Investigating causal relations by-
educational and occupational attainment. Journal of econometric models and cross-spectral methods.
Personality and Social Psychology, 1977, 35, 365-380. Economelrica, 1969, 37, 424-438.
Bohrnstedt, G. W. Observations on the measurement of Hannan, M. T., & Tuma, N, B. Methods for temporal
change. In E. F. Boratta (Ed.), Sociological method- analysis. In A. Inkeles (Ed.), Annual review of soci-
ology 1969. San Francisco: Jossey-Bass, 1969. ology (Vol. 5). Palo Alto, Calif.: Annual Reviews,
Calsyn, R. J. Guidelines for using cross-lagged panel 1979.
correlation. Representative Research in Social Psy- Heise, D. R. Causal inference from panel data. In E. F.
chology, 1976, 7, 105-119. Borgalta & G. W. Bohrnstedt (Eds.), Sociological
Calsyn, R. J., & Kenny, D. A. Self-concept of ability methodology, 1970. San Francisco: Jossey-Bass, 1970.
and perceived evaluation of others: Cause or effect Humphreys, L. G., & Stubbs, J. A longitudinal analysis
of academic achievement? Journal of Educational of teacher expectation, student expectation, and
Psychology, 1977, 69, 136-145. student achievement. Journal of Educational Mea-
Campbell, D. T. From description to experimentation: surement, 1977, 14, 261-270.
Interpreting trends from quasi-experiments. In Joreskog, K. G., & Sorbom, D. Advances in factor analy-
C. W. Harris (Ed.), Problems -in measuring change. sis and structural equation models. Cambridge, Mass.:
Madison: University of Wisconsin Press, 1963. Abt Books, 1979.
Clarke-Stewart, K. A. Interactions between mothers Kaufman, R. L. The solution and interpretation of
and their young children: Characteristics and con- differential equation models. American Sociological
sequences. Monographs of the Society for Research in Review, 1976, 41, 746-747.
Child Development, 1973, 38(6-1, Serial No. 153). Kenny, D. A. Cross-lagged and synchronous common
Coleman, J. S. The mathematical study of change. In factors in panel data. In A. S. Goldberg & 0. D.
H. II. Blalock & A. B. Blalock (Eds.), Methodology Duncan (Eds.), Structural equation models in the
in social research. New York: McGraw-Hill, 1968. social sciences. New York: Seminar Press, 1973.
Crano, W. D. Causal analysis of the effects of socio- Kenny, D. A. Cross-lagged panel correlation: A test
economic status and initial intellectual development for spuriousness. Psychological Bulletin, 1975, 82,
on patterns of cognitive development and academic 887-903.
achievement. In D. Green (Ed.), The aptilude- Olkin, I. Correlations revisited. In J. C. Stanley (Ed.),
acMevement distinction. New York: McGraw-Hill, Proceedings of the symposium on educational research:
1974. Improving experimental design and statistical analysis,
Crano, W. B. What do infant mental tests test? A Chicago: Rand McNally, 1966.
cross-lagged panel analysis of selected data from the Pelz, D. C., & Andrews, F. M, Detecting causal priori-
Berkeley Growth Study. Child Development, 1977, ties in panel study data. A merican Sociological Review,
48, 144-151. 1964, 29, 836-848.
Crano, W. D., Kenny, D. A., & Campbell, D. T. Does Pierce, D. A. Relationships—and the lack thereof—
intelligence cause achievement?: A cross-lagged panel between economic time series, with special reference
analysis. Journal of Educational Psychology, 1972, to money and interest rates. Journal of the American
63, 258-275. Statistical Association, 1977, 72, 11-22.
Crano, W. D., & Mellon, P. M. Causal influence of Pierce, D. A., & Haugh, L. D. Causality in temporal
teachers' expectations on children's academic per- systems: Characterizations and a survey. Journal of
formance: A cross-lagged panel analysis. Journal of Econometrics, 1977, 5, 265-293.
Educational Psychology, 1978, 70, 39-49. Purkey, W. W. Self concept and school achievement.
Duncan, O. D. Some linear models for two-wave, two- Englewood Cliffs, N.J.: Prentice-Hall, 1970.
variable panel analysis. Psychological Bulletin, 1969, Rozelle, R. M., & Campbell, D. T. More plausible rival
72, 177-182. hypotheses in the cross-lagged panel correlation
Duncan, 0. D. Unmeasured variables in linear models technique. Psychological Bulletin, 1969, 71, 74-80.
for panel analysis. In H. L. Costner (Ed.), Sociological Sims, C. A. Money, income, and causality. American
methodology: 1972. San Franciso: Jossey-Bass, 1972. Economic Review, 1972, 62, 540-552.
Duncan, 0. D. Some linear models for two-wave, two- West, C. K., & Anderson, T. H. The question of pre-
variable panel analysis with one-way causation and ponderant causation in teacher expectancy research.
measurement error. In H. M. Blalock, A. Aganbegian, Review of Educational Research, 1976, 46, 613-630.
F. M. Borodkin, R. Boudon, & V. Capecchi (Eds.), Yee, A., & Gage, N. L. Techniques for estimating the
Quantitative sociology. New York: Academic Press, source and direction of causal influence in panel data.
1975. Psychological Bulletin, 1968, 70, 115-126.
Eron, L, D., Huesmann, L. R., Lefkowitz, M. M., &
Walder, L. 0. Does television violence cause aggres-
sion? American Psychologist, 1972, 27, 253-263. Received March 30, 1979

You might also like