Professional Documents
Culture Documents
Adele M. Hayes
University of Miami
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
The ability of several process variables to predict therapy outcome was tested with 30 depressed
clients who received cognitive therapy with or without medication. Two types of process variables
were studied: 1 variable that is unique to cognitive therapy and 2 variables that this approach is
assumed to share with other forms of treatment. The client's improvement was found to be predicted
by the 2 common factors measured: the therapeutic alliance and the client's emotional involvement
(experiencing). The results also indicated, however, that a unique aspect of cognitive therapy (i.e.,
therapist's focus on the impact of distorted cognitions on depressive symptoms) correlated nega-
tively with outcome at the end of treatment. Descriptive analyses that were conducted to understand
this negative correlation suggest that therapists sometimes increased their adherence to cognitive
rationales and techniques to correct problems in the therapeutic alliance. Such increased focus,
however, seems to worsen alliance strains, thereby interfering with therapeutic change.
Despite support for the effectiveness of cognitive therapy for therapy and factors that this approach is assumed to share with
depression, researchers are still confronted with a high degree other orientations. Cognitive therapists have developed a set of
of uncertainty about its underlying processes of change unique techniques for the treatment of depression, such as ex-
(Whisman, 1993). As recently noted by Beck and Haaga amination of the impact of distorted thoughts on client's mood,
(1992), the refinement of our understanding of the mechanisms reality testing of false beliefs, reattribution, and search for al-
of action in the treatment of depression will take a predominant ternative interpretations (Beck, Rush, Shaw, & Emery, 1979).
place in the future of cognitive therapy. The present study is an Studies investigating the link between these techniques and
attempt to better understand the process of change in cognitive treatment outcome, however, have obtained mixed results.
therapy for depression. Although the degree of "purity" in the execution of cognitive
As recommended by several workers in the field (e.g., Kazdin, therapy has correlated positively with outcome in one study
1986; Lambert, Shapiro, & Bergin, 1986), two types of pro- (Luborsky, McLellan, Woody, O'Brien, & Auerbach, 1985), the
cesses were investigated: variables that are unique to cognitive adherence to the cognitive techniques and the skills of the ther-
apists in applying these procedures were not related to improve-
ment in another (DeRubeis, Evans, & Hollon, 1989). DeRubeis
and Feeley (1990) found that one set of "concrete" techniques
Louis G. Castonguay, Department of Psychology, Stanford Univer- (e.g., setting up and following session agenda) predicted out-
sity; Marvin R. Goldfried, Susan Wiser, and Patrick J. Raue, Depart- come but only when measured early in treatment. Furthermore,
ment of Psychology, State University of New York at Stony Brook; Adele
another set of techniques called "abstract" (e.g., encouraging
M. Hayes, Department of Psychology, University of Miami.
client's independence) showed no relationship to client's
This article is based on Louis G. Castonguay's dissertation completed
at the State University of New York at Stony Brook. change. Studies that have looked more specifically at certain
The study was supported in part by a fellowship from the Conseil de elements of cognitive therapy have arrived at somewhat clearer
Recherche en Sciences Humaines du Canada and was also supported in results. For instance, the adherence to homework has been
part by Grant MH40196 from the National Institute of Mental Health. linked to better outcome (Burns & Nolen-Hoeksema, 1991), as
We are grateful to Steve Hollon and Robert DeRubeis for their crucial has the challenging of distorted cognitions (Teasdale & Fennell,
roles in collecting the data and materials on which this study was based, 1982).
as well as their help and support in preparing this article. We are also One objective of the present study was to investigate the func-
grateful to Michelle Newman for her assistance in writing the manu- tional impact of another unique element of cognitive therapy:
script, as well as David Smith and David Burns for their statistical
the therapist's focus on the client's intrapersonal functioning.
guidance.
Correspondence concerning this article should be addressed to Louis Such a focus refers to connections or links made by the therapist
G. Castonguay, who is now at the Department of Psychology, Pennsyl- between different aspects of the client's functioning. Reflecting
vania State University, Moore Building, University Park, Pennsylvania the central element of the cognitive therapy model, these links
16802. include the impact of clients' distorted thoughts on their depres-
497
498 CASTONGUAY, GOLDFRIED, WISER, RAUE, AND HAYES
sive symptomatology (e.g., affect, motivational, and behavioral have been largely ignored by researchers and theorists (e.g., Ma-
patterns). Consistent with the behavioral components of cogni- honey, 1991).
tive therapy, these links also include the impact of the clients'
actions (e.g., success experiences between sessions) on their Method
mood and cognitions. In a preliminary study involving a small
number of clients, the therapist's focus on intrapersonal func- Design
tioning was found to be marginally related to improvement in The present study was based on data collected in the Cognitive-Phar-
cognitive-behavior therapy (Kerr, Goldfried, Hayes, Caston- macotherapy Project (CPT; Hollon et al., 1992), which compared the
guay, & Goldsamt, 1992). This study is partly an attempt to effectiveness of four approaches to the treatment of depression: phar-
replicate this result with a larger number of clients and a similar macotherapy without maintenance, pharmacotherapy with mainte-
form of therapy. nance, cognitive therapy, or a combination of cognitive therapy and
Few attempts have been made to determine whether factors pharmacotherapy. In the present study, only the process of cognitive
common to most treatments are related to outcome in cognitive therapy, with or without medication, was investigated.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
Clients were administered the BDI (Beck et al., 1961) before therapy,
ternal consistency (a of .98), as well as convergent validity with other
This document is copyrighted by the American Psychological Association or one of its allied publishers.
Table 1 Table 3
Means and Standard Deviations of Process Second-Order Partial Correlations of Process Variables
Variables for Two Treatments and Outcome, Controlling for Pretreatment Severity
and Type of Treatment (n = 30)
Cognitive Combined
condition condition Process variable BDI HDRS GAS
(n = 15) ( = 15)
Process Midtreatment
variable M SD M SD F(l,28) Alliance -.26 -.41* .49**
Experiencing -.23 -.22 .31
Alliance 5.78 0.90 6.02 0.60 0.73 Intra cons. .07 .07 .12
Experiencing 3.11 0.34 2.70 0.36 10.32** Posttreatment
Intra cons. 19.00 9.26 20.33 6.88 0.20 Alliance -.42* -.59** .45*
Experiencing -.47* -.32 .20
Note. Cognitive condition = cognitive therapy without medication; Intra cons. .26 .44* -.26
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
= intrapersonal consequences. Note. BDI = Beck Depression Inventory; HDRS = Hamilton Depres-
sion Rating Scale; GAS = Global Assessment Scale; Intra cons. = intra-
personal consequences. The raw scores of Alliance, HDRS (at posttreat-
ment), and GAS (at posttreatment) have been logarithmically
transformed. Higher scores on BDI and HDRS reflect more depressive
able (WAI) and two outcome variables (HDRS and GAS at symptomatology, and higher scores on GAS reflect better global adjust-
posttreatment) were logarithmically transformed to correct for ment.
*p<.05. * * p < . 0 i .
skewed distributions and outliers.
whereas the predictive validity of the focus on intrapersonal whelming emotions related to it. After each of these attempts,
consequences reflects its correlation with the alliance (i.e., their the therapist reacted by reemphasizing the cognitive model,
common variance). Consequently, once the alliance is con- specifically refocusing on the impact of the client's distorted
trolled for, the focus on intrapersonal consequences fails to be thoughts. This, in turn, was followed by clear signs of alliance
significantly related to the HDRS. strains (e.g., client's disagreement with therapeutic tasks),
which then appeared to serve as cues for more attempts to per-
Descriptive Analyses suade the client of the validity of the cognitive therapy rationale
and effectiveness of its procedures.
We conducted descriptive analyses to better understand the In two of the eight sessions, markers of alliance strains (e.g.,
unexpected positive correlation between the therapist's focus hostility of the client toward therapist; client's difficulty in talk-
on intrapersonal consequences and the higher level of depressive ing about certain issues in therapy) became the focus of treat-
symptoms, as measured by the HDRS at posttreatment. These ment. However, these strains in the alliance were treated by the
descriptive analyses were seen as relevant not only because such therapist as a manifestation of the client's distorted thoughts.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
a focus is central to the cognitive therapy rationale but also be- Consequently, therapists focused on what they viewed as the
This document is copyrighted by the American Psychological Association or one of its allied publishers.
cause a similar type of intervention was previously found to cor- dysfunctional beliefs (e.g., lack of trust of client's toward the
relate positively with symptomatic improvement in cognitive- therapist) responsible for the client's reluctance to engage in
behavioral therapy (Kerr et al., 1992). The descriptive analyses cognitive therapy. These interventions led to further avoidance
were conducted on the 15 sessions (out of 30) with the highest and unresponsiveness or more opposition toward the treatment.
scores on interpersonal consequences focus. These 15 sessions In the last (ninth) session with a high intrapersonal conse-
were divided into two groups: those ( = 9) with an alliance quence focus and low alliance, there was no repeated focus on
score below average (i.e., 5.90), and those (n = 6) with an alli- the impact of distorted thoughts on negative emotions. To a
ance score above average. Separate descriptive analyses for these large extent, the therapist in this session was attempting to facil-
two groups were suggested by the results of the previous itate an emotional shift through behavioral activationa
multiple regression, which indicated that once the quality of the method of intervention that was not as central to cognitive ther-
alliance was controlled for, the increment of variance predicted apy as cognitive restructuring but, important to its therapeutic
by the focus on intrapersonal consequences failed to achieve rationale nevertheless (see Beck et al., 1979). Alliance prob-
statistical significance. Such results suggest that it may not be lems seemed to emerge when the therapist repeatedly encour-
the cognitive technique per se that was detrimental to the cli- aged the client to apply for some specific jobs and the client
ent's improvement but, perhaps, the application of the tech- showed clear reluctance to do so. Part of the therapist's response
nique failed to take into account problems within the interper- to this alliance strain (i.e., disagreement with the therapeutic
sonal context of therapy. task) was to highlight positive consequences that the client
Examination of the nine sessions high in intrapersonal con- would derive from engaging in an active behavior related to a
sequences and low in alliance revealed, as expected, numerous job search (e.g., feel better by gaining more income), thereby
explicit signs of alliance strains (e.g., client's expression of neg- focusing on one type of intrapersonal consequence: the impact
ative sentiment regarding therapy, avoidance of therapeutic of action on other components of the self. These interventions,
tasks, unresponsiveness to the therapist's interventions). Al- however, may have contributed to unresponsiveness by pressur-
though therapists dealt with these alliance problems directly, ing the client to engage in activities he did not feel ready to do.
they did not do so by investigating their potential source. In- Thus, although the type of intrapersonal consequence focus in
stead, they attempted to resolve the alliance problems by in- this session differed from the one used in the eight sessions de-
creasing their adherence to the cognitive therapy model. scribed earlier, the same general intervention pattern prevailed
In eight of these nine sessions, therapists explicitly focused in dealing with alliance problems. Rather than exploring as-
clients' attention on intrapersonal consequences links that dealt pects of the therapy or their own behaviors that may have con-
with the role of cognitions in causing their negative emotions tributed to the client's reluctance to engage in the cognitive ther-
and on the importance of identifying and replacing these dis- apy tasks, therapists increased their focused on these tasks in an
torted thoughts. In all eight sessions, however, the clients dis- attempt to motivate the client to change. Such interventions,
agreed with the relevance of dysfunctional thoughts for their however, may have inadvertently worsened the alliance problem
problematic situation or showed reluctance to engage in any it attempted to solve.
part of cognitive restructuring. In a typical example, a client As for the six sessions with high intrapersonal consequences
reported having seen her husband driving his car accompanied and high alliance, in all six of them the therapist focused on
by another woman. Although the client was very upset and ex- the client's beliefs and their impact on emotion, and the client
pressed the need to talk about her emotional pain, the therapist actively engaged in the examination of his or her thoughts. Al-
engaged in repeated efforts to fit the client's experience into the though there was disagreement between the therapist and the
distinct components of a cognitive therapy rationale(A) situ- client, in that they had different perspectives on the veracity of
ation leading to (B) thoughts, which lead to (C) emotionsand the client's thoughts, such disagreements were part of the So-
then focused on the causal role of the client's thoughts about cratic dialogue connected with the challenging of maladaptive
her husband's unfaithfulness for her sadness and rage. While beliefs. As opposed to most of the sessions described earlier,
asserting that her thoughts and feelings were justified and refus- these disagreements were not about the cognitive therapy ratio-
ing to engage in the cognitive therapy tasks, the client repeatedly nale and procedures per se, and therefore did not result in lower
attempted to talk about her distressing life event and the over- alliance ratings.
502 CASTONGUAY, GOLDFRIED, WISER, RAUE, AND HAYES
The descriptive analyses revealed yet another difference be- desire to be close to others) and thereby facilitates behavioral
tween the sessions high and low in alliance scores. Of the nine change (e.g., motivating clients to increase social contacts).
sessions rated low in alliance, only one (the last one described) As for the positive correlation between the therapists' focus
showed a focus on the consequences of the client's actions on on intrapersonal consequences and depressive symptoms after
other aspects of their functioning, such as their thoughts or therapy, a series of regression analyses suggest that this correla-
emotions. In contrast, this type of intrapersonal consequences tion may be accounted for by problems in the alliance, because
involving the client's actual behavior was prevalent in five of the this correlation ceased to be significant when the quality of the
six sessions high in alliance scores. Most frequently, the thera- alliance was controlled for. Descriptive analyses performed on
pist's emphasis was on encouraging the client to behave in a sessions with the highest focus on intrapersonal consequences
way that would help him or her cope with difficult interpersonal and low alliance scores lend support to this interpretation. An
problems (e.g., marital conflict). As reflected in the alliance examination of these sessions suggests that some therapists dealt
scores for these sessions, the client seemed to agree with both with strains in the alliance by increasing their attempts to per-
the tasks and goals of these interventions. suade the client of the validity of the cognitive therapy rationale,
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
In light of the results of these descriptive analyses, an interac- as the client showed more and more disagreement with this ra-
This document is copyrighted by the American Psychological Association or one of its allied publishers.
tion term was computed from the alliance and intrapersonal tionale and its related tasks. In other instances, the therapist
consequences scores. The interaction term (corrected for treated these strains as a manifestation of the client's distorted
multicolinearity) was entered in a hierarchical multiple regres- thoughts, which needed to be challenged. Such interventions
sion, after its two constituants and the type of treatment were led to repeated cycles characterized by the therapist's persever-
controlled for. The interaction, however, did not predict out- ance in the application of cognitive techniques and the client's
come above the contribution of the alliance and intrapersonal increased unresponsiveness to the treatment.
consequences (change in R = .2\,p = .13). This lack of signifi- Some tentative interpretations can be offered regarding the
cant increment of predictive validity is perhaps not surprising therapist's focus on intrapersonal consequences in cognitive
considering the degree of freedom lost by using multiple predic- therapy. First, it is possible that such a focus may not be suitable
tors and the small sample used in this study. Hence, it is likely for certain types of problems. Most of the issues discussed in the
that there was not enough power to statistically detect the con- sessions with high intrapersonal consequences and low alliance
tribution of the interaction. scores concerned emotionally laden but real interpersonal prob-
lems (e.g., infidelity). Instead of focusing on the client's dis-
Discussion torted thoughts and their impact on emotions, it might have
been better to facilitate the client's exploration of feelings, as
This study has provided information regarding the predictive suggested by the positive correlation found between the client's
ability of common and unique factors in cognitive therapy. The experiencing and symptomatic improvement. It might also
therapeutic alliance and clients' emotional experiencing, as- have been helpful to provide concrete strategies for coping with
sumed to be common to different psychotherapy approaches, such interpersonal distress which, as we discuss later, was done
were both found to be related to improvement. On the other more frequently in the sessions high in intrapersonal conse-
hand, the focus on intrapersonal consequences (e.g., the link quences and high on alliance.
between distorted thoughts and negative emotions), which re- Second, it is conceivable that the therapists failed to use the
flects an intervention focus unique to cognitive therapy, was cognitive model and techniques in a flexible way. Because the
positively related to depressive symptoms after therapy. Before therapists were conducting a manualized treatment, they may
going on to discuss the implications of these findings, we cau- have used some techniques more frequently or rigidly than they
tion that the correlational nature of this study precludes any would have in a more naturalistic clinical context. This, in turn
firm conclusion about the causal impact of the process variables may have created or exacerbated alliance problems. This inter-
studied on client change or lack thereof. pretation is consistent with the findings of Henry, Strupp, But-
The results concerning the alliance extend the findings ob- ler, Schacht, and Binder (1993), who found that therapists us-
tained by Safran and Wallner (1991) with a variation of cogni- ing a form of psychodynamic therapy not only adhere to pre-
tive therapy that places particular emphasis on the use of the scribed interventions (e.g., interpretation of transference), but
therapist-client relationship as a key to the change process. at times also displayed a mechanical application of techniques
With regard to client experiencing, our results are the first em- and failed to be empathic and supportive. Thirdly, it may be that
pirical findings that we know of pointing to the therapeutic the interventions prescribed in cognitive therapy for correcting
value of clients' emotional involvement in cognitive therapy, alliance problems are not always adequate. Therapists in this
thereby confirming the importance of the recent attention given study followed Beck et al.'s (1979) guidelines, which specify
to affective processes in the cognitive-behavioral movement that problems such as client apathy or opposition to the treat-
(e.g., Mahoney, 1991; Teasdale, 1993). The mechanisms of ment should be addressed by challenging the client's distorted
change by which the experiencing leads to improvement, how- views of cognitive therapy that are responsible for these prob-
ever, remain speculative. Teasdale (1993) has suggested that lems (Beck et al., 1979). To repair such problems, however, it
emotional experiencing in cognitive therapy may facilitate may be more helpful to incorporate interpersonal and experien-
change by helping clients access and modify basic meaning tial interventions into cognitive therapy, as recommended by
structures. As hypothesized by Greenberg and Safran (1987), Burns (1993) and Safran and Segal (1990).
it is also possible that the experience of "primary feelings" (e.g., Preliminary descriptive analyses were also conducted on six
sadness) provides information to clients about their needs (e.g., sessions in which the emphasis on intrapersonal consequences
SPECIAL SECTION: UNIQUE AND COMMON FACTORS 503
was carried out in the context of good therapeutic alliances. In Beck, A. T, Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J.
these sessions, therapists focused on the role of cognitions in (1961). An inventory for measuring depression. Archives of General
emotional distress, and clients were actively involved in the Psychiatry, 4, 561-571.
identification and challenge of thoughts causing negative emo- Bordin, E. S. (1979). The generality of the psychoanalytic concept of
tions. However, it was also found that in all but one of these the working alliance. Psychotherapy: Theory, Research, and Practice,
16, 252-260.
sessions therapists also focused considerably on the conse-
Budescu, D. V. (1993). Dominance analysis: A new approach to the
quences of clients' behavior on other aspects of their function-
problem of relative importance of predictors in multiple regression.
ing. By contrast, this type of intrapersonal consequence was fre- Psychological Bulletin, 114, 542-551.
quent in only one of the nine sessions high in intrapersonal con- Burns, D. D. (1993). Ten days to self-esteem: The leader's manual. New
sequences but low in alliance scores. This type of therapeutic York: Quill.
focus reflected the therapists' attempts to help clients deal with Burns, D. D., & Nolen-Hoeksema, S. (1991). Coping styles, homework
significant life stresses, such as what changes in behavior could assignments, and the effectiveness of cognitive-behavioral therapy.
lead to better ways of coping with interpersonal problems. The Journal of Consulting and Clinical Psychology, 59, 305-311.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
potential benefit of such interventions is suggested by a previous Burns, D. D., & Nolen-Hoeksema, S. (1992). Therapeutic empathy
This document is copyrighted by the American Psychological Association or one of its allied publishers.
finding, obtained with the same data set, showing that the ther- and recovery from depression in cognitive-behavioral therapy: a
apists' encouragement of client's between-session activities was structural equation model. Journal of Consulting and Clinical Psy-
positively related to outcome (Hayes et al., 1995). It remains to chology, 60, 441-449.
be determined, however, whether the client's improvement was DeRubeis, R. J., Evans, M. D., & Hollon, S. D. (1989). Unpublished
primarily caused by the techniques aimed at facilitating action, raw data [Variables of the therapeutic process].
DeRubeis, R. J., Evans, M. D., Hollon, S. D., Garvey, M. J., Grove,
the quality of the alliance, or an interaction between these two
W. M., & Tuason, V. B. (1990). How does cognitive therapy work?
therapeutic components.
Cognitive change and symptom change in cognitive therapy and phar-
The results of the present study regarding intrapersonal con- macotherapy for depression. Journal of Consulting and Clinical Psy-
sequences are inconsistent with the preliminary finding of Kerr chology, 58. 1-8.
et al. (1992), where there was a tendency for intrapersonal links DeRubeis, R. J., & Feeley, M. (1990). Determinants of change in cog-
to be related to improvement. These contrasting findings may nitive therapy for depression. Cognitive Therapy and Research, 14,
be due to the fact that the type of treatment was not identical 469-482.
across the two studies. Because the emphasis in Kerr et al. was Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The Global
on behavioral interventions, it is possible that therapists focused Assessment Scale: A procedure for measuring overall severity of psy-
primarily on a type of intrapersonal links (i.e., the effect of cli- chiatric disturbance. Archives of General Psychiatry, 33, 766-771.
ent's actions on other components of functioning) that was Evans, M. D., Hollon, S. D., DeRubeis, R. J., Piasecki, J. M., Grove,
found in most of the sessions with high alliance. However, it is W. M., Garvey, M. J., & Tuason, V. B. (1992). Differential relapse
more likely that positive and negative outcome have less to do following cognitive therapy and pharmacotherapy for depression. Ar-
chives of General Psychiatry, 49, 802-808.
with the type of links focused on by the therapist than the way
Goldfried, M. R., Newman, C. N., & Hayes, A. M. (1989). Thecoding
such interventions are conducted. As found in one of the ses-
system of therapeutic focus. Unpublished training manual, State Uni-
sions with high intrapersonal consequences and low alliance, versity of New \brk at Stony Brook.
the focus on client's actions and their consequences may some- Goldfried, M. R., & Padawer, W. (1982). Current status and future
times contribute to the alliance problems when used without directions in psychotherapy. In M. R. Goldfried (Ed.), Converging
consideration of the client's readiness to engage in specific ther- themes in psychotherapy: Trends in psychodynamic, humanistic, and
apeutic tasks. behavioral practice (pp. 3-49). New York: Springer-Verlag.
It should also be emphasized that although the descriptive Goldsamt, L. A., Goldfried, M. R., Hayes, A. M., & Kerr, S. (1992).
analyses suggest that the application of cognitive techniques is Beck, Meichenbaum, and Strupp: A comparison of three therapies
not independent of what is taking place in the therapeutic rela- on the dimension of therapist feedback. Psychotherapy, 29, 167-176.
tionship, quantitative analysis failed to show that the interaction Greenberg, L. S., & Safran. J. D. (1987). Emotion in psychotherapy.
between intrapersonal consequences and alliance predict out- New York: Guilford Press.
come beyond the contribution of these two variables combined. Hamilton, M. (1960). A rating scale for depression. Journal of Neuro-
This finding may be due to factors related to statistical power, logical and Neurosurgical Psychiatry, 23, 56-61.
such as the use of multiple predictors and the small sample of Hayes, A. M., Castonguay, L. G., & Goldfried, M. R. (1995). Therapist
this study. Needless to say, more research should be conducted intervention, symptoms reduction, and time to relapse in cogni-
to confirm and possibly extend the present findings. tive-behavior therapy for depression. Manuscript submitted for
publication.
Henry, W. P., Strupp, H. H., Butler, S. F, Schacht, T. E., & Binder, J. L.
References (1993). Effects of training in time-limited dynamic psychotherapy:
Arnkoff, D. B., Victor, B. J., & Glass, C. R. (1993). Empirical research Changes in therapist behavior. Journal of Consulting and Clinical
on factors in psychotherapeutic change. In G. Strieker & J. R. Gold Psychology, 61, 434-440.
(Eds.), Comprehensive handbook of psychotherapy integration (pp. Hollon, S. D., DeRubeis, R. J., Evans, M. D., Wiemer, M., Garvey,
27-42). New York: Plenum. M. J., Grove, W. M., & Tuason, V. B. (1992). Cognitive therapy and
Beck, A. T., & Haaga, D. A. (1992). The future of cognitive therapy. pharmacotherapy for depression: singly and in combination. Archives
Psychotherapy, 29, 34-38. of General Psychiatry, 49, 774-781.
Beck, A. T., Rush, A. J., Shaw, B. E, & Emery. G. (1979). Cognitive Horvath, A. O., & Greenberg L. S. (1986). The development of the
therapy of depression. New York: Guilford Press. working alliance inventory. In L. S. Greenberg & W. M. Pinsof (Eds.),
504 CASTONGUAY, GOLDFRIED, WISER, RAUE, AND HAYES
The psychotherapy process: A research handbook (pp. 529-556). psychotherapy and behavior change (3rd ed., pp. 311-381). New
New York: Guilford Press. York: Wiley.
Kazdin, A. E. (1986). Comparative outcome studies of psychotherapy: Safran, J. D., & Segal, Z. V. (1990). Interpersonal process in cognitive
methodological issues and strategies. Journal of Consulting and Clin- therapy. New York: Basic Books.
ical Psychology, 54, 95-105. Safran, J. D., & Wallner, L. K. (1991). The relative predictive validity of
Kerr, S., Goldfried, M. R., Hayes, A. M., Castonguay, L. G., & Gold- two therapeutic alliance measures in cognitive therapy. Psychological
samt, L. A. (1992). Interpersonal and intrapersonal focus in cogni- Assessment, 31, 188-195.
tive-behavioral and psychodynamic-interpersonal therapies: A pre- Spitzer, R. L., Endicott, J., & Robins, E. (1979). Research diagnostic
liminary analysis of the Sheffield Project. Psychotherapy Research, 4, criteria. New York: Biometrics Research, Evaluation Section, New
266-276. York State Psychiatric Institute.
Klein, M. H., Mathieu, P. L., Gendlin, E. T, & Kiesler, D. J. (1969). Stiles, W. B. (1986). Development of a taxonomy of verbal responses
The Experiencing Scale: A research and training manual (Vol. 1). modes. In L. S. Greenberg& W. M. Pinsof(Eds.), The psychotherapy
Madison: University of Wisconsin Extension Bureau of Audiovisual process: A research handbook (pp. 161-199). New York: Guilford
Instruction. Press.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Klein, M. H., Mathieu-Coughlan, P. L., & Kiesler, D. J. (1986). The Teasdale, J. D. (1993). Emotion and two kinds of meaning: cognitive
This document is copyrighted by the American Psychological Association or one of its allied publishers.
Experiencing Scale. In L. S. Greenberg & W. M. Pinsof (Eds.), The therapy and applied cognitive science. Behavior Research and Ther-
psychotherapy process: A research handbook (pp. 21 -71). New \ork: apy, 31, 339-354.
Guilford Press. Teasdale, J. D.,&Fennell, J. V. (1982). Immediate effects on depression
Lambert, M. J., Shapiro, D. A., Bergin A. E. (1986). Process and out- of cognitive therapy interventions. Cognitive Therapy and Research,
6, 343-352.
come in psychotherapy. In S. L. Garfield & A. E. Bergin (Eds.), Hand-
Tichenor, V., & Hill, C. E. (1989). A comparison of six measures of
book of psychotherapy and behavior change (3rd ed., pp. 157-211).
working alliance. Psychotherapy, 26. 195-199.
New York: Wiley.
Whisman, M. A. (1993). Mediators and moderators in cognitive ther-
Luborsky, L., McLellan, A. T., Woody, G. E., O'Brien, C. P., & Auer-
apy for depression. Psychological Bulletin, 114, 248-265.
bach, A. (1985). Therapist success and its determinants. Archives of
Whitehurst, G. J. (1984). Interrater agreement for journal manuscript
General Psychiatry, 42, 602-611.
reviews. American Psychologist, 39, 22-27.
Mahoney, M. J. (1991). Human change processes. New York: Basic
Books. Received September 15, 1994
Orlinsky, D. E., & Howard, K. I. (1986). Process and outcome in psy- Revision received April 20, 1995
chotherapy. In S. L. Garfield & A. E. Bergin (Eds.), Handbook of Accepted September 19, 1995