The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
The dependability of alliance assessments: The alliance–outcome correlation is larger than you might think.
Open accessAbstract
OBJECTIVE: To examine the dependability of alliance scores at the patient and therapist level, to evaluate the potential causal direction of session-to-session changes in alliance and depressive symptoms, and to investigate the impact of aggregating the alliance over progressively more sessions on the size of the alliance-outcome relationship. METHOD: We used data from a study (N = 45 patients; N = 9 therapists) of psychotherapy for major depressive disorder in which the alliance was measured at every treatment session to calculate generalizability coefficients and to predict change in depressive symptoms from alliance scores. Two replication samples were also used. RESULTS: At the therapist level, a large number of patients (about 60) per therapist is needed to provide a dependable therapist-level alliance score. At the patient level, generalizability coefficients revealed that a single assessment of the alliance is only marginally acceptable. Very good (>.90) dependability at the patient level is only achieved through aggregating 4 or more assessments of the alliance. Session-to-session change in the alliance predicted subsequent session-to-session changes in symptoms. Evidence for reverse causation was found in later-in-treatment sessions, suggesting that only aggregates of early treatment alliance scores should be used to predict outcome. Session 3 alliance scores explained 4.7% of outcome variance, but the average of Sessions 3-9 explained 14.7% of outcome variance. CONCLUSION: Adequate assessment of the alliance using multiple patients per therapist and at least 4 treatment sessions is crucial for fully understanding the size of the alliance-outcome relationship.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The generalizability of the psychoanalytic concept of the working alliance.
Bordin, E. S. (1979) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0085885 · Cited by 5,238
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Relation between working alliance and outcome in psychotherapy: A meta-analysis
Horvath, A. O., & Symonds, B. D. (1991) · Journal of Counseling Psychology · doi:10.1037/0022-0167.38.2.139 · Cited by 2,673
Wilamowska (2010) · doi:10.1001/archpsyc.1988.01800320058007 · Cited by 2,115
THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†
Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1963.tb00206.x · Cited by 737
Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.842 · Cited by 646 · cited 8×
“The relatively large number (80) of therapists in the Baldwin et al. (2007) study likely provided enough statistical power to detect a therapist-level effect despite the fact that the low number (4.1) of patients per therapists in that study provided a ceiling on the potential size of the…”
BackgroundMethodResultInfluentialThe working alliance: Where are we and where should we go?
Castonguay, L. G., Constantino, M. J., & Holtforth, M. G. (2006) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.43.3.271 · Cited by 457
Determinants of change in cognitive therapy for depression
DeRubeis, R. J., & Feeley, M. (1990) · Cognitive Therapy and Research · doi:10.1007/bf01172968 · Cited by 401 · cited 1×
“…that technical factors predicted outcome more strongly than the alliance, or that the alliance did not predict outcome once other variables have been controlled (DeRubeis, Brotman, & Gibbons, 2005; DeRubeis & Feeley, 1990; Gaston, 1990; Feeley, DeRubeis, & Gelfand, 1999; Kokotovic & Tracey, 1990).”
BackgroundA Conceptual and Methodological Analysis of the Nonspecifics Argument.
DeRubeis, R. J., Brotman, M. A., & Gibbons, C. J. (2005) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpi022 · Cited by 310
Klein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., Arnow, B., Blalock, J. A., Manber, R., Markowitz, J. C., et al. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.6.997 · Cited by 264
Cited by
The alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763
Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0034332 · Cited by 443
Therapeutic alliance as a mediator of change: A systematic review and evaluation of research
Baier, A. L., Kline, A. C., & Feeny, N. C. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101921 · Cited by 441
Del Re, A. C., Flückiger, C., Horvath, A. O., Symonds, D., & Wampold, B. E. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.07.002 · Cited by 397
Norwood, C., Moghaddam, N. G., Malins, S., & Sabin‐Farrell, R. (2018) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2315 · Cited by 324
Zilcha-Mano, S. (2017) · American Psychologist · doi:10.1037/a0040435 · Cited by 303
Therapeutic alliance predicts symptomatic improvement session by session.
Falkenström, F., Granström, F., & Holmqvist, R. (2013) · Journal of Counseling Psychology · doi:10.1037/a0032258 · Cited by 291
The role of deliberate practice in the development of highly effective psychotherapists.
Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P. (2015) · Psychotherapy · doi:10.1037/pst0000015 · Cited by 267
Nienhuis, J. B., Owen, J., Valentine, J. C., Winkeljohn Black, S., Halford, T. C., Parazak, S. E., Budge, S., & Hilsenroth, M. (2018) · Psychotherapy Research · doi:10.1080/10503307.2016.1204023 · Cited by 257
Treatment adherence: The importance of therapist flexibility in relation to therapy outcomes.
Owen, J., & Hilsenroth, M. J. (2014) · Journal of Counseling Psychology · doi:10.1037/a0035753 · Cited by 177
Addressing racial and ethnic microaggressions in therapy
Owen, J., Tao, K. W., Imel, Z. E., Wampold, B. E., & Rodolfa, E. (2014) · Professional Psychology: Research and Practice · doi:10.1037/a0037420 · Cited by 143
Falkenström, F., Hatcher, R. L., Skjulsvik, T., Larsson, M. H., & Holmqvist, R. (2015) · Psychological Assessment · doi:10.1037/pas0000038 · Cited by 117
Ormhaug, S. M., Jensen, T. K., Wentzel-Larsen, T., & Shirk, S. R. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033884 · Cited by 113
Falkenström, F., Ekeblad, A., & Holmqvist, R. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000119 · Cited by 103
What is Supportive Psychotherapy?
Markowitz, J. C. (2014) · Focus · doi:10.1176/appi.focus.12.3.285 · Cited by 68
Haug, T., Nordgreen, T., Öst, L.-G., Tangen, T., Kvale, G., Hovland, O. J., Heiervang, E. R., & Havik, O. E. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.004 · Cited by 64
Webb, C. A., Beard, C., Auerbach, R. P., Menninger, E., & Björgvinsson, T. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.015 · Cited by 38
Is the therapeutic alliance overvalued in the treatment of eating disorders?
Brown, A., Mountford, V. A., & Waller, G. (2013) · International Journal of Eating Disorders · doi:10.1002/eat.22177 · Cited by 39
Common (Nonspecific) Factors in Psychotherapy
Huibers, M. J. H., & Cuijpers, P. (2015) · The Encyclopedia of Clinical Psychology · doi:10.1002/9781118625392.wbecp272 · Cited by 39
Gómez Penedo, J. M., Babl, A. M., grosse Holtforth, M., Hohagen, F., Krieger, T., Lutz, W., Meyer, B., Moritz, S., Klein, J. P., & Berger, T. (2020) · Journal of Medical Internet Research · doi:10.2196/15824 · Cited by 33
I-sharing on the couch: on the clinical implications of shared subjective experience.
Pinel, E. C., Bernecker, S. L., & Rampy, N. M. (2015) · Journal of Psychotherapy Integration · doi:10.1037/a0038895 · Cited by 35
Goldberg, S. B., Hoyt, W. T., Nissen-Lie, H. A., Nielsen, S. L., & Wampold, B. E. (2018) · Psychotherapy Research · doi:10.1080/10503307.2016.1216625 · Cited by 35
Fjermestad, K. W., Lerner, M. D., McLeod, B. D., Wergeland, G. J. H., Haugland, B. S. M., Havik, O. E., Öst, L. ‐., & Silverman, W. K. (2018) · Journal of Clinical Psychology · doi:10.1002/jclp.22551 · Cited by 24
Beierl, E. T., Murray, H., Wiedemann, M., Warnock-Parkes, E., Wild, J., Stott, R., Grey, N., Clark, D. M., & Ehlers, A. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.602648 · Cited by 22
Norwood, C., Sabin‐Farrell, R., Malins, S., & Moghaddam, N. G. (2021) · Journal of Clinical Psychology · doi:10.1002/jclp.23112 · Cited by 12
Client resistance predicts outcomes in cognitive–behavioral therapy for panic disorder
Schwartz, R. A., Chambless, D. L., McCarthy, K. S., Milrod, B., & Barber, J. P. (2019) · Psychotherapy Research · doi:10.1080/10503307.2018.1504174 · Cited by 9
Diehm, M. L., Kunz, J. I., Goerigk, S., Wolf, J., Lange, J., Jobst, A., Padberg, F., & Reinhard, M. A. (2025) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70200 · Cited by 2
“While the therapeutic working alliance has been traditionally examined as a unidirectional predictor of symptom change (Crits-Christoph et al. 2011; Falkenström et al. 2013; Strunk et al. 2012; Webb et al. 2014), researchers suggest that symptom severity can also influence the quality of the…”
Choice of Psychotherapy Approach
Marouf, F. (2020) · Psychotherapy in Later Life · doi:10.1017/9781108693905.005
Metadata
- Authors
- Crits-Christoph, P., Gibbons, M. B. C., Hamilton, J., Ring-Kurtz, S., & Gallop, R.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2011
- Volume
- 79
- Issue
- 3
- Pages
- 267-278
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2048781753
- Cited by
- 220
- References
- 13
- FWCI
- 17.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.