The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
The dependability of alliance assessments: The alliance–outcome correlation is larger than you might think.
Open accessAbstract
OBJECTIVE: To examine the dependability of alliance scores at the patient and therapist level, to evaluate the potential causal direction of session-to-session changes in alliance and depressive symptoms, and to investigate the impact of aggregating the alliance over progressively more sessions on the size of the alliance-outcome relationship. METHOD: We used data from a study (N = 45 patients; N = 9 therapists) of psychotherapy for major depressive disorder in which the alliance was measured at every treatment session to calculate generalizability coefficients and to predict change in depressive symptoms from alliance scores. Two replication samples were also used. RESULTS: At the therapist level, a large number of patients (about 60) per therapist is needed to provide a dependable therapist-level alliance score. At the patient level, generalizability coefficients revealed that a single assessment of the alliance is only marginally acceptable. Very good (>.90) dependability at the patient level is only achieved through aggregating 4 or more assessments of the alliance. Session-to-session change in the alliance predicted subsequent session-to-session changes in symptoms. Evidence for reverse causation was found in later-in-treatment sessions, suggesting that only aggregates of early treatment alliance scores should be used to predict outcome. Session 3 alliance scores explained 4.7% of outcome variance, but the average of Sessions 3-9 explained 14.7% of outcome variance. CONCLUSION: Adequate assessment of the alliance using multiple patients per therapist and at least 4 treatment sessions is crucial for fully understanding the size of the alliance-outcome relationship.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The generalizability of the psychoanalytic concept of the working alliance.
Bordin, E. S. (1979) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0085885 · Cited by 5,238
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Relation between working alliance and outcome in psychotherapy: A meta-analysis
Horvath, A. O., & Symonds, B. D. (1991) · Journal of Counseling Psychology · doi:10.1037/0022-0167.38.2.139 · Cited by 2,673
Wilamowska (2010) · doi:10.1001/archpsyc.1988.01800320058007 · Cited by 2,115
THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†
Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1963.tb00206.x · Cited by 737
Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.842 · Cited by 646 · cited 8×
“The relatively large number (80) of therapists in the Baldwin et al. (2007) study likely provided enough statistical power to detect a therapist-level effect despite the fact that the low number (4.1) of patients per therapists in that study provided a ceiling on the potential size of the…”
BackgroundMethodResultInfluentialThe working alliance: Where are we and where should we go?
Castonguay, L. G., Constantino, M. J., & Holtforth, M. G. (2006) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.43.3.271 · Cited by 457
Determinants of change in cognitive therapy for depression
DeRubeis, R. J., & Feeley, M. (1990) · Cognitive Therapy and Research · doi:10.1007/bf01172968 · Cited by 401 · cited 1×
“…that technical factors predicted outcome more strongly than the alliance, or that the alliance did not predict outcome once other variables have been controlled (DeRubeis, Brotman, & Gibbons, 2005; DeRubeis & Feeley, 1990; Gaston, 1990; Feeley, DeRubeis, & Gelfand, 1999; Kokotovic & Tracey, 1990).”
BackgroundKlein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., Arnow, B., Blalock, J. A., Manber, R., Markowitz, J. C., et al. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.6.997 · Cited by 264
Gaston, L. (1991) · Psychological Assessment: A Journal of Consulting and Clinical Psychology · doi:10.1037/1040-3590.3.1.68 · Cited by 219
Cited by
The alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763
Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0034332 · Cited by 443
Therapeutic alliance as a mediator of change: A systematic review and evaluation of research
Baier, A. L., Kline, A. C., & Feeny, N. C. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101921 · Cited by 441
Del Re, A. C., Flückiger, C., Horvath, A. O., Symonds, D., & Wampold, B. E. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.07.002 · Cited by 397
Norwood, C., Moghaddam, N. G., Malins, S., & Sabin‐Farrell, R. (2018) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2315 · Cited by 324
Metadata
- Authors
- Crits-Christoph, P., Gibbons, M. B. C., Hamilton, J., Ring-Kurtz, S., & Gallop, R.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2011
- Volume
- 79
- Issue
- 3
- Pages
- 267-278
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2048781753
- Cited by
- 220
- References
- 12
- FWCI
- 17.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The dependability of alliance assessments: The alliance–outcome correlation is larger than you might think. https://app.cochat.ai/papers/10.1037/a0023668
- The paper
- Crits-Christoph, P., Gibbons, M. B. C., Hamilton, J., Ring-Kurtz, S., & Gallop, R. (2011). The dependability of alliance assessments: The alliance–outcome correlation is larger than you might think. Journal of Consulting and Clinical Psychology. https://doi.org/10.1037/a0023668
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.