Implications of therapist effects for the design and analysis of comparative studies of psychotherapies.
Abstract
Technical reasons are presented as to why therapist should be included as a random design factor in the nested analysis of (co)variance (AN[C]OVA) design commonly used in psychotherapy research. Incorrect specification of the ANOVA design can, under some circumstances, result in incorrect estimation of the error term, overly liberal F ratios, and an unacceptably high risk of Type I errors. Review of studies indicates that the great majority of investigators continue to ignore this issue. Computer simulation studies revealed that considerable bias can be introduced by not specifying therapist as a random term. Finally, a reanalysis is presented of data from 10 psychotherapy outcome studies that indicated that therapist effects vary considerably and at times can be large. More recent studies that implement better quality controls appear to demonstrate less variance due to therapist. The implications of these results for the design of future studies are discussed.
Cites (1)
- Comparative efficacy of cognitive therapy and pharmacotherapy in the treatment of depressed outpatientsRush, Augustus J., Beck, Aaron T., Kovacs, Maria, Hollon, Steven · 1977 · Cognitive Therapy and Research
Cited by (52)
- Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaborationBoutron, Isabelle, Moher, David, Altman, Douglas G., Schulz, Kenneth F., Ravaud, Philippe, for the CONSORT Group* · 2008 · Annals of Internal Medicine
- Defining empirically supported therapies.Chambless, Dianne L., Hollon, Steven D. · 1998 · Journal of Consulting and Clinical Psychology
- The Empirical Status of Empirically Supported Psychotherapies: Assumptions, Findings, and Reporting in Controlled Clinical Trials.Westen, Drew, Novotny, Catherine M., Thompson-Brenner, Heather · 2004 · Psychological Bulletin
- A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes."Wampold, Bruce E., Mondin, Gregory W., Moody, Marcia, Stich, Frederick, Benson, Kurt, Ahn, Hyun-nie · 1997 · Psychological Bulletin
- The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trialsBorrelli, Belinda · 2011 · Journal of Public Health Dentistry
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. https://app.cochat.ai/papers/10.1037//0022-006x.59.1.20
- The paper
- Crits-Christoph, P., & Mintz, J. (1991). Implications of therapist effects for the design and analysis of comparative studies of psychotherapies. Journal of Consulting and Clinical Psychology. https://doi.org/10.1037//0022-006x.59.1.20
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.