The external validity of controlled clinical trials of psychotherapy for depression and anxiety: A naturalistic study
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Psychotherapy researchers have increasingly called for clinical practice and training to focus on empirically supported therapies tested in randomized controlled clinical trials (RCTs). In this paper, we report data from a naturalistic study of successful treatments in clinical practice that bear on the external validity of ESTs for three disorders. Participants were 242 experienced doctoral‐level clinicians who reported on their last successfully treated patient seeking treatment for clinically significant depression, panic, or anxiety without panic. Successful treatments typically take substantially longer than the 8–16 sessions characteristic of efficacy trials for these disorders, even for the briefest treatments (cognitive‐behavioural). Of particular relevance for generalizability from RCTs, most patients in clinical practice present with multiple problems other than a single Axis I disorder, which clinicians of all theoretical orientations recognize and treat, and these co‐occurring conditions have a substantial impact on treatment length in everyday practice. The data suggest the importance of effectiveness research in bridging research and practice. They also point to the utility of distinguishing two complementary ways in which effectiveness research can be understood and implemented: by starting with efficacy trials and then testing treatments with promising results in the laboratory using broader community samples; or by starting with everyday clinical practice, examining patterns of covariation between specific interventions and outcomes at clinically meaningful follow‐up intervals with diverse and ecologically valid samples and using these data to generate prototypes of treatments that can be used to guide the next generation of experimental studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 1×
“In psychology, a growing chorus of researchers have called for psychotherapypractice and training to be limited to treatments that have demonstrated efe cacy in randomized controlled trials (RCTs; Calhoun, Moras, Pilkonis, & Rehm, 1998; Chambless & Hollon, 1998 ).”
BackgroundBrown, T. A., Chorpita, B. F., & Barlow, D. H. (1998) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.107.2.179 · Cited by 1,400
A phase model of psychotherapy outcome: Causal mediation of change.
Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.678 · Cited by 576
Treatment and prevention of depression
Hollon, S. D., Thase, M. E., & Markowitz, J. C. (2002) · Psychological Science in the Public Interest · doi:10.1111/1529-1006.00008 · Cited by 511
The role of nonspecific factors in cognitive-behavior therapy for depression.
Ilardi, S. S., & Craighead, W. E. (1994) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.1994.tb00016.x · Cited by 501
Eddy, K. T., Dutra, L., Bradley, R., & Westen, D. (2004) · Clinical Psychology Review · doi:10.1016/j.cpr.2004.08.004 · Cited by 475
Self-citationPatterns of symptomatic recovery in psychotherapy.
Kopta, S. M., Howard, K. I., Lowry, J. L., & Beutler, L. E. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.5.1009 · Cited by 442 · cited 1×
“Naturalistic studies tendto show dose‐ response effects well beyondthe 12‐ 16 sessions characteristic ofmanualizedtreatments ( Kopta, Howard, Lowry, B Seligman, 1995).”
BackgroundToward a more clinically valid approach to therapy research.
Goldfried, M. R., & Wolfe, B. E. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.143 · Cited by 278
Research on psychotherapy efficacy and effectiveness: Between Scylla and Charybdis?
Nathan, P. E., Stuart, S. P., & Dolan, S. L. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.6.964 · Cited by 258
Hammen, C., Ellicott, A., Gitlin, M., & Jamison, K. R. (1989) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.98.2.154 · Cited by 252 · cited 1×
“Blatt & Zuroff, 1992; Hammen, Ellicott, Gitlin, J Kwon &Whisman, 1998).”
Cited by
Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.4.631 · Cited by 1,212
Self-citationPromoting and Protecting Youth Mental Health Through Evidence-Based Prevention and Treatment.
Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.6.628 · Cited by 589
Borckardt, J. J., Nash, M. R., Murphy, M. D., Moore, M., Shaw, D., & O'Neil, P. (2008) · American Psychologist · doi:10.1037/0003-066x.63.2.77 · Cited by 407
Driessen, E., Van, H. L., Don, F. J., Peen, J., Kool, S., Westra, D., Hendriksen, M., Schoevers, R. A., Cuijpers, P., Twisk, J. W. R., et al. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12070899 · Cited by 241
Brand, B., Classen, C., Lanins, R., Loewenstein, R., McNary, S., Pain, C., & Putnam, F. (2009) · Psychological Trauma: Theory, Research, Practice, and Policy · doi:10.1037/a0016210 · Cited by 172
“For example, research using this methodology has found that patients treated in the community typically present with multiple, rather than single psychiatric disorders, and that these cooccurring disorders substantially lengthen treatment ( Morrison et al., 2003 ).”
BackgroundMethodInfluential
Metadata
- Authors
- Morrison, K. H., Bradley, R., & Westen, D.
- Venue
- Psychology and Psychotherapy: Theory, Research and Practice
- Publisher
- Wiley
- Published
- 2003-06
- Volume
- 76
- Issue
- 2
- Pages
- 109-132
- ISSN
- 1476-0835 (ISSN-L)
- 2044-8341
- OpenAlex
- W1984791174
- Cited by
- 85
- References
- 12
- FWCI
- 5.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The external validity of controlled clinical trials of psychotherapy for depression and anxiety: A naturalistic study. https://app.cochat.ai/papers/10.1348/147608303765951168
- The paper
- Morrison, K. H., Bradley, R., & Westen, D. (2003). The external validity of controlled clinical trials of psychotherapy for depression and anxiety: A naturalistic study. Psychology and Psychotherapy: Theory, Research and Practice. https://doi.org/10.1348/147608303765951168
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.