Effects of psychological therapies in randomized trials and practice‐based studies
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Background: Randomized trials of the effects of psychological therapies seek internal validity via homogeneous samples and standardized treatment protocols. In contrast, practice‐based studies aim for clinical realism and external validity via heterogeneous samples of clients treated under routine practice conditions. We compared indices of treatment effects in these two types of studies. Method: Using published transformation formulas, the Beck Depression Inventory (BDI) scores from five randomized trials of depression ( N = 477 clients) were transformed into Clinical Outcomes in Routine Evaluation‐Outcome Measure (CORE‐OM) scores and compared with CORE‐OM data collected in four practice‐based studies ( N = 4,196 clients). Conversely, the practice‐based studies' CORE‐OM scores were transformed into BDI scores and compared with randomized trial data. Results: Randomized trials showed a modest advantage over practice‐based studies in amount of pre–post improvement. This difference was compressed or exaggerated depending on the direction of the transformation but averaged about 12%. There was a similarly sized advantage to randomized trials in rates of reliable and clinically significant improvement (RCSI). The largest difference was yielded by comparisons of effect sizes which suggested an advantage more than twice as large, reflecting narrower pre‐treatment distributions in the randomized trials. Conclusions: Outcomes of completed treatments for depression in randomized trials appeared to be modestly greater than those in routine care settings. The size of the difference may be distorted depending on the method for calculating degree of change. Transforming BDI scores into CORE‐OM scores and vice versa may be a preferable alternative to effect sizes for comparisons of studies using these measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300 · cited 2×
“The National Institute of Mental Health Treatment of Depression Collaborative Research Program (NIMH TDCRP; Elkin, 1994; Elkin et al., 1989) compared interpersonal therapy with cognitive behaviour therapy and included two additional conditions: imipramine plus clinical management and pill-placebo plus clinical managem…”
BackgroundMethodThe effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · cited 2×
“Forms are considered valid if up to three items are omitted (Evans et al., 2002).”
BackgroundSelf-citationEvaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996) · American Psychologist · doi:10.1037/0003-066x.51.10.1059 · Cited by 573
Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., Benson, L., Connell, J., Audin, K., & McGrath, G. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.2.184 · Cited by 532 · cited 4×
“For example, if we had calculated the standard error of the difference using published internal consistency reliabilities for the CORE-OM (0.94; Barkham et al., 2001) and the BDI (0.”
MethodInfluentialSelf-citationShapiro, D. A., Barkham, M., Rees, A., Hardy, G. E., Reynolds, S., & Startup, M. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.3.522 · Cited by 485
Self-citationThe effects of psychological therapies under clinically representative conditions: a meta-analysis
Shadish, W. R., Navarro, A. M., Matt, G. E., & Phillips, G. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.4.512 · Cited by 381
Dose-effect relations and responsive regulation of treatment duration: The good enough level.
Barkham, M., Connell, J., Stiles, W. B., Miles, J. N. V., Margison, F., Evans, C., & Mellor-Clark, J. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.1.160 · Cited by 293
Self-citationEarly sudden gains in psychotherapy under routine clinic conditions: Practice-based evidence.
Stiles, W. B., Leach, C., Barkham, M., Lucock, M., Iveson, S., Shapiro, D. A., Iveson, M., & Hardy, G. E. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.1.14 · Cited by 220 · cited 1×
“It is possible that clients who were not accepted for treatment or who failed to appear for or to complete treatment would have fared worse than those who complied and completed (Stiles et al., 2003).”
BackgroundSelf-citationBarkham, M., Mellor-Clark, J., Connell, J., & Cahill, J. (2006) · Counselling and Psychotherapy Research · doi:10.1080/14733140600581218 · Cited by 204
Self-citation
Cited by
Michelson, D., Davenport, C., Dretzke, J., Barlow, J., & Day, C. (2013) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-013-0128-0 · Cited by 292
Death anxiety interventions in patients with advanced cancer: a systematic review
Grossman, C. H., Brooker, J., Michael, N., & Kissane, D. (2018) · Palliative Medicine · doi:10.1177/0269216317722123 · Cited by 144
Carey, T. A., Tai, S. J., & Stiles, W. B. (2013) · Professional Psychology Research and Practice · doi:10.1037/a0035038 · Cited by 107
Systematic review of practice‐based research on psychological therapies in routine clinic settings
Cahill, J., Barkham, M., & Stiles, W. B. (2010) · British Journal of Clinical Psychology · doi:10.1348/014466509x470789 · Cited by 92
Self-citationvan der Lem, R., van der Wee, N. J. A., van Veen, T., & Zitman, F. G. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000330890 · Cited by 63
Metadata
- Authors
- Barkham, M., Stiles, W. B., Connell, J., Twigg, E., Leach, C., Lucock, M., Mellor‐Clark, J., Bower, P., King, M., Shapiro, D. A., Hardy, G. E., Greenberg, L., & Angus, L.
- Venue
- British Journal of Clinical Psychology
- Publisher
- Wiley
- Published
- 2008-11
- Volume
- 47
- Issue
- 4
- Pages
- 397-415
- ISSN
- 0144-6657 (ISSN-L)
- 2044-8260
- OpenAlex
- W2090846879
- Cited by
- 68
- References
- 14
- FWCI
- 8.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effects of psychological therapies in randomized trials and practice‐based studies. https://app.cochat.ai/papers/10.1348/014466508x311713
- The paper
- Barkham, M., Stiles, W. B., Connell, J., Twigg, E., Leach, C., Lucock, M., Mellor‐Clark, J., Bower, P., King, M., Shapiro, D. A., Hardy, G. E., Greenberg, L., & Angus, L. (2008). Effects of psychological therapies in randomized trials and practice‐based studies. British Journal of Clinical Psychology. https://doi.org/10.1348/014466508x311713
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.