Some Problems with Randomized Controlled Trials and Some Viable Alternatives
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Randomized controlled trials (RCTs) are currently the dominant methodology for evaluating psychological treatments. They are widely regarded as the gold standard, and in the current climate, it is unlikely that any particular psychotherapy would be considered evidence‐based unless it had been subjected to at least one, and usually more, RCTs. Despite the esteem within which they are held, RCTs have serious shortcomings. They are the methodology of choice for answering some questions but are not well suited for answering others. In particular, they seem poorly suited for answering questions related to why therapies work in some situations and not in others and how therapies work in general. Ironically, the questions that RCTs cannot answer are the questions that are of most interest to clinicians and of most benefit to patients. In this paper, we review some of the shortcomings of RCTs and suggest a number of other approaches. With a more nuanced understanding of the strengths and weaknesses of RCTs and a greater awareness of other research strategies, we might begin to develop a more realistic and precise understanding of which treatment options would be most effective for particular clients with different problems and in different circumstances. Copyright © 2015 John Wiley & Sons, Ltd. Key Practitioner Message: Practitioners can think more critically about evidence provided by RCTs and can contribute to progress in psychotherapy by conducting research using different methodologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327
Psychotherapy change process research: Realizing the promise
Elliott, R. (2010) · Psychotherapy Research · doi:10.1080/10503300903470743 · Cited by 367
A guide to conducting a task analysis of psychotherapeutic change
Greenberg, L. S. (2007) · Psychotherapy Research · doi:10.1080/10503300600720390 · Cited by 185
Budd, R., & Hughes, I. (2009) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.648 · Cited by 149
Carey, T. A., Tai, S. J., & Stiles, W. B. (2013) · Professional Psychology Research and Practice · doi:10.1037/a0035038 · Cited by 107
Can patients specify treatment parameters? a preliminary investigation
Carey, T. A. (2005) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.454 · Cited by 34
Self-citation
Cited by
Wiltsey Stirman, S., Gamarra, J. M., Bartlett, B. A., Calloway, A., & Gutner, C. A. (2017) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12218 · Cited by 138
Recent Developments in Group Psychotherapy Research
Rosendahl, J., Alldredge, C. T., Burlingame, G. M., & Strauss, B. (2021) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.20200031 · Cited by 117
Identifying Functional Mechanisms in Psychotherapy: A Scoping Systematic Review
Carey, T. A., Griffiths, R., Dixon, J. E., & Hines, S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00291 · Cited by 53
“Aggregating data and emphasizing instead, central tendencies between the groups, masks this result (9).”
Self-citationSMEETS, R. G. M., HERTROIJS, D. F. L., MUKUMBANG, F. C., KROESE, M. E. A. L., RUWAARD, D., & ELISSEN, A. M. J. (2022) · The Milbank Quarterly · doi:10.1111/1468-0009.12543 · Cited by 53
Calderon, G., Gonzalez-Izundegui, D., Shan, K. L., Garcia-Valencia, O. A., Cifuentes, L., Campos, A., Collazo-Clavell, M. L., Shah, M., Hurley, D. L., Abu Lebdeh, H. S., et al. (2022) · International Journal of Obesity · doi:10.1038/s41366-021-01019-6 · Cited by 52
“Although, RCTs are considered the gold standard for testing the efficacy and the safety of medical interventions, their outcomes are not consistently replicated in the clinical practice as a result of their strict eligibility criteria, specific study regulations and relatively short duration [21].”
Background
Metadata
- Authors
- Carey, T. A., & Stiles, W. B.
- Venue
- Clinical Psychology & Psychotherapy
- Publisher
- Wiley
- Published
- 2015-01-20
- Volume
- 23
- Issue
- 1
- Pages
- 87-95
- ISSN
- 1063-3995 (ISSN-L)
- 1099-0879
- OpenAlex
- W2098818823
- Cited by
- 108
- References
- 6
- FWCI
- 7.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Some Problems with Randomized Controlled Trials and Some Viable Alternatives. https://app.cochat.ai/papers/10.1002/cpp.1942
- The paper
- Carey, T. A., & Stiles, W. B. (2016). Some Problems with Randomized Controlled Trials and Some Viable Alternatives. Clinical Psychology & Psychotherapy. https://doi.org/10.1002/cpp.1942
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.