Drawing causal inferences from randomized controlled trials in psychotherapy research
The DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Randomized control trials (RCTs) have played a critical role in psychotherapy research. This article discusses RCTs in the context of the criteria for drawing causal inferences in psychotherapy and intervention research more generally. The article also highlights underused variations of RCTs and how they not only establish causal relations but also address critical questions that can improve our intervention portfolio and patient care. CONCLUSION: Random assignment is discussed in terms of what it can and cannot do in relation to drawing conclusions about the effects of interventions. Finally, RCTs are examined in the context of multiple questions that can guide therapy research, improve patient care, and develop treatments that reach people in need of psychological services.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, multiple alternative designs and methods can be useful in shedding light on mechanisms of change, such as single-case experimental studies [80] and qualitative work embedded in RCTs (e.g., [83]).”
From Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: a systematic review (2024) · cites this paper as [80]
In the citing paper
“As noted already long ago [79], but discussed more recently also by Kazdin [80] and others (e.g., [81, 82]), causality can reasonably be inferred even in the absence of randomization—and, in some cases, has to be.”
From Mediators of outcome in adolescent psychotherapy and their implications for theories and mechanisms of change: a systematic review (2024) · cites this paper as [80]
Citations
Cites
The Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974 · cited 1×
“The criteria, well known in science, were delineated in a seminal paper (Hill, 1965) and often are referred to as the Hill criteria.”
BackgroundSingle-Case Research Designs: Methods for Clinical and Applied Settings
Kazdin, A. E. (1982) · Cited by 3,985
Self-citationSingle-case research designs: Methods for clinical and applied settings
Hayes, S. C. (1983) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(83)90018-6 · Cited by 2,677
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998 · cited 1×
“Preregistration of research is now common across many funding agencies and journals (Nosek et al., 2018).”
BackgroundUnderstanding and misunderstanding randomized controlled trials
Deaton, A., & Cartwright, N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.12.005 · Cited by 1,841 · cited 2×
“At the same time, randomized trials may be worshipped a bit too much and perhaps other types of studies (e.g., observational research) and designs that permit causal relations (single-case experiments) a bit too little (Deaton & Cartwright, 2018; Frieden, 2017).”
BackgroundMethodSome implicit common factors in diverse methods of psychotherapy.
Rosenzweig, S. (1936) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1936.tb05248.x · Cited by 1,042 · cited 1×
“The role of such factors in explaining treatment effects has a long history going back before most of us were born (Rosenzweig, 1936) and continuing to serve as a major view and topic of contemporary research (Crits-Christoph & Gibbons, 2021).”
BackgroundPsychological Treatments for the World: Lessons from Low- and Middle-Income Countries
Singla, D. R., Kohrt, B. A., Murray, L. K., Anand, A., Chorpita, B. F., & Patel, V. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045217 · Cited by 913 · cited 1×
“Related, there is now a rather large literature showing that lay individuals can effectively treat severe psychopathology (Barnett et al., 2018; Kohrt et al., 2018; Patel et al., 2016; Singla et al., 2017).”
BackgroundAdaptive designs in clinical trials: why use them, and how to run and report them
Pallmann, P., Bedding, A. W., Choodari-Oskooei, B., Dimairo, M., Flight, L., Hampson, L. V., Holmes, J., Mander, A. P., Odondi, L., Sydes, M. R., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1017-7 · Cited by 829 · cited 1×
“Designs that change during the study itself including the possibility of stopping early are referred to as adaptive designs (FDA, 2016; Pallmann et al., 2018).”
BackgroundEvidence for Health Decision Making — Beyond Randomized, Controlled Trials
Frieden, T. R. (2017) · New England Journal of Medicine · doi:10.1056/nejmra1614394 · Cited by 770
Szucs, D., & Ioannidis, J. P. A. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000797 · Cited by 761 · cited 1×
“Sufficient sample size is not trivial because weak power to detect small and medium effects is a rather common problem (e.g., Götz et al., 2022; Szucs & Ioannidis, 2017).”
Background
Research works printed but not linked: 5
- Adesina, M. A., & Olajire, T. I. (2020). Physical and psychological complications of mastectomy: The role of physiotherapy. World News of Natural Sciences, 29(3), 212–224.
- Crits-Christoph, P., & Gibbons, M. B. C. (2021). Psychotherapy process-outcome research: Advances in understanding causal connections. In M. Barkham, W. Lutz, & L. Castonguay (Eds.), The Bergin and Garfield handbook of psychotherapy and behavior change (pp. 263–295). John Wiley & Sons.
- 10.1037/0022-006X.57.1.131 · doi:10.1037/0022-006x.57.1.131
- Kazdin, A. E. (2021a). Extending the scalability and reach of psychosocial interventions. In M. Barkham, W. Lutz, & L. Castonguay (Eds.), The Bergin and Garfield handbook of psychotherapy and behavior change (pp. 763–789). John Wiley & Sons.
- 10.1037/0022-006X.57.1.138 · doi:10.1037/0022-006x.57.1.138 · Paper page
Cited by
Taubner, S., Ioannou, Y., Saliba, A., Sales, C. M. D., Volkert, J., Protić, S., Adler, A., Barkauskiene, R., Conejo-Cerón, S., Di Giacomo, D., et al. (2024) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-023-02186-9 · Cited by 36
“Furthermore, multiple alternative designs and methods can be useful in shedding light on mechanisms of change, such as single-case experimental studies [80] and qualitative work embedded in RCTs (e.g., [83]).”
Causality in psychotherapy research: Towards evidential pluralism
Oddli, H. W., Stänicke, E., Halvorsen, M. S., & Lindstad, T. G. (2022) · Psychotherapy Research · doi:10.1080/10503307.2022.2161433 · Cited by 18
“However, pragmatic trials that allow more flexible use of manuals in response to patient responses than in the usual RCTs are, according to Kazdin (2022), an underused option to ease the transition of results from the experimental to the natural setting.”
BackgroundInfluentialYe, Z., Gao, Y., Yuan, J., Chen, F., Xu, P., & Liu, W. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121292 · Cited by 18
“One gut microbiota taxon was excluded due to the absence of suitable SNPs.”
Zainal, N. H., Benjet, C. L., Albor, Y., Núñez-Delgado, M. J., Cruz, R. Z., Contreras‐Ibáñez, C. C., Cudris–Torres, L., de la Peña, F. R., González, N., Guerrero-López, B., et al. (2025) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.70005 · Cited by 9
Self-citationZainal, N. H., Tan, H. H., Hong, R. Y. S., & Newman, M. G. (2024) · JMIR Mental Health · doi:10.2196/53712 · Cited by 7
“However, the absence of a control arm in these studies precluded knowing whether the brief MBI would outperform an active control, an essential aspect for drawing causal inferences [26].”
Metadata
- Authors
- Kazdin, A. E.
- Affiliations
- Yale University (US)
- Corresponding author
- Kazdin, Alan E.
- ORCID
- Kazdin, Alan E.
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2022-10-13
- Volume
- 33
- Issue
- 8
- Pages
- 991-1003
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W4304845746
- Cited by
- 16
- References
- 65
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 3 · 2023: 3 · 2022: 1
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychotherapy Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- randomized controlled trials, causal inference, random assignment, intervention research, treatment effects, patient care
- MeSH terms
- Humans, Psychotherapy, Research Design, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Drawing causal inferences from randomized controlled trials in psychotherapy research. https://app.cochat.ai/papers/10.1080/10503307.2022.2130112
- The paper
- Kazdin, A. E. (2023). Drawing causal inferences from randomized controlled trials in psychotherapy research. Psychotherapy Research. https://doi.org/10.1080/10503307.2022.2130112
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.