The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Research Strategies to Discern Active Psychological Therapy Components: A Scoping Review
Open accessAbstract
Some clinical scientists are shifting from research on complete named therapy protocols to a more elemental approach—research on specific therapy components that contribute to therapy goals. To characterize and evaluate this emerging field, we systematically searched PsycINFO and Medline for studies evaluating therapy components. We identified 208 studies. In a scoping review, we map, explain, and critically appraise the seven research strategies employed: (a) expert opinion, (b) shared components, (c) associations between the presence of components and therapy effects, (d) associations between fidelity to components and therapy effects, (e) microtrials, (f) additive and dismantling trials, and (g) factorial experiments. Our examination reveals a need for (a) renewed emphasis on experimental trials (vs. meta-analyses testing associations less rigorously), (b) expanded efforts to locate components within the emerging fields of process-based and principle-guided psychotherapy, and (c) a shift from innovative stand-alone studies to development of a coherent science of therapy components.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Suboptimal quantification of the active elements of cognitive-behavioral therapies has hampered progress in elucidating mechanisms of change.”
From Measuring the active elements of cognitive-behavioral therapies (2023) · cites this paper as Leijten, Weisz, & Gardner, 2021
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006 · cited 1×
“Mental health problems are prevalent, burdensome, and costly (Costello et al., 2003; Patel et al., 2016; Whiteford et al., 2013).”
BackgroundPrevalence and development of psychiatric disorders in childhood and adolescence
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., & Angold, A. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.8.837 · Cited by 4,035
Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 1×
“…2019) can be extended to identify combinations of therapy components that yield the strongest effects, using, for example, network meta-analysis (Caldwell et al., 2005; Pompoli et al., 2018), qualitative comparative analysis (Rihoux & Ragin, 2009; Thongseiratch et al., 2020), or meta-analytic…”
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · cited 2×
“Although this success is notable, numerous clinical scientists have noted that the magnitude of therapy effects is limited, that the mean effects of therapies have not improved measurably across the decades (Wampold et al., 1997; Weisz et al., 2019), that there may be an upper limit to effects that can be achieved wit…”
Background
Research works printed but not linked: 2
- Hayes S. C., 2020, Beyond the DSM: Toward a process-based alternative for diagnosis and mental health treatment
- Weisz J. R., 2020, Principle-guided psychotherapy for children and adolescents: The FIRST program for behavioral and emotional problems
Cited by
van de Wetering, J., Leijten, P., Spitzer, J., & Thomaes, S. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101782 · Cited by 289
Self-citationRognstad, K., Wentzel‐Larsen, T., Neumer, S., & Kjøbli, J. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01236-9 · Cited by 87
Measuring the active elements of cognitive-behavioral therapies
Cohen, Z. D., Barnes-Horowitz, N. M., Forbes, C. N., & Craske, M. G. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104364 · Cited by 58
Ghai, S., Fassi, L., Awadh, F., & Orben, A. (2023) · Clinical Psychological Science · doi:10.1177/21677026221114859 · Cited by 55
Weisz, J. R., Venturo‐Conerly, K. E., Fitzpatrick, O. M., Frederick, J., & Ng, M. Y. (2023) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080921-082920 · Cited by 75
Self-citation
Metadata
- Authors
- Leijten, P., Weisz, J. R., & Gardner, F.
- Affiliations
- University of Amsterdam (NL)
- Harvard University (US)
- University of Oxford (GB)
- Corresponding author
- Leijten, Patty
- Venue
- Clinical Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-03-29
- Volume
- 9
- Issue
- 3
- Pages
- 307-322
- ISSN
- 2167-7026 (ISSN-L)
- 2167-7034
- OpenAlex
- W3141770141
- Cited by
- 55
- References
- 82
- Citations by year
- 2026: 8 · 2025: 6 · 2024: 16 · 2023: 8 · 2022: 12 · 2021: 5
- FWCI
- 6.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Clinical Psychological Science (publishedVersion, cc-by)
- UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- ZonMw (636320007)
- Institute of Education Sciences (R305A140253)
- UBS Optimus Foundation (N.A.)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- active ingredients, factorial design, intervention fidelity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Research Strategies to Discern Active Psychological Therapy Components: A Scoping Review. https://app.cochat.ai/papers/10.1177/2167702620978615
- The paper
- Leijten, P., Weisz, J. R., & Gardner, F. (2021). Research Strategies to Discern Active Psychological Therapy Components: A Scoping Review. Clinical Psychological Science. https://doi.org/10.1177/2167702620978615
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.