Research Strategies to Discern Active Psychological Therapy Components: A Scoping Review
Open accessThe DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Abstract
Some clinical scientists are shifting from research on complete named therapy protocols to a more elemental approach—research on specific therapy components that contribute to therapy goals. To characterize and evaluate this emerging field, we systematically searched PsycINFO and Medline for studies evaluating therapy components. We identified 208 studies. In a scoping review, we map, explain, and critically appraise the seven research strategies employed: (a) expert opinion, (b) shared components, (c) associations between the presence of components and therapy effects, (d) associations between fidelity to components and therapy effects, (e) microtrials, (f) additive and dismantling trials, and (g) factorial experiments. Our examination reveals a need for (a) renewed emphasis on experimental trials (vs. meta-analyses testing associations less rigorously), (b) expanded efforts to locate components within the emerging fields of process-based and principle-guided psychotherapy, and (c) a shift from innovative stand-alone studies to development of a coherent science of therapy components.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Suboptimal quantification of the active elements of cognitive-behavioral therapies has hampered progress in elucidating mechanisms of change.”
From Measuring the active elements of cognitive-behavioral therapies (2023) · cites this paper as Leijten, Weisz, & Gardner, 2021
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006 · cited 1×
“Mental health problems are prevalent, burdensome, and costly (Costello et al., 2003; Patel et al., 2016; Whiteford et al., 2013).”
BackgroundPrevalence and development of psychiatric disorders in childhood and adolescence
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., & Angold, A. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.8.837 · Cited by 4,035
Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 1×
“…2019) can be extended to identify combinations of therapy components that yield the strongest effects, using, for example, network meta-analysis (Caldwell et al., 2005; Pompoli et al., 2018), qualitative comparative analysis (Rihoux & Ragin, 2009; Thongseiratch et al., 2020), or meta-analytic…”
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 1×
“…meta-analyses testing associations between inclusion of components and therapy effects suggest that computer and Internet-based therapies work better when they include the component of support from a therapist than when they do not (Andersson & Cuijpers, 2009; Richards & Richardson, 2012).”
BackgroundWampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · cited 2×
“Although this success is notable, numerous clinical scientists have noted that the magnitude of therapy effects is limited, that the mean effects of therapies have not improved measurably across the decades (Wampold et al., 1997; Weisz et al., 2019), that there may be an upper limit to effects that can be achieved wit…”
BackgroundFoa, E. B., Liebowitz, M. R., Kozak, M. J., Davies, S., Campeas, R., Franklin, M. E., Huppert, J. D., Kjernisted, K., Rowan, V., Schmidt, A. B., et al. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.1.151 · Cited by 1,048
Patel, V., Chisholm, D., Parikh, R., Charlson, F. J., Degenhardt, L., Dua, T., Ferrari, A. J., Hyman, S., Laxminarayan, R., Levin, C., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00390-6 · Cited by 889
The Future of Intervention Science: Process-Based Therapy
Hofmann, S. G., & Hayes, S. C. (2019) · Clinical Psychological Science · doi:10.1177/2167702618772296 · Cited by 888 · cited 4×
“…an upper limit to effects that can be achieved with therapies as currently designed ( Jones et al., 2019), and that improvement could be achieved by identifying and targeting the core processes underlying mental health problems (Hayes & Hofmann, 2020; Hofmann & Hayes, 2019; Holmes et al., 2014).”
BackgroundInfluentialWeisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., Jensen-Doss, A., Hawley, K. M., Krumholz Marchette, L. S., Chu, B. C., et al. (2017) · American Psychologist · doi:10.1037/a0040360 · Cited by 862
Self-citationDelphi: a technique to harness expert opinion for critical decision‐making tasks in education
Clayton, M. J. (1997) · Educational Psychology · doi:10.1080/0144341970170401 · Cited by 840
Resick, P. A., Galovski, T. E., Uhlmansiek, M. O., Scher, C. D., Clum, G. A., & Young-Xu, Y. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.2.243 · Cited by 825
Foa, E. B., Dancu, C. V., Hembree, E. A., Jaycox, L. H., Meadows, E. A., & Street, G. P. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.2.194 · Cited by 808
The Role of Common Factors in Psychotherapy Outcomes
Cuijpers, P., Reijnders, M., & Huibers, M. J. H. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095424 · Cited by 748
Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005) · Mental Health Services Research · doi:10.1007/s11020-005-1962-6 · Cited by 717
Self-citationChorpita, B. F., & Daleiden, E. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014565 · Cited by 687 · cited 1×
“…the distillation and matching model (Chorpita et al., 2005) to evidence-based treatment protocols for youth mental health to identify their shared components (Chorpita & Daleiden, 2009) Associations between component presence and therapy effects Testing whether therapy effects are larger in…”
MethodInternet-based interventions for smoking cessation
Taylor, G. M. J., Dalili, M. N., Semwal, M., Civljak, M., Sheikh, A., & Car, J. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007078.pub5 · Cited by 649
Ahn, H.-N., & Wampold, B. E. (2001) · Journal of Counseling Psychology · doi:10.1037/0022-0167.48.3.251 · Cited by 571
Where are the commonalities among the therapeutic common factors?
Grencavage, L. M., & Norcross, J. C. (1990) · Professional Psychology: Research and Practice · doi:10.1037//0735-7028.21.5.372 · Cited by 529
Psychological treatment of generalized anxiety disorder: A meta-analysis
Cuijpers, P., Sijbrandij, M., Koole, S., Huibers, M., Berking, M., & Andersson, G. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.01.002 · Cited by 527
Levin, M. E., Hildebrandt, M. J., Lillis, J., & Hayes, S. C. (2012) · Behavior Therapy · doi:10.1016/j.beth.2012.05.003 · Cited by 471
Toward the delineation of therapeutic change principles.
Goldfried, M. R. (1980) · American Psychologist · doi:10.1037/0003-066x.35.11.991 · Cited by 451
Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0034332 · Cited by 443 · cited 1×
“, 2017), and even prominent advocates of the common factors view have argued for the value of research testing the impact of therapy components (Laska et al., 2014).”
BackgroundMurray, L. K., Dorsey, S., Haroz, E., Lee, C., Alsiary, M. M., Haydary, A., Weiss, W. M., & Bolton, P. (2014) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2013.06.005 · Cited by 403
Evidence-based Kernels: Fundamental Units of Behavioral Influence
Embry, D. D., & Biglan, A. (2008) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-008-0036-x · Cited by 396 · cited 1×
“Embry and Biglan (2008) used the term kernels to refer to single therapeutic techniques that have their own meaningful function and cannot be further disentangled without losing their function.”
BackgroundKazdin, A. E., & Whitley, M. K. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.3.504 · Cited by 378
Michie, S., West, R., Sheals, K., & Godinho, C. A. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/ibx019 · Cited by 377
Evidence-Based Psychotherapies for Children and Adolescents
Cho, S.-M. (2018) · Korean Journal of Clinical Psychology · doi:10.15842/kjcp.2018.37.4.010 · Cited by 352
COMMON FACTORS AND OUR SACRED MODELS
Sprenkle, D. H., & Blow, A. J. (2004) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2004.tb01228.x · Cited by 340
Collins, L. M., Dziak, J. J., Kugler, K. C., & Trail, J. B. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.021 · Cited by 335
Functional analysis in behavior therapy
Haynes, S. N., & O'Brien, W. H. (1990) · Clinical Psychology Review · doi:10.1016/0272-7358(90)90074-k · Cited by 327
Meta-Analyses: Key Parenting Program Components for Disruptive Child Behavior
Leijten, P., Gardner, F., Melendez-Torres, G. J., van Aar, J., Hutchings, J., Schulz, S., Knerr, W., & Overbeek, G. (2019) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.07.900 · Cited by 315
Self-citationRosen, G. M., & Davison, G. C. (2003) · Behavior Modification · doi:10.1177/0145445503027003003 · Cited by 305
Causal Inference, Path Analysis, and Recursive Structural Equations Models
Holland, P. W. (1988) · Sociological Methodology · doi:10.2307/271055 · Cited by 297
Those confounded moderators in meta-analysis: good, bad, and ugly
Lipsey, M. W. (2003) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716202250791 · Cited by 283 · cited 2×
“…of these methods, especially when adopting a single-variable approach, include the third variable problem: Implementation of components is not protected by randomization, and components often cluster within trials, leading to confounded associations (Lipsey, 2003; Petticrew et al., 2012).”
MethodLet's face facts: Common factors are more potent than specific therapy ingredients.
Messer, S. B., & Wampold, B. E. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.1.21 · Cited by 271
Web-Based Smoking-Cessation Programs
Strecher, V. J., McClure, J. B., Alexander, G. L., Chakraborty, B., Nair, V. N., Konkel, J. M., Greene, S. M., Collins, L. M., Carlier, C. C., Wiese, C. J., et al. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.12.024 · Cited by 266
Psychosocial family intervention in schizophrenia: a review of empirical studies
Lam, D. H. (1991) · Psychological Medicine · doi:10.1017/s0033291700020535 · Cited by 249
Pompoli, A., Furukawa, T. A., Efthimiou, O., Imai, H., Tajika, A., & Salanti, G. (2018) · Psychological Medicine · doi:10.1017/s0033291717003919 · Cited by 249
Cognitive remediation for schizophrenia: An expert working group white paper on core techniques
Bowie, C. R., Bell, M. D., Fiszdon, J. M., Johannesen, J. K., Lindenmayer, J.-P., McGurk, S. R., Medalia, A. A., Penadés, R., Saperstein, A. M., Twamley, E. W., et al. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2019.10.047 · Cited by 247
Cuijpers, P. (2017) · Canadian Psychology / Psychologie canadienne · doi:10.1037/cap0000096 · Cited by 231
Behavioral treatment of generalized anxiety disorder
Barlow, D. H., Rapee, R. M., & Brown, T. A. (1992) · Behavior Therapy · doi:10.1016/s0005-7894(05)80221-7 · Cited by 221
Empirically Supported Treatment: Recommendations for a New Model
Tolin, D. F., McKay, D., Forman, E. M., Klonsky, E. D., & Thombs, B. D. (2015) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12122 · Cited by 219
Psychological treatments: A call for mental-health science
Holmes, E. A., Craske, M. G., & Graybiel, A. M. (2014) · Nature · doi:10.1038/511287a · Cited by 214
What Are the Components of CBT for Psychosis? A Delphi Study
Morrison, A. P., & Barratt, S. (2010) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp118 · Cited by 212
Abuse of the drug metaphor in psychotherapy process-outcome research
Stiles, W. B., & Shapiro, D. A. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90007-x · Cited by 202
Marcks, B. A., & Woods, D. W. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.03.005 · Cited by 198 · cited 1×
“…effect of implementing a single therapy component – Assigning individuals to thought suppression or thought acceptance (vs. control) for intrusive thoughts (Marcks & Woods, 2005) – Assigning children with disruptive behavior to receive praise (vs. no praise) for compliant behavior (Leijten et al.,…”
BackgroundCommon versus specific factors in psychotherapy: opening the black box
Mulder, R., Murray, G., & Rucklidge, J. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30100-1 · Cited by 198 · cited 1×
“Yet numerous clinical psychological scientists argue that understanding of therapy effects can only be advanced if this issue is addressed (Holmes et al., 2014; Mulder et al., 2017), and even prominent advocates of the common factors view have argued for the value of research testing the impact of therapy components (…”
BackgroundAre the parts as good as the whole? A meta-analysis of component treatment studies.
Bell, E. C., Marcus, D. K., & Goodlad, J. K. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033004 · Cited by 192 · cited 1×
“Meta-analyses of additive and dismantling studies show that target components rarely add significant levels of effectiveness to therapy protocols (Ahn & Wampold, 2001; Bell et al., 2013; Cuijpers et al., 2019).”
BackgroundTrajectories of change in youth anxiety during cognitive—behavior therapy.
Peris, T. S., Compton, S. N., Kendall, P. C., Birmaher, B., Sherrill, J., March, J., Gosch, E., Ginsburg, G., Rynn, M., McCracken, J. T., et al. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0038402 · Cited by 191
Meerwijk, E. L., Parekh, A., Oquendo, M. A., Allen, I. E., Franck, L. S., & Lee, K. A. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)00064-x · Cited by 181
Weisz, J. R., Kuppens, S., Ng, M. Y., Vaughn-Coaxum, R. A., Ugueto, A. M., Eckshtain, D., & Corteselli, K. A. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691618805436 · Cited by 180
Self-citationOnline parent programs for children’s behavioral problems: a meta-analytic review
Thongseiratch, T., Leijten, P. H. O., & Meléndez‐Torres, G. J. (2020) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-020-01472-0 · Cited by 165
Self-citationAnderson, T., McClintock, A. S., Himawan, L., Song, X., & Patterson, C. L. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000060 · Cited by 161
Castonguay, L. G., & Beutler, L. E. (2006) · Journal of Clinical Psychology · doi:10.1002/jclp.20256 · Cited by 154
Damned if you do, damned if you don't: subgroup analysis and equity
Petticrew, M., Tugwell, P., Kristjansson, E., Oliver, S., Ueffing, E., & Welch, V. (2012) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2010.121095 · Cited by 150
Lord, S. P., Sheng, E., Imel, Z. E., Baer, J., & Atkins, D. C. (2015) · Behavior Therapy · doi:10.1016/j.beth.2014.11.002 · Cited by 144
Essential components of cognitive-behavior therapy for depression.
Persons, J. B., Davidson, J., & Tompkins, M. A. (2001) · American Psychological Association eBooks · doi:10.1037/10389-000 · Cited by 131
Weisz, J., Bearman, S. K., Santucci, L. C., & Jensen-Doss, A. (2017) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1163708 · Cited by 128
Self-citationMicrotrial Methods for Translating Gene-environment Dynamics into Preventive Interventions
Howe, G. W., Beach, S. R. H., & Brody, G. H. (2010) · Prevention Science · doi:10.1007/s11121-010-0177-2 · Cited by 109
Feske, U., & Goldstein, A. J. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.65.6.1026 · Cited by 105
Fidelity to the Cognitive Processing Therapy Protocol: Evaluation of Critical Elements
Farmer, C. C., Mitchell, K. S., Parker-Guilbert, K. S., & Galovski, T. E. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.02.009 · Cited by 100
Leijten, P., Dishion, T. J., Thomaes, S., Raaijmakers, M. A. J., Orobio de Castro, B., & Matthys, W. (2015) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12087 · Cited by 89
Self-citationKlepac, R. K., Ronan, G. F., Andrasik, F., Arnold, K. D., Belar, C. D., Berry, S. L., Christofff, K. A., Craighead, L. W., Dougher, M. J., Dowd, E. T., et al. (2012) · Behavior Therapy · doi:10.1016/j.beth.2012.05.002 · Cited by 87
Impact of Robustness of Program Implementation on Outcomes of Clients in Dual Diagnosis Programs
Jerrell, J. M., & Ridgely, M. S. (1999) · Psychiatric Services · doi:10.1176/ps.50.1.109 · Cited by 85
Parenting behaviors that shape child compliance: A multilevel meta-analysis
Leijten, P. H. O., Gardner, F. E. M., Meléndez‐Torres, G. J., Knerr, W., & Overbeek, G. J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0204929 · Cited by 68
Self-citationYovel, I., Mor, N., & Shakarov, H. (2014) · Behavior Therapy · doi:10.1016/j.beth.2014.02.007 · Cited by 60
Lachman, J. M., Heinrichs, N., Jansen, E., Brühl, A., Tăut, D., Fang, X., Gardner, F. E. M., Hutchings, J., Ward, C. L., Williams, M. E., et al. (2019) · Contemporary Clinical Trials · doi:10.1016/j.cct.2019.105855 · Cited by 50
Self-citationBuilding Robust Psychotherapies for Children and Adolescents
Weisz, J. R. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613512658 · Cited by 43
Self-citationFACTORS THAT CONSTITUTE A GOOD COGNITIVE BEHAVIOURAL TREATMENT MANUAL: A DELPHI STUDY
Duncan, E., Nicol, M. M., & Ager, A. (2004) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246580400116x · Cited by 43
Better versus worse family therapy sessions as reflected in clients’ alliance-related behavior.
Friedlander, M. L., Bernardi, S., & Lee, H. (2010) · Journal of Counseling Psychology · doi:10.1037/a0019088 · Cited by 38
Oddli, H. W., Nissen‐Lie, H. A., & Halvorsen, M. S. (2016) · Journal of Psychotherapy Integration · doi:10.1037/int0000033 · Cited by 38
Leijten, P. H. O., Thomaes, S. C. E., de Castro, B. O., Dishion, T. J., & Matthys, W. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.09.008 · Cited by 38
Self-citationJones, P. J., Mair, P., Kuppens, S., & Weisz, J. R. (2019) · Clinical Psychological Science · doi:10.1177/2167702619858424 · Cited by 31
Self-citationA Second and Third Look at FIRST: Testing Adaptations of A Principle-Guided Youth Psychotherapy
Cho, E., Bearman, S. K., Woo, R., Weisz, J. R., & Hawley, K. M. (2020) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2020.1796678 · Cited by 24
Self-citationDavison, G. C. (2018) · Clinical Psychological Science · doi:10.1177/2167702618794924 · Cited by 23
Verbal repetition in the reappraisal of contamination-related thoughts
Watson, C., Burley, M. C., & Purdon, C. (2010) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465810000196 · Cited by 16 · cited 1×
“For example, if cognitive defusion is identified as a key therapeutic process to reduce depressive symptoms in some clients, the research strategies discussed in this review can be used to evaluate the most promising components for cognitive defusion (e.g., Levin et al., 2012; Watson et al., 2010; Yovel et al., 2014).”
Method
Research works printed but not linked: 2
- Hayes S. C., 2020, Beyond the DSM: Toward a process-based alternative for diagnosis and mental health treatment
- Weisz J. R., 2020, Principle-guided psychotherapy for children and adolescents: The FIRST program for behavioral and emotional problems
Cited by
van de Wetering, J., Leijten, P., Spitzer, J., & Thomaes, S. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101782 · Cited by 289
Self-citationRognstad, K., Wentzel‐Larsen, T., Neumer, S., & Kjøbli, J. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01236-9 · Cited by 87
Measuring the active elements of cognitive-behavioral therapies
Cohen, Z. D., Barnes-Horowitz, N. M., Forbes, C. N., & Craske, M. G. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104364 · Cited by 58
Ghai, S., Fassi, L., Awadh, F., & Orben, A. (2023) · Clinical Psychological Science · doi:10.1177/21677026221114859 · Cited by 55
Weisz, J. R., Venturo‐Conerly, K. E., Fitzpatrick, O. M., Frederick, J., & Ng, M. Y. (2023) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080921-082920 · Cited by 77
Self-citation
Metadata
- Authors
- Leijten, P., Weisz, J. R., & Gardner, F.
- Affiliations
- University of Amsterdam (NL)
- Harvard University (US)
- University of Oxford (GB)
- Corresponding author
- Leijten, Patty
- Venue
- Clinical Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-03-29
- Volume
- 9
- Issue
- 3
- Pages
- 307-322
- ISSN
- 2167-7026 (ISSN-L)
- 2167-7034
- OpenAlex
- W3141770141
- Cited by
- 55
- References
- 82
- Citations by year
- 2026: 8 · 2025: 6 · 2024: 16 · 2023: 8 · 2022: 12 · 2021: 5
- FWCI
- 6.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Clinical Psychological Science (publishedVersion, cc-by)
- UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- ZonMw (636320007)
- Institute of Education Sciences (R305A140253)
- UBS Optimus Foundation (N.A.)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- active ingredients, factorial design, intervention fidelity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.