Are the parts as good as the whole? A meta-analysis of component treatment studies.
The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Component studies compare standard treatments to treatments with added components or dismantled components. A previous meta-analysis (Ahn & Wampold, 2001) failed to find any differences in outcome between treatments with more components and those with fewer components, leading the authors to conclude that common factors and not specific ingredients account for therapeutic change. METHOD: The current random effects model meta-analysis of psychotherapy component studies conducted between 1980 and 2010 included more than 3 times as many studies as Ahn and Wampold's (2001) meta-analysis (k = 66). Unlike the previous meta-analysis, this study conducted separate meta-analyses for additive and dismantling studies and also examined treatment outcomes at follow-up. RESULTS: For the dismantling studies, there were no significant differences between the full treatments and the dismantled treatments. For the additive studies, the treatment with the added component yielded a small, but significant, effect at completion (d = 0.14) and a slightly larger effect at follow-up (d = 0.28), but only for the specific problems that were targeted for treatment. Despite the diversity of populations studied, problems treated, and treatments examined, there was little heterogeneity among the results of these studies. CONCLUSION: These findings suggest that added specific ingredients may contribute modestly to treatment outcomes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Meta-analyses of between-group treatment effects, including additive and dismantling studies, are unlikely to yield actionable insights for EBPI implementers (e.g., Ahn & Wampold, 2001; Bell et al., 2013) due to mismatched levels of analysis that obscure potentially important treatment by context interactions (for an illustrative exception, see Weisz, Weiss, Alicke, & Klotz, 1987).”
From Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes (2016) · cites this paper as Bell et al., 2013
In the citing paper
“However, a small but significant effect was found when a component was added to a therapy, and this effect was larger at follow-up.”
From The Role of Common Factors in Psychotherapy Outcomes (2019) · cites this paper as Bell et al. 2013
In the citing paper
“Two meta-analyses have examined dismantling designs and both found minimal differences between the total treatment and the treatment without one or more critical ingredients (d50.01,n530, see Figure 1) (53,54).”
From How important are the common factors in psychotherapy? An update (2015) · cites this paper as [53]
In the citing paper
“The most recent of these meta-analyses did find that adding an ingre-dient to an existing treatment increased the effect for targeted variables by a small amount (d50.28)(53).”
From How important are the common factors in psychotherapy? An update (2015) · cites this paper as [53]
In the citing paper
“A second major review examined a much larger set of component studies (n = 66; Bell et al. 2013) and found that the use of dismantling studies did not result in significant differences between the full and the partial treatment (in which one component was left out; Cuijpers et al. 2019a).”
From The Role of Common Factors in Psychotherapy Outcomes (2019) · cites this paper as Bell et al. 2013
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · cited 1×
“I2 values of 25% or less are considered low levels of heterogeneity (Higgins et al., 2003).”
BackgroundBias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
(2000) · Cited by 9,198
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955 · cited 1×
“…with the effect sizes plotted along the x-axis and the corresponding standard errors on the y-axis (largest values at the bottom), examined the funnel plot asymmetry using a regression test (Egger, Smith, Schneider, & Minder, 1997), and conducted trim and fill analyses (Duval & Tweedie, 2000).”
MethodInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884 · cited 2×
“Consequently, the average d value in a random effects model is “the average effect rather than the common effect” (Riley et al., 2011, p. 965).”
BackgroundResultA Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
Luborsky, L. (1975) · Archives of General Psychiatry · doi:10.1001/archpsyc.1975.01760260059004 · Cited by 1,485
A component analysis of cognitive-behavioral treatment for depression.
Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J. K., Gortner, E., & Prince, S. E. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.2.295 · Cited by 1,413 · cited 3×
“Even Kazdin and Whitley’s (2003) higher estimate of an effect size of .45 for additive design studies would require 78 patients in each condition. In contrast, the average sample size for the studies included in the present meta-analysis was 23 participants in each condition, which would require a large effect size of…”
BackgroundInfluential
Cited by
Items 101–193 of 193
Steubl, L., Sachser, C., Baumeister, H., & Domhardt, M. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1190-6 · Cited by 12
“, additive studies) offer the possibility to examine active intervention components and assess their incremental (add on) effect sizes [39].”
BackgroundSarama, J. H., Clements, D. H., Baroody, A. J., Kutaka, T. S., Chernyavskiy, P., Shi, J., & Cong, M. (2021) · AERA Open · doi:10.1177/23328584211026657 · Cited by 17
Georgiadis, C., Bose, D., Wolenski, R. A., Javadi, N., Coxe, S. J., Pettit, J. W., & Comer, J. S. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2109649 · Cited by 12
“…protocols within efficacy trials (e.g., Eslinger et al., 2020), and the lack of definitive evidence regarding the removal of therapeutic components (Bell et al., 2013), we hypothesized that modification strategies calling for the omission of treatment elements would be included least frequently.”
BackgroundInfluentialStige, S. H., & Binder, P. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1138335 · Cited by 12
Ashmore, J. A., Ditterich, K. W., Conley, C. C., Wright, M. R., Howland, P. S., Huggins, K. L., Cooreman, J., Andrews, P. S., Nicholas, D. R., Roberts, L., et al. (2018) · American Psychologist · doi:10.1037/amp0000309 · Cited by 12
Zhao, Z., Zhao, C., Ren, Z., Shi, C., & Lai, L. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100585 · Cited by 11
“That is, we will be able to address the question of whether one part of the ACT intervention is as effective as the whole ACT intervention (Bell et al., 2013).”
BackgroundSusman, E. S., Patino, E. O., Tiab, S. S., Dong, L., Gumport, N. B., Sarfan, L. D., Hinshaw, S. P., & Harvey, A. G. (2024) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2024.05.001 · Cited by 12
“…taper off at longer-term follow-up) (eg, 5 ); a logarithmic effect, where gains are achieved after intervention and maintained at follow-up (eg, 6 ); null effects after intervention with positive outcomes only at follow-up (eg, 7 ); or null effects both after intervention and at follow-up (eg, 3 ).”
Lundh, L., Petersson, T., & Wolgast, M. (2016) · BMC Psychology · doi:10.1186/s40359-016-0151-2 · Cited by 12
“Meta-analyses of such component designs indicate that, although there is so far no evidence that dismantling designs can provide increased knowledge about active treatment components, additive designs do show at least some small effect of adding new components to a treatment [12].”
BackgroundMander, J., Kröger, P., Blanck, P., Call, M., Bents, H., & Heidenreich, T. (2017) · Verhaltenstherapie · doi:10.1159/000455163 · Cited by 11
“Tatsächlich existieren zu Komponentenstudien bisher nur 2 Meta-Analysen, die insgesamt 67 Primärstudien zusammenfassen [Ahn und Wampold, 2001; Bell et al., 2013].”
BackgroundMira, A., Díaz-García, A., Castilla, D., Campos, D., Romero, S., Bretón-López, J., García-Palacios, A., Baños, R., & Botella, C. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2099-2 · Cited by 9
Bennett, C. B., Toevs, E. K., Angus, A., Krawczak, R. A., Trentacosta, C. J., Jagadeesh, D., Tomlinson, C. S., & Lindhiem, O. J. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102644 · Cited by 12
The Core Curricular Content of School-Based Mindfulness Programs
Schussler, D. L., Fosco, S. L. D., & Kohler, K. M. (2023) · School Mental Health · doi:10.1007/s12310-023-09623-9 · Cited by 9
“…(2020) conducted a review specifically of “component studies” of MBSR and MBCT. Unlike a traditional RCT with a treat-ment and control, component studies attempt to identify which components of a program drive intervention effects by using an additive or dismantling approach (Bell et al., 2013).”
Hoyer, J. (2016) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000370 · Cited by 9
Integrating psychotherapy with the Hierarchical Taxonomy of Psychopathology (HiTOP)Preprint
Hopwood, C. J., Bagby, M. R., Gralnick, T. M., Ro, E., Ruggero, C. J., Mullins‐Sweatt, S. N., Kotov, R., Bach, B. S., Cicero, D. C., Krueger, R. F., et al. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jb8z4 · Cited by 10
Cochran, G., Shen, J., Cox, N., Field, C. A., Carlston, K., Sengpraseut, B., White, A., Okifuji, A., Jackman, C., Haaland, B. A., et al. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.106759 · Cited by 8
Lauritzen, L. R., Jacobsen, C. F., Nielsen, J., Lunn, S., Mathiesen, B. B., Falkenström, F., & Poulsen, S. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-072277 · Cited by 9
Locher, C., Hasler, S., & Gaab, J. (2016) · Verhaltenstherapie · doi:10.1159/000443464 · Cited by 10
“So wie auch von der vorliegenden Analyse ausgeschlossene Studiendesigns, z.B. Komponentenstudien, mit methodischen Problemen einhergehen [Bell et al., 2013; Kazdin und Whitley, 2003], birgt auch die randomisierte Placebo-kontrollierte Studie – als Goldstandard der klinischen Forschung – ihre…”
BackgroundComponents Analyses of a School-Based Cognitive Behavioral Treatment for Youth Depression
Arora, P. G., Baker, C. N., Marchette, L. K., & Stark, K. D. (2017) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2017.1280800 · Cited by 16
“This finding is consistent with some literature that has underscored the role of specific ingredients of therapy (Bell et al., 2013) though inconsistent with findings that have highlighted the role of relational factors (Ahn & Wampold, 2001; Karver et al., 2006; Shirk & Karver, 2003).”
BackgroundResultde Wit, M., Leijten, P. H. O., van der Put, C. E., Asscher, J. J., Bouwmeester-Landweer, M. B. R., & Deković, M. (2020) · BMC Public Health · doi:10.1186/s12889-020-8237-4 · Cited by 9
Mertens, E. C. A., Deković, M., van Londen, M., Spitzer, J. E., & Reitz, E. (2022) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-022-00406-3 · Cited by 10
“For instance, a component unrelated to short-term effects may be related to longterm effects, thus representing a ‘sleeper effect’ in which intervention effects emerge or increase over time after the conclusion of the intervention (Bell et al., 2013; Van Aar et al., 2017).”
BackgroundInfluentialThe Promise and Challenge (and Reality) of Defining Therapist Expertise
Reese, R. J. (2017) · The Counseling Psychologist · doi:10.1177/0011000016657161 · Cited by 9
Scott, J. L., Vedaa, Ø., Sivertsen, B., Langsrud, K., & Kallestad, H. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.01.054 · Cited by 10
Smith, D. C., Ureche, D. J., Davis, J. P., & Walters, S. T. (2015) · Substance Abuse · doi:10.1080/08897077.2014.988838 · Cited by 12
“Studies using this methodology, called dismantling designs, are very rare with adolescents.(18) It is imperative that more dismantling studies are conducted with adolescents with SUDs in order to identify which intervention components are inert and which drive change.”
MethodThe Psychotherapy Outcome Problem: The Development of the Outcome Stability Index
Owen, J. J., Drinane, J. M., Adelson, J. L., & Kopta, S. M. (2017) · Psychotherapy Research · doi:10.1080/10503307.2017.1349352 · Cited by 8
Rumination following bereavement : Assessment, working mechanisms and intervention
Eisma, M. C. (2015) · Utrecht University Repository (Utrecht University) · Cited by 7
Finsrud, I., Nissen‐Lie, H. A., Ulvenes, P., Vrabel, K. R., Melsom, L., & Wampold, B. E. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000853 · Cited by 6
In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy
Wampold, B. E., Flückiger, C., Re, A. C. D., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., Laska, K. M., et al. (2019) · PERSON · doi:10.24989/person.v23i1.2428 · Cited by 6
Holtrop, K., Durtschi, J. A., & Forgatch, M. S. (2021) · Journal of Family Psychology · doi:10.1037/fam0000925 · Cited by 6
Compatibility of Components in Cognitive Behavioral Therapies: A Call for Combinatory Congruency
O’Toole, M. S., Mikkelsen, M. B., Arch, J. J., Tauber, N. M., Elkjær, E., & Michalak, J. (2024) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2023.12.006 · Cited by 6
D’Errico, L., Call, M., Blanck, P., Vonderlin, E., Bents, H., & Mander, J. (2019) · Counselling and Psychotherapy Research · doi:10.1002/capr.12233 · Cited by 5
National attitudes towards mental health treatment: the importance of research evidence
Kirk, A., Broman‐Fulks, J. J., & Bergquist, J. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1201847 · Cited by 8
Ryum, T., Hartmann, H., Borchgrevink, P. C., Ridder, K. D., & Stiles, T. C. (2020) · European Journal of Pain · doi:10.1002/ejp.1659 · Cited by 7
“Moreover, as noted by several authors (Bell et al., 2013; Cuijpers et al., 2019; Kazdin & Whitley, 2003), this study may have been underpowered to detect the relatively small effect-sizes that are perhaps most likely to be achieved in a component study.”
BackgroundAwareness, affect, and craving during smoking cessation: An experience sampling study.
Sala, M., Roos, C. R., Brewer, J. A., & Garrison, K. A. (2021) · Health Psychology · doi:10.1037/hea0001105 · Cited by 5
The impact of integrating physical health into a brief CBT approach for medically ill veterans
Brandt, C. P., Deavers, F., Hundt, N. E., Fletcher, T. L., & Cully, J. A. (2020) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-019-09634-2 · Cited by 4
Imai, H., Yamada, M., Inagaki, M., Watanabe, N., Chino, B., Mantani, A., & Furukawa, T. A. (2020) · Innovations in clinical neuroscience · Cited by 5
Emotion-Based Interventions for Clinicians
Stevens, F. L. (2022) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-022-09546-7 · Cited by 6
“The efficacies of these traditional interventions as agents of change have been called into question (Ahn & Wampold, 2001; Bell et al., 2013; Wampold, 2015).”
BackgroundSwartz, H. A. (2015) · Depression and Anxiety · doi:10.1002/da.22426 · Cited by 4
“” Meta-analyses of dismantling trials (studies wherein investigators compare a treatment to the treatment minus an integral component) have not found effect sizes that differ significantly from zero[3, 4] and effect sizes for additive studies (comparing a treatment to the treatment plus an element) are so small (d = .”
BackgroundRyynänen, T., Alén, M., Koivumaa-Honkanen, H. T., Joskitt, L., & Ebeling, H. E. (2014) · Nordic Journal of Psychiatry · doi:10.3109/08039488.2014.954268 · Cited by 6
Niveau, N., Beaudoin, M., & New, B. (2022) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2021.40.6.79 · Cited by 4
Smith, E. H., Free, B. L., Ginley, M. K., Whelan, J., & Pfund, R. A. (2025) · Journal of Gambling Studies · doi:10.1007/s10899-025-10444-5 · Cited by 5
“…harm at 13–25 weeks after receipt of the PFI ( g = −0.12, 95% CI [−0.21, −0.03]) and at 26 + weeks ( g = −0.13, 95% CI [−0.31, 0.05]), suggesting that there may be a “sleeper effect” (Bell et al., 2013) where the magnitude of reductions in outcomes increases over time following receipt of PFIs.”
InfluentialPSYKOTERAPIFORSKNING GENNEM 100 ÅR – HVOR LANGT ER VI NÅET?
Hougaard, E. (2021) · Psyke & Logos · doi:10.7146/pl.v42i1.128765 · Cited by 3
Long, L. R., Foster, M. R., Burr, K. E., Penberthy, J. K., Baker, T. N., & McCullough, J. P. (2024) · Cognitive Therapy and Research · doi:10.1007/s10608-024-10467-z · Cited by 3
Mander, J., Kröger, P., & Blanck, P. (2017) · PiD - Psychotherapie im Dialog · doi:10.1055/s-0043-118089 · Cited by 3
Clément, C. C., Lin, J., & Stangier, U. (2019) · Trials · doi:10.1186/s13063-019-3905-3 · Cited by 3
“[43] confirmed that the effects in dismantling studies were very small and nonsignificant.”
BackgroundEmotion-focused skills training for parents – a narrative review
Ansar, N. (2024) · Person-Centered & Experiential Psychotherapies · doi:10.1080/14779757.2024.2327993 · Cited by 5
“If the dismantled component is an active ingredient, the condition with fewer components should yield less successful outcomes (Ansar, 2022; Bell et al., 2013).”
Depresión y adherencia a la medicación antirretroviral: efectos de una intervención conductual breve
Valle-Soto, H., Montijo, S. R., Wiebe, J. S., & Sosa, J. J. S. (2018) · Psicología y Salud · doi:10.25009/pys.v29i1.2575 · Cited by 6
Petersen, R., Petermann, U., Petermann, F., Diener, C., & Nitkowski, D. (2019) · Zeitschrift für Psychiatrie, Psychologie und Psychotherapie · doi:10.1024/1661-4747/a000395 · Cited by 3
Steele, S. J., Baskin-sommers, A. R., Hearon, B. A., Gironde, S., & Björgvinsson, Þ. (2015) · Cognitive Therapy and Research · doi:10.1007/s10608-015-9726-0 · Cited by 3
Serbetci, D., Koh, Z. H., Murray, G., & Tremain, H. (2024) · Bipolar Disorders · doi:10.1111/bdi.13464 · Cited by 2
“9,10 An important first step towards determining mechanisms of action is to identify mediators, ‘intervening variables that may account (statistically) for the relationship between the independent and dependent variable’.”
Idrees, A. R., Kraft, R., Küchler, A., Bantleon, L., Baumeister, H., Reichert, M., Kählke, F., Ebert, D. D., & Pryss, R. C. (2025) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-025-00216-6 · Cited by 2
“Such designs can also be used to investigate the efficacy of PD features [14].”
Distinguishing the theoretical components of positive body image via expert consensus
Nair, K., Murray, K., Fardouly, J., & Farrer, L. M. (2026) · Body Image · doi:10.1016/j.bodyim.2026.102072 · Cited by 2
Ebner, K. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101108 · Cited by 2
Choice, voice and collaboration: using preference accommodation and feedback in trauma therapy
Mahon, D. (2021) · Mental Health and Social Inclusion · doi:10.1108/mhsi-06-2021-0032 · Cited by 3
COPS in Action: Exploring Structure in the Usage of the Youth Psychotherapy MATCH
Rusch, T. W., Venturo‐Conerly, K. E., Baja, G., & Mair, P. (2023) · Psych · doi:10.3390/psych5020020 · Cited by 2
Romero, S., Mira, A., Bretón-López, J. M., Díaz‐García, A., Díaz-Sanahuja, L., García‐Palacios, A., & Botella, C. (2019) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-25872-6_10 · Cited by 2
Tay, A. K., & Carlsson, J. M. (2022) · BJPsych Open · doi:10.1192/bjo.2022.73 · Cited by 1
Zuber, J., & Gnambs, T. (2026) · The Arts in Psychotherapy · doi:10.1016/j.aip.2026.102482 · Cited by 1
Damm, J. (2025) · Current Psychology · doi:10.1007/s12144-025-08842-4 · Cited by 1
“Furthermore, dismantling studies—where certain “essential” elements are removed from treatment— show no significant difference in effectiveness compared to full treatments (Ahn & Wampold, 2001 ; Bell et al., 2013 ).”
Wang, S., Ren, J., Fang, S., Hao, Q., Zhang, Y., Kong, L., & Fang, M. (2026) · Brain and Behavior · doi:10.1002/brb3.71513 · Cited by 1
“Traditional methods for examining treatment components often rely on dismantling studies, where a complete treatment package is compared to one that excludes a specific component (Bell et al. 2013 ).”
Personalized prediction of response to three meditation practices: A randomized controlled trial
Simonsson, O., Webb, C. A., Ruiz, M., Osika, W., Narayanan, J., Dahlén, M., Lutz, W., Schwartz, B., Ren, B., Dahl, C. J., et al. (2026) · Behaviour Research and Therapy · doi:10.1016/j.brat.2026.105141 · Cited by 1
Adding components improves treatment outcomes: Reply to Flückiger et al. (2015).
Marcus, D. K., Bell, E. C., & Mercer, S. H. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000012 · Cited by 2
Self-citationProviding Choice and Preferences to Service Users Accessing Trauma Treatment: A Multicultural Lens
Mahon, D. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80382-429-120221008 · Cited by 1
Østergård, O. K., Nielsen, J., Hjorthøj, C., Nilsson, K. K., & Poulsen, S. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-062506 · Cited by 1
Systemische Familienrekonstruktion im psychosomatischen Behandlungskontext
Bay, T., Hartmann, A., Wirsching, M., Klein, J., Riehl, J., Pletschen, N., & Joos, A. A. B. (2015) · Psychotherapeut · doi:10.1007/s00278-015-0025-8 · Cited by 1
The Constructivist Integrative Model: A New Proposal
Moggia, D. (2017) · Revista de Psicoterapia · doi:10.33898/rdp.v28i108.205 · Cited by 4
A Critique of Theoretical Models of Depression: Commonalties and Distinctive Features
Keefe, J. R., & DeRubeis, R. J. (2015) · Wiley eBooks · doi:10.1002/9781119114482.ch10 · Cited by 1
Cognitive-behavioral or psychodynamic therapy for people with bulimia nervosa
Dakanalis, A., Riva, G., Gaudio, S., & Clerici, M. (2017) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-017-0412-y · Cited by 1
“Given also the meta-analytic evidence that interventions across psychotherapies have specific benefits in the particular features that are targeted [17], Stefini et al.”
BackgroundChoice of Psychotherapy Approach
Marouf, F. (2020) · Psychotherapy in Later Life · doi:10.1017/9781108693905.005
Scientific Research into Psychotherapy
Sousa, D. (2017) · Palgrave Macmillan US eBooks · doi:10.1057/978-1-349-95217-5_1
Deavers, F. E. (2017) · STARS (University of Central Florida)
Contextual factors in treatment : a meta-analytic and an experimental approach
Birkhäuer, J. (2017) · edoc (University of Basel) · doi:10.5451/unibas-006765849
Crosby, H. (2018) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Jørgensen, C. R. (2019) · Springer eBooks · doi:10.1007/978-3-030-20437-2_4
”Leder! Er du relationskompetent?”
Hansen, K. L., Nielsen, S. B., & Fosgerau, C. F. (2021) · Samfundslederskab i Skandinavien · doi:10.22439/sis.v36i3.6278
Mayer, A., Szűcs, L., & Török, J. (1978) · PubMed · Cited by 2
Nurturing Therapeutic Mastery in Cognitive Behavioral Therapy and Beyond
Rousmaniere, T. G., Goodyear, R. K., Miller, S. D., & Wampold, B. E. (2017) · Wiley eBooks · doi:10.1002/9781119165590.ch9
DiBlasi, T., Tafrate, R. C., & Kassinove, H. (2022) · Psihologijske teme · doi:10.31820/pt.31.3.14
“Given that relational elements are present in the delivery of both conditions of dismantling studies, it is difficult to isolate such common factors and test for their effects (Bell et al., 2013).”
Mahon, D. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80455-732-720231003
Damm, J. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xya7r
Psychotherapieforschung: Zweifel am medizinischen Metamodell
Gmelch, M. (2024) · Springer eBooks · doi:10.1007/978-3-662-68490-0_2
Bharti, J., Srivastava, M., & Saxena, Y. (2023) · Journal for ReAttach Therapy and Developmental Diversities · doi:10.53555/jrtdd.v6i1s.2838
Selected Issues for the Next Decade
Herman, D. B., Conover, S., & Susser, E. (2024) · Oxford University Press eBooks · doi:10.1093/9780197518144.003.0011
Becquignon, A., Maoz, Z., & Sudres, J. L. (2025) · Annales Médico-psychologiques revue psychiatrique · doi:10.1016/j.amp.2025.03.001
Damm, J. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xya7r_v2
González-Araneda, N., & López-Vásquez, A. (2025) · Praxis Psy · doi:10.32995/praxispsy.v27i43.330
Thomas, E. B. K., Nettleton, S., O’Hara, M. W., & ALEXANDER, B. K. (2025) · doi:10.2196/preprints.89998
Levitt, H. M. (2026) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-026-09717-w
“…include that: (a) even when therapy orientations are found effective, component analyses may reveal that their core interventions were not (e.g., Bell et al., 2013); (b) many therapy orientation effects disappear when researchers’ allegiance is taken into consid - eration (e.g., Dragioti et…”
Leichsenring, F., Doering, S., & Steinert, C. (2026) · Zeitschrift für psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2026.72.2.159 · Cited by 2
Internet-Based Cognitive Behavioral Therapy and Telephone Coaching for Anxiety in Children
Sourander, A., Kaajalaakso, K., Korpilahti-Leino, T., Ristkari, T., Ståhlberg, T., Hinkka‐Yli‐Salomäki, S., Mori, Y., & Luntamo, T. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.29195
Barry, C. M., Pendergrass, T. M., Haile, K., Xie, H., & Fiellin, L. E. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.29173 · Cited by 1
Kalmar, J., Baumann, I., Schleiting, E., Grünert, A., Vonderlin, E., Lindenberg, K., Neubauer, A. B., Heidenreich, T., & Mander, J. (2026) · Journal of Clinical Psychology · doi:10.1002/jclp.70216
Metadata
- Authors
- Bell, E. C., Marcus, D. K., & Goodlad, J. K.
- Affiliations
- University of Southern Mississippi (US)
- Washington State University (US)
- ORCID
- Marcus, David K.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2013
- Volume
- 81
- Issue
- 4
- Pages
- 722-736
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2092459752
- Cited by
- 192
- References
- 93
- Citations by year
- 2026: 11 · 2025: 7 · 2024: 10 · 2023: 13 · 2022: 18 · 2021: 11 · 2020: 16 · 2019: 21 · 2018: 19 · 2017: 21 · 2016: 13 · 2015: 16 · 2014: 13 · 2013: 2
- FWCI
- 2.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Aquila Digital Community (University of Southern Mississippi) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- common factors, treatment outcomes, follow-up outcomes, psychotherapy effectiveness
- MeSH terms
- Humans, Models, Psychological, Psychotherapy, Research Design, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.