Are the parts as good as the whole? A meta-analysis of component treatment studies.
The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Component studies compare standard treatments to treatments with added components or dismantled components. A previous meta-analysis (Ahn & Wampold, 2001) failed to find any differences in outcome between treatments with more components and those with fewer components, leading the authors to conclude that common factors and not specific ingredients account for therapeutic change. METHOD: The current random effects model meta-analysis of psychotherapy component studies conducted between 1980 and 2010 included more than 3 times as many studies as Ahn and Wampold's (2001) meta-analysis (k = 66). Unlike the previous meta-analysis, this study conducted separate meta-analyses for additive and dismantling studies and also examined treatment outcomes at follow-up. RESULTS: For the dismantling studies, there were no significant differences between the full treatments and the dismantled treatments. For the additive studies, the treatment with the added component yielded a small, but significant, effect at completion (d = 0.14) and a slightly larger effect at follow-up (d = 0.28), but only for the specific problems that were targeted for treatment. Despite the diversity of populations studied, problems treated, and treatments examined, there was little heterogeneity among the results of these studies. CONCLUSION: These findings suggest that added specific ingredients may contribute modestly to treatment outcomes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Meta-analyses of between-group treatment effects, including additive and dismantling studies, are unlikely to yield actionable insights for EBPI implementers (e.g., Ahn & Wampold, 2001; Bell et al., 2013) due to mismatched levels of analysis that obscure potentially important treatment by context interactions (for an illustrative exception, see Weisz, Weiss, Alicke, & Klotz, 1987).”
From Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes (2016) · cites this paper as Bell et al., 2013
In the citing paper
“However, a small but significant effect was found when a component was added to a therapy, and this effect was larger at follow-up.”
From The Role of Common Factors in Psychotherapy Outcomes (2019) · cites this paper as Bell et al. 2013
In the citing paper
“Two meta-analyses have examined dismantling designs and both found minimal differences between the total treatment and the treatment without one or more critical ingredients (d50.01,n530, see Figure 1) (53,54).”
From How important are the common factors in psychotherapy? An update (2015) · cites this paper as [53]
In the citing paper
“The most recent of these meta-analyses did find that adding an ingre-dient to an existing treatment increased the effect for targeted variables by a small amount (d50.28)(53).”
From How important are the common factors in psychotherapy? An update (2015) · cites this paper as [53]
In the citing paper
“A second major review examined a much larger set of component studies (n = 66; Bell et al. 2013) and found that the use of dismantling studies did not result in significant differences between the full and the partial treatment (in which one component was left out; Cuijpers et al. 2019a).”
From The Role of Common Factors in Psychotherapy Outcomes (2019) · cites this paper as Bell et al. 2013
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · cited 1×
“I2 values of 25% or less are considered low levels of heterogeneity (Higgins et al., 2003).”
BackgroundBias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
(2000) · Cited by 9,198
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955 · cited 1×
“…with the effect sizes plotted along the x-axis and the corresponding standard errors on the y-axis (largest values at the bottom), examined the funnel plot asymmetry using a regression test (Egger, Smith, Schneider, & Minder, 1997), and conducted trim and fill analyses (Duval & Tweedie, 2000).”
MethodInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884 · cited 2×
“Consequently, the average d value in a random effects model is “the average effect rather than the common effect” (Riley et al., 2011, p. 965).”
BackgroundResultA Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
Luborsky, L. (1975) · Archives of General Psychiatry · doi:10.1001/archpsyc.1975.01760260059004 · Cited by 1,485
A component analysis of cognitive-behavioral treatment for depression.
Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J. K., Gortner, E., & Prince, S. E. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.2.295 · Cited by 1,413 · cited 3×
“Even Kazdin and Whitley’s (2003) higher estimate of an effect size of .45 for additive design studies would require 78 patients in each condition. In contrast, the average sample size for the studies included in the present meta-analysis was 23 participants in each condition, which would require a large effect size of…”
BackgroundInfluential
Cited by
How important are the common factors in psychotherapy? An update
Wampold, B. E. (2015) · World Psychiatry · doi:10.1002/wps.20238 · Cited by 1,728
The Role of Common Factors in Psychotherapy Outcomes
Cuijpers, P., Reijnders, M., & Huibers, M. J. H. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095424 · Cited by 748
“These studies decompose multicomponent therapies and compare the full therapy with a therapy in which one component is left out (dismantling studies) or in which a component is added to an existing therapy (additive studies; Bell et al. 2013).”
BackgroundBrief alcohol interventions for adolescents and young adults: A systematic review and meta-analysis
Tanner-Smith, E. E., & Lipsey, M. W. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.09.001 · Cited by 468
Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0034332 · Cited by 443
“…particular treatmente 18 633 .14 0.5 a Norcross and Lambert (2011). b Baldwin and Imel, 2013. c Wampold et al. (1997); confirmed by various other meta-analyses for specific disorders. d Bell et al., 2013 (targeted variables); see also Ahn and Wampold (2001). e Webb, DeRubeis, and Barber (2010).”
ResultInfluentialClient preferences affect treatment satisfaction, completion, and clinical outcome: a meta-analysis
Lindhiem, O., Bennett, C. B., Trentacosta, C. J., & McLear, C. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.06.002 · Cited by 315
Furukawa, T. A., Suganuma, A., Ostinelli, E. G., Andersson, G., Beevers, C. G., Shumake, J., Berger, T., Boele, F. W., Buntrock, C., Carlbring, P., et al. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00077-8 · Cited by 255
A qualitative meta-analysis examining clients’ experiences of psychotherapy: A new agenda.
Levitt, H. M., Pomerville, A., & Surace, F. I. (2016) · Psychological Bulletin · doi:10.1037/bul0000057 · Cited by 231
van Os, J., Guloksuz, S., Vijn, T. W., Hafkenscheid, A., & Delespaul, P. (2019) · World Psychiatry · doi:10.1002/wps.20609 · Cited by 217
Domhardt, M., Geßlein, H., von Rezori, R. E., & Baumeister, H. (2019) · Depression and Anxiety · doi:10.1002/da.22860 · Cited by 218
“Thus, it is possible that the nonsignificance in some comparisons might be primarily due to the small sample sizes of included studies, which is a common problem of component studies in psychotherapy research (Bell et al., 2013; Cuijpers et al., 2017).”
BackgroundMethodological Recommendations for Trials of Psychological Interventions
Guidi, J., Brakemeier, E.-L., Bockting, C. L. H., Cosci, F., Cuijpers, P., Jarrett, R. B., Linden, M., Marks, I., Peretti, C. S., Rafanelli, C., et al. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000490574 · Cited by 205
Enhancing the Personalization of Psychotherapy With Dynamic Assessment and Modeling
Fisher, A. J., & Boswell, J. F. (2016) · Assessment · doi:10.1177/1073191116638735 · Cited by 204
Common versus specific factors in psychotherapy: opening the black box
Mulder, R., Murray, G., & Rucklidge, J. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30100-1 · Cited by 198
Lorenzo-Luaces, L., German, R. E., & DeRubeis, R. J. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.12.003 · Cited by 190
“In a recent meta-analysis, Bell, Marcus, and Goodland (2013) reported that treatment packages with more than one component led to better outcomes than treatment packages that focus on a single component.”
BackgroundEisma, M. C., Boelen, P. A., van den Bout, J., Stroebe, W., Schut, H. A. W., Lancee, J., & Stroebe, M. S. (2015) · Behavior Therapy · doi:10.1016/j.beth.2015.05.007 · Cited by 185
“This is especially relevant given that dismantled treatments, consisting of single modules, generally yield similar results to full treatments (Bell, Marcus, & Goodlad, 2013).”
Egert, F., Dederer, V., & Fukkink, R. G. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.100309 · Cited by 194
Gukasyan, N., & Nayak, S. M. (2022) · Transcultural Psychiatry · doi:10.1177/1363461520983684 · Cited by 150
“In two meta-analyses of “dismantling” studies, in which the effects of removing a single specific ingredient are examined, removal of one or more “critical” elements of treatment resulted in no statistically significant change in treatment efficacy (Ahn & Wampold, 2001; Bell et al., 2013).”
BackgroundResultIs the Dodo bird endangered in the 21st century? A meta-analysis of treatment comparison studies
Marcus, D. K., O'Connell, D., Norris, A. L., & Sawaqdeh, A. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.08.001 · Cited by 148
“, Chambless, 2002; DeRubeis, Brotman, & Gibbons, 2005; Howard, Krause, Saunders, & Kopta, 1997). Although it was possible to examine some moderators in the cognitive contrast meta-analysis, most of these analyses only involved a small subset of studies and there were certainly not enough studies to examine treatment b…”
BackgroundInfluentialSelf-citationOnline parent programs for children’s behavioral problems: a meta-analytic review
Thongseiratch, T., Leijten, P. H. O., & Meléndez‐Torres, G. J. (2020) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-020-01472-0 · Cited by 162
Cuijpers, P., Cristea, I. A., Karyotaki, E., Reijnders, M., & Hollon, S. D. (2019) · Psychotherapy Research · doi:10.1080/10503307.2017.1395922 · Cited by 140
“largest and most recent review of component studies (Bell et al., 2013) identified only four studies on depression, while in the current meta-analysis we identified 16 component studies on therapies for depression with 22 comparisons between a full and partial therapy.”
BackgroundResultInfluentialWiltsey Stirman, S., Gamarra, J. M., Bartlett, B. A., Calloway, A., & Gutner, C. A. (2017) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12218 · Cited by 138
“401 Underwood, 2010; Nieuwsma et al., 2012), and one study that separately examined the impact of adding and removing components (Bell et al., 2013), which was a reanalysis of an earlier meta-analysis on component studies (Ahn & Wampold, 2001).”
InfluentialAcceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes
Villatte, J. L., Vilardaga, R., Villatte, M., Plumb Vilardaga, J. C., Atkins, D. C., & Hayes, S. C. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.001 · Cited by 136
In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy
Wampold, B. E., Flückiger, C., Del Re, A. C., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., Laska, K. M., et al. (2017) · Psychotherapy Research · doi:10.1080/10503307.2016.1249433 · Cited by 131
“As well, given that many of the CBT treatments were actually combined treatments, this evidence supports that some of the components added may lead to improvement, at least for targeted measures (see Bell et al., 2013)—that is to say, the components that were isolated in other classes and were at some disadvantage met…”
BackgroundWong, Y. J., Owen, J., Gabana, N. T., Brown, J. W., McInnis, S., Toth, P., & Gilman, L. (2018) · Psychotherapy Research · doi:10.1080/10503307.2016.1169332 · Cited by 127
“The sleeper effect: Artifact or phenomenon— brief comment on Bell et al. (2013).”
BackgroundA meta-analytic review of psychodynamic therapies for anxiety disorders
Keefe, J. R., McCarthy, K. S., Dinger, U., Zilcha‐Mano, S., & Barber, J. P. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.03.004 · Cited by 136
van der Pol, T. M., Hoeve, M., Noom, M. J., Stams, G. J. J. M., Doreleijers, T. A. H., van Domburgh, L., & Vermeiren, R. R. J. M. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12685 · Cited by 108
Quantifying the association between psychotherapy content and clinical outcomes using deep learning
Ewbank, M. P., Cummins, R., Tablan, V., Bateup, S., Catarino, A., Martin, A. J., & Blackwell, A. D. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2664 · Cited by 108
Kramer, U., Kolly, S., Berthoud, L., Keller, S., Preisig, M., Caspar, F., Berger, T., de Roten, Y., Marquet, P., & Despland, J.-N. (2014) · Psychotherapy and Psychosomatics · doi:10.1159/000358528 · Cited by 103
Lorenzo‐Luaces, L., DeRubeis, R. J., van Straten, A., & Tiemens, B. G. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.02.010 · Cited by 110
Integrating psychotherapy with the hierarchical taxonomy of psychopathology (HiTOP).
Hopwood, C. J., Bagby, R. M., Gralnick, T., Ro, E., Ruggero, C., Mullins-Sweatt, S., Kotov, R., Bach, B., Cicero, D. C., Krueger, R. F., et al. (2020) · Journal of Psychotherapy Integration · doi:10.1037/int0000156 · Cited by 91
Schoneveld, E. A., Lichtwarck-Aschoff, A., & Granic, I. (2018) · Prevention Science · doi:10.1007/s11121-017-0843-8 · Cited by 94
“Questions about mechanisms of change could be addressed in dismantling studies (Bell et al. 2013) in which one component of MindLight (e.”
BackgroundBradley, H. A., Rucklidge, J. J., & Mulder, R. T. (2017) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12647 · Cited by 92
“Aggregated disorder-specific outcomes though can yield effects much larger than aggregated non-specific outcomes (41), potentially because they are more specific to what the treatment is targeting (42).”
BackgroundKramer, U., Pascual‐Leone, A., Berthoud, L., de Roten, Y., Marquet, P., Kolly, S., Despland, J., & Page, D. (2016) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1956 · Cited by 84
“The present study has several limitations, in particular the ones known for add-on designs in psychotherapy (Bell et al., 2013): we need to highlight that we did not control for time nor for added attention in one group and effects observed might be due to these confounding factors.”
BackgroundGrös, D. F. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.018 · Cited by 81
Kladnitski, N., Smith, J., Uppal, S., James, M. A., Allen, A. R., Andrews, G., & Newby, J. M. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100310 · Cited by 77
Zagorscak, P., Heinrich, M., Sommer, D., Wagner, B., & Knaevelsrud, C. (2018) · Psychotherapy and Psychosomatics · doi:10.1159/000481515 · Cited by 78
A common factors perspective on mindfulness-based interventions
Goldberg, S. B. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00090-8 · Cited by 75
Goldberg, S. B., Sun, S., Carlbring, P., & Torous, J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00923-7 · Cited by 75
Heinrich, M., Zagorscak, P., Eid, M., & Knaevelsrud, C. (2020) · Assessment · doi:10.1177/1073191118803738 · Cited by 73
Psychedelics and psychotherapy
Nayak, S., & Johnson, M. W. (2021) · Pharmacopsychiatry · doi:10.1055/a-1312-7297 · Cited by 71
“Meta-analyses of dismantling studies, in which psychotherapies are compared with and without a putative active component, find minimal effect of the supposed active components [16, 17].”
BackgroundControlling for the placebo effect in psychotherapy: Noble quest or tilting at windmills?
Kirsch, I., Wampold, B., & Kelley, J. M. (2016) · Psychology of Consciousness: Theory, Research, and Practice · doi:10.1037/cns0000065 · Cited by 71
Ten things to remember about common factor theory.
Laska, K. M., & Wampold, B. E. (2014) · Psychotherapy · doi:10.1037/a0038245 · Cited by 84
Locher, C., Gaab, J., & Blease, C. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02317 · Cited by 65
“packages are superior to partial treatment packages at the end of psychotherapy (Ahn and Wampold, 2001; Bell et al., 2013).”
BackgroundCognitive-Behavioral Therapy: Nature and Relation to Non-Cognitive Behavioral Therapy
Lorenzo‐Luaces, L., Keefe, J. R., & DeRubeis, R. J. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.02.012 · Cited by 81
“In anxiety disorders, among the studies included in the meta-analyses of Adams et al. (2015) and Bell et al. (2013), only eight studies (Barlow, Rapee, Brown, 1992; Borkovec, Newman, Pincus, & Lytle, 2002; Emmelkamp & Beens, 1991; Marks, Lovell, Noshirvani, Livanou, & Thrasher, 1998; Mattick,…”
BackgroundMethodInfluentialStein, E., & Witkiewitz, K. (2020) · Mindfulness · doi:10.1007/s12671-020-01444-0 · Cited by 63
“The term “component study” is an umbrella term to describe clinical trials that compare hypothesized active components of a particular evidence-based treatment (Bell et al. 2013).”
BackgroundResultInfluentialReinforcer Pathology: Implications for Substance Abuse Intervention
Bickel, W. K., Athamneh, L. N., Snider, S. E., Craft, W. H., DeHart, W. B., Kaplan, B. A., & Basso, J. C. (2020) · Current topics in behavioral neurosciences · doi:10.1007/7854_2020_145 · Cited by 63
Measuring the active elements of cognitive-behavioral therapies
Cohen, Z. D., Barnes-Horowitz, N. M., Forbes, C. N., & Craske, M. G. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104364 · Cited by 58
Schotanus-Dijkstra, M., Pieterse, M. E., Drossaert, C. H. C., Walburg, J. A., & Bohlmeijer, E. T. (2019) · The Journal of Positive Psychology · doi:10.1080/17439760.2017.1388430 · Cited by 56
Mander, J., Blanck, P., Neubauer, A. B., Kröger, P., Flückiger, C., Lutz, W., Barnow, S., Bents, H., & Heidenreich, T. (2019) · Journal of Clinical Psychology · doi:10.1002/jclp.22695 · Cited by 56
Research strategies to discern active psychological therapy components: A scoping review
Leijten, P., Weisz, J. R., & Gardner, F. (2021) · Clinical Psychological Science · doi:10.1177/2167702620978615 · Cited by 55
“Meta-analyses of additive and dismantling studies show that target components rarely add significant levels of effectiveness to therapy protocols (Ahn & Wampold, 2001; Bell et al., 2013; Cuijpers et al., 2019).”
BackgroundThe future of psychological treatments: The Marburg Declaration
Rief, W., Asmundson, G. J. G., Bryant, R. A., Clark, D. M., Ehlers, A., Holmes, E. A., McNally, R. J., Neufeld, C. B., Wilhelm, S., Jaroszewski, A. C., et al. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102417 · Cited by 54
Factorial Designs Help to Understand How Psychological Therapy Works
Watkins, E. R., & Newbold, A. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00429 · Cited by 51
“Component Study Designs One experimental approach that has been used to examine the specific elements of psychological interventions is the component study (9), in which the full intervention is compared with the intervention with at least one component removed (a dismantling study) or in which a component is added to…”
MethodPsychotherapy for eating disorders: A meta-analysis of direct comparisons
Grenon, R., Carlucci, S., Brugnera, A., Schwartze, D., Hammond, N. G., Ivanova, I. V., Mcquaid, N., Proulx, G., & Tasca, G. A. (2018) · Psychotherapy Research · doi:10.1080/10503307.2018.1489162 · Cited by 61
Dismantling Studies of Psychotherapy
Papa, A., & Follette, W. C. (2015) · The Encyclopedia of Clinical Psychology · doi:10.1002/9781118625392.wbecp523 · Cited by 48
Kellett, S., Stockton, C., Marshall, H., Hall, J., Jennings, C., & Delgadillo, J. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.05.070 · Cited by 49
Harvey, A. G., Callaway, C. A., Zieve, G. G., Gumport, N. B., & Armstrong, C. C. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691621995752 · Cited by 57
“…that postintervention improvements become more pronounced at long-term follow-up (Compas et al., 2009; Ginsburg, 2009); and an occasional delayed treatment effect, such that improvements are evident only at follow-up and not immediately postintervention (Bell et al., 2013; Carroll et al., 1994).”
BackgroundBoettcher, J., Magnusson, K., Marklund, A., Berglund, E., Blomdahl, R., Braun, U., Delin, L., Lundén, C., Sjöblom, K., Sommer, D., et al. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.04.052 · Cited by 47
Furukawa, T. A., Karyotaki, E., Suganuma, A., Pompoli, A., Ostinelli, E. G., Cipriani, A., Cuijpers, P., & Efthimiou, O. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-026137 · Cited by 45
Flückiger, C., & Re, A. C. D. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796016000780 · Cited by 44
“…of additive component designs: Additive intervention components address specific therapeutic aspects, which may result in broader patient competencies and more sustainable treatment effects in comparison with treatments with less systematic focus on the specific ingredient (Bell et al. 2013).”
BackgroundMarsden, J., Stillwell, G., James, K., Shearer, J., Byford, S., Hellier, J. M., Kelleher, M., Kelly, J., Murphy, C., & Mitcheson, L. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30097-5 · Cited by 58
O’Reilly, K., Donohoe, G. J., O’Sullivan, D., Coyle, C., Corvin, A. P., O’Flynn, P., O’Donnell, M., Galligan, T., O’Connell, P., & Kennedy, H. G. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2018-6 · Cited by 49
Steubl, L., Sachser, C., Baumeister, H., & Domhardt, M. (2021) · European Journal of Psychotraumatology · doi:10.1080/20008198.2021.1879551 · Cited by 45
“…in IMIs for PTSD, the results align with previous meta-analytic reviews on dismantling/additive studies in regard to components in IMIs for anxiety disorders (Domhardt et al., 2019) and in face-to-face psychotherapies (Bell et al., 2013; Cuijpers, Cristea, Karyotaki, Reijnders, & Hollon, 2017).”
BackgroundResultSakata, M., Toyomoto, R., Yoshida, K., Luo, Y., Nakagami, Y., Uwatoko, T., Shimamoto, T., Tajika, A., Suga, H., Ito, H., et al. (2022) · Evidence Based Mental Health · doi:10.1136/ebmental-2022-300455 · Cited by 42
Constantino, M. J., & Bernecker, S. L. (2014) · Psychotherapy · doi:10.1037/a0036604 · Cited by 46
Strachan, L. P., Hyett, M. P., & McEvoy, P. M. (2020) · Current Psychiatry Reports · doi:10.1007/s11920-020-1139-4 · Cited by 40
Ewbank, M. P., Cummins, R., Tablan, V., Catarino, A., Buchholz, S., & Blackwell, A. D. (2021) · Psychotherapy Research · doi:10.1080/10503307.2020.1788740 · Cited by 39
Inclusion and exclusion strategies for conducting meta-analyses
Swift, J. K., & Wampold, B. E. (2017) · Psychotherapy Research · doi:10.1080/10503307.2017.1405169 · Cited by 52
Thomas, J. G., & Sharp, P. B. (2019) · Clinical Psychological Science · doi:10.1177/2167702618810223 · Cited by 45
Psychosocial Development in Adolescence: Insights from the Dynamic Systems Approach
Kunnen, E. S., Ruiter, N. M. P. D., Jeronimus, B. F., & der Gaag, M. A. E. V. (2019) · Routledge eBooks · doi:10.4324/9781315165844 · Cited by 54
“Similarly, so-called component studies (dismantling or additive studies) show that components of treatment programs can be rearranged or even eliminated without affecting the overall effectiveness of the treatment (Ahn & Wampold, 2001; Bell et al., 2013; Wampold, 2015; Wampold & Imel, 2015).”
BackgroundMadigan, S., Vaillancourt, K., McKibbon, A., & Benoit, D. (2015) · Attachment & Human Development · doi:10.1080/14616734.2015.1006386 · Cited by 34
Edmunds, S. R., Frost, K. M., Sheldrick, R. C., Bravo, A., Straiton, D., Pickard, K. E., Grim, V., Drahota, A., Kuhn, J., Azad, G. F., et al. (2022) · Autism · doi:10.1177/13623613211064431 · Cited by 36
“Experimental trials using an additive or dismantling approach (Bell et al., 2013), factorial design (Collins et al.”
MethodFurukawa, T. A., Horikoshi, M., Fujita, H., Tsujino, N., Jinnin, R., Kako, Y., Ogawa, S., Sato, H., Kitagawa, N., Shinagawa, Y., et al. (2018) · JMIR Mental Health · doi:10.2196/mental.9092 · Cited by 32
“So-called dismantling studies or component studies to disentangle individual constituents of broadly conceived CBT have been largely underpowered and inconclusive, as each study can only examine the value of adding one particular component in question in a relatively limited number of patients [10,11].”
BackgroundCuijpers, P. J., Harrer, M., & Furukawa, T. A. (2026) · World Psychiatry · doi:10.1002/wps.70002 · Cited by 36
Placebo effects in psychotherapy: A flawed concept and a contorted history.
Wampold, B. E., Frost, N. D., & Yulish, N. E. (2016) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000045 · Cited by 40
Prusiński, T. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.827321 · Cited by 45
Sandlund, C., Hetta, J. E., Nilsson, G. H., Ekstedt, M., & Westman, J. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2018.05.002 · Cited by 32
Wagner, C., Grob, C., & Hediger, K. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.931347 · Cited by 37
“Their study designs can decompose multicomponent treatments by comparing the complete intervention with an intervention in which one component is left out (dismantling studies) or with an intervention with an additional component (additive studies) (Bell et al., 2013; Mira et al., 2019).”
BackgroundLet’s teach peer support skills to all college students: Here’s how and why
Caporale-Berkowitz, N. A. (2020) · Journal of American College Health · doi:10.1080/07448481.2020.1841775 · Cited by 30
Hides, L. M., Quinn, C. A., Chan, G., Cotton, S., Pocuca, N., Connor, J. P., Witkiewitz, K. A., Daglish, M. R. C., Young, R. M., Stoyanov, S. R., et al. (2020) · Addiction · doi:10.1111/add.15146 · Cited by 26
“Such delayed treatment effects, also termed ‘sleeper effects’ (30) have been reported at 12 months follow-up in previous trials of CBT for substance use disorders (31).”
BackgroundWampold, B. E. (2017) · Wiley eBooks · doi:10.1002/9781119165590.ch3 · Cited by 27
Zhao, C., Zhao, Z., Levin, M. E., Lai, L., Shi, C., Hu, J., Chen, W., & Ren, Z. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104440 · Cited by 22
Grös, D. F., & Allan, N. P. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112541 · Cited by 22
A narrative review of the active ingredients in psychotherapy delivered by conversational agents
Herbener, A. B., Klincewicz, M., & Damholdt, M. F. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100401 · Cited by 25
Bedendo, A., McCambridge, J., Gaume, J., de Souza, A. A. L., Formigoni, M. L. O. D. S., & Noto, A. R. (2019) · Addiction · doi:10.1111/add.14923 · Cited by 26
The sleeper effect: Artifact or phenomenon—A brief comment on Bell et al. (2013).
Flückiger, C., Del Re, A. C., & Wampold, B. E. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0037220 · Cited by 19
Forensic Psychotherapy for Sexual Offenders: Has Its Effectiveness Yet Been Demonstrated?
Hoberman, H. M. (2015) · Springer eBooks · doi:10.1007/978-1-4939-2416-5_28 · Cited by 13
The professionalization and training of psychologists: The place of clinical wisdom
Levitt, H. M., & Piazza-Bonin, E. (2015) · Psychotherapy Research · doi:10.1080/10503307.2015.1090034 · Cited by 24
Tondorf, T., Kaufmann, L., Degel, A., Locher, C., Birkhäuer, J., Gerger, H., Ehlert, U., & Gaab, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187400 · Cited by 19
Podina, I. R., Vîslă, A., Fodor, L. A., & Flückiger, C. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.101774 · Cited by 21
Roca, P., Vázquez, C., Díez, G. G., & McNally, R. J. (2023) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2023.101895 · Cited by 20
Mansell, W., & Huddy, V. C. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00624 · Cited by 19
“However, there is little evidence that this approach has yielded insights into more effective treatments (10).”
BackgroundThe assessment of cognitive errors using an observer-rated method
Drapeau, M. (2013) · Psychotherapy Research · doi:10.1080/10503307.2013.861094 · Cited by 19
Intervention response among preschoolers with ADHD: The role of emotion understanding
Hare, M. M., Garcia, A. M., Hart, K. C., & Graziano, P. A. (2020) · Journal of School Psychology · doi:10.1016/j.jsp.2020.11.001 · Cited by 18
Schaeuffele, C., Heinrich, M., Behr, S., Fenski, F., Hammelrath, L., Zagorscak, P., Jansen, A., Pohl, S., Boettcher, J., & Knaevelsrud, C. (2022) · Trials · doi:10.1186/s13063-022-06757-0 · Cited by 16
Strunk, G., & Lichtwarck‐Aschoff, A. (2019) · Journal for Person-Oriented Research · doi:10.17505/jpor.2019.08 · Cited by 18
“Similarly, so-called component studies (dismantling or additive studies) show that components of treatment programs can be rearranged or even eliminated without affecting the overall effectiveness of the treatment (Ahn & Wampold, 2001; Bell et al., 2013; Bozog & Bühler, 1988; Wampold, 2015; Wampold & Imel, 2015).”
BackgroundZarski, A.-C., Weisel, K. K., Berger, T., Krieger, T., Schaub, M. P., Berking, M., Görlich, D., Jacobi, C., & Ebert, D. D. (2024) · Psychotherapy and Psychosomatics · doi:10.1159/000536149 · Cited by 13
“One could also argue that the differences between the two guidance formats were too minimal to alter the intervention ’ s ef fi cacy, as shown in previous studies [78, 79].”
ResultAdaptation in Dissemination and Implementation Science
Baumann, A. A., Stirman, S. W., & Cabassa, L. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197660690.003.0008 · Cited by 14
Doran, J. M., O’Shea, M., & Harpaz‐Rotem, I. (2018) · Psychiatric Quarterly · doi:10.1007/s11126-018-9604-5 · Cited by 16
An Investigation of Module-Specific Effects of Metacognitive Training for Psychosis
Schneider, B. C., Cludius, B., Lutz, W., Moritz, S., & Rubel, J. A. (2018) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000336 · Cited by 18
“and may be viewed by researchers as thus negating the need for dismantling studies (Ahn & Wampold, 2001; Bell et al., 2013).”
BackgroundInfluentialClinical Supervision at the International Crossroads
Watkins, C. E., Jr., & Milne, D. L. (2014) · Wiley eBooks · doi:10.1002/9781118846360.ch32 · Cited by 17
Psychoanalytic Psychotherapy or Cognitive-Behavioral Therapy for Bulimia Nervosa
Tasca, G. A., Hilsenroth, M. J., & Thompson‐Brenner, H. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.13121616 · Cited by 13
Metadata
- Authors
- Bell, E. C., Marcus, D. K., & Goodlad, J. K.
- Affiliations
- University of Southern Mississippi (US)
- Washington State University (US)
- ORCID
- Marcus, David K.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2013
- Volume
- 81
- Issue
- 4
- Pages
- 722-736
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2092459752
- Cited by
- 192
- References
- 93
- Citations by year
- 2026: 11 · 2025: 7 · 2024: 10 · 2023: 13 · 2022: 18 · 2021: 11 · 2020: 16 · 2019: 21 · 2018: 19 · 2017: 21 · 2016: 13 · 2015: 16 · 2014: 13 · 2013: 2
- FWCI
- 2.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Aquila Digital Community (University of Southern Mississippi) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Keywords
- common factors, treatment outcomes, follow-up outcomes, psychotherapy effectiveness
- MeSH terms
- Humans, Models, Psychological, Psychotherapy, Research Design, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.