Moderators in psychotherapy meta-analysis
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Psychotherapy meta-analyses sometimes generate heterogeneous results, partially due to key methodological characteristics which vary between studies (e.g., psychotherapy conditions are contrasted with structurally different control conditions). Examining these potential moderator variables can help explain heterogeneous results within and between psychotherapy meta-analyses. The present manuscript provides an overview of moderators that are highly relevant to test the generalizability of effects across psychotherapy trials. These moderators mainly fall into one of the following groups: (a) structural equivalence of interventions, (b) preferences/allegiances, (c) therapist effects, and (d) sample representativeness. Individual moderators include: Bona fide psychotherapy, proximity to psychological interventions, psychotherapy orientation, pre-training of therapists, supervision, caseload of therapists, dosage, homework, patient preferences, researcher and therapist allegiance, therapist effects in nested designs, aspects of sample representativeness, multiple outcomes, and time of assessment. Our analysis of 15 psychotherapy meta-analyses published in 2016 suggests that the structural equivalence of psychotherapeutic conditions, patient and therapist preferences/allegiances, therapist effects and nested data structures as well as sample representativeness were often neglected and little-discussed as potential moderators. The manuscript describes further conceptual and methodological challenges when conducting moderator analyses such as the categorization of psychological treatments and the importance of interrater coding. We encourage meta-analysts to consider moderators which have previously shown utility in explaining heterogeneous results in the psychotherapy literature. Clinical or methodological significance of this article: Relevant moderator variables help explain heterogeneous results in psychotherapy meta-analyses. Though these variables are often overlooked, they should be regularly incorporated in meta-analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · cited 1×
“Conclusions Given the lasting impact of meta-analytic methods in psychotherapy research and the importance of moderators, it is surprising that current meta-analyses typically fail to consider several key psychological moderators (e.g., Luborsky et al., 1999; Smith & Glass, 1977).”
BackgroundAlliance in individual psychotherapy
Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011) · Psychotherapy · doi:10.1037/a0022186 · Cited by 2,072 · cited 1×
“…during the first five sessions, “late assessment” (assessed during the last five sessions), mid assessment (assessed between early and late), or average (assessments over various assessment-points) are typical (e.g., Flückiger, Del Re, Wampold, Symonds, & Horvath, 2012; Horvath et al., 2011).”
BackgroundSelf-citationLinehan, M. M., Comtois, K. A., Murray, A. M., Brown, M. Z., Gallop, R. J., Heard, H. L., Korslund, K. E., Tutek, D. A., Reynolds, S. K., & Lindenboim, N. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.7.757 · Cited by 2,025 · cited 1×
“Linehan et al. (2006) compared dialectical behavior therapy (DBT) to community treatment by experts (CTBE), finding superior outcomes for DBT in treating clients with borderline personality disorder (BPD).”
BackgroundThe Great Psychotherapy Debate: The Evidence for What Makes Psychotherapy Work
Wampold, B. E. (2015) · doi:10.4324/9780203582015 · Cited by 1,773
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · cited 2×
“The scheme from Wampold et al. (1997) for defining a bona fide therapy has been adapted in several meta-analyses and is described in more detail in Swift and Wampold (this issue).”
BackgroundMethodBisson, J. I., Ehlers, A., Matthews, R., Pilling, S., Richards, D., & Turner, S. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.021402 · Cited by 900
Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.3.450 · Cited by 884
A meta-analysis of the effects of cognitive therapy in depressed patients
Gloaguen, V., Cottraux, J., Cucherat, M., & Blackburn, I.-M. (1998) · Journal of Affective Disorders · doi:10.1016/s0165-0327(97)00199-7 · Cited by 809
The power of statistical tests for moderators in meta-analysis
Hedges, L. V., & Pigott, T. D. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.426 · Cited by 672 · cited 1×
“Clearly, considerations about integrating moderators in meta-analyses may depend on the number of included studies (Hedges & Pigott, 2004).”
BackgroundBaldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.842 · Cited by 646
Research works printed but not linked: 48
- 10.1037/0033-2909.101.2.213 · DOI · Paper page
- 10.1016/j.cpr.2013.01.004 · DOI
- 10.1037/a0015235 · DOI · Paper page
- Baldwin S. A., 2013, Bergin and Garfield’s handbook of psychotherapy and behavior change, 258
- 10.1080/16506073.2010.520731 · DOI
- 10.1176/appi.psychotherapy.1966.20.1.184 · DOI · Paper page
- 10.1016/j.cpr.2013.08.003 · DOI
- 10.2105/AJPH.93.5.792 · DOI · Paper page
- 10.1016/j.cpr.2012.07.002 · DOI · Paper page
- 10.1080/10503300802621198 · DOI
- 10.1037/a0039774 · DOI · Paper page
- 10.1017/S2045796016000780 · DOI
- 10.1037/a0033161 · DOI · Paper page
- 10.1037/cns0000063 · DOI · Paper page
- 10.1016/j.jagp.2016.06.006 · DOI · Paper page
- 10.1093/clipsy/bpg051 · doi:10.1093/clipsy/bpg051
- Hedges L. V., 1985, Statistical methods for meta-analysis
- 10.1002/sim.1186 · DOI · Paper page
- 10.1037/1082-989X.11.2.193 · DOI · Paper page
- 10.1177/0269215506070793 · DOI · Paper page
- 10.1016/S0140-6736(07)61241-0 · DOI · Paper page
- Kiresuk T. J., 1994, Goal attainment scaling: Applications, theory, and measurement
- 10.1016/j.cpr.2015.05.003 · DOI
- 10.1002/mpr.1377 · DOI · Paper page
- 10.1111/add.13285 · DOI · Paper page
- 10.1037/pst000002410.1037/pst0000024.supp · doi:10.1037/pst000002410.1037/pst0000024.supp
- Lipsey M. W., 2001, Practical meta-analysis
- 10.1017/ipm.2015.59 · DOI
- 10.1093/clipsy/6.1.95 · DOI
- 10.1007/s10879-016-9351-6 · DOI
- 10.1037/pst0000014 · DOI
- 10.1080/10503307.2014.935830 · DOI
- 10.1007/s10488-016-0736-3 · DOI
- 10.1037/0022-006X.59.6.883 · doi:10.1037/0022-006x.59.6.883 · Paper page
- 10.1080/10503300903311293 · DOI
- 10.1159/000356191 · DOI
- 10.1016/j.cpr.2006.06.001 · DOI
- 10.1037/10232-000 · DOI · Paper page
- 10.1037/a0031423 · DOI
- 10.1080/10503300902933188 · DOI
- 10.1016/j.cpr.2010.05.003 · DOI · Paper page
- 10.1186/s12888-016-0979-2 · DOI
- 10.1080/10503300500265181 · DOI · Paper page
- 10.1080/10503307.2016.1249433 · DOI · Paper page
- 10.1037/1082-989X.5.4.425 · doi:10.1037/1082-989x.5.4.425 · Paper page
- 10.1111/j.0963-7214.2005.00378.x · DOI · Paper page
- 10.1002/cpp.1957 · DOI
- 10.1037/cou0000145 · DOI
Cited by
Hayes, S. C., Hofmann, S. G., & Ciarrochi, J. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101908 · Cited by 227
Cochrane’s risk of bias tool in the context of psychotherapy outcome research
Munder, T., & Barth, J. (2018) · Psychotherapy Research · doi:10.1080/10503307.2017.1411628 · Cited by 174
Lomas, T., Medina, J. C., Ivtzan, I., Rupprecht, S., & Eiroa-Orosa, F. J. (2019) · Mindfulness · doi:10.1007/s12671-018-1062-5 · Cited by 152
Bear, H. A., Edbrooke-Childs, J., Norton, S., Krause, K. R., & Wolpert, M. (2020) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2019.12.002 · Cited by 101
Schaeuffele, C., Meine, L. E., Schulz, A., Weber, M. C., Moser, A., Paersch, C., Recher, D., Boettcher, J., Renneberg, B., Flückiger, C., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-023-01787-3 · Cited by 91
Self-citation
Metadata
- Authors
- Spielmans, G. I., & Flückiger, C.
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2018-01-09
- Volume
- 28
- Issue
- 3
- Pages
- 333-346
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W2783882257
- Cited by
- 40
- References
- 38
- FWCI
- 5.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Moderators in psychotherapy meta-analysis. https://app.cochat.ai/papers/10.1080/10503307.2017.1422214
- The paper
- Spielmans, G. I., & Flückiger, C. (2018). Moderators in psychotherapy meta-analysis. Psychotherapy Research. https://doi.org/10.1080/10503307.2017.1422214
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.