Is the allegiance effect an epiphenomenon of true efficacy differences between treatments? A meta-analysis.
Abstract
Many meta-analyses of comparative outcome studies found a substantial association of researcher allegiance (RA) and relative treatment effects. Therefore, RA is regarded as a biasing factor in comparative outcome research (RA bias hypothesis). However, the RA bias hypothesis has been criticized as causality might be reversed. That is, RA might be a reflection of true efficacy differences between treatments (true efficacy hypothesis). Consequently, the RA-outcome association would not be indicative of bias but an epiphenomenon of true efficacy differences. This meta-analysis tested the validity of the true efficacy hypothesis. This was done by controlling the RA-outcome association for true efficacy differences by restricting analysis to direct comparisons of treatments with equivalent efficacy. We included direct comparisons of different versions of trauma-focused therapy (TFT) in the treatment of posttraumatic stress disorder (PTSD). RA was measured from the research reports. Relative effect sizes for symptoms of PTSD were calculated. Random effects meta-regression was conducted. Twenty-nine comparisons of TFTs from 20 studies were identified. Initial heterogeneity among relative effect sizes was low. RA was a significant predictor of outcome and explained 12% of the variance in outcomes. The true efficacy hypothesis predicted the RA-outcome association to be zero; however, a substantial association was found. Thus, this study does not support the true efficacy hypothesis. Given findings from psychotherapy research and other fields that support a biasing influence of researcher preferences, RA should be regarded as a causal factor and conceptualized as a threat to the validity of conclusions from comparative outcome studies.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The allegiances of therapists to the mindfulness or PMR approaches could be a potential bias.
“The allegiances of therapists to the mindfulness or PMR approaches could be a potential bias (Munder et al. 2012).”
From The process-outcome mindfulness effects in trainees (PrOMET) study: Protocol of a pragmatic randomized controlled trial (2015) · cites this paper as Munder et al. 2012
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · see citing works
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · see citing works
(2000) · Cited by 9,198 · see citing works
Impact of Event Scale: A Measure of Subjective Stress
Horowitz, M., Wilner, N., & Alvarez, W. (1979) · Psychosomatic Medicine · doi:10.1097/00006842-197905000-00004 · Cited by 7,813 · see citing works
The development of a Clinician-Administered PTSD Scale
Blake, D. D., Weathers, F. W., Nagy, L. M., Kaloupek, D. G., Gusman, F. D., Charney, D. S., & Keane, T. M. (1995) · Journal of Traumatic Stress · doi:10.1002/jts.2490080106 · Cited by 5,024 · see citing works
Essentials of Behavioral Research: Methods and Data Analysis
Rosenthal, R., & Rosnow, R. L. (1984) · Cited by 3,925 · see citing works
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · see citing works
A Multidimensional Meta-Analysis of Psychotherapy for PTSD
Bradley, R., Greene, J., Russ, E., Dutra, L., & Westen, D. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.2.214 · Cited by 1,938 · see citing works
Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
Luborsky, L. (1975) · Archives of General Psychiatry · doi:10.1001/archpsyc.1975.01760260059004 · Cited by 1,485 · see citing works
Resick, P. A., Nishith, P., Weaver, T. L., Astin, M. C., & Feuer, C. A. (2002) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.70.4.867 · Cited by 1,294 · see citing works
Resick, P. A., Nishith, P., Weaver, T. L., Astin, M. C., & Feuer, C. A. (2002) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.70.4.867 · Cited by 1,294 · see citing works
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · see citing works
Self-citationFoa, E. B., Dancu, C. V., Hembree, E. A., Jaycox, L. H., Meadows, E. A., & Street, G. P. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.2.194 · Cited by 1,060 · see citing works
A meta-analytic review of prolonged exposure for posttraumatic stress disorder
Powers, M. B., Halpern, J. M., Ferenschak, M. P., Gillihan, S. J., & Foa, E. B. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.04.007 · Cited by 1,005 · see citing works
Foa, E. B., Hembree, E. A., Cahill, S. P., Rauch, S. A. M., Riggs, D. S., Feeny, N. C., & Yadin, E. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.953 · Cited by 931 · see citing works
Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.3.450 · Cited by 884 · see citing works
Resick, P. A., Galovski, T. E., Uhlmansiek, M. O., Scher, C. D., Clum, G. A., & Young-Xu, Y. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.76.2.243 · Cited by 825 · see citing works
Cognitive therapy for post-traumatic stress disorder: development and evaluation
Ehlers, A., Clark, D. M., Hackmann, A., McManus, F., & Fennell, M. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.03.006 · Cited by 703 · see citing works
Chapter 16: Special Topics in Statistics
Higgins, J. P. T., Deeks, J. J., & Altman, D. (2008) · Cited by 702 · see citing works
Robinson, L. A., Berman, J., & Neimeyer, R. (1990) · Psychological bulletin · doi:10.1037/0033-2909.108.1.30 · Cited by 691 · see citing works
Treatment for PTSD Related to Childhood Abuse: a Randomized Controlled Trial
Cloitre, M., Stovall-McClough, K. C., Nooner, K., Zorbas, P., Cherry, S., Jackson, C. L., Gan, W., & Petkova, E. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09081247 · Cited by 642 · see citing works
The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy.
Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., Halperin, G., Bishop, M., Berman, J. S., & Schweizer, E. (1999) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.6.1.95 · Cited by 572 · see citing works
Taylor, S. J., Thordarson, D. S., Maxfield, L., Fedoroff, I. C., Lovell, K., & Ogrodniczuk, J. S. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.2.330 · Cited by 563 · see citing works
Efficacy of the Eye Movement Desensitization procedure in the treatment of traumatic memories.
Shapiro, F. (1989) · Journal of Traumatic Stress · doi:10.1002/jts.2490020207 · Cited by 543 · see citing works
Tarrier, N., Pilgrim, H., Sommerfield, C., Faragher, B. E., Reynolds, M., Graham, E., & Barrowclough, C. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.1.13 · Cited by 458 · see citing works
Prolonged Exposure versus Eye Movement Desensitization and Reprocessing (EMDR) for PTSD rape victims
ROTHBAUM, B. O., Astin, M. C., & Marsteller, F. (2005) · Journal of Traumatic Stress · doi:10.1002/jts.20069 · Cited by 458 · see citing works
Cognitive-behavior therapy vs exposure therapy in the treatment of PTSD in refugees
Paunović, N., & Öst, L. (2001) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(00)00093-0 · Cited by 373 · see citing works
Bryant, R. A., Moulds, M. L., Guthrie, R. M., Dang, S. T., & Nixon, R. D. V. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.4.706 · Cited by 325 · see citing works
Ironson, G. H., Freund, B., Strauss, J. L., & Williams, J. G. (2001) · Journal of Clinical Psychology · doi:10.1002/jclp.1132 · Cited by 315 · see citing works
Devilly, G. J., & Spence, S. H. (1999) · Journal of Anxiety Disorders · doi:10.1016/s0887-6185(98)00044-9 · Cited by 291 · see citing works
Treatment of PTSD: A comparison of imaginal exposure with and without imagery rescripting
Arntz, A. R., Tiesema, M., & Kindt, M. (2007) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2007.10.006 · Cited by 290 · see citing works
Treatment of PTSD: Stress inoculation training with prolonged exposure compared to EMDR
Lee, C. W., Gavriel, H., Drummond, P. D., Richards, J., & Greenwald, R. (2002) · Journal of Clinical Psychology · doi:10.1002/jclp.10039 · Cited by 230 · see citing works
Power, K., McGoldrick, T., Brown, K., Buchanan, R., Sharp, D., Swanson, V., & Karatzias, A. (2002) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.341 · Cited by 203 · see citing works
Do all psychological treatments really work the same in posttraumatic stress disorder?
Ehlers, A., Bisson, J., Clark, D. M., Creamer, M., Pilling, S., Richards, D., Schnurr, P. P., Turner, S., & Yule, W. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.12.001 · Cited by 199 · see citing works
Bryant, R. A., Moulds, M. L., Guthrie, R. M., Dang, S. T., Mastrodomenico, J., Nixon, R. D. V., Felmingham, K. L., Hopwood, S., & Creamer, M. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0012616 · Cited by 195 · see citing works
Researcher allegiance and meta-analysis: The case of cognitive therapy for depression.
Gaffan, E. A., Tsaousis, I., & Kemp-Wheeler, S. M. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.6.966 · Cited by 194 · see citing works
Allegiance in psychotherapy outcome research: Separating association from bias.
Leykin, Y., & DeRubeis, R. J. (2009) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01143.x · Cited by 170 · see citing works
Devilly, G. J., Spence, S. H., & Rapee, R. M. (1998) · Behavior Therapy · doi:10.1016/s0005-7894(98)80042-7 · Cited by 131 · see citing works
Direct comparisons of treatment modalities for youth disorders: a meta-analysis
Miller, S., Wampold, B., & Varhely, K. (2008) · Psychotherapy Research · doi:10.1080/10503300701472131 · Cited by 126 · see citing works
Self-citationRogers, S., Silver, S. M., Goss, J., Obenchain, J. V., Willis, A. C., & Whitney, R. L. (1999) · Journal of Anxiety Disorders · doi:10.1016/s0887-6185(98)00043-7 · Cited by 100 · see citing works
Cognitive therapy versus systematic desensitization: Is one treatment superior?
Berman, J. S., Miller, R. C., & Massman, P. J. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.3.451 · Cited by 99 · see citing works
Testing the allegiance bias hypothesis: a meta-analysis
Munder, T., Gerger, H., Trelle, S., & Barth, J. (2011) · Psychotherapy Research · doi:10.1080/10503307.2011.602752 · Cited by 91 · see citing works
Self-citationLambert, M. J. (1999) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.6.1.127 · Cited by 26 · see citing works
Johnson, D. R., & Lubin, H. (2006) · Traumatology An International Journal · doi:10.1177/153476560601200106 · Cited by 18 · see citing works
Nüesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W., Bürgi, E., Scherer, M. N., Altman, D. G., & Jüni, P. (2009) · Cited by 6 · see citing works
Marks, I., Lovell, K., Noshirvani, H., Livanou, M., & Thrasher, S. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.4.317 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Barth, J., Munder, T., Gerger, H., Nüesch, E., Trelle, S., Znoj, H., Jüni, P., & Cuijpers, P. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001454 · Cited by 569 · see citing works
Self-citationLeichsenring, F., Salzer, S., Beutel, M. E., Herpertz, S., Hiller, W., Hoyer, J., Huesing, J., Joraschky, P., Nolting, B., Poehlmann, K., et al. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12081125 · Cited by 300 · see citing works
Researcher allegiance in psychotherapy outcome research: An overview of reviews
Munder, T., Brütsch, O., Leonhart, R., Gerger, H., & Barth, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.02.002 · Cited by 260 · see citing works
Self-citationBeyond emotions: A meta-analysis of neural response within face processing system in social anxiety
Gentili, C., Cristea, I. A., Angstadt, M., Klumpp, H., Tozzi, L., Phan, K. L., & Pietrini, P. (2015) · Experimental Biology and Medicine · doi:10.1177/1535370215603514 · Cited by 161 · see citing works
Barth, J., Münder, T., Gerger, H., Nüesch, E., Trelle, S., Znoj, H., Jüni, P., & Cuijpers, P. J. (2016) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.140201 · Cited by 131 · see citing works
Self-citationIn pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy
Wampold, B. E., Flückiger, C., Re, A. C. D., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., Laska, K. M., et al. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1249433 · Cited by 133 · see citing works
Self-citationIs psychotherapy effective? A re-analysis of treatments for depression
Münder, T., Flückiger, C., Leichsenring, F., Abbass, A. A., Hilsenroth, M. J., Luyten, P., Rabung, S., Steinert, C., & Wampold, B. E. (2018) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796018000355 · Cited by 137 · see citing works
Self-citationHow to prove that your therapy is effective, even when it is not: a guideline
Cuijpers, P., & Cristea, I. A. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796015000864 · Cited by 122 · see citing works
Gerger, H., Münder, T., Gemperli, A., Nüesch, E., Trelle, S., Jüni, P., & Barth, J. (2014) · Psychological Medicine · doi:10.1017/s0033291714000853 · Cited by 95 · see citing works
Self-citationThe emerging evidence for long-term psychodynamic therapy.
Leichsenring, F., Abbass, A., Luyten, P., Hilsenroth, M., & Rabung, S. (2013) · Psychodynamic Psychiatry · doi:10.1521/pdps.2013.41.3.361 · Cited by 76 · see citing works
Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research
Leichsenring, F., Abbass, A. A., Hilsenroth, M. J., Leweke, F., Luyten, P., Keefe, J. R., Midgley, N., Rabung, S., Salzer, S., & Steinert, C. (2016) · Psychological Medicine · doi:10.1017/s003329171600324x · Cited by 79 · see citing works
Tran, U., & Gregor, B. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0979-2 · Cited by 46 · see citing works
A Meta-Analysis of Mindfulness-Based Therapies for Insomnia and Sleep Disturbance
Rash, J. A., Kavanagh, V. A. J., & Garland, S. N. (2019) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2019.01.004 · Cited by 70 · see citing works
Conflicts of interest and spin in reviews of psychological therapies: a systematic review
Lieb, K., Osten-Sacken, J. V. D., Stoffers-Winterling, J., Reiss, N., & Barth, J. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010606 · Cited by 69 · see citing works
Self-citationKleinstäuber, M., Allwang, C., Bailer, J., Berking, M., Brünahl, C., Erkic, M., Gitzen, H., Gollwitzer, M., Gottschalk, J.-M., Heider, J., et al. (2019) · Psychotherapy and Psychosomatics · doi:10.1159/000501621 · Cited by 65 · see citing works
Bahji, A., Pierce, M., Wong, J., Roberge, J. N., Ortega, I., & Patten, S. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.6614 · Cited by 60 · see citing works
Go open: A plea for transparency in psychotherapy.
Gaab, J., Blease, C. R., Locher, C., & Gerger, H. (2015) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000063 · Cited by 60 · see citing works
Self-citationThe Gap Between Couple Therapy Research Efficacy and Practice Effectiveness
Halford, W. K., Pepping, C. A., & Petch, J. F. (2015) · Journal of Marital and Family Therapy · doi:10.1111/jmft.12120 · Cited by 59 · see citing works
Dragioti, E., Dimoliatis, I., & Evangelou, E. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-007206 · Cited by 44 · see citing works
“Gold Standards,” Plurality and Monocultures: The Need for Diversity in Psychotherapy
Leichsenring, F., Abbass, A. A., Hilsenroth, M. J., Luyten, P., Münder, T., Rabung, S., & Steinert, C. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00159 · Cited by 47 · see citing works
Moderators in psychotherapy meta-analysis
Spielmans, G. I., & Flückiger, C. (2018) · Psychotherapy Research · doi:10.1080/10503307.2017.1422214 · Cited by 40 · see citing works
Self-citationVink, M., & Vink-Niese, A. (2018) · Health Psychology Open · doi:10.1177/2055102918805187 · Cited by 38 · see citing works
A Series of Meta-Analytic Tests of the Efficacy of Long-Term Psychoanalytic Psychotherapy
Woll-Weber, C. F. J., & Schönbrodt, F. D. (2019) · European Psychologist · doi:10.1027/1016-9040/a000385 · Cited by 37 · see citing works
Palpacuer, C., Gallet, L., Drapier, D., Reymann, J., Falissard, B., & Naudet, F. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.12.015 · Cited by 33 · see citing works
Improving Disclosure of Financial Conflicts of Interest for Research on Psychosocial Interventions
Cristea, I. A., & Ioannidis, J. P. A. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.0382 · Cited by 31 · see citing works
Vink, M., & Vink-Niese, F. (2020) · Work · doi:10.3233/wor-203174 · Cited by 31 · see citing works
Stoll, M., Mancini, A. L., Hubenschmid, L., Dreimüller, N., König, J., Cuijpers, P. J., Barth, J., & Lieb, K. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.08.013 · Cited by 29 · see citing works
Self-citationBaraldi, J. H., Picozzo, S. A., Arnold, J. C., Volarich, K., Gionfriddo, M. R., & Piper, B. J. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-057598 · Cited by 26 · see citing works
Vink, M., & Vink-Niese, A. (2019) · Health Psychology Open · doi:10.1177/2055102919840614 · Cited by 27 · see citing works
A Case Study of Overselling Psychotherapy: An ACT Intervention for Diabetes Management
O’Donohue, W., Snipes, C., & Soto, C. G. (2015) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-015-9308-1 · Cited by 23 · see citing works
Increase value and reduce waste in research on psychological therapies
Cristea, I. A., & Naudet, F. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103479 · Cited by 22 · see citing works
Duwe, G., & Rocque, M. (2016) · Corrections · doi:10.1080/23774657.2015.1111743 · Cited by 22 · see citing works
Allegiance effects in mindfulness-based interventions for psychiatric disorders: A meta-re-analysis
Goldberg, S. B., & Tucker, R. P. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1664783 · Cited by 21 · see citing works
Hunger‐Schoppe, C., Hilzinger, R., Klewinghaus, L., Deußer, L., Sander, A., Mander, J., Bents, H., Ditzen, B., & Schweitzer, J. (2019) · Family Process · doi:10.1111/famp.12492 · Cited by 20 · see citing works
Tondorf, T., Kaufmann, L., Degel, A., Locher, C., Birkhäuer, J., Gerger, H., Ehlert, U., & Gaab, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187400 · Cited by 18 · see citing works
Self-citationPodina, I. R., Vîslă, A., Fodor, L. A., & Flückiger, C. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.101774 · Cited by 18 · see citing works
Self-citationThe problem of bias in behavioural intervention studies: Lessons from the PACE trial
Wilshire, C. E. (2017) · Journal of Health Psychology · doi:10.1177/1359105317700885 · Cited by 17 · see citing works
The importance of problem-focused treatments: A meta-analysis of anxiety treatments.
Yulish, N. E., Goldberg, S. B., Frost, N. D., Abbas, M., Oleen-Junk, N. A., Kring, M., Chin, M. Y., Raines, C. R., Soma, C. S., & Wampold, B. E. (2017) · Psychotherapy · doi:10.1037/pst0000144 · Cited by 16 · see citing works
Self-citationMander, J., Kröger, P., Heidenreich, T., Flückiger, C., Lutz, W., Bents, H., & Barnow, S. (2015) · BMC Psychology · doi:10.1186/s40359-015-0082-3 · Cited by 15 · see citing works
Self-citationThe Metacognitive Training for obsessive-compulsive disorder: A pilot study
Miegel, F., Demiralay, C., Sure, A., Moritz, S., Hottenrott, B., Cludius, B., & Jelinek, L. (2022) · Current Psychology · doi:10.1007/s12144-020-01158-5 · Cited by 15 · see citing works
Aktuelle Entwicklungen der psychodynamischen Psychotherapieforschung
Ehrenthal, J., Dinger, U., & Nikendei, C. (2014) · Psychotherapeut (Berlin) · doi:10.1007/s00278-014-1045-5 · Cited by 12 · see citing works
Yoder, W. R., Karyotaki, E., Cristea, I.-A., van Duin, D., & Cuijpers, P. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024622 · Cited by 11 · see citing works
Rash, J. A., Kavanagh, V. A. J., & Garland, S. N. (2022) · Sleep Medicine Clinics · doi:10.1016/j.jsmc.2022.06.002 · Cited by 12 · see citing works
Hunger‐Schoppe, C., Hilzinger, R., Koch, T., Mander, J., Sander, A., Bents, H., & Schweitzer, J. (2016) · Trials · doi:10.1186/s13063-016-1252-1 · Cited by 10 · see citing works
Investigator bias and the PACE trial
Lubet, S. (2017) · Journal of Health Psychology · doi:10.1177/1359105317697324 · Cited by 10 · see citing works
Zimmerman, J. A., & Marcus, D. K. (2024) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2974 · Cited by 10 · see citing works
Vink, M., & Vink-Niese, A. (2023) · Diseases · doi:10.3390/diseases11010011 · Cited by 9 · see citing works
Barth, J., Michlig, N., & Münder, T. (2014) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2014.931231 · Cited by 8 · see citing works
Self-citationFlückiger, C., Wolfer, C., Held, J., Hilpert, P., Rubel, J. A., Allemand, M., Zinbarg, R. E., & Vîslă, A. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1666-2 · Cited by 8 · see citing works
Self-citationDie Allegianz von Forschenden als versteckter Moderator in der Psychotherapieforschung
Gerger, H., & Gaab, J. (2016) · Verhaltenstherapie · doi:10.1159/000443543 · Cited by 7 · see citing works
Self-citationIn pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy
Wampold, B. E., Flückiger, C., Re, A. C. D., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., Laska, K. M., et al. (2019) · PERSON · doi:10.24989/person.v23i1.2428 · Cited by 6 · see citing works
Self-citationBoyde, C., Berger, B., Längler, A., Neugebauer, L., Jacobsen, S. L., Swanick, R., Gaebel, C., Schneider, D., Bernbeck, B., Paulussen, M., et al. (2024) · Pilot and Feasibility Studies · doi:10.1186/s40814-024-01490-8 · Cited by 5 · see citing works
Vollbehr, N. K., Hoenders, R. H. J., Bartels‐Velthuis, A. A., de Jong, P. J., & Ostafin, B. D. (2025) · Mindfulness · doi:10.1007/s12671-024-02502-7 · Cited by 5 · see citing works
Wong, J., Bahji, A., & Khalid‐Khan, S. (2020) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719898328 · Cited by 5 · see citing works
Skills for life: A review of life skills and their measurability, malleability, and meaningfulness
McGrath, R. E., & Adler, A. (2022) · doi:10.18235/0004414 · Cited by 4 · see citing works
Evidence Based Practice: An Overview
Mahon, D. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80455-732-720231002 · Cited by 3 · see citing works
Meijer, Y., & de Haan, E. (2015) · Tijdschrift voor Psychotherapie · doi:10.1007/s12485-015-0003-1 · Cited by 2 · see citing works
Choice, voice and collaboration: using preference accommodation and feedback in trauma therapy
Mahon, D. (2021) · Mental Health and Social Inclusion · doi:10.1108/mhsi-06-2021-0032 · Cited by 2 · see citing works
Cognitive-reminiscence therapy for the treatment of depression in young adults
Hallford, D. J. (2013) · Cited by 3 · see citing works
The Ethics of Neglecting Clinical Relationship and Alliance Building in Trauma-Focused Treatments
Gnaulati, E. (2019) · Ethical Human Psychology and Psychiatry · doi:10.1891/ehpp-d-19-00010 · Cited by 2 · see citing works
Humanistische und experientielle Psychotherapieverfahren
Gaab, J., Ziem, M., & Flückiger, C. (2020) · Springer eBooks · doi:10.1007/978-3-662-61814-1_17 · Cited by 2 · see citing works
Self-citationDahl, H. J. (2013) · NORA - Norwegian Open Research Archives · Cited by 2 · see citing works
Ware, J. W., Venere, K., Miller, S. A., Freeman, H., Scalzitti, D. A., & Hoogeboom, T. J. (2023) · Physical Therapy · doi:10.1093/ptj/pzad023 · Cited by 1 · see citing works
Vollbehr, N. K., Hoenders, R. H. J., Bartels‐Velthuis, A. A., de Jong, P. J., & Ostafin, B. D. (2023) · Journal of Experimental Psychopathology · doi:10.1177/20438087231183777 · Cited by 1 · see citing works
Maddox, C.-S. S., & Berle, D. (2024) · Clinical Psychologist · doi:10.1080/13284207.2024.2347643 · Cited by 1 · see citing works
Interessenkonflikte in der Psychotherapie
Lieb, K. (2016) · Elsevier eBooks · doi:10.1016/b978-3-437-23731-7.00042-9 · Cited by 1 · see citing works
Wright, S. P. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.06.001 · Cited by 1 · see citing works
Juul, S. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.1053844 · Cited by 1 · see citing works
Post-Traumatic Stress Disorder Outcome Research: Why Moderators Should not be Neglected
Gerger, H., & Gaab, J. (2016) · InTech eBooks · doi:10.5772/64266 · Cited by 1 · see citing works
Self-citationYork, R. O., Bolton, K., & Blundo, R. G. (2014) · International Journal of Solution-Focused Practices · doi:10.14335/ijsfp.v2i2.20
A rejoinder from Gerger and colleagues
Gerger, H., Münder, T., & Barth, J. (2014) · Psychological Medicine · doi:10.1017/s0033291714002037
Self-citationContextual factors in treatment : a meta-analytic and an experimental approach
Birkhäuer, J. (2017) · edoc (University of Basel) · doi:10.5451/unibas-006765849
Formative Evaluation der arbeitsbezogenen Gruppentherapie „Gesund bleiben im Beruf“
Wittmann, L., Groen, G., & Hampel, P. (2020) · Prävention und Gesundheitsförderung · doi:10.1007/s11553-020-00763-3
Tran, U. S., & Gregor, B. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2462096
Blause, S. D., Léonard, F., Willems, S. J., & Tirelli, E. (2025) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaf048
Münder, T., Barthelmes, B., Weber, L., Flückiger, C., Kerber, A., Krieger, T., Watzke, B., & Wolf, M. (2025) · Psychotherapy Research · doi:10.1080/10503307.2025.2538549 · Cited by 1 · see citing works
Self-citationAuthorship network bias in meta-analysis
Rieck, M., Mupepele, A., & Dormann, C. F. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2025.10063
Sunzeri, F. (2026) · Springer eBooks · doi:10.1007/978-3-032-14465-2_4
- Authors
- Munder, T., Flückiger, C., Gerger, H., Wampold, B. E., & Barth, J.
- Affiliations
- University of Zurich (CH)
- University of Bern (CH)
- University of Wisconsin–Madison (US)
- Venue
- Journal of Counseling Psychology
- Published
- 2012
- Volume
- 59
- Issue
- 4
- Pages
- 631-637
- ISSN
- 0022-0167 (ISSN-L)
- 1939-2168
- OpenAlex
- W2032387399
- Cited by
- 79
- References
- 46
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 3 · 2023: 5 · 2022: 4 · 2021: 2 · 2020: 7 · 2019: 11 · 2018: 6 · 2017: 5 · 2016: 11 · 2015: 8 · 2014: 6 · 2013: 6
- FWCI
- 7.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Counseling Psychology (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Funders
- Swiss National Science Foundation (105314-118312/1)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Clinical Psychology › Posttraumatic Stress Disorder Research
- Keywords
- relative treatment effect, post-traumatic stress disorder, trauma-focused psychotherapy
- MeSH terms
- Humans, Interprofessional Relations, Psychotherapy, Regression Analysis, Research Personnel, Stress Disorders, Post-Traumatic, Bias, Causality, Randomized Controlled Trials as Topic, Comparative Effectiveness Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review