Mediators and moderators in meta-analysis: There's a reason we don't let dodo birds tell us which psychotherapies should have prizes.

Abstract

In primary studies, psychotherapy researchers frequently search for mediator and moderator variables that can help them understand the relationship between treatment and outcome. Yet a review of past psychotherapy meta-analyses revealed that none examined the possible role of mediator variables; and although all of them searched for moderators of study outcome, that search was generally not as complete as it could have been. This article illustrates methods for studying such mediator and moderator variables in meta-analysis, discusses their advantages and disadvantages, and shows how the inclusion of these variables can change interpretation of meta-analytic results. In particular, the perennial interpretation of past psychotherapy meta-analyses that therapeutic orientation makes no difference to outcome--or as the dodo bird put it: "Everyone has won and all must have prizes"--may be wrong. Orientation may make significant difference, but only by virtue of its moderating and mediating effects.

Cites (6)

1. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
   Schmidt, Frank L., Hunter, John E. · 2015
2. Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
   Luborsky, Lester · 1975 · Archives of General Psychiatry
3. Consequences of prejudice against the null hypothesis.
   Greenwald, Anthony G. · 1975 · Psychological Bulletin
4. A meta-analysis of the efficacy of cognitive therapy for depression.
   Dobson, Keith S. · 1989 · Journal of Consulting and Clinical Psychology
5. Meta-analysis of comparative therapy outcome studies: a replication and refinement.
   Shapiro, David A., Shapiro, Diana · 1982 · Psychological Bulletin
6. Empirical bayes meta-analysis.
   Raudenbush, Stephen W., Bryk, Anthony S. · 1985 · Journal of Educational Statistics

Show all 6 references

Cited by (33)

1. The Handbook of Research Synthesis and Meta-Analysis
   2019
2. The role of the therapeutic alliance in psychotherapy.
   Horvath, Adam O., Luborsky, Lester · 1993 · Journal of Consulting and Clinical Psychology
3. Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies.
   Cuijpers, Pim, van Straten, Annemieke, Andersson, Gerhard, van Oppen, Patricia · 2008 · Journal of Consulting and Clinical Psychology
4. A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes."
   Wampold, Bruce E., Mondin, Gregory W., Moody, Marcia, Stich, Frederick, Benson, Kurt, Ahn, Hyun-nie · 1997 · Psychological Bulletin
5. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies.
   Cuijpers, P., Donker, T., van Straten, A., Li, J., Andersson, G. · 2010 · Psychological Medicine

See all 254