Trials and tribulations in the meta-analysis of treatment differences: Comment on Wampold et al. (1997).
Abstract
A fair test of the Dodo bird conjecture that different psychotherapies are equally effective would entail separate comparisons of every pair of therapies. A meta-analysis of overall effect size for any particular set of such pairs is only relevant o the Dodo bird conjecture when the mean absolute value of differences i 0. The limitations of the underlying randomized clinical trials and the problem of uncontrolled causal variables make clinically useful treatment differences unlikely to be revealed by such heterogeneous meta-analyses. To enhance implications for practice, the authors recommend an intensified focus on patient-treatment interactions, cost-effectiveness variables, and separate meta-analyses for each pair of treatments. Wampold et al. (1997) examined studies that directly compared "bona fide " treatments [i.e., treatments hat "were based on psy-chological principles, were offered to the psychotherapy commu-nity as viable treatments (e.g., through professional books or man-uals), " and "were delivered by trained therapists " (p. 205; with at least a master's degree)] to patients with bona fide clinical problems. The results of their analyses are consistent with those
Cites (6)
- The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.Lipsey, Mark W., Wilson, David B. · 1993 · American Psychologist
- A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes."Wampold, Bruce E., Mondin, Gregory W., Moody, Marcia, Stich, Frederick, Benson, Kurt, Ahn, Hyun-nie · 1997 · Psychological Bulletin
- A phase model of psychotherapy outcome: Causal mediation of change.Howard, Kenneth I., Lueger, Robert J., Maling, Michael S., Martinovich, Zoran · 1993 · Journal of Consulting and Clinical Psychology
- Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.Howard, Kenneth I., Moras, Karla, Brill, Peter L., Martinovich, Zoran, Lutz, Wolfgang · 1996 · American Psychologist
- What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.Schmidt, Frank L. · 1992 · American Psychologist
- Patterns of symptomatic recovery in psychotherapy.Kopta, Stephen Mark, Howard, Kenneth I., Lowry, Jenny L., Beutler, Larry E. · 1994 · Journal of Consulting and Clinical Psychology
Cited by (8)
- The empirical status of cognitive-behavioral therapy: A review of meta-analysesButler, Andrew C., Chapman, Jason E., Forman, Evan M., Beck, Aaron T. · 2006 · Clinical Psychology Review
- Is cognitive–behavioral therapy more effective than other therapies?Tolin, David F. · 2010 · Clinical Psychology Review
- The Dodo bird verdict is alive and well-mostly.Luborsky, Lester, Rosenthal, Robert, Diguer, Louis, Andrusyna, Tomasz P., Berman, Jeffrey S., Levitt, Jill T., Seligman, David A., Krause, Elizabeth D. · 2002 · Clinical Psychology: Science and Practice
- The relative efficacy of bona fide psychotherapies for treating post-traumatic stress disorder: A meta-analysis of direct comparisonsBenish, Steven G., Imel, Zac E., Wampold, Bruce E. · 2008 · Clinical Psychology Review
- Let's face facts: Common factors are more potent than specific therapy ingredients.Messer, Stanley B., Wampold, Bruce E. · 2002 · Clinical Psychology: Science and Practice
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trials and tribulations in the meta-analysis of treatment differences: Comment on Wampold et al. (1997). https://app.cochat.ai/papers/10.1037//0033-2909.122.3.221
- The paper
- Howard, K. I., Krause, M. S., Saunders, S. M., & Kopta, S. M. (1997). Trials and tribulations in the meta-analysis of treatment differences: Comment on Wampold et al. (1997). Psychological Bulletin. https://doi.org/10.1037//0033-2909.122.3.221
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.