Trials and tribulations in the meta-analysis of treatment differences: Comment on Wampold et al. (1997).

Howard, Kenneth I., Krause, Merton S., Saunders, Stephen M., Kopta, S. Mark·1997·Psychological Bulletin

Abstract

A fair test of the Dodo bird conjecture that different psychotherapies are equally effective would entail separate comparisons of every pair of therapies. A meta-analysis of overall effect size for any particular set of such pairs is only relevant o the Dodo bird conjecture when the mean absolute value of differences i 0. The limitations of the underlying randomized clinical trials and the problem of uncontrolled causal variables make clinically useful treatment differences unlikely to be revealed by such heterogeneous meta-analyses. To enhance implications for practice, the authors recommend an intensified focus on patient-treatment interactions, cost-effectiveness variables, and separate meta-analyses for each pair of treatments. Wampold et al. (1997) examined studies that directly compared "bona fide " treatments [i.e., treatments hat "were based on psy-chological principles, were offered to the psychotherapy commu-nity as viable treatments (e.g., through professional books or man-uals), " and "were delivered by trained therapists " (p. 205; with at least a master's degree)] to patients with bona fide clinical problems. The results of their analyses are consistent with those

Cites (6)

  1. The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.
    Lipsey, Mark W., Wilson, David B. · 1993 · American Psychologist
  2. A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes."
    Wampold, Bruce E., Mondin, Gregory W., Moody, Marcia, Stich, Frederick, Benson, Kurt, Ahn, Hyun-nie · 1997 · Psychological Bulletin
  3. A phase model of psychotherapy outcome: Causal mediation of change.
    Howard, Kenneth I., Lueger, Robert J., Maling, Michael S., Martinovich, Zoran · 1993 · Journal of Consulting and Clinical Psychology
  4. Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress.
    Howard, Kenneth I., Moras, Karla, Brill, Peter L., Martinovich, Zoran, Lutz, Wolfgang · 1996 · American Psychologist
  5. What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
    Schmidt, Frank L. · 1992 · American Psychologist
  6. Patterns of symptomatic recovery in psychotherapy.
    Kopta, Stephen Mark, Howard, Kenneth I., Lowry, Jenny L., Beutler, Larry E. · 1994 · Journal of Consulting and Clinical Psychology

Show all 6 references

Cited by (8)

  1. The empirical status of cognitive-behavioral therapy: A review of meta-analyses
    Butler, Andrew C., Chapman, Jason E., Forman, Evan M., Beck, Aaron T. · 2006 · Clinical Psychology Review
  2. Is cognitive–behavioral therapy more effective than other therapies?
    Tolin, David F. · 2010 · Clinical Psychology Review
  3. The Dodo bird verdict is alive and well-mostly.
    Luborsky, Lester, Rosenthal, Robert, Diguer, Louis, Andrusyna, Tomasz P., Berman, Jeffrey S., Levitt, Jill T., Seligman, David A., Krause, Elizabeth D. · 2002 · Clinical Psychology: Science and Practice
  4. The relative efficacy of bona fide psychotherapies for treating post-traumatic stress disorder: A meta-analysis of direct comparisons
    Benish, Steven G., Imel, Zac E., Wampold, Bruce E. · 2008 · Clinical Psychology Review
  5. Let's face facts: Common factors are more potent than specific therapy ingredients.
    Messer, Stanley B., Wampold, Bruce E. · 2002 · Clinical Psychology: Science and Practice

See all 52

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Trials and tribulations in the meta-analysis of treatment differences: Comment on Wampold et al. (1997). https://app.cochat.ai/papers/10.1037//0033-2909.122.3.221
The paper
Howard, K. I., Krause, M. S., Saunders, S. M., & Kopta, S. M. (1997). Trials and tribulations in the meta-analysis of treatment differences: Comment on Wampold et al. (1997). Psychological Bulletin. https://doi.org/10.1037//0033-2909.122.3.221

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.