The Dodo Bird Verdict–controversial, inevitable and important: a commentary on 30 years of meta-analyses
Abstract
In this article, the assertion that different psychological therapies are of broadly similar efficacy-often called the 'Dodo Bird Verdict'-is contrasted with the alternative view that there are specific therapies that are more effective than others for particular diagnoses. We note that, despite thirty years of meta-analytic reviews tending to support the finding of therapy equivalence, this view is still controversial and has not been accepted by many within the psychological therapy community; we explore this from a theory of science perspective. It is further argued that the equivalence of ostensibly different therapies is an inevitable consequence of the methodology that has dominated this field of investigation; namely, randomised controlled trials [RCTs]. The implicit assumptions of RCTs are analysed and it is argued that what we know about psychological therapy indicates that it is not appropriate to treat 'type of therapy' and 'diagnosis' as if they were independent variables in an experimental design. It is noted that one logical consequence of this is that we would not expect RCTs to be capable of isolating effects that are specific to 'type of therapy' and 'diagnosis'. Rather, RCTs would only be expected to be capable of identifying the non-specific effects of covariates, such as those of therapist allegiance. It is further suggested that those non-specific effects that have been identified via meta-analysis are not trivial findings, but rather characterise important features of psychological therapy.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
It is difficult to find advantages for psychological treatments over active control treatments.
“given the known difficulty in finding advantages for psychological treatments over active control treatments [29].”
From One-Day Acceptance and Commitment Therapy Compared to Support for Depressed Migraine Patients: a Randomized Clinical Trial. (2020) · cites this paper as [29]
Cites
(1975) · Medical Entomology and Zoology · Cited by 7,245 · see citing works
Cognitive Therapy and the Emotional Disorders
Jaffe, B. (1977) · Psychosomatics · doi:10.1016/s0033-3182(77)71107-7 · Cited by 4,722 · see citing works
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355 · see citing works
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215 · see citing works
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.1.7 · Cited by 3,067 · see citing works
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 1× · see citing works
“16, 510–522 (2009) DOI: 10.1002/cpp with all other interventions being little more than inert placebos (e.g., Chambless & Hollon, 1998).”
BackgroundInfluentialKirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442 · see citing works
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300 · see citing works
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · see citing works
The Structure of Common Mental Disorders
Krueger, R. F. (1999) · Archives of General Psychiatry · doi:10.1001/archpsyc.56.10.921 · Cited by 1,881 · see citing works
The effects of psychotherapy: an evaluation.
Eysenck, H. J. (1952) · Journal of Consulting Psychology · doi:10.1037/h0063633 · Cited by 1,734 · see citing works
The Great Psychotherapy Debate: Models Methods and Findings
Horvath, A. O. (2002) · Psychotherapy Research · doi:10.1093/ptr/12.1.108 · Cited by 1,705 · see citing works
Comorbidity of anxiety and unipolar mood disorders
Mineka, S., Watson, D., & Clark, L. A. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.377 · Cited by 1,573 · see citing works
Brown, T. A., Campbell, L. A., Lehman, C. L., Grisham, J. R., & Mancill, R. B. (2001) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.110.4.585 · Cited by 1,562 · see citing works
Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
Luborsky, L. (1975) · Archives of General Psychiatry · doi:10.1001/archpsyc.1975.01760260059004 · Cited by 1,485 · see citing works
Hoffman, S. G., & Smits, J. A. J. (2008) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v69n0415 · Cited by 1,420 · see citing works
Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.4.631 · Cited by 1,212 · see citing works
Psychotherapy relationships that work : therapist contributions and responsiveness to patients
Norcross, J. C. (2002) · Cited by 1,200 · see citing works
Psychotherapy Relationships That Work: Therapist Contributions and Responsiveness to Patients
Weiner, I. B. (2003) · Psychotherapy Research · doi:10.1093/ptr/kpg044 · Cited by 1,158 · see citing works
Wedding, D. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0248 · Cited by 1,097 · see citing works
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · see citing works
Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies.
Cuijpers, P., van Straten, A., Andersson, G., & van Oppen, P. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013075 · Cited by 1,050 · see citing works
A meta-analysis of the effects of cognitive therapy in depressed patients
Gloaguen, V., Cottraux, J., Cucherat, M., & Blackburn, I.-M. (1998) · Journal of Affective Disorders · doi:10.1016/s0165-0327(97)00199-7 · Cited by 809 · see citing works
Robinson, L. A., Berman, J., & Neimeyer, R. (1990) · Psychological bulletin · doi:10.1037/0033-2909.108.1.30 · Cited by 691 · see citing works
Acceptance and mindfulness-based therapy: New wave or old hat?
Hofmann, S. G., & Asmundson, G. J. G. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.09.003 · Cited by 665 · see citing works
The handbook of psychotherapy and behaviour change
Eysenck, H. J. (1979) · Behaviour Research and Therapy · doi:10.1016/0005-7967(79)90071-8 · Cited by 622 · see citing works
A Meta-Analytic Review of Adult Cognitive-Behavioral Treatment Outcome Across the Anxiety Disorders
Norton, P. J., & Price, E. C. (2007) · Journal of Nervous & Mental Disease · doi:10.1097/01.nmd.0000253843.70149.9a · Cited by 612 · cited 2× · see citing works
“Norton and Price (2007), reporting a meta-analysis that summarized 108 treatment studies across all the anxiety disorders, showed that behavioural therapy (BT) was as effi cacious as cognitive therapy (CT) and CBT, while Benish et al.’s (2008) meta-analysis in post-traumatic stress disorder (PTSD)…”
BackgroundMeta-analysis of comparative therapy outcome studies: a replication and refinement.
Shapiro, D. A., & Shapiro, D. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.581 · Cited by 590 · see citing works
The Dodo bird verdict is alive and well-mostly.
Luborsky, L., Rosenthal, R., Diguer, L., Andrusyna, T. P., Berman, J. S., Levitt, J. T., Seligman, D. A., & Krause, E. D. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.1.2 · Cited by 581 · see citing works
Psychotherapy In A New Key: A Guide To Time-limited Dynamic Psychotherapy
Strupp, H. H., & Binder, J. L. (1984) · Medical Entomology and Zoology · Cited by 555 · see citing works
A meta-analysis of treatment outcome for panic disorder
Gould, R. A., Ott, M. W., & Pollack, M. H. (1995) · Clinical Psychology Review · doi:10.1016/0272-7358(95)00048-8 · Cited by 520 · see citing works
Leichsenring, F., Rabung, S., & Leibing, E. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.12.1208 · Cited by 513 · see citing works
Do we need to challenge thoughts in cognitive behavior therapy?
Longmore, R. J., & Worrell, M. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.08.001 · Cited by 499 · see citing works
Kessler, R. C., Gruber, M., Hettema, J. M., Hwang, I., Sampson, N., & Yonkers, K. A. (2008) · Psychological Medicine · doi:10.1017/s0033291707002012 · Cited by 493 · see citing works
An exercise in mega-silliness.
Eysenck, H. J. (1978) · American Psychologist · doi:10.1037/0003-066x.33.5.517.a · Cited by 466 · see citing works
Lambert, M. (2007) · Psychotherapy Research · doi:10.1080/10503300601032506 · Cited by 461 · cited 1× · see citing works
“Moreover, at a clinical level it suggests that it may be of value for therapists routinely to monitor clients’ progress in therapy (e.g., Lambert, 2007), and the quality of the therapeutic alliance, in order to enable them promptly to address events that may disrupt therapy.”
BackgroundResponsiveness in psychotherapy.
Stiles, W. B., Honos‐Webb, L., & Surko, M. (1998) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1998.tb00166.x · Cited by 449 · see citing works
Meta‐Analysis of Therapist Effects in Psychotherapy Outcome Studies
Crits-Christoph, P. F., Baranackie, K., Kurcias, J., Beck, A. T., Carroll, K. M., Perry, K. J., Luborsky, L. B., McLellan, A. T., WOODY, G. E., Thompson, L. W., et al. (1991) · Psychotherapy Research · doi:10.1080/10503309112331335511 · Cited by 433 · see citing works
Cognitive-behavioral and pharmacological treatment for social phobia: A meta-analysis.
Gould, R. A., Buckminster, S., Pollack, M. H., Otto, M. W., & Yap, L. (1997) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1997.tb00123.x · Cited by 427 · see citing works
Psychotherapy in a New Key: A Guide to Time-Limited Dynamic Psychotherapy
Phillips, J. E. (1985) · American Journal of Psychiatry · doi:10.1176/ajp.142.11.1380 · Cited by 415 · see citing works
A Study of Brief Psychotherapy
(1964) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.1964.tb114051.x · Cited by 406 · see citing works
A meta-analysis of randomized trials of behavioural treatment of depression
Ekers, D., Richards, D., & Gilbody, S. (2008) · Psychological Medicine · doi:10.1017/s0033291707001614 · Cited by 400 · see citing works
Ormel, J., & Wohlfarth, T. D. (1991) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.60.5.744 · Cited by 345 · see citing works
Benish, S. G., Imel, Z. E., & Wampold, B. E. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.10.005 · Cited by 335 · see citing works
Kim, D., Wampold, B. E., & Bolt, D. M. (2006) · Psychotherapy Research · doi:10.1080/10503300500264911 · Cited by 330 · see citing works
Psychological therapy as viewed by clients and therapists
Llewelyn, S. P. (1988) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1988.tb00779.x · Cited by 319 · see citing works
Vulnerability before, during, and after a major depressive episode: a 3-wave population-based study.
Ormel, J., Oldehinkel, A. J., & Vollebergh, W. (2004) · PubMed · doi:10.1001/archpsyc.61.10.990 · Cited by 310 · see citing works
Brown, T. A. (2007) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.116.2.313 · Cited by 306 · see citing works
Ablon, J. S., & Jones, E. (1998) · Psychotherapy Research · doi:10.1093/ptr/8.1.71 · Cited by 305 · see citing works
A meta-(re) analysis of the effects of cognitive therapy versus ‘other therapies’ for depression
Wampold, B. E., Minami, T., Baskin, T. W., & Callen Tierney, S. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00287-1 · Cited by 305 · see citing works
Leichsenring, F. (2001) · Clinical Psychology Review · doi:10.1016/s0272-7358(99)00057-4 · Cited by 281 · cited 3× · see citing works
“The fi rst, which is often adopted by researchers aligned to a traditional psychotherapeutic perspective (e.g., Leichsenring, 2001; Luborsky et al., 2002; Shapiro & Shapiro, 1982; Wampold, 2001), is that most psychological therapies are of approximately equal effi cacy.”
BackgroundAblon, J. S., & Jones, E. E. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.5.775 · Cited by 280 · see citing works
2. THE MEASUREMENT OF SELF-ESTEEM
Rosenberg, M. (1965) · Princeton University Press eBooks · doi:10.1515/9781400876136-003 · Cited by 279 · see citing works
Bloom, H. S. (1987) · Evaluation Review · doi:10.1177/0193841x8701100407 · Cited by 216 · see citing works
Luborsky, L. B., McLellan, A. T., Diguer, L., WOODY, G. E., & Seligman, D. A. (1997) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1997.tb00099.x · Cited by 213 · see citing works
Abuse of the drug metaphor in psychotherapy process-outcome research
Stiles, W. B., & Shapiro, D. A. (1989) · Clinical Psychology Review · doi:10.1016/0272-7358(89)90007-x · Cited by 202 · see citing works
Ablon, J. S., & Jones, E. E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.1.64 · Cited by 191 · see citing works
Siev, J., & Chambless, D. L. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.4.513 · Cited by 182 · cited 3× · see citing works
“Moreover, there have been signifi - cant developments both in methodology, and in the specifi city of the questions being asked (e.g., Benish, Imel, & Wampold, 2008; Siev & Chambless, 2007).”
BackgroundMethodComparative effects of short-term psychodynamic psychotherapy: A meta-analysis.
Svartberg, M., & Stiles, T. C. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.5.704 · Cited by 181 · see citing works
Blatt, S. J., Zuroff, D. C., Quinlan, D. M., & Pilkonis, P. A. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.64.1.162 · Cited by 174 · see citing works
Psychiatrist effects in the psychopharmacological treatment of depression
McKay, K. M., Imel, Z. E., & Wampold, B. E. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.01.020 · Cited by 169 · see citing works
Disabuse of the drug metaphor: psychotherapy process-outcome correlations.
Stiles, W. B., & Shapiro, D. A. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.5.942 · Cited by 168 · see citing works
Grissom, R. J. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.5.973 · Cited by 159 · see citing works
Goldfried, M. R., Raue, P. J., & Castonguay, L. G. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.5.803 · Cited by 154 · see citing works
McEvoy, P. M., & Nathan, P. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.2.344 · Cited by 137 · cited 1× · see citing works
“This has been done, for instance, in a recent study by McEvoy and Nathan (2007), with apparently promising results: 10 2-hour CBT groups for a diagnostically heterogeneous sample of patients Copyright © 2009 John Wiley & Sons, Ltd. Clin.”
ResultAblon, J. S., & Jones, E. E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.1.64 · Cited by 132 · see citing works
Watson, D., O’Hara, M. W., & Stuart, S. P. (2008) · Depression and Anxiety · doi:10.1002/da.20496 · Cited by 124 · see citing works
David and Goliath: When empirical and clinical standards of practice meet.
Beutler, L. E. (2000) · American Psychologist · doi:10.1037/0003-066x.55.9.997 · Cited by 118 · see citing works
Generalized Anxiety Disorder in Patients With Major Depression: Is DSM-IV’s Hierarchy Correct?
Zimmerman, M. A., & Chelminski, I. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.3.504 · Cited by 113 · see citing works
Cognitive behavior therapy for anxiety disorders: 40 years of progress
Öst, L. (2008) · Nordic Journal of Psychiatry · doi:10.1080/08039480802315590 · Cited by 111 · see citing works
Panic Disorder, Phobias, and Generalized Anxiety Disorder
Craske, M. G., & Waters, A. M. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143857 · Cited by 106 · see citing works
Holmes, J. A. (2002) · BMJ · doi:10.1136/bmj.324.7332.288 · Cited by 103 · see citing works
Cognitive therapy versus systematic desensitization: Is one treatment superior?
Berman, J. S., Miller, R. C., & Massman, P. J. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.3.451 · Cited by 99 · see citing works
Blatt, S. J., Zuroff, D. C., Quinlan, D. M., et al. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.1.162 · Cited by 97 · see citing works
Hardy, G. E., Stiles, W. B., Barkham, M., & Startup, M. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.2.304 · Cited by 93 · see citing works
THE THERAPY RELATIONSHIP IN COGNITIVE THERAPY: A REVIEW
Waddington, L. (2002) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465802002059 · Cited by 92 · see citing works
Morrison, K. H., Bradley, R. G., & Westen, D. (2003) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1348/147608303765951168 · Cited by 85 · see citing works
Meta-analysis: A mixed meta-phor?
Gallo, P. S. (1978) · American Psychologist · doi:10.1037/0003-066x.33.5.515 · Cited by 84 · see citing works
Beutler, L. E. (2002) · Clinical Psychology Science and Practice · doi:10.1093/clipsy.9.1.30 · Cited by 84 · see citing works
Verbal response mode use in contrasting psychotherapies: A within-subjects comparison.
Stiles, W. B., Shapiro, D. A., & Firth‐Cozens, J. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.56.5.727 · Cited by 80 · see citing works
Zimmerman, M. A., McGlinchey, J. B., Chelminski, I., & Young, D. (2007) · Psychological Medicine · doi:10.1017/s0033291707001717 · Cited by 66 · see citing works
A Naturalistic Study of Psychotherapy for Bulimia Nervosa, Part 1
Thompson‐Brenner, H., & Westen, D. (2005) · The Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000178843.81100.eb · Cited by 62 · see citing works
Common misconceptions about cognitive mediation of treatment change: A commentary to
Hofmann, S. G. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.03.003 · Cited by 62 · see citing works
Longitudinal associations between depressive and anxiety disorders: a comparison of two trait models
Olino, T. M., Klein, D. N., Lewinsohn, P. M., Rohde, P., & Seeley, J. R. (2007) · Psychological Medicine · doi:10.1017/s0033291707001341 · Cited by 62 · see citing works
On the next generation of process research
Pachankis, J. E., & Goldfried, M. R. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.01.009 · Cited by 50 · see citing works
Verbal response mode use in contrasting psychotherapies: A within-subjects comparison.
Stiles, W. B., Shapiro, D. A., & Firth‐Cozens, J. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.5.727 · Cited by 47 · see citing works
A Naturalistic Study of Psychotherapy for Bulimia Nervosa, Part 2
Thompson‐Brenner, H., & Westen, D. (2005) · The Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000178883.82580.18 · Cited by 44 · see citing works
NICE, CHI and the NHS Reforms : Enabling Excellence or Imposing Control?
Miles, A., Hurwitz, B., & Hampton, J. (2000) · Research Portal (King's College London) · Cited by 27 · see citing works
Expansion in the provision of psychological treatment in the United Kingdom
Rachman, S., & Wilson, G. T. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.01.005 · Cited by 15 · see citing works
Trijsburg, R. W., Semeniuk, T., & Perry, J. C. (2004) · UvA-DARE (University of Amsterdam) · Cited by 12 · see citing works
Experimentation: A Social Psychological Perspective
Farr, R. M. (1976) · British Journal of Social and Clinical Psychology · doi:10.1111/j.2044-8260.1976.tb00029.x · Cited by 5 · see citing works
Paterson, D. G. (1933) · Psychological Bulletin · doi:10.1037/h0072181 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Role of Common Factors in Psychotherapy Outcomes
Cuijpers, P., Reijnders, M., & Huibers, M. J. H. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095424 · Cited by 748 · see citing works
Fonagy, P., Luyten, P., & Allison, E. (2015) · Journal of Personality Disorders · doi:10.1521/pedi.2015.29.5.575 · Cited by 540 · see citing works
Gone, J. P. (2013) · Transcultural Psychiatry · doi:10.1177/1363461513487669 · Cited by 533 · see citing works
Psychiatry beyond the current paradigm
Bracken, P., Thomas, P., Timimi, S., Asen, E., Behr, G., Beuster, C., Bhunnoo, S., Browne, I., Chhina, N., Double, D., et al. (2012) · British Journal of Psychiatry · doi:10.1192/bjp.bp.112.109447 · Cited by 474 · see citing works
Hayes, S. C., Hofmann, S. G., & Ciarrochi, J. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101908 · Cited by 227 · see citing works
Journal of Counselor Preparation and Supervision
Renfro-Michel, E., & Burlew, L. D. (2026) · Journal of Counselor Preparation and Supervision · doi:10.7729/00.5277 · Cited by 199 · see citing works
van Bronswijk, S., Moopen, N., Beijers, L., Ruhe, H. G., & Peeters, F. (2019) · Psychological Medicine · doi:10.1017/s003329171800199x · Cited by 128 · see citing works
The responsiveness problem in psychotherapy: A review of proposed solutions.
Kramer, U., & Stiles, W. B. (2015) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12107 · Cited by 135 · see citing works
Beutler, L. E., Harwood, T. M., Michelson, A., Song, X., & Holman, J. E. (2010) · Journal of Clinical Psychology · doi:10.1002/jclp.20753 · Cited by 121 · see citing works
Some Problems with Randomized Controlled Trials and Some Viable Alternatives
Carey, T. A., & Stiles, W. B. (2015) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1942 · Cited by 108 · see citing works
Greenway, K. T., Garel, N., Jerome, L., & Feduccia, A. A. (2020) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2020.1772054 · Cited by 94 · see citing works
Ciarrochi, J., Hayes, S. C., Oades, L. G., & Hofmann, S. G. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.809362 · Cited by 95 · see citing works
Throwaway Citation of Prior Work Creates Risk of Bad HCI Research
Marshall, J., Linehan, C., Spence, J. C., & Rennick‐Egglestone, S. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3052751 · Cited by 77 · see citing works
Tran, U., & Gregor, B. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0979-2 · Cited by 46 · see citing works
Conversational Hypnosis: Conceptual and Technical Differences Relative to Traditional Hypnosis
Short, D. (2018) · American Journal of Clinical Hypnosis · doi:10.1080/00029157.2018.1441802 · Cited by 21 · see citing works
Polese, D., Fornaro, M., Palermo, M., Luca, V. D., & de Bartolomeis, A. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00210 · Cited by 70 · see citing works
The evidence-based practice of psychotherapy: Facing the challenges that lie ahead
Gaudiano, B. A., & Miller, I. W. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.04.004 · Cited by 67 · see citing works
Bad Blood Revisited: Attachment and Psychoanalysis, 2015
Fonagy, P., & Campbell, C. (2015) · British Journal of Psychotherapy · doi:10.1111/bjp.12150 · Cited by 61 · see citing works
Common, specific, and treatment fit variables in psychotherapy outcome.
Beutler, L. E., Forrester, B. T., Gallagher-Thompson, D. E., Thompson, L. W., & Tomlins, J. B. (2012) · Journal of Psychotherapy Integration · doi:10.1037/a0029695 · Cited by 57 · see citing works
Mentalizing, attachment and epistemic trust: how psychotherapy can promote resilience.
Fonagy, P., & Campbell, C. (2017) · PubMed · Cited by 50 · see citing works
Mindfulness Research in Social Work: Conceptual and Methodological Recommendations
Garland, E. L. (2013) · Social Work Research · doi:10.1093/swr/svt038 · Cited by 48 · see citing works
Gambrill, E. D. (2013) · Research on Social Work Practice · doi:10.1177/1049731513499411 · Cited by 47 · see citing works
Fraser, J. G., Lloyd, S., Murphy, R., Crowson, M. M., Zolotor, A., Coker-Schwimmer, E. J. L., & Viswanathan, M. (2013) · Journal of Developmental and Behavioral Pediatrics · doi:10.1097/dbp.0b013e31828a7dfc · Cited by 50 · see citing works
Critical psychiatry: a brief overview
Middleton, H. C., & Moncrieff, J. (2018) · BJPsych Advances · doi:10.1192/bja.2018.38 · Cited by 45 · see citing works
Whiston, A., Bockting, C., & Semkovska, M. (2019) · Psychological Medicine · doi:10.1017/s0033291719002812 · Cited by 42 · see citing works
Bruijniks, S. J. E., Bosmans, J. E., Peeters, F. P. M. L., Hollon, S. D., van Oppen, P., van den Boogaard, M., Dingemanse, P., Cuijpers, P. J., Arntz, A. R., Franx, G. C., et al. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0532-8 · Cited by 42 · see citing works
How to spot hype in the field of psychotherapy: A 19-item checklist.
Meichenbaum, D. H., & Lilienfeld, S. O. (2018) · Professional Psychology Research and Practice · doi:10.1037/pro0000172 · Cited by 36 · see citing works
Hertzmann, L., Target, M., Hewison, D., Casey, P., Fearon, P. R. M., & Lassri, D. (2016) · Psychotherapy · doi:10.1037/pst0000092 · Cited by 34 · see citing works
Palpacuer, C., Gallet, L., Drapier, D., Reymann, J., Falissard, B., & Naudet, F. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.12.015 · Cited by 33 · see citing works
Fang, S., & Ding, D. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.03.015 · Cited by 33 · see citing works
Zamaria, J. A., Fernandes-Osterhold, G., Shedler, J., & Yehuda, R. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1505894 · Cited by 29 · see citing works
Schemer, L., Vlaeyen, J. W. S., Doerr, J. M., Skoluda, N., Nater, U. M., Rief, W., & Glombiewski, J. A. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.07.002 · Cited by 28 · see citing works
McQuillin, S. D., Lyons, M. D., Clayton, R. J., & Anderson, J. E. (2018) · Applied Developmental Science · doi:10.1080/10888691.2018.1454837 · Cited by 27 · see citing works
Challenges of creating synergy between global mental health and cultural psychiatry
de Jong, J. T. V. M. (2014) · Transcultural Psychiatry · doi:10.1177/1363461514557995 · Cited by 26 · see citing works
Social Work Education and Avoidable Ignorance
Gambrill, E. D. (2014) · Journal of Social Work Education · doi:10.1080/10437797.2014.916937 · Cited by 26 · see citing works
Aardema, F., Bouchard, S., Koszycki, D., Lavoie, M. E., Audet, J., & O’Connor, K. P. (2022) · Psychotherapy and Psychosomatics · doi:10.1159/000524425 · Cited by 27 · see citing works
Nadkarni, A., Massazza, A., Guda, R., Fernandes, L., Garg, A., Jolly, M., Andersen, L. S., Bhatia, U., Bogdanov, S., Roberts, B., et al. (2022) · Drug and Alcohol Review · doi:10.1111/dar.13550 · Cited by 28 · see citing works
Timimi, S. B. (2015) · BJPsych Bulletin · doi:10.1192/pb.bp.114.047118 · Cited by 24 · see citing works
Psychotherapy and brain plasticity
Collerton, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00548 · Cited by 24 · see citing works
Psychotherapy in Jordan: An Investigation of the Host and Syrian Refugee Community’s Perspectives
Karnouk, C., Böge, K., Hahn, E. W., Strasser, J., Schweininger, S., & Bajbouj, M. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00556 · Cited by 24 · see citing works
Dindo, L. N., Recober, A., Calarge, C. A., Zimmerman, B. M., Weinrib, A., Marchman, J. N., & Turvey, C. (2020) · Neurotherapeutics · doi:10.1007/s13311-019-00818-0 · Cited by 24 · see citing works
Quinze ans après le rapport de l’Inserm. L’efficacité de la psychanalyse ré-évaluée
Visentini, G. (2020) · L Évolution Psychiatrique · doi:10.1016/j.evopsy.2020.04.009 · Cited by 13 · see citing works
Uusitalo, S., Tuominen, J., & Arstila, V. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13485 · Cited by 22 · see citing works
Zimmermann, R., Krause, M., Weise, S., Schenk, N., Fürer, L., Schrobildgen, C., Schlüter-Müller, S., Valdés, N., Koenig, J., Kaess, M., et al. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.10.007 · Cited by 20 · see citing works
Psychedelic therapy – refining the claim of a paradigm shift
Aicher, H. D., Wolff, M., & Herwig, U. (2024) · International Review of Psychiatry · doi:10.1080/09540261.2024.2410853 · Cited by 15 · see citing works
What needs to change: Moving from “research informed” practice to “empirically effective” practice.
Beutler, L. E., & Forrester, B. T. (2014) · Journal of Psychotherapy Integration · doi:10.1037/a0037587 · Cited by 18 · see citing works
Zaboski, B. A., Joyce‐Beaulieu, D., Kranzler, J. H., McNamara, J. P. H., Gayle, C., & MacInnes, J. W. (2019) · Journal of Clinical Psychology · doi:10.1002/jclp.22792 · Cited by 16 · see citing works
Gonon, F., & Keller, P. H. (2020) · L Encéphale · doi:10.1016/j.encep.2020.04.020 · Cited by 15 · see citing works
EFFECTIVE THERAPIES OR EFFECTIVE MECHANISMS IN TREATMENT GUIDELINES FOR DEPRESSION?
Cuijpers, P. J. (2013) · Depression and Anxiety · doi:10.1002/da.22205 · Cited by 14 · see citing works
Efficacy of systemic therapy on adults with depressive disorders: A meta-analysis
Vossler, A., Pinquart, M., Forbat, L., & Stratton, P. (2024) · Psychotherapy Research · doi:10.1080/10503307.2024.2352741 · Cited by 13 · see citing works
Innovation in Psychotherapy, Challenges, and Opportunities: An Opinion Paper
Schweiger, J. I., Kahl, K. G., Klein, J. P., Sipos, V., & Schweiger, U. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00495 · Cited by 13 · see citing works
Böses Blut – ein Rückblick: Bindung und Psychoanalyse, 2015
Fonagy, P., & Campbell, C. (2017) · PSYCHE · doi:10.21706/ps-71-4-275 · Cited by 13 · see citing works
Behan, D. (2022) · BMC Psychology · doi:10.1186/s40359-022-00886-6 · Cited by 12 · see citing works
Integration in counselling psychology: To what purpose?
Cutts, L. (2011) · Counselling Psychology Review · doi:10.53841/bpscpr.2011.26.2.38 · Cited by 12 · see citing works
Blainey, S. H., Rumball, F., Mercer, L., Evans, L. J., & Beck, A. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2108 · Cited by 11 · see citing works
Bedeutung der psychotherapeutischen Schulen heute
Tschuschke, V., von Wyl, A., Koemeda-Lutz, M., Crameri, A., Schlegel, M., & Schulthess, P. (2015) · Psychotherapeut · doi:10.1007/s00278-015-0067-y · Cited by 11 · see citing works
Tschuschke, V., & Freyberger, H. J. (2015) · Zeitschrift für psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2015.61.2.122 · Cited by 11 · see citing works
Qinaʻau, J., & Masuda, A. (2020) · Springer eBooks · doi:10.1007/978-3-030-32229-8_7 · Cited by 10 · see citing works
Marshall, J., Linehan, C., Spence, J. C., & Rennick‐Egglestone, S. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3052752 · Cited by 10 · see citing works
Batstra, L., & Timimi, S. B. (2024) · PLOS mental health. · doi:10.1371/journal.pmen.0000194 · Cited by 9 · see citing works
‘A life I can cope with’. An alternative model of cognitive behavioural therapy (CBT) for CFS/ME
Clark, C. E., & Holttum, S. (2021) · Health Expectations · doi:10.1111/hex.13326 · Cited by 8 · see citing works
Holttum, S., Wright, T., & Wood, C. (2021) · International Journal of Art Therapy · doi:10.1080/17454832.2021.1893370 · Cited by 8 · see citing works
The mindful resiliency in recovery model: empowering the transcendence of stigma
Moniz-Lewis, D. I. K. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1460329 · Cited by 8 · see citing works
López-Guerrero, J., Vadillo, M. A., Rivero, F. J., Muela, I., Navas, J. F., & Perales, J. C. (2025) · Current Addiction Reports · doi:10.1007/s40429-025-00614-1 · Cited by 8 · see citing works
Schaich, A., Outzen, J., Assmann, N., Gebauer, C., Jauch‐Chara, K., Alvarez‐Fischer, D., Hüppe, M., Adrian Wells, A., Schweiger, U., Klein, J. P., et al. (2022) · Psychotherapy and Psychosomatics · doi:10.1159/000527482 · Cited by 7 · see citing works
Developing Adaptive Change Capabilities Through Client-Centred Therapy
Bowles, T. (2012) · Behaviour Change · doi:10.1017/bec.2012.24 · Cited by 7 · see citing works
Macheiner, T., Skavantzos, A., Pilz, R., & Reininghaus, E. Z. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.06.057 · Cited by 7 · see citing works
Timimi, S. B. (2018) · Journal of Health Psychology · doi:10.1177/1359105318766139 · Cited by 7 · see citing works
Acceptance and commitment therapy (ACT) and humanistic psychotherapy: an integrative approximation
Sabucedo, P. (2019) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2019.1597016 · Cited by 7 · see citing works
Service user experiences of clinical psychology within an adult mental health service: an IPA study
Beattie, D., Murphy, S., Burke, J., O’Connor, H., & Jamieson, S. (2019) · Mental Health Review Journal · doi:10.1108/mhrj-02-2018-0005 · Cited by 7 · see citing works
Ketamine-assisted psychotherapies for mental disorders: A historical overview and systematic review
Veraart, J. K. E., Schimmers, N., Breeksema, J. J., Seybert, C., Kamphuis, J., Huber, L. F. T., Rota, A., Coerts, D. T., Oliveira-Maia, A. J., & Schoevers, R. A. (2026) · Clinical Psychology Review · doi:10.1016/j.cpr.2026.102706 · Cited by 7 · see citing works
In defence of loose ends: Psychotherapy process research in the real world
Sidis, A., Bøe, T. D., Karlsson, B., Lidbom, P. A., Moore, A. R., Pickard, J. A., & Deane, F. P. (2023) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2023.101011 · Cited by 6 · see citing works
Yeryomenko, N. (2012) · Scholarship at UWindsor (University of Windsor) · Cited by 6 · see citing works
Shapiro, Y., John, N., Scott, R., & Tomy, N. (2016) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000161 · Cited by 8 · see citing works
What Makes Psychodynamic Psychotherapy Work? A Review of Five Perspectives
Minges, M. V., Solomonov, N., & Barber, J. P. (2017) · Psychoanalytic Inquiry · doi:10.1080/07351690.2017.1285188 · Cited by 6 · see citing works
The Identity Formation of Psychotherapists in Training: A Dialectical and Personal Process
Tsuman-Caspi, L. (2012) · doi:10.7916/d80g3s49 · Cited by 6 · see citing works
Dodo Bird Verdict in Psychotherapy
Elliott, K. P., Barker, K. K., & Hunsley, J. (2015) · The Encyclopedia of Clinical Psychology · doi:10.1002/9781118625392.wbecp053 · Cited by 6 · see citing works
More focused attention upon relationship; another call for paradigm shift in psychiatry
Middleton, H. C. (2017) · European Journal of Psychotherapy & Counselling · doi:10.1080/13642537.2017.1348374 · Cited by 5 · see citing works
From Package to Process: An Evidence-based Approach to Processes of Change in Psychotherapy
Ciarrochi, J., Hayes, S. C., Hayes, L., Sahdra, B. K., Ferrari, M., Yap, K., & Hofmann, S. G. (2021) · Comprehensive Clinical Psychology · doi:10.1016/b978-0-12-818697-8.00085-6 · Cited by 5 · see citing works
The Medical Model: What Is It, Where Did It Come from and How Long Has It Got?
Middleton, H. C. (2015) · Palgrave Macmillan UK eBooks · doi:10.1057/9781137460585_2 · Cited by 5 · see citing works
McCaffrey, T. (2014) · University of Limerick Institutional Repository (University of Limerick) · Cited by 5 · see citing works
Rotger, J. M., Coromina, L., & Segarra, V. C. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1624438 · Cited by 5 · see citing works
Social validity of a contextual behavioral science-based intervention for retirement education
Barbosa, L. M., & Murta, S. G. (2019) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-019-0137-0 · Cited by 5 · see citing works
National attitudes towards mental health treatment: the importance of research evidence
Kirk, A., Broman‐Fulks, J. J., & Bergquist, J. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1201847 · Cited by 5 · see citing works
Improving knowledge about the effectiveness of psychotherapy
Donald, I. N., & Carey, T. A. (2017) · Psychotherapy and Politics International · doi:10.1002/ppi.1424 · Cited by 4 · see citing works
Fifteen years after the INSERM report. Psychoanalysis's efficacy reevaluated
Visentini, G. (2021) · L'Évolution Psychiatrique · doi:10.1016/j.evopsy.2021.06.014 · Cited by 3 · see citing works
Tramonti, F., Saviozzi, V., Ferrante, B., Saliani, S., Galeazzi, E., Vatteroni, S., Genovesi, I., Vecchio, I. D., & Možina, M. (2024) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.14039 · Cited by 4 · see citing works
Approaches to “mental health” in low-income countries: a case study of Uganda
SHAW, I. F., & Middleton, H. C. (2013) · Mental Health Review Journal · doi:10.1108/mhrj-07-2013-0025 · Cited by 4 · see citing works
Homeopathy and Psychological Therapies
Donelli, D., & Antonelli, M. (2020) · Encyclopedia · doi:10.3390/encyclopedia1010008 · Cited by 4 · see citing works
Holt, R., & McLean, L. (2019) · Neuroethics · doi:10.1007/s12152-019-09398-4 · Cited by 3 · see citing works
Toward a New Science of the Clinical Uses of the Arts
Brown, S., & Cameirao, J. (2023) · Open Psychology · doi:10.1515/psych-2022-0133 · Cited by 3 · see citing works
Özkafacı, A. A., NALÇA, N., & Eren, N. (2023) · Türkiye Bütüncül Psikoterapi Dergisi · doi:10.56955/bpd.1309661 · Cited by 3 · see citing works
Una psichiatria al di là dell'attuale paradigma
Bracken, P. J., Thomas, P., Timimi, S. B., Asen, E., Behr, G., Beuster, C., Bhunnoo, S. A., Browne, I., Chhina, N., Double, D. B., et al. (2013) · PSICOTERAPIA E SCIENZE UMANE · doi:10.3280/pu2013-001002 · Cited by 3 · see citing works
Where is the Dialogue? A Social Constructionist View of Empirically Supported Treatments
Fourie, D. P. (2012) · South African Journal of Psychology · doi:10.1177/008124631204200113 · Cited by 3 · see citing works
Disciplining psychology education – a Foucauldian discourse analysis
Dempsey, I. (2018) · Psychology Teaching Review · doi:10.53841/bpsptr.2018.24.2.12 · Cited by 3 · see citing works
The Importance of Intentionality in Untangling Trauma From Severe Mental Illness
Lutton, S. S., & Swank, J. M. (2018) · Journal of Mental Health Counseling · doi:10.17744/mehc.40.2.02 · Cited by 3 · see citing works
Rowland, H. (2026) · Transactional Analysis Journal · doi:10.1080/03621537.2026.2677312 · Cited by 2 · see citing works
The cultural change narrative as a core component of therapeutic change
Tobiassen, A. H., Sundal, T., Stänicke, E., & Folmo, E. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1149984 · Cited by 2 · see citing works
Clients' narratives of healing and harm in psychotherapy: A qualitative method
Tavallaii, V., Najarpourian, S., & Rastegar, Y. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12855 · Cited by 2 · see citing works
Abordaje de los trastornos del estado de ánimo en la atención primaria de salud
León-Sanromà, M. (2013) · FMC - Formación Médica Continuada en Atención Primaria · doi:10.1016/s1134-2072(13)70608-x · Cited by 2 · see citing works
- Authors
- Budd, R., & Hughes, I.
- Affiliations
- Maindiff Court Hospital (GB)
- Cardiff and Vale University Health Board (GB)
- Corresponding author
- Hughes, Ian
- Venue
- Clinical Psychology & Psychotherapy
- Publisher
- Wiley
- Published
- 2009-09-02
- Volume
- 16
- Issue
- 6
- Pages
- 510-522
- ISSN
- 1063-3995 (ISSN-L)
- 1099-0879
- OpenAlex
- W1999117020
- Cited by
- 149
- References
- 89
- Citations by year
- 2026: 8 · 2025: 4 · 2024: 8 · 2023: 5 · 2022: 11 · 2021: 10 · 2020: 11 · 2019: 12 · 2018: 15 · 2017: 10 · 2016: 10 · 2015: 13 · 2014: 8 · 2013: 13 · 2012: 6
- FWCI
- 3.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Psychology & Psychotherapy (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- randomized controlled trials, non-specific effects, theory of science, methodological critique
- MeSH terms
- Anxiety Disorders, Mental Disorders, Depressive Disorder, Humans, Individuality, Outcome and Process Assessment, Health Care, Professional-Patient Relations, Psychotherapy, Meta-Analysis as Topic, Observer Variation, Cognitive Behavioral Therapy, Randomized Controlled Trials as Topic, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review