Does Publication Bias Inflate the Apparent Efficacy of Psychological Treatment for Major Depressive Disorder? A Systematic Review and Meta-Analysis of US National Institutes of Health-Funded Trials
Open accessThe DOI matches its Crossref record; 88 of the 89 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The efficacy of antidepressant medication has been shown empirically to be overestimated due to publication bias, but this has only been inferred statistically with regard to psychological treatment for depression. We assessed directly the extent of study publication bias in trials examining the efficacy of psychological treatment for depression. METHODS AND FINDINGS: We identified US National Institutes of Health grants awarded to fund randomized clinical trials comparing psychological treatment to control conditions or other treatments in patients diagnosed with major depressive disorder for the period 1972-2008, and we determined whether those grants led to publications. For studies that were not published, data were requested from investigators and included in the meta-analyses. Thirteen (23.6%) of the 55 funded grants that began trials did not result in publications, and two others never started. Among comparisons to control conditions, adding unpublished studies (Hedges' g = 0.20; CI95% -0.11~0.51; k = 6) to published studies (g = 0.52; 0.37~0.68; k = 20) reduced the psychotherapy effect size point estimate (g = 0.39; 0.08~0.70) by 25%. Moreover, these findings may overestimate the "true" effect of psychological treatment for depression as outcome reporting bias could not be examined quantitatively. CONCLUSION: The efficacy of psychological interventions for depression has been overestimated in the published literature, just as it has been for pharmacotherapy. Both are efficacious but not to the extent that the published literature would suggest. Funding agencies and journals should archive both original protocols and raw data from treatment trials to allow the detection and correction of outcome reporting bias. Clinicians, guidelines developers, and decision makers should be aware that the published literature overestimates the effects of the predominant treatments for depression.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“After adding the effect sizes of these unpublished trials to those of the published ones, the mean effect size for psychotherapy dropped by more than 25%.”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“a recent study found that almost one quarter of trials of psychotherapy for adult depression funded by the US National Institutes of Health were not published 15 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [15]
The cited source says what the claim attributes to it.
In the citing paper
“However, this was a relatively small drop compared to that reported in other studies on publication bias in psychotherapies for MDD 15,18,184 .”
From How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence (2016) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Hollon, S. D., DeRubeis, R. J., Fawcett, J., Amsterdam, J. D., Shelton, R. C., Zajecka, J., Young, P. R., & Gallop, R. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1054 · Cited by 179
Self-citationRetractedAn inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Zhang, Q., Wang, C., Zheng, M., Li, Y., Li, J., Zhang, L., Shang, X., & Yan, C. (2015) · Cerebrovascular Diseases · doi:10.1159/000369778 · Cited by 11,533
Projections of Global Mortality and Burden of Disease from 2002 to 2030
Mathers, C. D., & Loncar, D. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030442 · Cited by 11,386
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Koretz, D., Merikangas, K. R., Rush, A. J., Walters, E. E., & Wang, P. S. (2003) · JAMA · doi:10.1001/jama.289.23.3095 · Cited by 7,988
Scoville, W. B. (1949) · Journal of neurosurgery · doi:10.3171/jns.1949.6.1.0065 · Cited by 7,380
Research Diagnostic Criteria: Rationale and Reliability
Spitzer, R. L. (1978) · Archives of General Psychiatry · doi:10.1001/archpsyc.1978.01770300115013 · Cited by 6,951
Diagnostic Criteria for Use in Psychiatric Research
Feighner, J. P. (1972) · Archives of General Psychiatry · doi:10.1001/archpsyc.1972.01750190059011 · Cited by 5,715
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Self-citationElkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300
Investigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225
Dimidjian, S., Hollon, S. D., Dobson, K. S., Schmaling, K. B., Kohlenberg, R. J., Addis, M. E., Gallop, R., McGlinchey, J. B., Markley, D. K., Gollan, J. K., et al. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.658 · Cited by 1,607
Self-citationPRACTICE GUIDELINE FOR THE Treatment of Patients With Major Depressive Disorder
Gelenberg, A. J., Freeman, P. B., Markowitz, J. C., Rosenbaum, J. F., Thase, M. E., Trivedi, M. H., & Rhoads, R. S. (2010) · Cited by 1,510
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417
A component analysis of cognitive-behavioral treatment for depression.
Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J. K., Gortner, E., & Prince, S. E. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.2.295 · Cited by 1,413
Uncertainty in heterogeneity estimates in meta-analyses
Ioannidis, J. P. A., Patsopoulos, N. A., & Evangelou, E. (2007) · BMJ · doi:10.1136/bmj.39343.408449.80 · Cited by 1,254
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091
Cognitive Therapy vs Medications in the Treatment of Moderate to Severe Depression
DeRubeis, R. J., Hollon, S. D., Amsterdam, J. D., Shelton, R. C., Young, P. R., Salomon, R. M., O’Reardon, J. P., Lovett, M. L., Gladis, M. M., Brown, L. L., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.4.409 · Cited by 989
Self-citationRush, A. J., Beck, A. T., Kovacs, M., & Hollon, S. (1977) · Cognitive Therapy and Research · doi:10.1007/bf01173502 · Cited by 913
Self-citationMajor depressive disorder: new clinical, neurobiological, and treatment perspectives
Kupfer, D. J., Frank, E., & Phillips, M. L. (2012) · The Lancet · doi:10.1016/s0140-6736(11)60602-8 · Cited by 894
Kessler, R. C. (2012) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2011.11.005 · Cited by 871
Manber, R., Edinger, J. D., Gress, J. L., Pedro-Salcedo, M. G. S., Kuo, T. F., & Kalista, T. (2008) · Sleep · doi:10.1093/sleep/31.4.489 · Cited by 868
A Nonparametric "Trim and Fill" Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. L. (2000) · Journal of the American Statistical Association · doi:10.2307/2669529 · Cited by 694
Efficacy of Interpersonal Psychotherapy for Postpartum Depression
O'Hara, M. W., Stuart, S., Gorman, L. L., & Wenzel, A. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.11.1039 · Cited by 662
Reynolds III, C. F., Frank, E., Perel, J. M., Imber, S. D., Cornes, C., Miller, M. D., Mazumdar, S., Houck, P. R., Dew, M. A., Stack, J. A., et al. (1999) · JAMA · doi:10.1001/jama.281.1.39 · Cited by 659
Lustman, P. J., Griffith, L. S., Freedland, K. E., Kissel, S. S., & Clouse, R. E. (1998) · Annals of Internal Medicine · doi:10.7326/0003-4819-129-8-199810150-00005 · Cited by 562
Treating Depression in Predominantly Low-Income Young Minority Women: A Randomized Controlled Trial
Miranda, J., Chung, J. Y., Green, B. L., Krupnick, J., Siddique, J., Revicki, D. A., & Belin, T. (2003) · JAMA · doi:10.1001/jama.290.1.57 · Cited by 520
Cognitive Therapy and Pharmacotherapy for Depression: Singly and in Combination
Hollon, S. D. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820100018004 · Cited by 481
Self-citationComparative effectiveness of psychotherapies for depressed elders.
Thompson, L. W., Gallagher-Thompson, D. E., & Breckenridge, J. S. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.55.3.385 · Cited by 469
Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444
Cognitive Therapy and Pharmacotherapy: Singly and Together in the Treatment of Depression
Murphy, G. E. (1984) · Archives of General Psychiatry · doi:10.1001/archpsyc.1984.01790120037006 · Cited by 437
Treating Major Depression in Primary Care Practice: Eight-Month Clinical Outcomes
Schulberg, H. C. (1996) · Archives of General Psychiatry · doi:10.1001/archpsyc.1996.01830100061008 · Cited by 426
Cuijpers, P., Smit, F., Bohlmeijer, E., Hollon, S. D., & Andersson, G. (2010) · British Journal of Psychiatry · doi:10.1192/bjp.bp.109.066001 · Cited by 391
Self-citationThe Efficacy of Drugs and Psychotherapy in the Treatment of Acute Depressive Episodes
Weissman, M. M., Prusoff, B. A., Dimascio, A., Neu, C., Goklaney, M., & Klerman, G. L. (1979) · American Journal of Psychiatry · doi:10.1176/ajp.1979.136.4b.555 · Cited by 385
Dialectical Behavior Therapy for Depressed Older Adults: A Randomized Pilot Study
Lynch, T. R., Morse, J. Q., Mendelson, T., & Robins, C. J. (2003) · The American Journal of Geriatric Psychiatry · doi:10.1097/00019442-200301000-00006 · Cited by 384
Spinelli, M. G., & Endicott, J. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.3.555 · Cited by 379
Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis
Ross, J. S., Tse, T., Zarin, D. A., Xu, H., Zhou, L., & Krumholz, H. M. (2012) · BMJ · doi:10.1136/bmj.d7292 · Cited by 371
Public Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363
Mohr, D. C., Boudewyn, A. C., Goodkin, D. E., Bostrom, A., & Epstein, L. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.6.942 · Cited by 334
Differential Symptom Reduction by Drugs and Psychotherapy in Acute Depression
DiMascio, A. (1979) · Archives of General Psychiatry · doi:10.1001/archpsyc.1979.01780130068008 · Cited by 332
Wright, J. H., Wright, A. S., Albano, A. M., Basco, M. R., Goldsmith, L. J., Raffield, T., & Otto, M. W. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.6.1158 · Cited by 319
Marital therapy as a treatment for depression.
Jacobson, N. S., Dobson, K., Fruzzetti, A. E., & Schmaling, K. B. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.59.4.547 · Cited by 314
National trends in the treatment for depression from 1998 to 2007
Marcus, S. C., & Olfson, M. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.151 · Cited by 312
Reynolds, C. F., Miller, M. D., Pasternak, R. E., Frank, E., Perel, J. M., Cornes, C., Houck, P. R., Mazumdar, S., Dew, M. A., & Kupfer, D. J. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.2.202 · Cited by 308
NIH clinical trials and publication bias.
Dickersin, K., & Min, Y. (1993) · PubMed · Cited by 300
Areán, P. A., Raue, P., Mackin, R. S., Kanellopoulos, D., McCulloch, C., & Alexopoulos, G. S. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091327 · Cited by 275
Beutler, L. E., Engle, D., Mohr, D., & Daldrup, R. J. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.59.2.333 · Cited by 245
Treatment of major depressive disorder in older adult outpatients with brief psychotherapies.
Gallagher, D. E., & Thompson, L. W. (1982) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0088461 · Cited by 243
Psychological treatment of depression: A meta-analytic database of randomized studies
Cuijpers, P., van Straten, A., Warmerdam, L., & Andersson, G. (2008) · BMC Psychiatry · doi:10.1186/1471-244x-8-36 · Cited by 241
Self-citationReynolds, C. F., Miller, M. D., Pasternak, R. E., Frank, E., Perel, J. M., Cornes, C., Houck, P. R., Mazumdar, S., Dew, M. A., & Kupfer, D. J. (2004) · Focus · doi:10.1176/foc.2.2.260 · Cited by 233
Thompson, L. W., Coon, D. W., Gallagher-Thompson, D., Sommer, B. R., & Koin, D. (2001) · The American Journal of Geriatric Psychiatry · doi:10.1097/00019442-200108000-00006 · Cited by 212
Goldman, R. N., Greenberg, L. S., & Angus, L. (2006) · Psychotherapy Research · doi:10.1080/10503300600589456 · Cited by 205
Jarrett, R. B., Schaffer, M., McIntire, D., Witt-Browder, A., Kraft, D., & Risser, R. C. (1999) · Archives of General Psychiatry · doi:10.1001/archpsyc.56.5.431 · Cited by 174
Swartz, H. A., Frank, E., Zuckoff, A., Cyranowski, J. M., Houck, P. R., Cheng, Y., Fleming, M. A. D., Grote, N. K., Brent, D. A., & Shear, M. K. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.07081339 · Cited by 164
A randomized clinical trial of inpatient family intervention V. results for affective disorders
Clarkin, J. F., Glick, I. D., Haas, G. L., Spencer, J. H., Lewis, A. B., Peyser, J., DeMane, N., Good-Ellis, M., Harris, E., & Lestelle, V. (1990) · Journal of Affective Disorders · doi:10.1016/0165-0327(90)90113-m · Cited by 163
Barber, J. P., Barrett, M. S., Gallop, R., Rynn, M. A., & Rickels, K. (2012) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.11m06831 · Cited by 157
Effects of social skill training, amitriptyline, and psychotherapy in unipolar depressed women
Hersen, M., Himmelhoch, J. M., Thase, M. E., & Bellack, A. S. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80039-8 · Cited by 153
Frank, E., Cassano, G. B., Rucci, P., Thompson, W. K., Kraemer, H. C., Fagiolini, A., Maggi, L., Kupfer, D. J., Shear, M. K., Houck, P. R., et al. (2011) · Psychological Medicine · doi:10.1017/s0033291710000553 · Cited by 152
Cuijpers, P., van Straten, A., Smit, F., & Andersson, G. (2009) · International Psychogeriatrics · doi:10.1017/s1041610208008089 · Cited by 141
Self-citationCognitive-behavioral treatment of depressed inpatients: six- and twelve- month follow-up
(1989) · American Journal of Psychiatry · doi:10.1176/ajp.146.10.1274 · Cited by 119
HETEROGI: Stata module to quantify heterogeneity in a meta-analysis
Orsini, N., Bottai, M., Higgins, J. P. T., & Buchan, I. E. (2005) · RePEc: Research Papers in Economics · Cited by 118
Murphy, G. E., Carney, R. M., Knesevich, M. A., Wetzel, R. D., & Whitworth, P. (1995) · Psychological Reports · doi:10.2466/pr0.1995.77.2.403 · Cited by 111
Individual versus conjoint interpersonal psychotherapy for depressed patients with marital disputes
Foley, S. H., Rounsaville, B. J., Weissman, M. M., Sholomskas, D. E., & Chevron, E. S. (1989) · Cited by 95
Cognitive-behavioral treatment of depressed inpatients
Miller, I. W., Norman, W. H., Keitner, G. I., Bishop, S. B., & Dow, M. G. T. (1989) · Behavior Therapy · doi:10.1016/s0005-7894(89)80116-9 · Cited by 93
Denton, W. H., Wittenborn, A. K., & Golden, R. N. (2012) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2012.00291.x · Cited by 92
Linde, J. A., Simon, G. E., Ludman, E. J., Ichikawa, L. E., Operskalski, B. H., Arterburn, D., Rohde, P., Finch, E. A., & Jeffery, R. W. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9232-2 · Cited by 90
Rohan, K. J., Roecklein, K. A., Tierney Lindsey, K., Johnson, L. G., Lippy, R. D., Lacy, T. J., & Barton, F. B. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.3.489 · Cited by 87
Talbot, N. L., Chaudron, L. H., Ward, E. A., Duberstein, P. R., Conwell, Y., O'Hara, M. W., Tu, X., Lu, N., He, H., & Stuart, S. (2011) · Psychiatric Services · doi:10.1176/appi.ps.62.4.374 · Cited by 79
Cognitive behavioral group psychotherapy combined with imipramine in major depression.
Covi, L., & Lipman, R. S. (1987) · PubMed · Cited by 69
Is there an excess of significant findings in published studies of psychotherapy for depression?
Flint, J., Cuijpers, P., Horder, J., Koole, S. L., & Munafò, M. R. (2015) · Psychological Medicine · doi:10.1017/s0033291714001421 · Cited by 56
Self-citationWaiving confidentiality for the greater good
Chan, A.-W., Upshur, R., Singh, J. A., Ghersi, D., Chapuis, F., & Altman, D. G. (2006) · BMJ · doi:10.1136/bmj.332.7549.1086 · Cited by 46
Hayden, T., Perantie, D. C., Nix, B. D., Barnes, L. D., Mostello, D., Holcomb, W. L., Švrakić, D. M., Scherrer, J. F., Lustman, P. J., & Hershey, T. G. (2012) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-011-9294-8 · Cited by 46
Conceptualization and treatment of personality disorders
Clarkin, J. F. (2006) · Psychotherapy Research · doi:10.1080/10503300500395889 · Cited by 42
Clinical Significance of Inpatient Family Intervention: Conclusions From a Clinical Trial
Glick, I. D., Clarkin, J. F., Haas, G. L., & Spencer, J. H. (1993) · Psychiatric Services · doi:10.1176/ps.44.9.869 · Cited by 41
Wright, A. G. C., Hallquist, M. N., Swartz, H. A., Frank, E., & Cyranowski, J. M. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0034430 · Cited by 38
Patient Safety Requires a New Way to Publish Clinical Trials
Smith, R. W., & Roberts, I. (2006) · PLoS Clinical Trials · doi:10.1371/journal.pctr.0010006 · Cited by 32
Making raw data more widely available
Vickers, A. J. (2011) · BMJ · doi:10.1136/bmj.d2323 · Cited by 31
The effects of cognitive behavior therapy on depression in older patients with cardiovascular risk
Strachowski, D., Khaylis, A., Conrad, A., Neri, E., Spiegel, D., & Taylor, C. B. (2008) · Depression and Anxiety · doi:10.1002/da.20302 · Cited by 27
Waters, S. J., Strauman, T. J., McKee, D. C., Campbell, L. C., Shelby, R. A., Dixon, K. E., Fras, A. M., & Keefe, F. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2015.1040485 · Cited by 9
Sharing raw data: another of Francis Galton's ideas
Perneger, T. (2011) · BMJ · doi:10.1136/bmj.d3035 · Cited by 8
Follow-up of trials funded by NIH in 1979: Evidence of publication bias
Dickersin, K., Min, Y. I., & Meinert, C. L. (1991) · Controlled Clinical Trials · doi:10.1016/0197-2456(91)90115-3 · Cited by 5
Cited by
Time for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104
Self-citationMalhi, G. S., Bassett, D., Boyce, P., Bryant, R., Fitzgerald, P. B., Fritz, K., Hopwood, M., Lyndon, B., Mulder, R., Murray, G., et al. (2015) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867415617657 · Cited by 842
“The scientific literature on psychological therapies is also influenced by publication bias (increased likelihood that positive outcome studies will be published) (Driessen et al., 2015) and researcher allegiance effects (Munder et al.”
BackgroundExercise as a treatment for depression: A meta-analysis
Kvam, S., Kleppe, C. L., Nordhus, I. H., & Hovland, A. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.03.063 · Cited by 837
““file drawer problem,” where nonsignificant or negative findings are less likely to be published than positive findings (Rosenthal, 1979), may have led to an overestimation of the effect of psychological treatments and antidepressant medication for depression (Driessen et al., 2015) and this problem could also apply t…”
BackgroundKuyken, W., Warren, F. C., Taylor, R. S., Whalley, B., Crane, C., Bondolfi, G., Hayes, R., Huijbers, M., Ma, H., Schweizer, S., et al. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.0076 · Cited by 821
Malhi, G. S., Bell, E., Bassett, D., Boyce, P., Bryant, R., Hazell, P., Hopwood, M., Lyndon, B., Mulder, R., Porter, R., et al. (2021) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867420979353 · Cited by 614
“Short-term psychodynamic therapy appears to be effective in the treatment of depression, both as monotherapy (Driessen et al., 2015a, 2017) and as an adjunct to antidepressant medication (Driessen et al., 2020) and recent findings await robust replication.”
Background
Metadata
- Authors
- Driessen, E., Hollon, S. D., Bockting, C. L. H., Cuijpers, P., & Turner, E. H.
- Affiliations
- Amsterdam Public Health (NL)
- Vanderbilt University (US)
- University of Groningen (NL)
- Oregon Health & Science University (US)
- Corresponding author
- Driessen, Ellen
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-09-30
- Volume
- 10
- Issue
- 9
- Pages
- e0137864
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4589340
- OpenAlex
- W2201728466
- Cited by
- 208
- References
- 89
- Citations by year
- 2026: 9 · 2025: 8 · 2024: 14 · 2023: 16 · 2022: 18 · 2021: 14 · 2020: 16 · 2019: 23 · 2018: 27 · 2017: 30 · 2016: 28 · 2015: 5
- FWCI
- 4.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Pure Amsterdam UMC (submittedVersion, other-oa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- National Institutes of Health
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- publication bias, major depressive disorder, psychological intervention, psychotherapy efficacy, unpublished trials, selective reporting, data archiving, effect size overestimation
- MeSH terms
- Antidepressive Agents, Clinical Trials as Topic, Depressive Disorder, Major, Major Depressive Disorder, Financing, Government, Humans, National Institutes of Health (U.S.), Psychotherapy, United States, Treatment Outcome, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.