Methodological Flaws, Conflicts of Interest, and Scientific Fallacies: Implications for the Evaluation of Antidepressants’ Efficacy and Harm
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
BACKGROUND: In current psychiatric practice, antidepressants are widely and with ever-increasing frequency prescribed to patients. However, several scientific biases obfuscate estimates of antidepressants' efficacy and harm, and these are barely recognized in treatment guidelines. The aim of this mini-review is to critically evaluate the efficacy and harm of antidepressants for acute and maintenance treatment with respect to systematic biases related to industry funding and trial methodology. METHODS: Narrative review based on a comprehensive search of the literature. RESULTS: It is shown that the pooled efficacy of antidepressants is weak and below the threshold of a minimally clinically important change once publication and reporting biases are considered. Moreover, the small mean difference in symptom reductions relative to placebo is possibly attributable to observer effects in unblinded assessors and patient expectancies. With respect to trial dropout rates, a hard outcome not subjected to observer bias, no difference was observed between antidepressants and placebo. The discontinuation trials on the efficacy of antidepressants in maintenance therapy are systematically flawed, because in these studies, spontaneous remitters are excluded, whereas half of all patients who remitted on antidepressants are abruptly switched to placebo. This can cause a severe withdrawal syndrome that is easily misdiagnosed as a relapse when assessed on subjective symptom rating scales. In accordance, the findings of naturalistic long-term studies suggest that maintenance therapy has no clear benefit, and non-drug users do not show increased recurrence rates. Moreover, a growing body of evidence from hundreds of randomized controlled trials suggests that antidepressants cause suicidality, but this risk is underestimated because data from industry-funded trials are systematically flawed. Unselected, population-wide observational studies indicate that depressive patients who use antidepressants are at an increased risk of suicide and that they have a higher rate of all-cause mortality than matched controls. CONCLUSION: The strong reliance on industry-funded research results in an uncritical approval of antidepressants. Due to several flaws such as publication and reporting bias, unblinding of outcome assessors, concealment and recoding of serious adverse events, the efficacy of antidepressants is systematically overestimated, and harm is systematically underestimated. Therefore, I conclude that antidepressants are largely ineffective and potentially harmful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147 · cited 2×
“That is, the estimated efficacy of pharmaceutical products is significantly higher when the research was funded by the industry compared to non-industry funding, but this difference is not attributable to differences in the study quality (13, 14).”
BackgroundAntidepressant Drug Effects and Depression Severity: A Patient-Level Meta-analysis
Fournier, J. C., DeRubeis, R. J., Hollon, S. D., Dimidjian, S., Amsterdam, J. D., Shelton, R. C., & Fawcett, J. (2010) · JAMA · doi:10.1001/jama.2009.1943 · Cited by 2,009
Scope and Impact of Financial Conflicts of Interest in Biomedical Research: A Systematic Review
Bekelman, J. E., Li, Y., & Gross, C. P. (2003) · JAMA · doi:10.1001/jama.289.4.454 · Cited by 1,816
Industry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 1×
“Outcome reporting bias is a common scientific flaw and means that authors conceal the effect of the prespecified primary efficacy outcome and instead choose to report the most convenient from different secondary outcomes (25).”
BackgroundSuicidality in Pediatric Patients Treated With Antidepressant Drugs
Hammad, T. A., Laughren, T., & Racoosin, J. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.3.332 · Cited by 1,054
Relapse prevention with antidepressant drug treatment in depressive disorders: a systematic review
Geddes, J. R., Carney, S. M., Davies, C., Furukawa, T. A., Kupfer, D. J., Frank, E., & Goodwin, G. M. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12599-8 · Cited by 945 · cited 1×
“Meta-analyses of discontinuation trials suggest that long-term antidepressant use may prevent relapse, but only very few trials have empirically examined that effect for 2 years or more (56, 57).”
BackgroundAntidepressant use and risk of adverse outcomes in older people: population based cohort study
Coupland, C., Dhiman, P., Morriss, R., Arthur, A., Barton, G., & Hippisley-Cox, J. (2011) · BMJ · doi:10.1136/bmj.d4551 · Cited by 833 · cited 2×
“Continuation and maintenance therapy is not recommended due to an apparent lack of clear clinical benefits (54, 55, 96), coupled with a possibly increased vulnerability to chronic depression (58, 97), increased suicide risk (79, 83), and, in particular in older adults, higher all-cause mortality (86, 88, 98).”
BackgroundCarvalho, A. F., Sharma, M. S., Brunoni, A. R., Vieta, E., & Fava, G. A. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000447034 · Cited by 650
Stone, M., Laughren, T., Jones, M. L., Levenson, M., Holland, P. C., Hughes, A., Hammad, T. A., Temple, R., & Rochester, G. (2009) · BMJ · doi:10.1136/bmj.b2880 · Cited by 609 · cited 2×
“(76) was criticized, because many cases of suicidality were evidently missing in antidepressant treatment arms (50).”
BackgroundIndustry sponsorship and research outcome
Lundh, A., Sismondo, S., Lexchin, J., Busuioc, O. A., & Bero, L. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub2 · Cited by 605
The double-blind, randomized, placebo-controlled trial
Kaptchuk, T. J. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00347-4 · Cited by 595 · cited 1×
“Finally, the evidence reviewed in this article relied mostly on RCT, which are also subject to bias (34, 94).”
MethodJorm, A. F., Patten, S. B., Brugha, T. S., & Mojtabai, R. (2017) · World Psychiatry · doi:10.1002/wps.20388 · Cited by 556
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.120744 · Cited by 527 · cited 1×
“org December 2017 | Volume 8 | Article 275 unblinded outcome assessors systematically overestimate the efficacy of experimental interventions (48, 49).”
BackgroundFava, G. A., Gatti, A., Belaise, C., Guidi, J., & Offidani, E. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000370338 · Cited by 436 · cited 2×
“Research has shown that antidepressants may cause severe withdrawal symptoms after discontinuation (61, 62), which in some cases persist for months and therefore are easily misdiagnosed as depression relapse (63).”
BackgroundZimmerman, M., Mattia, J. I., & Posternak, M. A. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.3.469 · Cited by 382 · cited 2×
“Because RCT typically excludes severely impaired persons with suicidal ideation (35, 36), they run the risk to overlook a pernicious risk.”
BackgroundJakobsen, J. C., Katakam, K. K., Schou, A., Hellmuth, S. G., Stallknecht, S. E., Leth-Møller, K., Iversen, M., Banke, M. B., Petersen, I. J., Klingenberg, S. L., et al. (2017) · BMC Psychiatry · doi:10.1186/s12888-016-1173-2 · Cited by 366
Treatment of Adult Depression in the United States
Olfson, M., Blanco, C., & Marcus, S. C. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.5057 · Cited by 352 · cited 1×
“Moreover, in psychiatric outpatients, antidepressant use is higher in persons with low distress (89), whereas in primary care, most antidepressants are prescribed to persons without a psychiatric diagnosis (90).”
BackgroundEfficacy and effectiveness of antidepressants: current status of research
Pigott, H. E., Leventhal, A. M., Alter, G. S., & Boren, J. J. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000318293 · Cited by 347 · cited 5×
“Finally, according to the re-analysis of STAR*D (54), only 5.”
BackgroundMethodInfluentialMajor Depressive Disorder Treatment Guidelines in America and Europe
Davidson, J. R. T. (2010) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.9058se1c.04gry · Cited by 344
Perlis, R. H., Perlis, C. S., Wu, Y., Hwang, C., Joseph, M., & Nierenberg, A. A. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.10.1957 · Cited by 318 · cited 1×
“Thus, it is crucial to reiterate that industryfunded trials and research conducted by authors with financial COI is systematically biased toward the pharmaceutical industry’s vested interests (13, 14, 20).”
BackgroundNewer generation antidepressants for depressive disorders in children and adolescents
Hetrick, S. E., McKenzie, J. E., Cox, G. R., Simmons, M. B., & Merry, S. N. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004851.pub3 · Cited by 291
A systematic review of comparative efficacy of treatments and controls for depression
Khan, A., Faucett, J., Lichtenberg, P., Kirsch, I., & Brown, W. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0041778 · Cited by 288
Antidepressant discontinuation reactions: Are preventable and simple to treat
Haddad, P., Lejoyeux, M., & Young, A. (1998) · BMJ · doi:10.1136/bmj.316.7138.1105 · Cited by 286
Chekroud, A. M., Gueorguieva, R., Krumholz, H. M., Trivedi, M. H., Krystal, J. H., & McCarthy, G. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0025 · Cited by 276
Gibbons, R. D., Hur, K., Brown, C. H., Davis, J. M., & Mann, J. J. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.2044 · Cited by 271
Effectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials?
Ioannidis, J. P. (2008) · Philosophy, Ethics, and Humanities in Medicine · doi:10.1186/1747-5341-3-14 · Cited by 253
Wisniewski, S. R., Rush, A. J., Nierenberg, A. A., Gaynes, B. N., Warden, D., Luther, J. F., McGrath, P. J., Lavori, P. W., Thase, M. E., Fava, M., et al. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08071027 · Cited by 223 · cited 3×
“Included participants are less impaired and have a higher level of functioning (36, 37), and it has been demonstrated that they respond better to antidepressants than the average real-world patient (36).”
BackgroundFurukawa, T. A., Cipriani, A., Atkinson, L. Z., Leucht, S., Ogawa, Y., Takeshima, N., Hayasaka, Y., Chaimani, A., & Salanti, G. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30307-8 · Cited by 219 · cited 1×
“A recent meta-analysis has clearly shown that the placebo response rate has been stable for almost 30 years now (95).”
Sim, K., Lau, W. K., Sim, J., Sum, M. Y., & Baldessarini, R. J. (2016) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyv076 · Cited by 218 · cited 2×
“Meta-analyses of discontinuation trials suggest that long-term antidepressant use may prevent relapse, but only very few trials have empirically examined that effect for 2 years or more (56, 57).”
BackgroundResultGartlehner, G., Wagner, G., Matyas, N., Titscher, V., Greimel, J., Lux, L., Gaynes, B. N., Viswanathan, M., Patel, S., & Lohr, K. N. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014912 · Cited by 192
Biesheuvel-Leliefeld, K. E. M., Kok, G. D., Bockting, C. L. H., Cuijpers, P., Hollon, S. D., van Marwijk, H. W. J., & Smit, F. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.016 · Cited by 175
Zimmerman, M., Chelminski, I., & Posternak, M. A. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.7.1370 · Cited by 144
Illness risk following rapid versus gradual discontinuation of antidepressants
Baldessarini, R. J., Tondo, L., Ghiani, C., & Lepri, B. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09060880 · Cited by 123 · cited 1×
“In support of this notion, it has been shown that rapid discontinuation of antidepressants, relative to gradual tapering, prospectively increases the risk of depression reoccurrence (64), but note that even very slow tapering may cause severe mood disturbances (61, 63).”
BackgroundContinuation and Maintenance Use of Antidepressants in Recurrent Depression
Bockting, C. L. H., ten Doesschate, M. C., Spijker, J., Spinhoven, P., Koeter, M. W. J., & Schene, A. H. (2008) · Psychotherapy and Psychosomatics · doi:10.1159/000110056 · Cited by 121
Ebrahim, S., Bance, S., Athale, A., Malachowski, C., & Ioannidis, J. P. A. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.021 · Cited by 107 · cited 1×
“Also, harms and serious adverse events of antidepressants are often not reported, and such concealment is strongly related to authors’ financial COI and industry funding (26).”
BackgroundMaslej, M. M., Bolker, B. M., Russell, M. J., Eaton, K., Durisko, Z., Hollon, S. D., Swanson, G. M., Thomson Jr., J. A., Mulsant, B. H., & Andrews, P. W. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000477940 · Cited by 98 · cited 2×
“Continuation and maintenance therapy is not recommended due to an apparent lack of clear clinical benefits (54, 55, 96), coupled with a possibly increased vulnerability to chronic depression (58, 97), increased suicide risk (79, 83), and, in particular in older adults, higher all-cause mortality (86, 88, 98).”
BackgroundRational Use of Antidepressant Drugs
Fava, G. A. (2014) · Psychotherapy and Psychosomatics · doi:10.1159/000362803 · Cited by 95
Fava, G. A., Bernardi, M., Tomba, E., & Rafanelli, C. (2007) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145706007462 · Cited by 80
A systematic review of long-term studies of drug treated and non-drug treated depression
Hughes, S., & Cohen, D. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.01.027 · Cited by 71 · cited 1×
“A systematic review of observational long-term studies found that maintenance therapy conveys no clear benefits: antidepressant users had no better long-term outcome than non-users (69).”
BackgroundChen, J. A., Papakostas, G. I., Youn, S. J., Baer, L., Clain, A. J., Fava, M., & Mischoulon, D. (2011) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.10m06453 · Cited by 56 · cited 1×
“(47) re-analyzed a double-blind RCT with the treatment arms antidepressant (sertraline), St John’s Wort, and placebo, with respect to patients’ treatment beliefs.”
MethodGardarsdottir, H., Egberts, T. C., Stolker, J. J., & Heerdink, E. R. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp142 · Cited by 47
Cited by
Munkholm, K., Paludan-Müller, A. S., & Boesen, K. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024886 · Cited by 151
Depressive disorders: treatment failures and poor prognosis over the last 50 years
Blackburn, T. P. (2019) · Pharmacology Research & Perspectives · doi:10.1002/prp2.472 · Cited by 136
Van Leeuwen, E., van Driel, M. L., Horowitz, M. A., Kendrick, T., Donald, M., De Sutter, A. I., Robertson, L., & Christiaens, T. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013495.pub2 · Cited by 90
Guy, A., Brown, M., Lewis, S., & Horowitz, M. (2020) · Therapeutic Advances in Psychopharmacology · doi:10.1177/2045125320967183 · Cited by 77
Hengartner, M. P., Schulthess, L., Sorensen, A., & Framer, A. (2020) · Therapeutic Advances in Psychopharmacology · doi:10.1177/2045125320980573 · Cited by 74
Self-citation
Metadata
- Authors
- Hengartner, M. P.
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2017-12-07
- Volume
- 8
- Pages
- 275-275
- ISSN
- 1664-0640 (ISSN-L)
- OpenAlex
- W2771327817
- Cited by
- 52
- References
- 45
- FWCI
- 3.76
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.