Statistically Significant Antidepressant-Placebo Differences on Subjective Symptom-Rating Scales Do Not Prove That the Drugs Work: Effect Size and Method Bias Matter!
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Following the publication of a recent meta-analysis by Cipriani et al. (1), various opinion leaders and news reports claimed that the effectiveness of antidepressants has been definitely proven (2).E.g., Dr. Pariante, spokesperson for the Royal College of Psychiatrists, stated that this study "finally puts to bed the controversy on antidepressants, clearly showing that these drugs do work in lifting mood and helping most people with depression" (https://www.theguardian.com/ science/2018/feb/21/the-drugs-do-work-antidepressants-are-effective-study-shows).We surely would embrace drug treatments that effectively help most people with depression, but based on work that has contested the validity of mostly industry-sponsored antidepressant trials (3-6) we remain skeptical about antidepressants' clinical benefits.The most recent meta-analysis indeed concludes that antidepressants are more effective than placebo but also acknowledges that risk of bias was substantial and that the mean effect size of d = 0.3 was modest (1).Unfortunately, no clarification is given what this effect size means and whether it can be expected to be clinically significant in real-world routine practice.In this opinion paper we therefore ponder over how the reported effect size of d = 0.3 relates to clinical significance and how method bias undermines its validity, in order that the public, clinicians, and patients can judge for themselves whether antidepressants clearly work in most people with depression.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490 · cited 1×
“A statistically significant result neither proves that the null hypothesis is false nor that the alternative hypothesis is true (8, 9, 11).”
BackgroundSelective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
The Hamilton Depression Rating Scale: Has the Gold Standard Become a Lead Weight?
Bagby, R. M., Ryder, A. G., Schuller, D. R., & Marshall, M. B. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.12.2163 · Cited by 1,148
Antidepressant use and risk of adverse outcomes in older people: population based cohort study
Coupland, C., Dhiman, P., Morriss, R., Arthur, A., Barton, G., & Hippisley-Cox, J. (2011) · BMJ · doi:10.1136/bmj.d4551 · Cited by 833
Carvalho, A. F., Sharma, M. S., Brunoni, A. R., Vieta, E., & Fava, G. A. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000447034 · Cited by 650
Stone, M., Laughren, T., Jones, M. L., Levenson, M., Holland, P. C., Hughes, A., Hammad, T. A., Temple, R., & Rochester, G. (2009) · BMJ · doi:10.1136/bmj.b2880 · Cited by 609
Cited by
Leichsenring, F., Steinert, C., Rabung, S., & Ioannidis, J. P. A. (2022) · World Psychiatry · doi:10.1002/wps.20941 · Cited by 485
Doss, M. K., Považan, M., Rosenberg, M. D., Sepeda, N. D., Davis, A. K., Finan, P. H., Smith, G. S., Pekar, J. J., Barker, P. B., Griffiths, R. R., et al. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01706-y · Cited by 356
Almeida, R. N. D., Galvão, A. C. D. M., da Silva, F. S., Silva, E. A. D. S., Palhano-Fontes, F., Maia-de-Oliveira, J. P., de Araújo, L.-S. B., Lobão-Soares, B., & Galvão-Coelho, N. L. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01234 · Cited by 177
Galvão-Coelho, N. L., Marx, W., Gonzalez, M., Sinclair, J., de Manincor, M., Perkins, D., & Sarris, J. (2021) · Psychopharmacology · doi:10.1007/s00213-020-05719-1 · Cited by 137
Changes in inflammatory biomarkers are related to the antidepressant effects of Ayahuasca
Galvão-Coelho, N. L., de Menezes Galvão, A. C., de Almeida, R. N., Palhano-Fontes, F., Campos Braga, I., Lobão Soares, B., Maia-de-Oliveira, J. P., Perkins, D., Sarris, J., & de Araujo, D. B. (2020) · Journal of Psychopharmacology · doi:10.1177/0269881120936486 · Cited by 128
Hengartner, M. P., & Plöderl, M. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111600 · Cited by 114
Self-citationZeifman, R. J., Wagner, A. C., Watts, R., Kettner, H., Mertens, L. J., & Carhart-Harris, R. L. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00782 · Cited by 106
Marsden, J., White, M., Annand, F., Burkinshaw, P., Carville, S., Eastwood, B., Kelleher, M., Knight, J., O'Connor, R., Tran, A., et al. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30331-1 · Cited by 106
Selective Serotonin Reuptake Inhibitor-Induced Sexual Dysfunction: Current Management Perspectives
Atmaca, M. (2020) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s185757 · Cited by 89
Assessing expectancy and suggestibility in a trial of escitalopram v. psilocybin for depression
Szigeti, B., Weiss, B., Rosas, F. E., Erritzoe, D., Nutt, D., & Carhart-Harris, R. (2024) · Psychological Medicine · doi:10.1017/s0033291723003653 · Cited by 89
Hengartner, M. P. (2020) · Therapeutic Advances in Psychopharmacology · doi:10.1177/2045125320921694 · Cited by 72
Self-citationBiological principles for music and mental health
Bowling, D. L. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02671-4 · Cited by 64
Metadata
- Authors
- Hengartner, M. P., & Plöderl, M.
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2018-10-17
- Volume
- 9
- Pages
- 517-517
- ISSN
- 1664-0640 (ISSN-L)
- OpenAlex
- W2894886297
- Cited by
- 93
- References
- 27
- FWCI
- 5.82
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.