Considering the methodological limitations in the evidence base of antidepressants for depression: a reanalysis of a network meta-analysis
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Objectives: To investigate whether the conclusion of a recent systematic review and network meta-analysis (Cipriani et al) that antidepressants are more efficacious than placebo for adult depression was supported by the evidence. Design: Reanalysis of a systematic review, with meta-analyses. Data sources: 522 trials (116 477 participants) as reported in the systematic review by Cipriani et al and clinical study reports for 19 of these trials. Analysis: We used the Cochrane Handbook’s risk of bias tool and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to evaluate the risk of bias and the certainty of evidence, respectively. The impact of several study characteristics and publication status was estimated using pairwise subgroup meta-analyses. Results: Several methodological limitations in the evidence base of antidepressants were either unrecognised or underestimated in the systematic review by Cipriani et al. The effect size for antidepressants versus placebo on investigator-rated depression symptom scales was higher in trials with a ‘placebo run-in’ study design compared with trials without a placebo run-in design (p=0.05). The effect size of antidepressants was higher in published trials compared with unpublished trials (p<0.0001). The outcome data reported by Cipriani et al differed from the clinical study reports in 12 (63%) of 19 trials. The certainty of the evidence for the placebo-controlled comparisons should be very low according to GRADE due to a high risk of bias, indirectness of the evidence and publication bias. The mean difference between antidepressants and placebo on the 17-item Hamilton depression rating scale (range 0–52 points) was 1.97 points (95% CI 1.74 to 2.21). Conclusions: The evidence does not support definitive conclusions regarding the benefits of antidepressants for depression in adults. It is unclear whether antidepressants are more efficacious than placebo.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies without active placebo are considered to be at unclear or high risk of performance bias (Munkholm 2019).”
From Approaches for discontinuation versus continuation of long-term antidepressant use for depressive and anxiety disorders in adults (2021) · cites this paper as Munkholm 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The efficacy of antidepressant treatment for depression is modest compared with placebo [2, 3]”
From The relationship between dose and serotonin transporter occupancy of antidepressants—a systematic review (2022) · cites this paper as [2]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541 · cited 10×
“They classified the trials as low risk of bias if none of the domains assessed were rated as high risk of bias and three or less were rated as unclear risk; moderate if one domain was rated as high risk of bias or none were rated as high risk of bias but four or more were rated as unclear risk; and all other cases wer…”
InfluentialThe cost of dichotomising continuous variables
Altman, D. G., & Royston, P. (2006) · BMJ · doi:10.1136/bmj.332.7549.1080 · Cited by 2,688
Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435 · cited 2×
“antidepressant trials remain unpublished or are inadequately reported.(9) Cipriani et al(5) included 436 published and 86 unpublished studies, but as many as a thousand antidepressant studies may have been conducted.”
BackgroundIntHout, J., Ioannidis, J. P., & Borm, G. F. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-25 · Cited by 2,419 · cited 1×
“For the comparisons between antidepressants and placebo on rating scales, we used the Hartung-Knapp-SidikJonkman approach because it results in fewer type I errors than the DerSimonian and Laird approach.(16) We based our analyses on the number of participants from Cipriani et al’s ‘efficacy’ analyses.”
MethodAntidepressant Drug Effects and Depression Severity: A Patient-Level Meta-analysis
Fournier, J. C., DeRubeis, R. J., Hollon, S. D., Dimidjian, S., Amsterdam, J. D., Shelton, R. C., & Fawcett, J. (2010) · JAMA · doi:10.1001/jama.2009.1943 · Cited by 2,009
Yatham, L. N., Kennedy, S. H., Parikh, S. V., Schaffer, A., Bond, D. J., Frey, B. N., Sharma, V., Goldstein, B. I., Rej, S., Beaulieu, S., et al. (2018) · Bipolar Disorders · doi:10.1111/bdi.12609 · Cited by 1,852
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
GRADE guidelines: 8. Rating the quality of evidence—indirectness
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Falck-Ytter, Y., Jaeschke, R., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.04.014 · Cited by 1,843 · cited 1×
“Downgrading due to the indirectness of the network meta-analysis’ methodology should also be considered.(38) Taken together, the certainty of evidence should be ‘very low’.”
BackgroundIndustry sponsorship and research outcome
Lundh, A., Lexchin, J., Mintzes, B., Schroll, J. B., & Bero, L. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000033.pub3 · Cited by 1,697 · cited 1×
“Some argue that ‘vested interests’ should also be considered, since industry sponsored drug studies lead to more favourable effects than other studies by mechanisms that are not explained by the usual bias domains.(26) We explored whether industry sponsorship was associated with larger effect estimates, by performing…”
Research works printed but not linked: 1
- Sharma T . Effects of selective serotonin reuptake inhibitors (SSRIs) and serotonin - norepinephrine reuptake inhibitors (SNRIs) on suicidality, violence, and quality of life (PhD Thesis): University of Copenhagen, 2018.
Cited by
Leichsenring, F., Steinert, C., Rabung, S., & Ioannidis, J. P. A. (2022) · World Psychiatry · doi:10.1002/wps.20941 · Cited by 485
von Rotz, R., Schindowski, E. M., Jungwirth, J., Schuldt, A., Rieser, N. M., Zahoranszky, K., Seifritz, E., Nowak, A., Nowak, P., Jäncke, L., et al. (2023) · eClinicalMedicine · doi:10.1016/j.eclinm.2022.101809 · Cited by 354
Galvão-Coelho, N. L., Marx, W., Gonzalez, M., Sinclair, J., de Manincor, M., Perkins, D., & Sarris, J. (2021) · Psychopharmacology · doi:10.1007/s00213-020-05719-1 · Cited by 137
O’Connor, E., Perdue, L. A., Coppola, E. L., Henninger, M. L., Thomas, R. G., & Gaynes, B. N. (2023) · JAMA · doi:10.1001/jama.2023.7787 · Cited by 126
Hengartner, M. P., & Plöderl, M. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111600 · Cited by 114
Metadata
- Authors
- Munkholm, K., Paludan-Müller, A. S., & Boesen, K.
- Affiliations
- Rigshospitalet (DK)
- Corresponding author
- Munkholm, Klaus
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2019-06
- Volume
- 9
- Issue
- 6
- Pages
- e024886
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC6597641
- OpenAlex
- W2954134279
- Semantic Scholar
- 1f02503fe1b4290d23f35fdcf0ce927d794271ed
- Cited by
- 151
- References
- 43
- Citations by year
- 2026: 13 · 2025: 15 · 2024: 17 · 2023: 31 · 2022: 20 · 2021: 29 · 2020: 15 · 2019: 11
- FWCI
- 3.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- BMJ Open (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Nordic Cochrane Centre
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- antidepressants, depression, placebo response, risk of bias, publication bias, clinical study reports, quality of evidence, Hamilton Depression Rating Scale, antidepressant efficacy
- MeSH terms
- Network Meta-Analysis, Network Meta-Analysis as Topic, Systematic Reviews as Topic, Adult, Antidepressive Agents, Depression, Humans, Meta-Analysis as Topic, Bias, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Considering the methodological limitations in the evidence base of antidepressants for depression: a reanalysis of a network meta-analysis. https://app.cochat.ai/papers/10.1136/bmjopen-2018-024886
- The paper
- Munkholm, K., Paludan-Müller, A. S., & Boesen, K. (2019). Considering the methodological limitations in the evidence base of antidepressants for depression: a reanalysis of a network meta-analysis. BMJ Open. https://doi.org/10.1136/bmjopen-2018-024886
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.