Impact of Reporting Bias in Network Meta-Analysis of Antidepressant Placebo-Controlled Trials
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Indirect comparisons of competing treatments by network meta-analysis (NMA) are increasingly in use. Reporting bias has received little attention in this context. We aimed to assess the impact of such bias in NMAs. METHODS: We used data from 74 FDA-registered placebo-controlled trials of 12 antidepressants and their 51 matching publications. For each dataset, NMA was used to estimate the effect sizes for 66 possible pair-wise comparisons of these drugs, the probabilities of being the best drug and ranking the drugs. To assess the impact of reporting bias, we compared the NMA results for the 51 published trials and those for the 74 FDA-registered trials. To assess how reporting bias affecting only one drug may affect the ranking of all drugs, we performed 12 different NMAs for hypothetical analysis. For each of these NMAs, we used published data for one drug and FDA data for the 11 other drugs. FINDINGS: Pair-wise effect sizes for drugs derived from the NMA of published data and those from the NMA of FDA data differed in absolute value by at least 100% in 30 of 66 pair-wise comparisons (45%). Depending on the dataset used, the top 3 agents differed, in composition and order. When reporting bias hypothetically affected only one drug, the affected drug ranked first in 5 of the 12 NMAs but second (n = 2), fourth (n = 1) or eighth (n = 2) in the NMA of the complete FDA network. CONCLUSIONS: In this particular network, reporting bias biased NMA-based estimates of treatments efficacy and modified ranking. The reporting bias effect in NMAs may differ from that in classical meta-analyses in that reporting bias affecting only one drug may affect the ranking of all drugs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147 · cited 1×
“The direction of bias in estimating treatment effect because of reporting bias is uncertain in head-to-head trials: the sponsored treatment could be favored [5,42] or the newest treatment could be favored [43,44] and disentangling the sources of bias operating on direct and indirect evidence would be difficult.”
BackgroundCipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 1×
“An NMA, or mixed-treatment comparison meta-analysis, allows for the simultaneous analysis of multiple competing interventions by pooling direct and indirect comparisons [7,8].”
MethodEvaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
The appropriateness of asymmetry tests for publication bias in meta-analyses: A large survey
Ioannidis, J. P. A., & Trikalinos, T. A. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.060410 · Cited by 1,052 · cited 1×
“However, the number of trials addressing each pair-wise comparison may often be limited, which would prevent this approach from documenting or excluding reporting bias appropriately [30,31].”
BackgroundDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 1×
“Reporting bias is a major threat to the validity of results of conventional systematic reviews or meta-analyses [13–17].”
BackgroundPublication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898 · cited 1×
“Reporting bias is a major threat to the validity of results of conventional systematic reviews or meta-analyses [13–17].”
BackgroundRising, K., Bacchetti, P., & Bero, L. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050217 · Cited by 328
Research works printed but not linked: 28
- K Dickersin, 2010, Health-care policy. To reform U.S. health care, start with systematic reviews., Science, 329, 516, 10.1126/science.1189330 · DOI
- KG Volpp, 2009, Comparative effectiveness–thinking beyond medication A versus medication B., N Engl J Med, 361, 331, 10.1056/NEJMp0903496 · DOI · Paper page
- M Hochman, 2010, Characteristics of published comparative effectiveness studies of medications., JAMA, 303, 951, 10.1001/jama.2010.240 · DOI · Paper page
- DN Lathyris, 2010, Industry sponsorship and selection of comparators in randomized clinical trials., Eur J Clin Invest, 40, 172, 10.1111/j.1365-2362.2009.02240.x · DOI · Paper page
- C Estellat, 2012, Lack of Head-to-head Trials and Fair Control Arms: Randomized Controlled Trials of Biologic Treatment for Rheumatoid Arthritis., Arch Intern Med, 172, 237, 10.1001/archinternmed.2011.1209 · DOI · Paper page
- G Lu, 2004, Combination of direct and indirect evidence in mixed treatment comparisons., Stat Med, 23, 3105, 10.1002/sim.1875 · DOI · Paper page
- AM Glenny, 2005, Indirect comparisons of competing interventions., Health Technol Assess, 9, 1, 10.3310/hta9260 · DOI · Paper page
- F Song, 2009, Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews., BMJ, 338, b1147, 10.1136/bmj.b1147 · DOI · Paper page
- DM Kent, 2008, Stroke prevention–insights from incoherence., N Engl J Med, 359, 1287, 10.1056/NEJMe0806806 · DOI
- RS Stafford, 2009, New, but not improved? Incorporating comparative-effectiveness information into FDA labeling., N Engl J Med, 361, 1230, 10.1056/NEJMp0906490 · DOI
- D Eyding, 2010, Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials., BMJ, 341, c4737, 10.1136/bmj.c4737 · DOI · Paper page
- SS Vedula, 2009, Outcome reporting in industry-sponsored trials of gabapentin for off-label use., N Engl J Med, 361, 1963, 10.1056/NEJMsa0906126 · DOI · Paper page
- JP Higgins, 1996, Borrowing strength from external trials in a meta-analysis., Stat Med, 15, 2733, 10.1002/(SICI)1097-0258(19961230)15:24<2733::AID-SIM562>3.0.CO;2-0 · DOI · Paper page
- NJ Welton, 2009, Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease., Am J Epidemiol, 169, 1158, 10.1093/aje/kwp014 · DOI · Paper page
- G Salanti, 2009, A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered., J Clin Epidemiol, 62, 857, 10.1016/j.jclinepi.2008.10.001 · DOI · Paper page
- E Turner, 2005, Correction/Clarification about FDA Review Documents., PLoS Med, 2, e422, 10.1371/journal.pmed.0020422 · doi:10.1371/journal.pmed.0020422
- JA Sterne, 2011, Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials., BMJ, 343, d4002, 10.1136/bmj.d4002 · DOI · Paper page
- SG Moreno, 2011, Adjusting for publication biases across similar interventions performed well when compared with gold standard data., J Clin Epidemiol, 64, 1230, 10.1016/j.jclinepi.2011.01.009 · DOI
- CD DeAngelis, 2010, Ensuring integrity in industry-sponsored research: primum non nocere, revisited., JAMA, 303, 1196, 10.1001/jama.2010.337 · DOI
- DA Zarin, 2008, Medicine. Moving toward transparency of clinical trials., Science, 319, 1340, 10.1126/science.1153632 · DOI · Paper page
- AB O'Connor, 2009, The Need for Improved Access to FDA Reviews., JAMA: The Journal of the American Medical Association, 302, 191, 10.1001/jama.2009.973 · DOI
- S Donegan, 2010, Indirect comparisons: a review of reporting and methodological quality., PLoS One, 5, e11054, 10.1371/journal.pone.0011054 · DOI · Paper page
- C O'Regan, 2009, Incorporating multiple interventions in meta-analysis: an evaluation of the mixed treatment comparison with the adjusted indirect comparison., Trials, 10, 86, 10.1186/1745-6215-10-86 · DOI · Paper page
- G Salanti, 2008, Exploring the geometry of treatment networks., Ann Intern Med, 148, 544, 10.7326/0003-4819-148-7-200804010-00011 · DOI · Paper page
- G Gartlehner, 2008, Comparative benefits and harms of second-generation antidepressants: background paper for the American College of Physicians., Ann Intern Med, 149, 734, 10.7326/0003-4819-149-10-200811180-00008 · DOI · Paper page
- I Chalmers, 2006, What are the implications of optimism bias in clinical research?, Lancet, 367, 449, 10.1016/S0140-6736(06)68153-1 · DOI
- EH Turner, 2004, A taxpayer-funded clinical trials registry and results database., PLoS Med, 1, e60, 10.1371/journal.pmed.0010060 · DOI · Paper page
- JD Miller, 2010, Registering Clinical Trial Results., JAMA: The Journal of the American Medical Association, 303, 773, 10.1001/jama.2010.207 · DOI
Cited by
GetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
“A similar model was also presented by Trinquart et al. (2012b).”
BackgroundMethodInfluentialAssessing key assumptions of network meta‐analysis: a review of methods
Donegan, S., Williamson, P., D'Alessandro, U., & Tudur Smith, C. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1085 · Cited by 267
Reporting of results from network meta-analyses: methodological systematic review
Bafeta, A., Trinquart, L., Seror, R., & Ravaud, P. (2014) · BMJ · doi:10.1136/bmj.g1741 · Cited by 220
“28 Thirdly, readers should be able to assess whether similar but not identical interventions were grouped, which may weaken the interpretability of a network meta-analysis.”
BackgroundSelf-citationFurukawa, T. A., Salanti, G., Atkinson, L. Z., Leucht, S., Ruhe, H. G., Turner, E. H., Chaimani, A., Ogawa, Y., Takeshima, N., Hayasaka, Y., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010919 · Cited by 214
Oliva, V., Lippi, M., Paci, R., Del Fabro, L., Delvecchio, G., Brambilla, P., De Ronchi, D., Fanelli, G., & Serretti, A. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110266 · Cited by 219
Metadata
- Authors
- Trinquart, L., Abbé, A., & Ravaud, P.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-04-20
- Volume
- 7
- Issue
- 4
- Pages
- e35219
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2038645302
- Cited by
- 54
- References
- 16
- FWCI
- 2.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Impact of Reporting Bias in Network Meta-Analysis of Antidepressant Placebo-Controlled Trials. https://app.cochat.ai/papers/10.1371/journal.pone.0035219
- The paper
- Trinquart, L., Abbé, A., & Ravaud, P. (2012). Impact of Reporting Bias in Network Meta-Analysis of Antidepressant Placebo-Controlled Trials. PLoS ONE. https://doi.org/10.1371/journal.pone.0035219
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.