Evaluating the impact of imputations for missing participant outcome data in a network meta-analysis
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Background: In a meta-analysis of trials with missing outcome data, a parameter known as informative missing odds ratio (IMOR) can be used to quantify the relationship between informative missingness and a binary outcome. IMORs also account for the increased uncertainty due to missingness in the meta-analysis results. Purpose: To extend the idea of IMOR into a network meta-analysis (NMA) setting in order to explore the impact of missing outcome data on the inferences about the relative effectiveness of several competing treatments in psychiatric trials. Methods: IMORs were estimated in two datasets comparing anti-manic treatments and antidepressants. The outcome was response to treatments. In the original meta-analyses, missing participants were assumed to have failed regardless the treatment they were allocated to. To evaluate the robustness of this assumption in each dataset, several imputations of the missing outcomes were studied by an IMOR parameter in the NMA model. By comparing the odds ratios for efficacy under the initial analysis and under several assumptions about the missingness, we assessed the consistency of the conclusions. The missing data mechanism was studied by comparing the prior with the posterior IMOR distribution. Models were fitted using Markov chain Monte Carlo (MCMC) in WinBUGS. Results: In both datasets, the relative effectiveness of the treatments seems to be affected only by the two extreme imputation scenarios of worst- and best-case analyses. Moreover, heterogeneity increases in both datasets under these two extreme scenarios. Overall, there is a non-significant change on the ranking of the anti-manic and antidepressant treatments. The posterior and prior IMOR distributions are very similar showing that the data do not provide any information about the true outcome in missing participants. There is a very weak indication that missing participants tend to fail in placebo and paroxetine, while the opposite occurs for sertraline, fluoxetine, and fluvoxamine. Limitations: Investigation of informative missingness was limited two classes of treatments and for dichotomous outcome measures. The proportion of missing outcomes was very low overall, and hence, the power of detecting any differences in effectiveness estimated under the various imputation methods is small. Conclusions: Sensitivity analysis to account for missing outcome data and their uncertainty in the NMA can be undertaken by extending the idea of IMOR. In two case examples, we found no differences between the various models due to low missing data rate. In line with previous observations, data carry little information about the reason of missingness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766
Self-citationCipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
Self-citationEvaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Self-citationAttrition in randomized controlled clinical trials: methodological issues in psychopharmacology
Leon, A. C., Mallinckrodt, C. H., Chuang-Stein, C., Archibald, D. G., Archer, G. E., & Chartier, K. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.10.020 · Cited by 303 · cited 1×
“The issue of missing outcome data is particularly pertinent to psychiatric trials [10].”
BackgroundNuesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W. S., Burgi, E., Scherer, M., Altman, D. G., & Juni, P. (2009) · BMJ · doi:10.1136/bmj.b3244 · Cited by 248 · cited 1×
“Informative missing outcome data can lead to biased meta-analysis estimates as well as to high heterogeneity [1,2].”
BackgroundInvestigating patient exclusion bias in meta-analysis
Tierney, J. F. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh300 · Cited by 221
Is the superior efficacy of new generation antipsychotics an artifact of LOCF?
Leucht, S., Engel, R. R., Bauml, J., & Davis, J. M. (2006) · Schizophrenia Bulletin · doi:10.1093/schbul/sbl025 · Cited by 193
Cited by
GetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
“…2011), Saramago et al. (2012), Schmid et al. (2013), Schmidli et al. (2013), Schmitz et al. (2012, 2013), Soares et al. (2014), Song et al. (2012), Spineli et al. (2013), Sturtz and Bender (2012), Thorlund et al. (2013, 2014), Thorlund and Mills (2012a), Trinquart et al. (2012a, 2012b), Tu and…”
Self-citationAssessing key assumptions of network meta‐analysis: a review of methods
Donegan, S., Williamson, P., D'Alessandro, U., & Tudur Smith, C. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1085 · Cited by 267
Furukawa, T. A., Cipriani, A., Atkinson, L. Z., Leucht, S., Ogawa, Y., Takeshima, N., Hayasaka, Y., Chaimani, A., & Salanti, G. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30307-8 · Cited by 219
Self-citationFurukawa, T. A., Salanti, G., Atkinson, L. Z., Leucht, S., Ruhe, H. G., Turner, E. H., Chaimani, A., Ogawa, Y., Takeshima, N., Hayasaka, Y., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010919 · Cited by 214
Self-citationPompoli, A., Furukawa, T. A., Imai, H., Tajika, A., Efthimiou, O., & Salanti, G. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011004.pub2 · Cited by 142
Self-citation
Metadata
- Authors
- Spineli, L. M., Higgins, J. P., Cipriani, A., Leucht, S., & Salanti, G.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2013-01-15
- Volume
- 10
- Issue
- 3
- Pages
- 378-388
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2112120659
- Cited by
- 49
- References
- 7
- FWCI
- 5.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating the impact of imputations for missing participant outcome data in a network meta-analysis. https://app.cochat.ai/papers/10.1177/1740774512470317
- The paper
- Spineli, L. M., Higgins, J. P., Cipriani, A., Leucht, S., & Salanti, G. (2013). Evaluating the impact of imputations for missing participant outcome data in a network meta-analysis. Clinical Trials. https://doi.org/10.1177/1740774512470317
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.