Dealing with missing outcome data in meta‐analysis
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Missing data result in less precise and possibly biased effect estimates in single studies. Bias arising from studies with incomplete outcome data is naturally propagated in a meta‐analysis. Conventional analysis using only individuals with available data is adequate when the meta‐analyst can be confident that the data are missing at random (MAR) in every study—that is, that the probability of missing data does not depend on unobserved variables, conditional on observed variables. Usually, such confidence is unjustified as participants may drop out due to lack of improvement or adverse effects. The MAR assumption cannot be tested, and a sensitivity analysis to assess how robust results are to reasonable deviations from the MAR assumption is important. Two methods may be used based on plausible alternative assumptions about the missing data. Firstly, the distribution of reasons for missing data may be used to impute the missing values. Secondly, the analyst may specify the magnitude and uncertainty of possible departures from the missing at random assumption, and these may be used to correct bias and reweight the studies. This is achieved by employing a pattern mixture model and describing how the outcome in the missing participants is related to the outcome in the completers. Ideally, this relationship is informed using expert opinion. The methods are illustrated in two examples with binary and continuous outcomes. We provide recommendations on what trial investigators and systematic reviewers should do to minimize the problem of missing outcome data in meta‐analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
Self-citationSterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Self-citationCipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541
CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165
What is meant by intention to treat analysis? Survey of published randomised controlled trials
Hollis, S., & Campbell, F. (1999) · BMJ · doi:10.1136/bmj.319.7211.670 · Cited by 2,160
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884
Higgins, J. P., Deeks, J. J., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch16 · Cited by 475 · cited 1×
“6 However, there is no consensus in the literature on how to perform ITT analysis when outcomes are missing.”
Epidemiology and reporting of randomised trials published in PubMed journals
Chan, A.-W., & Altman, D. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71879-1 · Cited by 474
Handling missing data in RCTs; a review of the top medical journals
Bell, M. L., Fiero, M., Horton, N. J., & Hsu, C.-H. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-118 · Cited by 395 · cited 1×
“For example, in 2000, only 34% of studies in PubMed reported the handling of missing data,(19) but by 2013, methods could be classified in 100% of trials in major medical journals.(16) Errors can arise through misunderstanding how data were handled.”
Savović, J., Weeks, L., Sterne, J. A., Turner, L., Altman, D. G., Moher, D., & Higgins, J. P. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-37 · Cited by 340 · cited 1×
“Participants in a focus group felt that assessing the risk of bias due to incomplete outcome data was more difficult to assess than other biases.(23) 3.”
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Impact of Covid-19 on health-related quality of life of patients: A structured review
Poudel, A. N., Zhu, S., Cooper, N., Roderick, P., Alwan, N., Tarrant, C., Ziauddeen, N., & Yao, G. L. (2021) · PLOS ONE · doi:10.1371/journal.pone.0259164 · Cited by 255
Veroniki, A. A., Hutton, B., Stevens, A., McKenzie, J. E., Page, M. J., Moher, D., McGowan, J., Straus, S. E., Li, T., Munn, Z., et al. (2025) · JBI Evidence Synthesis · doi:10.11124/jbies-24-00308 · Cited by 110
Hypnosis and the Alleviation of Clinical Pain: A Comprehensive Meta-Analysis
Milling, L. S., Valentine, K. E., LoStimolo, L. M., Nett, A. M., & McCarley, H. S. (2021) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207144.2021.1920330 · Cited by 81
“According to Mavridis and White (2020), missing data may compromise the validity of a single randomized clinical trial and thereby represent a threat to the validity of a meta-analysis, because it is often assumed the problem has been dealt with at the trial level.”
MethodKahale, L. A., Khamis, A. M., Diab, B., Chang, Y., Lopes, L. C., Agarwal, A., Li, L., Mustafa, R. A., Koujanian, S., Waziry, R., et al. (2020) · BMJ · doi:10.1136/bmj.m2898 · Cited by 33
Metadata
- Authors
- Mavridis, D., & White, I. R.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2019-06-09
- Volume
- 11
- Issue
- 1
- Pages
- 2-13
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2938677524
- Cited by
- 65
- References
- 15
- FWCI
- 4.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dealing with missing outcome data in meta‐analysis. https://app.cochat.ai/papers/10.1002/jrsm.1349
- The paper
- Mavridis, D., & White, I. R. (2020). Dealing with missing outcome data in meta‐analysis. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1349
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.