Missing Data in Clinical Studies: Issues and Methods
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Missing data are a prevailing problem in any type of data analyses. A participant variable is considered missing if the value of the variable (outcome or covariate) for the participant is not observed. In this article, various issues in analyzing studies with missing data are discussed. Particularly, we focus on missing response and/or covariate data for studies with discrete, continuous, or time-to-event end points in which generalized linear models, models for longitudinal data such as generalized linear mixed effects models, or Cox regression models are used. We discuss various classifications of missing data that may arise in a study and demonstrate in several situations that the commonly used method of throwing out all participants with any missing data may lead to incorrect results and conclusions. The methods described are applied to data from an Eastern Cooperative Oncology Group phase II clinical trial of liver cancer and a phase III clinical trial of advanced non–small-cell lung cancer. Although the main area of application discussed here is cancer, the issues and methods we discuss apply to any type of study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Linear Mixed Models for Longitudinal Data
Verbeke, G. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2294-1_3 · Cited by 3,506
Adjusting for partially missing baseline measurements in randomized trials
White, I. R., & Thompson, S. G. (2005) · Statistics in Medicine · doi:10.1002/sim.1981 · Cited by 378
Cited by
A Primer on Effectiveness and Efficacy Trials
Singal, A. G., Higgins, P. D. R., & Waljee, A. K. (2014) · Clinical and Translational Gastroenterology · doi:10.1038/ctg.2013.13 · Cited by 698
Li, J., Chen, Z., Tian, L., Zhou, C., He, M. Y., Gao, Y., Wang, S., Zhou, F., Shi, S., Feng, X., et al. (2014) · Gut · doi:10.1136/gutjnl-2013-305806 · Cited by 438
Handling missing data in RCTs; a review of the top medical journals
Bell, M. L., Fiero, M., Horton, N. J., & Hsu, C.-H. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-118 · Cited by 395
“Guidelines for handling missing data have been published in journals such as the Journal of Clinical Oncology [15], the BMJ [4,16,17] and the New England Journal of Medicine [18].”
MethodPrognosis of hepatocellular carcinoma: Assessment of eleven staging systems
Liu, P.-H., Hsu, C.-Y., Hsia, C.-Y., Lee, Y.-H., Su, C.-W., Huang, Y.-H., Lee, F.-Y., Lin, H.-C., & Huo, T.-I. (2016) · Journal of Hepatology · doi:10.1016/j.jhep.2015.10.029 · Cited by 263
Analysis of randomised trials with long-term follow-up
Herbert, R. D., Kasza, J., & Bø, K. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0499-5 · Cited by 80
Missing data in clinical trials: Pitfalls and remedies
Kaushal, S. (2014) · International Journal of Applied and Basic Medical Research · doi:10.4103/2229-516x.140707 · Cited by 13
“These include maximum likelihood method (large class of model based procedures arising from defining a model for the variable with missing values and making statistical inferences based on maximum likelihood, helps to obtain standard errors also), multiple imputation (creating multiple complete data sets by filling in…”
MethodDeep learning with robustness to missing data: A novel approach to the detection of COVID-19
Çallı, E., Murphy, K., Kurstjens, S., Samson, T., Herpers, R., Smits, H., Rutten, M., & van Ginneken, B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0255301 · Cited by 6
“Missing data is an issue in the medical domain, as in many others [22].”
Background
Metadata
- Authors
- Ibrahim, J. G., Chu, H., & Chen, M.-H.
- Venue
- Journal of Clinical Oncology
- Published
- 2012-09-10
- Volume
- 30
- Issue
- 26
- Pages
- 3297-3303
- ISSN
- 0732-183X (ISSN-L)
- 1527-7755
- OpenAlex
- W2125677766
- Cited by
- 201
- References
- 5
- FWCI
- 9.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.