Missing data methods in longitudinal studies: a review
Open accessThe DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Abstract
Incomplete data are quite common in biomedical and other types of research, especially in longitudinal studies. During the last three decades, a vast amount of work has been done in the area. This has led, on the one hand, to a rich taxonomy of missing-data concepts, issues, and methods and, on the other hand, to a variety of data-analytic tools. Elements of taxonomy include: missing data patterns, mechanisms, and modeling frameworks; inferential paradigms; and sensitivity analysis frameworks. These are described in detail. A variety of concrete modeling devices is presented. To make matters concrete, two case studies are considered. The first one concerns quality of life among breast cancer patients, while the second one examines data from the Muscatine children’s obesity study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Longitudinal Data Analysis for Discrete and Continuous Outcomes
Zeger, S. L., & Liang, K.-Y. (1986) · Biometrics · doi:10.2307/2531248 · Cited by 7,764
(2001) · Statistics for Psychologists · doi:10.4324/9781410605542-11 · Cited by 6,877
Fitzmaurice, G. M., Laird, N. M., & Ware, J. H. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781119513469 · Cited by 4,639
Approximate Inference in Generalized Linear Mixed Models
Breslow, N. E., & Clayton, D. G. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594284 · Cited by 4,629
Linear Mixed Models for Longitudinal Data
Verbeke, G. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2294-1_3 · Cited by 3,506
Diggle, P. J., Heagerty, P. J., Liang, K.-Y., & Zeger, S. L. (2002) · doi:10.1093/oso/9780198524847.001.0001 · Cited by 3,384
Dialysis Dose and Intradialytic Hypotension: Results from the HEMO Study
Mc Causland, F. R., Brunelli, S. M., & Waikar, S. S. (2013) · American Journal of Nephrology · doi:10.1159/000355958 · Cited by 2,690
Linear Mixed Models for Longitudinal Data
Molenberghs, G., & Verbeke, G. (2000) · Springer Series in Statistics · doi:10.1007/978-1-4419-0300-6 · Cited by 2,646
Self-citationFinding the Observed Information Matrix When Using the EM Algorithm
Louis, T. A. (1982) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1982.tb01203.x · Cited by 2,229
Quasi-likelihood functions, generalized linear models, and the Gauss—Newton method
WEDDERBURN, R. W. M. (1974) · Biometrika · doi:10.1093/biomet/61.3.439 · Cited by 2,122 · cited 2×
“Quasi-likelihood 23 was first introduced for the generalized linear model by Wedderburn (1974) who defined the quasi-likelihood function as follows.”
MethodSurrogate endpoints in clinical trials: Definition and operational criteria
Prentice, R. L. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080407 · Cited by 2,057
Adaptive Rejection Sampling for Gibbs Sampling
Gilks, W. R., & Wild, P. (1992) · Applied Statistics · doi:10.2307/2347565 · Cited by 1,642
Analysis of Semiparametric Regression Models for Repeated Outcomes in the Presence of Missing Data
Robins, J. M., Rotnitzky, A., & Zhao, L. P. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476493 · Cited by 1,595
Modeling the Drop-Out Mechanism in Repeated-Measures Studies
Little, R. J. A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476615 · Cited by 1,522 · cited 9×
“Little (1993, 1995) identified two ways of factoring this joint distribution.”
BackgroundMethodInfluentialInformative Drop-Out in Longitudinal Data Analysis
Diggle, P., & Kenward, M. G. (1994) · Applied Statistics · doi:10.2307/2986113 · Cited by 1,468
A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms
Wei, G. C. G., & Tanner, M. A. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474930 · Cited by 1,453
(2004) · Choice Reviews Online · doi:10.5860/choice.42-2265 · Cited by 1,384
Unbalanced Repeated-Measures Models with Structured Covariance Matrices
Jennrich, R. I., & Schluchter, M. D. (1986) · Biometrics · doi:10.2307/2530695 · Cited by 1,325
Generalized linear mixed models a pseudo-likelihood approach
Wolfinger, R., & O'connell, M. (1993) · Journal of Statistical Computation and Simulation · doi:10.1080/00949659308811554 · Cited by 1,271
Cook, R. D. (1986) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1986.tb01398.x · Cited by 1,044
Pattern-Mixture Models for Multivariate Incomplete Data
Little, R. J. A. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594302 · Cited by 1,035
Models for Discrete Longitudinal Data
(2005) · Springer Series in Statistics · doi:10.1007/0-387-28980-1 · Cited by 1,021
Adjusting for Nonignorable Drop-Out Using Semiparametric Nonresponse Models
Scharfstein, D. O., Rotnitzky, A., & Robins, J. M. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473862 · Cited by 995
Missing Data in Clinical Studies
Molenberghs, G., & Kenward, M. G. (2007) · Wiley eBooks · doi:10.1002/9780470510445 · Cited by 962
Self-citationJoint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
Tsiatis, A. A., Degruttola, V., & Wulfsohn, M. S. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476485 · Cited by 575
Wu, M. C., & Carroll, R. J. (1988) · Biometrics · doi:10.2307/2531905 · Cited by 536
Wu, M. C., & Carroll, R. J. (1987) · doi:10.21236/ada186320 · Cited by 523
Missing-Data Methods for Generalized Linear Models: A Comparative Review
Ibrahim, J. G., Chen, M.-H., Lipsitz, S. R., & Herring, A. H. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001844 · Cited by 471
Self-citation(2008) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420011579 · Cited by 460
Semiparametric Regression for Repeated Outcomes with Nonignorable Nonresponse
Rotnitzky, A., Robins, J. M., & Scharfstein, D. O. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473795 · Cited by 445
A class of pattern-mixture models for normal incomplete data
LITTLE, R. J. A. (1994) · Biometrika · doi:10.1093/biomet/81.3.471 · Cited by 405
FAUCETT, C. L., & THOMAS, D. C. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960815)15:15<1663::aid-sim294>3.0.co;2-1 · Cited by 391
Modelling Progression of CD4-Lymphocyte Count and Its Relationship to Survival Time
Gruttola, V. D., & Tu, X. M. (1994) · Biometrics · doi:10.2307/2533439 · Cited by 384
A Fast Improvement to the Em Algorithm on its Own Terms
Meilijson, I. (1989) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1989.tb01754.x · Cited by 371
Wu, M. C., & Bailey, K. R. (1989) · Biometrics · doi:10.2307/2531694 · Cited by 370
Missing Data in Longitudinal Studies: Strategies for Bayesian Modeling and Sensitivity Analysis
Daniels, M. J., & Hogan, J. W. (2008) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420011180 · Cited by 356
Incomplete Data in Generalized Linear Models
Ibrahim, J. G. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474938 · Cited by 344
Self-citationInformative dropout in longitudinal data analysis (with discussion)
Diggle, P. J., & Kenward, M. G. (1994) · Journal of the Royal Statistical Society Series C (Applied Statistics) · Cited by 341
MIXTURE MODELS FOR THE JOINT DISTRIBUTION OF REPEATED MEASURES AND EVENT TIMES
HOGAN, J. W., & LAIRD, N. M. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970215)16:3<239::aid-sim483>3.0.co;2-x · Cited by 339
Local Influence in Linear Mixed Models
Lesaffre, E., & Verbeke, G. (1998) · Biometrics · doi:10.2307/3109764 · Cited by 307
Missing Covariates in Generalized Linear Models When the Missing Data Mechanism is Non-ignorable
Ibrahim, J. G., Lipsitz, S. R., & Chen, M.-H. (1999) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00170 · Cited by 293
Self-citationAn Approximate Generalized Linear Model with Random Effects for Informative Missing Data
Follmann, D., & Wu, M. (1995) · Biometrics · doi:10.2307/2533322 · Cited by 292
Methods for the analysis of informatively censored longitudinal data
Schluchter, M. D. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111408 · Cited by 287
Pattern-Mixture Models for Multivariate Incomplete Data with Covariates
Little, R. J. A., & Wang, Y. (1996) · Biometrics · doi:10.2307/2533148 · Cited by 244
Joint Analysis of Longitudinal Data Comprising Repeated Measures and Times to Events
Xu, J., & Zeger, S. L. (2001) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00241 · Cited by 228
Missing responses in generalised linear mixed models when the missing data mechanism is nonignorable
Ibrahim, J. G. (2001) · Biometrika · doi:10.1093/biomet/88.2.551 · Cited by 227
Self-citationLocal Influence for Incomplete Data Models
Zhu, H.-T., & Lee, S.-Y. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00279 · Cited by 217
The analysis of longitudinal ordinal data with nonrandom drop-out
Molenberghs, G. (1997) · Biometrika · doi:10.1093/biomet/84.1.33 · Cited by 201
Self-citationA Bayesian Semiparametric Joint Hierarchical Model for Longitudinal and Survival Data
R. Brown, E., & G. Ibrahim, J. (2003) · Biometrics · doi:10.1111/1541-0420.00028 · Cited by 199
Strategies to fit pattern-mixture models
Thijs, H., Molenberghs, G., Michiels, B., Verbeke, G. N., & Curran, D. (2002) · Biostatistics · doi:10.1093/biostatistics/3.2.245 · Cited by 190
Self-citationA Flexible B‐Spline Model for Multiple Longitudinal Biomarkers and Survival
Brown, E. R., Ibrahim, J. G., & DeGruttola, V. (2005) · Biometrics · doi:10.1111/j.0006-341x.2005.030929.x · Cited by 189
Self-citationDiagnostics for Mixed-Model Analysis of Variance
Beckman, R. J., Nachtsheim, C. J., & Cook, R. D. (1987) · Technometrics · doi:10.2307/1269452 · Cited by 167
Analysing changes in the presence of informative right censoring caused by death and withdrawal
Wu, M. C., & Bailey, K. (1988) · Statistics in Medicine · doi:10.1002/sim.4780070134 · Cited by 158
Models for Discrete Longitudinal Data
Williamson, J. M. (2006) · Journal of the American Statistical Association · doi:10.1198/jasa.2006.s117 · Cited by 156
A Stochastic Model for Analysis of Longitudinal AIDS Data
Taylor, J. M. G., Cumberland, W. G., & Sy, J. P. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476806 · Cited by 150
Monte Carlo EM for Missing Covariates in Parametric Regression Models
Ibrahim, J. G., Chen, M., & Lipsitz, S. R. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.00591.x · Cited by 134
Self-citationModel Selection Criteria for Missing-Data Problems Using the EM Algorithm
Ibrahim, J. G., Hongtu Zhu, B., & Tang, N. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000001057 · Cited by 132
Self-citationBayesian methods for generalized linear models with covariates missing at random
Ibrahim, J. G., Chen, M., & Lipsitz, S. R. (2002) · Canadian Journal of Statistics · doi:10.2307/3315865 · Cited by 123
Self-citationBayesian Analysis of Realistically Complex Models
Best, N. G., Spiegelhalter, D. J., Thomas, A., & Brayne, C. E. G. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983178 · Cited by 117
Lipsitz, S. R., Ibrahim, J. G., & Zhao, L. P. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473870 · Cited by 115
Self-citationMaximum Likelihood Methods for Cure Rate Models with Missing Covariates
Chen, M., & Ibrahim, J. G. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00043.x · Cited by 102
Self-citationMissing Data in Longitudinal Studies
Donald, H., & Gibbons Robert, D. (2006) · Wiley series in probability and statistics · doi:10.1002/0470036486.ch14 · Cited by 102
Parameter Estimation in Longitudinal Studies with Outcome-Dependent Follow-Up
Lipsitz, S. R., Fitzmaurice, G. M., Ibrahim, J. G., Gelber, R. D., & Lipshultz, S. E. (2002) · Biometrics · doi:10.1111/j.0006-341x.2002.00621.x · Cited by 99
Self-citationCowles, M. K., Carlin, B. P., & Connett, J. E. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476666 · Cited by 95
Likelihood-Based Methods for Missing Covariates in the Cox Proportional Hazards Model
Herring, A. H., & Ibrahim, J. G. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332866 · Cited by 95
Self-citationModeling Disease Marker Processes in AIDS
Pawitan, Y., & Self, S. G. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476332 · Cited by 95
Brown, E. R., & Ibrahim, J. G. (2003) · Biometrics · doi:10.1111/1541-0420.00079 · Cited by 94
Self-citationIbrahim, J. G., Chen, M. H., & Sinha, D. (2021) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/ee62-bj81 · Cited by 91
Self-citationAnalysis of Longitudinal Data with Non-Ignorable Non-Monotone Missing Values
Troxel, A. B., Harrington, D. P., & Lipsitz, S. R. (1998) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00119 · Cited by 89
Coping with missing data in clinical trials: A model‐based approach applied to asthma trials
Carpenter, J. R., Pocock, S., & Lamm, C. J. (2002) · Statistics in Medicine · doi:10.1002/sim.1065 · Cited by 89
A Latent‐Class Mixture Model for Incomplete Longitudinal Gaussian Data
Beunckens, C., Molenberghs, G., Verbeke, G. N., & Mallinckrodt, C. H. (2007) · Biometrics · doi:10.1111/j.1541-0420.2007.00837.x · Cited by 87
Self-citationStubbendick, A. L., & Ibrahim, J. G. (2003) · Biometrics · doi:10.1111/j.0006-341x.2003.00131.x · Cited by 80
Self-citationTroxel, A. B. (1998) · Biometrika · doi:10.1093/biomet/85.3.661 · Cited by 75
Generalized linear mixture models for handling nonignorable dropouts in longitudinal studies
Fitzmaurice, G. M. (2000) · Biostatistics · doi:10.1093/biostatistics/1.2.141 · Cited by 72
VARIABLE SELECTION FOR REGRESSION MODELS WITH MISSING DATA
The University of North Carolina at Chapel Hill University Libraries (2020) · PubMed · doi:10.17615/b1pe-2b05 · Cited by 68
A new joint model for longitudinal and survival data with a cure fraction
Chen, M., Ibrahim, J. G., & Sinha, D. (2004) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2004.04.005 · Cited by 62
Self-citationValidation of Surrogate Endpoints in Multiple Randomized Clinical Trials with Discrete Outcomes
Renard, D., Geys, H., Molenberghs, G., Burzykowski, T., & Buyse, M. E. (2002) · Biometrical Journal · doi:10.1002/bimj.200290004 · Cited by 61
Self-citationThe Muscatine Children’s Obesity Data Reanalysed Using Pattern Mixture Models
Ekholm, A. G., & Skinner, C. J. (1998) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00110 · Cited by 48
A Sensitivity Analysis for Shared‐Parameter Models for Incomplete Longitudinal Outcomes
Creemers, A., Hens, N., Aerts, M., Molenberghs, G., Verbeke, G. N., & Kenward, M. G. (2009) · Biometrical Journal · doi:10.1002/bimj.200800235 · Cited by 44
Self-citationHogan, J. W., & Laird, N. M. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700104 · Cited by 42
Herring, A. H., Ibrahim, J. G., & Lipsitz, S. R. (2004) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1046/j.1467-9876.2003.05168.x · Cited by 40
Self-citationUsing a Box–Cox Transformation in the Analysis of Longitudinal Data with Incomplete Responses
Lipsitz, S. R., Ibrahim, J. G., & Molenberghs, G. (2000) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00192 · Cited by 33
Self-citationChen, M., Ibrahim, J. G., & Shao, Q.-M. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000368 · Cited by 21
Self-citationBayesian variable selection for the Cox regression model with missing covariates
Ibrahim, J. G., Chen, M., & Kim, S. (2008) · Lifetime Data Analysis · doi:10.1007/s10985-008-9101-5 · Cited by 20
Self-citationSieve Maximum Likelihood Estimation for Regression Models With Covariates Missing at Random
Chen, Q., Zeng, D., & Ibrahim, J. G. (2007) · Journal of the American Statistical Association · doi:10.1198/016214507000001058 · Cited by 11
Self-citation
Cited by
Practical and statistical issues in missing data for longitudinal patient-reported outcomes
Bell, M. L., & Fairclough, D. L. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280213476378 · Cited by 285
Breaking the prejudice habit: Mechanisms, timecourse, and longevity
Forscher, P. S., Mitamura, C., Dix, E. L., Cox, W. T. L., & Devine, P. G. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.04.009 · Cited by 255
Addressing parents’ vaccine concerns: a randomized trial of a social media intervention
Daley, M. F., Narwaney, K. J., Shoup, J. A., Wagner, N. M., & Glanz, J. M. (2018) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.04.010 · Cited by 164
Longitudinal effects of medication nonadherence on glycemic control
Egede, L. E., Gebregziabher, M., Echols, C., & Lynch, C. P. (2014) · Annals of Pharmacotherapy · doi:10.1177/1060028014526362 · Cited by 146
de Melo, M. B., Daldegan‐Bueno, D., Menezes Oliveira, M. G., & de Souza, A. L. (2022) · European Journal of Neuroscience · doi:10.1111/ejn.15858 · Cited by 116
Metadata
- Authors
- Ibrahim, J. G., & Molenberghs, G.
- Venue
- TEST
- Published
- 2009-02-27
- Volume
- 18
- Issue
- 1
- Pages
- 1-43
- ISSN
- 1133-0686 (ISSN-L)
- 1863-8260
- OpenAlex
- W2059180350
- Cited by
- 512
- References
- 93
- FWCI
- 10.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.