Multiple Imputation of Multilevel Missing Data: An Introduction to the R Package pan
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
The treatment of missing data can be difficult in multilevel research because state-of-the-art procedures such as multiple imputation (MI) may require advanced statistical knowledge or a high degree of familiarity with certain statistical software. In the missing data literature, pan has been recommended for MI of multilevel data. In this article, we provide an introduction to MI of multilevel missing data using the R package pan, and we discuss its possibilities and limitations in accommodating typical questions in multilevel research. To make pan more accessible to applied researchers, we make use of the mitml package, which provides a user-friendly interface to the pan package and several tools for managing and analyzing multiply imputed data sets. We illustrate the use of pan and mitml with two empirical examples that represent common applications of multilevel models, and we discuss how these procedures may be used in conjunction with other software.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · cited 2×
“For example, it has been suggested that the multilevel structure be represented by creating a set of dummy-indicator variables (Drechsler, 2015; Graham, 2009; White, Royston, & Wood, 2011).”
Centering predictor variables in cross-sectional multilevel models: A new look at an old issue.
Enders, C. K., & Tofighi, D. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.2.121 · Cited by 4,462
Hox, J., Moerbeek, M., & van de Schoot, R. (2010) · doi:10.4324/9780203852279 · Cited by 3,469
How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007) · Prevention Science · doi:10.1007/s11121-007-0070-9 · Cited by 2,795
A comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389
Practical markov chain monte carlo
Geyer, C. J. (1992) · Statistical Science · doi:10.1214/ss/1177011137 · Cited by 2,045
Flexible Imputation of Missing Data
van Buuren, S. (2012) · doi:10.1201/b11826 · Cited by 2,022
Missing Data: Five Practical Guidelines
Newman, D. A. (2014) · Organizational Research Methods · doi:10.1177/1094428114548590 · Cited by 1,411
Variance components testing in the longitudinal mixed effects model
Stram, D. O., & Lee, J. W. (1994) · Biometrics · doi:10.2307/2533455 · Cited by 992
Multiple Imputation and its Application
Carpenter, J. R., & Kenward, M. G. (2013) · doi:10.1002/9781119942283 · Cited by 913 · cited 4×
“In general, an imputation model based on latent group means (i.e., random effects) yields similar results as one that is based on manifest means, and both can be considered correct imputation models for multilevel data (Carpenter & Kenward, 2013; Lüdtke et al., in press; Mistler, 2015).”
MethodResultInfluentialMissing data techniques for multilevel data: implications of model misspecification
Black, A. C., Harel, O., & Betsy McCoach, D. (2011) · Journal of Applied Statistics · doi:10.1080/02664763.2010.529882 · Cited by 55
Cited by
Kuyken, W., Ball, S., Crane, C., Ganguli, P., Jones, B., Montero-Marin, J., Nuthall, E., Raja, A., Taylor, L., Tudor, K., et al. (2022) · Evidence Based Mental Health · doi:10.1136/ebmental-2021-300396 · Cited by 285
Multiple Imputation of Missing Data for Multilevel Models: Simulations and Recommendations
Grund, S., Lüdtke, O., & Robitzsch, A. (2018) · Organizational Research Methods · doi:10.1177/1094428117703686 · Cited by 224
Self-citationfor the MEDUSA study group, Bloos, F., Rüddel, H., Thomas-Rüddel, D., Schwarzkopf, D., Pausch, C., Harbarth, S., Schreiber, T., Gründling, M., Marshall, J., et al. (2017) · Intensive Care Medicine · doi:10.1007/s00134-017-4782-4 · Cited by 200
“As a sensitivity analysis, hierarchical regression models were repeated after multilevel multiple imputation of missing data in 100 data sets (see electronic supplement for detailed description) [28].”
Richards, D., Enrique, A., Eilert, N., Franklin, M., Palacios, J., Duffy, D., Earley, C., Chapman, J., Jell, G., Sollesse, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0293-8 · Cited by 154
Kuyken, W., Ball, S., Crane, C., Ganguli, P., Jones, B., Montero-Marin, J., Nuthall, E., Raja, A., Taylor, L., Tudor, K., et al. (2022) · Evidence Based Mental Health · doi:10.1136/ebmental-2022-300424 · Cited by 56
“Data were imputed and analysed using R (V.3.6.1), 25 and Stata V.16.1, respectively.”
MethodInfluential
Metadata
- Authors
- Grund, S., Lüdtke, O., & Robitzsch, A.
- Venue
- Sage Open
- Publisher
- SAGE Publications
- Published
- 2016-10
- Volume
- 6
- Issue
- 4
- ISSN
- 2158-2440 (ISSN-L)
- OpenAlex
- W4296733573
- Cited by
- 120
- References
- 15
- FWCI
- 3.90
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.