Multiple Imputation of Missing Data for Multilevel Models: Simulations and Recommendations
The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
Multiple imputation (MI) is one of the principled methods for dealing with missing data. In addition, multilevel models have become a standard tool for analyzing the nested data structures that result when lower level units (e.g., employees) are nested within higher level collectives (e.g., work groups). When applying MI to multilevel data, it is important that the imputation model takes the multilevel structure into account. In the present paper, based on theoretical arguments and computer simulations, we provide guidance using MI in the context of several classes of multilevel models, including models with random intercepts, random slopes, cross-level interactions (CLIs), and missing data in categorical and group-level variables. Our findings suggest that, oftentimes, several approaches to MI provide an effective treatment of missing data in multilevel research. Yet we also note that the current implementations of MI still have room for improvement when handling missing data in explanatory variables in models with random slopes and CLIs. We identify areas for future research and provide recommendations for research practice along with a number of step-by-step examples for the statistical software R.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Mixed models can handle unbalanced data by making use of available information when outcome data is available at one time point and missing at others, thus preserving sample size [58, 59].”
From Benchmark findings from a veteran electronic patient-reported outcomes evaluation from a chronic pain management telehealth program (2024) · cites this paper as [58]
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 1×
“Here, we consider the JM approach implemented in the pan package (Schafer & Yucel, 2002) and the FCS approach known as “multiple imputation by chained equations” implemented in the mice package (van Buuren & Groothuis-Oudshoorn, 2011) in the statistical software R (R Core Team, 2016).”
MethodMultilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,775
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
(2010) · Cited by 7,034
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,368
Research works printed but not linked: 10
- Allison P. D., 2001, Missing data
- Allison P. D., 2012, Proceedings of the SAS Global Forum
- Gottfredson N. C., 2016, Prevention Science
- Grund S., Handbook for multilevel theory, measurement, and analysis
- 10.1177/014920639802400504 · doi:10.1177/014920639802400504 · Paper page
- Hox J. J., 2016, Advances in multilevel modeling for educational research: Addressing practical issues found in real-world applications, 39
- Meng X.-L., 1994, Statistical Science, 9
- Mistler S. A., 2013, Proceedings of the SAS Global Forum
- Mistler S. A. (2015). Multilevel multiple imputation: An examination of competing methods (Doctoral dissertation). Retrieved from http://repository.asu.edu/
- Muthén L. K., 2012, Mplus user’s guide
Cited by
Methodological guidance paper: High-quality meta- analysis in a systematic review
Pigott, T. D., & Polanin, J. R. (2020) · Review of Educational Research · doi:10.3102/0034654319877153 · Cited by 568
Evaluation of Pressing Issues in Ecological Momentary Assessment
Stone, A. A., Schneider, S., & Smyth, J. M. (2023) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080921-083128 · Cited by 200
jomo: A Flexible Package for Two-level Joint Modelling Multiple Imputation
Quartagno, M., Grund, S., & Carpenter, J. (2019) · The R Journal · doi:10.32614/rj-2019-028 · Cited by 140
Self-citationmiceadds: Some Additional Multiple Imputation Functions, Especially for 'mice'
Robitzsch, A., & Grund, S. (2014) · doi:10.32614/cran.package.miceadds · Cited by 110
Self-citationPilot randomized trial of self-guided virtual reality exposure therapy for social anxiety disorder
Zainal, N. H., Chan, W. W., Saxena, A. P., Taylor, C. B., & Newman, M. G. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.103984 · Cited by 84
Metadata
- Authors
- Grund, S., Lüdtke, O., & Robitzsch, A.
- Affiliations
- Leibniz Institute for Science and Mathematics Education (DE)
- Corresponding author
- Grund, Simon
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2017-05-15
- Volume
- 21
- Issue
- 1
- Pages
- 111-149
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2615970617
- Semantic Scholar
- e06f85dc773d8ae1f4e21764feecabcb66b2684a
- Cited by
- 224
- References
- 60
- Citations by year
- 2026: 34 · 2025: 24 · 2024: 38 · 2023: 34 · 2022: 27 · 2021: 27 · 2020: 23 · 2019: 13 · 2018: 3
- FWCI
- 7.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- multiple imputation, missing data, multilevel models, nested data, random slopes, cross-level interaction, random intercepts, categorical variables, R implementation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multiple Imputation of Missing Data for Multilevel Models: Simulations and Recommendations. https://app.cochat.ai/papers/10.1177/1094428117703686
- The paper
- Grund, S., Lüdtke, O., & Robitzsch, A. (2018). Multiple Imputation of Missing Data for Multilevel Models: Simulations and Recommendations. Organizational Research Methods. https://doi.org/10.1177/1094428117703686
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.