A model-based imputation procedure for multilevel regression models with random coefficients, interaction effects, and nonlinear terms
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Despite the broad appeal of missing data handling approaches that assume a missing at random (MAR) mechanism (e.g., multiple imputation and maximum likelihood estimation), some very common analysis models in the behavioral science literature are known to cause bias-inducing problems for these approaches. Regression models with incomplete interactive or polynomial effects are a particularly important example because they are among the most common analyses in behavioral science research applications. In the context of single-level regression, fully Bayesian (model-based) imputation approaches have shown great promise with these popular analysis models. The purpose of this article is to extend model-based imputation to multilevel models with up to 3 levels, including functionality for mixtures of categorical and continuous variables. Computer simulation results suggest that this new approach can be quite effective when applied to multilevel models with random coefficients and interaction effects. In most scenarios that we examined, imputation-based parameter estimates were quite accurate and tracked closely with those of the complete data. The new procedure is available in the Blimp software application for macOS, Windows, and Linux, and the article includes a data analysis example illustrating its use. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To account for missing data, we used multiple imputation with fully conditional specification, which takes into account the multilevel nature of the data (Enders et al., 2020).”
From Work-Related Cognitive Behavioral Therapy for racially and economically diverse unemployed persons with social anxiety: A randomized clinical trial (2024) · cites this paper as Enders et al., 2020
Citations
Cites
Multiple regression: testing and interpreting interactions
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3352 · Cited by 36,654
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195 · cited 1×
“…# "3(x3j), $ε2# & N")3 # *31()1j ( )1) # *32()2j ( )2), $+32 # (21) In practice, it is more straightforward to use a Metropolis sampling step (Hastings, 1970) to draw imputations from p(Y | Xr , X!r) % p(Xr | X!r) because this approach can approximate a target distribution such as Equation…”
MethodHapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
Sufficient Sample Sizes for Multilevel Modeling
Maas, C. J. M., & Hox, J. J. (2005) · Methodology · doi:10.1027/1614-2241.1.3.86 · Cited by 3,582 · cited 1×
“We restrict our attention to the fixed effects because the literature argues that symmetric confidence intervals are inappropriate for variance estimates (Maas & Hox, 2005; Snijders & Bosker, 2012).”
BackgroundBayesian Analysis of Binary and Polychotomous Response Data
Albert, J. H., & Chib, S. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476321 · Cited by 3,167
4. Regression with Missing Ys: An Improved Strategy for Analyzing Multiply Imputed Data
von Hippel, P. T. (2007) · Sociological Methodology · doi:10.1111/j.1467-9531.2007.00180.x · Cited by 1,495 · cited 1×
“…the outcome variable, maximum likelihood solutions abound in popular software packages (e.g., mixed modeling packages in SPSS, Stata, R, etc.) and are probably preferable because valid estimates are obtained by simply fitting the analysis model to the observed data (Little, 1992; von Hippel, 2007).”
MethodBartlett, J. W., Seaman, S. R., White, I. R., Carpenter, J. R., & Initiative*, F. T. A. D. N. (2015) · Statistical Methods in Medical Research · doi:10.1177/0962280214521348 · Cited by 485
Simulation of truncated normal variablesPreprint
Robert, C. P. (2009) · HAL · Cited by 453
Computational Strategies for Multivariate Linear Mixed-Effects Models With Missing Values
Schafer, J. L., & Yucel, R. M. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002760180608 · Cited by 380
Albert, J. H., & Johnson, V. E. (1999) · Medical Entomology and Zoology · Cited by 363
Accelerating Monte Carlo Markov chain convergence for cumulative-link generalized linear models
Cowles, M. K. (1996) · Statistics and Computing · doi:10.1007/bf00162520 · Cited by 224
Multiple imputation by chained equations for systematically and sporadically missing multilevel data
Resche-Rigon, M., & White, I. R. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280216666564 · Cited by 218
Finch, J. F., West, S. G., & MacKinnon, D. P. (1997) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519709540063 · Cited by 210
Multilevel models with multivariate mixed response types
Goldstein, H., Carpenter, J., Kenward, M. G., & Levin, K. A. (2009) · Statistical Modelling · doi:10.1177/1471082x0800900301 · Cited by 202
Enders, C. K., Keller, B. T., & Levy, R. (2018) · Psychological Methods · doi:10.1037/met0000148 · Cited by 198
Self-citationKaplan, D. (1988) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2301_4 · Cited by 163
Multiple Imputation of Multilevel Data
Buuren, S. V. (2015) · Handbook of Advanced Multilevel Analysis · doi:10.4324/9780203848852.ch10 · Cited by 149
Bayesian methods for generalized linear models with covariates missing at random
Ibrahim, J. G., Chen, M., & Lipsitz, S. R. (2002) · Canadian Journal of Statistics · doi:10.2307/3315865 · Cited by 123
Conditionally specified distributions: an introduction
Arnold, B. C., Ron, E. C., & Sarabia, J. M. (2001) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 63
Kim, S., Sugar, C. A., & Belin, T. R. (2015) · Statistics in Medicine · doi:10.1002/sim.6435 · Cited by 41
Cited by
Best practices for addressing missing data through multiple imputation
Woods, A. D., Gerasimova, D., Van Dusen, B., Nissen, J., Bainter, S., Uzdavines, A., Davis‐Kean, P. E., Halvorson, M., King, K. M., Logan, J. A. R., et al. (2024) · Infant and Child Development · doi:10.1002/icd.2407 · Cited by 208
Evaluation of Pressing Issues in Ecological Momentary Assessment
Stone, A. A., Schneider, S., & Smyth, J. M. (2023) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080921-083128 · Cited by 200
Age disparities in mental health during the COVID19 pandemic: The roles of resilience and coping
Na, L., Yang, L., Mezo, P. G., & Liu, R. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.115031 · Cited by 96
Sun, J., Singletary, B., Jiang, H., Justice, L. M., Lin, T., & Purtell, K. M. (2021) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2021.101375 · Cited by 112
Tamm, L., Loren, R. E. A., Peugh, J., & Ciesielski, H. A. (2020) · Journal of Learning Disabilities · doi:10.1177/0022219420961338 · Cited by 99
Metadata
- Authors
- Enders, C. K., Du, H., & Keller, B. T.
- Affiliations
- University of California, Los Angeles (US)
- Venue
- Psychological Methods
- Published
- 2020-02
- Volume
- 25
- Issue
- 1
- Pages
- 88-112
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2954168252
- Cited by
- 166
- References
- 22
- Citations by year
- 2026: 28 · 2025: 25 · 2024: 26 · 2023: 21 · 2022: 27 · 2021: 22 · 2020: 11
- FWCI
- 12.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Grantee Submission
- Funders
- Institute of Educational Sciences (R305D150056.)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- model-based imputation, missing data, multilevel regression models, random coefficients, interaction effects, nonlinear terms, missing at random, Bayesian imputation, categorical and continuous variables
- MeSH terms
- Data Interpretation, Statistical, Humans, Psychology, Regression Analysis, Models, Statistical, Multilevel Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.