New Confidence Intervals and Bias Comparisons Show That Maximum Likelihood Can Beat Multiple Imputation in Small Samples
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
When analyzing incomplete data, is it better to use multiple imputation (MI) or full information maximum likelihood (ML)? In large samples ML is clearly better, but in small samples ML’s usefulness has been limited because ML commonly uses normal test statistics and confidence intervals that require large samples. We propose small-sample t-based ML confidence intervals that have good coverage and are shorter than t-based confidence intervals under MI. We also show that ML point estimates are less biased and more efficient than MI point estimates in small samples of bivariate normal data. With our new confidence intervals, ML should be preferred over MI, even in small samples, whenever both options are available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497
Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164413495237 · Cited by 3,931
How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007) · Prevention Science · doi:10.1007/s11121-007-0070-9 · Cited by 2,795 · cited 1×
“E-mail: paulvonhippel.utaustin@gmail.com large, standard errors estimated by MI can require 200 to 300 imputed data sets to approach the efficiency of standard errors estimated by ML (Bodner, 2008; Graham et al., 2007).”
MethodHow to Use a Monte Carlo Study to Decide on Sample Size and Determine Power
Muthén, L. K., & Muthén, B. O. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0904_8 · Cited by 2,362
4. Regression with Missing Ys: An Improved Strategy for Analyzing Multiply Imputed Data
von Hippel, P. T. (2007) · Sociological Methodology · doi:10.1111/j.1467-9531.2007.00180.x · Cited by 1,495 · cited 1×
“(6) ML estimates for the regression of Y on X can be obtained simply by ignoring the incomplete cases and applying ordinary least squares (OLS) to the n0 cases with Y observed (Anderson, 1957; Little, 1992; von Hippel, 2007).”
MethodThe Analysis of Social Science Data with Missing Values
LITTLE, R. J. A., & RUBIN, D. B. (1989) · Sociological Methods & Research · doi:10.1177/0049124189018002004 · Cited by 1,016 · cited 1×
“The PD estimates are obtained as follows (Little & Rubin, 1989).”
MethodSample size in psychological research over the past 30 years
Marszalek, J. M., Barber, C., Kohlhart, J., & Cooper, B. H. (2011) · Perceptual and Motor Skills · doi:10.2466/03.11.pms.112.2.331-348 · Cited by 167
Cited by
Developmental cognitive neuroscience using latent change score models: A tutorial and applications
Kievit, R. A., Brandmaier, A. M., Ziegler, G., van Harmelen, A.-L., de Mooij, S. M. M., Moutoussis, M., Goodyer, I. M., Bullmore, E., Jones, P. B., Fonagy, P., et al. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2017.11.007 · Cited by 516
Liew, T. M., Tai, B. C., Yap, P., & Koh, G. C.-H. (2019) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2018.11.016 · Cited by 61
Trends and Disparities in Subjective Upward Mobility since 1940
Berger, T., & Engzell, P. (2020) · Socius: Sociological Research for a Dynamic World · doi:10.1177/2378023120951139 · Cited by 29
Hajek, A., Gyasi, R. M., & König, H.-H. (2024) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2024.105443 · Cited by 22
Hajek, A., & König, H. (2022) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.5631 · Cited by 22
“In sensitivity analysis, full‐information maximum likelihood (FIML) was used to address missing data.(19) The statistical significance was defined as p value of ≤ 0.”
Method
Metadata
- Authors
- von Hippel, P. T.
- Venue
- Structural Equation Modeling: A Multidisciplinary Journal
- Publisher
- Informa UK Limited
- Published
- 2015-10-12
- Volume
- 23
- Issue
- 3
- Pages
- 422-437
- ISSN
- 1070-5511 (ISSN-L)
- 1532-8007
- OpenAlex
- W2099928254
- Cited by
- 72
- References
- 7
- FWCI
- 2.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: New Confidence Intervals and Bias Comparisons Show That Maximum Likelihood Can Beat Multiple Imputation in Small Samples. https://app.cochat.ai/papers/10.1080/10705511.2015.1047931
- The paper
- von Hippel, P. T. (2016). New Confidence Intervals and Bias Comparisons Show That Maximum Likelihood Can Beat Multiple Imputation in Small Samples. Structural Equation Modeling: A Multidisciplinary Journal. https://doi.org/10.1080/10705511.2015.1047931
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.