The DOI matches its Crossref record; 12 of the 13 references it cites were found in a registry or an index.
How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Abstract
Multiple imputation (MI) and full information maximum likelihood (FIML) are the two most common approaches to missing data analysis. In theory, MI and FIML are equivalent when identical models are tested using the same variables, and when m, the number of imputations performed with MI, approaches infinity. However, it is important to know how many imputations are necessary before MI and FIML are sufficiently equivalent in ways that are important to prevention scientists. MI theory suggests that small values of m, even on the order of three to five imputations, yield excellent results. Previous guidelines for sufficient m are based on relative efficiency, which involves the fraction of missing information (gamma) for the parameter being estimated, and m. In the present study, we used a Monte Carlo simulation to test MI models across several scenarios in which gamma and m were varied. Standard errors and p-values for the regression coefficient of interest varied as a function of m, but not at the same rate as relative efficiency. Most importantly, statistical power for small effect sizes diminished as m became smaller, and the rate of this power falloff was much greater than predicted by changes in relative efficiency. Based our findings, we recommend that researchers using MI should perform many more imputations than previously considered sufficient. These recommendations are based on gamma, and take into consideration one's tolerance for a preventable power falloff (compared to FIML) due to using too few imputations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Due to the high attrition rate of up to 40% and above, 40 data sets were imputed, aiming to reduce the power fallout to less than 1% in accordance with a recommendation based on Monte Carlo simulations [87].”
From Lessons Learned from an Attempted Pragmatic Randomized Controlled Trial for Improvement of Chronic Pain-Associated Disability in Green Professions: Long-Term Effectiveness of a Guided Online-Based Acceptance and Commitment Therapy (PACT-A) (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Concomitant with the change of the estimator, we used multiple imputation (with covariates included; 40 imputations63) to address missing data (instead of FIML, which is used with MLR).”
From Adolescent leisure reading and its longitudinal association with prosocial behavior and social adjustment (2023) · cites this paper as [63]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Self-citationAnalysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627
A comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389
Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation
King, G., Honaker, J., Joseph, A., & Scheve, K. (2001) · American Political Science Review · doi:10.1017/s0003055401000235 · Cited by 1,834 · cited 1×
“Technical articles, books, and multiple imputation software abound (e.g., Collins et al. 2001; Graham et al. 2003; King et al. 2001; Schafer, 1997; Schafer and Graham 2002; Schafer and Olsen 1998).”
Multiple Imputation for Multivariate Missing-Data Problems: A Data Analyst's Perspective
Schafer, J. L., & Olsen, M. K. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3304_5 · Cited by 1,518
Research Methods in Psychology
(2016) · doi:10.24926/8668.2201 · Cited by 1,492
Cited by
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
“argued that we should instead choose the number of imputations to limit the loss in power for testing an association of interest [35].”
BackgroundMissing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
“However, Graham et al. (2007) have recently shown that the effects of m on statistical power for detecting a small effect size (ρ = 0.10) can be strikingly different from what is observed for relative efficiency.”
BackgroundResultInfluentialSelf-citationMultiple imputation by chained equations: what is it and how does it work?
Azur, M. J., Stuart, E. A., Frangakis, C., & Leaf, P. J. (2011) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.329 · Cited by 3,542
“Initial research indicated that 5–10 imputed datasets was sufficient; however, recent research suggests that, depending upon the amount of missing information in the data, increasing that to as many as 40 imputed datasets can improve power (Graham et al., 2007).”
BackgroundPrincipled missing data methods for researchers
Dong, Y., & Peng, C.-Y. J. (2013) · SpringerPlus · doi:10.1186/2193-1801-2-222 · Cited by 2,208
Early palliative care for patients with advanced cancer: a cluster-randomised controlled trial
Zimmermann, C., Swami, N., Krzyzanowska, M., Hannon, B., Leighl, N., Oza, A., Moore, M., Rydall, A., Rodin, G., Tannock, I., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62416-2 · Cited by 1,781
Metadata
- Authors
- Graham, J. W., Olchowski, A. E., & Gilreath, T. D.
- Affiliations
- Pennsylvania State University (US)
- ORCID
- Gilreath, Tamika D.
- Venue
- Prevention Science
- Published
- 2007-06-05
- Volume
- 8
- Issue
- 3
- Pages
- 206-213
- ISSN
- 1389-4986 (ISSN-L)
- 1573-6695
- OpenAlex
- W2133494987
- Cited by
- 2,795
- References
- 13
- Citations by year
- 2026: 140 · 2025: 169 · 2024: 194 · 2023: 181 · 2022: 203 · 2021: 262 · 2020: 227 · 2019: 206 · 2018: 220 · 2017: 177 · 2016: 163 · 2015: 180 · 2014: 127 · 2013: 132 · 2012: 95
- FWCI
- 21.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Prevention Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- multiple imputation, full information maximum likelihood, missing data, relative efficiency, statistical power, standard errors, p-values, Monte Carlo simulation, prevention research
- MeSH terms
- Data Interpretation, Statistical, Humans, Monte Carlo Method, Preventive Medicine, Models, Statistical, Likelihood Functions, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory. https://app.cochat.ai/papers/10.1007/s11121-007-0070-9
- The paper
- Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007). How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory. Prevention Science. https://doi.org/10.1007/s11121-007-0070-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.