How Multiple Imputation Makes a Difference
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Political scientists increasingly recognize that multiple imputation represents a superior strategy for analyzing missing data to the widely used method of listwise deletion. However, there has been little systematic investigation of how multiple imputation affects existing empirical knowledge in the discipline. This article presents the first large-scale examination of the empirical effects of substituting multiple imputation for listwise deletion in political science. The examination focuses on research in the major subfield of comparative and international political economy (CIPE) as an illustrative example. Specifically, I use multiple imputation to reanalyze the results of almost every quantitative CIPE study published during a recent five-year period in International Organization and World Politics, two of the leading subfield journals in CIPE. The outcome is striking: in almost half of the studies, key results “disappear” (by conventional statistical standards) when reanalyzed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
A test of missing completely at random for multivariate data with missing values
Little, R. J. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478722 · Cited by 8,963
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Ethnicity, Insurgency, and Civil War
FEARON, J. D., & LAITIN, D. D. (2003) · American Political Science Review · doi:10.1017/s0003055403000534 · Cited by 7,366
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012 · cited 4×
“Statisticians have traditionally recommended no more than five imputations, which is the default setting in Amelia II (Rubin 1987; Schafer 1997).”
BackgroundMethodInfluentialHow Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation Theory
Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007) · Prevention Science · doi:10.1007/s11121-007-0070-9 · Cited by 2,795
Amelia II: A Program for Missing Data
Honaker, J., King, G., & Blackwell, M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i07 · Cited by 2,552
Cited by
Freese, J., & Peterson, D. (2017) · Annual Review of Sociology · doi:10.1146/annurev-soc-060116-053450 · Cited by 310
A Thousand Cuts: Social Protection in the Age of Austerity
Kentikelenis, A., & Stubbs, T. (2023) · doi:10.1093/oso/9780190637736.001.0001 · Cited by 94
Synergies and Trade-Offs in Reaching the Sustainable Development Goals
Hegre, H., Petrova, K., & von Uexkull, N. (2020) · Sustainability · doi:10.3390/su12208729 · Cited by 82
Causal Panel Analysis under Parallel Trends: Lessons from a Large Reanalysis Study
CHIU, A., LAN, X., LIU, Z., & XU, Y. (2026) · American Political Science Review · doi:10.1017/s0003055425000243 · Cited by 48
“Finally, we contribute to the ongoing conversation on replication and reproducibility in political science (e.g., Eggers et al., 2015; Lall, 2016; Hainmueller, Mummolo and Xu, 2019; Lal et al., 2024).”
Metadata
- Authors
- Lall, R.
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2016
- Volume
- 24
- Issue
- 4
- Pages
- 414-433
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2508931422
- Cited by
- 236
- References
- 14
- FWCI
- 20.13
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Multiple Imputation Makes a Difference. https://app.cochat.ai/papers/10.1093/pan/mpw020
- The paper
- Lall, R. (2016). How Multiple Imputation Makes a Difference. Political Analysis. https://doi.org/10.1093/pan/mpw020
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.