The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
What to do about missing values in time series cross- section data
Open accessAbstract
Applications of modern methods for analyzing data with missing values, based primarily on multiple imputation, have in the last half‐decade become common in American politics and political behavior. Scholars in this subset of political science have thus increasingly avoided the biases and inefficiencies caused by ad hoc methods like listwise deletion and best guess imputation. However, researchers in much of comparative politics and international relations, and others with similar data, have been unable to do the same because the best available imputation methods work poorly with the time‐series cross‐section data structures common in these fields. We attempt to rectify this situation with three related developments. First, we build a multiple imputation model that allows smooth time trends, shifts across cross‐sectional units, and correlations over time and space, resulting in far more accurate imputations. Second, we enable analysts to incorporate knowledge from area studies experts via priors on individual missing cell values, rather than on difficult‐to‐interpret model parameters. Third, because these tasks could not be accomplished within existing imputation algorithms, in that they cannot handle as many variables as needed even in the simpler cross‐sectional data for which they were designed, we also develop a new algorithm that substantially expands the range of computationally feasible data types and sizes for which multiple imputation can be used. These developments also make it possible to implement the methods introduced here in freely available open source software that is considerably more reliable than existing algorithms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The Amelia II R package was selected due to the statistical validity of its approach in handling time-series, cross-sectional data (Honaker & King, 2010;Honaker et al., 2011).”
From A single-case experimental evaluation of a new group-based intervention to enhance adjustment to life with acquired brain injury: VaLiANT (valued living after neurological trauma) (2022) · cites this paper as Honaker & King, 2010
In the citing paper
“Given that the bootstrapping method does not allow the sample to include missing values, multiple imputation was performed (Honaker & King, 2010).”
From The reciprocal and indirect relationships between passive Facebook use, comparison on Facebook, and adolescents' body dissatisfaction (2017) · cites this paper as Honaker & King, 2010
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Breitung, J., & Hamilton, J. D. (1995) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2076916 · Cited by 11,114
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Hsiao, C. (2022) · doi:10.1017/9781009057745 · Cited by 7,869
Ethnicity, Insurgency, and Civil War
FEARON, J. D., & LAITIN, D. D. (2003) · American Political Science Review · doi:10.1017/s0003055403000534 · Cited by 7,366
What To Do (and Not to Do) with Time-Series Cross-Section Data
Beck, N., & Katz, J. N. (1995) · American Political Science Review · doi:10.2307/2082979 · Cited by 6,840
Greed and grievance in civil war
Collier, P. D. (2004) · Oxford Economic Papers · doi:10.1093/oep/gpf064 · Cited by 6,295
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
The EM Algorithm and Extensions
Kushary, D., McLachlan, G. J., & Krishnan, T. (1998) · Technometrics · doi:10.2307/1271189 · Cited by 5,419
Maximum likelihood estimation from incomplete data via the EM algorithm
Dempster, A. P. (1977) · Journal of the Royal Statistical Society Series A (Statistics in Society) · Cited by 4,543
Making the most of statistical analyses: improving interpretation and presentation
King, G., Tomz, M., & Wittenberg, J. (2000) · American Journal of Political Science · doi:10.2307/2669316 · Cited by 3,232
Self-citationWhy Do More Open Economies Have Bigger Governments?
Rodrik, D. (1996) · Journal of Political Economy · doi:10.1086/250038 · Cited by 3,172
Amelia II: A Program for Missing Data
Honaker, J., King, G., & Blackwell, M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i07 · Cited by 2,552
Self-citationAnalyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation
King, G., Honaker, J., Joseph, A., & Scheve, K. (2001) · American Political Science Review · doi:10.1017/s0003055401000235 · Cited by 1,834
Self-citationProceedings of the 6th Berkeley Symposium on Mathematical Statistics and Probability
Cam, L. M. L., Neyman, J., & Scott, E. L. (1972) · Medical Entomology and Zoology · Cited by 1,679
The EM Algorithm and Extensions, 2E
McLachlan, G. J., & Krishnan, T. (2008) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9780470191613 · Cited by 1,653
Modeling the Drop-Out Mechanism in Repeated-Measures Studies
Little, R. J. A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476615 · Cited by 1,522
Multiple Imputation for Multivariate Missing-Data Problems: A Data Analyst's Perspective
Schafer, J. L., & Olsen, M. K. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3304_5 · Cited by 1,518
Models for Discrete Longitudinal Data
Molenberghs, G., & Verbeke, G. (2005) · Springer eBooks · doi:10.1007/0-387-28980-1 · Cited by 1,487
Heckman, J. J. (1990) · American Economic Review · Cited by 1,194
Iversen, T., & Soskice, D. (2006) · American Political Science Review · doi:10.1017/s0003055406062083 · Cited by 1,177
Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research
King, G., Murray, C., Salomon, J. A., & Tandon, A. (2004) · American Political Science Review · doi:10.1017/s000305540400108x · Cited by 954
Self-citationThe Invisible Hand of Democracy
Lake, D. A., & Baum, M. (2001) · Comparative Political Studies · doi:10.1177/0010414001034006001 · Cited by 912
Primary Commodity Exports and Civil War
Fearon, J. D. (2005) · Journal of Conflict Resolution · doi:10.1177/0022002705277544 · Cited by 836
Horton, N. J., & Kleinman, K. (2007) · The American Statistician · doi:10.1198/000313007x172556 · Cited by 829
Inequality, Social Insurance, and Redistribution
Moene, K. O., & Wallerstein, M. (2001) · American Political Science Review · doi:10.1017/s0003055400400067 · Cited by 825
Is Democracy Good for the Poor?
Ross, M. L. (2006) · American Journal of Political Science · doi:10.1111/j.1540-5907.2006.00220.x · Cited by 788
Multiple Imputation for Interval Estimation From Simple Random Samples With Ignorable Nonresponse
Rubin, D. B., & Nathaniel Schenker, A. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478280 · Cited by 768
Multiple-Imputation Inferences with Uncongenial Sources of Input
Meng, X. (1994) · Statistical Science · doi:10.1214/ss/1177010269 · Cited by 761
Models for Discrete Longitudinal Data
Karlsson, A. (2006) · Biometrics · doi:10.1111/j.1541-0420.2006.00589_5.x · Cited by 680
Maximum Likelihood Estimation from Incomplete Data
Hartley, H. O. (1958) · Biometrics · doi:10.2307/2527783 · Cited by 602
The Dangers of Extreme Counterfactuals
King, G., & Zeng, L. (2005) · Political Analysis · doi:10.1093/pan/mpj004 · Cited by 549
Self-citationDynamic Generalized Linear Models and Bayesian Forecasting
West, M., Harrison, P. J., & Migon, H. S. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10477131 · Cited by 529
On Pure and Mixed Statistical Estimation in Economics
Theil, H., & Goldberger, A. S. (1961) · International Economic Review · doi:10.2307/2525589 · Cited by 507
The Political Economy of Growth: Democracy and Human Capital
Baum, M., & Lake, D. A. (2003) · American Journal of Political Science · doi:10.1111/1540-5907.00023 · Cited by 496
Armed conflict as a public health problem
Murray, C. J. L. (2002) · BMJ · doi:10.1136/bmj.324.7333.346 · Cited by 487
Missing Data, Imputation, and the Bootstrap
Efron, B. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476768 · Cited by 471
Do Economic Sanctions Destabilize Country Leaders?
Marinov, N. (2005) · American Journal of Political Science · doi:10.1111/j.1540-5907.2005.00142.x · Cited by 463
A MISSING INFORMATION PRINCIPLE: THEORY AND APPLICATIONS
Orchard, T., & Woodbury, M. A. (1972) · University of California Press eBooks · doi:10.1525/9780520325883-036 · Cited by 451
Horowitz, J. L. (2001) · Handbook of econometrics · doi:10.1016/s1573-4412(01)05005-x · Cited by 407
On Pure and Mixed Statistical Estimation in Economics
Theil, H., & Goldberger, A. S. (1992) · Advanced studies in theoretical and applied econometrics · doi:10.1007/978-94-011-2546-8_18 · Cited by 404
Determinants of Economic Growth
Knack, S., & Barro, R. J. (1998) · Southern Economic Journal · doi:10.2307/1061363 · Cited by 377
Laud, P. W., & Ibrahim, J. G. (1995) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1995.tb02028.x · Cited by 351
Burgoon, B. M. (2006) · Journal of Conflict Resolution · doi:10.1177/0022002705284829 · Cited by 322
The Determinants of Economic Growth:
(2004) · Harvard University Press eBooks · doi:10.2307/j.ctv1ns7mrh.17 · Cited by 319
The Fiscal Contract: States, Taxes, and Public Services
Timmons, J. F. (2005) · World Politics · doi:10.1353/wp.2006.0015 · Cited by 310
When Can History Be Our Guide? The Pitfalls of Counterfactual Inference
King, G., & Zeng, L. (2007) · International Studies Quarterly · doi:10.1111/j.1468-2478.2007.00445.x · Cited by 258
Self-citationLittle, R. J. A. (2006) · The American Statistician · doi:10.1198/000313006x117837 · Cited by 240
A New Perspective on Priors for Generalized Linear Models
Bedrick, E. J., Christensen, R., & Johnson, W. O. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476713 · Cited by 227
Bootstrap for Imputed Survey Data
Shao, J., & Sitter, R. R. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476997 · Cited by 205
A New Perspective on Priors for Generalized Linear Models
Bedrick, E. J., Christensen, R., & Johnson, W. O. (1996) · Journal of the American Statistical Association · doi:10.2307/2291571 · Cited by 201
Clogg, C. C., Rubin, D. B., Nathaniel Schenker, A., Schultz, B. D., & Weidman, L. (1991) · Journal of the American Statistical Association · doi:10.1080/01621459.1991.10475005 · Cited by 188
Girosi, F., & King, G. (2008) · Princeton University Press eBooks · doi:10.1515/9780691186788 · Cited by 162
Self-citationBayesian analysis in econometrics and statistics
Bunn, D. W. (1981) · European Journal of Operational Research · doi:10.1016/0377-2217(81)90015-1 · Cited by 134
On the Impact of Bootstrap in Survey Sampling and Small-Area Estimation
Lahiri, P. (2003) · Statistical Science · doi:10.1214/ss/1063994975 · Cited by 95
Bayesian Estimation of Item Response Curves
Tsutakawa, R. K., & Lin, H. Y. (1986) · Psychometrika · doi:10.1007/bf02293983 · Cited by 85
Davey, A., Shanahan, M. J., & Schafer, J. L. (2001) · The Journal of Human Resources · doi:10.2307/3069628 · Cited by 74
Elicited Priors for Bayesian Model Specifications in Political Science Research
Gill, J., & Walker, L. D. (2005) · The Journal of Politics · doi:10.1111/j.1468-2508.2005.00342.x · Cited by 66
Putting Background Information About Relative Risks into Conjugate Prior Distributions
Greenland, S. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00663.x · Cited by 50
Greenland, S., & Christensen, R. (2001) · Statistics in Medicine · doi:10.1002/sim.902 · Cited by 47
Rubin, D. B. (1994) · Journal of the American Statistical Association · doi:10.2307/2290847 · Cited by 36
Prior distribution for item response curves
Tsutakawa, R. K. (1992) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1992.tb00977.x · Cited by 27
A Bayesian Model for Longitudinal Count Data with Non-Ignorable Dropout
Kaciroti, N., Raghunathan, T. E., Schork, M. A., & Clark, N. M. (2008) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/j.1467-9876.2008.00628.x · Cited by 20
Predictive Model Selection for Repeated Measures Random Effects Models Using Bayes Factors
Weiss, R. E., Wang, Y., & Ibrahim, J. G. (1997) · Biometrics · doi:10.2307/2533960 · Cited by 17
Predictive Variable Selection for the Multivariate Linear Model
Ibrahim, J. G., & Chen, M. (1997) · Biometrics · doi:10.2307/2533950 · Cited by 9
Calibrated Bayes: A Bayes/Frequentist Roadmap
Little, R. J. (2006) · RePEc: Research Papers in Economics · Cited by 7
Model Selection for Cepheid Star Oscillations
Jefferys, W. H., Barnes, T. G., III, Rodrigues, R., & Berger, J. O. (2000) · Cited by 4
Moments under conjugate distributions in bioassay
Tsutakawa, R. K. (1992) · Statistics & Probability Letters · doi:10.1016/0167-7152(92)90194-a · Cited by 2
Replication data for: What To Do about Missing Data in Time-Series Cross-Sectional Data
Honaker, J., & King, G. (2010) · Harvard Dataverse · doi:10.7910/dvn/ggur0p · Cited by 1
Self-citation
Research works printed but not linked: 1
- 10.1017/CBO9780511754203 · DOI · Paper page
Cited by
Sorted by citations
The Politics of Authoritarian Rule
Svolik, M. W. (2012) · doi:10.1017/cbo9781139176040 · Cited by 2,611
Amelia II: A Program for Missing Data
Honaker, J., King, G., & Blackwell, M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i07 · Cited by 2,552
Self-citationBeyens, I., Frison, E., & Eggermont, S. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.083 · Cited by 847
Modeling Dynamics in Time-Series–Cross-Section Political Economy Data
Beck, N., & Katz, J. N. (2011) · Annual Review of Political Science · doi:10.1146/annurev-polisci-071510-103222 · Cited by 825
Shih, V., Adolph, C., & Liu, M. (2012) · American Political Science Review · doi:10.1017/s0003055411000566 · Cited by 819
Metadata
- Authors
- Honaker, J., & King, G.
- Affiliations
- Pennsylvania State University (US)
- Harvard University (US)
- ORCID
- King, Gary
- Venue
- American Journal of Political Science
- Publisher
- Wiley
- Published
- 2010-04
- Volume
- 54
- Issue
- 2
- Pages
- 561-581
- ISSN
- 0092-5853 (ISSN-L)
- 1540-5907
- OpenAlex
- W2125291718
- Cited by
- 966
- References
- 71
- Citations by year
- 2026: 44 · 2025: 41 · 2024: 27 · 2023: 41 · 2022: 45 · 2021: 60 · 2020: 64 · 2019: 77 · 2018: 77 · 2017: 54 · 2016: 55 · 2015: 90 · 2014: 83 · 2013: 74 · 2012: 68
- FWCI
- 48.73
- Type
- journal article
- Language
- en
- Open access
- green
- nrs.harvard.edu
- Locations
- American Journal of Political Science (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Keywords
- missing data, multiple imputation, time-series cross-section data, imputation algorithm, temporal trends, spatial correlation, listwise deletion, open source software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review