How Not to Lie with Statistics: Avoiding Common Mistakes in Quantitative Political Science
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
This article identifies a set of serious theoretical mistakes appearing with troublingly high frequency throughout the quantitative political science literature. These mistakes are all based on faulty statistical theory or on erroneous statistical analysis. Through algebraic and interpretive proofs, some of the most commonly made mistakes are explicated and illustrated. The theoretical problem underlying each is highlighted, and suggested solutions are provided throughout. It is argued that closer attention to these problems and solutions will result in more reliable quantitative analyses and more useful theoretical contributions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In political science, King argued that if apples and oranges cannot be meaningfully compared on the original outcome measurement scale then this lack of comparability is not improved by comparing standardized fruit94.”
From A systematic review and meta-analysis of effects of early life non-cognitive skills on academic, psychosocial, cognitive and health outcomes (2018) · cites this paper as [94]
In the citing paper
“Use of such standardized effect measures has been criticized in several disciplines.”
From A systematic review and meta-analysis of effects of early life non-cognitive skills on academic, psychosocial, cognitive and health outcomes (2018) · cites this paper as [94]
Citations
Cites
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Sims, C. A. (1980) · Econometrica · doi:10.2307/1912017 · Cited by 12,727
Investigating Causal Relations by Econometric Models and Cross-Spectral Methods
Granger, C. W. J. (2010) · Essays in Econometrics · doi:10.1017/cbo9780511753978.002 · Cited by 4,762
Let's Take the Con out of Econometrics
Leamer, E. E. (2026) · Journal of Business Cycle Research · doi:10.1007/s41549-026-00137-2 · Cited by 2,202
Huff, D., & Geis, I. (1954) · Cited by 762
Econometrics: Alchemy or Science?: Essays in Econometric Methodology
Hendry, D. F. (2000) · doi:10.1093/0198293542.001.0001 · Cited by 634
Factor Analysis of Dichotomized Variables
Christoffersson, A. (1975) · Psychometrika · doi:10.1007/bf02291477 · Cited by 397
Causal Inferences, Closed Populations, and Measures of Association
Blalock, H. M. (1967) · American Political Science Review · doi:10.2307/1953880 · Cited by 144
Standardized and Unstandardized Coefficients in Causal Analysis: An Expository Note
Kim, J.-O., & Mueller, C. W. (1976) · Sociological Methods & Research · doi:10.1177/004912417600400402 · Cited by 66
Stepwise Regression: A Caution
Lewis‐Beck, M. S. (1978) · Cited by 34
Cited by
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Simple means to improve the interpretability of regression coefficients
Schielzeth, H. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2010.00012.x · Cited by 3,027
Preacher, K. J., & Kelley, K. (2011) · Psychological Methods · doi:10.1037/a0022658 · Cited by 3,060
“Achen (1977), Baguley (2009), Greenland (1998), Greenland, Schlesselman, and Criqui (1986), Kim and Ferree (1981), King (1986), and O'Grady (1982) are decidedly pessimistic about the use of correlations and r 2 and other standardized effect sizes for expressing effects, as they depend on the…”
Scaling regression inputs by dividing by two standard deviations
Gelman, A. (2008) · Statistics in Medicine · doi:10.1002/sim.3107 · Cited by 2,522
Multimodel inference in ecology and evolution: challenges and solutions
GRUEBER, C. E., NAKAGAWA, S., LAWS, R. J., & JAMIESON, I. G. (2011) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2010.02210.x · Cited by 2,263
Johnston, R., Jones, K., & Manley, D. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0584-6 · Cited by 1,181
The Acceptable R-Square in Empirical Modelling for Social Science Research
Ozili, P. K. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4128165 · Cited by 716
Marcus, G. E., & MacKuen, M. B. (1993) · American Political Science Review · doi:10.2307/2938743 · Cited by 758
Adams, K., Hean, S., Sturgis, P., & Clark, J. M. (2006) · Learning in Health and Social Care · doi:10.1111/j.1473-6861.2006.00119.x · Cited by 553
Traxler, F., Blaschke, S., & Kittel, B. (2001) · doi:10.1093/acprof:oso/9780198295549.001.0001 · Cited by 523
How to Standardize Regression Coefficients
Bring, J. (1994) · The American Statistician · doi:10.1080/00031305.1994.10476059 · Cited by 519
Class and Status: The Conceptual Distinction and its Empirical Relevance
Chan, T. W., & Goldthorpe, J. H. (2007) · American Sociological Review · doi:10.1177/000312240707200402 · Cited by 514
Sweet, A. S., & Brunell, T. L. (1998) · American Political Science Review · doi:10.2307/2585929 · Cited by 484
King, G. (1988) · American Journal of Political Science · doi:10.2307/2111248 · Cited by 464
Self-citationCole, D. A., & Preacher, K. J. (2014) · Psychological Methods · doi:10.1037/a0033805 · Cited by 462
The Time Has Come: Bayesian Methods for Data Analysis in the Organizational Sciences
Kruschke, J. K., Aguinis, H., & Joo, H. (2012) · Organizational Research Methods · doi:10.1177/1094428112457829 · Cited by 457
The Continued Significance of Class Voting
Evans, G. (2000) · Annual Review of Political Science · doi:10.1146/annurev.polisci.3.1.401 · Cited by 416
The End of Class Politics?: Class Voting in Comparative Context
(1999) · doi:10.1093/0198296347.001.0001 · Cited by 407
Post-Maastricht Blues: The Transformation of Citizen Support for European Integration, 1973–2004
Eichenberg, R. C., & Dalton, R. J. (2007) · Acta Politica · doi:10.1057/palgrave.ap.5500182 · Cited by 381
Class, Mobility and Merit The Experience of Two British Birth Cohorts
Breen, R. (2001) · European Sociological Review · doi:10.1093/esr/17.2.81 · Cited by 336
Reporting effect sizes in original psychological research: A discussion and tutorial.
Pek, J., & Flora, D. B. (2018) · Psychological Methods · doi:10.1037/met0000126 · Cited by 320
How to compare cross-lagged associations in a multilevel autoregressive model.
Schuurman, N. K., Ferrer, E., de Boer-Sonnenschein, M., & Hamaker, E. L. (2016) · Psychological Methods · doi:10.1037/met0000062 · Cited by 315
Seven deadly sins of contemporary quantitative political analysis
Schrodt, P. A. (2014) · Journal of Peace Research · doi:10.1177/0022343313499597 · Cited by 264
Goodness-of-Fit Measures for Probit and Logit
Hagle, T. M., & II, G. E. M. (1992) · American Journal of Political Science · doi:10.2307/2111590 · Cited by 254
From Space to Place: Predicting Users’ Intentions to Return to Virtual Worlds1
Goel, L., Johnson, N. A., Junglas, I., & Ives, B. (2011) · MIS Quarterly · doi:10.2307/23042807 · Cited by 181
Smithers, L. G., Sawyer, A. C. P., Chittleborough, C. R., Davies, N. M., Davey Smith, G., & Lynch, J. W. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0461-x · Cited by 175
Democratic Representation and Partisan Bias in Congressional Elections
King, G., & Browning, R. X. (1987) · American Political Science Review · doi:10.2307/1962588 · Cited by 168
Self-citationPublic Administration Research and Practice: A Methodological Manifesto
Gill, J., & Meier, K. J. (2000) · Journal of Public Administration Research and Theory · doi:10.1093/oxfordjournals.jpart.a024262 · Cited by 156
Economic Significance in Corporate Finance
Mitton, T. (2022) · The Review of Corporate Finance Studies · doi:10.1093/rcfs/cfac008 · Cited by 184
Desvendando os Mistérios do Coeficiente de Correlação de Pearson (r)
Filho, D. B. F., & Júnior, J. A. D. S. (2009) · Revista Política Hoje · Cited by 915
Family and neighborhood sources of socioeconomic inequality in children’s achievement
Sastry, N., & Pebley, A. R. (2010) · Demography · doi:10.1353/dem.0.0114 · Cited by 162
On Measuring and Modeling Physiological Synchrony in Dyads
Helm, J. L., Miller, J. G., Kahle, S., Troxel, N. R., & Hastings, P. D. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1459292 · Cited by 112
Rising complexity and falling explanatory power in ecology
Low-Décarie, E., Chivers, C., & Granados, M. (2014) · Frontiers in Ecology and the Environment · doi:10.1890/130230 · Cited by 111
Read this paper if you want to learn logistic regression
Fernandes, A., Figueiredo, D., da Rocha, E. D., & Nascimento, W. D. S. (2020) · Revista de Sociologia e Política · doi:10.1590/1678-987320287406en · Cited by 97
Durand, C. P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071079 · Cited by 96
Tepe, M., & Vanhuysse, P. (2010) · Journal of European Social Policy · doi:10.1177/0958928710364436 · Cited by 105
Vable, A., Gilsanz, P., Nguyen, T. T., Kawachi, I., & Glymour, M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0185898 · Cited by 65
"Truth" Is Stranger than Prediction, More Questionable than Causal Inference
King, G. (1991) · American Journal of Political Science · doi:10.2307/2111506 · Cited by 67
Self-citationCommercial Data Mining: Processing, Analysis and Modeling for Predictive Analytics Projects
Nettleton, D. (2014) · Thammasat University Digital Collections · Cited by 89
The Level of Democracy during Interregnum Periods: Recoding the polity2 Score
Plümper, T., & Neumayer, E. (2010) · Political Analysis · doi:10.1093/pan/mpp039 · Cited by 71
Wither Elites? The Role of Elite Credibility and Knowledge in Public Perceptions of Foreign Policy
Lupton, D. L., & Webb, C. M. (2022) · International Studies Quarterly · doi:10.1093/isq/sqac057 · Cited by 57
Determinantes do comportamento particularista de legisladores estaduais brasileiros
de Castro, M. M. M., Anastasia, F., & Nunes, F. (2009) · Dados · doi:10.1590/s0011-52582009000400005 · Cited by 40
Hannon, L., & DeFina, R. (2005) · Journal of Poverty · doi:10.1300/j134v09n03_03 · Cited by 33
Block, Drop or Roll(back): Alternative Preemption Methods for RH Multi-Tasking
Rupnow, K., Fu, W., & Compton, K. (2009) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2009.30 · Cited by 32
The Old J im C row: Racial Residential Segregation and Neighborhood Imprisonment
Burch, T. R. (2014) · Law & Policy · doi:10.1111/lapo.12022 · Cited by 35
Mistrust and negative self‐esteem: Two paths from attachment styles to paranoia.
Martinez, A. P., Agostini, M., Al‐Suhibani, A., & Bentall, R. P. (2021) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12314 · Cited by 25
“Importantly, as in previous work (Wickham et al., 2015), the path from attachment anxiety to negative self-esteem, β = .40, 95% CI 0.35–0.45, p .001, and the 4 Standardization does not always allow for direct comparison of effects (King, 1986).”
BackgroundInfluentialOut of context: the absence of geographic variation in US immigrants' perceptions of discrimination
Hopkins, D. J., Mummolo, J., Esses, V. M., Kaiser, C. R., Marrow, H. B., & McDermott, M. (2016) · Politics, Groups, and Identities · doi:10.1080/21565503.2015.1121155 · Cited by 21
“To our knowledge, this use of the ICC to study contextual effects is novel and so requires some discussion, especially given critiques of related metrics such as the Rsquared statistic (Achen 1977; King 1986).”
MethodSubstantive significance and it´s measures
Soukup, P. (2013) · Data and Research – SDA Info · doi:10.13060/23362391.2013.127.2.41 · Cited by 23
Applications of Multiple Regression in Psychological Research
Azen, R., & Budescu, D. V. (2009) · SAGE Publications Ltd eBooks · doi:10.4135/9780857020994.n13 · Cited by 21
Overconfidence, Sentiment and Beta Herding: A Behavioral Explanation of the Low-Beta AnomalyPreprint
Hwang, S., Rubesam, A., & Salmon, M. H. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3224321 · Cited by 18
Fuks, M., & Pereira, F. B. (2011) · Revista Brasileira de Ciências Sociais · doi:10.1590/s0102-69092011000200007 · Cited by 16
Three common statistical missteps we make in reservoir characterization
Male, F., & Jensen, J. L. (2022) · AAPG Bulletin · doi:10.1306/07202120076 · Cited by 12
Oosterhuis, E. J., Slade, K., Smith, E., May, P., & Nuttall, H. E. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280566 · Cited by 14
Presidential Influence Versus Agency Characteristics in Explaining Policy Implementation
Shull, S. A., & Garland, D. (1995) · Review of Policy Research · doi:10.1111/j.1541-1338.1995.tb00621.x · Cited by 11
Profiling organ donors in Egypt using intelligent modeling techniques
Mostafa, M. M. (2008) · Marketing Intelligence & Planning · doi:10.1108/02634500810860610 · Cited by 7
Heckman, A. C. (2008) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 4
Razão e emoção: reações ao estado da economia e aprovação do governo federal
Mundim, P. S., Gramacho, W. G., & Pinto, A. J. D. P. (2018) · Opinião Pública · doi:10.1590/1807-0191201824190 · Cited by 6
Strenze, T. (2006) · Trames Journal of the Humanities and Social Sciences · doi:10.3176/tr.2006.3.03 · Cited by 8
Relationship Marketing and Intangible Resources: The Mediating Effect of Loyalty
Rosa, D., & Rua, O. L. (2020) · Review of Marketing Science · doi:10.1515/roms-2020-0026 · Cited by 8
Nash, R. (2016) · Waikato journal of education · doi:10.15663/wje.v10i1.347 · Cited by 3
Omondi, L. A., & Orinda, M. A. (2023) · Turkish Journal of Agriculture - Food Science and Technology · doi:10.24925/turjaf.v11i12.2211-2217.5645 · Cited by 3
The Financial Implications of Flexible Labor Use in Nonprofit Organizations
Liu, Q., & Altamimi, H. (2025) · Nonprofit Management and Leadership · doi:10.1002/nml.70002 · Cited by 3
Performance metrics for hybrid multi-tasking systems
Rupnow, K., Adriaens, J. T., Fu, W., & Compton, K. (2009) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2009.5272416 · Cited by 2
Prudnikov, E. K., & Robles-Zavala, E. (2022) · El Periplo Sustentable · doi:10.36677/elperiplo.v0i43.16396 · Cited by 1
Social and political event data to support Army requirements : volume 1
Perkins, T. K., Wood, C., Santos, R. D., Meyer, W. D., Garfinkle, N. W., Wang, X., Enscore, S. I., Selig, L., & Calfas, G. W. (2017) · US Army Corps of Engineers: Engineer Research and Development Center (Knowledge Core) · doi:10.21079/11681/25702 · Cited by 2
Flutuação do voto e sistema partidário: o caso de São Paulo
Simoni, S. (2012) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.8.2012.tde-24072012-160028
INSTABILIDADE PLUVIOMÉTRICA NA PRODUÇÃO AGRÍCOLA DE SEQUEIRO NO ESTADO DO PIAUÍ
Sousa, É. C., Campos, K. C., Lemos, J. D. J. S., & Lessa, L. C. R. (2023) · Revista de Economia e Agronegócio · doi:10.25070/rea.v20i2.15083
The Performance of Stock Portfolios formed using Fuzzy Logic
Sinha, A. K., & Jacob, A. J. (2020) · Financial Statistical Journal · doi:10.24294/fsj.v3i1.814
Metadata
- Authors
- King, G.
- Affiliations
- Harvard University (US)
- Corresponding author
- King, Gary
- ORCID
- King, Gary
- Venue
- American Journal of Political Science
- Publisher
- JSTOR
- Published
- 1986-08
- Volume
- 30
- Issue
- 3
- Pages
- 666
- ISSN
- 0092-5853 (ISSN-L)
- OpenAlex
- W2103958867
- Cited by
- 41
- References
- 13
- Citations by year
- 2025: 1 · 2023: 3 · 2022: 6 · 2020: 3 · 2018: 2 · 2017: 2 · 2016: 2 · 2014: 2 · 2013: 2 · 2012: 1
- FWCI
- 8.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Political Science (publishedVersion)
- Topics
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- statistical errors, mathematical statistics, econometrics, regression analysis, model misspecification, statistical interpretation, research methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.