How Not to Lie with Statistics: Avoiding Common Mistakes in Quantitative Political Science
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
This article identifies a set of serious theoretical mistakes appearing with troublingly high frequency throughout the quantitative political science literature. These mistakes are all based on faulty statistical theory or on erroneous statistical analysis. Through algebraic and interpretive proofs, some of the most commonly made mistakes are explicated and illustrated. The theoretical problem underlying each is highlighted, and suggested solutions are provided throughout. It is argued that closer attention to these problems and solutions will result in more reliable quantitative analyses and more useful theoretical contributions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In political science, King argued that if apples and oranges cannot be meaningfully compared on the original outcome measurement scale then this lack of comparability is not improved by comparing standardized fruit94.”
From A systematic review and meta-analysis of effects of early life non-cognitive skills on academic, psychosocial, cognitive and health outcomes (2018) · cites this paper as [94]
In the citing paper
“Use of such standardized effect measures has been criticized in several disciplines.”
From A systematic review and meta-analysis of effects of early life non-cognitive skills on academic, psychosocial, cognitive and health outcomes (2018) · cites this paper as [94]
Citations
Cites
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Sims, C. A. (1980) · Econometrica · doi:10.2307/1912017 · Cited by 12,727
Investigating Causal Relations by Econometric Models and Cross-Spectral Methods
Granger, C. W. J. (2010) · Essays in Econometrics · doi:10.1017/cbo9780511753978.002 · Cited by 4,762
Let's Take the Con out of Econometrics
Leamer, E. E. (2026) · Journal of Business Cycle Research · doi:10.1007/s41549-026-00137-2 · Cited by 2,202
Huff, D., & Geis, I. (1954) · Cited by 762
Econometrics: Alchemy or Science?: Essays in Econometric Methodology
Hendry, D. F. (2000) · doi:10.1093/0198293542.001.0001 · Cited by 634
Factor Analysis of Dichotomized Variables
Christoffersson, A. (1975) · Psychometrika · doi:10.1007/bf02291477 · Cited by 397
Causal Inferences, Closed Populations, and Measures of Association
Blalock, H. M. (1967) · American Political Science Review · doi:10.2307/1953880 · Cited by 144
Standardized and Unstandardized Coefficients in Causal Analysis: An Expository Note
Kim, J.-O., & Mueller, C. W. (1976) · Sociological Methods & Research · doi:10.1177/004912417600400402 · Cited by 66
Stepwise Regression: A Caution
Lewis‐Beck, M. S. (1978) · Cited by 34
Political Parties and Foreign Policy: A Structuralist Approach
King, G. (1986) · Political Psychology · doi:10.2307/3791158 · Cited by 18
Self-citationTests of significance: Some frequent misunderstandings.
Smith, K. (1983) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1983.tb03375.x · Cited by 11
Analyzing Contingency Tables by Weighted Least Squares: An Alternative to the Goodman Approach
Kritzer, H. M. (1978) · Cited by 8
Statistical sense and nonsense.
Gurel, L. (1968) · PubMed · Cited by 4
Cited by
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Simple means to improve the interpretability of regression coefficients
Schielzeth, H. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2010.00012.x · Cited by 3,027
Preacher, K. J., & Kelley, K. (2011) · Psychological Methods · doi:10.1037/a0022658 · Cited by 3,060
“Achen (1977), Baguley (2009), Greenland (1998), Greenland, Schlesselman, and Criqui (1986), Kim and Ferree (1981), King (1986), and O'Grady (1982) are decidedly pessimistic about the use of correlations and r 2 and other standardized effect sizes for expressing effects, as they depend on the…”
Scaling regression inputs by dividing by two standard deviations
Gelman, A. (2008) · Statistics in Medicine · doi:10.1002/sim.3107 · Cited by 2,522
Multimodel inference in ecology and evolution: challenges and solutions
GRUEBER, C. E., NAKAGAWA, S., LAWS, R. J., & JAMIESON, I. G. (2011) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2010.02210.x · Cited by 2,263
Metadata
- Authors
- King, G.
- Affiliations
- Harvard University (US)
- Corresponding author
- King, Gary
- ORCID
- King, Gary
- Venue
- American Journal of Political Science
- Publisher
- JSTOR
- Published
- 1986-08
- Volume
- 30
- Issue
- 3
- Pages
- 666
- ISSN
- 0092-5853 (ISSN-L)
- OpenAlex
- W2103958867
- Cited by
- 41
- References
- 13
- Citations by year
- 2025: 1 · 2023: 3 · 2022: 6 · 2020: 3 · 2018: 2 · 2017: 2 · 2016: 2 · 2014: 2 · 2013: 2 · 2012: 1
- FWCI
- 8.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Political Science (publishedVersion)
- Topics
- Social Sciences › Political Science and International Relations › Political Science Research and Education
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- statistical errors, mathematical statistics, econometrics, regression analysis, model misspecification, statistical interpretation, research methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.