Administrative Records Mask Racially Biased Policing
Open accessThe DOI matches its Crossref record; 103 of the 109 references it cites were found in a registry or an index.
Abstract
Researchers often lack the necessary data to credibly estimate racial discrimination in policing. In particular, police administrative records lack information on civilians that police observe but do not investigate. In this paper, we show that if police racially discriminate when choosing whom to investigate, analyses using administrative records to estimate racial discrimination in police behavior are statistically biased, rendering many quantities of interest unidentified---even among investigated individuals---absent strong and untestable assumptions. Using principal stratification in a causal mediation framework, we derive the exact form of the statistical bias that results from traditional estimation. We develop a bias-correction procedure and nonparametric sharp bounds for race effects, replicate published findings, and show the traditional estimator can severely underestimate levels of racially biased policing or mask discrimination entirely. We conclude by outlining a general and feasible design for future studies that is robust to this inferential snare.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While a substantial body of evidence shows that people of color, especially African Americans, are at greater risk for experiencing criminal justice contact and police-involved harm than are whites (14-19)”
From Risk of being killed by police use of force in the United States by age, race–ethnicity, and sex (2019) · cites this paper as [19]
Citations
Cites
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
Lipsky, M. (1981) · Michigan Law Review · doi:10.2307/1288305 · Cited by 8,981
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
The new Jim Crow: mass incarceration in the age of colorblindness
(2010) · Choice Reviews Online · doi:10.5860/choice.48-1766 · Cited by 4,407
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Bureaucracy: what government agencies do and why they do it
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4796 · Cited by 3,795
Research works printed but not linked: 29
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 0| = 1, = ) Pr
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 0| = 1, = ) Pr
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 0| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 0| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 0| = 1, = ) Pr
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 0| = 1, = ) Pr
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 0| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 0| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 0| = 1, = ) Pr
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 0| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 1, = ) Pr
- Pr, ) = 0| = 1, = ) Pr
- Pr, ) = 1| = 0, = ) Pr( = 0, = )
- Pr, ) = 0| = 0, = ) Pr( = 0, = )
- Pr, ) = 1| = 1, = ) Pr
Cited by
How Structural Racism Works — Racist Policies as a Root Cause of U.S. Racial Health Inequities
Bailey, Z. D., Feldman, J. M., & Bassett, M. T. (2021) · New England Journal of Medicine · doi:10.1056/nejmms2025396 · Cited by 1,598
Risk of being killed by police use of force in the United States by age, race–ethnicity, and sex
Edwards, F., Lee, H., & Esposito, M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821204116 · Cited by 916
What Is Your Estimand? Defining the Target Quantity Connects Statistical Evidence to Theory
Lundberg, I., Johnson, R., & Stewart, B. M. (2021) · American Sociological Review · doi:10.1177/00031224211004187 · Cited by 364
The Effects of Police Violence on Inner-City Students*
Ang, D. (2020) · The Quarterly Journal of Economics · doi:10.1093/qje/qjaa027 · Cited by 226
Race Discrimination: An Economic Perspective
Lang, K., & Spitzer, A. K.-L. (2020) · Journal of Economic Perspectives · doi:10.1257/jep.34.2.68 · Cited by 220
Metadata
- Authors
- Knox, D., Lowe, W., & Mummolo, J.
- Affiliations
- Princeton University (US)
- Hertie School (DE)
- Corresponding author
- Knox, Dean
- Lowe, Will
- Mummolo, Jonathan
- Venue
- American Political Science Review
- Publisher
- Elsevier BV
- Published
- 2019
- Volume
- 114
- Issue
- 3
- Pages
- 619-637
- ISSN
- 0003-0554 (ISSN-L)
- OpenAlex
- W3122864926
- Cited by
- 314
- References
- 109
- Citations by year
- 2026: 39 · 2025: 39 · 2024: 47 · 2023: 68 · 2022: 48 · 2021: 34 · 2020: 33 · 2019: 5
- FWCI
- 161.39
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- American Political Science Review (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- PhilPapers (PhilPapers Foundation) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- OPUS 4 (Zuse Institute Berlin) (submittedVersion)
- Topics
- Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Keywords
- racial discrimination in policing, administrative records, statistical bias, principal stratification, causal mediation analysis, bias correction, sharp bounds, unobserved heterogeneity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.