Administrative Records Mask Racially Biased Policing
Open accessThe DOI matches its Crossref record; 115 of the 116 references it cites were found in a registry or an index; 13 of the 33 sources its claims cite were checked for support.
Abstract
Researchers often lack the necessary data to credibly estimate racial discrimination in policing. In particular, police administrative records lack information on civilians police observe but do not investigate. In this article, we show that if police racially discriminate when choosing whom to investigate, analyses using administrative records to estimate racial discrimination in police behavior are statistically biased, and many quantities of interest are unidentified—even among investigated individuals—absent strong and untestable assumptions. Using principal stratification in a causal mediation framework, we derive the exact form of the statistical bias that results from traditional estimation. We develop a bias-correction procedure and nonparametric sharp bounds for race effects, replicate published findings, and show the traditional estimator can severely underestimate levels of racially biased policing or mask discrimination entirely. We conclude by outlining a general and feasible design for future studies that is robust to this inferential snare.
Overview
CoChat Summary
## TL;DR
The paper argues that analyses using police administrative records can systematically misstate racial bias because the data only include people police chose to stop, making the observed sample itself a product of potentially discriminatory selection. Using principal stratification and a causal mediation framework, the authors derive the bias, propose bounds and a bias-correction strategy, and show in a reanalysis of NYPD data that conventional estimates can dramatically understate racially discriminatory use of force.
## Key findings
- If police discriminate when deciding whom to stop, then estimates based only on stopped individuals are statistically biased; the paper says the bias is always negative, so naïve estimates understate racially discriminatory police violence.
- In their reanalysis of Fryer (2019) using NYPD Stop, Question and Frisk data from 2003–13, the paper says the naïve approach suggested only about 10,000 black and Hispanic civilians were handcuffed because of racial bias, while the bias-corrected estimate is approximately 56,000.
- For uses of force against black and Hispanic civilians in those data, the paper says the naïve estimate implied 10% were discriminatory, while the bias-corrected estimate is 39%.
- In one example, the naïve approach implied 2.4 instances per 1,000 encounters of pushing Hispanic suspects to a wall due to suspect race, while the revised estimate was at least 26 per 1,000 encounters.
## Methods
- The paper uses a principal stratification / causal mediation framework to define quantities of interest, derive the exact form of bias from conventional estimation, and distinguish estimates among stopped encounters from the overall causal effect of race.
- It proposes nonparametric sharp bounds for the average treatment effect among stops and the average treatment effect on the treated, and a bias-correction procedure based on an estimated share of racially discriminatory stops.
- It reanalyzes and extends Fryer (2019) using the NYPD Stop, Question and Frisk database (2003–13), which the paper says contains roughly 5 million pedestrian stop records, and compares naïve versus bias-corrected estimates across force thresholds.
## Limitations
- The paper explicitly says its bias-correction and bounding methods still rely on weaker assumptions that can be difficult to verify, and that some key quantities remain only partially identified without additional data.
- It states that point identification of the ATE requires additional data on unreported encounters; police administrative records alone are “virtually uninformative” about the unobserved proportion of discriminatory stops.
- Evident from the text: the reanalysis depends on assumptions about the proportion of discriminatory stops, including a conservative estimate from prior work, so corrected estimates still depend on an externally supplied sensitivity parameter.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
11 Valid · 5 Not valid · 15 Not checked · 114 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Replicating and extending the study of police behavior in New York in Fryer (2019), we show that the consequences of ignoring the selective process that generates police data are severe, leading analysts to dramatically underestimate or conceal entirely the differential police violence faced by civilians of color.”
What the sources say
- Could not verifycites Fryer 2019 sourceExperimental — accuracy not yet measured
The cited work is Fryer and Toros’s *Viktor Simov*, not Roland Fryer’s 2019 study of police behavior. Two paper-scoped searches returned no snippets, and we do not hold its full text. Semantic Scholar snippets from other policing papers discuss selection bias and identify Knox, Lowe, and Mummolo’s work as relevant, but none provides the high-confidence matching text required to establish a specific misattribution under this rubric. (LLM, conf=0.72)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Knox and Mummolo(2020)showthat this conclusion rests on the erroneous assumption that police encounter minority and white civilians in equal number.”
What the sources say
- Partly supportedcites Knox and Mummolo 2020 sourceExperimental — accuracy not yet measured
In “Making inferences about racial disparities in police violence” (page unavailable), the authors say Johnson et al. did not account for how many minority or White civilians police encounter, so its data cannot support the claimed comparison of shooting rates. The paper does not say Johnson et al. assumed equal numbers of encounters or establish that such an assumption is false. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Using the SQF data and controlling for precinct, suspected crime, and prior local arrest rates by race, Gelman, Fagan, and Kiss (2007) produce estimates that -by our calculations -imply 32% of black-civilian stops made by the NYPD could not be explained even by differential criminality between racial groups of suspects, as proxied by prior arrest rates.”
What the sources say
- Partly supportedcites Gelman, Fagan, and Kiss (2007) sourceExperimental — accuracy not yet measured
Section 5.1 reports estimates by suspected crime and precinct showing that, relative to prior arrests, Black civilians were stopped more often than white civilians for the most common stop categories. Section 6 concludes that prior arrest rates and precinct do not explain the disparities. The cited paper does not give or verify the citing authors’ calculation that 32% of all Black-civilian stops were unexplained. (LLM, conf=0.81)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Using a fl exible logistic regression to adjust for a vast array of indicators visible to of fi cers prestop, the study shows that white hit rates exceeded those of ' similarly situated ' black civilians.”
What the sources say
- Supportedcites Goel, Rao, and Shroff (2016) source
The Results (p. 15) describe using logistic regression to estimate hit rates for hypothetical similarly situated whites while preserving other aspects of stops of black civilians. They report a 3.8% hit rate for similarly situated whites versus 2.5% for black civilians. (LLM, conf=0.95)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To state this more formally, note that the na¨ ı ve estimator recovers the weighted combination of violence rates in observed principal strata:”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
60 more claims
Create a free account to see all 145 claims and to verify the 7 references still open.
- It may state two separate claims as one. 33
- Probably not a substantial claim. 54
- The quote only partly states this claim. 2
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“10.1073/pnas.1903856116”
Cited work 10.1073/pnas.1903856116 · retracted 2020-07-10 · notice 10.1073/pnas.2014148117 · this paper published 2020-05-21
Citations
Cites
1 retracted
RETRACTED: Officer characteristics and racial disparities in fatal officer-involved shootings
Johnson, D. J., Tress, T., Burkel, N., Taylor, C., & Cesario, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1903856116 · Cited by 83
RetractedSample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“We ground our analysis in the potential outcomes framework (Rubin 1974) often used in the study of causal mediation (Imai et al. 2011; Pearl 2001).”
Street-Level Bureaucracy: Dilemmas of the Individual in Public Services
Lipsky, M. (1981) · Michigan Law Review · doi:10.2307/1288305 · Cited by 8,981
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
The new Jim Crow: mass incarceration in the age of colorblindness
(2010) · Choice Reviews Online · doi:10.5860/choice.48-1766 · Cited by 4,407
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Bureaucracy: what government agencies do and why they do it
(1990) · Choice Reviews Online · doi:10.5860/choice.27-4796 · Cited by 3,795
Is Anyone Responsible?: How Television Frames Political Issues
Iyengar, S. (1991) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226388533.001.0001 · Cited by 3,722
The Statistical Theory of Racism and Sexism.
Phelps, E. S. (1972) · American Economic Review · Cited by 3,412
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 1×
“Aswe show in this article, the dif fi culty of estimating racial bias using police records stems from a thorny combination of mediation (Hern´an, Hern´andez-Di´az, and Robins 2004; Imai et al. 2011; Pearl 2001; Robins, Hern´an, and Brumback 2000; VanderWeele 2009) and selection (Heckman 1979; Lee…”
The Economics of Discrimination
Leonard, R. C., & Becker, G. S. (1957) · The American Catholic Sociological Review · doi:10.2307/3708738 · Cited by 2,818
The New Jim Crow: Mass Incarceration in the Age of Colorblindness
Hauhart, R. C. (2011) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306111419111 · Cited by 2,732
Street-Level Bureaucracy: The Dilemmas of the Individual in Public Service
Lipsky, M. (1980) · Project Muse (Johns Hopkins University) · Cited by 2,135
Politics : Who Gets What, When, How
Fromm, E., & Sozialforschung, I. F. (1937) · Zeitschrift für Sozialforschung · doi:10.5840/zfs193761185 · Cited by 1,909
The Economics of Discrimination
Becker, G. S. (1971) · doi:10.7208/chicago/9780226041049.001.0001 · Cited by 1,794
Identifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793
Southern Politics in State and Nation, by V. O. Key, Jr., Alexander Heard
Sydnor, C. S. (1950) · Political Science Quarterly · doi:10.2307/2144283 · Cited by 1,737
IMAI, K., KEELE, L., TINGLEY, D., & YAMAMOTO, T. (2011) · American Political Science Review · doi:10.1017/s0003055411000414 · Cited by 1,537
Principal Stratification in Causal Inference
Frangakis, C. E., & Rubin, D. B. (2002) · Biometrics · doi:10.1111/j.0006-341x.2002.00021.x · Cited by 1,511
Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects
LEE, D. S. (2009) · Review of Economic Studies · doi:10.1111/j.1467-937x.2009.00536.x · Cited by 1,399
Seeing Black: Race, Crime, and Visual Processing.
Eberhardt, J. L., Goff, P. A., Purdie, V. J., & Davies, P. G. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.6.876 · Cited by 1,208 · cited 2×
“…literature attempts to parse “ taste-based discrimination ” (racial animus) from so-called “ statistical discrimination ” (Arrow 1972, 1998; Becker 1971; Eberhardt et al. 2004; Phelps 1972) as mechanisms for racially biased policing, and instead focuses on recovering the causal effect of…”
Endogenous Selection Bias: The Problem of Conditioning on a Collider Variable
Elwert, F., & Winship, C. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043455 · Cited by 1,168 · cited 2×
“At the fi rst glance, the problem of race-based selection into policing data may appear a classic case of sample selection bias (Elwert and Winship 2014; Heckman 1979) for which numerous remedies already exist.”
Identification Problems in the Social Sciences
Manski, C. F. (1993) · Sociological Methodology · doi:10.2307/271005 · Cited by 1,130
Varieties of Police Behavior: The Management of Law and Order in Eight Communities
Wilson, J. Q. (1968) · doi:10.4159/9780674045200 · Cited by 1,076
Pearl, J. (2022) · Probabilistic and Causal Inference · doi:10.1145/3501714.3501736 · Cited by 1,033
Risk of being killed by police use of force in the United States by age, race–ethnicity, and sex
Edwards, F., Lee, H., & Esposito, M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821204116 · Cited by 916 · cited 1×
“The fi eld ’ s relative inattention to policing was made evident by several recent of fi cer-involved shootings of unarmed black men (Edwards, Lee, and Esposito 2019) and subsequent social unrest that caught many political scientists fl atfooted, with little systematic evidence to offer as the demand…”
Gelman, A., Fagan, J., & Kiss, A. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001040 · Cited by 873
The Consquences of Adjustment for a Concomitant Variable That Has Been Affected by the Treatment
Rosenbaum, P. R. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981697 · Cited by 849
Politics: Who Gets What, When, How
Lasswell, H. D. (2011) · Medical Entomology and Zoology · Cited by 806
Southern Politics in State and Nation
Hesseltine, W. B., Key, V. O., & Heard, A. (1950) · The American Historical Review · doi:10.2307/1841217 · Cited by 798
Working, Shirking, and Sabotage: Bureaucratic Response to a Democratic Public
Brehm, J., & Gates, S. (1997) · University of Michigan Press eBooks · doi:10.3998/mpub.15149 · Cited by 726
What Has Economics to Say About Racial Discrimination?
Arrow, K. J. (1998) · Journal of Economic Perspectives · doi:10.1257/jep.12.2.91 · Cited by 679
Racial discrimination in economic life
Pascal, A. H. (1972) · Medical Entomology and Zoology · Cited by 670
Murphy, P. V., & Wilson, J. Q. (1970) · Harvard Law Review · doi:10.2307/1339697 · Cited by 630
Racial Bias in Motor Vehicle Searches: Theory and Evidence
Knowles, J., Persico, N., & Todd, P. (2001) · Journal of Political Economy · doi:10.1086/318603 · Cited by 608
Identification problems in the social sciences
(1994) · Mathematical Social Sciences · doi:10.1016/0165-4896(94)90027-2 · Cited by 608
Soss, J., & Weaver, V. (2017) · Annual Review of Political Science · doi:10.1146/annurev-polisci-060415-093825 · Cited by 591 · cited 2×
“As Soss and Weaver (2017) note, the fi eld ’ s limited store of relevant knowledge in the aftermath of these events was especially glaring given law enforcement ’ s role as an everyday conduit of state power.”
Marginal Structural Models for the Estimation of Direct and Indirect Effects
VanderWeele, T. J. (2009) · Epidemiology · doi:10.1097/ede.0b013e31818f69ce · Cited by 583 · cited 3×
“To formalize the limitations of the na¨ ı ve estimator, we begin by partitioning the population into principal strata with respect to the mediator (Frangakis and Rubin 2002; VanderWeele 2011).”
Bounds on Treatment Effects from Studies with Imperfect Compliance
Balke, A., & Pearl, J. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474074 · Cited by 564
Is anyone responsible?: how television frames political issues
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4312 · Cited by 560
Explaining Causal Findings Without Bias: Detecting and Assessing Direct Effects
ACHARYA, A., BLACKWELL, M., & SEN, M. (2016) · American Political Science Review · doi:10.1017/s0003055416000216 · Cited by 532
Formal mode of statistical inference for causal effects
Rubin, D. B. (1990) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(90)90077-8 · Cited by 483
Arresting Citizenship: The Democratic Consequences of American Crime Control
Lerman, A. E., & Weaver, V. M. (2014) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226137971.001.0001 · Cited by 459
Who Gets a Swiss Passport? A Natural Experiment in Immigrant Discrimination
HAINMUELLER, J., & HANGARTNER, D. (2013) · American Political Science Review · doi:10.1017/s0003055412000494 · Cited by 433
Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (2001)
Breese, J. S., & Koller, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.4607 · Cited by 428
Nonparametric Analysis of Randomized Experiments with Missing Covariate and Outcome Data
Horowitz, J. L., & Manski, C. F. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473902 · Cited by 427
Race as a Bundle of Sticks: Designs that Estimate Effects of Seemingly Immutable Characteristics
Sen, M., & Wasow, O. (2016) · Annual Review of Political Science · doi:10.1146/annurev-polisci-032015-010015 · Cited by 422
Racial Bias in Bail Decisions*
Arnold, D., Dobbie, W., & Yang, C. S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjy012 · Cited by 387
Working, shirking, and sabotage: bureaucratic response to a democratic public
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0563 · Cited by 375
An Empirical Analysis of Racial Differences in Police Use of Force
Fryer, R. G. (2019) · Journal of Political Economy · doi:10.1086/701423 · Cited by 343
A Bird's Eye View of Civilians Killed by Police in 2015: Further Evidence of Implicit Bias
Nix, J., Campbell, B. A., Byers, E. H., & Alpert, G. P. (2017) · Criminology & Public Policy · doi:10.1111/1745-9133.12269 · Cited by 336 · cited 1×
“These studies consider a range of outcomes including ticketing, stop duration, searches, and the use of force (e.g., Antonovics and Knight 2009; Fryer 2019; Ridgeway 2006; Nix et al. 2017).”
Zhang, J. L., & Rubin, D. B. (2003) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986028004353 · Cited by 308
An Alternative Test of Racial Prejudice in Motor Vehicle Searches: Theory and Evidence
Anwar, S., & Fang, H. (2006) · American Economic Review · doi:10.1257/000282806776157579 · Cited by 293
A New Look at Racial Profiling: Evidence from the Boston Police Department
Antonovics, K., & Knight, B. G. (2009) · Review of Economics and Statistics · doi:10.1162/rest.91.1.163 · Cited by 292
Precinct or prejudice? Understanding racial disparities in New York City’s stop-and-frisk policy
Goel, S., Rao, J. M., & Shroff, R. (2016) · The Annals of Applied Statistics · doi:10.1214/15-aoas897 · Cited by 285 · cited 8×
“16 Using SQF data from 2008 – 12, Goel, Rao, and Shroff (2016) es-timateahitrateof3.”
InfluentialArresting Citizenship: The Democratic Consequences of American Crime Control
Lerman, A. E., & Weaver, V. M. (2014) · Cited by 281
Equity and Discretionary Justice: The Influence of Race on Police Arrest Decisions
Smith, D. A., Visher, C. A., & Davidson, L. A. (1984) · The Journal of Criminal Law and Criminology (1973-) · doi:10.2307/1143211 · Cited by 266
Testing for Racial Profiling in Traffic Stops From Behind a Veil of Darkness
Grogger, J., & Ridgeway, G. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000168 · Cited by 260 · cited 1×
“Grogger and Ridgeway (2006), for example, leverage the so-called “ veilofdarkness ” strategy, comparingpatternsintraf fi c stops that occur before and after sunset under the logic that the race of the driver is plausibly hidden to police of fi cers after dark.”
A field experiment on community policing and police legitimacy
Peyton, K., Sierra-Arévalo, M., & Rand, D. G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910157116 · Cited by 254
Killing in the Slums: Social Order, Criminal Governance, and Police Violence in Rio de Janeiro
MAGALONI, B., FRANCO-VIVANCO, E., & MELO, V. (2020) · American Political Science Review · doi:10.1017/s0003055419000856 · Cited by 253
An Empirical Analysis of Racial Differences in Police Use of Force
Fryer, R. (2016) · doi:10.3386/w22399 · Cited by 238
Militarization fails to enhance police safety or reduce crime but may harm police reputation
Mummolo, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1805161115 · Cited by 231
Self-citationDoes water kill? A call for less casual causal inferences
Hernán, M. A. (2016) · Annals of Epidemiology · doi:10.1016/j.annepidem.2016.08.016 · Cited by 219
Burch, T. R. (2013) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226065090.001.0001 · Cited by 214
Assessing the Effect of Race Bias in Post-traffic Stop Outcomes Using Propensity Scores
Ridgeway, G. (2006) · Journal of Quantitative Criminology · doi:10.1007/s10940-005-9000-9 · Cited by 176 · cited 1×
“…examples represent a mere fraction of a decades-long, multidisciplinary effort to quantify the degree to which police discriminate against civilians of color [see Atiba Goff and Kahn (2012), Fridell (2017), and Ridgeway and MacDonald (2010) for more extensive reviews of this empirical literature].”
A Test of Racial Bias in Capital Sentencing
Alesina, A., & La Ferrara, E. (2014) · American Economic Review · doi:10.1257/aer.104.11.3397 · Cited by 169
Modern Police Tactics, Police-Citizen Interactions, and the Prospects for Reform
Mummolo, J. (2018) · The Journal of Politics · doi:10.1086/694393 · Cited by 161
Self-citationOutcome Tests of Racial Disparities in Police Practices
Ayres, I. (2002) · Justice Research and Policy · doi:10.3818/jrp.4.1.2002.131 · Cited by 156
The problem of infra-marginality in outcome tests for discrimination
Simoiu, C., Corbett-Davies, S., & Goel, S. (2017) · The Annals of Applied Statistics · doi:10.1214/17-aoas1058 · Cited by 154
Does Local Community Control of Police make a Difference? Some Preliminary Findings
Ostrom, E., & Whitaker, G. (1973) · American Journal of Political Science · doi:10.2307/2110474 · Cited by 154
Hiding in Plain Sight: American Politics and the Carceral State
Gottschalk, M. (2008) · Annual Review of Political Science · doi:10.1146/annurev.polisci.11.060606.135218 · Cited by 136 · cited 1×
“Viewed in this way, the role of race in the state ’ s exercise of violence, as well as in the provision of safety more broadly, is inherently political (Alexander 2010; Gottschalk 2008; Key 1949).”
Racial Bias in Motor Vehicle Searches: Theory and Evidence
Knowles, J., Persico, N., & Todd, P. (1999) · National Bureau of Economic Research · doi:10.3386/w7449 · Cited by 132
Principal Stratification -- Uses and Limitations
VanderWeele, T. J. (2011) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1329 · Cited by 131
Causal Inference Without Counterfactuals: Comment
Robins, J. M., & Greenland, S. (2000) · Journal of the American Statistical Association · doi:10.2307/2669381 · Cited by 130
Causal Empiricism in Quantitative Research
Samii, C. (2016) · The Journal of Politics · doi:10.1086/686690 · Cited by 127
Causal Inference Without Counterfactuals: Comment
Rubin, D. B. (2000) · Journal of the American Statistical Association · doi:10.2307/2669382 · Cited by 122
A Framework for Dynamic Causal Inference in Political Science
Blackwell, M. (2013) · American Journal of Political Science · doi:10.1111/j.1540-5907.2012.00626.x · Cited by 116
Causal Effects of Perceived Immutable Characteristics
Greiner, D. J., & Rubin, D. B. (2011) · Review of Economics and Statistics · doi:10.1162/rest_a_00110 · Cited by 114
(2002) · The Hidden Curriculum in Higher Education · doi:10.4324/9780203901854-4 · Cited by 113
Suspect Race: Causes and Consequences of Racial Profiling
Glaser, J. (2014) · Cited by 105
Misdemeanor Disenfranchisement? The Demobilizing Effects of Brief Jail Spells on Potential Voters
WHITE, A. (2019) · American Political Science Review · doi:10.1017/s000305541800093x · Cited by 102
An Alternative Test of Racial Prejudice in Motor Vehicle Searches: Theory and Evidence
Anwar, S., & Fang, H. (2005) · National Bureau of Economic Research · doi:10.3386/w11264 · Cited by 92
Killing in the Slums: An Impact Evaluation of Police Reform in Rio de Janeiro
Magaloni, B., Melo, V., & Franco, E. S. (2015) · Cited by 82
Racial Bias in Policing: Why We Know Less Than We Should
Atiba Goff, P., & Barsamian Kahn, K. (2012) · Social Issues and Policy Review · doi:10.1111/j.1751-2409.2011.01039.x · Cited by 79
Baumgartner, F. R., Epp, D. A., Shoub, K., & Love, B. (2017) · Politics, Groups, and Identities · doi:10.1080/21565503.2016.1160413 · Cited by 79
Precinct or Prejudice? Understanding Racial Disparities in New York City's Stop-and-Frisk PolicyPreprint
Goel, S., Rao, J. M., & Shroff, R. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2572718 · Cited by 76
Burch, T. R. (2013) · Cited by 73
Lange, J. E., Johnson, M. B., & Voas, R. B. (2005) · Justice Quarterly · doi:10.1080/07418820500088952 · Cited by 72
Does Obesity Shorten Life? Or is it the Soda? On Non-manipulable Causes
Pearl, J. (2018) · Journal of Causal Inference · doi:10.1515/jci-2018-2001 · Cited by 71
Differential Registration Bias in Voter File Data: A Sensitivity Analysis Approach
Nyhan, B., Skovron, C., & Titiunik, R. (2017) · American Journal of Political Science · doi:10.1111/ajps.12288 · Cited by 68
A Critique of the “Outcome Test” in Racial Profiling Research
Engel, R. S. (2008) · Justice Quarterly · doi:10.1080/07418820701717177 · Cited by 64
Racial bias in police use of lethal force in Brazil
Cano, I. (2010) · Police Practice and Research · doi:10.1080/15614260802586350 · Cited by 59
Making inferences about racial disparities in police violence
Knox, D., & Mummolo, J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919418117 · Cited by 55
Self-citationReconciling Results on Racial Differences in Police Shootings
Fryer, R. G. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181004 · Cited by 51
Do Officer-Involved Shootings Reduce Citizen Contact with Government?
Cohen, E., Gunderson, A., Jackson, K., McLachlan, P., Clark, T. S., Glynn, A. N., & Owens, M. L. (2019) · The Journal of Politics · doi:10.1086/703539 · Cited by 51
Fridell, L. A. (2016) · American Journal of Criminal Justice · doi:10.1007/s12103-016-9378-y · Cited by 50
Methods for Assessing Racially Biased Policing
Ridgeway, G., & MacDonald, J. (2010) · New York University Press eBooks · doi:10.18574/nyu/9780814776155.003.0007 · Cited by 50
Suspect Race: Causes and Consequences of Racial Profiling
Glaser, J. (2014) · doi:10.1093/acprof:oso/9780195370409.001.0001 · Cited by 47
German policing at the intersection: race, gender, migrant status and mental health
Bruce-Jones, E. (2015) · Race & Class · doi:10.1177/0306396814556223 · Cited by 45
Understanding the Past: Statistical Analysis of Causal Attribution
Yamamoto, T. (2011) · American Journal of Political Science · doi:10.1111/j.1540-5907.2011.00539.x · Cited by 43
Design, Identification, and Sensitivity Analysis for Patient Preference Trials
Knox, D., Yamamoto, T., Baum, M., & Berinsky, A. J. (2019) · Journal of the American Statistical Association · doi:10.1080/01621459.2019.1585248 · Cited by 42
Self-citationPolice supervision on the street: An analysis of supervisor/officer interaction during the shift
Allen, D. N. (1982) · Journal of Criminal Justice · doi:10.1016/0047-2352(82)90001-0 · Cited by 32
Methods for Assessing Racially Biased Policing
Ridgeway, G. K., & MacDonald, J. M. (2010) · NYU Press eBooks · doi:10.7249/rp1427 · Cited by 28
Reconciling Results on Racial Differences in Police Shootings
Fryer, R. G. (2018) · National Bureau of Economic Research · doi:10.3386/w24238 · Cited by 14
The Problem of Infra-Marginality in Outcome Tests for DiscriminationPreprint
Simoiu, C., Corbett‐Davies, S., & Goel, S. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2811449 · Cited by 6
The Political Economy of Traffic DeathsPreprint
DeAngelo, G. J., Harvey, A., & Mungan, M. C. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3197705 · Cited by 4
Militarization Fails to Enhance Police Safety or Reduce Crime, But May Harm Police Reputation
Mummolo, J. (2018) · Harvard Dataverse · doi:10.7910/dvn/vypuvc · Cited by 4
Self-citationImai, K., Keele, L. J., Tingley, D. H., & Yamamoto, T. (2011) · Harvard Dataverse · doi:10.7910/dvn/x73i3j · Cited by 1
White, A. R. (2018) · Harvard Dataverse · doi:10.7910/dvn/twvxkz
Causal Empiricism in Quantitative Research
Samii, C. (2016) · Harvard Dataverse · doi:10.7910/dvn/uctown
"Modern Police Tactics, Police-Citizen Interactions and the Prospects for Reform
Mummolo, J. (2017) · Harvard Dataverse · doi:10.7910/dvn/t9wesh
Self-citationRisk of being killed by police use of force in the United States by age, race–ethnicity, and sex
Edwards, F., Lee, H., & Esposito, M. H. (2019) · doi:10.31235/osf.io/kw9cu
Research works printed but not linked: 1
- Kocieniewski, 2002, Study Suggests Racial Gap in Speeding in New Jersey
Cited by
How Structural Racism Works — Racist Policies as a Root Cause of U.S. Racial Health Inequities
Bailey, Z. D., Feldman, J. M., & Bassett, M. T. (2021) · New England Journal of Medicine · doi:10.1056/nejmms2025396 · Cited by 1,598
Risk of being killed by police use of force in the United States by age, race–ethnicity, and sex
Edwards, F., Lee, H., & Esposito, M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821204116 · Cited by 916
What Has Economics to Say About Racial Discrimination?
Arrow, K. J. (1998) · Journal of Economic Perspectives · doi:10.1257/jep.12.2.91 · Cited by 679
What Is Your Estimand? Defining the Target Quantity Connects Statistical Evidence to Theory
Lundberg, I., Johnson, R., & Stewart, B. M. (2021) · American Sociological Review · doi:10.1177/00031224211004187 · Cited by 364
The Effects of Police Violence on Inner-City Students*
Ang, D. (2020) · The Quarterly Journal of Economics · doi:10.1093/qje/qjaa027 · Cited by 226
Metadata
- Authors
- KNOX, D., LOWE, W., & MUMMOLO, J.
- Affiliations
- Princeton University (US)
- Hertie School (DE)
- Corresponding author
- KNOX, DEAN
- LOWE, WILL
- MUMMOLO, JONATHAN
- Venue
- American Political Science Review
- Publisher
- Cambridge University Press (CUP)
- Published
- 2020-05-21
- Volume
- 114
- Issue
- 3
- Pages
- 619-637
- ISSN
- 0003-0554 (ISSN-L)
- 1537-5943
- OpenAlex
- W3122864926
- Cited by
- 314
- References
- 115
- Citations by year
- 2026: 39 · 2025: 39 · 2024: 47 · 2023: 68 · 2022: 48 · 2021: 34 · 2020: 33
- FWCI
- 161.39
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- American Political Science Review (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- PhilPapers (PhilPapers Foundation) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- OPUS 4 (Zuse Institute Berlin) (submittedVersion)
- Topics
- Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Keywords
- racial discrimination in policing, administrative records, statistical bias, principal stratification, causal mediation analysis, bias correction, sharp bounds, unobserved heterogeneity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.