CoChat

Racial Disparities in Police Use of Deadly Force Against Unarmed Individuals Persist After Appropriately Benchmarking Shooting Data on Violent Crime Rates

Open access
Ross, Cody T., Winterhalder, Bruce, McElreath, Richard · 2021 · Social Psychological and Personality Science

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index; 13 of the 43 sources its claims cite were checked for support.

Abstract

Cesario et al. argue that benchmarking the relative counts of killings by police on relative crime rates, rather than relative population sizes, generates a measure of racial disparity in the use of lethal force that is unbiased by differential crime rates. Their publication, however, lacked any formal derivation showing that their benchmarking methodology has the statistical properties required to establish such a claim. We use the causal model of lethal force by police conditional on relative crime rates implicit in their analyses and prove that their benchmarking methodology does not, in general, remove the bias introduced by crime rate differences. Instead, it creates strong statistical biases that mask true racial disparities, especially in the killing of unarmed noncriminals by police. Reanalysis of their data using formally derived criminality-correcting benchmarks shows that there is strong and statistically reliable evidence of anti-Black racial disparities in the killing of unarmed Americans by police in 2015–2016.

Overview

CoChat Summary

TL;DR

The paper formally evaluates Cesario et al.’s crime-rate benchmarking method for police deadly force and shows it does not remove crime-rate bias, instead biasing estimates in ways that can mask anti-Black disparities, especially for unarmed noncriminals. Reanalyzing the same 2015–2016 data with corrected benchmarks, the authors find strong evidence of anti-Black disparities in police killings of unarmed civilians, while armed-suspect disparities track violent crime rates.

Key findings

  • Formal derivation shows Cesario et al.’s benchmark does not generally yield unbiased estimates; it can create stronger statistical biases that mask true racial disparities, especially in killings of unarmed noncriminals. Using NCVS 2016 violent crime data, the bias would multiply the true anti-Black disparity by approximately 0.38; if unarmed, noncriminal Black individuals were 2.6 times more likely to be killed by police than unarmed, noncriminal White individuals, the Cesario et al. methodology would suggest no racial disparities.
  • Reanalysis with corrected criminality benchmarks finds substantial evidence of anti-Black racial disparities in police killings of unarmed civilians across all crime benchmarks in both 2015 and 2016.
  • For armed suspects, the authors recover Cesario et al.’s principal finding: racial disparities in the killing of armed suspects are proportional to relative rates of violent criminality. NCVS data suggest almost perfect proportionality, whereas NIBRS data suggest White suspects are killed at greater rates than expected relative to their violent crime rates.
  • NIBRS data show greater racial differences in crime rates than NCVS data across almost all years and crime classifications; benchmarking on NIBRS may underestimate anti-Black disparities in police use-of-force.

Methods

  • The authors build a formal causal/generative model of police killings conditional on race and criminality, derive expected relative risks under population-size and crime-rate benchmarks, and prove the bias properties of Cesario et al.’s methodology.
  • Data on civilian killings by police come from “The Counted” (The Guardian, 2015–2016), with “unarmed and nonaggressing” data as presented in Cesario et al. Crime benchmarks come from NIBRS and NCVS for violent crimes (major), violent crimes (minor), and weapons violations.
  • Bayesian statistical models are coded in Stan and fit using R and rstan; the analysis compares posterior distributions of the relative probability of Black versus White individuals being killed by police, with central 90% credible intervals.

Limitations

  • Paper-stated: the causal model assumes armed individuals killed by police come from the criminal subpopulation and unarmed individuals come from the noncriminal subpopulation; the authors note this is unlikely to exactly hold in empirical data, though they expect a strong correlation.
  • Paper-stated: NIBRS compliance is variable and may be nonrandom; NIBRS data may be biased by differential policing and reporting, so benchmarking on NIBRS may underestimate anti-Black disparities.
  • Evident from the text: the analysis relies on observational police killing data and crime benchmarks that cannot directly measure encounter contexts or officer-level bias, so causal conclusions depend on model assumptions; the “unarmed and nonaggressing” coding was done by Cesario et al.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1177/1948550620916071

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Analysis of data on killings by police from 'The Counted,' 2015 (blue) and 2016 (orange), using benchmarking on population size. Note . Density curves show the natural log of the posterior distributions of the relative probability (for Black individuals relative to White individuals) of being killed by police. Values greater than 0 indicate anti-Black racial disparity, and values less than 0 indicate anti-White racial disparity. Central 90% credible intervals are represented by darker vertical bars on the distributions. Across armed and unarmed subpopulations and encounter types, we find robust evidence of anti-Black racial disparities in killings by police. Panel positions without curves indicate categories not considered in our analysis.
Figure 1 Analysis of data on killings by police from 'The Counted,' 2015 (blue) and 2016 (orange), using benchmarking on population size. Note . Density curves show the natural log of the posterior distributions of the relative probability (for Black individuals relative to White individuals) of being killed by police. Values greater than 0 indicate anti-Black racial disparity, and values less than 0 indicate anti-White racial disparity. Central 90% credible intervals are represented by darker vertical bars on the distributions. Across armed and unarmed subpopulations and encounter types, we find robust evidence of anti-Black racial disparities in killings by police. Panel positions without curves indicate categories not considered in our analysis.CC-BY · From the PDF
Figure 2 Analysis of data on killings of armed suspects by police from 'The Counted,' 2015 (blue) and 2016 (orange), using crime rate benchmarking. Note . Density curves show the natural log of the posterior distributions of the relative probability (for Black individuals relative to White individuals) of being killed by police. Values greater than 0 indicate anti-Black racial disparity, and values less than 0 indicate anti-White racial disparity. Central 90% credible intervals are represented by darker vertical bars on the distributions. Panel positions without curves indicate categories not considered in our analysis. Across crime rate benchmarks using National Crime Victimization Survey data, we find that there is no evidence of anti-Black racial disparity in police killings of armed individuals after differential crime rates have been accounted for. National Incident-Based Reporting System (NIBRS) crime rate data actually suggest anti-White racial disparities but see issues with the NIBRS data in Figure 3.
Figure 2 Analysis of data on killings of armed suspects by police from 'The Counted,' 2015 (blue) and 2016 (orange), using crime rate benchmarking. Note . Density curves show the natural log of the posterior distributions of the relative probability (for Black individuals relative to White individuals) of being killed by police. Values greater than 0 indicate anti-Black racial disparity, and values less than 0 indicate anti-White racial disparity. Central 90% credible intervals are represented by darker vertical bars on the distributions. Panel positions without curves indicate categories not considered in our analysis. Across crime rate benchmarks using National Crime Victimization Survey data, we find that there is no evidence of anti-Black racial disparity in police killings of armed individuals after differential crime rates have been accounted for. National Incident-Based Reporting System (NIBRS) crime rate data actually suggest anti-White racial disparities but see issues with the NIBRS data in Figure 3.CC-BY · From the PDF
Figure 3 A contrast between the National Crime Victimization Survey (NCVS) and the National Incident-Based Reporting System (NIBRS) regarding crime rate differences in 2015 (blue) and 2016 (orange). Note . Density curves show the natural log of the posterior distributions of the ratio of relative crime rates, as NIBRS over NCVS. Values greater than 0 indicate higher Black crime rates in the NIBRS data than the NCVS data, and values less than 0 indicate the opposite. Central 90% credible intervals are represented by darker vertical bars on the distributions. We find evidence that across most years and crime classifications, NIBRS data show higher rates of crime being committed by Black individuals than is apparent from NCVS data.
Figure 3 A contrast between the National Crime Victimization Survey (NCVS) and the National Incident-Based Reporting System (NIBRS) regarding crime rate differences in 2015 (blue) and 2016 (orange). Note . Density curves show the natural log of the posterior distributions of the ratio of relative crime rates, as NIBRS over NCVS. Values greater than 0 indicate higher Black crime rates in the NIBRS data than the NCVS data, and values less than 0 indicate the opposite. Central 90% credible intervals are represented by darker vertical bars on the distributions. We find evidence that across most years and crime classifications, NIBRS data show higher rates of crime being committed by Black individuals than is apparent from NCVS data.CC-BY · From the PDF
Figure 4 Analysis of data on killings of unarmed suspects by police from 'The Counted,' 2015 (blue) and 2016 (orange), using crime rate benchmarking. Note . Density curves show the natural log of the posterior distributions of the relative probability (for Black individuals relative to White individuals) of being killed by police. Values greater than 0 indicate anti-Black racial disparity, and values less than 0 indicate anti-White racial disparity. Central 90% credible intervals are represented by darker vertical bars on the distributions. Across all crime benchmarks in all years, we find substantial evidence of anti-Black racial disparities in killings of unarmed civilians by police.
Figure 4 Analysis of data on killings of unarmed suspects by police from 'The Counted,' 2015 (blue) and 2016 (orange), using crime rate benchmarking. Note . Density curves show the natural log of the posterior distributions of the relative probability (for Black individuals relative to White individuals) of being killed by police. Values greater than 0 indicate anti-Black racial disparity, and values less than 0 indicate anti-White racial disparity. Central 90% credible intervals are represented by darker vertical bars on the distributions. Across all crime benchmarks in all years, we find substantial evidence of anti-Black racial disparities in killings of unarmed civilians by police.CC-BY · From the PDF

Verification

Claims the paper makes

10 Valid · 1 Not valid · 20 Not checked · 28 Own results and interpretations

42 more claims · 4 with their cited sources checked

Create a free account to see all 59 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 9
  • It may state two separate claims as one. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Cited works that were retracted

Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.

1 of 1

Citations

Cites

1 retracted

Show all 35 references

Research works printed but not linked: 2

  1. Ringrose K., 2019, Virginia Law Review, 105, 57
  2. Selby N., 2016, In context: Understanding police killings of unarmed civilians

Cited by

See all 63

Metadata

Authors
Ross, C. T., Winterhalder, B., & McElreath, R.
Affiliations
  • Max Planck Institute for Evolutionary Anthropology (DE)
  • University of California, Davis (US)
Corresponding author
Ross, Cody T.
Venue
Social Psychological and Personality Science
Published
2020-06-18
Volume
12
Issue
3
Pages
323-332
ISSN
  • 1948-5506 (ISSN-L)
  • 1948-5514
OpenAlex
W3036948988
Cited by
61
References
29
Citations by year
2026: 3 · 2025: 5 · 2024: 12 · 2023: 14 · 2022: 13 · 2021: 8 · 2020: 6
FWCI
35.39
Type
journal article
Language
en
Open access
Locations
  • Social Psychological and Personality Science (publishedVersion, cc-by)
  • MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
Topics
  • Social Sciences › Political Science and International Relations › Policing Practices and Perceptions
  • Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
  • Social Sciences › Sociology and Political Science › Racial and Ethnic Identity Research
Keywords
police use of deadly force, racial disparities, benchmarking, violent crime rates, causal models, anti-Black racism, police killings

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Racial Disparities in Police Use of Deadly Force Against Unarmed Individuals Persist After Appropriately Benchmarking Shooting Data on Violent Crime Rates. https://app.cochat.ai/papers/10.1177/1948550620916071
The paper
Ross, C. T., Winterhalder, B., & McElreath, R. (2021). Racial Disparities in Police Use of Deadly Force Against Unarmed Individuals Persist After Appropriately Benchmarking Shooting Data on Violent Crime Rates. Social Psychological and Personality Science. https://doi.org/10.1177/1948550620916071

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.