On the Validity of Arrest as a Proxy for Offense: Race and the Likelihood of Arrest for Violent Crimes
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Re-offense risk is considered in decision-making at many stages of the criminal justice system, from pre-trial, to sentencing, to parole. To aid decision-makers in their assessments, institutions increasingly rely on algorithmic risk assessment instruments (RAIs). These tools assess the likelihood that an individual will be arrested for a new criminal offense within some time window following their release. However, since not all crimes result in arrest, RAIs do not directly assess the risk of re-offense. Furthermore, disparities in the likelihood of arrest can potentially lead to biases in the resulting risk scores. Several recent validations of RAIs have therefore focused on arrests for violent offenses, which are viewed as being more accurate and less biased reflections of offending behavior. In this paper, we investigate biases in violent arrest data by analysing racial disparities in the likelihood of arrest for White and Black violent offenders. We focus our study on 2007--2016 incident-level data of violent offenses from 16 US states as recorded in the National Incident Based Reporting System (NIBRS). Our analysis shows that the magnitude and direction of the racial disparities depend on various characteristics of the crimes. In addition, our investigation reveals large variations in arrest rates across geographical locations and offense types. We discuss the implications of the observed disconnect between re-arrest and re-offense in the context of RAIs and the challenges around the use of data from NIBRS to correct for the sampling bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The role of procedural justice and legitimacy in shaping public support for policing
Sunshine, J., & Tyler, T. R. (2003) · Law & Society Review · doi:10.1111/1540-5893.3703002 · Cited by 2,973 · cited 1×
“There is considerable evidence that cooperation varies with these types of (sub)cultural factors [18, 72, 109, 113, 114].”
BackgroundEquality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 1×
“These papers, many of which draw on the ProPublica-COMPAS dataset, tend to focus on metrics for capturing bias, techniques for mitigating bias as measured by these metrics, and characterizing fundamental tradeoffs [1, 9, 19, 27, 61, 67].”
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 1×
“Later work on the topic showed that predictive parity and error rate balance cannot be simultaneously satisfied when the recidivism rates differ across demographic groups [20, 22, 74], sparking a flurry of technical research on algorithmic fairness within the machine learning community.”
BackgroundSelf-citationA Reductions Approach to Fair Classification
Agarwal, A., Beygelzimer, A., Dudík, M., Langford, J., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1803.02453 · Cited by 1,288
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Inherent trade-offs in the fair determination of risk scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.itcs.2017.43 · Cited by 943 · cited 1×
“Later work on the topic showed that predictive parity and error rate balance cannot be simultaneously satised when the recidivism rates dier across demographic groups [20, 22, 74], sparking a urry of technical research on algorithmic fairness within the machine learning community.”
BackgroundInherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
NEGOTIATING ORDER IN PATROL WORK: AN ECOLOGICAL THEORY OF POLICE RESPONSE TO DEVIANCE*
KLINGER, D. A. (1997) · Criminology · doi:10.1111/j.1745-9125.1997.tb00877.x · Cited by 645
CARR, P. J., NAPOLITANO, L., & KEATING, J. (2007) · Criminology · doi:10.1111/j.1745-9125.2007.00084.x · Cited by 641 · cited 1×
“There is considerable evidence that cooperation varies with these types of (sub)cultural factors [18, 72, 109, 113, 114].”
BackgroundLum, K., & Isaac, W. (2016) · Significance · doi:10.1111/j.1740-9713.2016.00960.x · Cited by 611
VanderWeele, T. J., & Robinson, W. R. (2014) · Epidemiology · doi:10.1097/ede.0000000000000105 · Cited by 567
A large-scale analysis of racial disparities in police stops across the United States
Pierson, E., Simoiu, C., Overgoor, J., Corbett-Davies, S., Jenson, D., Shoemaker, A., Ramachandran, V., Barghouty, P., Phillips, C., Shroff, R., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0858-1 · Cited by 552
On The So-Called “Huber Sandwich Estimator” and “Robust Standard Errors”
Freedman, D. A. (2006) · The American Statistician · doi:10.1198/000313006x152207 · Cited by 498 · cited 1×
“Second, we clustered the sandwich standard errors [56] by law enforcement agency and year.”
MethodStreet stops and police legitimacy: Teachable moments in young urban men’s legal socialization
Tyler, T. R., Fagan, J., & Geller, A. (2014) · Journal of Empirical Legal Studies · doi:10.1111/jels.12055 · Cited by 457 · cited 1×
“There is considerable evidence that cooperation varies with these types of (sub)cultural factors [18, 72, 109, 113, 114].”
BackgroundRISK, RACE, AND RECIDIVISM: PREDICTIVE BIAS AND DISPARATE IMPACT*
SKEEM, J. L., & LOWENKAMP, C. T. (2016) · Criminology · doi:10.1111/1745-9125.12123 · Cited by 317 · cited 1×
“Such arrests are viewed as representing “the most unbiased criterion [of offense] available” [103].”
BackgroundPrecinct or prejudice? Understanding racial disparities in New York City’s stop-and-frisk policy
Goel, S., Rao, J. M., & Shroff, R. (2016) · The Annals of Applied Statistics · doi:10.1214/15-aoas897 · Cited by 285 · cited 1×
“Importantly, there is ample evidence that racial minorities tend to face higher risk of arrest, especially for crimes targeted through proactive policing, such as drug and traffic offenses [57, 82, 94].”
BackgroundClassification with Fairness Constraints: A Meta-Algorithm with Provable Guarantees
Celis, L. E., Huang, L., Keswani, V., & Vishnoi, N. K. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287586 · Cited by 231 · cited 1×
“These papers, many of which draw on the ProPublica-COMPAS dataset, tend to focus on metrics for capturing bias, techniques for mitigating bias as measured by these metrics, and characterizing fundamental tradeoffs [1, 9, 19, 27, 61, 67].”
A Convex Framework for Fair Regression
Berk, R., Heidari, H., Jabbari, S., Joseph, M., Kearns, M., Morgenstern, J., Neel, S., & Roth, A. (2017) · arXiv · doi:10.48550/arxiv.1706.02409 · Cited by 198
Johndrow, J. E., & Lum, K. (2019) · The Annals of Applied Statistics · doi:10.1214/18-aoas1201 · Cited by 141 · cited 1×
“These papers, many of which draw on the ProPublica-COMPAS dataset, tend to focus on metrics for capturing bias, techniques for mitigating bias as measured by these metrics, and characterizing fundamental tradeoffs [1, 9, 19, 27, 61, 67].”
Does Incapacitation Reduce Crime?
Piquero, A. R., & Blumstein, A. (2007) · Journal of Quantitative Criminology · doi:10.1007/s10940-007-9030-6 · Cited by 111
Measuring Self-Reported Wrongful Convictions Among Prisoners
Loeffler, C. E., Hyatt, J., & Ridgeway, G. (2019) · Journal of Quantitative Criminology · doi:10.1007/s10940-018-9381-1 · Cited by 95
Interventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment
Barabas, C., Dinakar, K., Ito, J., Virza, M., & Zittrain, J. (2017) · arXiv · doi:10.48550/arxiv.1712.08238 · Cited by 87
The false promise of risk assessments: epistemic reform and the limits of fairness
Green, B. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372869 · Cited by 80
When are victims unlikely to cooperate with the police?
Felson, R. B., & Lantz, B. (2016) · Aggressive Behavior · doi:10.1002/ab.21626 · Cited by 51 · cited 1×
“The only piece of information that is available, and that has been analysed by recent work on violent offenses, is whether the incident is exceptionally cleared because of the lack of victim’s cooperation [52].”
Background
Cited by
Fairness and Bias in Algorithmic Hiring: A Multidisciplinary Survey
Fabris, A., Baranowska, N., Dennis, M. J., Graus, D., Hacker, P., Saldivar, J., Zuiderveen Borgesius, F., & Biega, A. J. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3696457 · Cited by 117
Zilka, M., Sargeant, H., & Weller, A. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534200 · Cited by 28
“In the USA, data collected includes separate fields for race and ethnicity, yet not all agencies fill in the ethnicity field [18].”
BackgroundGround(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making
Guerdan, L., Coston, A., Wu, Z. S., & Holstein, K. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594036 · Cited by 28
Metadata
- Authors
- Fogliato, R., Xiang, A., Lipton, Z., Nagin, D., & Chouldechova, A.
- Venue
- Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2021-07-21
- Pages
- 100-111
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W3162097651
- Cited by
- 39
- References
- 25
- FWCI
- 20.06
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.