The accuracy, fairness, and limits of predicting recidivism
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
Abstract
Should we trust computers to make life-altering decisions in the criminal justice system?
Overview
CoChat Summary
TL;DR
In a Broward County sample, nonexpert Amazon Mechanical Turk participants predicted recidivism about as accurately and with similar racial disparities as COMPAS, and COMPAS’s proprietary 137-feature score could be matched by simple linear classifiers using as few as two features. The authors conclude that algorithmic recidivism prediction, at least as represented by COMPAS, is no better than untrained human judgment and reaches a performance ceiling around 65% accuracy.
Key findings
- A crowd of nonexperts was statistically indistinguishable from COMPAS: crowd accuracy was 67.0% versus COMPAS’s 65.2% on the 1000-defendant subset (P = 0.85), and AUC-ROC was 0.71 ± 0.03 for participants versus 0.70 ± 0.04 for COMPAS.
- Both humans and COMPAS showed similar racial disparities in error rates: participants’ false-positive rate was 37.1% for black defendants versus 27.2% for white defendants (P = 0.027), while COMPAS’s was 40.4% versus 25.4% (P = 0.002); participants’ false-negative rate was 29.2% for black defendants versus 40.3% for white defendants (P = 0.034), while COMPAS’s was 30.9% versus 47.9% (P = 0.003).
- COMPAS’s accuracy was reproducible with simpler models: logistic regression with 7 features achieved 66.6% accuracy [64.4, 68.9], logistic regression with only 2 features—age and total number of previous convictions—achieved 66.8% [64.3, 69.2], and a nonlinear SVM achieved 65.2% [63.0, 67.2], all comparable to COMPAS’s 65.4% [64.3, 66.5].
- Including race in the human prediction task did not significantly change overall accuracy or fairness: crowd accuracy was 66.5% with race versus 67.0% without race (P = 0.66), while false-positive rates for black versus white defendants remained significantly different (40.0% vs. 26.2%, P = 0.001).
Methods
- Data came from 7214 pretrial defendants in Broward County, Florida, from 2013–2014, including demographics, criminal history, COMPAS recidivism risk scores, and 2-year rearrest records; human assessment used a fixed random subset of 1000 defendants.
- Human participants were recruited via Amazon’s Mechanical Turk: 462 in the no-race condition and 449 in the race condition, with catch trials removing inattentive respondents; each participant judged one of 20 subsets of 50 defendants, and crowd predictions used a majority-rules criterion.
- Algorithmic assessment trained logistic regression and nonlinear SVM classifiers on 7 features over 1000 random 80%/20% training/testing splits, and also tested all subsets of the 7 features, including a 2-feature logistic regression.
Limitations
- Stated in the paper: recidivism is operationalized as rearrest, not direct reoffending, and differences in arrest rates across race complicate direct comparison of false-positive and false-negative rates.
- Stated in the paper: participants were not instructed how to weight features; it remains unknown whether guidelines, dynamic risk factors, larger crowds, or criminal justice expertise would improve accuracy.
- Evident from the text: the human sample was drawn from Mechanical Turk and assumed to have little to no criminal justice expertise, there were not enough nonwhite participants to reliably measure differences across participant race, and COMPAS’s proprietary inner workings were not revealed, limiting independent verification.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 1 Not valid · 8 Not checked · 47 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This predictor yields similar results to COMPAS in terms of predictive fairness [Table 2, (A) and (D) columns].”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Algorithmic assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The COMPAS accuracy for this subset of 1000 defendants was 65.2%.”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With respect to fairness, participant accuracy is not significantly different for black defendants (66.2%) compared with white defendants (67.6%; P = 0.65, unpaired t test).”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This crowd-based approach yields a prediction accuracy of 67.0%.”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average COMPAS accuracy on 10,000 random subsets of size 1000 each was 65.4% with a 95% confidence interval of (62.6, 68.1).”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 56 claims and to verify the 6 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, quite a lot of effort has been made by scientists to understand how COMPAS depends on important variables like race and age, without a lot of success (59, 60).”
From Interpretable algorithmic forensics (2023) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, this work has demonstrated that simple interpretable models (with two and respectively three features) can perform as well as the widely used criminal justice COMPAS algorithm, which instead draws on 137 features.”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Dressel and Farid 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another example is [399], where the authors propose a fair-by-design approach in order to develop ML models that jointly have less bias and include as explanations human comprehensible rules.”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [400]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Dressel and Farid (2018) achieved this result by using a linear predictor-logistic regressor that made use of only two variables (age and total number of previous convictions of the subject).”
From Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward (2020) · cites this paper as Dressel and Farid (2018)
The cited source says what the claim attributes to it.
In the citing paper
“Recent research for predicting social outcomes has shown that even with complex models and large datasets, there are strong limits to predictive performance.49,83”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [83]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Predicting relapse: A meta-analysis of sexual offender recidivism studies.
Hanson, R. K., & Bussière, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.2.348 · Cited by 2,375
A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
GENDREAU, P., LITTLE, T., & GOGGIN, C. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01220.x · Cited by 1,244
Hanson, R. K., & Morton-Bourgon, K. E. (2009) · Psychological Assessment · doi:10.1037/a0014421 · Cited by 1,050
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Where Should We Intervene?: Dynamic Predictors of Sexual Offense Recidivism
HANSON, R. K., & HARRIS, A. J. R. (2000) · Criminal Justice and Behavior · doi:10.1177/0093854800027001002 · Cited by 793
Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations
Perry, W., McInnis, B., Price, C., Smith, S., & Hollywood, J. (2013) · doi:10.7249/rr233 · Cited by 693
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
The Robust Beauty of Majority Rules in Group Decisions.
Hastie, R., & Kameda, T. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.494 · Cited by 462
Cited by
Items 501–600 of 1,260
Artificial Intelligence for Construction Dispute Resolution: Justice of the Future
Putera, N. S. F. M. S., Saripan, H., Hassan, R. A., & Abdullah, S. M. (2021) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v11-i11/11263 · Cited by 13
Increasing Fairness in Predictions Using Bias Parity Score Based Loss Function Regularization
Jain, B., Huber, M., & Elmasri, R. A. (2023) · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference · doi:10.32473/flairs.36.133311 · Cited by 9
5. Reassembling the Black Box of Machine Learning : Of Monsters and the Reversibility of Foldings
Jarke, J., & Heuer, H. (2024) · Amsterdam University Press eBooks · doi:10.1515/9789048556908-005 · Cited by 11
Algorithms and Recidivism: A Multi-disciplinary Systematic Review
Scaria, A. G., Subramanian, V., George, N. K., & Sengupta, N. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31724 · Cited by 14
Using Pareto simulated annealing to address algorithmic bias in machine learning
Blanzeisky, W., & Cunningham, P. (2022) · The Knowledge Engineering Review · doi:10.1017/s0269888922000029 · Cited by 8
“In this section, we experimentally validate our framework described in Section 4 on a synthetic dataset introduced in [9], the Census Income dataset [16] and a reduced version of the ProPublica Recidivism dataset [8].”
MethodParole Board Decision Making and Constitutional Rights
Hritz, A. C. (2021) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-051121-070621 · Cited by 8
Exploring data science for public good in South Africa: evaluating factors that lead to success
Marivate, V. N., & Moorosi, N. (2018) · Annual International Conference on Digital Government Research · doi:10.1145/3209281.3209366 · Cited by 10
Prediction of Recidivism in Thefts and Burglaries Using Machine Learning
Espinosa, F. H. T. (2020) · Indian Journal of Science and Technology · doi:10.17485/ijst/2020/v13i06/149853 · Cited by 8
Yu, B., Yuan, Y., Terveen, L., Wu, Z. S., Forlizzi, J., & Zhu, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03061 · Cited by 8
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4772689 · Cited by 8
Data-Driven Innovation for Trustworthy AI
Siddharth, L., & Luo, J. (2025) · She ji · doi:10.1016/j.sheji.2025.06.002 · Cited by 16
Kaspar, J., Höffler, K., & Harrendorf, S. (2020) · Neue Kriminalpolitik · doi:10.5771/0934-9200-2020-1-35 · Cited by 15
Liu, J., Wu, X., Xie, Y., Tang, Z., Xie, Y., & Gong, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121138 · Cited by 11
Moral judgements of errors by AI systems and humans in civil and criminal law
Parlangeli, O., Currò, F., Palmitesta, P., & Guidi, S. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2283622 · Cited by 9
Wu, J., & Thomann, E. (2023) · Springer eBooks · doi:10.1007/978-3-030-90434-0_66-1 · Cited by 8
Risks of Observable and Unobservable Biases in Artificial Intelligence Predicting Consumer Choice
Teleaba, F., Popescu, S., Olaru, M., & Pitic, D. (2021) · Amfiteatru Economic · doi:10.24818/ea/2021/56/102 · Cited by 8
Political machines: a framework for studying politics in social machines
Papakyriakopoulos, O. (2021) · AI & Society · doi:10.1007/s00146-021-01180-6 · Cited by 8
Assessing the Impact of Cognitive Biases in AI Project Development
Bernault, C., Juan, S., Delmas, A., André, J., Rodier, M., & Kaadoud, I. C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35891-3_24 · Cited by 11
Grüning, D. J. (2022) · Futures & Foresight Science · doi:10.1002/ffo2.137 · Cited by 8
Counterfactual Reasoning for Bias Evaluation and Detection in a Fairness Under Unawareness Setting
Cornacchia, G., Anelli, V. W., Narducci, F., Ragone, A., & Sciascio, E. D. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230306 · Cited by 10
Adversarial Scrutiny of Evidentiary Statistical Software
Abebe, R., Hardt, M., Jin, A., Miller, J. A., Schmidt, L., & Wexler, R. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533228 · Cited by 17
The Danger of Reverse-Engineering of Automated Judicial Decision-Making SystemsPreprint
Medvedeva, M., Wieling, M. B., & Vols, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10301 · Cited by 9
Ou, C., Buschek, D., Mayer, S., & Butz, A. (2022) · Mensch und Computer 2022 · doi:10.1145/3543758.3543761 · Cited by 7
The Role of Personality in Trust in Public Policy Automation
Waggoner, P., & Kennedy, R. (2022) · Journal of Behavioral Data Science · doi:10.35566/v2n1/p4/ · Cited by 7
Artificial intelligence in forensic anthropology: State of the art and Skeleton-ID project
Martos, R., Ibáñez, O. C., & Mesejo, P. (2024) · Elsevier eBooks · doi:10.1016/b978-0-12-819394-5.00006-7 · Cited by 10
Wallace, R. (2021) · AI and Ethics · doi:10.1007/s43681-021-00061-4 · Cited by 10
Monroe‐White, T., & Lecy, J. D. (2022) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-022-00479-2 · Cited by 10
Moore, C., Ferguson, E., & Guerin, P. (2022) · Journal of Empirical Legal Studies · doi:10.1111/jels.12351 · Cited by 7
Fairness Through the Lens of Proportional Equality
Biswas, A., & Mukherjee, S. (2019) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/dzjo3042 · Cited by 11
Apparent Algorithmic Bias and Algorithmic LearningPreprint
Lambrecht, A., & Tucker, C. E. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3570076 · Cited by 7
The Explanation Game: A Formal Framework for Interpretable Machine LearningPreprint
Watson, D., & Floridi, L. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3509737 · Cited by 9
Fair Governance with Humans and MachinesPreprint
Hermstrüwer, Y., & Langenbach, P. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4118650 · Cited by 7
Dimensions of power and resistance: a critical review of racial dynamics in the marketplace
Davis, J. F., & Sauber, M. H. (2026) · Journal of Marketing Management · doi:10.1080/0267257x.2026.2641021 · Cited by 8
Williams, K. R., Stansfield, R., & Campbell, J. C. (2021) · Violence Against Women · doi:10.1177/1077801220988347 · Cited by 7
A Federated-Learning Algorithm Based on Client Sampling and Gradient Projection for the Smart Grid
Zhao, R., Lu, J., Liu, Z., Wang, T., Guo, W., Lan, T., & Hu, C. (2024) · Electronics · doi:10.3390/electronics13112023 · Cited by 8
Recopilar y vigilar: algunas consideraciones filosófico-jurídicas sobre inteligencia artificial
Campione, R. (2021) · Sociología y Tecnociencia · doi:10.24197/st.extra_2.2021.123-139 · Cited by 7
Artificial Intelligence-Powered Criminal Sentencing in Malaysia: A conflict with the rule of law
Putera, N. S. F. M. S., Saripan, H., Bajury, M. S. M., & Ya’cob, S. N. (2022) · Environment-Behaviour Proceedings Journal · doi:10.21834/ebpj.v7isi7.3813 · Cited by 12
SimFair: A Unified Framework for Fairness-Aware Multi-Label Classification
Liu, T., Wang, H., Wang, Y., Wang, X., Su, L., & Gao, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26677 · Cited by 13
Democratic legitimacy of AI in judicial decision-making
Vidaki, A. N., & Papakonstantinou, V. (2025) · AI & Society · doi:10.1007/s00146-025-02411-w · Cited by 9
Thao, N. P. (2023) · Vietnamese Journal of Legal Sciences · doi:10.2478/vjls-2023-0003 · Cited by 7
Predicting risk in criminal justice in the United States: The ProPublica-COMPAS case
Maxwell, W., Beaudouin, V., & Domingues‐Montanari, S. (2023) · Réseaux · doi:10.3917/res.240.0071 · Cited by 11
Learning Fairness-aware Relational StructuresPreprint
Zhang, Y., & Ramesh, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09471 · Cited by 10
Achieving Private and Fair Truth Discovery in Crowdsourcing Systems
Wang, Z., Cheng, X., Su, S., & Wang, L. (2022) · Security and Communication Networks · doi:10.1155/2022/9281729 · Cited by 7
Kang, B., & Wu, S. (2023) · Journal of Experimental Criminology · doi:10.1007/s11292-022-09512-2 · Cited by 6
Li, K., Wang, Z., Yao, X., Liu, J., Fang, H., & Lei, Y. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03337-z · Cited by 6
Bewertung in und durch digitale Infrastrukturen
Krüger, A. K., Heßelmann, F., & Hartstein, J. (2021) · Organisationssoziologie · doi:10.1007/978-3-658-31549-8_5 · Cited by 8
Digital Trends of Criminology and Criminal Justice of the 21st Century
Asli, M. R. (2023) · Journal of Digital Technologies and Law · doi:10.21202/jdtl.2023.9 · Cited by 12
An Analysis of Opinions on AI Ethics Based on Network Motifs using the Case Method
Shao, T., Ieiri, Y., Hosoya, H., & Hishiyama, R. (2023) · International Conference on Software and Computer Applications (ICSCA) · doi:10.1145/3587828.3587873 · Cited by 6
Parlangeli, O., Currò, F., Palmitesta, P., & Guidi, S. (2023) · European Conference on Cognitive Ergonomics · doi:10.1145/3605655.3605676 · Cited by 6
The Paradox of Algorithms and Blame on Public Decision-makers
Ozer, A. L., Waggoner, P., & Kennedy, R. (2024) · Business and Politics · doi:10.1017/bap.2023.35 · Cited by 8
A Framework for Addressing the Risks and Opportunities In Al-Supported Virtual Health Coaches
Baee, S., Rucker, M., Baglione, A. N., Ameko, M. K., & Barnes, L. (2020) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3421937.3421971 · Cited by 6
Acceptance of criteria for health and driver scoring in the general public in Germany
Rebitschek, F. G., Gigerenzer, G., Keitel, A., Sommer, S., Groß, C., & Wagner, G. G. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250224 · Cited by 6
A Survey on Social-Physical Sensing.Preprint
Rashid, M. T., Wei, N., & Wang, D. (2021) · arXiv (Cornell University) · Cited by 6
Understanding risk with FOTRES?
Räz, T. (2022) · AI and Ethics · doi:10.1007/s43681-022-00223-y · Cited by 6
Machine Learning in Public Policy: The Perils and the Promise of Interpretability
Peet, E. D., Vegetabile, B., Cefalu, M. S., Pane, J., & Damberg, C. L. (2022) · RAND Corporation eBooks · doi:10.7249/pea828-1 · Cited by 12
JudicialTech Supporting JusticePreprint
Barnett, J., Treleaven, P. C., Lederer, F. I., Vermeys, N., & Zeleznikow, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4597917 · Cited by 6
Law Enforcement and Legal Professionals’ Trust in Algorithms
Kennedy, R., Tiede, L. B., Austin, A., & Ismael, K. (2025) · Journal of law & empirical analysis. · doi:10.1177/2755323x251325594 · Cited by 6
Fairness of machine learning readmission predictions following open ventral hernia repair
Zander, T. L., Kendall, M. A., Wolansky, R. L., Grimsley, E. A., Parikh, R., Sujka, J. A., & Kuo, P. C. (2025) · Surgical Endoscopy · doi:10.1007/s00464-025-11927-7 · Cited by 6
Investigating and Mitigating the Performance–Fairness Tradeoff via Protected-Category Sampling
Popoola, G., & Sheppard, J. W. (2024) · Electronics · doi:10.3390/electronics13153024 · Cited by 9
Achieving Counterfactual Fairness for Anomaly Detection
Han, X., Zhang, L., Wu, Y., & Yuan, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_5 · Cited by 6
Wu, Y.-H. (2024) · AI and Ethics · doi:10.1007/s43681-024-00535-1 · Cited by 8
Gigerenzer, G. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108684354.010 · Cited by 6
Jenkins, B. Q., & Tilbury, C. (2024) · Children and Youth Services Review · doi:10.1016/j.childyouth.2024.107891 · Cited by 6
Artificial Intelligence and Sentencing from a Human Rights Perspective
Kaspar, J., Harrendorf, S., Butz, F., Höffler, K., Sommerer, L. M., & Christoph, S. (2023) · Critical criminological perspectives · doi:10.1007/978-3-031-19149-7_1 · Cited by 9
Dhungel, A.-K., & Heine, M. (2024) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.33.1.14 · Cited by 8
Taming the AI Monster: Monitoring of Individual Fairness for Effective Human Oversight
Baum, K. L., Biewer, S., Hermanns, H., Hetmank, S., Langer, M., Lauber-Rönsberg, A., & Sterz, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-66149-5_1 · Cited by 6
Inteligencia artificial y tutela cautelar. Especial referencia a la prisión provisional
Pena, A. M. N. (2021) · Revista Brasileira de Direito Processual Penal · doi:10.22197/rbdpp.v7i3.618 · Cited by 6
A Literature Review: Bias Detection and Mitigation in Criminal Justice
Kondapalli, P., Singh, P., Malik, A., & Lesmana, C. S. A. T. (2025) · International Global Conference Series on ICT Integration in Technical Education & Smart Society · doi:10.3390/engproc2025107072 · Cited by 8
Intelligent justice: AI-driven forensics and legal process for criminal justice reforms
Srivastav, S., Shruti, K., Agarwal, D., Soni, P., & Singh, R. (2026) · International journal of law, crime and justice · doi:10.1016/j.ijlcj.2026.100832 · Cited by 6
Machines of justice: A systematic review of AI applications in policing and criminal justice
Farber, S. (2026) · The Police Journal Theory Practice and Principles · doi:10.1177/0032258x261439572 · Cited by 11
Kienzle, S., Velarde, G., & Gannon, B. (2026) · AI and Ethics · doi:10.1007/s43681-026-01116-0 · Cited by 8
Navigating Privacy on Gay-Oriented Mobile Dating Applications
Waldman, A. E. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83982-848-520211027 · Cited by 9
A Simulation Based Dynamic Evaluation Framework for System-wide Algorithmic FairnessPreprint
Cortés, E. C., & Ghosh, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09209 · Cited by 6
Principled diverse counterfactuals in multilinear models
Papantonis, I., & Belle, V. (2024) · Machine Learning · doi:10.1007/s10994-023-06411-z · Cited by 6
Redefining usability in the age of generative AI: Towards a new evaluation paradigm
Palwe, R., & Kumar, A. (2025) · International Journal of Computing and Artificial Intelligence · doi:10.33545/27076571.2025.v6.i2b.193 · Cited by 7
Desiere, S., Landeghem, B. V., & Struyven, L. (2018) · Lirias · Cited by 6
Artificial Intelligence and Machine Learning in Global Healthcare
Panesar, A., & Panesar, H. (2021) · Springer eBooks · doi:10.1007/978-3-030-45009-0_75 · Cited by 5
Paderborn, U., Biehler, R., Fleischer, Y., Paderborn, U., Budde, L., Paderborn, U., Frischemeier, D., Paderborn, U., Gerstenberger, D., Paderborn, U., et al. (2020) · IASE Roundtable Conference · doi:10.52041/srap.20304 · Cited by 5
The Rule of Law and Technology in the Public Sector
Strikaitė-Latušinskaja, G. (2023) · Access to Justice in Eastern Europe · doi:10.33327/ajee-18-6.1-a000104 · Cited by 5
ShapX Engine: A Demonstration of Shapley Value Approximations
Gupte, S., & Paparrizos, J. (2025) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3722212.3725135 · Cited by 9
Hoffmann, R., & Malrieu, J. (2019) · Angewandte Chemie · doi:10.1002/ange.201910283 · Cited by 5
A Human-in-the-loop Framework to Construct Context-dependent Mathematical Formulations of FairnessPreprint
Yaghini, M., Heidari, H., & Krause, A. (2019) · arXiv (Cornell University) · Cited by 5
Demographic Perspectives on Predicting Individual-level MortalityPreprint
Breen, C. F., & Seltzer, N. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/znsqg · Cited by 5
The taming of sociodigital anticipations: AI in the digital welfare state
Zenkl, T. (2025) · Frontiers in Sociology · doi:10.3389/fsoc.2025.1556675 · Cited by 5
Dwivedi, A. V. (2025) · Emerging Media · doi:10.1177/27523543251373105 · Cited by 7
Public attitudes towards police use of AI-driven face recognition technology
Σαγανά, Ά., Zhang, M., & Sauerland, M. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108821 · Cited by 5
Designing an AI compatible open government data ecosystem for public governance
Tan, E. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.291 · Cited by 5
Three Lessons for and from Algorithmic Discrimination
Thomsen, F. K. (2023) · Res Publica · doi:10.1007/s11158-023-09579-2 · Cited by 11
Boddington, P. (2023) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-981-19-9382-4_2 · Cited by 6
Beyond scores: A machine learning approach to comparing educational system effectiveness
Filho, R. L. C. S., Garg, A., Brito, K. D. S., Adeodato, P. J. L., & Carnoy, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0289260 · Cited by 5
Historical Aspects of Technological Revolutions and Society Transformation
Kumar, S., Verma, A. K., & Mirza, A. (2024) · Frontiers of artificial intelligence, ethics and multidisciplinary applications. · doi:10.1007/978-981-97-5656-8_2 · Cited by 5
González-Sendino, R., Serrano, E., & Bajo, J. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109979 · Cited by 6
The Explanation Game: A Formal Framework for Interpretable Machine Learning
Watson, D., & Floridi, L. (2021) · Digital ethics lab yearbook · doi:10.1007/978-3-030-80083-3_11 · Cited by 6
Awotunde, J. B., Jimoh, R. G., Adeniyi, A. E., Ayo, F. E., Ajamu, G. J., & Aremu, D. R. (2023) · Springer eBooks · doi:10.1007/978-3-031-38036-5_11 · Cited by 7
Repurposing recidivism models for forecasting police officer use of force
Khorshidi, S., Carter, J. G., & Mohler, G. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378173 · Cited by 12
A Framework for Fairer Machine Learning in OrganizationsPreprint
Morse, L., Teodorescu, M. H., Awwad, Y., & Kane, G. C. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3690570 · Cited by 6
Braga, J., Regateiro, F. S., Stiubiener, I., & Braga, J. C. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/wexjr · Cited by 6
Trusting machines with morality — Delegating moral decisions to AI
Hüholt, N., & Szech, N. (2026) · European Economic Review · doi:10.1016/j.euroecorev.2025.105255 · Cited by 8
Umeike, R. (2023) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai59109.2023.00027 · Cited by 6
Societal Implications of Recommendation Systems: A Technical Perspective
Gonçalves-Sá, J., & Pinheiro, F. L. (2023) · Law, governance and technology series · doi:10.1007/978-3-031-41264-6_3 · Cited by 8
Metadata
- Authors
- Dressel, J., & Farid, H.
- Affiliations
- Dartmouth College (US)
- Corresponding author
- Farid, Hany
- Venue
- Science Advances
- Published
- 2018-01-05
- Volume
- 4
- Issue
- 1
- Pages
- eaao5580-eaao5580
- ISSN
- 2375-2548 (ISSN-L)
- PMC
- PMC5777393
- OpenAlex
- W2785011159
- Cited by
- 1,071
- References
- 17
- Citations by year
- 2026: 138 · 2025: 124 · 2024: 149 · 2023: 153 · 2022: 126 · 2021: 127 · 2020: 148 · 2019: 76 · 2018: 29
- FWCI
- 188.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- Science Advances (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- recidivism prediction, COMPAS, risk assessment software, algorithmic fairness, algorithmic accuracy, criminal justice, parole decisions, sentencing, linear predictor, algorithmic bias
- MeSH terms
- Recidivism, Algorithms, Humans, ROC Curve, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
