The accuracy, fairness, and limits of predicting recidivism
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
Abstract
Should we trust computers to make life-altering decisions in the criminal justice system?
Overview
CoChat Summary
TL;DR
In a Broward County sample, nonexpert Amazon Mechanical Turk participants predicted recidivism about as accurately and with similar racial disparities as COMPAS, and COMPAS’s proprietary 137-feature score could be matched by simple linear classifiers using as few as two features. The authors conclude that algorithmic recidivism prediction, at least as represented by COMPAS, is no better than untrained human judgment and reaches a performance ceiling around 65% accuracy.
Key findings
- A crowd of nonexperts was statistically indistinguishable from COMPAS: crowd accuracy was 67.0% versus COMPAS’s 65.2% on the 1000-defendant subset (P = 0.85), and AUC-ROC was 0.71 ± 0.03 for participants versus 0.70 ± 0.04 for COMPAS.
- Both humans and COMPAS showed similar racial disparities in error rates: participants’ false-positive rate was 37.1% for black defendants versus 27.2% for white defendants (P = 0.027), while COMPAS’s was 40.4% versus 25.4% (P = 0.002); participants’ false-negative rate was 29.2% for black defendants versus 40.3% for white defendants (P = 0.034), while COMPAS’s was 30.9% versus 47.9% (P = 0.003).
- COMPAS’s accuracy was reproducible with simpler models: logistic regression with 7 features achieved 66.6% accuracy [64.4, 68.9], logistic regression with only 2 features—age and total number of previous convictions—achieved 66.8% [64.3, 69.2], and a nonlinear SVM achieved 65.2% [63.0, 67.2], all comparable to COMPAS’s 65.4% [64.3, 66.5].
- Including race in the human prediction task did not significantly change overall accuracy or fairness: crowd accuracy was 66.5% with race versus 67.0% without race (P = 0.66), while false-positive rates for black versus white defendants remained significantly different (40.0% vs. 26.2%, P = 0.001).
Methods
- Data came from 7214 pretrial defendants in Broward County, Florida, from 2013–2014, including demographics, criminal history, COMPAS recidivism risk scores, and 2-year rearrest records; human assessment used a fixed random subset of 1000 defendants.
- Human participants were recruited via Amazon’s Mechanical Turk: 462 in the no-race condition and 449 in the race condition, with catch trials removing inattentive respondents; each participant judged one of 20 subsets of 50 defendants, and crowd predictions used a majority-rules criterion.
- Algorithmic assessment trained logistic regression and nonlinear SVM classifiers on 7 features over 1000 random 80%/20% training/testing splits, and also tested all subsets of the 7 features, including a 2-feature logistic regression.
Limitations
- Stated in the paper: recidivism is operationalized as rearrest, not direct reoffending, and differences in arrest rates across race complicate direct comparison of false-positive and false-negative rates.
- Stated in the paper: participants were not instructed how to weight features; it remains unknown whether guidelines, dynamic risk factors, larger crowds, or criminal justice expertise would improve accuracy.
- Evident from the text: the human sample was drawn from Mechanical Turk and assumed to have little to no criminal justice expertise, there were not enough nonwhite participants to reliably measure differences across participant race, and COMPAS’s proprietary inner workings were not revealed, limiting independent verification.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 1 Not valid · 8 Not checked · 47 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This predictor yields similar results to COMPAS in terms of predictive fairness [Table 2, (A) and (D) columns].”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Algorithmic assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The COMPAS accuracy for this subset of 1000 defendants was 65.2%.”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With respect to fairness, participant accuracy is not significantly different for black defendants (66.2%) compared with white defendants (67.6%; P = 0.65, unpaired t test).”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This crowd-based approach yields a prediction accuracy of 67.0%.”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average COMPAS accuracy on 10,000 random subsets of size 1000 each was 65.4% with a 95% confidence interval of (62.6, 68.1).”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 56 claims and to verify the 6 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, quite a lot of effort has been made by scientists to understand how COMPAS depends on important variables like race and age, without a lot of success (59, 60).”
From Interpretable algorithmic forensics (2023) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, this work has demonstrated that simple interpretable models (with two and respectively three features) can perform as well as the widely used criminal justice COMPAS algorithm, which instead draws on 137 features.”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Dressel and Farid 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another example is [399], where the authors propose a fair-by-design approach in order to develop ML models that jointly have less bias and include as explanations human comprehensible rules.”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [400]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Dressel and Farid (2018) achieved this result by using a linear predictor-logistic regressor that made use of only two variables (age and total number of previous convictions of the subject).”
From Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward (2020) · cites this paper as Dressel and Farid (2018)
The cited source says what the claim attributes to it.
In the citing paper
“Recent research for predicting social outcomes has shown that even with complex models and large datasets, there are strong limits to predictive performance.49,83”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [83]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Predicting relapse: A meta-analysis of sexual offender recidivism studies.
Hanson, R. K., & Bussière, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.2.348 · Cited by 2,375
A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
GENDREAU, P., LITTLE, T., & GOGGIN, C. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01220.x · Cited by 1,244
Hanson, R. K., & Morton-Bourgon, K. E. (2009) · Psychological Assessment · doi:10.1037/a0014421 · Cited by 1,050
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Where Should We Intervene?: Dynamic Predictors of Sexual Offense Recidivism
HANSON, R. K., & HARRIS, A. J. R. (2000) · Criminal Justice and Behavior · doi:10.1177/0093854800027001002 · Cited by 793
Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations
Perry, W., McInnis, B., Price, C., Smith, S., & Hollywood, J. (2013) · doi:10.7249/rr233 · Cited by 693
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
The Robust Beauty of Majority Rules in Group Decisions.
Hastie, R., & Kameda, T. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.494 · Cited by 462
Cited by
Items 401–500 of 1,260
Bias, fairness, and assurance in AI: overview and synthesis
Al-Khulaidy, A., & Kavak, H. (2023) · Elsevier eBooks · doi:10.1016/b978-0-32-391919-7.00016-0 · Cited by 17
Improving Fairness and Privacy in Selection Problems
Khalili, M. M., Zhang, X., Abroshan, M., & Sojoudi, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16986 · Cited by 31
Biswas, A., Kołczyńska, M., Rantanen, S., & Rozenshtein, P. (2020) · ACM SIGCAS Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3378393.3402507 · Cited by 20
Artificial Intelligence and Algorithmic Bias
Williams, N. H. (2023) · The International Library of Bioethics · doi:10.1007/978-3-031-48262-5_1 · Cited by 16
A comprehensive review of techniques for documenting artificial intelligence
Königstorfer, F. (2024) · Digital Policy Regulation and Governance · doi:10.1108/dprg-01-2024-0008 · Cited by 18
E-Commerce Dispute Resolution Prediction
Tsurel, D., Doron, M., Nus, A., Dagan, A., Guy, I., & Shahaf, D. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411906 · Cited by 19
Zhang, B., Yu, R., Sun, H., Li, Y., Xu, J., & Wang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08855 · Cited by 15
Forks over knives: Predictive inconsistency in criminal justice algorithmic risk assessment tools
Greene, T., Shmueli, G., Fell, J., Lin, C.-F., & Liu, H.-W. (2022) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12966 · Cited by 15
Explainable Artificial Intelligence (xAI): Reflections on Judicial System
Chaudhary, G. (2024) · Kutafin Law Review · doi:10.17803/2713-0533.2023.4.26.872-889 · Cited by 18
Algorithmic Bias and Fairness in Case-Based Reasoning
Blanzeisky, W., Smyth, B., & Cunningham, P. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-14923-8_4 · Cited by 24
The Challenges of Risk Profiling Used by Law Enforcement: Examining the Cases of COMPAS and SyRI
van Schendel, S. (2019) · Information Technology and Law Series · doi:10.1007/978-94-6265-279-8_12 · Cited by 14
Smartphones within Psychological Science
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408 · Cited by 15
Quantitative Systems Pharmacology and Machine Learning: A Match Made in Heaven or Hell?
Tindall, M. J., Cucurull-Sanchez, L., Mistry, H. B., & Yates, J. W. T. (2023) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1124/jpet.122.001551 · Cited by 15
This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
Mulligan, D. K., Kroll, J. A., Kohli, N., & Wong, R. Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11869 · Cited by 13
Explainable AI and stakes in medicine: A user study
Baron, S., Latham, A. J., & Varga, S. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2025.104282 · Cited by 18
Trustworthy Predictive Algorithms for Complex Forest System Decision-Making
Rana, P., & Varshney, L. R. (2021) · Frontiers in Forests and Global Change · doi:10.3389/ffgc.2020.587178 · Cited by 17
Monitoring Laws: Profiling and Identity in the World State
Goldenfein, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108637657 · Cited by 56
Online Routine Activities and Self-Guardianship against Cyber Abuse
Vakhitova, Z., Alston‐Knox, C., & Mawby, R. I. (2022) · Victims & Offenders · doi:10.1080/15564886.2021.2022056 · Cited by 16
Bias and fairness in machine learning and artificial intelligence
Cirillo, D., & Rementeria, M. J. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-821392-6.00006-6 · Cited by 22
Watamura, E., Liu, Y., & Ioku, T. (2025) · PLoS ONE · doi:10.1371/journal.pone.0318486 · Cited by 18
Revealing Neural Network Bias to Non-Experts Through Interactive Counterfactual ExamplesPreprint
Myers, C. M., Freed, E., Pardo, L. L., Furqan, A., Risi, S., & Zhu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.02271 · Cited by 17
Synergies between machine learning and reasoning - An introduction by the Kay R. Amel group
Baaj, I., Bouraoui, Z., Cornuéjols, A., Denœux, T., Destercke, S., Dubois, D., Lesot, M., Marques-Silva, J. P., Mengin, J., Prade, H. M., et al. (2024) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2024.109206 · Cited by 17
Sum, C. M., Zhi, J., Cook, A. N. T., Cooper, P. J., Lozano, A., Johnson, T., Perez, J., Ghani, R., Skirpan, M. W., Eslami, M., et al. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711110 · Cited by 16
A Discussion on Ethical Cybersecurity Issues in Digital Service Chains
Tronnier, F., Pape, S., Löbner, S., & Rannenberg, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-04036-8_10 · Cited by 18
Grgić-Hlača, N., Castelluccia, C., & Gummadi, K. P. (2022) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v10i1.21989 · Cited by 26
Enforcing fairness using ensemble of diverse Pareto-optimal models
Guardieiro, V., Raimundo, M. M., & Poco, J. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00922-y · Cited by 18
Mu, D., Zhang, S., Zhu, T., Zhou, Y., & Zhang, W. (2024) · Social Science Computer Review · doi:10.1177/08944393241226607 · Cited by 15
Mechanical Jurisprudence and Domain Distortion: How Predictive Algorithms Warp the Law
Pruss, D. (2021) · Philosophy of Science · doi:10.1086/715512 · Cited by 18
AI algorithmic oversight: new frontiers in regulation
Busuioc, M. (2022) · Edward Elgar Publishing eBooks · doi:10.4337/9781839108990.00043 · Cited by 36
Software doping analysis for human oversight
Biewer, S., Baum, K. L., Sterz, S., Hermanns, H., Hetmank, S., Langer, M., Lauber-Rönsberg, A., & Lehr, F. (2024) · Formal Methods in System Design · doi:10.1007/s10703-024-00445-2 · Cited by 13
The Amplifying Effect of Explainability in AI-assisted Decision-making in Groups
Duarte, R. D. B., Abreu, M. C., Campos, J., & Paiva, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713534 · Cited by 18
Legitimacy and automated decisions: the moral limits of algocracy
Chomanski, B. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09647-w · Cited by 16
Fair tree classifier using strong demographic parity
Barata, A. P., Takes, F. W., van den Herik, H. J., & Veenman, C. J. (2023) · Machine Learning · doi:10.1007/s10994-023-06376-z · Cited by 16
Time Can Invalidate Algorithmic Recourse
Toni, G. D., Teso, S., Lepri, B., & Passerini, A. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732008 · Cited by 21
Integrating Computer Prediction Methods in Social Science: A Comment on Hofman et al. (2021)
Breznau, N. (2022) · Social Science Computer Review · doi:10.1177/08944393211049776 · Cited by 12
AI and Holistic Review: Informing Human Reading in College AdmissionsPreprint
Alvero, A., Arthurs, N., antonio, A. L., Domingue, B. W., Gebre-Medhin, B., Giebel, S., & Stevens, M. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.09318 · Cited by 12
Machine Behaviour (Originally Published 2019 by Springer Nature)
Rahwan, I., Cebrián, M., Obradovich, N., Bongard, J., Bonnefon, J., Breazeal, C., Crandall, J. W., Christakis, N. A., Couzin, I. D., Jackson, M. O., et al. (2022) · Wiley eBooks · doi:10.1002/9781119815075.ch10 · Cited by 13
Fulton, R., Fulton, D., & Kaplan, S. (2022) · International Conference on Embedded Systems and Applications (EMSA) · doi:10.5121/csit.2022.120613 · Cited by 13
Digital Sovereignty, the Private Sector, and a Social Republican Alternative
Hoeksema, B. (2024) · Digital Society · doi:10.1007/s44206-024-00140-z · Cited by 14
Bias and Discrimination in Machine Decision-Making Systems
Casillas, J. (2023) · The International library of ethics, law and technology · doi:10.1007/978-3-031-48135-2_2 · Cited by 18
Whose tweets are surveilled for the police: an audit of a social-media monitoring tool via log files
Borradaile, G., Burkhardt, B. C., & LeClerc, A. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372841 · Cited by 12
A multidisciplinary definition of privacy labels
Johansen, J., Pedersen, T., Fischer‐Hübner, S., Johansen, C., Schneider, G., Roosendaal, A., Zwingelberg, H., Sivesind, A. J., & Noll, J. (2022) · Information and Computer Security · doi:10.1108/ics-06-2021-0080 · Cited by 15
Ethics, Transparency, Fairness and the Responsibility of Artificial Intelligence
Carneiro, D. R., & Veloso, P. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-87687-6_12 · Cited by 16
AI in Education: Some Thoughts About Ethics, Equity, and Social Impact
Jones, J. W. (2024) · Postdigital science and education · doi:10.1007/978-3-031-64487-0_3 · Cited by 12
A comparative analysis of human and AI performance in forensic estimation of physical attributes
Barrington, S., & Farid, H. (2023) · Scientific Reports · doi:10.1038/s41598-023-31821-3 · Cited by 13
Self-citationMitigating Label Bias in Machine Learning: Fairness through Confident Learning
Zhang, Y., Li, B., Ling, Z., & Zhou, F. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i15.29634 · Cited by 18
FairCompass: Operationalizing Fairness in Machine Learning
Liu, J., Chen, H., Shen, J., & Choo, K. R. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3348429 · Cited by 13
Artificial intelligence at sentencing: when do algorithms perform well enough to replace humans?
Ryberg, J. (2024) · AI and Ethics · doi:10.1007/s43681-024-00442-5 · Cited by 12
Scherzinger, S., Seifert, C., & Wiese, L. (2019) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00161 · Cited by 17
AI, Complexity, and Regulation
Weissinger, L. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197579329.013.66 · Cited by 17
El sistema penal en la encrucijada ante el reto de la inteligencia artificial
Caterini, M. (2022) · IDP Revista de Internet Derecho y Política · doi:10.7238/idp.v0i35.392754 · Cited by 12
Drenth, A., & van Steden, R. (2020) · Journal of Crime and Justice · doi:10.1080/0735648x.2020.1722202 · Cited by 6
Towards an Evidence-Based Approach to Pre-trial Detention in Europe
Martufi, A., & Peristeridou, C. (2022) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-022-09526-6 · Cited by 13
Machine's Eye View: Postmodern Data Science and the Politics of Ground Truth
Sadowski, J. (2025) · Science Technology & Human Values · doi:10.1177/01622439251331138 · Cited by 12
Ho, Y., Jabr, W., & Zhang, Y. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4533047 · Cited by 12
The Rule of Law, Science Fiction, and Fears of Artificial Intelligence
Burgess, P. (2022) · Law Technology and Humans · doi:10.5204/lthj.2461 · Cited by 16
Machine Learning and Law and Economics: A Preliminary Overview
Park, S.-C., & Ko, H. (2020) · Asian Journal of Law and Economics · doi:10.1515/ajle-2020-0030 · Cited by 12
Priority-based Post-Processing Bias Mitigation for Individual and Group FairnessPreprint
Lohia, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.00417 · Cited by 13
Estimating Racial Disparities When Race is Not Observed
McCartan, C., Fisher, R., Goldin, J. S., Ho, D. E., & Imai, K. (2025) · Journal of the American Statistical Association · doi:10.1080/01621459.2025.2526695 · Cited by 24
Verma, H., Padh, K. S., & Thelisson, E. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009625180.008 · Cited by 13
The Greatest Challenge to Using AI/ML for Primary Health Care: Mindset or Datasets?
Troncoso, E. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00053 · Cited by 13
Method for Appropriating the Brief Implicit Association Test to Elicit Biases in Users
Dingler, T., Tag, B., Eccles, D., van Berkel, N., & Kostakos, V. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517570 · Cited by 11
What’s Impossible about Algorithmic Fairness?
Sahlgren, O. (2024) · Philosophy & Technology · doi:10.1007/s13347-024-00814-z · Cited by 16
The hard proxy problem: proxies aren’t intentional; they’re intentional
Johnson, G. M. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02333-9 · Cited by 14
Social context of the issue of discriminatory algorithmic decision-making systems
Varona, D., & Suarez, J. L. (2023) · AI & Society · doi:10.1007/s00146-023-01741-x · Cited by 11
Artificial Intelligence and Machine Learning in Global Healthcare
Panesar, A., & Panesar, H. (2020) · Springer eBooks · doi:10.1007/978-3-030-05325-3_75-1 · Cited by 11
Artificial Intelligence in the Judiciary System of Saudi Arabia: A Literature Review
Al‐Alawi, A. I., & A-Lmansouri, A. M. (2023) · International Conference on Cyber Management and Engineering (CyMaEn) · doi:10.1109/cymaen57228.2023.10050929 · Cited by 13
Integration of Artificial Intelligence into Criminal Procedure Law and Practice in Kazakhstan
Mukhamadiyeva, G., Zhanibekov, A. K., Apsimet, N. M., & Alimkulov, Y. (2025) · Laws · doi:10.3390/laws14060098 · Cited by 17
Uplift modeling with continuous treatments: A predict-then-optimize approach
Vos, S. D., Bockel-Rickermann, C., Lessmann, S., & Verbeke, W. (2025) · European Journal of Operational Research · doi:10.1016/j.ejor.2025.10.025 · Cited by 15
Malgieri, G. (2021) · Law and Business · doi:10.2478/law-2021-0003 · Cited by 10
Regulatory, social, ethical, and legal issues of artificial intelligence in medicine
Shearer, E. J., Cho, M. K., & Magnus, D. C. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-821259-2.00023-5 · Cited by 16
Kim, J. Y., & Cho, S. (2020) · National Conference on Artificial Intelligence · Cited by 20
Fair Sequential Selection Using Supervised Learning ModelsPreprint
Khalili, M. M., Zhang, X., & Abroshan, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13986 · Cited by 23
Access Denied: Meaningful Data Access for Quantitative Algorithm Audits
Zaccour, J., Binns, R., & Rocher, L. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713963 · Cited by 14
Big Data and Trust in Public Policy Automation
Waggoner, P., Kennedy, R., Le, H., & Shiran, M. (2019) · Statistics Politics and Policy · doi:10.1515/spp-2019-0005 · Cited by 12
Closure: On Ethics, Code, and Law
Hildebrandt, M. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198860877.003.0011 · Cited by 10
Ezema, K., Chandler, C., Southwell, R. V., Cholendiran, N., & D’Mello, S. K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714059 · Cited by 19
It's Not What Machines Can Learn, It's What We Cannot TeachPreprint
Yehuda, G., Gabel, M., & Schuster, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09398 · Cited by 16
Algorithmic Risk Scoring and Welfare State Contact Among US Children
Eiermann, M. (2024) · Sociological Science · doi:10.15195/v11.a26 · Cited by 11
Beyond Predictive Algorithms in Child Welfare
Moon, E. S.-Y., Saxena, D., Maharaj, T., & Guha, S. (2024) · Graphics Interface · doi:10.1145/3670947.3670976 · Cited by 11
Public attitudes on performance for algorithmic and human decision-makers
Bansak, K. C., & Paulson, E. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae520 · Cited by 13
An Invitation to System-wide Algorithmic Fairness
Cortés, E. C., & Ghosh, D. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375860 · Cited by 10
Fairness in Forecasting and Learning Linear Dynamical Systems
Zhou, Q., Mareček, J., & Shorten, R. N. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17328 · Cited by 12
Explaining and Contesting Judicial Profiling Systems
Metikoš, L. (2024) · Technology and Regulation · doi:10.71265/azacz070 · Cited by 14
Machine Learning Can Predict Shooting Victimization Well Enough to Help Prevent It
Heller, S., Jakubowski, B., Jelveh, Z., & Kapustin, M. (2022) · National Bureau of Economic Research · doi:10.3386/w30170 · Cited by 13
Guardians Against Cyber Abuse: Who are They and Why do They Intervene?
Vakhitova, Z., Go, A., & Alston‐Knox, C. (2021) · American Journal of Criminal Justice · doi:10.1007/s12103-021-09641-w · Cited by 9
Iudicium ex Machinae: The Ethical Challenges of ADM at Sentencing
Thomsen, F. K. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197539538.003.0013 · Cited by 11
Bansak, K. C. (2018) · Political Analysis · doi:10.1017/pan.2018.55 · Cited by 10
Urueña, R. (2019) · Latin American Law Review · doi:10.29263/lar02.2019.05 · Cited by 18
The Quarantine Model and its Limits
Lavazza, A., Levin, S. M., & Farina, M. (2023) · Philosophia · doi:10.1007/s11406-023-00683-4 · Cited by 10
Holsinger, A. M., Lowenkamp, C. T., Latessa, E. J., Serin, R. C., Cohen, T. H., Robinson, C. R., Flores, A. W., & VanBenschoten, S. W. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3271682 · Cited by 9
Fair-by-design explainable models for prediction of recidivism
Soares, E., & Angelov, P. (2019) · arXiv · doi:10.48550/arxiv.1910.02043 · Cited by 9
Using Bias Parity Score to Find Feature-Rich Models with Least Relative Bias
Jain, B., Huber, M., Elmasri, R. A., & Fegaras, L. (2020) · Technologies · doi:10.3390/technologies8040068 · Cited by 9
Towards Threshold Invariant Fair ClassificationPreprint
Chen, M., & Wu, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10667 · Cited by 9
Dina, A. B., Sarno, R., Anggraini, R. N. E., Haryono, A. T., & Septiyanto, A. F. (2024) · International Conference on Information Technology Research and Innovation (ICITRI) · doi:10.1109/icitri62858.2024.10699016 · Cited by 9
Sustainability powered by digitalization? (Re-)politicizing the debate
Steig, F., König, P. D., Marquardt, J., Oels, A., Radtke, J., Rehak, R., & Weiland, S. (2025) · Sustainability Science Practice and Policy · doi:10.1080/15487733.2025.2521181 · Cited by 13
Enhancing University Curricula with Integrated AI Ethics Education: A Comprehensive Approach
Deb, D., Taylor, G., Betz, S., Maddux, B.-A., Ebert, C., Richardson, F. W., Couto, J., Jarrett, M. S., & Madjd‐Sadjadi, Z. (2025) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3641554.3701953 · Cited by 14
The AI is now in session – The impact of digitalisation on courts
Papp, D., Krausz, B., & Gyuranecz, F. (2022) · Cybersecurity and Law · doi:10.35467/cal/151833 · Cited by 9
Monitoring Algorithmic Fairness Under Partial Observations
Henzinger, T. A., Kueffner, K., & Mallik, K. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44267-4_15 · Cited by 9
Metadata
- Authors
- Dressel, J., & Farid, H.
- Affiliations
- Dartmouth College (US)
- Corresponding author
- Farid, Hany
- Venue
- Science Advances
- Published
- 2018-01-05
- Volume
- 4
- Issue
- 1
- Pages
- eaao5580-eaao5580
- ISSN
- 2375-2548 (ISSN-L)
- PMC
- PMC5777393
- OpenAlex
- W2785011159
- Cited by
- 1,071
- References
- 17
- Citations by year
- 2026: 138 · 2025: 124 · 2024: 149 · 2023: 153 · 2022: 126 · 2021: 127 · 2020: 148 · 2019: 76 · 2018: 29
- FWCI
- 188.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- Science Advances (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- recidivism prediction, COMPAS, risk assessment software, algorithmic fairness, algorithmic accuracy, criminal justice, parole decisions, sentencing, linear predictor, algorithmic bias
- MeSH terms
- Recidivism, Algorithms, Humans, ROC Curve, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
