The accuracy, fairness, and limits of predicting recidivism
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
Abstract
Should we trust computers to make life-altering decisions in the criminal justice system?
Overview
CoChat Summary
TL;DR
In a Broward County sample, nonexpert Amazon Mechanical Turk participants predicted recidivism about as accurately and with similar racial disparities as COMPAS, and COMPAS’s proprietary 137-feature score could be matched by simple linear classifiers using as few as two features. The authors conclude that algorithmic recidivism prediction, at least as represented by COMPAS, is no better than untrained human judgment and reaches a performance ceiling around 65% accuracy.
Key findings
- A crowd of nonexperts was statistically indistinguishable from COMPAS: crowd accuracy was 67.0% versus COMPAS’s 65.2% on the 1000-defendant subset (P = 0.85), and AUC-ROC was 0.71 ± 0.03 for participants versus 0.70 ± 0.04 for COMPAS.
- Both humans and COMPAS showed similar racial disparities in error rates: participants’ false-positive rate was 37.1% for black defendants versus 27.2% for white defendants (P = 0.027), while COMPAS’s was 40.4% versus 25.4% (P = 0.002); participants’ false-negative rate was 29.2% for black defendants versus 40.3% for white defendants (P = 0.034), while COMPAS’s was 30.9% versus 47.9% (P = 0.003).
- COMPAS’s accuracy was reproducible with simpler models: logistic regression with 7 features achieved 66.6% accuracy [64.4, 68.9], logistic regression with only 2 features—age and total number of previous convictions—achieved 66.8% [64.3, 69.2], and a nonlinear SVM achieved 65.2% [63.0, 67.2], all comparable to COMPAS’s 65.4% [64.3, 66.5].
- Including race in the human prediction task did not significantly change overall accuracy or fairness: crowd accuracy was 66.5% with race versus 67.0% without race (P = 0.66), while false-positive rates for black versus white defendants remained significantly different (40.0% vs. 26.2%, P = 0.001).
Methods
- Data came from 7214 pretrial defendants in Broward County, Florida, from 2013–2014, including demographics, criminal history, COMPAS recidivism risk scores, and 2-year rearrest records; human assessment used a fixed random subset of 1000 defendants.
- Human participants were recruited via Amazon’s Mechanical Turk: 462 in the no-race condition and 449 in the race condition, with catch trials removing inattentive respondents; each participant judged one of 20 subsets of 50 defendants, and crowd predictions used a majority-rules criterion.
- Algorithmic assessment trained logistic regression and nonlinear SVM classifiers on 7 features over 1000 random 80%/20% training/testing splits, and also tested all subsets of the 7 features, including a 2-feature logistic regression.
Limitations
- Stated in the paper: recidivism is operationalized as rearrest, not direct reoffending, and differences in arrest rates across race complicate direct comparison of false-positive and false-negative rates.
- Stated in the paper: participants were not instructed how to weight features; it remains unknown whether guidelines, dynamic risk factors, larger crowds, or criminal justice expertise would improve accuracy.
- Evident from the text: the human sample was drawn from Mechanical Turk and assumed to have little to no criminal justice expertise, there were not enough nonwhite participants to reliably measure differences across participant race, and COMPAS’s proprietary inner workings were not revealed, limiting independent verification.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 1 Not valid · 8 Not checked · 47 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This predictor yields similar results to COMPAS in terms of predictive fairness [Table 2, (A) and (D) columns].”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Algorithmic assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The COMPAS accuracy for this subset of 1000 defendants was 65.2%.”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With respect to fairness, participant accuracy is not significantly different for black defendants (66.2%) compared with white defendants (67.6%; P = 0.65, unpaired t test).”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This crowd-based approach yields a prediction accuracy of 67.0%.”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average COMPAS accuracy on 10,000 random subsets of size 1000 each was 65.4% with a 95% confidence interval of (62.6, 68.1).”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 56 claims and to verify the 6 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, quite a lot of effort has been made by scientists to understand how COMPAS depends on important variables like race and age, without a lot of success (59, 60).”
From Interpretable algorithmic forensics (2023) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, this work has demonstrated that simple interpretable models (with two and respectively three features) can perform as well as the widely used criminal justice COMPAS algorithm, which instead draws on 137 features.”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Dressel and Farid 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another example is [399], where the authors propose a fair-by-design approach in order to develop ML models that jointly have less bias and include as explanations human comprehensible rules.”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [400]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Dressel and Farid (2018) achieved this result by using a linear predictor-logistic regressor that made use of only two variables (age and total number of previous convictions of the subject).”
From Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward (2020) · cites this paper as Dressel and Farid (2018)
The cited source says what the claim attributes to it.
In the citing paper
“Recent research for predicting social outcomes has shown that even with complex models and large datasets, there are strong limits to predictive performance.49,83”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [83]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Predicting relapse: A meta-analysis of sexual offender recidivism studies.
Hanson, R. K., & Bussière, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.2.348 · Cited by 2,375
A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
GENDREAU, P., LITTLE, T., & GOGGIN, C. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01220.x · Cited by 1,244
Hanson, R. K., & Morton-Bourgon, K. E. (2009) · Psychological Assessment · doi:10.1037/a0014421 · Cited by 1,050
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Where Should We Intervene?: Dynamic Predictors of Sexual Offense Recidivism
HANSON, R. K., & HARRIS, A. J. R. (2000) · Criminal Justice and Behavior · doi:10.1177/0093854800027001002 · Cited by 793
Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations
Perry, W., McInnis, B., Price, C., Smith, S., & Hollywood, J. (2013) · doi:10.7249/rr233 · Cited by 693
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
The Robust Beauty of Majority Rules in Group Decisions.
Hastie, R., & Kameda, T. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.494 · Cited by 462
Cited by
Items 701–800 of 1,260
Rosburg, T., von Allmen, D. Y., Langewitz, H., Weber, H., Bunker, E. B., & Langewitz, W. A. (2023) · Patient Education and Counseling · doi:10.1016/j.pec.2023.108093 · Cited by 2
Data Quality, Data Diversity and Data Provenance: An Ethical Perspective
Ramalli, E. (2024) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-031-52962-7_4 · Cited by 4
Hauspurg, A. K., Barry, V. G., Hernandez, N., Clapp, M. A., Wong, M. S., & Lewkowitz, A. K. (2025) · Pregnancy · doi:10.1002/pmf2.70070 · Cited by 3
Basch, C. E., & Basch, C. H. (2025) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.70020 · Cited by 2
Bugajska, J., Lukas, L. P., Rupp, R., Weidner, N., Schubert, M. J. W., Röhrich, F., Waldmann, J., Kalke, Y.-B., Abel, R. F., Maier, D. D., et al. (2025) · Journal of Neurotrauma · doi:10.1177/08977151251386008 · Cited by 2
AI-Assisted Case Analytics for the Indian Judicial System: Enhancing Efficiency and Transparency
Patil, S., & Desai, D. (2025) · IEEE International Conference on Advanced Computing Technologies (ICACT) · doi:10.1109/icact67549.2025.11351390 · Cited by 2
Wu, C., Curtis, F. E., & Robinson, D. P. (2026) · INFORMS Journal on Optimization · doi:10.1287/ijoo.2025.0091 · Cited by 2
Baucum, M., Rabiee, M., Aslani, B., & Dutta, K. (2026) · Decision Support Systems · doi:10.1016/j.dss.2026.114680 · Cited by 3
The Rise of Digital Media and the Retooling of Politics
Jungherr, A. M., Rivero, G., & Gayo-Avello, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108297820.001 · Cited by 3
Reducing recidivism rate: A comparative study of Nigeria and China’s Prison Systems
Olaniyi, B. A. (2022) · African Journal of Social Issues · doi:10.4314/ajosi.v4i1.1 · Cited by 3
Model Transparency: Why Do We Care?
Papantonis, I., & Belle, V. (2023) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0011726300003393 · Cited by 2
FairAW – Additive weighting without discrimination
Radovanović, S., Petrović, A., Dodevska, Z., & Delibašić, B. (2023) · Intelligent Data Analysis · doi:10.3233/ida-226898 · Cited by 3
A neurocriminological perspective on violence
Anderson, N. E., Allen, C. H., & Kiehl, K. A. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95272-9.00019-x · Cited by 4
Interpretable AI: Enhancing Transparency and Fairness in Decision-Making
Nair, R., Thomas, R., Sandra, M. V., & B, S. K. (2025) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-23772 · Cited by 2
Interdisciplinary Perspectives on the (Un)fairness of Artificial Intelligence
Starke, C., Blanke, T., Helberger, N., Smets, S., & de Vreese, C. H. (2025) · Minds and Machines · doi:10.1007/s11023-025-09722-3 · Cited by 2
Indeterminate punishment as a ‘Contract’ in Denmark and Norway
Laursen, J. (2025) · Incarceration · doi:10.1177/26326663251356656 · Cited by 2
Enabling Equal Opportunity in Logistic Regression Algorithm
Radovanović, S., & Ivić, M. (2021) · Management Journal of Sustainable Business and Management Solutions in Emerging Economies · doi:10.7595/management.fon.2021.0029 · Cited by 7
Transparency Tools for Fairness in AI (Luskin)
Chen, M., Shahverdi, A., Anderson, S. E., Park, S. Y., Zhang, Z., Dachman-Soled, D., Lauter, K., & Wu, M. H. (2020) · Association for Women in Mathematics series · doi:10.1007/978-3-030-58748-2_4 · Cited by 3
Brown Hands Aren’t Terrorists: Challenges in Image Classification of Violent Extremist Content
Hall, M., & Haas, C. S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77820-0_15 · Cited by 2
Interpreting and Improving Deep-Learning Models with Reality Checks
Singh, C., Ha, W., & Yu, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-04083-2_12 · Cited by 4
Profiling and Predictions: Challenges in Cybercrime Research Datafication
Custers, B. H. M. (2021) · Springer eBooks · doi:10.1007/978-3-030-74837-1_4 · Cited by 5
Data Synthesis for Testing Black-Box Machine Learning Models
Saha, D., Aggarwal, A., & Hans, S. (2022) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3493700.3493704 · Cited by 4
Veränderungen organisationaler Legitimationsmuster durch Digitalisierung
Besio, C., Fedtke, C., & Pronzini, A. (2022) · Sozialwissenschaften und Berufspraxis · doi:10.1007/978-3-658-36514-1_4 · Cited by 4
Locally fitting hyperplanes to high-dimensional data
Hou, M., & Kambhampati, C. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-06909-y · Cited by 2
Emancipating data science for Black and Indigenous students via liberatory datasets and curricula
Monroe‐White, T. (2022) · IASSIST Quarterly · doi:10.29173/iq1007 · Cited by 2
IEEE Computer Graphics and Applications
(2023) · Computer · doi:10.1109/mc.2023.3269216 · Cited by 2
خوارزميات الذكاء الإصطناعي والعدالة الجنائية التنبؤية دراسة وصفية تحليلية تأصيلية مقارنة
زغلول, ط. أ. م. (2023) · مجلة الدراسات القانونیة والاقتصادیة · doi:10.21608/jdl.2023.205889.1154 · Cited by 2
Casey, A. J., & Niblett, A. (2023) · University of Toronto Law Journal · doi:10.3138/utlj-2023-0006 · Cited by 4
Höllig, J., Markus, A. F., de Slegte, J., & Bagave, P. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44067-0_32 · Cited by 5
Alunge, R. (2024) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-51849-2_21 · Cited by 2
Khan, S. O., Morales, A., & Plale, B. (2024) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-71304-0_3 · Cited by 2
Traceability and Accountability by Construction
Wenzel, J., Köhl, M. A., Sterz, S., Zhang, H., Schmidt, A., Fetzer, C. W., & Hermanns, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75387-9_16 · Cited by 4
Predictability of Violent Behaviour and Recidivism
Quattrocolo, S. (2020) · Legal studies in international, european and comparative criminal law · doi:10.1007/978-3-030-52470-8_6 · Cited by 2
VitrAI: Applying Explainable AI in the Real World
Hanussek, M., Koetter, F., Kintz, M., & Drawehn, J. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-82196-8_2 · Cited by 3
Fairnessprinzipien der algorithmischen Verwaltung
Hermstrüwer, Y. (2020) · Archiv des öffentlichen Rechts · doi:10.1628/aoer-2020-0013 · Cited by 7
Personality and Individual Differences
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.006 · Cited by 5
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408.003 · Cited by 2
A Critical Study of Geospatial Algorithm Use in Crime Analysis and Predictive Policing
Weathington, K. (2020) · e-Publications@Marquette (Marquette University) · Cited by 3
Algorithmic Bias and Regularisation in Machine LearningPreprint
Cunningham, P., & Delany, S. J. (2020) · arXiv (Cornell University) · Cited by 2
Measure Utility, Gain Trust: Practical Advice for XAI ResearcherPreprint
Davis, B., Glenski, M., Sealy, W. I. N., & Arendt, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.12924 · Cited by 2
Rebitschek, F. G., Gigerenzer, G., & Wagner, G. G. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kq8ra · Cited by 3
Use the best, ignore the rest: How heuristics allow to tell a lie from the truthPreprint
Verschuère, B., Lin, C.-C., Huismann, S., Kleinberg, B., & Meijer, E. H. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kdr6u · Cited by 2
Stegenga, S. M., Munger, K. F., Squires, J., & Anderson, D. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/5jg2p · Cited by 2
Zafar, A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4656578 · Cited by 2
Weld, G., Ayton, E., Althoff, T., & Glenski, M. (2021) · Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda (NLP4IF) · doi:10.18653/v1/2021.nlp4if-1.5 · Cited by 2
Do we Reach Desired Disparate Impact with In-Processing Fairness Techniques?
Radovanović, S., Delibašić, B., & Suknović, M. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.11.173 · Cited by 6
Loinaz, I. (2025) · AI & Society · doi:10.1007/s00146-025-02192-2 · Cited by 2
Wherever there is AI there is memory: AI as the agency of the (synthesized) past
Öhman, C. (2025) · Memory Mind & Media · doi:10.1017/mem.2025.10008 · Cited by 2
Classification algorithms and social outcomes
Penn, E. M., & Patty, J. W. (2025) · American Journal of Political Science · doi:10.1111/ajps.70005 · Cited by 2
AI and Access to Justice: Digital Gap Debunked?
Zubir, A. H., & Azmi, I. M. (2025) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-031-97931-6_16 · Cited by 2
AI in Social Divides: Data Policies, Structural Oppression, and Decision Automation in India
Biju, P. R., & Gayathri, O. (2025) · Journal of Social Computing · doi:10.23919/jsc.2025.0021 · Cited by 2
Badolato, L., Decter-Frain, A., Irons, N. J., Miranda, M. L., Walk, E., Zhalieva, E., Alexander, M. J., Basellini, U., & Zagheni, E. (2026) · Demography · doi:10.1215/00703370-12464628 · Cited by 5
Dias, S. A. D. J., Sátiro, R. M., & Limongi, R. (2026) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2026.103145 · Cited by 2
Gonçalves, H. O., Amaral, R., & Pereira, J. C. (2026) · Risk Analysis · doi:10.1111/risa.70297 · Cited by 2
Kaspar, J., & Derisiotis, P. (2026) · International journal of law, crime and justice · doi:10.1016/j.ijlcj.2026.100898 · Cited by 2
Chapter 2: The role of big data, AI and blockchain technology in digital public governance
Tan, E. (2022) · Wageningen Academic Publishers eBooks · doi:10.3920/978-90-8686-930-5_2 · Cited by 5
Evaluating algorithmic homeless service allocation
Qi, W., & Chelmis, C. (2022) · Journal of Computational Social Science · doi:10.1007/s42001-022-00190-8 · Cited by 3
Gula, N. B., Ferro, C., Mazzitelli, M. G., Etcheverry, L., & Rocamora, M. (2023) · Novos Rumos Sociológicos · doi:10.15210/norus.v10i18.4847 · Cited by 2
Chasing Yesterday: Struggle for Digitalization in Serial Violent Crimes Investigation in Russia
Denisov, E. V. (2023) · Legal Issues in the Digital Age · doi:10.17323/2713-2749.2023.4.68.91 · Cited by 2
Artificial Intelligence: The New Frontier?
Nweke, G. I., Nweke, O. C., & James, E. (2024) · Advances in Computer and Communication · doi:10.26855/acc.2024.04.001 · Cited by 2
Bentos, S., Bailis, E., Oikonomou, F., Spirou, S., Mavrikos, E., Chatzistamatis, S., Kotis, K., & Tsekouras, G. E. (2024) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset60544.2024.10548202 · Cited by 2
Group calibration is a byproduct of unconstrained learning.Preprint
Liu, L. T., Simchowitz, M., & Hardt, M. (2018) · arXiv (Cornell University) · Cited by 3
Wheeler, A. P., Worden, R. E., & Silver, J. R. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3122636 · Cited by 2
On Prediction-Modelers and Decision-Makers: Why Fairness Requires More Than a Fair Prediction ModelPreprint
Scantamburlo, T., Baumann, J., & Heitz, C. (2023) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.48550/arxiv.2310.05598 · Cited by 2
Duker, A., Bak, H., Daumeyer, N. M., & Richeson, J. A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4791709 · Cited by 2
Redesigning Governments through Algorithmic Systems
Mendonça, R. F., Filgueiras, F. D. B., & Almeida, V. A. F. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780192870070.003.0005 · Cited by 2
Urzúa, M. U. (2024) · Revista Chilena de Derecho y Tecnología · doi:10.5354/0719-2584.2024.72923 · Cited by 2
A bias evaluation solution for multiple sensitive attribute speech recognition
Chen, Z., Zhou, Y., Wang, Z., Liu, F., Leng, T., & Zhu, H. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101787 · Cited by 2
Leveraging ChatGPT in K-12 School Discipline: Potential Applications and Ethical Considerations
Kush, J. C. (2025) · AI · doi:10.3390/ai6070139 · Cited by 3
Exploring Bias Formation Mechanisms in Legal LLMs from a Cognitive Science Perspective
Jialin, L. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-0880-8_24 · Cited by 2
Weerheijm, B., Giest, S. N., & Klievink, B. (2025) · Government Information Quarterly · doi:10.1016/j.giq.2025.102088 · Cited by 2
Ethics Without Teeth? Challenges and Opportunities in AI Declarations for Platform Governance
Haidar, A. (2026) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer21040103 · Cited by 3
Artificial Intelligence – a Vector for Crime and a Tool for Carrying Out Criminal Justice
Tolbaru, C.-E. (2025) · Athens Journal of Law · doi:10.30958/ajl.11-4-5 · Cited by 2
Historias de la Inteligencia Artificial: pasado y presente.
Valverde, N., & Yankelevich, S. N. (2025) · Asclepio · doi:10.3989/asclepio.2025.1413 · Cited by 2
What are AI systems? Rethinking the core definition in the EU AI Act
Meinel, P., Baum, K. L., Hermanns, H., Pöppelmann, E., Langer, M., & Lauber-Rönsberg, A. (2026) · Computer law & security review · doi:10.1016/j.clsr.2026.106373 · Cited by 2
Mahl, D., & Guenther, L. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2740745 · Cited by 2
Cuellar, M. (2023) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnad011 · Cited by 2
Machine Learning Can Predict Shooting Victimization Well Enough to Help Prevent It
Heller, S., Jakubowski, B., Jelveh, Z., & Kapustin, M. (2024) · The Review of Economics and Statistics · doi:10.1162/rest_a_01519 · Cited by 6
Artificial intelligence and the end of justice
Razmetaeva, Y. (2024) · BioLaw Journal - Rivista di BioDiritto · doi:10.15168/2284-4503-3001 · Cited by 4
CryptoCredit: securely training fair models
de Castro, L., Chen, J., & Polychroniadou, A. (2020) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3383455.3422567 · Cited by 5
Rethinking recidivism through a causal lensPreprint
Shirvaikar, V., & Lakshminarayan, C. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.11483 · Cited by 2
Man and Machine: Artificial Intelligence and Judicial Decision MakingPreprint
Dyèvre, A., & Shahvaroughi, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7548322 · Cited by 1
Rost, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.02720 · Cited by 3
THE FUTURE OF THE CRIMINAL PROCEDURE: PREDICTIVE OR REAL JUSTICE
(2018) · Legal Issues of Strengthening Russian Statehood · doi:10.17223/9785946217637/13 · Cited by 1
Mitigating Voter Attribute Bias for Fair Opinion Aggregation
Ueda, R., Takeuchi, K., & Kashima, H. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604660 · Cited by 2
A Parallelizable Counterfactual Generation Method Based on Gradient Optimization
Ding, H., & Jiang, X. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00173 · Cited by 2
Fairness for Deep Learning Predictions Using Bias Parity Score Based Loss Function Regularization
Jain, B., Huber, M., & Elmasri, R. A. (2024) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213024600030 · Cited by 4
FLARE: Fuzzy Local Agnostic Rule-Based Explanations for Closed Box Classifiers
Fernández, G., Aledo, J. A., Gámez, J. A., & Puerta, J. M. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3547875 · Cited by 1
Assessing Information Influence for Node Attribute Prediction
Jui, T. D., Baker, E., & Benton, M. L. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-85628-0_2 · Cited by 1
Understanding Sociotechnical Systems
Powers, T. M. (2025) · Philosophy of engineering and technology · doi:10.1007/978-3-031-87974-6_9 · Cited by 3
Towards Fair Recidivism Prediction: Addressing Bias in Machine Learning for the Greek Prison System
Oikonomou, F., Bailis, E., Bentos, S., Chatzistamatis, S., Tzortzi, M., Kotis, K., Spirou, S., & Tsekouras, G. E. (2025) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset64571.2025.11008007 · Cited by 1
Khatun, S., & Sivananda Kumar, K. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83608-156-220251007 · Cited by 3
de Villiers, R. (2025) · Administrative Sciences · doi:10.3390/admsci15070259 · Cited by 2
Strong Group Fair Classification via Optimal Transport and Mixed-Integer Linear Programming
Tao, Y., Chen, C., Jiang, S., & Wang, Q. (2025) · Journal of Global Optimization · doi:10.1007/s10898-025-01525-1 · Cited by 1
Biases and debiasing in human and artificial intelligence
Catellani, P., & Piastra, M. (2025) · Oñati Socio-legal Series · doi:10.35295/osls.iisl.2304 · Cited by 1
Connolly, T. F. (2025) · SN Social Sciences · doi:10.1007/s43545-025-01245-z · Cited by 1
Transforming Legal Education in the Age of AI: Towards a Critical and Experiential Pedagogy
Bennett, T. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3451-6.ch009 · Cited by 1
Liu, J., Lee, R. K.-W., & Lim, K. H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13821-7_5 · Cited by 1
Sushiiel, A. (2026) · Journal of Electrical Systems and Information Technology · doi:10.1186/s43067-026-00324-2 · Cited by 1
García-Alonso, E.-M. (2026) · Artificial intelligence · doi:10.5772/intechopen.1014994 · Cited by 2
Metadata
- Authors
- Dressel, J., & Farid, H.
- Affiliations
- Dartmouth College (US)
- Corresponding author
- Farid, Hany
- Venue
- Science Advances
- Published
- 2018-01-05
- Volume
- 4
- Issue
- 1
- Pages
- eaao5580-eaao5580
- ISSN
- 2375-2548 (ISSN-L)
- PMC
- PMC5777393
- OpenAlex
- W2785011159
- Cited by
- 1,071
- References
- 17
- Citations by year
- 2026: 138 · 2025: 124 · 2024: 149 · 2023: 153 · 2022: 126 · 2021: 127 · 2020: 148 · 2019: 76 · 2018: 29
- FWCI
- 188.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- Science Advances (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- recidivism prediction, COMPAS, risk assessment software, algorithmic fairness, algorithmic accuracy, criminal justice, parole decisions, sentencing, linear predictor, algorithmic bias
- MeSH terms
- Recidivism, Algorithms, Humans, ROC Curve, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
