The accuracy, fairness, and limits of predicting recidivism
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
Abstract
Should we trust computers to make life-altering decisions in the criminal justice system?
Overview
CoChat Summary
TL;DR
In a Broward County sample, nonexpert Amazon Mechanical Turk participants predicted recidivism about as accurately and with similar racial disparities as COMPAS, and COMPAS’s proprietary 137-feature score could be matched by simple linear classifiers using as few as two features. The authors conclude that algorithmic recidivism prediction, at least as represented by COMPAS, is no better than untrained human judgment and reaches a performance ceiling around 65% accuracy.
Key findings
- A crowd of nonexperts was statistically indistinguishable from COMPAS: crowd accuracy was 67.0% versus COMPAS’s 65.2% on the 1000-defendant subset (P = 0.85), and AUC-ROC was 0.71 ± 0.03 for participants versus 0.70 ± 0.04 for COMPAS.
- Both humans and COMPAS showed similar racial disparities in error rates: participants’ false-positive rate was 37.1% for black defendants versus 27.2% for white defendants (P = 0.027), while COMPAS’s was 40.4% versus 25.4% (P = 0.002); participants’ false-negative rate was 29.2% for black defendants versus 40.3% for white defendants (P = 0.034), while COMPAS’s was 30.9% versus 47.9% (P = 0.003).
- COMPAS’s accuracy was reproducible with simpler models: logistic regression with 7 features achieved 66.6% accuracy [64.4, 68.9], logistic regression with only 2 features—age and total number of previous convictions—achieved 66.8% [64.3, 69.2], and a nonlinear SVM achieved 65.2% [63.0, 67.2], all comparable to COMPAS’s 65.4% [64.3, 66.5].
- Including race in the human prediction task did not significantly change overall accuracy or fairness: crowd accuracy was 66.5% with race versus 67.0% without race (P = 0.66), while false-positive rates for black versus white defendants remained significantly different (40.0% vs. 26.2%, P = 0.001).
Methods
- Data came from 7214 pretrial defendants in Broward County, Florida, from 2013–2014, including demographics, criminal history, COMPAS recidivism risk scores, and 2-year rearrest records; human assessment used a fixed random subset of 1000 defendants.
- Human participants were recruited via Amazon’s Mechanical Turk: 462 in the no-race condition and 449 in the race condition, with catch trials removing inattentive respondents; each participant judged one of 20 subsets of 50 defendants, and crowd predictions used a majority-rules criterion.
- Algorithmic assessment trained logistic regression and nonlinear SVM classifiers on 7 features over 1000 random 80%/20% training/testing splits, and also tested all subsets of the 7 features, including a 2-feature logistic regression.
Limitations
- Stated in the paper: recidivism is operationalized as rearrest, not direct reoffending, and differences in arrest rates across race complicate direct comparison of false-positive and false-negative rates.
- Stated in the paper: participants were not instructed how to weight features; it remains unknown whether guidelines, dynamic risk factors, larger crowds, or criminal justice expertise would improve accuracy.
- Evident from the text: the human sample was drawn from Mechanical Turk and assumed to have little to no criminal justice expertise, there were not enough nonwhite participants to reliably measure differences across participant race, and COMPAS’s proprietary inner workings were not revealed, limiting independent verification.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 1 Not valid · 8 Not checked · 47 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This predictor yields similar results to COMPAS in terms of predictive fairness [Table 2, (A) and (D) columns].”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Algorithmic assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The COMPAS accuracy for this subset of 1000 defendants was 65.2%.”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With respect to fairness, participant accuracy is not significantly different for black defendants (66.2%) compared with white defendants (67.6%; P = 0.65, unpaired t test).”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This crowd-based approach yields a prediction accuracy of 67.0%.”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average COMPAS accuracy on 10,000 random subsets of size 1000 each was 65.4% with a 95% confidence interval of (62.6, 68.1).”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 56 claims and to verify the 6 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, quite a lot of effort has been made by scientists to understand how COMPAS depends on important variables like race and age, without a lot of success (59, 60).”
From Interpretable algorithmic forensics (2023) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, this work has demonstrated that simple interpretable models (with two and respectively three features) can perform as well as the widely used criminal justice COMPAS algorithm, which instead draws on 137 features.”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Dressel and Farid 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another example is [399], where the authors propose a fair-by-design approach in order to develop ML models that jointly have less bias and include as explanations human comprehensible rules.”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [400]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Dressel and Farid (2018) achieved this result by using a linear predictor-logistic regressor that made use of only two variables (age and total number of previous convictions of the subject).”
From Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward (2020) · cites this paper as Dressel and Farid (2018)
The cited source says what the claim attributes to it.
In the citing paper
“Recent research for predicting social outcomes has shown that even with complex models and large datasets, there are strong limits to predictive performance.49,83”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [83]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Predicting relapse: A meta-analysis of sexual offender recidivism studies.
Hanson, R. K., & Bussière, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.2.348 · Cited by 2,375
A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
GENDREAU, P., LITTLE, T., & GOGGIN, C. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01220.x · Cited by 1,244
Hanson, R. K., & Morton-Bourgon, K. E. (2009) · Psychological Assessment · doi:10.1037/a0014421 · Cited by 1,050
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Where Should We Intervene?: Dynamic Predictors of Sexual Offense Recidivism
HANSON, R. K., & HARRIS, A. J. R. (2000) · Criminal Justice and Behavior · doi:10.1177/0093854800027001002 · Cited by 793
Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations
Perry, W., McInnis, B., Price, C., Smith, S., & Hollywood, J. (2013) · doi:10.7249/rr233 · Cited by 693
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
The Robust Beauty of Majority Rules in Group Decisions.
Hastie, R., & Kameda, T. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.494 · Cited by 462
Cited by
Items 601–700 of 1,260
Suh, J. W., Saunders, R., Simes, E., Delamain, H., Butler, S., Cottrell, D. J., Kraam, A., Scott, S., Goodyer, I. M., Wason, J. M. S., et al. (2024) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-024-02592-7 · Cited by 3
Ethical prompting: toward strategies for rapid and inclusive assistance in dual-use AI systems
Farnós, J., Pinillos, A. S., & Costa, V. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1646444 · Cited by 5
Campione, R. (2019) · Cuadernos Electrónicos de Filosofía del Derecho · doi:10.7203/cefd.40.13881 · Cited by 5
Smith, J. M. (2020) · Advances in logistics, operations, and management science book series · doi:10.4018/978-1-7998-3473-1.ch065 · Cited by 5
Beyond Cash Bail: Public Health, Risk Assessment, and California Senate Bill 10
Guttman, Z., Hebner, Y., Mori, K., & Balk, J. (2020) · Journal of Science Policy & Governance · doi:10.38126/jspg170107 · Cited by 5
Opesanwo, O., & Awofeso, O. (2024) · The International Journal of Information Diversity & Inclusion (IJIDI) · doi:10.33137/ijidi.v8i1.41248 · Cited by 7
Mitigating the judicial human–AI fairness gap
Chen, B. M., Hermstrüwer, Y., Langenbach, P., Stremitzer, A., & Tobia, K. P. (2026) · The Journal of Legal Analysis · doi:10.1093/jla/laag007 · Cited by 5
Revisiting big data optimism: risks of data-driven black box algorithms for society
Mahajan, S., & Helbing, D. (2026) · Ethics and Information Technology · doi:10.1007/s10676-026-09888-z · Cited by 9
Judgment Cannot Be Delegated: A Subject-Preserving Framework for AI Governance
Torrecilla-Pinero, J. A. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01140-2 · Cited by 5
Under manipulations, are some AI models harder to audit?
Godinot, A., Merrer, E. L., Trédan, G., Penzo, C., & Taïani, F. (2024) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml59370.2024.00038 · Cited by 11
Approximate Regions of Attraction in Learning with Decision-Dependent DistributionsPreprint
Dong, R., Zhang, H., & Ratliff, L. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.00055 · Cited by 6
Machine Bias: A Survey of Issues
Farič, A., & Bratko, I. (2024) · Informatica · doi:10.31449/inf.v48i2.5971 · Cited by 5
From Open Data to Knowledge Production: Biomedical Data Sharing and Unpredictable Data Reuses
Pasquetto, I. V. (2018) · eScholarship (California Digital Library) · Cited by 17
Porębski, A. (2023) · Research Handbook on Law and Technology · doi:10.4337/9781803921327.00037 · Cited by 4
Algorithmic Fairness Criteria as EvidencePreprint
Fleisher, W. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3974963 · Cited by 6
Public Perceptions of Algorithmic Bias and Fairness in Cloud-Based Decision Systems
Alhosban, A., Gaire, R., & Al-Ababneh, H. A. (2025) · Standards · doi:10.3390/standards6010002 · Cited by 4
Wei, Z., Zhou, Y., Li, Z., Kulkarni, M., & Zhang, Y. (2024) · Accident Analysis & Prevention · doi:10.1016/j.aap.2024.107585 · Cited by 6
Wang, H., Chen, W., Luo, X., Xing, Z., Liu, L., Qin, J., Wu, S., & Zhu, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02234 · Cited by 16
An Android-based application for convenient visitation at windhoek correctional facility
Haiduwa, T., Hashiyana, V., & Samuel, J. N. (2020) · International Conference on Intelligent and Innovative Computing Applications · doi:10.1145/3415088.3415127 · Cited by 4
Criminal History Enhancements at Sentencing
Roberts, J. R., & Harrendorf, S. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108649742.008 · Cited by 4
Waggoner, P., & Macmillen, A. (2021) · Journal of Computational Social Science · doi:10.1007/s42001-021-00122-y · Cited by 4
Just Algorithms: Using Science to Reduce Incarceration and Inform a Jurisprudence of Risk
Slobogin, C. (2021) · Cited by 4
Predicting Heuristic Decisions in Child Welfare: A Neural Network Exploration
Ninness, C., Yelick, A., Ninness, S. K., & Cordova, W. (2021) · Behavior and Social Issues · doi:10.1007/s42822-021-00047-1 · Cited by 4
Toward a normative theory of parole grounded in agency
Bell, K. (2021) · Philosophical Issues · doi:10.1111/phis.12205 · Cited by 4
Racial Skew in Fine-Tuned Legal AI Language Models
Malic, V. Q., Kumari, A., & Liu, X. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00037 · Cited by 7
Data-Driven Algorithms in Criminal Justice: Predictions as Self-fulfilling Prophecies
Ugwudike, P. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108891325.015 · Cited by 6
Welcoming the “Intel‐ethicist”
Banja, J. D. (2019) · The Hastings Center Report · doi:10.1002/hast.976 · Cited by 4
Embedded Systems and Applications
(2022) · doi:10.5121/csit.2022.1206 · Cited by 4
Algorithmic Decision-making in the US Healthcare IndustryPreprint
Marabelli, M., Newell, S., & Page, X. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3262379 · Cited by 8
Wilson, M. P. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.199696 · Cited by 17
Fragile Algorithms and Fallible Decision-Makers: Lessons from the Justice System
Ludwig, J., & Mullainathan, S. (2021) · National Bureau of Economic Research · doi:10.3386/w29267 · Cited by 4
Do opaque algorithms have functions?
Hurshman, C. E. (2024) · Synthese · doi:10.1007/s11229-024-04745-2 · Cited by 8
Sode, K. (2026) · AI & Society · doi:10.1007/s00146-026-02885-2 · Cited by 4
Pretrial Risk Assessment on the Ground: Algorithms, Judgments, Meaning, and Policy
Moore, C., Ferguson, E., & Guerin, P. (2023) · doi:10.21428/2c646de5.b016a7b3 · Cited by 5
Human-AI Teaming: Following the IMOI Framework
Kleanthous, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60611-3_27 · Cited by 6
A Framework for Feasible Counterfactual Exploration incorporating Causality, Sparsity and Density
Markou, K., Tomaras, D., Kalogeraki, V., & Gunopulos, D. (2024) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew61823.2024.00038 · Cited by 4
Long-Term Fairness in Sequential Multi-Agent Selection With Positive Reinforcement
Puranik, B., Guldogan, O., Madhow, U., & Pedarsani, R. (2024) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2024.3416078 · Cited by 4
General procedure to measure fairness in regression problems
Ferreira, J. S., Slavkovik, M., & Casillas, J. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00721-2 · Cited by 8
Lin, Y. (2024) · Applied Geography · doi:10.1016/j.apgeog.2024.103244 · Cited by 5
A fully Bayesian tracking algorithm for mitigating disparate prediction misclassification
Short, M. B., & Mohler, G. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.05.008 · Cited by 6
Jungherr, A. M., Rivero, G., & Gayo-Avello, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108297820.008 · Cited by 5
Big Data Ethics: A Life Cycle Perspective
Vydra, S., Poamă, A., Giest, S. N., Ingrams, A. R., & Klievink, B. (2021) · Erasmus Law Review · doi:10.5553/elr.000190 · Cited by 4
L2P: An Algorithm for Estimating Heavy-tailed OutcomesPreprint
Wang, X., Varol, O., & Eliassi‐Rad, T. (2019) · arXiv (Cornell University) · Cited by 5
Surveillance and Gender-Based Power Dynamics: Psychological Considerations
Conrey, S. C., & Zurbriggen, E. L. (2023) · Springer eBooks · doi:10.1007/978-3-031-41531-9_9 · Cited by 4
AI, Evidentiary Authority, and the Right to a Fair Trial in Criminal Proceedings
Kocagul, H., & Kartal, M. (2026) · Laws · doi:10.3390/laws15030058 · Cited by 8
Learning Fair and Interpretable Representations via Linear OrthogonalizationPreprint
He, Y., Burghardt, K., & Lerman, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12854 · Cited by 5
Beyond black boxes and biases: advancing artificial intelligence in sentencing
Alimardani, A., & Istiqomah, M. (2025) · Current Issues in Criminal Justice · doi:10.1080/10345329.2025.2527994 · Cited by 5
Schaltegger, T., Ambuehl, B., Ackermann, K. A., & Ebert, N. (2024) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2024.568 · Cited by 4
Quota-based debiasing can decrease representation of the most under-represented groups
Smirnov, I., Lemmerich, F., & Strohmaier, M. (2021) · Royal Society Open Science · doi:10.1098/rsos.210821 · Cited by 5
Explanatory Publics: Explainability and Democratic ThoughtPreprint
Berry, D. M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.02108 · Cited by 4
Liu, J., Lim, K. H., & Lee, R. K.-W. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.08504 · Cited by 4
Kaur, S., Salimzadeh, S., & Gadiraju, U. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.15064 · Cited by 4
Shahid, M. O., Ahmed, C. M., Palleti, V. R., & Zhou, J. (2022) · IEEE Conference on Dependable and Secure Computing (DSC) · doi:10.1109/dsc54232.2022.9888940 · Cited by 3
A PSO Based Method to Generate Actionable Counterfactuals for High Dimensional Data
Shekhar, S., Salim, A., Jinturkar, V., Nayak, A., & Bansode, A. (2023) · IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE) · doi:10.1109/csde59766.2023.10487744 · Cited by 4
„KI“ in der Rechtsmedizin – von der Forschung in die Praxis: Welche Herausforderungen ergeben sich?
Rüther, M., Eickhoff, S. B., König, L. M., Ritz, S., & Schäffer, B. (2025) · Rechtsmedizin · doi:10.1007/s00194-025-00742-y · Cited by 3
Hemesath, S., & Tepe, M. (2025) · Behavioural Public Policy · doi:10.1017/bpp.2025.2 · Cited by 3
Wu, H., & Hu, Y. Q. (2026) · Dia-noesis. · doi:10.12681/dia.45795 · Cited by 3
Material calculation and its unconscious: approaching computerization with Heidegger and Lacan
Heimann, M., & Hübener, A.-F. (2023) · Psychoanalysis Culture & Society · doi:10.1057/s41282-023-00407-3 · Cited by 4
Algorithmic Fairness, Risk, and the Dominant Protective Agency
Franke, U. (2023) · Philosophy & Technology · doi:10.1007/s13347-023-00684-x · Cited by 3
Toward Exploring Fairness in Visual Transformer Based Natural and GAN Image Detection Systems
Gangan, M. P., Kadan, A., & Lajish, V. L. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3509340 · Cited by 4
Nehring, A., Buschhüter, D., Kubsch, M., Ludwig, T., Wulff, P., & Neumann, K. (2025) · Zeitschrift für Didaktik der Naturwissenschaften · doi:10.1007/s40573-025-00177-8 · Cited by 4
Data Transparency and Fairness Analysis of the NYPD Stop-and-Frisk Program
Badr, Y., & Sharma, R. (2022) · Journal of Data and Information Quality · doi:10.1145/3460533 · Cited by 3
Towards Fair and Robust Classification
Sun, H., Wu, K., Wang, T., & Wang, W. H. (2022) · 2022 IEEE 7th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp53844.2022.00030 · Cited by 3
FADES: Fair Disentanglement with Sensitive Relevance
Jang, T., & Wang, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01147 · Cited by 11
Lob, A. B., Chakir, N., van Heuven, L. V. M., & Verschuère, B. (2024) · Applied Cognitive Psychology · doi:10.1002/acp.70006 · Cited by 3
AI Data Development: A Scorecard for the System Card Framework
Bahiru, T. K., Tibebu, H., & Kakadiaris, I. A. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-8687-2_42 · Cited by 3
Prophesied Future and Redefined Past in the Genomic Era
Kovas, Y. V., & Selita, F. (2021) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-349-96048-4_4 · Cited by 3
The Effects of Mixing Machine Learning and Human Judgment
Vaccaro, M. A., & Waldo, J. (2019) · Queue · doi:10.1145/3358955.3363293 · Cited by 7
Inclusion, equality and bias in designing online mass deliberative platformsPreprint
Shortall, R., Itten, A. V., van der Meer, M., Murukannaiah, P. K., & Jonker, C. M. (2021) · arXiv (Cornell University) · Cited by 5
An Anti-Subordination Approach to Fair ClassificationPreprint
Keswani, V., & Celis, L. E. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4116835 · Cited by 3
Rolison, J. J., Gooding, P., Russo, R., & Buchanan, K. E. (2024) · PLoS ONE · doi:10.1371/journal.pone.0292944 · Cited by 3
Yi, S., Choi, J., & Kim, G. (2024) · Information Development · doi:10.1177/02666669241276427 · Cited by 3
Adams, I. T., McLean, K. D., Vaughn, P. E., Fabila, A. R., & Alpert, G. P. (2026) · Evidence Base · doi:10.1080/30679125.2026.2696967 · Cited by 3
Challenges of Profiling Offenders for Recidivism Risk
Jamil, M. L., Pais, S., Pombo, N. G. C. C., Cordeiro, J., & Neves, P. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00036 · Cited by 3
Schneider, D., & Weber, K. (2024) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.33.1.08 · Cited by 6
Criminal Justice in the Age of AI: Addressing Bias in Predictive Algorithms Used by Courts
Karthikeyan, R., Yi, C., & Boudourides, M. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83797-635-520241003 · Cited by 7
Chowdhury, S., & Klautzer, L. (2025) · Cambridge Forum on AI Law and Governance · doi:10.1017/cfl.2025.7 · Cited by 4
Künstliche Intelligenz, Bias und Versicherungen – Eine technische und rechtliche Analyse
Pohlmann, P., Vossen, G., Everding, J., & Scheiper, J. (2022) · Zeitschrift für die gesamte Versicherungswissenschaft · doi:10.1007/s12297-022-00528-1 · Cited by 10
Ethics Education of Human Factors Engineers for Responsible AI Development
Rantanen, E. M., Lee, J. D., Darveau, K., Miller, D., Intriligator, J. M., & Sawyer, B. D. (2021) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181321651038 · Cited by 3
Rio, J. D. (2022) · Trends in Organized Crime · doi:10.1007/s12117-021-09444-9 · Cited by 3
Training Data Improvement by Automatic Generation of Semantic Networks for Bias Mitigation
Englert, R. A., & Muschiol, J. (2022) · American Journal of Information Science and Technology · doi:10.11648/j.ajist.20220601.11 · Cited by 3
Algorithmic indirect discrimination, fairness and harm
Thomsen, F. K. (2023) · AI and Ethics · doi:10.1007/s43681-023-00326-0 · Cited by 4
Incremental Learning Models of Bike Counts at Bike Sharing Systems
Almannaa, M., Elhenawy, M. M. Z., Guo, F., & Rakha, H. A. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569735 · Cited by 3
Distilling Interpretable Models into Human-Readable CodePreprint
Ravina, W., Sterling, E., Oryeshko, O., Bell, N., Zhuang, H., Wang, X., Wu, Y., & Grushetsky, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.08393 · Cited by 3
Inference-Time Rule Eraser: Fair Recognition via Distilling and Removing Biased Rules
Zhang, Y., Lu, D., & Sang, J. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3654438 · Cited by 3
Dual erosion of equality and remedy in algorithmic decision systems
Johari, B. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01040-6 · Cited by 5
The compositionality continuum as a principle for studying the neural basis of intelligence
Riveland, R., Pouget, A., & Driscoll, L. N. (2026) · Nature Neuroscience · doi:10.1038/s41593-026-02382-1 · Cited by 6
Raising Ethical Machines: Bottom-Up Methods to Implementing Machine Ethics
Kaas, M. H. L. (2020) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-7998-4894-3.ch004 · Cited by 6
Provably training overparameterized neural network classifiers with non-convex constraints
Chen, Y.-L., Wang, Z., & Kolar, M. (2022) · Electronic Journal of Statistics · doi:10.1214/22-ejs2036 · Cited by 3
Cash Transfers and Violent Crime in IndonesiaPreprint
Cisneros, E., Kis‐Katos, K., Priebe, J., & Reiners, L. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4381722 · Cited by 4
Inequality-Averse Outcome-Based MatchingPreprint
Körtner, J., & Bach, R. L. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/yrn4d · Cited by 6
Building Trust in the AI Ecosystem by Re-Evaluating Public Perception
Flores, C. (2024) · Challenger Research Journal · doi:10.5070/cr37224 · Cited by 3
Kawakami, A., Taylor, J., Fox, S., Zhu, H., & Holstein, K. (2026) · Big Data & Society · doi:10.1177/20539517261424164 · Cited by 8
Evans, K. (2021) · theses.fr (ABES) · doi:10.70675/77343456z9d12z4417z8715z2fce53011344 · Cited by 5
Sun, J., & Shen, T. (2026) · Information · doi:10.3390/info17030234 · Cited by 4
Campedelli, G. M. (2025) · Theory and Society · doi:10.1007/s11186-026-09699-7 · Cited by 6
Fabricating publics : the dissemination of culture in the post-truth era
Balaskas, B., & Rito, C. (2020) · Research Repository (Kingston University London) · Cited by 3
Generalizing in the Real World with Representation LearningPreprint
Maharaj, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.09925 · Cited by 4
The Narrow Depth and Breadth of Corporate Responsible AI ResearchPreprint
Ahmed, N., Das, A., Martin, K., & Banerjee, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.12193 · Cited by 6
Barman, P. K., & Barman, P. K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.18987 · Cited by 3
Metadata
- Authors
- Dressel, J., & Farid, H.
- Affiliations
- Dartmouth College (US)
- Corresponding author
- Farid, Hany
- Venue
- Science Advances
- Published
- 2018-01-05
- Volume
- 4
- Issue
- 1
- Pages
- eaao5580-eaao5580
- ISSN
- 2375-2548 (ISSN-L)
- PMC
- PMC5777393
- OpenAlex
- W2785011159
- Cited by
- 1,071
- References
- 17
- Citations by year
- 2026: 138 · 2025: 124 · 2024: 149 · 2023: 153 · 2022: 126 · 2021: 127 · 2020: 148 · 2019: 76 · 2018: 29
- FWCI
- 188.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- Science Advances (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- recidivism prediction, COMPAS, risk assessment software, algorithmic fairness, algorithmic accuracy, criminal justice, parole decisions, sentencing, linear predictor, algorithmic bias
- MeSH terms
- Recidivism, Algorithms, Humans, ROC Curve, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
