The accuracy, fairness, and limits of predicting recidivism
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
Abstract
Should we trust computers to make life-altering decisions in the criminal justice system?
Overview
CoChat Summary
TL;DR
In a Broward County sample, nonexpert Amazon Mechanical Turk participants predicted recidivism about as accurately and with similar racial disparities as COMPAS, and COMPAS’s proprietary 137-feature score could be matched by simple linear classifiers using as few as two features. The authors conclude that algorithmic recidivism prediction, at least as represented by COMPAS, is no better than untrained human judgment and reaches a performance ceiling around 65% accuracy.
Key findings
- A crowd of nonexperts was statistically indistinguishable from COMPAS: crowd accuracy was 67.0% versus COMPAS’s 65.2% on the 1000-defendant subset (P = 0.85), and AUC-ROC was 0.71 ± 0.03 for participants versus 0.70 ± 0.04 for COMPAS.
- Both humans and COMPAS showed similar racial disparities in error rates: participants’ false-positive rate was 37.1% for black defendants versus 27.2% for white defendants (P = 0.027), while COMPAS’s was 40.4% versus 25.4% (P = 0.002); participants’ false-negative rate was 29.2% for black defendants versus 40.3% for white defendants (P = 0.034), while COMPAS’s was 30.9% versus 47.9% (P = 0.003).
- COMPAS’s accuracy was reproducible with simpler models: logistic regression with 7 features achieved 66.6% accuracy [64.4, 68.9], logistic regression with only 2 features—age and total number of previous convictions—achieved 66.8% [64.3, 69.2], and a nonlinear SVM achieved 65.2% [63.0, 67.2], all comparable to COMPAS’s 65.4% [64.3, 66.5].
- Including race in the human prediction task did not significantly change overall accuracy or fairness: crowd accuracy was 66.5% with race versus 67.0% without race (P = 0.66), while false-positive rates for black versus white defendants remained significantly different (40.0% vs. 26.2%, P = 0.001).
Methods
- Data came from 7214 pretrial defendants in Broward County, Florida, from 2013–2014, including demographics, criminal history, COMPAS recidivism risk scores, and 2-year rearrest records; human assessment used a fixed random subset of 1000 defendants.
- Human participants were recruited via Amazon’s Mechanical Turk: 462 in the no-race condition and 449 in the race condition, with catch trials removing inattentive respondents; each participant judged one of 20 subsets of 50 defendants, and crowd predictions used a majority-rules criterion.
- Algorithmic assessment trained logistic regression and nonlinear SVM classifiers on 7 features over 1000 random 80%/20% training/testing splits, and also tested all subsets of the 7 features, including a 2-feature logistic regression.
Limitations
- Stated in the paper: recidivism is operationalized as rearrest, not direct reoffending, and differences in arrest rates across race complicate direct comparison of false-positive and false-negative rates.
- Stated in the paper: participants were not instructed how to weight features; it remains unknown whether guidelines, dynamic risk factors, larger crowds, or criminal justice expertise would improve accuracy.
- Evident from the text: the human sample was drawn from Mechanical Turk and assumed to have little to no criminal justice expertise, there were not enough nonwhite participants to reliably measure differences across participant race, and COMPAS’s proprietary inner workings were not revealed, limiting independent verification.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 1 Not valid · 8 Not checked · 47 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This predictor yields similar results to COMPAS in terms of predictive fairness [Table 2, (A) and (D) columns].”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Algorithmic assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The COMPAS accuracy for this subset of 1000 defendants was 65.2%.”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With respect to fairness, participant accuracy is not significantly different for black defendants (66.2%) compared with white defendants (67.6%; P = 0.65, unpaired t test).”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This crowd-based approach yields a prediction accuracy of 67.0%.”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average COMPAS accuracy on 10,000 random subsets of size 1000 each was 65.4% with a 95% confidence interval of (62.6, 68.1).”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 56 claims and to verify the 6 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, quite a lot of effort has been made by scientists to understand how COMPAS depends on important variables like race and age, without a lot of success (59, 60).”
From Interpretable algorithmic forensics (2023) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, this work has demonstrated that simple interpretable models (with two and respectively three features) can perform as well as the widely used criminal justice COMPAS algorithm, which instead draws on 137 features.”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Dressel and Farid 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another example is [399], where the authors propose a fair-by-design approach in order to develop ML models that jointly have less bias and include as explanations human comprehensible rules.”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [400]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Dressel and Farid (2018) achieved this result by using a linear predictor-logistic regressor that made use of only two variables (age and total number of previous convictions of the subject).”
From Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward (2020) · cites this paper as Dressel and Farid (2018)
The cited source says what the claim attributes to it.
In the citing paper
“Recent research for predicting social outcomes has shown that even with complex models and large datasets, there are strong limits to predictive performance.49,83”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [83]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Predicting relapse: A meta-analysis of sexual offender recidivism studies.
Hanson, R. K., & Bussière, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.2.348 · Cited by 2,375
A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
GENDREAU, P., LITTLE, T., & GOGGIN, C. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01220.x · Cited by 1,244
Hanson, R. K., & Morton-Bourgon, K. E. (2009) · Psychological Assessment · doi:10.1037/a0014421 · Cited by 1,050
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Where Should We Intervene?: Dynamic Predictors of Sexual Offense Recidivism
HANSON, R. K., & HARRIS, A. J. R. (2000) · Criminal Justice and Behavior · doi:10.1177/0093854800027001002 · Cited by 793
Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations
Perry, W., McInnis, B., Price, C., Smith, S., & Hollywood, J. (2013) · doi:10.7249/rr233 · Cited by 693
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
The Robust Beauty of Majority Rules in Group Decisions.
Hastie, R., & Kameda, T. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.494 · Cited by 462
Cited by
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
Leakage and the reproducibility crisis in machine-learning-based science
Kapoor, S., & Narayanan, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100804 · Cited by 1,387
“Recent research for predicting social outcomes has shown that even with complex models and large datasets, there are strong limits to predictive performance.(49,83) However, results such as the better-than-human performance of ML models in perception tasks such as image classification(88,89) give the impression of ML…”
BackgroundResultRahwan, I., Cebrian, M., Obradovich, N., Bongard, J., Bonnefon, J.-F., Breazeal, C., Crandall, J. W., Christakis, N. A., Couzin, I. D., Jackson, M. O., et al. (2019) · Nature · doi:10.1038/s41586-019-1138-y · Cited by 1,364
Aas, K., Jullum, M., & Løland, A. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103502 · Cited by 1,023
Explaining machine learning classifiers through diverse counterfactual explanations
Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233
“taset into 80%-20% train and test sets, and use TensorFlow library to train a neural network model. For COMPAS, we obtain an accuracy of 0.67, comparable to the best accuracy reported on this dataset [3, 12]. Similarly, for Adult and LendingClub datasets, we obtain accuracies of 0.83 and 0.66 respectively. 4.4 Baselin…”
MethodInfluentialIn AI we trust? Perceptions about automated decision-making by artificial intelligence
Araujo, T., Helberger, N., Kruikemeier, S., & de Vreese, C. H. (2020) · AI & SOCIETY · doi:10.1007/s00146-019-00931-w · Cited by 1,038
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882
Explainable artificial intelligence: an analytical review
Angelov, P. P., Soares, E. A., Jiang, R., Arnold, N. I., & Atkinson, P. M. (2021) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1424 · Cited by 843
Transparency and the black box problem: why we do not trust AI
von Eschenbach, W. J. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00477-0 · Cited by 786
Algorithmic fairness in artificial intelligence for medicine and healthcare
Chen, R. J., Wang, J. J., Williamson, D. F. K., Chen, T. Y., Lipkova, J., Lu, M. Y., Sahai, S., & Mahmood, F. (2023) · Nature Biomedical Engineering · doi:10.1038/s41551-023-01056-8 · Cited by 750
Accountable Artificial Intelligence: Holding Algorithms to Account
Busuioc, M. (2021) · Public Administration Review · doi:10.1111/puar.13293 · Cited by 652
“…explanations often presented as a solution for algorithmic accountability), such work is geared at demonstrating that interpretable algorithms can be powerful, and do away with the need to rely on overly complex black-boxes for high-stakes decision-making (Dressel and Farid 2018; Rudin 2019).”
BackgroundAntoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021) · Applied Sciences · doi:10.3390/app11115088 · Cited by 629
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“, underprivileged groups might experience systematic disadvantage in hiring decisions [49], or be disproportionally impacted in criminal risk profiling [104, 146, 161]).”
BackgroundA Framework of Potential Sources of Harm Throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. V. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 576
WILDS: A Benchmark of in-the-Wild Distribution Shifts
Koh, P. W., Sagawa, S., Marklund, H., Xie, S. M., Zhang, M., Balsubramani, A., Hu, W., Yasunaga, M., Phillips, R. L., Gao, I., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07421 · Cited by 518
“On the COMPAS dataset, logistic regression on a small number of features performs comparably to a black-box commercial algorithm (Jung et al., 2020; Dressel and Farid, 2018).”
Humans and Technology: Forms of Conjoined Agency in Organizations
Murray, A., Rhymer, J., & Sirmon, D. G. (2021) · Academy of Management Review · doi:10.5465/amr.2019.0186 · Cited by 518
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English
Chalkidis, I., Jana, A., Hartung, D., Bommarito, M., Androutsopoulos, I., Katz, D., & Aletras, N. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.297 · Cited by 201
Artificial Intelligence in Society
OECD (2019) · doi:10.1787/eedfee77-en · Cited by 487
The Measure and Mismeasure of Fairness
Corbett-Davies, S., Gaebler, J. D., Nilforoshan, H., Shroff, R., & Goel, S. (2018) · arXiv · doi:10.48550/arxiv.1808.00023 · Cited by 444
A Review of Taxonomies of Explainable Artificial Intelligence (XAI) Methods
Speith, T. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3534639 · Cited by 337
A Review of Challenges and Opportunities in Machine Learning for Health
Ghassemi, M., Naumann, T., Schulam, P., Beam, A. L., Chen, I. Y., & Ranganath, R. (2018) · PubMed · doi:10.48550/arxiv.1806.00388 · Cited by 248
Predictability and Surprise in Large Generative Models
Ganguli, D., Hernandez, D., Lovitt, L., DasSarma, N., Henighan, T., Jones, A., Joseph, N., Kernion, J., Mann, B., Askell, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.07785 · Cited by 324
Artificial Intelligence in Tactical Human Resource Management: A Systematic Literature Review
Votto, A. M., Valecha, R., Najafirad, P., & Rao, H. R. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2021.100047 · Cited by 322
Neural Additive Models: Interpretable Machine Learning with Neural NetsPreprint
Agarwal, R., Melnick, L., Frosst, N., Zhang, X., Lengerich, B. J., Caruana, R., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13912 · Cited by 457
Explaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300789 · Cited by 292
An Introduction to Ethics in Robotics and AI
Bartneck, C., Lütge, C., Wagner, A., & Welsh, S. (2021) · SpringerBriefs in Ethics · doi:10.1007/978-3-030-51110-4 · Cited by 223
Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments
Green, B., & Chen, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287563 · Cited by 275
“This is in contrast to a recent study suggesting that humans are just as accurate as COMPAS: that result holds only when the predictions of humans are aggregated to create a “wisdom of the crowd” eect; in fact, that study similarly found COMPAS to be more accurate than individuals [21].”
ResultTimmons, A. C., Duong, J. B., Simo Fiallo, N., Lee, T., Vo, H. P. Q., Ahle, M. W., Comer, J. S., Brewer, L. C., Frazier, S. L., & Chaspari, T. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221134490 · Cited by 263
Young, M. M., Bullock, J. B., & Lecy, J. D. (2019) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvz014 · Cited by 255
The Bias Bias in Behavioral Economics
Gigerenzer, G. (2018) · Review of Behavioral Economics · doi:10.1561/105.00000092 · Cited by 210
How can we manage biases in artificial intelligence systems – A systematic literature review
P.S., D. V. (2023) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2023.100165 · Cited by 239
Lo Piano, S. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0501-9 · Cited by 229
“Dressel and Farid (2018) achieved this result by using a linear predictor-logistic regressor that made use of only two variables (age and total number of previous convic-tions of the subject).”
Method(2019)
Retooling Politics: How Digital Media Are Shaping Democracy
Jungherr, A., Rivero, G., & Gayo-Avello, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108297820 · Cited by 161
Leyer, M., & Schneider, S. (2021) · Business Horizons · doi:10.1016/j.bushor.2021.02.026 · Cited by 178
Wang, Y. (2021) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2020.100872 · Cited by 162
Interpretability and fairness evaluation of deep learning models on MIMIC-IV dataset
Meng, C., Trinh, L., Xu, N., Enouen, J., & Liu, Y. (2022) · Scientific Reports · doi:10.1038/s41598-022-11012-2 · Cited by 174
Singh, A., Kanaujia, A., Singh, V. K., & Vinuesa, R. (2024) · Sustainable Development · doi:10.1002/sd.2706 · Cited by 211
Predictability and Surprise in Large Generative Models
Ganguli, D., Hernandez, D., Lovitt, L., Askell, A., Bai, Y., Chen, A., Conerly, T., Dassarma, N., Drain, D., Elhage, N., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533229 · Cited by 207
“13 Here, we use the same prompts outlined in [20] but instead ask language models [3] instead of people to predict recidivism.”
BackgroundMethodInfluentialMorley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2021) · Philosophical studies series · doi:10.1007/978-3-030-81907-1_10 · Cited by 221
Racial Discrimination in Housing: How Landlords Use Algorithms and Home Visits to Screen Tenants
Rosen, E., Garboden, P. M. E., & Cossyleon, J. E. (2021) · American Sociological Review · doi:10.1177/00031224211029618 · Cited by 174
Artificial intelligence in public services: When and why citizens accept its usage
Gesk, T. S., & Leyer, M. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2022.101704 · Cited by 195
Game theory interpretation of digital soil mapping convolutional neural networks
Padarian, J., McBratney, A. B., & Minasny, B. (2020) · SOIL · doi:10.5194/soil-6-389-2020 · Cited by 178
Statistical profiling in public employment services
Desiere, S., Langenbucher, K., & Struyven, L. (2019) · OECD social employment and migration working papers · doi:10.1787/b5e5f16e-en · Cited by 178
The Butterfly Effect in artificial intelligence systems: Implications for AI bias and fairness
Ferrara, E. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100525 · Cited by 208
Artificial intelligence and crime: A primer for criminologists
Hayward, K., & Maas, M. M. (2020) · Crime Media Culture An International Journal · doi:10.1177/1741659020917434 · Cited by 199
Maaß, W., Parsons, J., Purao, S., Storey, V. C., & WOO, C. C. (2018) · Journal of the Association for Information Systems · doi:10.17705/1jais.00526 · Cited by 202
Brain–phenotype models fail for individuals who defy sample stereotypes
Greene, A. S., Shen, X., Noble, S., Horien, C., Hahn, C. A., Arora, J., Tokoglu, F., Spann, M. N., Carrión, C. I., Barron, D. S., et al. (2022) · Nature · doi:10.1038/s41586-022-05118-w · Cited by 167
Martin, K. E., & Waldman, A. E. (2022) · Journal of Business Ethics · doi:10.1007/s10551-021-05032-7 · Cited by 205
Brain imaging with portable low-field MRI
Kimberly, W. T., Sorby‐Adams, A., WEBB, A. G., Wu, E. X., Beekman, R. B., Bowry, R., Schiff, S. J., de Havenon, A., Shen, F. X., Sze, G. K., et al. (2023) · Nature Reviews Bioengineering · doi:10.1038/s44222-023-00086-w · Cited by 186
Interdisciplinary Research in Artificial Intelligence: Challenges and Opportunities
Kusters, R., Misevic, D., Berry, H., Cully, A., Cunff, Y. L., Dandoy, L., Díaz-Rodríguez, N., Ficher, M., Grizou, J., Othmani, A., et al. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.577974 · Cited by 188
Area under the ROC Curve has the most consistent evaluation for binary classification
Li, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0316019 · Cited by 183
Algorithmic fairness datasets: the story so far
Fabris, A., Messina, S., Silvello, G., & Susto, G. A. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00854-z · Cited by 221
Layers of bias: A unified approach for understanding problems with risk assessment
Eckhouse, L., Lum, K., Conti-Cook, C., & Ciccolini, J. (2019) · Criminal Justice and Behavior · doi:10.1177/0093854818811379 · Cited by 156
Preventing repeated real world AI failures by cataloging incidents: the AI incident database
McGregor, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17817 · Cited by 156
Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobserved
Chen, J., Kallus, N., Mao, X., Svacha, G., & Udell, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287594 · Cited by 150
Interpretations are useful: penalizing explanations to align neural networks with prior knowledgePreprint
Rieger, L., Singh, C., Murdoch, W. J., & Yu, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.13584 · Cited by 264
Housing Insecurity Among the Poor Today
DeLuca, S., & Rosen, E. (2022) · Annual Review of Sociology · doi:10.1146/annurev-soc-090921-040646 · Cited by 163
Algorithmic Decision-Making and the Control Problem
Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019) · Minds and Machines · doi:10.1007/s11023-019-09513-7 · Cited by 145
Measuring algorithmically infused societies
Wagner, C., Strohmaier, M., Olteanu, A., Kıcıman, E., Contractor, N., & Eliassi-Rad, T. (2021) · Nature · doi:10.1038/s41586-021-03666-1 · Cited by 144
Enhancing AI-Assisted Group Decision Making through LLM-Powered Devil's Advocate
Chiang, C.-W., Lu, Z., Li, Z., & Yin, M. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645199 · Cited by 142
Artificial intelligence, bureaucratic form, and discretion in public service
Bullock, J., Young, M. M., & Wang, Y.-F. (2020) · Information Polity · doi:10.3233/ip-200223 · Cited by 139
“Predictive policing is an umbrella term for the use of data analytics and operations management to first forecast future criminal activity, and then deploy police resources proactively to prevent occurrences, facilitate arrests (Meijer & Wessels, 2019) and predict recidivism (Dressel & Farid, 2018).”
Fair Algorithms for ClusteringPreprint
Bera, S. K., Chakrabarty, D., Flores, N. J., & Negahbani, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.02393 · Cited by 289
Towards risk-aware artificial intelligence and machine learning systems: An overview
Zhang, X., Chan, F. T. S., Yan, C., & Bose, I. (2022) · Decision Support Systems · doi:10.1016/j.dss.2022.113800 · Cited by 153
Human and artificial cognition
Siemens, G., Marmolejo-Ramos, F., Gabriel, F., Medeiros, K., Marrone, R., Joksimovic, S., & de Laat, M. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100107 · Cited by 133
Narrative transportation: How stories shape how we see ourselves and the world
Green, M. C., & Appel, M. (2024) · Advances in experimental social psychology · doi:10.1016/bs.aesp.2024.03.002 · Cited by 190
Oswald, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0359 · Cited by 132
Srinivasan, R., & Chander, A. (2021) · Communications of the ACM · doi:10.1145/3464903 · Cited by 135
Artificial intelligence and the value of transparency
Walmsley, J. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01066-z · Cited by 131
Ochmann, J., Michels, L., Tiefenbeck, V., Maier, C., & Laumer, S. (2024) · Information Systems Journal · doi:10.1111/isj.12482 · Cited by 156
The limits of human predictions of recidivism
Lin, Z. J., Jung, J., Goel, S., & Skeem, J. L. (2020) · Science Advances · doi:10.1126/sciadv.aaz0652 · Cited by 159
Using Artificial Intelligence to classify Jobseekers: The Accuracy-Equity Trade-off
Desiere, S., & Struyven, L. (2020) · Journal of Social Policy · doi:10.1017/s0047279420000203 · Cited by 158
Representative Bureaucracy and Attitudes Toward Automated Decision Making
Miller, S. M., & Keiser, L. R. (2021) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muaa019 · Cited by 127
The promise and perils of using artificial intelligence to fight corruption
Köbis, N., Starke, C., & Rahwan, I. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00489-1 · Cited by 131
A governance framework for algorithmic accountability and transparency
Koene, A. R., Clifton, C., Hatada, Y., Webb, H., & Richardson, R. (2019) · Repository@Nottingham (University of Nottingham) · doi:10.2861/59990 · Cited by 191
AI Ethics in Predictive Policing: From Models of Threat to an Ethics of Care
Asaro, P. (2019) · IEEE Technology and Society Magazine · doi:10.1109/mts.2019.2915154 · Cited by 170
The growing ubiquity of algorithms in society: implications, impacts and innovations
Olhede, S. C., & Wolfe, P. J. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0364 · Cited by 120
Zafar, A. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00121-8 · Cited by 144
González-Sendino, R., Serrano, E., & Bajo, J. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.02.023 · Cited by 135
AI in the hands of imperfect users
Kostick, K. M., & Gerke, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00737-z · Cited by 137
An Overview of Fairness in Clustering
Chhabra, A., Masalkovaitė, K., & Mohapatra, P. (2021) · IEEE Access · doi:10.1109/access.2021.3114099 · Cited by 155
Human Decision Making with Machine Assistance: An Experiment on Bailing and Jailing
Grgić-Hlača, N., Engel, C., & Gummadi, K. P. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359280 · Cited by 113
Fair Class Balancing: Enhancing Model Fairness without Observing Sensitive Attributes
Yan, S., Kao, H.-T., & Ferrara, E. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411980 · Cited by 158
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English
Chalkidis, I., Jana, A., Hartung, D., Bommarito, M. J., Androutsopoulos, I., Katz, D. M., & Aletras, N. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3936759 · Cited by 111
This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
Mulligan, D. K., Kroll, J. A., Kohli, N., & Wong, R. Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359221 · Cited by 111
Learning Certifiably Optimal Rule Lists for Categorical Data
Angelino, E., Larus-Stone, N., Alabi, D., Seltzer, M., & Rudin, C. (2017) · arXiv · doi:10.48550/arxiv.1704.01701 · Cited by 108
Counterfactual risk assessments, evaluation, and fairness
Coston, A., Mishler, A., Kennedy, E. H., & Chouldechova, A. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372851 · Cited by 162
Synthetic data in biomedicine via generative artificial intelligence
van Breugel, B., Liu, T., Oglić, D., & van der Schaar, M. (2024) · Nature Reviews Bioengineering · doi:10.1038/s44222-024-00245-7 · Cited by 149
Marinucci, L., Mazzuca, C., & Gangemi, A. (2022) · AI & Society · doi:10.1007/s00146-022-01474-3 · Cited by 124
Does Explainable Artificial Intelligence Improve Human Decision-Making?
Alufaisan, Y., Marusich, L. R., Bakdash, J. Z., Zhou, Y., & Kantarcioglu, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16819 · Cited by 106
Challenges of responsible AI in practice: scoping review and recommended actions
Sadek, M., Kallina, E., Bohné, T., Mougenot, C., Calvo, R. A., & Cave, S. (2024) · AI & Society · doi:10.1007/s00146-024-01880-9 · Cited by 142
Black Feminist Musings on Algorithmic Oppression
Hampton, L. M. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445929 · Cited by 125
An Action-Oriented AI Policy Toolkit for Technology Audits by Community Advocates and Activists
Krafft, P. M., Young, M., Katell, M. A., Lee, J. E., Narayan, S., Epstein, M., Dailey, D., Herman, B., Tam, A., Guetler, V., et al. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445938 · Cited by 102
Making Sense of Machine Learning: A Review of Interpretation Techniques and Their Applications
Tursunalieva, A., Alexander, D. L., Dunne, R. A., Li, J., Riera, L., & Zhao, Y. (2024) · Applied Sciences · doi:10.3390/app14020496 · Cited by 119
Fairness issues, current approaches, and challenges in machine learning models
Jui, T. D., & Rivas, P. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-02083-2 · Cited by 131
Algorithmic fairness in business analytics: Directions for research and practice
De‐Arteaga, M., Feuerriegel, S., & Saar‐Tsechansky, M. (2022) · Production and Operations Management · doi:10.1111/poms.13839 · Cited by 135
Prognostic models will be victims of their own success, unless…
Lenert, M. C., Matheny, M. E., & Walsh, C. G. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz145 · Cited by 114
Menard, P., & Bott, G. J. (2024) · Information Systems Journal · doi:10.1111/isj.12544 · Cited by 120
Metadata
- Authors
- Dressel, J., & Farid, H.
- Affiliations
- Dartmouth College (US)
- Corresponding author
- Farid, Hany
- Venue
- Science Advances
- Published
- 2018-01-05
- Volume
- 4
- Issue
- 1
- Pages
- eaao5580-eaao5580
- ISSN
- 2375-2548 (ISSN-L)
- PMC
- PMC5777393
- OpenAlex
- W2785011159
- Cited by
- 1,071
- References
- 17
- Citations by year
- 2026: 138 · 2025: 124 · 2024: 149 · 2023: 153 · 2022: 126 · 2021: 127 · 2020: 148 · 2019: 76 · 2018: 29
- FWCI
- 188.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- Science Advances (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- recidivism prediction, COMPAS, risk assessment software, algorithmic fairness, algorithmic accuracy, criminal justice, parole decisions, sentencing, linear predictor, algorithmic bias
- MeSH terms
- Recidivism, Algorithms, Humans, ROC Curve, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
