The accuracy, fairness, and limits of predicting recidivism
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
Abstract
Should we trust computers to make life-altering decisions in the criminal justice system?
Overview
CoChat Summary
TL;DR
In a Broward County sample, nonexpert Amazon Mechanical Turk participants predicted recidivism about as accurately and with similar racial disparities as COMPAS, and COMPAS’s proprietary 137-feature score could be matched by simple linear classifiers using as few as two features. The authors conclude that algorithmic recidivism prediction, at least as represented by COMPAS, is no better than untrained human judgment and reaches a performance ceiling around 65% accuracy.
Key findings
- A crowd of nonexperts was statistically indistinguishable from COMPAS: crowd accuracy was 67.0% versus COMPAS’s 65.2% on the 1000-defendant subset (P = 0.85), and AUC-ROC was 0.71 ± 0.03 for participants versus 0.70 ± 0.04 for COMPAS.
- Both humans and COMPAS showed similar racial disparities in error rates: participants’ false-positive rate was 37.1% for black defendants versus 27.2% for white defendants (P = 0.027), while COMPAS’s was 40.4% versus 25.4% (P = 0.002); participants’ false-negative rate was 29.2% for black defendants versus 40.3% for white defendants (P = 0.034), while COMPAS’s was 30.9% versus 47.9% (P = 0.003).
- COMPAS’s accuracy was reproducible with simpler models: logistic regression with 7 features achieved 66.6% accuracy [64.4, 68.9], logistic regression with only 2 features—age and total number of previous convictions—achieved 66.8% [64.3, 69.2], and a nonlinear SVM achieved 65.2% [63.0, 67.2], all comparable to COMPAS’s 65.4% [64.3, 66.5].
- Including race in the human prediction task did not significantly change overall accuracy or fairness: crowd accuracy was 66.5% with race versus 67.0% without race (P = 0.66), while false-positive rates for black versus white defendants remained significantly different (40.0% vs. 26.2%, P = 0.001).
Methods
- Data came from 7214 pretrial defendants in Broward County, Florida, from 2013–2014, including demographics, criminal history, COMPAS recidivism risk scores, and 2-year rearrest records; human assessment used a fixed random subset of 1000 defendants.
- Human participants were recruited via Amazon’s Mechanical Turk: 462 in the no-race condition and 449 in the race condition, with catch trials removing inattentive respondents; each participant judged one of 20 subsets of 50 defendants, and crowd predictions used a majority-rules criterion.
- Algorithmic assessment trained logistic regression and nonlinear SVM classifiers on 7 features over 1000 random 80%/20% training/testing splits, and also tested all subsets of the 7 features, including a 2-feature logistic regression.
Limitations
- Stated in the paper: recidivism is operationalized as rearrest, not direct reoffending, and differences in arrest rates across race complicate direct comparison of false-positive and false-negative rates.
- Stated in the paper: participants were not instructed how to weight features; it remains unknown whether guidelines, dynamic risk factors, larger crowds, or criminal justice expertise would improve accuracy.
- Evident from the text: the human sample was drawn from Mechanical Turk and assumed to have little to no criminal justice expertise, there were not enough nonwhite participants to reliably measure differences across participant race, and COMPAS’s proprietary inner workings were not revealed, limiting independent verification.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 1 Not valid · 8 Not checked · 47 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This predictor yields similar results to COMPAS in terms of predictive fairness [Table 2, (A) and (D) columns].”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Algorithmic assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The COMPAS accuracy for this subset of 1000 defendants was 65.2%.”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With respect to fairness, participant accuracy is not significantly different for black defendants (66.2%) compared with white defendants (67.6%; P = 0.65, unpaired t test).”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This crowd-based approach yields a prediction accuracy of 67.0%.”
§ The accuracy, fairness, and limits of predicting recidivism > RESULTS > Human assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average COMPAS accuracy on 10,000 random subsets of size 1000 each was 65.4% with a 95% confidence interval of (62.6, 68.1).”
§ The accuracy, fairness, and limits of predicting recidivism > MATERIALS AND METHODS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
20 more claims
Create a free account to see all 56 claims and to verify the 6 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 6
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, quite a lot of effort has been made by scientists to understand how COMPAS depends on important variables like race and age, without a lot of success (59, 60).”
From Interpretable algorithmic forensics (2023) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, this work has demonstrated that simple interpretable models (with two and respectively three features) can perform as well as the widely used criminal justice COMPAS algorithm, which instead draws on 137 features.”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Dressel and Farid 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another example is [399], where the authors propose a fair-by-design approach in order to develop ML models that jointly have less bias and include as explanations human comprehensible rules.”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [400]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Dressel and Farid (2018) achieved this result by using a linear predictor-logistic regressor that made use of only two variables (age and total number of previous convictions of the subject).”
From Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward (2020) · cites this paper as Dressel and Farid (2018)
The cited source says what the claim attributes to it.
In the citing paper
“Recent research for predicting social outcomes has shown that even with complex models and large datasets, there are strong limits to predictive performance.49,83”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [83]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Predicting relapse: A meta-analysis of sexual offender recidivism studies.
Hanson, R. K., & Bussière, M. T. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.2.348 · Cited by 2,375
A META‐ANALYSIS OF THE PREDICTORS OF ADULT OFFENDER RECIDIVISM: WHAT WORKS!*
GENDREAU, P., LITTLE, T., & GOGGIN, C. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01220.x · Cited by 1,244
Hanson, R. K., & Morton-Bourgon, K. E. (2009) · Psychological Assessment · doi:10.1037/a0014421 · Cited by 1,050
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Where Should We Intervene?: Dynamic Predictors of Sexual Offense Recidivism
HANSON, R. K., & HARRIS, A. J. R. (2000) · Criminal Justice and Behavior · doi:10.1177/0093854800027001002 · Cited by 793
Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations
Perry, W., McInnis, B., Price, C., Smith, S., & Hollywood, J. (2013) · doi:10.7249/rr233 · Cited by 693
The efficacy of violence prediction: a meta-analytic comparison of nine risk assessment tools.
Yang, M., Wong, S. C. P., & Coid, J. (2010) · Psychological Bulletin · doi:10.1037/a0020473 · Cited by 525
The Robust Beauty of Majority Rules in Group Decisions.
Hastie, R., & Kameda, T. (2005) · Psychological Review · doi:10.1037/0033-295x.112.2.494 · Cited by 462
Cited by
Items 201–300 of 1,260
Klein, U., Depping, J., Wohlfahrt, L., & Fassbender, P. (2023) · AI & Society · doi:10.1007/s00146-023-01699-w · Cited by 53
Security, privacy, and robustness for trustworthy AI systems: A review
Saeed, M. M., & Alsharidah, M. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109643 · Cited by 54
Fine, A., Berthelot, E. R., & Marsh, S. (2025) · Behavioral Sciences · doi:10.3390/bs15040476 · Cited by 46
Digital Technology, Politics, and Policy-Making
Gilardi, F. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108887304 · Cited by 53
Srinivasan, R., & Chander, A. (2021) · Queue · doi:10.1145/3466132.3466134 · Cited by 49
The Ethics of Privacy in Research and Design: Principles, Practices, and Potential
Kisselburgh, L. G., & Beever, J. (2022) · Springer eBooks · doi:10.1007/978-3-030-82786-1_17 · Cited by 52
The Accuracy of the Violent Offender Identification Directive Tool to Predict Future Gun Violence
Wheeler, A. P., Worden, R. E., & Silver, J. R. (2019) · Criminal Justice and Behavior · doi:10.1177/0093854818824378 · Cited by 43
Fritz, A., Brandt, W., Gimpel, H., & Bayer, S. (2020) · De Ethica · doi:10.3384/de-ethica.2001-8819.20613 · Cited by 37
Luo, Y., Tian, Y., Shi, M., Pasquale, L. R., Shen, L. Q., Zebardast, N., Elze, T., & Wang, M. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3377552 · Cited by 68
A Geometric Solution to Fair Representations
He, Y., Burghardt, K., & Lerman, K. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375864 · Cited by 54
Predicting Recidivism Risk Meets AI Act
DIJCK, G. V. (2022) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-022-09516-8 · Cited by 43
Baron, S. (2025) · Philosophy & Technology · doi:10.1007/s13347-024-00837-6 · Cited by 29
Fairness and Bias in Robot Learning
Londoño, L., Hurtado, J. V., Hertz, N., Kellmeyer, P., Vöeneky, S., & Valada, A. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3403898 · Cited by 60
Classification in the Wild: The Science and Art of Transparent Decision Making
Katsikopoulos, K. V., Şimşek, Ö., Buckmann, M., & Gigerenzer, G. (2021) · doi:10.7551/mitpress/11790.001.0001 · Cited by 42
A Missing Piece in the Puzzle: Considering the Role of Task Complexity in Human-AI Decision Making
Salimzadeh, S., He, G., & Gadiraju, U. (2023) · Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3565472.3592959 · Cited by 42
“For example, recidivism prediction algorithms have been used to help judges determine whether defendants are likely to re-offend [26, 31, 65, 69], medical diseases are being diagnosed with AI systems [19, 57, 62], and loan risk prediction algorithms are employed to approve or reject loan applications [11, 25, 38, 95].”
MethodInherent Bias in Artificial Intelligence-Based Decision Support Systems for Healthcare
Gurupur, V., & Wan, T. T. H. (2020) · Medicina · doi:10.3390/medicina56030141 · Cited by 42
The AI-mediated intimacy economy: a paradigm shift in digital interactions
Bozdağ, A. A. (2025) · AI & SOCIETY · doi:10.1007/s00146-024-02132-6 · Cited by 42
Algorithmic Risk Assessment in the Hands of Humans
Stevenson, M., & Doleac, J. L. (2020) · doi:10.2139/ssrn.3513695 · Cited by 42
Benchmarking Triage Capability of Symptom Checkers Against That of Medical Laypersons: Survey Study
Schmieding, M. L., Mörgeli, R., Schmieding, M. A. L., Feufel, M. A., & Balzer, F. (2021) · Journal of Medical Internet Research · doi:10.2196/24475 · Cited by 42
The Explanation Game: A Formal Framework for Interpretable Machine Learning
Watson, D., & Floridi, L. (2021) · Philosophical studies series · doi:10.1007/978-3-030-81907-1_11 · Cited by 55
AI and Blackness: Toward Moving Beyond Bias and Representation
Dancy, C. L., & Saucier, P. K. (2021) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3125998 · Cited by 50
How do judges use large language models? Evidence from Shenzhen
Liu, J. Z., & Li, X. (2024) · The Journal of Legal Analysis · doi:10.1093/jla/laae009 · Cited by 54
Lalor, J. P., Abbasi, A., Oketch, K., Yang, Y., & Forsgren, N. (2024) · ACM Transactions on Information Systems · doi:10.1145/3641276 · Cited by 58
Evaluating Superhuman Models with Consistency Checks
Fluri, L., Paleka, D., & Tramèr, F. (2024) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml59370.2024.00017 · Cited by 67
The Use of Risk Assessment in Sentencing
van Ginneken, E. F. J. C. (2019) · Hart Publishing eBooks · doi:10.5040/9781509921447.ch-002 · Cited by 39
Individual Fairness for $k$-ClusteringPreprint
Mahabadi, S., & Vakilian, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.06742 · Cited by 98
Does Explainable Artificial Intelligence Improve Human Decision-Making?
Alufaisan, Y., Marusich, L. R., Bakdash, J. Z., Zhou, Y., & Kantarcioglu, M. (2020) · doi:10.31234/osf.io/d4r9t · Cited by 30
Viljoen, J. L., Goossens, I., Monjazeb, S., Cochrane, D. M., Vargen, L. M., Jonnson, M. R., Blanchard, A. J. E., Li, S. M. Y., & Jackson, J. R. (2024) · Behavioral Sciences & the Law · doi:10.1002/bsl.2698 · Cited by 39
Liars know they are lying: differentiating disinformation from disagreement
Lewandowsky, S., Ecker, U. K. H., Cook, J., van der Linden, S., Roozenbeek, J., Орескес, Н., & McIntyre, L. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03503-6 · Cited by 44
InfoFair: Information-Theoretic Intersectional Fairness
Kang, J. L., Xie, T., Wu, X., Maciejewski, R., & Tong, H. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020588 · Cited by 52
Hartmann, J., Schwenzow, J., & Witte, M. (2023) · arXiv · doi:10.48550/arxiv.2301.01768 · Cited by 37
“Policy & Internet, 8(4):376–390, 2016.”
BackgroundOrganizational preparedness for the use of large language models in pathology informatics
Hart, S. N., Hoffman, N. G., Gershkovich, P., Christenson, C., McClintock, D. S., Miller, L. J., Jackups, R., Azimi, V., Spies, N., & Brodsky, V. (2023) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2023.100338 · Cited by 36
Towards Fair Truth Discovery from Biased Crowdsourced Answers
Li, Y., Sun, H., & Wang, H. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403102 · Cited by 44
Underestimation Bias and Underfitting in Machine Learning
Cunningham, P., & Delany, S. J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-73959-1_2 · Cited by 38
Algorithmic Factors Influencing Bias in Machine Learning
Blanzeisky, W., & Cunningham, P. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-93736-2_41 · Cited by 49
Novozhilova, E., Mays, K. K., & Katz, J. E. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-02625-1 · Cited by 45
Towards Formal Fairness in Machine Learning
Ignatiev, A., Cooper, M., Siala, M., Hébrard, E., & Marques-Silva, J. P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58475-7_49 · Cited by 53
Constructing a Fair Classifier with Generated Fair Data
Jang, T., Zheng, F., & Wang, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16965 · Cited by 52
Data’s Impact on Algorithmic Bias
Shin, D., & Shin, E. Y. (2023) · Computer · doi:10.1109/mc.2023.3262909 · Cited by 43
Explaining Deep Neural NetworksPreprint
Camburu, O.-M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01496 · Cited by 49
Ensuring Fairness under Prior Probability Shifts
Biswas, A., & Mukherjee, S. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462596 · Cited by 46
Injustice in the Justice System: Reforming Inequities for True “Justice for All”
Varghese, F. P., Israel, T., Seymour, G. O., Herbst, R. B., Suarez, L. G., & Hargons, C. N. (2019) · The Counseling Psychologist · doi:10.1177/0011000019892329 · Cited by 43
Artificial Intelligence Algorithms for Treatment of Diabetes
Rashid, M. M., Askari, M. R., Chen, C., Liang, Y., Shu, K., & Çınar, A. (2022) · Algorithms · doi:10.3390/a15090299 · Cited by 41
Wolf, C. T., Zhu, H., Bullard, J., Lee, M. K., & Brubaker, J. R. (2018) · Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3272973.3273005 · Cited by 32
Understanding Potential Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. V. (2021) · doi:10.21428/2c646de5.c16a07bb · Cited by 44
Kaplina, O., Tumanyants, A., & Verkhoglyad-Gerasymenko, I. K. A. O. (2023) · Access to Justice in Eastern Europe · doi:10.33327/ajee-18-6.3-a000314 · Cited by 34
Rashid, M. T., Wei, N., & Wang, D. (2023) · Collective Intelligence · doi:10.1177/26339137231170825 · Cited by 38
König, G., Molnar, C., Bischl, B., & Grosse‐Wentrup, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68787-8 · Cited by 36
An approach for combining ethical principles with public opinion to guide public policy
Awad, E., Anderson, M., Anderson, S. L., & Liao, B. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103349 · Cited by 29
Do We Collaborate With What We Design?
Evans, K. D., Robbins, S., & Bryson, J. J. (2023) · Topics in Cognitive Science · doi:10.1111/tops.12682 · Cited by 42
A General Framework for Fair Regression
Fitzsimons, J., Ali, A. A., Osborne, M., & Roberts, S. (2019) · Entropy · doi:10.3390/e21080741 · Cited by 45
Machine Decisions and Human Consequences
Scantamburlo, T., Charlesworth, A., & Cristianini, N. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198838494.003.0003 · Cited by 56
Multi-dimensional Discrimination in Law and Machine Learning - A Comparative Overview
Roy, A. G., Horstmann, J., & Ntoutsi, E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593979 · Cited by 43
An Empirical Study on Learning Fairness Metrics for COMPAS Data with Human SupervisionPreprint
Wang, H., Grgić-Hlača, N., Lahoti, P., Gummadi, K. P., & Weller, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10255 · Cited by 32
OmniFair: A Declarative System for Model-Agnostic Group Fairness in Machine Learning
Zhang, H., Chu, X., Asudeh, A., & Navathe, S. B. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3452787 · Cited by 44
An information theoretic approach to reducing algorithmic bias for machine learning
Kim, J.-Y., & Cho, S. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.09.081 · Cited by 38
Measure Utility, Gain Trust: Practical Advice for XAI Researchers
Davis, B., Glenski, M., Sealy, W. I. N., & Arendt, D. (2020) · IEEE Workshop on TRust and EXpertise in Visual Analytics (TREX) · doi:10.1109/trex51495.2020.00005 · Cited by 43
Breaking Away From AI: The Ontological and Ethical Evolution of Machine Learning
Barbierato, E., Gatti, A., Incremona, A., Pozzi, A., & Toti, D. (2025) · IEEE Access · doi:10.1109/access.2025.3553032 · Cited by 32
Ireland, L. (2019) · Journal of Crime and Justice · doi:10.1080/0735648x.2019.1655781 · Cited by 32
Group-Aware Threshold Adaptation for Fair Classification
Jang, T., Shi, P., & Wang, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20657 · Cited by 57
Predictive algorithms in the delivery of public employment services
Körtner, J., & Bonoli, G. (2023) · Edward Elgar Publishing eBooks · doi:10.4337/9781800880887.00037 · Cited by 48
Māori Algorithmic Sovereignty: Idea, Principles, and Use
Brown, P. T., Wilson, D., West, K., Escott, K.-R., Basabas, K., Ritchie, B., Lucas, D., Taia, I., Kusabs, N., & Keegan, T. T. (2024) · Data Science Journal · doi:10.5334/dsj-2024-015 · Cited by 36
How Fair Can We Go: Detecting the Boundaries of Fairness Optimization in Information Retrieval
Gao, R., & Shah, C. S. (2019) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3341981.3344215 · Cited by 37
Windelband, L. (2023) · Springer eBooks · doi:10.1007/978-3-031-26490-0_12 · Cited by 29
Crime, inequality and public health: a survey of emerging trends in urban data science
Luca, M., Campedelli, G. M., Centellegher, S., Tizzoni, M., & Lepri, B. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1124526 · Cited by 33
Risk scores, label bias, and everything but the kitchen sink
Zanger-Tishler, M., Nyarko, J., & Goel, S. (2024) · Science Advances · doi:10.1126/sciadv.adi8411 · Cited by 33
Statistical Panopticism and Its Critique
Diaz-Bone, R. (2019) · Historical social research · doi:10.12759/hsr.44.2019.2.77-102 · Cited by 42
Difficulty-Based Sampling for Debiased Contrastive Representation Learning
Jang, T., & Wang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02302 · Cited by 34
Torkamaan, H., Tahaei, M., Buijsman, S., Xiao, Z., Wilkinson, D., & Knijnenburg, B. P. (2024) · Human-computer interaction series · doi:10.1007/978-3-031-55109-3_2 · Cited by 40
Algorithmic Institutionalism: The Changing Rules of Social and Political Life
Mendonça, R. F., Almeida, V. A. F., & Filgueiras, F. D. B. (2023) · doi:10.1093/oso/9780192870070.001.0001 · Cited by 65
FairDomain: Achieving Fairness in Cross-Domain Medical Image Segmentation and Classification
Tian, Y., Wen, C., Shi, M., Afzal, M. M., Huang, H. M., Khan, M. O., Luo, Y., Fang, Y., & Wang, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73116-7_15 · Cited by 50
Shamsuddin, R., Tabrizi, H. B., & Gottimukkula, P. R. (2025) · AI Perspectives & Advances · doi:10.1186/s42467-024-00016-5 · Cited by 29
Apparent Algorithmic Bias and Algorithmic Learning
Lambrecht, A., & Tucker, C. E. (2020) · Quantitative Marketing and Economics · doi:10.1007/s11129-024-09286-z · Cited by 30
AI and Discrimination: Sources of Algorithmic Biases
Moussawi, S., Deng, X. N., & Joshi, K. D. (2024) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/3701613.3701615 · Cited by 38
We are Building Gods: AI as the Anthropomorphised Authority of the Past
Öhman, C. (2024) · Minds and Machines · doi:10.1007/s11023-024-09667-z · Cited by 34
Trustworthy Artificial Intelligence in Education: Pitfalls and PathwaysPreprint
Smuha, N. A. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3742421 · Cited by 40
Li, Y., Zhang, L., & Zhang, Y. (2023) · arXiv · doi:10.48550/arxiv.2305.18569 · Cited by 28
Artificial Intelligence and Legal Tech: Challenges to the Rule of Law
Buchholtz, G. (2020) · Regulating Artificial Intelligence · doi:10.1007/978-3-030-32361-5_8 · Cited by 27
Doing Justice, Preventing Crime
Tonry, M. (2020) · doi:10.1093/oso/9780195320503.001.0001 · Cited by 33
Rebitschek, F. G., Gigerenzer, G., & Wagner, G. G. (2021) · Scientific Reports · doi:10.1038/s41598-021-99802-y · Cited by 37
COVID-19 amplified racial disparities in the US criminal legal system
Klein, B., Ogbunugafor, C. B., Schafer, B. J., Bhadricha, Z., Kori, P., Sheldon, J., Kaza, N., Sharma, A., Wang, E. A., Eliassi‐Rad, T., et al. (2023) · Nature · doi:10.1038/s41586-023-05980-2 · Cited by 29
Artificial intelligence in forensic mental health: A review of applications and implications
Olawade, D. B., Ayoola, F. I., Ebo, T. O., Asaolu, A. J., Egbon, E., & David-Olawade, A. C. (2025) · Journal of Forensic and Legal Medicine · doi:10.1016/j.jflm.2025.102895 · Cited by 33
Body stakes: an existential ethics of care in living with biometrics and AI
Lagerkvist, A., Tudor, M., Smolicki, J., Ess, C., Lundström, J. E., & Rogg, M. (2022) · AI & Society · doi:10.1007/s00146-022-01550-8 · Cited by 27
Knowledge and support for AI in the public sector: a deliberative poll experiment
Arnesen, S., Broderstad, T. S., Fishkin, J. S., Johannesson, M. P., & Siu, A. (2024) · AI & Society · doi:10.1007/s00146-024-02104-w · Cited by 32
Lyons, J. B., Hobbs, K. L., Rogers, S. C., & Clouse, H. S. (2023) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2023.1201777 · Cited by 28
Sung, G., Guillain, L. V., & Schneider, B. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00455-5 · Cited by 30
Prediction as extraction of discretion
Hong, S. (2023) · Big Data & Society · doi:10.1177/20539517231171053 · Cited by 34
Causal inference for social discrimination reasoning
Qureshi, B., Kamiran, F., Karim, A., Ruggieri, S., & Pedreschi, D. (2019) · Journal of Intelligent Information Systems · doi:10.1007/s10844-019-00580-x · Cited by 30
A Decision Theoretic Framework for Measuring AI Reliance
Guo, Z., Wu, Y., Hartline, J. D., & Hullman, J. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658901 · Cited by 27
Hoffmann, R., & Malrieu, J. (2019) · Angewandte Chemie International Edition · doi:10.1002/anie.201910283 · Cited by 26
Procedural Justice and Risk-Assessment AlgorithmsPreprint
Wang, A. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3170136 · Cited by 32
Crowdsourcing with Fairness, Diversity and Budget Constraints
Goel, N., & Faltings, B. V. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314282 · Cited by 36
Utilizing large language models for gastroenterology research: a conceptual framework
Berry, P., Dhanakshirur, R. R., & Khanna, S. (2025) · Therapeutic Advances in Gastroenterology · doi:10.1177/17562848251328577 · Cited by 29
Immune moral models? Pro-social rule breaking as a moral enhancement approach for ethical AI
Ramanayake, R., Wicke, P., & Nallur, V. (2022) · AI & Society · doi:10.1007/s00146-022-01478-z · Cited by 30
Human preferences toward algorithmic advice in a word association task
Bogert, E., Lauharatanahirun, N., & Schecter, A. (2022) · Scientific Reports · doi:10.1038/s41598-022-18638-2 · Cited by 35
Artificial Intelligence—A New Knowledge and Decision-Making Paradigm?
Huang, L., & Peissl, W. (2023) · Springer eBooks · doi:10.1007/978-3-031-10617-0_9 · Cited by 32
The Ethics of Artificial Intelligence
Rees, C. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-64246-4_5 · Cited by 32
Do Expressions Change Decisions? Exploring the Impact of AI's Explanation Tone on Decision-Making
Okoso, A., Yang, M., & Baba, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713744 · Cited by 32
Unfairness in AI Anti-Corruption Tools: Main Drivers and Consequences
Odilla, F. (2024) · Minds and Machines · doi:10.1007/s11023-024-09688-8 · Cited by 31
Promises and Pitfalls of Artificial Intelligence for Legal Applications
Kapoor, S., Henderson, P., & Narayanan, A. (2024) · doi:10.2139/ssrn.4695412 · Cited by 25
“In a follow-up study, Dressel and Farid [2018] found that this accuracy was no more accurate than predictions made by people without any background in criminal justice.”
Metadata
- Authors
- Dressel, J., & Farid, H.
- Affiliations
- Dartmouth College (US)
- Corresponding author
- Farid, Hany
- Venue
- Science Advances
- Published
- 2018-01-05
- Volume
- 4
- Issue
- 1
- Pages
- eaao5580-eaao5580
- ISSN
- 2375-2548 (ISSN-L)
- PMC
- PMC5777393
- OpenAlex
- W2785011159
- Cited by
- 1,071
- References
- 17
- Citations by year
- 2026: 138 · 2025: 124 · 2024: 149 · 2023: 153 · 2022: 126 · 2021: 127 · 2020: 148 · 2019: 76 · 2018: 29
- FWCI
- 188.76
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- Locations
- Science Advances (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- recidivism prediction, COMPAS, risk assessment software, algorithmic fairness, algorithmic accuracy, criminal justice, parole decisions, sentencing, linear predictor, algorithmic bias
- MeSH terms
- Recidivism, Algorithms, Humans, ROC Curve, Area Under Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
