The DOI matches its Crossref record; 19 of the 22 references it cites were found in a registry or an index.
The Age of Secrecy and Unfairness in Recidivism Prediction
Open accessAbstract
In our current society, secret algorithms make important decisions about individuals. There has been substantial discussion about whether these algorithms are unfair to groups of individuals. While noble, this pursuit is complex and ultimately stagnating because there is no clear definition of fairness and competing definitions are largely incompatible. We argue that the focus on the question of fairness is misplaced, as these algorithms fail to meet a more important and yet readily obtainable goal: transparency. As a result, creators of secret algorithms can provide incomplete or misleading descriptions about how their models work, and various other kinds of errors can easily go unnoticed. By trying to partially reconstruct the COMPAS model—a recidivism risk-scoring model used throughout the criminal justice system—we show that it does not seem to depend linearly on the defendant’s age, despite statements to the contrary by the model’s creator. This observation has not been made before despite many recently published papers on COMPAS. Furthermore, by subtracting from COMPAS its (hypothesized) nonlinear age component, we show that COMPAS does not necessarily depend on race other than through age and criminal history. This contradicts ProPublica’s analysis, which made assumptions about age that disagree with what we observe in the data. In other words, faulty assumptions about a proprietary model led to faulty conclusions that went unchecked until now. Were the model transparent in the first place, this likely would not have occurred. We demonstrate other issues with definitions of fairness and lack of transparency in the context of COMPAS, including that a simple model based entirely on a defendant’s age is as ‘unfair’ as COMPAS by ProPublica’s chosen definition. We find that there are many defendants with low risk scores but long criminal histories, suggesting that data inconsistencies occur frequently in criminal justice databases. We argue that transparency satisfies a different notion of procedural fairness by providing both the defendants and the public with the opportunity to scrutinize the methodology and calculations behind risk scores for recidivism.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Basic typographical errors in inputs to black box recidivism prediction models have led to catastrophic errors deeply affecting people’s lives (29).”
From Interpretable algorithmic forensics (2023) · cites this paper as [29]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Self-citationFisher, A., Rudin, C., & Dominici, F. (2018) · arXiv · doi:10.48550/arxiv.1801.01489 · Cited by 1,165
Self-citationFairness in Criminal Justice Risk Assessments: The State of the Art
Berk, R., Heidari, H., Jabbari, S., Kearns, M., & Roth, A. (2021) · Sociological Methods & Research · doi:10.1177/0049124118782533 · Cited by 988
Improving the Predictive Accuracy of Static-99 and Static-2002 With Older Sex Offenders
Helmus, L., Thornton, D., Hanson, R. K., & Babchishin, K. (2012) · Sexual abuse. A Journal of Research and Treatment · doi:10.1177/1079063211409951 · Cited by 349
Evaluating the predictive validity of the COMPAS risk and needs assessment system
Brennan, T., Dieterich, W., & Ehret, B. (2009) · Criminal Justice and Behavior · doi:10.1177/0093854808326545 · Cited by 272
Marmarelis, V. Z. (2004) · doi:10.1109/9780471679370.ch5 · Cited by 152
Tollenaar, N., & van der Heijden, P. G. M. (2012) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2012.01056.x · Cited by 133
Actuarial Assessment of Risk for Reoffense Among Adult Sex Offenders
Langton, C. M., Barbaree, H. E., Seto, M. C., Peacock, E. J., Harkins, L., & Hansen, K. T. (2007) · Criminal Justice and Behavior · doi:10.1177/0093854806291157 · Cited by 129
Optimized Scoring Systems: Toward Trust in Machine Learning for Healthcare and Criminal Justice
Rudin, C. D., & Ustun, B. (2018) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.2018.0957 · Cited by 114
Self-citation
Research works printed but not linked: 6
- [21]21. J. Zeng, B. Ustun, C. Rudin, Interpretable classification models for recidivism prediction, Journal of the Royal Statistical Society: Series A (Statistics in Society) 180 , 689 (2017).
- [23]23. E. Angelino, N. Larus-Stone, D. Alabi, M. Seltzer, C. Rudin, Learning certifiably optimal rule lists for categorical data, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) (2017).
- [24]24. E. Angelino, N. Larus-Stone, D. Alabi, M. Seltzer, C. Rudin, Certifiably optimal rule lists for categorical data, Journal of Machine Learning Research 19 , 1 (2018).
- [26]26. B. Ustun, C. Rudin, Learning optimized risk scores from large-scale datasets, Journal of Machine Learning Research (2019). Accepted.
- [28]28. S. Tan, R. Caruana, G. Hooker, Y. Lou, Distill-and-compare: Auditing black-box models using transparent model distillation, AAAI/ACM Conference on AI, Ethics, and Society (2018).
- [32]32. T. Chen, C. Guestrin, Xgboost: A scalable tree boosting system, 22nd SIGKDD Conference on Knowledge Discovery and Data Mining (2016).
Cited by
Sorted by citations
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Self-citationFisher, A., Rudin, C., & Dominici, F. (2018) · arXiv · doi:10.48550/arxiv.1801.01489 · Cited by 1,165
Self-citationInterpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958
Self-citationTransparency and the black box problem: why we do not trust AI
von Eschenbach, W. J. (2021) · Philosophy & Technology · doi:10.1007/s13347-021-00477-0 · Cited by 786
Chun, W. H. K., & Barnett, A. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/14050.001.0001 · Cited by 456
Rudin, C., & Radin, J. (2019) · Harvard Data Science Review · doi:10.1162/99608f92.5a8a3a3d · Cited by 432
Self-citationPredictability and Surprise in Large Generative Models
Ganguli, D., Hernandez, D., Lovitt, L., Askell, A., Bai, Y., Chen, A., Conerly, T., Dassarma, N., Drain, D., Elhage, N., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533229 · Cited by 207
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123
Human-Centered Explainable AI (HCXAI): Beyond Opening the Black-Box of AI
Ehsan, U., Wintersberger, P., Liao, Q. V., Watkins, E. A., Manger, C., Daumé III, H., Riener, A., & Riedl, M. O. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3503727 · Cited by 117
Algorithmic Political Bias in Artificial Intelligence Systems
Peters, U. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00512-8 · Cited by 111
In Pursuit of Interpretable, Fair and Accurate Machine Learning for Criminal Recidivism Prediction
Wang, C., Han, B., Patel, B., & Rudin, C. (2023) · Journal of Quantitative Criminology · doi:10.1007/s10940-022-09545-w · Cited by 101
Self-citationOn the Existence of Simpler Machine Learning Models
Semenova, L., Rudin, C., & Parr, R. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533232 · Cited by 90
Self-citationCharting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI
Ehsan, U., Saha, K., Choudhury, M. D., & Riedl, M. O. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579467 · Cited by 113
Banerjee, S., Alsop, P. H., Jones, L. A., & Cardinal, R. N. (2022) · Patterns · doi:10.1016/j.patter.2022.100506 · Cited by 86
Explainability pitfalls: beyond dark patterns in explainable AI
Ehsan, U., & Riedl, M. O. (2024) · Patterns · doi:10.1016/j.patter.2024.100971 · Cited by 72
The explanation game: a formal framework for interpretable machine learning
Watson, D., & Floridi, L. (2020) · Synthese · doi:10.1007/s11229-020-02629-9 · Cited by 81
Interpretable algorithmic forensics
Garrett, B. L., & Rudin, C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2301842120 · Cited by 68
“Basic typographical errors in inputs to black box recidivism prediction models have led to catastrophic errors deeply affecting people’s lives (29).”
BackgroundSelf-citationFederatedTrust: A solution for trustworthy federated learning
Sánchez, P. M. S., Celdrán, A. H., Xie, N., Bovet, G., Pérez, G. M., & Stiller, B. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.10.013 · Cited by 82
AI-enabled investment advice: Will users buy it?
Chua, A. Y. K., Pal, A., & Banerjee, S. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107481 · Cited by 79
Chen, C., Lin, K., Rudin, C. D., Shaposhnik, Y., Wang, S., & Wang, T. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113647 · Cited by 76
Self-citation“Part Man, Part Machine, All Cop”: Automation in Policing
Adensamer, A., & Klausner, L. D. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.655486 · Cited by 64
Wang, A., Kapoor, S., Barocas, S., & Narayanan, A. (2023) · ACM Journal on Responsible Computing · doi:10.1145/3636509 · Cited by 82
In AI We Trust? Factors That Influence Trustworthiness of AI-infused Decision-Making ProcessesPreprint
Ashoori, M., & Weisz, J. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02675 · Cited by 117
Towards Explainability for AI Fairness
Zhou, J. J., Chen, F., & Holzinger, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-04083-2_18 · Cited by 56
Counterfactual Explanations Can Be ManipulatedPreprint
Slack, D., Hilgard, S., Lakkaraju, H., & Singh, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02666 · Cited by 58
Teaching yourself about structural racism will improve your machine learning
Robinson, W. R., Renson, A., & Naimi, A. I. (2019) · Biostatistics · doi:10.1093/biostatistics/kxz040 · Cited by 50
Semenova, L., & Rudin, C. D. (2019) · arXiv (Cornell University) · Cited by 49
Self-citationMultiple stakeholders drive diverse interpretability requirements for machine learning in healthcare
Imrie, F., Davis, R. A., & van der Schaar, M. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00698-2 · Cited by 54
Artificial intelligence, complexity, and systemic resilience in global governance
Ilcic, A. A., Fuentes, M., & Lawler, D. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1562095 · Cited by 70
The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail
Bowman, S. R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.516 · Cited by 60
With Malice Toward None: Assessing Uncertainty via Equalized Coverage
Romano, Y., Barber, R. F., Sabatti, C., & Candès, E. J. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.03f00592 · Cited by 56
Imai, K., Jiang, Z., Greiner, D. J., Halen, R., & Shin, S. (2023) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnad010 · Cited by 60
Rudin, C. D., & Carlson, D. (2019) · doi:10.1287/educ.2019.0200 · Cited by 41
Self-citationRelating instance hardness to classification performance in a dataset: a visual approach
Paiva, P. Y. A., Moreno, C. C., Smith‐Miles, K., Valeriano, M. G., & Lorena, A. C. (2022) · Machine Learning · doi:10.1007/s10994-022-06205-9 · Cited by 37
The Empirical Case for Pretrial Risk Assessment Instruments
Desmarais, S. L., Monahan, J. T., & Austin, J. (2021) · Criminal Justice and Behavior · doi:10.1177/00938548211041651 · Cited by 35
Predicting Recidivism Risk Meets AI Act
DIJCK, G. V. (2022) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-022-09516-8 · Cited by 43
A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithms
Coston, A., Kawakami, A., Zhu, H., Holstein, K., & Heidari, H. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00050 · Cited by 57
The Ethics of Artificial Intelligence in Defence
Taddeo, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197745441.001.0001 · Cited by 30
Human-Centered Explainable AI (HCXAI): Coming of Age
Ehsan, U., Wintersberger, P., Watkins, E. A., Manger, C., Ramos, G., Weisz, J. D., Daumé, H., Riener, A., & Riedl, M. O. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3573832 · Cited by 29
Towards another paradigm for forensic science?
Crispino, F., Weyermann, C., Delémont, O., Roux, C. P., & Olivier Ribaux, A. (2021) · Wiley Interdisciplinary Reviews Forensic Science · doi:10.1002/wfs2.1441 · Cited by 34
Alon‐Barkat, S., Busuioc, M., Schwoerer, K., & Weißmüller, K. S. (2025) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muaf024 · Cited by 38
Setting the Record Straight: What the COMPAS Core Risk and Need Assessment Is and Is Not
Jackson, E., & Mendoza, C. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.1b3dadaa · Cited by 26
Corbett, E., & Denton, E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594104 · Cited by 32
Watson, D. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533170 · Cited by 27
A Theory of Statistical Inference for Ensuring the Robustness of Scientific Results
Coker, B., Rudin, C. D., & King, G. (2021) · Management Science · doi:10.1287/mnsc.2020.3818 · Cited by 25
Self-citationMachine Learning in Gifted Education: A Demonstration Using Neural Networks
Hodges, J., & Mohan, S. (2019) · Gifted Child Quarterly · doi:10.1177/0016986219867483 · Cited by 27
Characterizing Fairness Over the Set of Good Models Under Selective LabelsPreprint
Coston, A., Rambachan, A., & Chouldechova, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00352 · Cited by 27
Introduction to Interpretability and Explainability
Kamath, U., & Liu, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-83356-5_1 · Cited by 24
Bias in AI systems: integrating formal and socio-technical approaches
Ahmad, A., Vallès, Y., & Idaghdour, Y. (2026) · Frontiers in Big Data · doi:10.3389/fdata.2025.1686452 · Cited by 26
Using Edge Cases to Disentangle Fairness and Solidarity in AI Ethics
Brusseau, J. (2021) · PhilPapers (PhilPapers Foundation) · Cited by 20
Ten years after ImageNet: a 360° perspective on artificial intelligence
Chawla, S., Nakov, P., Ali, A., Hall, W., Khalil, I. M., Ma, X., Sencar, H. T., Weber, I. G., Wooldridge, M., & Yu, T. (2023) · Royal Society Open Science · doi:10.1098/rsos.221414 · Cited by 24
Explainability Pitfalls: Beyond Dark Patterns in Explainable AI
Ehsan, U., & Riedl, M. O. (2021) · arXiv · doi:10.48550/arxiv.2109.12480 · Cited by 99
ProPublica's COMPAS Data RevisitedPreprint
Barenstein, M. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1906.04711 · Cited by 57
Bias in AI (Supported) Decision Making: Old Problems, New Technologies
Krištofík, A. (2025) · International Journal for Court Administration · doi:10.36745/ijca.598 · Cited by 32
The Who in Explainable AI: How AI Background Shapes Perceptions of AI ExplanationsPreprint
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M. J., & Riedl, M. O. (2021) · arXiv (Cornell University) · Cited by 17
A Human-in-the-loop Framework to Construct Context-aware Mathematical Notions of Outcome Fairness
Yaghini, M., Krause, A., & Heidari, H. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462583 · Cited by 22
Learning Fair Scoring Functions: Bipartite Ranking under ROC-based Fairness ConstraintsPreprint
Vogel, R., Bellet, A., & Clémençon, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08159 · Cited by 15
Fazel, S., Sariaslan, A., & Fanshawe, T. R. (2022) · European Journal on Criminal Policy and Research · doi:10.1007/s10610-022-09520-y · Cited by 21
Artificial intelligence and judicial decision-making: Evaluating the role of AI in debiasing
Lopes, G. (2024) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.33.1.28 · Cited by 12
Nieuwenhuizen, E., Meijer, A. J., Bex, F., & Grimmelikhuijsen, S. (2024) · Public Performance & Management Review · doi:10.1080/15309576.2024.2443140 · Cited by 18
AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development
Saxena, D., Jung, J.-Y., Forlizzi, J., Holstein, K., & Zimmerman, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714098 · Cited by 25
TOWARD HOLISTIC DATA SCIENCE EDUCATION
Veaux, R. D. D., Hoerl, R. W., Snee, R. D., & Velleman, P. F. (2022) · Statistics Education Research Journal · doi:10.52041/serj.v21i2.40 · Cited by 12
Apt and actionable possible identities matter: The case of academic outcomes
O’Donnell, S. C., & Oyserman, D. (2022) · Journal of Adolescence · doi:10.1002/jad.12118 · Cited by 12
Butcher, B., Zilka, M., Hron, J., Cook, D., & Weller, A. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3652591 · Cited by 16
Sources of Opacity in Computer Systems: Towards a Comprehensive Taxonomy
Mann, S., Crook, B., Kästner, L., Schomäcker, A., & Speith, T. (2023) · 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew57809.2023.00063 · Cited by 10
Fair Models for Impartial Policies: Controlling Algorithmic Bias in Transport Behavioural Modelling
Vega-Gonzalo, M., & Christidis, P. (2022) · Sustainability · doi:10.3390/su14148416 · Cited by 11
AI algorithmic oversight: new frontiers in regulation
Busuioc, M. (2022) · Edward Elgar Publishing eBooks · doi:10.4337/9781839108990.00043 · Cited by 13
Variable Importance Without Impossible Data
Mase, M., Owen, A. B., & Seiler, B. B. (2023) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-040722-045325 · Cited by 13
Performative Ethics From Within the Ivory Tower: How CS Practitioners Uphold Systems of Oppression
McFadden, Z., & Alvarez, L. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15423 · Cited by 11
Equalised Odds is not Equal Individual Odds: Post-processing for Group and Individual Fairness
Small, E. A., Sokol, K., Manning, D., Salim, F. D., & Chan, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658989 · Cited by 9
Enhancing (Publications on) Data Quality: Deeper Data Minding and Fuller Data Confession
Meng, X. (2021) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12762 · Cited by 9
Using Explainable Boosting Machines (EBMs) to Detect Common Flaws in Data
Chen, Z., Tan, S., Nori, H., Inkpen, K. M., Lou, Y., & Caruana, R. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-93736-2_40 · Cited by 9
Liu, J., & Li, D. M. (2024) · Asian Journal of Criminology · doi:10.1007/s11417-024-09429-x · Cited by 18
Ceva, E., & Jiménez, M. C. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09670-x · Cited by 12
Double Your Variance, Dirtify Your Bayes, Devour Your Pufferfish, and Draw your Kidstrogram
Meng, X. (2022) · The New England Journal of Statistics in Data Science · doi:10.51387/22-nejsds6 · Cited by 9
User Driven Model Adjustment via Boolean Rule Explanations
Daly, E., Mattetti, M., Alkan, Ö., & Nair, R. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16737 · Cited by 10
Landmarks in Case-Based Reasoning: From Theory to Data
van Woerkom, W., Grossi, D., Prakken, H., & Bart Verheij, A. (2022) · Frontiers in artificial intelligence and applications · doi:10.3233/faia220200 · Cited by 11
Khosrowi, D., & van Basshuysen, P. (2024) · American Philosophical Quarterly · doi:10.5406/21521123.61.4.02 · Cited by 10
AI Accountability in Judicial Proceedings: An Actor–Network Approach
Contini, F., Onţanu, E. A., & Velicogna, M. (2024) · Laws · doi:10.3390/laws13060071 · Cited by 7
COMPAS: zu einer wegweisenden Debatte über algorithmische Risikobeurteilung
Räz, T. (2022) · Forensische Psychiatrie Psychologie Kriminologie · doi:10.1007/s11757-022-00741-9 · Cited by 7
Algorithmic Risk Scoring and Welfare State Contact Among US Children
Eiermann, M. (2024) · Sociological Science · doi:10.15195/v11.a26 · Cited by 10
Broader Issues Surrounding Model Transparency in Criminal Justice Risk Scoring
Rudin, C. D., Wang, C., & Coker, B. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.038c43fe · Cited by 8
Self-citationSafe Policy Learning through Extrapolation: Application to Pre-trial Risk Assessment
Ben‐Michael, E., Greiner, D. J., Imai, K., & Jiang, Z. (2025) · Journal of the American Statistical Association · doi:10.1080/01621459.2025.2489135 · Cited by 7
Kang, B., & Wu, S. (2023) · Journal of Experimental Criminology · doi:10.1007/s11292-022-09512-2 · Cited by 6
Nested conformal prediction sets for classification with applications to probation data
Kuchibhotla, A. K., & Berk, R. A. (2023) · The Annals of Applied Statistics · doi:10.1214/22-aoas1650 · Cited by 9
Using edge cases to disentangle fairness and solidarity in AI ethics
Brusseau, J. (2021) · AI and Ethics · doi:10.1007/s43681-021-00090-z · Cited by 7
The Explanation Game: A Formal Framework for Interpretable Machine LearningPreprint
Watson, D., & Floridi, L. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3509737 · Cited by 7
A new approach toward social licensing of data analytics in the public sector
O’Loughlin, T., & Bukowitz, R. (2021) · Australian Journal of Social Issues · doi:10.1002/ajs4.161 · Cited by 6
Understanding risk with FOTRES?
Räz, T. (2022) · AI and Ethics · doi:10.1007/s43681-022-00223-y · Cited by 6
Ercanlı, İ. (2024) · Canadian Journal of Forest Research · doi:10.1139/cjfr-2024-0068 · Cited by 5
Yousefzadeh, R., & O’Leary, D. P. (2021) · La Matematica · doi:10.1007/s44007-021-00003-w · Cited by 9
The Role of Risk Assessment in the Criminal Justice System: Moving Beyond a Return to the Status Quo
Desmarais, S. L. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.181cd09f · Cited by 5
A Human-in-the-loop Framework to Construct Context-dependent Mathematical Formulations of FairnessPreprint
Yaghini, M., Heidari, H., & Krause, A. (2019) · arXiv (Cornell University) · Cited by 5
Porębski, A. (2023) · Research Handbook on Law and Technology · doi:10.4337/9781803921327.00037 · Cited by 4
Explainable AI for Daily Scenarios from End-Users’ Perspective: Non-Use, Concerns, and Ideal Design
Wang, L., Anyi, C. L., Xu, K., Liu, Y., Arriaga, R. I., & Goel, A. K. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735796 · Cited by 7
Mapping the Smart City: Participatory approaches to XAI
Gupta, S. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563703.3593063 · Cited by 4
Requirements and Attitudes towards Explainable AI in Law Enforcement
Herrewijnen, E., Loerakker, M. B., Vredenborg, M., & Woźniak, P. W. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661629 · Cited by 10
Fragile Algorithms and Fallible Decision-Makers: Lessons from the Justice System
Ludwig, J., & Mullainathan, S. (2021) · National Bureau of Economic Research · doi:10.3386/w29267 · Cited by 4
Mensch, K. G., & Ochasi, A. (2025) · Philosophy & Technology · doi:10.1007/s13347-025-00892-7 · Cited by 3
Reranking Individuals: The Effect of Fair Classification Within-Groups
Goethals, S., Favier, M., & Calders, T. (2026) · ACM Journal on Responsible Computing · doi:10.1145/3802540 · Cited by 12
Metadata
- Authors
- Rudin, C., Wang, C., & Coker, B.
- Affiliations
- Duke University (US)
- Department of Computer Science, Trinity College of Arts and Sciences, Duke University, Durham, North Carolina, United States of America; Department of Mathematics, Trinity College of Arts and Sciences, Duke University, Durham, North Carolina, United States of America
- Department of Biostatistics, T.H. Chan School of Public Health, Harvard University, Cambridge, Massachusetts, United States of America
- Venue
- Harvard Data Science Review
- Publisher
- MIT Press
- Published
- 2020-03-31
- Volume
- 2
- Issue
- 1
- ISSN
- 2644-2353 (ISSN-L)
- 2688-8513
- OpenAlex
- W2899360465
- Cited by
- 177
- References
- 22
- Citations by year
- 2026: 17 · 2025: 26 · 2024: 30 · 2023: 23 · 2022: 31 · 2021: 25 · 2020: 14
- FWCI
- 31.69
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Harvard Data Science Review (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Artificial Intelligence in Law
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Keywords
- COMPAS, algorithmic transparency, algorithmic fairness, criminal justice, ProPublica, model interpretability, procedural justice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review