Algorithmic Decision Making and the Cost of Fairness
Open accessThe DOI matches its Crossref record; 41 of the 43 references it cites were found in a registry or an index.
Abstract
Algorithms are now regularly used to decide whether defendants awaiting trial are too dangerous to be released back into the community. In some cases, black defendants are substantially more likely than white defendants to be incorrectly classified as high risk. To mitigate such disparities, several techniques have recently been proposed to achieve algorithmic fairness. Here we reformulate algorithmic fairness as constrained optimization: the objective is to maximize public safety while satisfying formal fairness constraints designed to reduce racial disparities. We show that for several past definitions of fairness, the optimal algorithms that result require detaining defendants above race-specific risk thresholds. We further show that the optimal unconstrained algorithm requires applying a single, uniform threshold to all defendants. The unconstrained algorithm thus maximizes public safety while also satisfying one important understanding of equality: that all individuals are held to the same standard, irrespective of race. Because the optimal constrained and unconstrained algorithms generally differ, there is tension between improving public safety and satisfying prevailing notions of algorithmic fairness. By examining data from Broward County, Florida, we show that this trade-off can be large in practice. We focus on algorithms for pretrial release decisions, but the principles we discuss apply to other domains, and also to human decision makers carrying out structured decision rules.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There is always a trade-off between accuracy, fairness and privacy that needs to be taken into account as Corbett-Davies et al. [31] examined in their study.”
In the citing paper
“applications of AI to the tax domain -which need to deal with large volumes of taxpayer data and, in applications such as tax fraud detection, achieve high levels of accuracy -tend to rely on machine learning models that are not transparent by design.”
From Towards eXplainable Artificial Intelligence (XAI) in Tax Law: The Need for a Minimum Legal Standard (2022) · cites this paper as [111]
In the citing paper
“However, it is important to recognize that bias is not the only factor that can lead to unfairness, and achieving fairness may require additional efforts beyond bias mitigation [27].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [27]
In the citing paper
“Corbett-Davies and collaborators introduced risk-minimization approaches aimed at minimizing disparities [27,28].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [27]
In the citing paper
“several studies have observed that satisfying multiple fairness conditions at the same time is infeasible [7,9,22,23].”
From A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual &Group Unfairness via Inequality Indices (2018) · cites this paper as [9]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,384
The Economics of Discrimination.
Collard, D., & Becker, G. S. (1972) · The Economic Journal · doi:10.2307/2230052 · Cited by 3,573
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
The difference: how the power of diversity creates better groups, firms, schools, and societies
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1534 · Cited by 2,280
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Platt, J. C. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0008 · Cited by 1,156
Research works printed but not linked: 7
- Lindsay C Ahlman and Ellen M Kurtz 2009. The APPD randomized controlled trial in low risk supervision: The effects on low risk supervision on rearrest. Philadelphia Adult Probation and Parole Department ( 2009 ). Lindsay C Ahlman and Ellen M Kurtz 2009. The APPD randomized controlled trial in low risk supervision: The effects on low risk supervision on rearrest. Philadelphia Adult Probation and Parole Department (2009).
- Julia Angwin , Jeff Larson , Surya Mattu , and Lauren Kirchner 2016. Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. ProPublica (5 2016 ). Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner 2016. Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. ProPublica (5 2016).
- Fisher v. University of Texas at Austin . 2016 . Vol. 136 S. Ct . 2198, 2208 (2016). Fisher v. University of Texas at Austin. 2016. Vol. 136 S. Ct. 2198, 2208 (2016).
- Eric Holder . 2014. ( 2014 ). Remarks at the National Association of Criminal Defense Lawyers 57th Annual Meeting . Eric Holder. 2014. (2014). Remarks at the National Association of Criminal Defense Lawyers 57th Annual Meeting.
- Shahin Jabbari , Matthew Joseph , Michael Kearns , Jamie Morgenstern , and Aaron Roth . 2016. Fair Learning in Markovian Environments. arXiv preprint arXiv:1611.03071 ( 2016 ). Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, and Aaron Roth. 2016. Fair Learning in Markovian Environments. arXiv preprint arXiv:1611.03071 (2016). · arXiv
- Jeff Larson , Surya Mattu , Lauren Kirchner , and Julia Angwin . 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (5 2016 ). Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (5 2016).
- Indré Žliobaité 2017. Measuring discrimination in algorithmic decision making Data Mining and Knowledge Discovery ( 2017 ). Indré Žliobaité 2017. Measuring discrimination in algorithmic decision making Data Mining and Knowledge Discovery (2017).
Cited by
Items 301–400 of 1,012
Towards a pragmatist dealing with algorithmic bias in medical machine learning
Starke, G., De Clercq, E., & Elger, B. S. (2021) · Medicine, Health Care and Philosophy · doi:10.1007/s11019-021-10008-5 · Cited by 54
Silva: Interactively Assessing Machine Learning Fairness Using Causality
Yan, J. N., Gu, Z., Lin, H., & Rzeszotarski, J. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376447 · Cited by 54
Learning under selective labels in the presence of expert consistencyPreprint
De‐Arteaga, M., Dubrawski, A. W., & Chouldechova, A. (2018) · arXiv (Cornell University) · doi:10.4230/lipics.forc.2020.3 · Cited by 49
Studying human-to-computer bias transference
Johansen, J., Pedersen, T., & Johansen, C. (2021) · AI & Society · doi:10.1007/s00146-021-01328-4 · Cited by 54
Trust Development and Repair in AI-Assisted Decision-Making during Complementary Expertise
Pareek, S., Velloso, E., & Gonçalves, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658924 · Cited by 54
Zimmermann, A., & Lee‐Stronach, C. (2021) · Canadian Journal of Philosophy · doi:10.1017/can.2021.17 · Cited by 54
Impact of Imputation Strategies on Fairness in Machine Learning
Caton, S. J., Malisetty, S., & Haas, C. S. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13197 · Cited by 54
Multiaccuracy: Black-Box Post-Processing for Fairness in ClassificationPreprint
Kim, M. P., Ghorbani, A., & Zou, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12317 · Cited by 54
Wasserstein Fair Classification
Jiang, R., Pacchiano, A., Stepleton, T., Jiang, H., & Chiappa, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.12059 · Cited by 53
Towards Formal Fairness in Machine Learning
Ignatiev, A., Cooper, M., Siala, M., Hébrard, E., & Marques-Silva, J. P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58475-7_49 · Cited by 53
Enter the metrics: critical theory and organizational operationalization of AI ethics
Krijger, J. (2021) · AI & Society · doi:10.1007/s00146-021-01256-3 · Cited by 53
Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML
Weerts, H., Pfisterer, F., Feurer, M., Eggensperger, K., Bergman, E., Awad, N. H., Vanschoren, J., Pechenizkiy, M., Bischl, B., & Hutter, F. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14747 · Cited by 53
Fairness in Design: A Framework for Facilitating Ethical Artificial Intelligence Designs
Zhang, J., Shu, Y., & Yu, H. (2023) · International Journal of Crowd Science · doi:10.26599/ijcs.2022.9100033 · Cited by 52
A Systematic Review of Using Machine Learning and Natural Language Processing in Smart Policing
Sarzaeim, P., Mahmoud, Q. H., Azim, A., Bauer, G., & Bowles, I. (2023) · Computers · doi:10.3390/computers12120255 · Cited by 51
Mitigating Bias in Algorithmic Employment Screening: Evaluating Claims and Practices
Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3408010 · Cited by 51
Rozado, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231189 · Cited by 51
Designing equitable algorithms
Chohlas-Wood, A., Coots, M., Goel, S., & Nyarko, J. (2023) · Nature Computational Science · doi:10.1038/s43588-023-00485-4 · Cited by 51
Self-citationLearning Bounds for Risk-sensitive LearningPreprint
Lee, J., Park, S., & Shin, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08138 · Cited by 51
Characterizing the risk of fairwashingPreprint
Aïvodji, U., Arai, H., Gambs, S., & Hara, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07504 · Cited by 53
Accuracy and Fairness for Juvenile Justice Risk Assessments
Berk, R. (2019) · Journal of Empirical Legal Studies · doi:10.1111/jels.12206 · Cited by 50
Glymour, B., & Herington, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287573 · Cited by 50
Simplicity Creates Inequity: Implications for Fairness, Stereotypes, and Interpretability
Kleinberg, J., & Mullainathan, S. (2019) · National Bureau of Economic Research · doi:10.3386/w25854 · Cited by 50
Software Fairness: An Analysis and Survey
Soremekun, E., Papadakis, M., Cordy, M., & Traon, Y. L. (2025) · ACM Computing Surveys · doi:10.1145/3762170 · Cited by 50
Sketching Linear Classifiers over Data Streams
Tai, K. S., Sharan, V., Bailis, P. D., & Valiant, G. J. (2018) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3183713.3196930 · Cited by 50
Classification with Fairness Constraints: A Meta-Algorithm with Provable GuaranteesPreprint
Celis, L. E., Huang, L., Keswani, V., & Vishnoi, N. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.06055 · Cited by 50
The effects of mixing machine learning and human judgment
Vaccaro, M., & Waldo, J. (2019) · Communications of the ACM · doi:10.1145/3359338 · Cited by 49
Twitter Universal Dependency Parsing for African-American and Mainstream American English
Blodgett, S. L., Wei, J., & O’Connor, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1131 · Cited by 49
Fairness-Aware Machine Learning: Practical Challenges and Lessons Learned
Bird, S., Kenthapadi, K., Kiciman, E., & Mitchell, M. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3291383 · Cited by 49
Implicit Diversity in Image Summarization
Celis, L. E., & Keswani, V. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415210 · Cited by 49
On Fair Selection in the Presence of Implicit Variance
Emelianov, V., Gast, N., Gummadi, K. P., & Loiseau, P. (2020) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3391403.3399482 · Cited by 49
Beyond Bias: “Ethical AI” in Criminal Law
Barabas, C. (2020) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190067397.013.47 · Cited by 49
Fairness On The Ground: Applying Algorithmic Fairness Approaches to Production SystemsPreprint
Bakalar, C., Barreto, R. D. C., Bergman, S., Bogen, M., Chern, B., Corbett‐Davies, S., Hall, M. A., Kloumann, I. M., Lam, M. S., Candela, J. Q., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06172 · Cited by 49
Self-citationSafety and Fairness for Content Moderation in Generative ModelsPreprint
Hao, S., Kumar, P., Laszlo, S., Poddar, S., Radharapu, B., & Shelby, R. M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.06135 · Cited by 49
Agarwal, A., Agarwal, H., & Agarwal, N. (2023) · AI and Ethics · doi:10.1007/s43681-022-00147-7 · Cited by 48
FARE: Diagnostics for Fair Ranking using Pairwise Error Metrics
Kuhlman, C., VanValkenburg, M., & Rundensteiner, E. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313443 · Cited by 48
Allocating Police Resources While Limiting Racial Inequality
Wheeler, A. P. (2019) · Justice Quarterly · doi:10.1080/07418825.2019.1630471 · Cited by 48
Survey on AI Ethics: A Socio‐Technical Perspective
Mbiazi, D., Bhange, M., Babaei, M., Sheth, I., Kenfack, P. J., & Kahou, S. E. (2025) · Computational Intelligence · doi:10.1111/coin.70149 · Cited by 48
Cybersecurity of Critical Infrastructure
Viganò, E., Loi, M., & Yaghmaei, E. (2020) · The International library of ethics, law and technology · doi:10.1007/978-3-030-29053-5_8 · Cited by 48
Normative Principles for Evaluating Fairness in Machine Learning
Leben, D. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375808 · Cited by 48
Bias and Non-Diversity of Big Data in Artificial Intelligence: Focus on Retinal Diseases
Jacoba, C. M. P., Celi, L. A., Lorch, A., Fickweiler, W., Sobrin, L., Gichoya, J. W., Aiello, L. P., & Silva, P. S. (2023) · Seminars in Ophthalmology · doi:10.1080/08820538.2023.2168486 · Cited by 49
All of the Fairness for Edge Prediction with Optimal TransportPreprint
Laclau, C., Redko, I., Choudhary, M., & Largeron, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.16326 · Cited by 48
Fairness metrics and bias mitigation strategies for rating predictions
Ashokan, A., & Haas, C. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102646 · Cited by 47
An Introduction to Vision-Language Modeling
Bordes, F., Pang, R. Y., Ajay, A., Li, A. C., Bardes, A., Petryk, S., Mañas, O., Lin, Z., Mahmoud, A., Jayaraman, B., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.17247 · Cited by 47
Online Experimentation: Benefits, Operational and Methodological Challenges, and Scaling Guide
Bojinov, I., & Gupta, S. (2022) · Harvard Data Science Review · doi:10.1162/99608f92.a579756e · Cited by 47
Fair Representation Learning: An Alternative to Mutual Information
Liu, J., Li, Z., Yao, Y., Feng, X., Ma, X., Xu, M., & Tong, H. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539302 · Cited by 47
To be forgotten or to be fair: unveiling fairness implications of machine unlearning methods
Zhang, D., Pan, S., Hoang, T., Xing, Z., Staples, M., Xu, X., Yao, L., Lu, Q., & Zhu, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00398-y · Cited by 47
Fair Prediction with Endogenous Behavior
Jung, C., Kannan, S., Lee, C., Pai, M. M., Roth, A., & Vohra, R. (2020) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3391403.3399473 · Cited by 47
Demographic Fairness in Biometric Systems: What Do the Experts Say?
Rathgeb, C., Drozdowski, P., Frings, D., Damer, N., & Busch, C. (2022) · IEEE Technology and Society Magazine · doi:10.1109/mts.2022.3217700 · Cited by 47
Learning to Be Fair: A Consequentialist Approach to Equitable Decision Making
Chohlas-Wood, A., Coots, M., Zhu, H., Brunskill, E., & Goel, S. (2024) · Management Science · doi:10.1287/mnsc.2022.00345 · Cited by 47
Self-citationOn the Moral Justification of Statistical Parity
Hertweck, C., Heitz, C., & Loi, M. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445936 · Cited by 46
Ensuring Fairness under Prior Probability Shifts
Biswas, A., & Mukherjee, S. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462596 · Cited by 46
Fairness and Risk: An Ethical Argument for a Group Fairness Definition Insurers Can Use
Baumann, J., & Loi, M. (2023) · Philosophy & Technology · doi:10.1007/s13347-023-00624-9 · Cited by 46
Disambiguating Algorithmic Bias: From Neutrality to Justice
Edenberg, E., & Wood, A. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604695 · Cited by 46
Talukder, K. A. (2025) · doi:10.63125/3v98q104 · Cited by 46
Fairness In Reciprocal Recommendations: A Speed-Dating Study
Zheng, Y., Dave, T., Mishra, N., & Kumar, H. (2018) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3213586.3226207 · Cited by 46
Trajectories of Blocked Community Members: Redemption, Recidivism and Departure
Chang, J. P., & Danescu-Niculescu-Mizil, C. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313638 · Cited by 46
Awareness in practice: tensions in access to sensitive attribute data for antidiscrimination
Bogen, M., Rieke, A., & Ahmed, S. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372877 · Cited by 45
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603207 · Cited by 45
Towards a Better Understanding of Evaluating Trustworthiness in AI Systems
Kemmerzell, N., Schreiner, A., Khalid, H., Schalk, M., & Bordoli, L. (2025) · ACM Computing Surveys · doi:10.1145/3721976 · Cited by 45
Search-based fairness testing for regression-based machine learning systems
Perera, A., Aleti, A., Tantithamthavorn, C. K., Jiarpakdee, J., Turhan, B., Kühn, L., & Walker, K. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10116-7 · Cited by 45
Selective Classification Can Magnify Disparities Across GroupsPreprint
Jones, E., Sagawa, S., Koh, P. W., Kumar, A., & Liang, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14134 · Cited by 45
Auditing the Use of Language Models to Guide Hiring DecisionsPreprint
Gaebler, J., Goel, S., Huq, A., & Tambe, P. B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.03086 · Cited by 45
Self-citationFairness Behind a Veil of Ignorance: A Welfare Analysis for Automated Decision Making
Heidari, H., Ferrari, C., Gummadi, K. P., & Krause, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04959 · Cited by 44
Calibration for the (Computationally-Identifiable) Masses
Hébert-Johnson, Ú., Kim, M. P., Reingold, O., & Rothblum, G. N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.08513 · Cited by 44
Yu, B., Yuan, Y., Terveen, L., Wu, Z. S., Forlizzi, J., & Zhu, H. (2020) · Proceedings of the 2020 ACM Designing Interactive Systems Conference · doi:10.1145/3357236.3395528 · Cited by 44
García-Soriano, D., & Bonchi, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00675-y · Cited by 44
Ruggieri, S., Álvarez, J. M., Pugnana, A., State, L., & Turini, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.26798 · Cited by 44
Individual Calibration with Randomized ForecastingPreprint
Zhao, S., Ma, T., & Ermon, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10288 · Cited by 44
Characterizing Intersectional Group Fairness with Worst-Case ComparisonsPreprint
Ghosh, A., Genuit, L., & Reagan, M. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.01673 · Cited by 44
A general approach to fairness with optimal transport
Silvia, C., Ray, J., Tom, S., Aldo, P., Heinrich, J., & John, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5771 · Cited by 43
Antidiscrimination Insurance Pricing: Regulations, Fairness Criteria, and Models
Xin, X., & Huang, F. (2024) · North American Actuarial Journal · doi:10.1080/10920277.2023.2190528 · Cited by 43
Kirat, T., Tambou, O., Do, V., & Tsoukiàs, A. (2023) · EURO Journal on Decision Processes · doi:10.1016/j.ejdp.2023.100036 · Cited by 43
Fairness-aware Federated Matrix Factorization
Liu, S., Ge, Y., Xu, S., Zhang, Y., & Marian, A. (2022) · Proceedings of the 16th ACM Conference on Recommender Systems · doi:10.1145/3523227.3546771 · Cited by 43
Learning Optimal Fair Policies
Nabi, R., Malinsky, D., & Shpitser, I. (2018) · PubMed · doi:10.48550/arxiv.1809.02244 · Cited by 43
Wang, C., Yin, Y., & Hu, H. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103264 · Cited by 44
The Accuracy of the Violent Offender Identification Directive Tool to Predict Future Gun Violence
Wheeler, A. P., Worden, R. E., & Silver, J. R. (2019) · Criminal Justice and Behavior · doi:10.1177/0093854818824378 · Cited by 43
Algorithmic Equity: A Framework for Social Applications
Osoba, O., Boudreaux, B., Saunders, J. M., Irwin, J., Mueller, P. A., & Cherney, S. (2019) · RAND Corporation eBooks · doi:10.7249/rr2708 · Cited by 43
Fast and fair simultaneous confidence bands for functional parameters
Liebl, D., & Reimherr, M. L. (2023) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1093/jrsssb/qkad026 · Cited by 43
Inherent Trade-Offs in Algorithmic Fairness
Kleinberg, J. M. (2018) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/3292040.3219634 · Cited by 43
Pfohl, S. R., Zhang, H., Xu, Y., Foryciarz, A., Ghassemi, M., & Shah, N. H. (2022) · Scientific Reports · doi:10.1038/s41598-022-07167-7 · Cited by 43
Adaptive Sampling Strategies to Construct Equitable Training Datasets
Cai, W., Encarnación, R., Chern, B., Corbett‐Davies, S., Bogen, M., Bergman, S., & Goel, S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533203 · Cited by 43
Self-citationExplaining Toxic Text via Knowledge Enhanced Text Generation
Sridhar, R., & Yang, D. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.59 · Cited by 43
Beigang, F. (2022) · Minds and Machines · doi:10.1007/s11023-022-09615-9 · Cited by 43
Bias on Demand: A Modelling Framework That Generates Synthetic Data With Bias
Baumann, J., Castelnovo, A., Crupi, R., Inverardi, N., & Regoli, D. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594058 · Cited by 43
Fairness in face presentation attack detection
Fang, M., Yang, W., Kuijper, A., Štruc, V., & Damer, N. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110002 · Cited by 43
Research Questions and a Proposal for the Future Governance of Translation Data
Moorkens, J., & Lewis, D. (2019) · The Journal of Specialised Translation · doi:10.26034/cm.jostrans.2019.154 · Cited by 43
A Missing Piece in the Puzzle: Considering the Role of Task Complexity in Human-AI Decision Making
Salimzadeh, S., He, G., & Gadiraju, U. (2023) · Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3565472.3592959 · Cited by 42
Learning fair representations via an adversarial framework
Qiu, H., Feng, R., Hu, R., Yang, X., Lin, S., Tao, Q., & Yang, Y. (2023) · AI Open · doi:10.1016/j.aiopen.2023.08.003 · Cited by 42
Correlated Proxies: A New Definition and Improved Mitigation for Reward Hacking
Laidlaw, C., Singhal, S., & Dragan, A. D. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2403.03185 · Cited by 44
Towards fairness-aware multi-objective optimization
Yu, G., Ma, L., Wang, X., Du, W., Du, W., & Jin, Y. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01668-w · Cited by 42
Fair Allocation through Selective Information Acquisition
Cai, W., Gaebler, J., Garg, N., & Goel, S. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375823 · Cited by 42
Self-citationAlgorithmic Decision Making with Conditional Fairness
Xu, R., Cui, P., Kuang, K., Li, B., Zhou, L., Shen, Z., & Cui, W. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403263 · Cited by 42
Enforcing Group Fairness in Algorithmic Decision Making: Utility Maximization Under Sufficiency
Baumann, J., Hannák, A., & Heitz, C. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3534645 · Cited by 42
Fairness in the Eyes of the Data: Certifying Machine-Learning Models
Segal, S., Adi, Y., Pinkas, B., Baum, C., Ganesh, C., & Keshet, J. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462554 · Cited by 41
Enhancing the Accuracy and Fairness of Human Decision MakingPreprint
Valera, I., Singla, A. K., & Gomez-Rodriguez, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10318 · Cited by 41
Navigating fairness measures and trade-offs
Buijsman, S. (2023) · AI and Ethics · doi:10.1007/s43681-023-00318-0 · Cited by 40
Fairness Transferability Subject to Bounded Distribution Shift
Chen, Y., Raab, R., Wang, J., & Liu, Y. (2022) · neural information processing systems · doi:10.52202/068431-0819 · Cited by 40
Multi-objective Asynchronous Successive HalvingPreprint
Schmucker, R., Donini, M., Zafar, M. B., Salinas, D., & Archambeau, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12639 · Cited by 40
Fogliato, R., Xiang, A., Lipton, Z., Nagin, D., & Chouldechova, A. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462538 · Cited by 39
Jaquet-Chiffelle, D.-O., & Loi, M. (2020) · The International library of ethics, law and technology · doi:10.1007/978-3-030-29053-5_9 · Cited by 40
Metadata
- Authors
- Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A.
- Affiliations
- Stanford University, Stanford, CA, USA
- Stanford University (US)
- University of California, Berkeley (US)
- University of Chicago (US)
- Venue
- Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2017-08-04
- Pages
- 797-806
- OpenAlex
- W2584805976
- Cited by
- 1,149
- References
- 43
- Citations by year
- 2026: 62 · 2025: 113 · 2024: 141 · 2023: 173 · 2022: 146 · 2021: 162 · 2020: 150 · 2019: 119 · 2018: 67 · 2017: 13
- FWCI
- 238.91
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- John S. and James L. Knight Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Artificial Intelligence in Law
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Keywords
- algorithmic fairness, risk assessment algorithm, racial disparities, public safety, constrained optimization, risk thresholds, equal treatment, Broward County
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.