Algorithmic Decision Making and the Cost of Fairness
Open accessThe DOI matches its Crossref record; 41 of the 43 references it cites were found in a registry or an index.
Abstract
Algorithms are now regularly used to decide whether defendants awaiting trial are too dangerous to be released back into the community. In some cases, black defendants are substantially more likely than white defendants to be incorrectly classified as high risk. To mitigate such disparities, several techniques have recently been proposed to achieve algorithmic fairness. Here we reformulate algorithmic fairness as constrained optimization: the objective is to maximize public safety while satisfying formal fairness constraints designed to reduce racial disparities. We show that for several past definitions of fairness, the optimal algorithms that result require detaining defendants above race-specific risk thresholds. We further show that the optimal unconstrained algorithm requires applying a single, uniform threshold to all defendants. The unconstrained algorithm thus maximizes public safety while also satisfying one important understanding of equality: that all individuals are held to the same standard, irrespective of race. Because the optimal constrained and unconstrained algorithms generally differ, there is tension between improving public safety and satisfying prevailing notions of algorithmic fairness. By examining data from Broward County, Florida, we show that this trade-off can be large in practice. We focus on algorithms for pretrial release decisions, but the principles we discuss apply to other domains, and also to human decision makers carrying out structured decision rules.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There is always a trade-off between accuracy, fairness and privacy that needs to be taken into account as Corbett-Davies et al. [31] examined in their study.”
In the citing paper
“applications of AI to the tax domain -which need to deal with large volumes of taxpayer data and, in applications such as tax fraud detection, achieve high levels of accuracy -tend to rely on machine learning models that are not transparent by design.”
From Towards eXplainable Artificial Intelligence (XAI) in Tax Law: The Need for a Minimum Legal Standard (2022) · cites this paper as [111]
In the citing paper
“However, it is important to recognize that bias is not the only factor that can lead to unfairness, and achieving fairness may require additional efforts beyond bias mitigation [27].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [27]
In the citing paper
“Corbett-Davies and collaborators introduced risk-minimization approaches aimed at minimizing disparities [27,28].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [27]
In the citing paper
“several studies have observed that satisfying multiple fairness conditions at the same time is infeasible [7,9,22,23].”
From A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual &Group Unfairness via Inequality Indices (2018) · cites this paper as [9]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,384
The Economics of Discrimination.
Collard, D., & Becker, G. S. (1972) · The Economic Journal · doi:10.2307/2230052 · Cited by 3,573
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
The difference: how the power of diversity creates better groups, firms, schools, and societies
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1534 · Cited by 2,280
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Platt, J. C. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0008 · Cited by 1,156
Research works printed but not linked: 7
- Lindsay C Ahlman and Ellen M Kurtz 2009. The APPD randomized controlled trial in low risk supervision: The effects on low risk supervision on rearrest. Philadelphia Adult Probation and Parole Department ( 2009 ). Lindsay C Ahlman and Ellen M Kurtz 2009. The APPD randomized controlled trial in low risk supervision: The effects on low risk supervision on rearrest. Philadelphia Adult Probation and Parole Department (2009).
- Julia Angwin , Jeff Larson , Surya Mattu , and Lauren Kirchner 2016. Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. ProPublica (5 2016 ). Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner 2016. Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. ProPublica (5 2016).
- Fisher v. University of Texas at Austin . 2016 . Vol. 136 S. Ct . 2198, 2208 (2016). Fisher v. University of Texas at Austin. 2016. Vol. 136 S. Ct. 2198, 2208 (2016).
- Eric Holder . 2014. ( 2014 ). Remarks at the National Association of Criminal Defense Lawyers 57th Annual Meeting . Eric Holder. 2014. (2014). Remarks at the National Association of Criminal Defense Lawyers 57th Annual Meeting.
- Shahin Jabbari , Matthew Joseph , Michael Kearns , Jamie Morgenstern , and Aaron Roth . 2016. Fair Learning in Markovian Environments. arXiv preprint arXiv:1611.03071 ( 2016 ). Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, and Aaron Roth. 2016. Fair Learning in Markovian Environments. arXiv preprint arXiv:1611.03071 (2016). · arXiv
- Jeff Larson , Surya Mattu , Lauren Kirchner , and Julia Angwin . 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (5 2016 ). Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (5 2016).
- Indré Žliobaité 2017. Measuring discrimination in algorithmic decision making Data Mining and Knowledge Discovery ( 2017 ). Indré Žliobaité 2017. Measuring discrimination in algorithmic decision making Data Mining and Knowledge Discovery (2017).
Cited by
Items 101–200 of 1,012
The Challenge of Big Data and Data Science
Brady, H. E. (2019) · Annual Review of Political Science · doi:10.1146/annurev-polisci-090216-023229 · Cited by 139
Operationalizing individual fairness with pairwise fair representations
Lahoti, P., Gummadi, K. P., & Weikum, G. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3372716.3372723 · Cited by 139
Human Autonomy at Risk? An Analysis of the Challenges from AI
Prunkl, C. (2024) · Minds and Machines · doi:10.1007/s11023-024-09665-1 · Cited by 138
A Survey of Trustworthy Federated Learning: Issues, Solutions, and Challenges
Zhang, Y., Zeng, D., Luo, J., Fu, X., Chen, G., Xu, Z., & King, I. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3678181 · Cited by 139
Learning Optimal and Fair Decision Trees for Non-Discriminative Decision-Making
Aghaei, S., Azizi, M. J., & Vayanos, P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011418 · Cited by 135
On statistical criteria of algorithmic fairness
Hedden, B. (2021) · Philosophy & Public Affairs · doi:10.1111/papa.12189 · Cited by 135
The Causal Fairness Field Guide: Perspectives From Social and Formal Sciences
Carey, A. N., & Wu, X. (2022) · AI and Ethics · doi:10.3389/fdata.2022.892837 · Cited by 135
Understanding artificial intelligence ethics and safety
Leslie, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05684 · Cited by 134
Representation Bias in Data: A Survey on Identification and Resolution Techniques
Shahbazi, N., Lin, Y., Asudeh, A., & Jagadish, H. V. (2023) · ACM Computing Surveys · doi:10.1145/3588433 · Cited by 132
Algorithms as co‐workers: Human algorithm role interactions in algorithmic work
Tarafdar, M., Page, X., & Marabelli, M. (2023) · Information Systems Journal · doi:10.1111/isj.12389 · Cited by 132
Fairness issues, current approaches, and challenges in machine learning models
Jui, T. D., & Rivas, P. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-02083-2 · Cited by 132
Capturing Clicks: How the Chinese Government Uses Clickbait to Compete for Visibility
Lu, Y., & Pan, J. (2021) · Political Communication · doi:10.1080/10584609.2020.1765914 · Cited by 130
Fairway: a way to build fair ML software
Chakraborty, J., Majumder, S., Yu, Z., & Menzies, T. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3409697 · Cited by 130
Criminal courts’ artificial intelligence: the way it reinforces bias and discrimination
Malek, A. (2022) · AI and Ethics · doi:10.1007/s43681-022-00137-9 · Cited by 130
Fairness in Machine Learning: A Survey
Caton, S., & Haas, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04053 · Cited by 646
Adaptive Sensitive Reweighting to Mitigate Bias in Fairness-aware Classification
Krasanakis, E., Spyromitros-Xioufis, E., Papadopoulos, S., & Kompatsiaris, Y. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186133 · Cited by 127
FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age
Kärkkäinen, K., & Joo, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.04913 · Cited by 126
Inherent Trade-Offs in Algorithmic Fairness
Kleinberg, J. (2018) · Abstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer Systems · doi:10.1145/3219617.3219634 · Cited by 125
Distill-and-Compare: Auditing Black-Box Models Using Transparent Model Distillation
Tan, S., Caruana, R., Hooker, G., & Lou, Y. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278725 · Cited by 125
Fair Coresets and Streaming Algorithms for Fair k-means
Schmidt, M., Schwiegelshohn, C., & Sohler, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-39479-0_16 · Cited by 125
On the Applicability of Machine Learning Fairness Notions
Makhlouf, K., Zhioua, S., & Palamidessi, C. (2021) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3468507.3468511 · Cited by 123
Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluation
de Jesus, S. H. C., Pombal, J., Alves, D., Cruz, A., Saleiro, P., Ribeiro, R. P., Gama, J., & Bizarro, P. (2022) · neural information processing systems · doi:10.52202/068431-2432 · Cited by 122
Fairea: a model behaviour mutation approach to benchmarking bias mitigation methods
Hort, M., Zhang, J. M., Sarro, F., & Harman, M. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3468565 · Cited by 120
Strong Optimal Classification Trees
Aghaei, S., Gómez, A., & Vayanos, P. (2024) · Operations Research · doi:10.1287/opre.2021.0034 · Cited by 118
A brief review on algorithmic fairness
Wang, X., Zhang, Y., & Zhu, R. (2022) · Management System Engineering · doi:10.1007/s44176-022-00006-z · Cited by 118
How Different Groups Prioritize Ethical Values for Responsible AI
Jakesch, M., Buçinca, Z., Amershi, S., & Olteanu, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533097 · Cited by 116
Fairness Feedback Loops: Training on Synthetic Data Amplifies Bias
Wyllie, S., Shumailov, I., & Papernot, N. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659029 · Cited by 116
A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challenges
Gohar, U., & Cheng, L. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/742 · Cited by 116
Human Decision Making with Machine Assistance: An Experiment on Bailing and Jailing
Grgić-Hlača, N., Engel, C., & Gummadi, K. P. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359280 · Cited by 113
Achieving Fairness through Adversarial Learning: an Application to Recidivism Prediction
Wadsworth, C., Vera, F., & Piech, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00199 · Cited by 113
A scoping review and evidence gap analysis of clinical AI fairness
Liu, M., Ning, Y., Teixayavong, S., Liu, X., Mertens, M., Shang, Y., Li, X., Miao, D., Liao, J., Xu, J., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01667-2 · Cited by 113
A Comprehensive Survey on Trustworthy Recommender SystemsPreprint
Fan, W., Zhao, X., Chen, X., Su, J., Gao, J., Wang, L., Liu, Q., Wang, Y., Han, X., Chen, L., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.10117 · Cited by 113
The limits of human predictions of recidivism
Lin, Z. “., Jung, J., Goel, S., & Skeem, J. (2020) · Science Advances · doi:10.1126/sciadv.aaz0652 · Cited by 112
Self-citationThis Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
Mulligan, D. K., Kroll, J. A., Kohli, N., & Wong, R. Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359221 · Cited by 111
Putting Fairness Principles into Practice: Challenges, Metrics, and Improvements
Beutel, A., Chen, J., Doshi, T., Qian, H., Woodruff, A., Luu, C., Kreitmann, P., Bischof, J., & Chi, E. H. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314234 · Cited by 111
Machine learning fairness notions: Bridging the gap with real-world applications
Makhlouf, K., Zhioua, S., & Palamidessi, C. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102642 · Cited by 111
Racial categories in machine learning
Benthall, S., & Haynes, B. D. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287575 · Cited by 110
Koshiyama, A., Kazim, E., Treleaven, P., Rai, P., Szpruch, L., Pavey, G., Ahamat, G., Leutner, F., Goebel, R., Knight, A., et al. (2024) · Royal Society Open Science · doi:10.1098/rsos.230859 · Cited by 110
Pérez-Suay, A., Laparra, V., Mateo‐García, G., Muñoz-Marí, J., Gómez‐Chova, L., & Camps‐Valls, G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71249-9_21 · Cited by 110
A Framework for Fairness: A Systematic Review of Existing Fair AI Solutions
Richardson, B., & Gilbert, J. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.05700 · Cited by 112
Chen, Z., Zhang, J. M., Sarro, F., & Harman, M. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3549093 · Cited by 109
Learning with Complex Loss Functions and Constraints.
Narasimhan, H. (2018) · International Conference on Artificial Intelligence and Statistics · Cited by 107
A Survey of Bias in Machine Learning Through the Prism of Statistical Parity
Besse, P. C., del Barrio, E., Gordaliza, P., Loubes, J., & Risser, L. (2021) · The American Statistician · doi:10.1080/00031305.2021.1952897 · Cited by 105
Rastegarpanah, B., Gummadi, K. P., & Crovella, M. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3291002 · Cited by 104
Fairway: A Way to Build Fair ML Software
Chakraborty, J., Majumder, S., Yu, Z., & Menzies, T. (2020) · Figshare · doi:10.6084/m9.figshare.12363347 · Cited by 103
The implicit fairness criterion of unconstrained learningPreprint
Liu, L. T., Simchowitz, M., & Hardt, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.10013 · Cited by 103
Fair Influence Maximization: a Welfare Optimization Approach
Rahmattalabi, A., Jabbari, S., Lakkaraju, H., Vayanos, P., Izenberg, M., Brown, R. A., Rice, E. R. W., & Tambe, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17383 · Cited by 102
In Pursuit of Interpretable, Fair and Accurate Machine Learning for Criminal Recidivism Prediction
Wang, C., Han, B., Patel, B., & Rudin, C. (2023) · Journal of Quantitative Criminology · doi:10.1007/s10940-022-09545-w · Cited by 101
From Parity to Preference-based Notions of Fairness in Classification
Zafar, M. B., Valera, I., Gomez-Rodriguez, M., Gummadi, K. P., & Weller, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00010 · Cited by 101
Emergent Unfairness in Algorithmic Fairness-Accuracy Trade-Off Research
Cooper, A. F., Abrams, E., & NA, N. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462519 · Cited by 101
The Unfairness of Fair Machine Learning: Leveling Down and Strict Egalitarianism by Default
Mittelstadt, B., Wachter, S., & Russell, C. (2024) · Michigan Technology Law Review · doi:10.36645/mtlr.30.1.unfairness · Cited by 101
Repairing without Retraining: Avoiding Disparate Impact with Counterfactual DistributionsPreprint
Wang, H., Ustun, B., & Calmon, F. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10501 · Cited by 101
In-Processing Modeling Techniques for Machine Learning Fairness: A Survey
Wan, M., Zha, D., Liu, N., & Zou, N. (2023) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3551390 · Cited by 99
Mahmud, B. U., Hong, G. Y., & Fong, B. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3542698 · Cited by 99
Balayn, A., Lofi, C., & Houben, G.-J. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00671-8 · Cited by 98
Building more accurate decision trees with the additive tree
Luna, J. M., Gennatas, E. D., Ungar, L. H., Eaton, E., Diffenderfer, E. S., Jensen, S. T., Simone, C. B., Friedman, J. H., Solberg, T. D., & Valdes, G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1816748116 · Cited by 98
Fairness Through Computationally-Bounded Awareness
Kim, M. P., Reingold, O., & Rothblum, G. N. (2018) · arXiv · doi:10.48550/arxiv.1803.03239 · Cited by 97
Fast Model DeBias with Machine Unlearning
Chen, R., Yang, J., Xiong, H., Bai, J., Hu, T., Hao, J., Feng, Y., Zhou, J. T., Wu, J., & Liu, Z. (2023) · neural information processing systems · doi:10.52202/075280-0639 · Cited by 100
Bai, B., Dai, H., Zhang, D. J., Zhang, F., & Hu, H. (2022) · Manufacturing & Service Operations Management · doi:10.1287/msom.2022.1120 · Cited by 96
Algorithmic Fairness in AI: An Interdisciplinary View
Pfeiffer, J., Gutschow, J., Haas, C. S., Möslein, F., Maspfuhl, O., Borgers, F., & Alpsancar, S. (2023) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00787-x · Cited by 97
Fair Algorithms for Infinite and Contextual BanditsPreprint
Joseph, M., Kearns, M. J., Morgenstern, J., Neel, S., & Roth, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09559 · Cited by 96
Does Object Recognition Work for Everyone?
DeVries, T., Misra, I., Wang, C., & van der Maaten, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02659 · Cited by 95
A Causal Bayesian Networks Viewpoint on Fairness
Chiappa, S., & Isaac, W. S. (2019) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-16744-8_1 · Cited by 95
OECD (2023) · OECD digital economy papers · doi:10.1787/2448f04b-en · Cited by 97
Lessons for artificial intelligence from the study of natural stupidity
Rich, A. S., & Gureckis, T. M. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0038-z · Cited by 94
Towards Knowledge-Grounded Counter Narrative Generation for Hate Speech
Chung, Y.-L., Tekiroğlu, S. S., & Guerini, M. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.79 · Cited by 94
Fairness Metrics: A Comparative Analysis
Garg, P., Villasenor, J., & Foggo, V. (2020) · 2020 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata50022.2020.9378025 · Cited by 90
Escaping the Impossibility of Fairness: From Formal to Substantive Algorithmic Fairness
Green, B. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00584-6 · Cited by 90
Diagnosing Gender Bias in Image Recognition Systems
Schwemmer, C., Knight, C., Bello-Pardo, E. D., Oklobdzija, S., Schoonvelde, M., & Lockhart, J. W. (2020) · Socius: Sociological Research for a Dynamic World · doi:10.1177/2378023120967171 · Cited by 90
AI ethics in action: a circular model for transparency, accountability and inclusivity
Tabaghdehi, S. A. H., & Arda, Ö. A. (2025) · Journal of Managerial Psychology · doi:10.1108/jmp-03-2024-0177 · Cited by 91
Counterfactual risk assessments, evaluation, and fairness
Coston, A., Mishler, A., Kennedy, E. H., & Chouldechova, A. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372851 · Cited by 89
Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification
Cooper, A. F., Lee, K., Choksi, M. Z., Barocas, S., De, C., Grimmelmann, J., Kleinberg, J. M., Sen, S., & Zhang, B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i20.30203 · Cited by 89
An Economic Approach to Regulating Algorithms
Rambachan, A., Kleinberg, J. M., Mullainathan, S., & Ludwig, J. (2020) · National Bureau of Economic Research · doi:10.3386/w27111 · Cited by 89
Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech
Zhu, W., & Bhat, S. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.12 · Cited by 88
Algorithmic fairness in business analytics: Directions for research and practice
De‐Arteaga, M., Feuerriegel, S., & Saar‐Tsechansky, M. (2022) · Production and Operations Management · doi:10.1111/poms.13839 · Cited by 87
Simple Rules for Complex Decisions
Jung, J., Concannon, C., & Shroff, R. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2919024 · Cited by 87
Self-citationBest of Both Worlds: Ex Ante and Ex Post Fairness in Resource Allocation
Aziz, H., Freeman, R., Shah, N., & Vaish, R. (2023) · Operations Research · doi:10.1287/opre.2022.2432 · Cited by 87
Heidari, H., Nanda, V., & Gummadi, K. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.01209 · Cited by 87
Fair Top-k Ranking with multiple protected groups
Zehlike, M., Sühr, T., Baeza-Yates, R. A., Bonchi, F., Castillo, C., & Hajian, S. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102707 · Cited by 86
Fairness Improvement with Multiple Protected Attributes: How Far Are We?
Chen, Z., Zhang, J. M., Sarro, F., & Harman, M. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639083 · Cited by 87
You Complete Me: Human-AI Teams and Complementary Expertise
Zhang, Q., Lee, M. L., & Carter, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517791 · Cited by 85
How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions
Cheng, H.-F., Stapleton, L., Kawakami, A., Sivaraman, V., Cheng, Y., Qing, D., Perer, A., Holstein, K., Wu, Z. S., & Zhu, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501831 · Cited by 85
Pessach, D., & Shmueli, E. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115667 · Cited by 84
Residual unfairness in fair machine learning from prejudiced data
Kallus, N., & Zhou, A. (2018) · arXiv · doi:10.48550/arxiv.1806.02887 · Cited by 83
Imai, K., Jiang, Z., Greiner, D. J., Halen, R., & Shin, S. (2023) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1093/jrsssa/qnad010 · Cited by 83
ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia
Halfaker, A., & Geiger, R. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415219 · Cited by 82
A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. (2021) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3465416.3483305 · Cited by 82
A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. V. (2019) · arXiv · doi:10.48550/arxiv.1901.10002 · Cited by 82
Kuo, T.-S., Shen, H., Geum, J., Jones, N., Hong, J. I., Zhu, H., & Holstein, K. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580882 · Cited by 82
Anahideh, H., Asudeh, A., & Thirumuruganathan, S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116981 · Cited by 82
Predictive policing and algorithmic fairness
Hung, T.-W., & Yen, C.-P. (2023) · Synthese · doi:10.1007/s11229-023-04189-0 · Cited by 82
How Do Fair Decisions Fare in Long-term Qualification?Preprint
Zhang, X., Tu, R., Liu, Y., Liu, M., Kjellström, H., Zhang, K., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11300 · Cited by 82
To Live in Their Utopia: Why Algorithmic Systems Create Absurd Outcomes
Alkhatib, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445740 · Cited by 81
Kassir, S., Baker, L. J., Dolphin, J., & Polli, F. E. (2022) · AI and Ethics · doi:10.1007/s43681-022-00208-x · Cited by 81
Fair and Unbiased Algorithmic Decision Making: Current State and Future ChallengesPreprint
Tolan, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.04730 · Cited by 81
The false promise of risk assessments: epistemic reform and the limits of fairness
Green, B. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372869 · Cited by 80
Fairness Perceptions of Artificial Intelligence: A Review and Path Forward
Narayanan, D., Nagpal, M., McGuire, J., Schweitzer, S., & De Cremer, D. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2210890 · Cited by 80
Exploring the impacts of artificial intelligence on freedom of religion or belief online
Ashraf, C. (2021) · The International Journal of Human Rights · doi:10.1080/13642987.2021.1968376 · Cited by 82
Nakao, Y., Strappelli, L., Stumpf, S., Naseer, A., Regoli, D., & Gamba, G. D. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2067936 · Cited by 80
Bridging the gap: Towards an expanded toolkit for AI-driven decision-making in the public sector
Fischer-Abaigar, U., Kern, C. A., Barda, N., & Kreuter, F. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101976 · Cited by 81
Metadata
- Authors
- Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A.
- Affiliations
- Stanford University, Stanford, CA, USA
- Stanford University (US)
- University of California, Berkeley (US)
- University of Chicago (US)
- Venue
- Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2017-08-04
- Pages
- 797-806
- OpenAlex
- W2584805976
- Cited by
- 1,149
- References
- 43
- Citations by year
- 2026: 62 · 2025: 113 · 2024: 141 · 2023: 173 · 2022: 146 · 2021: 162 · 2020: 150 · 2019: 119 · 2018: 67 · 2017: 13
- FWCI
- 238.91
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- John S. and James L. Knight Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Artificial Intelligence in Law
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Keywords
- algorithmic fairness, risk assessment algorithm, racial disparities, public safety, constrained optimization, risk thresholds, equal treatment, Broward County
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.