Algorithmic Decision Making and the Cost of Fairness
Open accessThe DOI matches its Crossref record; 41 of the 43 references it cites were found in a registry or an index.
Abstract
Algorithms are now regularly used to decide whether defendants awaiting trial are too dangerous to be released back into the community. In some cases, black defendants are substantially more likely than white defendants to be incorrectly classified as high risk. To mitigate such disparities, several techniques have recently been proposed to achieve algorithmic fairness. Here we reformulate algorithmic fairness as constrained optimization: the objective is to maximize public safety while satisfying formal fairness constraints designed to reduce racial disparities. We show that for several past definitions of fairness, the optimal algorithms that result require detaining defendants above race-specific risk thresholds. We further show that the optimal unconstrained algorithm requires applying a single, uniform threshold to all defendants. The unconstrained algorithm thus maximizes public safety while also satisfying one important understanding of equality: that all individuals are held to the same standard, irrespective of race. Because the optimal constrained and unconstrained algorithms generally differ, there is tension between improving public safety and satisfying prevailing notions of algorithmic fairness. By examining data from Broward County, Florida, we show that this trade-off can be large in practice. We focus on algorithms for pretrial release decisions, but the principles we discuss apply to other domains, and also to human decision makers carrying out structured decision rules.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There is always a trade-off between accuracy, fairness and privacy that needs to be taken into account as Corbett-Davies et al. [31] examined in their study.”
In the citing paper
“applications of AI to the tax domain -which need to deal with large volumes of taxpayer data and, in applications such as tax fraud detection, achieve high levels of accuracy -tend to rely on machine learning models that are not transparent by design.”
From Towards eXplainable Artificial Intelligence (XAI) in Tax Law: The Need for a Minimum Legal Standard (2022) · cites this paper as [111]
In the citing paper
“However, it is important to recognize that bias is not the only factor that can lead to unfairness, and achieving fairness may require additional efforts beyond bias mitigation [27].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [27]
In the citing paper
“Corbett-Davies and collaborators introduced risk-minimization approaches aimed at minimizing disparities [27,28].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [27]
In the citing paper
“several studies have observed that satisfying multiple fairness conditions at the same time is infeasible [7,9,22,23].”
From A Unified Approach to Quantifying Algorithmic Unfairness: Measuring Individual &Group Unfairness via Inequality Indices (2018) · cites this paper as [9]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,384
The Economics of Discrimination.
Collard, D., & Becker, G. S. (1972) · The Economic Journal · doi:10.2307/2230052 · Cited by 3,573
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
The difference: how the power of diversity creates better groups, firms, schools, and societies
(2007) · Choice Reviews Online · doi:10.5860/choice.45-1534 · Cited by 2,280
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Platt, J. C. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0008 · Cited by 1,156
Research works printed but not linked: 7
- Lindsay C Ahlman and Ellen M Kurtz 2009. The APPD randomized controlled trial in low risk supervision: The effects on low risk supervision on rearrest. Philadelphia Adult Probation and Parole Department ( 2009 ). Lindsay C Ahlman and Ellen M Kurtz 2009. The APPD randomized controlled trial in low risk supervision: The effects on low risk supervision on rearrest. Philadelphia Adult Probation and Parole Department (2009).
- Julia Angwin , Jeff Larson , Surya Mattu , and Lauren Kirchner 2016. Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. ProPublica (5 2016 ). Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner 2016. Machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. ProPublica (5 2016).
- Fisher v. University of Texas at Austin . 2016 . Vol. 136 S. Ct . 2198, 2208 (2016). Fisher v. University of Texas at Austin. 2016. Vol. 136 S. Ct. 2198, 2208 (2016).
- Eric Holder . 2014. ( 2014 ). Remarks at the National Association of Criminal Defense Lawyers 57th Annual Meeting . Eric Holder. 2014. (2014). Remarks at the National Association of Criminal Defense Lawyers 57th Annual Meeting.
- Shahin Jabbari , Matthew Joseph , Michael Kearns , Jamie Morgenstern , and Aaron Roth . 2016. Fair Learning in Markovian Environments. arXiv preprint arXiv:1611.03071 ( 2016 ). Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, and Aaron Roth. 2016. Fair Learning in Markovian Environments. arXiv preprint arXiv:1611.03071 (2016). · arXiv
- Jeff Larson , Surya Mattu , Lauren Kirchner , and Julia Angwin . 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (5 2016 ). Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (5 2016).
- Indré Žliobaité 2017. Measuring discrimination in algorithmic decision making Data Mining and Knowledge Discovery ( 2017 ). Indré Žliobaité 2017. Measuring discrimination in algorithmic decision making Data Mining and Knowledge Discovery (2017).
Cited by
Items 501–600 of 1,012
Laato, S., Vilppu, H., Heimonen, J., Hakkala, A., Björne, J., Farooq, A., Salakoski, T., & Airola, A. (2020) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie44824.2020.9273940 · Cited by 29
Accounting for Model Uncertainty in Algorithmic Discrimination
Ali, J., Lahoti, P., & Gummadi, K. P. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462630 · Cited by 29
Ethical implications of fairness interventions: what might be hidden behind engineering choices?
Tubella, A. A., Barsotti, F., Koçer, R. G., & Mendez, J. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09636-z · Cited by 29
A Near-Optimal Algorithm for Debiasing Trained Machine Learning ModelsPreprint
Alabdulmohsin, I., & Lučić, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12887 · Cited by 29
Bayes-Optimal Classifiers under Group FairnessPreprint
Zeng, X., Dobriban, E., & Cheng, G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.09724 · Cited by 29
Predictive Multiplicity in Classification
Marx, C. T., Calmon, F. P., & Ustun, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06677 · Cited by 28
Improved Adversarial Learning for Fair Classification
Celis, L. E., & Keswani, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10443 · Cited by 28
Promoting Fairness through Hyperparameter Optimization
F.Cruz, A., Saleiro, P., Belem, C., Soares, C., & Bizarro, P. (2021) · 2021 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm51629.2021.00119 · Cited by 28
Lowder, E. M., Diaz, C. L., Grommon, E., & Ray, B. R. (2022) · Journal of Experimental Criminology · doi:10.1007/s11292-021-09492-9 · Cited by 28
Private and Reliable Neural Network Inference
Jovanović, N., Fischer, M., Steffen, S., & Vechev, M. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3560709 · Cited by 28
The Misuse of AUC: What High Impact Risk Assessment Gets Wrong
Kwegyir-Aggrey, K., Gerchick, M. K., Mohan, M., Horowitz, A., & Venkatasubramanian, S. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594100 · Cited by 28
Farayola, M. M., Tal, I., Bendechache, M., Saber, T., & Connolly, R. (2023) · International Conference on Availability, Reliability and Security (ARES) · doi:10.1145/3600160.3605033 · Cited by 28
On prediction-modelers and decision-makers: why fairness requires more than a fair prediction model
Scantamburlo, T., Baumann, J., & Heitz, C. (2024) · AI & Society · doi:10.1007/s00146-024-01886-3 · Cited by 28
Causal Context Connects Counterfactual Fairness to Robust Prediction and Group Fairness
Anthis, J. R., & Veitch, V. (2023) · neural information processing systems · doi:10.52202/075280-1478 · Cited by 28
Revalidation of the Federal PTRA: Testing the PTRA for Predictive Biases
Cohen, T. H., & Lowenkamp, C. T. (2018) · Criminal Justice and Behavior · doi:10.1177/0093854818810315 · Cited by 28
Data Management for Causal Algorithmic FairnessPreprint
Salimi, B., Howe, B., & Suciu, D. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07924 · Cited by 28
Predictive Analytics for City Agencies: Lessons from Children's Services
Shroff, R. (2017) · Big Data · doi:10.1089/big.2016.0052 · Cited by 27
Fair Feature Selection: A Causal Perspective
Ling, Z., Xu, E., Zhou, P., Du, L., Yu, K., & Wu, X. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3643890 · Cited by 27
FairXAI - A Taxonomy and Framework for Fairness and Explainability Synergy in Machine Learning
Ramachandranpillai, R., Baeza-Yates, R. A., & Heintz, F. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3528321 · Cited by 27
A simple, statistically robust test of discrimination
Gaebler, J., & Goel, S. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2416348122 · Cited by 27
Self-citationPareek, S., Schömbs, S., Velloso, E., & Gonçalves, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713468 · Cited by 27
de Matos, J. C. R. G., CALSTER, B. V., Celi, L. A., Dhiman, P., Gichoya, J. W., Riley, R. D., Russell, C., Khalid, S., & Collins, G. S. (2026) · The Lancet Digital Health · doi:10.1016/j.landig.2026.101001 · Cited by 27
Chapman, A. P., Grylls, P. J., Ugwudike, P., Gammack, D., & Ayling, J. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533071 · Cited by 27
Berk, R. A., Kuchibhotla, A. K., & Tchetgen, E. T. (2022) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-033021-120649 · Cited by 27
Enhancing and Accelerating Social Science Via Automation: Challenges and Opportunities
Yarkoni, T., Eckles, D., Heathers, J. A. J., Levenstein, M. C., Smaldino, P. E., & Lane, J. I. (2021) · Harvard Data Science Review · doi:10.1162/99608f92.df2262f5 · Cited by 26
Bias and Fairness in Computer Vision Applications of the Criminal Justice System
Noiret, S., Lumetzberger, J., & Kampel, M. (2021) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci50451.2021.9660177 · Cited by 26
A Recommendation Engine to Aid in Identifying Crime Patterns
Chohlas-Wood, A., & Levine, E. S. (2019) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.2019.0985 · Cited by 26
On Heavy-user Bias in A/B Testing
Wang, Y., Gupta, S., Lu, J., Mahmoudzadeh, A., & Liu, S. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358143 · Cited by 26
Tuning Fairness by Balancing Target Labels
Kehrenberg, T., Chen, Z., & Quadrianto, N. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00033 · Cited by 26
Automating Automaticity: How the Context of Human Choice Affects the Extent of Algorithmic Bias
Agan, A., Davenport, D., Ludwig, J., & Mullainathan, S. (2023) · doi:10.3386/w30981 · Cited by 25
Demographics and discussion influence views on algorithmic fairness
Pierson, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.09124 · Cited by 25
Self-citationThe Invisible Power of Fairness. How Machine Learning Shapes Democracy
Beretta, E., Santangelo, A. D. M., Lepri, B., Vetrò, A., & Martin, J. C. D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-18305-9_19 · Cited by 25
The Price of Local Fairness in Multistage Selection
Emelianov, V., Arvanitakis, G., Gast, N., Gummadi, K. P., & Loiseau, P. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/809 · Cited by 25
IB-GAN: A Unified Approach for Multivariate Time Series Classification under Class Imbalance
Deng, G., Han, C., Dreossi, T., Lee, C. C., & Matteson, D. S. (2022) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611977172.25 · Cited by 25
Data-Centric Factors in Algorithmic Fairness
Li, N., Goel, N., & Ash, E. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534147 · Cited by 25
Friedl, P. (2023) · Law Innovation and Technology · doi:10.1080/17579961.2023.2184134 · Cited by 25
FPGNN: Fair path graph neural network for mitigating discrimination
Zhang, G., Cheng, D., & Zhang, S. (2023) · World Wide Web · doi:10.1007/s11280-023-01178-8 · Cited by 25
Fairness Implications of Encoding Protected Categorical Attributes
Mougan, C., Álvarez, J. M., Ruggieri, S., & Staab, S. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604657 · Cited by 25
Secretary Problems with Biased Evaluations Using Partial Ordinal Information
Salem, J., & Gupta, S. (2023) · Management Science · doi:10.1287/mnsc.2023.4926 · Cited by 25
Travel Demand Forecasting: A Fair AI Approach
Zhang, X., Ke, Q., & Zhao, X. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3395061 · Cited by 25
Matroids, Matchings and Fairness
Chierichetti, F., Kumar, R., Lattanzi, S., & Vassilvitskii, S. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4697719 · Cited by 25
Fairly evaluating and scoring items in a data set
Asudeh, A., & Jagadish, H. V. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3415478.3415566 · Cited by 25
Towards Fairness-Aware Disaster Informatics: an Interdisciplinary Perspective
Yang, Y., Zhang, C., Fan, C. H., Mostafavi, A., & Hu, X. (2020) · IEEE Access · doi:10.1109/access.2020.3035714 · Cited by 25
On the Fairness of Machine-Assisted Human DecisionsPreprint
Gillis, T. B., McLaughlin, B., & Spiess, J. (2021) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2110.15310 · Cited by 25
Beyond Adult and COMPAS: Fairness in Multi-Class PredictionPreprint
Alghamdi, W., Hsu, H., Jeong, H., Wang, H., Michalak, P. W., Asoodeh, S., & Calmon, F. P. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.07801 · Cited by 25
Integrating Technical and Legal Concepts of Privacy
Sokolovska, A., & Kocarev, L. (2018) · IEEE Access · doi:10.1109/access.2018.2836184 · Cited by 24
Meritocratic Fairness for Infinite and Contextual Bandits
Joseph, M., Kearns, M., Morgenstern, J., Neel, S., & Roth, A. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278764 · Cited by 24
Ribeiro, R. S. (2022) · Revista de Informação Legislativa · doi:10.70015/ril_v59_n236_p29 · Cited by 24
A fairness-focused approach to recidivism prediction: implications for accuracy, trust, and equity
Farayola, M. M., Tal, I., Saber, T., Connolly, R., & Bendechache, M. (2025) · AI & Society · doi:10.1007/s00146-025-02452-1 · Cited by 24
EADTC: An Approach to Interpretable and Accurate Crime Prediction
Ma, Y., Nakamura, K., Lee, E.-J., & Bhattacharyya, S. S. (2022) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53654.2022.9945130 · Cited by 24
Johnson, B., Bartola, J., Angell, R., Witty, S., Giguere, S., & Brun, Y. (2023) · EURO Journal on Decision Processes · doi:10.1016/j.ejdp.2023.100031 · Cited by 24
Detecting disparities in police deployments using dashcam data
Franchi, M., Zamfirescu-Pereira, J. D., Ju, W. G., & Pierson, E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594020 · Cited by 24
Self-citationSocial Bias Meets Data Bias: The Impacts of Labeling and Measurement Errors on Fairness Criteria
Liao, Y., & Naghizadeh, P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26054 · Cited by 24
Multicalibrated Regression for Downstream Fairness
Globus-Harris, I., Gupta, V., Jung, C., Kearns, M. J., Morgenstern, J., & Roth, A. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604683 · Cited by 24
Murch, W. S., Kairouz, S., & French, M. A. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100427 · Cited by 24
Wongvorachan, T., Bulut, O., Liu, J. X., & Mazzullo, E. (2024) · Information · doi:10.3390/info15060326 · Cited by 24
Fairness in online social network timelines: Measurements, models and mechanism design
Hargreaves, E. M., Agosti, C., Menasché, D. S., Neglia, G., Reiffers-Masson, A., & Altman, E. (2018) · Performance Evaluation · doi:10.1016/j.peva.2018.09.009 · Cited by 24
Enforcing fairness in logistic regression algorithm
Radovanović, S., Petrović, A., Delibašić, B., & Suknović, M. (2020) · International Conference on Innovations in Intelligent Systems and Applications (INISTA) · doi:10.1109/inista49547.2020.9194676 · Cited by 24
Tools and Algorithms for the Construction and Analysis of Systems
(2019) · Directory of Open access Books (OAPEN Foundation) · Cited by 24
Fair Bayes-Optimal Classifiers Under Predictive Parity
Zeng, X., Dobriban, E., & Cheng, G. (2022) · neural information processing systems · doi:10.52202/068431-2008 · Cited by 24
AI Fairness in Action: A Human-Computer Perspective on AI Fairness in Organizations and Society
Cremer, D. D., Narayanan, D., Nagpal, M., McGuire, J., & Schweitzer, S. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2273673 · Cited by 24
Fairness Evaluation in Presence of Biased Noisy Labels
Fogliato, R., G'Sell, M., & Chouldechova, A. (2020) · arXiv · doi:10.48550/arxiv.2003.13808 · Cited by 23
Properties of Fairness Measures in the Context of Varying Class Imbalance and Protected Group Ratios
Brzeziński, D., Stachowiak, J., Stefanowski, J., Szczęch, I., Susmaga, R., Aksenyuk, S., Ivashka, U., & Yasinskyi, O. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3654659 · Cited by 23
Genetic programming approaches to learning fair classifiers
Cava, W. L., & Moore, J. H. (2020) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3377930.3390157 · Cited by 23
Retiring $Δ$DP: New Distribution-Level Metrics for Demographic Parity
Han, X., Jiang, Z., Jin, H., Liu, Z., Zou, N., Wang, Q., & Hu, X. (2023) · Transactions on machine learning research · doi:10.48550/arxiv.2301.13443 · Cited by 23
Koenecke, A., Giannella, E., Willer, R., & Goel, S. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22163 · Cited by 23
Self-citationZhou, J., & Joachims, T. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593972 · Cited by 23
Fairness in AI-Based Mental Health: Clinician Perspectives and Bias Mitigation
Soğancıoğlu, G., Mosteiro, P. J., Salah, A. A., Scheepers, F. E., & Kaya, H. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31732 · Cited by 23
Fairness Under Feature Exemptions: Counterfactual and Observational Measures
Dutta, S., Venkatesh, P., Mardziel, P., Datta, A., & Grover, P. (2021) · IEEE Transactions on Information Theory · doi:10.1109/tit.2021.3103206 · Cited by 23
Don’t Throw it Away! The Utility of Unlabeled Data in Fair Decision Making
Rateike, M., Majumdar, A., Mineeva, O., Gummadi, K. P., & Valera, I. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533199 · Cited by 23
Wiśniewski, J., & Biecek, P. (2022) · The R Journal · doi:10.32614/rj-2022-019 · Cited by 23
Questioning the assumptions behind fairness solutionsPreprint
Overdorf, R., Kulynych, B., Balsa, E., Troncoso, C., & Gürses, S. F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11293 · Cited by 23
Achieving Model Fairness in Vertical Federated LearningPreprint
Liu, C., Fan, Z., Zhou, Z., Shi, Y., Pei, J., Chu, L., & Zhang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08344 · Cited by 23
Fair Sequential Selection Using Supervised Learning ModelsPreprint
Khalili, M. M., Zhang, X., & Abroshan, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13986 · Cited by 23
Bridging Prediction and Intervention Problems in Social SystemsPreprint
Liu, L. T., Raji, I. D., Zhou, A., Guerdan, L., Hullman, J. R., Malinsky, D., Wilder, B., Zhang, S., Adam, H., Coston, A., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.05216 · Cited by 23
Self-citationMeasuring Fairness in an Unfair World
Herington, J. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375854 · Cited by 22
Blind Justice: Algorithmically Masking Race in Charging Decisions
Chohlas-Wood, A., Nudell, J., Yao, K., Lin, Z. (., Nyarko, J., & Goel, S. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462524 · Cited by 22
Self-citationDistill-and-Compare: Auditing Black-Box Models Using Transparent Model Distillation
Tan, S., Caruana, R., Hooker, G., & Lou, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.06169 · Cited by 22
Navigating AI conformity: A design framework to assess fairness, explainability, and performance
von Zahn, M., Zacharias, J., Lowin, M., Chen, J., & Hinz, O. F. (2025) · Electronic Markets · doi:10.1007/s12525-025-00770-2 · Cited by 22
Borinca, I. (2025) · Analyses of Social Issues and Public Policy · doi:10.1111/asap.70031 · Cited by 22
Bias and fairness in machine learning and artificial intelligence
Cirillo, D., & Rementeria, M. J. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-821392-6.00006-6 · Cited by 22
Application of fairness to healthcare, organizational justice, and finance: A survey
Birzhandi, P., & Cho, Y.-S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119465 · Cited by 22
Algorithmic Fairness and Statistical Discrimination
Patty, J. W., & Penn, E. M. (2022) · Philosophy Compass · doi:10.1111/phc3.12891 · Cited by 22
PreFair: Privately Generating Justifiably Fair Synthetic Data
Pujol, D., Gilad, A., & Machanavajjhala, A. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3583140.3583168 · Cited by 22
Suk, Y., & Han, K. T. (2023) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986231171711 · Cited by 22
Preserving the Fairness Guarantees of Classifiers in Changing Environments: A Survey
Barrainkua, A., Gordaliza, P., Lozano, J. A., & Quadrianto, N. (2025) · ACM Computing Surveys · doi:10.1145/3637438 · Cited by 22
Szafran, D., & Bach, R. L. (2024) · Minds and Machines · doi:10.1007/s11023-024-09684-y · Cited by 22
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 22
Protecting the Protected Group: Circumventing Harmful Fairness
Ben-Porat, O., Sandomirskiy, F., & Tennenholtz, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16654 · Cited by 22
Nápoles, G., & Koumeri, L. K. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.01.005 · Cited by 22
Cooperative Multi-Agent Fairness and Equivariant Policies
Grupen, N. A., Selman, B., & Lee, D. D. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21166 · Cited by 22
Algorithmic Decision Making in the Presence of Unmeasured ConfoundingPreprint
Jung, J., Shroff, R., Feller, A., & Goel, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.01868 · Cited by 22
Self-citationConsumer Redlining and the Reproduction of Inequality at Dollar General
Vargas, T. L. (2021) · Qualitative Sociology · doi:10.1007/s11133-020-09473-w · Cited by 21
Taking Algorithms to Courts: A Relational Approach to Algorithmic Accountability
Metcalf, J., Singh, R., Moss, E., Tafesse, E., & Watkins, E. A. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594092 · Cited by 21
Responsible AI for Measurement and Learning: Principles and Practices
Matthew S. Johnson (2025) · ETS Research Report Series · doi:10.64634/4ftg8n64 · Cited by 21
The Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 20
First- and Second-Level Bias in Automated Decision-making
Franke, U. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00500-y · Cited by 21
Contrastive Counterfactual Fairness in Algorithmic Decision-Making
Mutlu, E. Ç., Yousefi, N., & Garibay, Ö. Ö. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534143 · Cited by 21
Anoop, K. R., Gangan, M. P., Deepak, P., & Lajish, V. L. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-19-4453-6_2 · Cited by 21
Rutherford, S. E., Wolfers, T., Fraza, C., Harrnet, N. G., Beckmann, C. F., Ruhé, H. G., & Marquand, A. F. (2024) · Pure Amsterdam UMC · doi:10.48550/arxiv.2407.19114 · Cited by 21
Metadata
- Authors
- Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A.
- Affiliations
- Stanford University, Stanford, CA, USA
- Stanford University (US)
- University of California, Berkeley (US)
- University of Chicago (US)
- Venue
- Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2017-08-04
- Pages
- 797-806
- OpenAlex
- W2584805976
- Cited by
- 1,149
- References
- 43
- Citations by year
- 2026: 62 · 2025: 113 · 2024: 141 · 2023: 173 · 2022: 146 · 2021: 162 · 2020: 150 · 2019: 119 · 2018: 67 · 2017: 13
- FWCI
- 238.91
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- John S. and James L. Knight Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Artificial Intelligence in Law
- Social Sciences › Sociology and Political Science › Criminal Justice and Corrections Analysis
- Keywords
- algorithmic fairness, risk assessment algorithm, racial disparities, public safety, constrained optimization, risk thresholds, equal treatment, Broward County
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.