Mitigating bias in algorithmic hiring: evaluating claims and practices
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments built, validated, and examined for bias? In this work, we document and analyze the claims and practices of companies offering algorithms for employment assessment. In particular, we identify vendors of algorithmic pre-employment assessments (i.e., algorithms to screen candidates), document what they have disclosed about their development and validation procedures, and evaluate their practices, focusing particularly on efforts to detect and mitigate bias. Our analysis considers both technical and legal perspectives. Technically, we consider the various choices vendors make regarding data collection and prediction targets, and explore the risks and trade-offs that these choices pose. We also discuss how algorithmic de-biasing techniques interface with, and create challenges for, antidiscrimination law.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Audits evaluate performance relative to expected behavior, as part of a broader accountability process [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“The author attributed these shortcomings in part to management pre-screening of information and interviews for auditors.”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“One systematic analysis of the monitoring methods employed by the company PricewaterhouseCoopers (PwC), for example, found that the resulting audits omitted several major violations and contained serious deficiencies [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“An analysis of PwC's auditing practices also found that the confidential nature of PwC's audits shielded them from verification by other researchers or NGOs and limited their ability to improve the conditions of the regulated entity [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“Assessing the success of potential employees based on existing employees perpetuates a bias toward candidates who resemble those already employed (Raghavan et al., 2020).”
From Ethics and discrimination in artificial intelligence-enabled recruitment practices (2023) · cites this paper as Raghavan et al., 2020
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 3×
“. When is an assessment legally considered discriminatory? Based on existing precedent, the Uniform Guidelines provide two avenues to challenge an assessment: disparate treatment and disparate impact [6]. Disparate treatment is relatively straightforward|it is illegal to explicitly treat candidates dierently based on…”
BackgroundInfluentialSelf-citationNorman, W. T. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040291 · Cited by 2,485
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Self-citationThe measurement of intelligence.
Terman, L. M. (1916) · doi:10.1037/10014-000 · Cited by 986
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706255114 · Cited by 887
Discrimination-aware data mining
Pedreshi, D., Ruggieri, S., & Turini, F. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401959 · Cited by 676
Raji, I. D., & Buolamwini, J. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314244 · Cited by 651
Research works printed but not linked: 43
- Ajunwa Ifeoma, 2020, The Paradox of Automation as Anti-Bias Intervention. Cardozo Law Review 41
- Angwin Julia, 2016, ProPublica
- Barrett Lisa Feldman, 2019, Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest 20, 1
- Ben-David Shai, 2010, A theory of learning from different domains. Machine learning 79, 1-2
- Bent Jason R, 2020, Is Algorithmic Affirmative Action Legal? Georgetown Law Journal 108
- Bertrand Marianne, 2004, Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American economic review 94, 4
- Bornstein Stephanie, 2018, Antidiscriminatory Algorithms. Ala, L. Rev., 70, 519
- Buolamwini Joy, 2018, Conference on Fairness, Accountability and Transparency. 77--91
- Cappelli Peter, 2018, Artificial Intelligence in Human Resources Management: Challenges and a Path Forward. Available at SSRN 3263878
- Chamorro-Prezumic Tomas, 2019, Should Companies Use AI to Assess Job Candidates? Harvard Business Review
- Cohn Richard M, 1979, On the Use of Statistics in Employment Discrimination, Cases. Ind. LJ, 55, 493
- Cohn Richard M, 1979, Statistical Laws and the Use of Statistics in Law: A Rejoinder to Professor, Shoben. Ind. LJ, 55, 537
- National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press. National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press.
- National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press. National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press.
- Cowgill Bo, 2018, Bias and Productivity in Humans and Algorithms: Theory and Evidence from Resume Screening. Columbia Business School
- Dunnette Marvin D, 1979, Personnel selection and classification systems. Annual review of psychology 30, 1
- Edwards Harrison, 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2--4, 2016, Conference Track Proceedings.
- Society for Industrial, Organizational Psychology (US), and American Psychological Association., 2018, Division of Industrial-Organizational Psychology
- Friedman Jerome, The elements of statistical learning
- Gerhardt PW, 1916, Scientific selection of employees. Electric Railway Journal 47
- Grimmett Jeff, 2017, Veterinary Practitioners - personal characteristics and professional longevity. VetScript
- Guo Anhong, 2019, Hannah Wallach, and Meredith Ringel Morris.
- Hellman Deborah, 2019, Measuring Algorithmic Fairness. Virginia Public Law and Legal Theory Research Paper 2019-39
- Houser Kimberly, 2019, Can AI solve the diversity problem in the tech industry? Mitigating noise and bias in employment decision-making. Stanford Technology Law Review 22
- Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016). Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016).
- Kemble William F, 1916, Testing the fitness of your employees. Industrial Management
- Kim Pauline T, 2020, Virginia Law Review 106
- Kroll Joshua A, 2016, Accountable algorithms, U. Pa. L. Rev., 165, 633
- Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135. Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135.
- Neumark David, 1996, Sex discrimination in restaurant hiring: An audit study. The Quarterly journal of economics 111, 3
- Puri Ruchir, 2018, Mitigating Bias in AI Models. IBM Research Blog
- Rhue Lauren, 2018, Racial Influence on Automated Perceptions of Emotions. Available at SSRN 3281765
- Riach Peter A, 2002, Field experiments of discrimination in the market place. The economic journal 112, 483
- Roach John, 2018, Microsoft improves facial recognition technology to perform well across all skin tones, genders. The AI Blog
- Rodriguez Michael C, 2006, Meta-analysis of coefficient alpha. Psychological methods 11, 3
- Ruda Edward, 1968, Racial differences on selection instruments related to subsequent job performance. Personnel Psychology
- Sanchez-Monedero Javier, 2020, Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM.
- Shoben Elaine W, 1978, Differential pass-fail rates in employment testing: Statistical proof under Title VII. Harvard Law Review
- Shoben Elaine W, 1979, In defense of disparate impact analysis under Title VII: A reply to Dr, Cohn. Ind. LJ, 55, 515
- Young John W, 2001, Differential Prediction, and College Admission Testing: A Comprehensive Review and Analysis. Research Report No. 2001-6
- Zafar Muhammad Bilal, Fairness Constraints: Mechanisms for Fair Classification. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 54
- Zemel Rich, 2013, International Conference on Machine Learning. 325--333
- 10.5555/2887007.2887201 · doi:10.5555/2887007.2887201
Cited by
Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y., & Ghassemi, M. (2021) · Nature Medicine · doi:10.1038/s41591-021-01595-0 · Cited by 928
Fairness in machine learning: A survey
Caton, S., & Haas, C. (2024) · ACM Computing Surveys · doi:10.1145/3616865 · Cited by 646
Ethical Considerations of Using ChatGPT in Health Care
Wang, C., Liu, S., Yang, H., Guo, J., Wu, Y., & Liu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/48009 · Cited by 541
Köchling, A., & Wehner, M. C. (2020) · Business Research · doi:10.1007/s40685-020-00134-w · Cited by 511
“If the companies use algorithms provided by an external service provider, the algorithms’ code and training data are not transparent for the companies (Raghavan et al. 2020; Sánchez-Monedero et al. 2020).”
BackgroundMethodInfluentialEthics and discrimination in artificial intelligence-enabled recruitment practices
Chen, Z. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02079-x · Cited by 450
Ethics of AI-enabled recruiting and selection: a review and research agenda
Hunkenschroer, A. L., & Luetge, C. (2022) · Journal of Business Ethics · doi:10.1007/s10551-022-05049-6 · Cited by 447
Understanding and shaping the future of work with self-determination theory
Gagné, M., Parker, S. K., Griffin, M. A., Dunlop, P. D., Knight, C., Klonek, F. E., & Parent-Rocheleau, X. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00056-w · Cited by 434
Inherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
Self-citationLanger, M., & Landers, R. N. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106878 · Cited by 338
Power to the People? Opportunities and Challenges for Participatory AI
Birhane, A., Isaac, W., Prabhakaran, V., Diaz, M., Elish, M. C., Gabriel, I., & Mohamed, S. (2022) · Equity and Access in Algorithms Mechanisms and Optimization · doi:10.1145/3551624.3555290 · Cited by 330
Multi-Agent Risks from Advanced AI
Hammond, L., Chan, A., Clifton, J., Hoelscher-Obermaier, J., Khan, A., McLean, E., Smith, C., Barfuss, W., Foerster, J., Gavenčiak, T., et al. (2025) · arXiv · doi:10.48550/arxiv.2502.14143 · Cited by 305
Ahmad, K., Maabreh, M., Ghaly, M., Khan, K., Qadir, J., & Al-Fuqaha, A. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2021.100452 · Cited by 291
Should ChatGPT be biased? Challenges and risks of bias in large language models
Ferrara, E. (2023) · First Monday · doi:10.5210/fm.v28i11.13346 · Cited by 282
“This could lead to the perpetuation of existing inequalities in the job market, limiting opportunities for affected individuals and reducing diversity in the workforce [108, 109].”
BackgroundShould ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
Ferrara, E. (2023) · arXiv · doi:10.48550/arxiv.2304.03738 · Cited by 282
Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations
Rong, Y., Leemann, T., Nguyen, T.-T., Fiedler, L., Qian, P., Unhelkar, V., Seidel, T., Kasneci, G., & Kasneci, E. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3331846 · Cited by 278
The Fallacy of AI Functionality
Raji, I. D., Kumar, I. E., Horowitz, A., & Selbst, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533158 · Cited by 251
Systemic Discrimination Among Large U.S. Employers
Kline, P., Rose, E. K., & Walters, C. R. (2022) · The Quarterly Journal of Economics · doi:10.1093/qje/qjac024 · Cited by 209
Sánchez-Monedero, J., Dencik, L., & Edwards, L. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372849 · Cited by 196
Bujold, A., Roberge‐Maltais, I., Parent‐Rocheleau, X., Boasen, J., Sénécal, S., & Léger, P. (2023) · AI and Ethics · doi:10.1007/s43681-023-00325-1 · Cited by 271
Biased Programmers? Or Biased Data? A Field Experiment in Operationalizing AI Ethics
Cowgill, B., Dell'Acqua, F., Deng, S., Hsu, D., Verma, N., & Chaintreau, A. (2020) · Proceedings of the 21st ACM Conference on Economics and Computation · doi:10.1145/3391403.3399545 · Cited by 166
Disability, fairness, and algorithmic bias in AI recruitment
Tilmes, N. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09633-2 · Cited by 256
Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases
Steed, R., & Caliskan, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445932 · Cited by 270
Transformative AI in human resource management: enhancing workforce planning with topic modeling
Venugopalan, M., Madhavan, V., Prasad, R., & Raghu Raman, R. (2024) · Cogent Business & Management · doi:10.1080/23311975.2024.2432550 · Cited by 195
Figueroa-Armijos, M., Clark, B. B., & da Motta Veiga, S. P. (2023) · Journal of Business Ethics · doi:10.1007/s10551-022-05166-2 · Cited by 164
Spatiotemporal data mining: a survey on challenges and open problems
Hamdi, A., Shaban, K. B., Erradi, A., Mohamed, A. M. S., Rumi, S. K., & Salim, F. D. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09994-y · Cited by 211
The Butterfly Effect in artificial intelligence systems: Implications for AI bias and fairness
Ferrara, E. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100525 · Cited by 208
Exciting, Useful, Worrying, Futuristic: Public Perception of Artificial Intelligence in 8 Countries
Kelley, P. G., Yang, Y., Heldreth, C., Moessner, C., Sedley, A., Kramm, A., Newman, D. T., & Woodruff, A. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462605 · Cited by 229
Ethical machines: The human-centric use of artificial intelligence
Lepri, B., Oliver, N., & Pentland, A. (2021) · iScience · doi:10.1016/j.isci.2021.102249 · Cited by 149
Measuring algorithmically infused societies
Wagner, C., Strohmaier, M., Olteanu, A., Kıcıman, E., Contractor, N., & Eliassi-Rad, T. (2021) · Nature · doi:10.1038/s41586-021-03666-1 · Cited by 144
The cyclical ethical effects of using artificial intelligence in education
Dieterle, E., Dede, C., & Walker, M. (2024) · AI & SOCIETY · doi:10.1007/s00146-022-01497-w · Cited by 142
“…that education is not alone in its susceptibility to bias; examples of algorithmic bias also associated with life outcomes abound in the criminal justice system (Angwin et al., 2016; Završnik 2019), social services (Eubanks 2017), and job recruitment (Caliskan et al. 2017; Raghavan et al. 2020).”
Langer, M., König, C. J., Back, C., & Hemsing, V. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09829-9 · Cited by 173
Building and Auditing Fair Algorithms: A Case Study in Candidate Screening
Wilson, C., Ghosh, A., Jiang, S., Mislove, A., Baker, L., Szary, J., Trindel, K., & Polli, F. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445928 · Cited by 133
“• pymetrics performs post-training adverse impact testing on models using a held-out set of data [43, 50].”
BackgroundMethodInfluentialScientific, Legal, and Ethical Concerns About AI-Based Personnel Selection Tools: A Call to Action
Tippins, N. T., Oswald, F. L., & McPhail, S. M. (2021) · Personnel Assessment and Decisions · doi:10.25035/pad.2021.02.001 · Cited by 141
Park, H., Ahn, D., Hosanagar, K., & Lee, J. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445304 · Cited by 199
From human resources to human rights: Impact assessments for hiring algorithms
Yam, J., & Skorburg, J. A. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09599-7 · Cited by 169
Fairness in Machine Learning: A Survey
Caton, S., & Haas, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04053 · Cited by 646
Iftikhar, A., Mohammad, S. I., Alqudah, M. A., Al‐Adwan, A. S., Vasudevan, A., Ali, I., & Farhan, M. (2024) · Data & Metadata · doi:10.56294/dm2025487 · Cited by 128
Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance
Raji, I. D., Xu, P., Honigsberg, C., & Ho, D. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534181 · Cited by 209
Applicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures
Lavanchy, M., Reichert, P., Narayanan, J., & Savani, K. (2023) · Journal of Business Ethics · doi:10.1007/s10551-022-05320-w · Cited by 167
Fairness and Bias in Algorithmic Hiring: A Multidisciplinary Survey
Fabris, A., Baranowska, N., Dennis, M. J., Graus, D., Hacker, P., Saldivar, J., Zuiderveen Borgesius, F., & Biega, A. J. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3696457 · Cited by 117
Artificial Intelligence and Public Human Resource Management: Questions for Research and Practice
Johnson, B. A. M., Coggburn, J. D., & Llorens, J. J. (2022) · Public Personnel Management · doi:10.1177/00910260221126498 · Cited by 170
Kieslich, K., Lünich, M., & Marcinkowski, F. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00734-w · Cited by 146
Algorithmic Hiring in Practice: Recruiter and HR Professional's Perspectives on AI Use in Hiring
Li, L., Lassiter, T. B., Oh, J., & Lee, M. K. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462531 · Cited by 151
“Who goes first? Influences of human-AI workflow on decision making in clinical imaging,”
Fogliato, R., Chappidi, S., Lungren, M., Fisher, P., Wilson, D., Fitzke, M., Parkinson, M., Horvitz, E., Inkpen, K., & Nushi, B. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533193 · Cited by 103
Is AI recruiting (un) ethical? A human rights perspective on the use of AI for hiring
Hunkenschroer, A. L., & Kriebitz, A. (2023) · AI and Ethics · doi:10.1007/s43681-022-00166-4 · Cited by 111
Hofeditz, L., Clausen, S., Rieß, A., Mirbabaie, M., & Stieglitz, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00600-9 · Cited by 136
Invited perspectives: How machine learning will change flood risk and impact assessment
Wagenaar, D., Curran, A., Balbi, M., Bhardwaj, A., Soden, R., Hartato, E., Sarica, G. M., Ruangpan, L., Molinario, G., & Lallemant, D. (2020) · Natural hazards and earth system sciences · doi:10.5194/nhess-20-1149-2020 · Cited by 118
Exploring gender biases in ML and AI academic research through systematic literature review
Shrestha, S., & Das, S. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.976838 · Cited by 156
Black-Box Access is Insufficient for Rigorous AI Audits
Casper, S., Ezell, C., Siegmann, C., Kolt, N., Curtis, T. L., Bucknall, B., Haupt, A., Wei, K., Scheurer, J., Hobbhahn, M., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3659037 · Cited by 86
Langer, M., König, C. J., & Busch, V. (2020) · Journal of Business and Psychology · doi:10.1007/s10869-020-09711-6 · Cited by 134
The mechanisms of AI hype and its planetary and social costs
Markelius, A., Wright, C., Kuiper, J., Delille, N., & Kuo, Y.-T. (2024) · AI and Ethics · doi:10.1007/s43681-024-00461-2 · Cited by 143
In-Processing Modeling Techniques for Machine Learning Fairness: A Survey
Wan, M., Zha, D., Liu, N., & Zou, N. (2023) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3551390 · Cited by 99
“Machine learning models are becoming pervasive in real-world applications and have been increasingly deployed in high-stakes decision-making processes, such as loan management [62], job applications [69], and criminal justice [9].”
BackgroundAn Overview of Fairness in Clustering
Chhabra, A., Masalkovaitė, K., & Mohapatra, P. (2021) · IEEE Access · doi:10.1109/access.2021.3114099 · Cited by 155
Köchling, A., Riazy, S., Wehner, M., & Simbeck, K. (2020) · Business & Information Systems Engineering · doi:10.1007/s12599-020-00673-w · Cited by 125
Algorithmic fairness in business analytics: Directions for research and practice
De‐Arteaga, M., Feuerriegel, S., & Saar‐Tsechansky, M. (2022) · Production and Operations Management · doi:10.1111/poms.13839 · Cited by 135
Pandey, A., & Caliskan, A. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462561 · Cited by 125
Markl, N. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533117 · Cited by 153
Menard, P., & Bott, G. J. (2024) · Information Systems Journal · doi:10.1111/isj.12544 · Cited by 120
Reducing AI bias in recruitment and selection: an integrative grounded approach
Soleimani, M., Intezari, A. H., Arrowsmith, J., Pauleen, D. J., & Taşkın, N. (2025) · The International Journal of Human Resource Management · doi:10.1080/09585192.2025.2480617 · Cited by 122
Effective human–AI work design for collaborative decision-making
Jain, R., Garg, N., & Khera, S. N. (2023) · Kybernetes · doi:10.1108/k-04-2022-0548 · Cited by 85
Model Multiplicity: Opportunities, Concerns, and Solutions
Black, E., Raghavan, M., & Barocas, S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533149 · Cited by 85
Self-citationChan, A., Ezell, C., Kaufmann, M., Wei, K., Hammond, L., Bradley, H., Bluemke, E., Rajkumar, N., Krueger, D., Kolt, N., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658948 · Cited by 84
Bridging Machine Learning and Mechanism Design towards Algorithmic Fairness
Finocchiaro, J., Maio, R., Monachou, F., Patro, G. K., Raghavan, M., Stoica, A.-A., & Tsirtsis, S. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445912 · Cited by 124
Self-citationA Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. (2021) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3465416.3483305 · Cited by 82
Park, H., Ahn, D., Hosanagar, K., & Lee, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517672 · Cited by 112
Scientism as illusio in HR algorithms: Towards a framework for algorithmic hygiene for bias proofing
Vassilopoulou, J., Kyriakidou, O., Özbilgin, M. F., & Groutsis, D. G. (2022) · Human Resource Management Journal · doi:10.1111/1748-8583.12430 · Cited by 92
Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies
Vecchione, B., Levy, K. E. C., & Barocas, S. (2021) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3465416.3483294 · Cited by 128
Self-citationA Challenge-based Survey of E-recruitment Recommendation Systems
Mashayekhi, Y., Li, N., Kang, B., Lijffijt, J., & Bie, T. D. (2024) · ACM Computing Surveys · doi:10.1145/3659942 · Cited by 79
Creel, K., & Hellman, D. (2022) · Canadian Journal of Philosophy · doi:10.1017/can.2022.3 · Cited by 67
Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603203 · Cited by 67
Self-citationAlgorithmic Fairness in AI: An Interdisciplinary View
Pfeiffer, J., Gutschow, J., Haas, C. S., Möslein, F., Maspfuhl, O., Borgers, F., & Alpsancar, S. (2023) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00787-x · Cited by 96
Personnel selection: A review of ways to maximize validity, diversity, and the applicant experience
Iddekinge, C. H. V., Lievens, F., & Sackett, P. R. (2023) · Personnel Psychology · doi:10.1111/peps.12578 · Cited by 87
Introduction to large language models (LLMs) for dementia care and research
Treder, M. S., Lee, S., & Tsvetanov, K. A. (2024) · Frontiers in Dementia · doi:10.3389/frdem.2024.1385303 · Cited by 63
Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-Based Recruitment
Peña, A., Serna, I., Morales, A., Fiérrez, J., Ortega, A., Sánchez, A. H., Saéz, M. A., & Ortega-García, J. (2023) · SN Computer Science · doi:10.1007/s42979-023-01733-0 · Cited by 97
Delegation to artificial intelligence can increase dishonest behaviour
Köbis, N., Rahwan, Z., Rilla, R., Supriyatno, B. I., Bersch, C., Ajaj, T., Bonnefon, J., & Rahwan, I. (2025) · Nature · doi:10.1038/s41586-025-09505-x · Cited by 126
Bailey, D. E. (2022) · Industrial and Labor Relations Review · doi:10.1177/00197939221076747 · Cited by 85
Auditing Work: Exploring the New York City algorithmic bias audit regime
Groves, L., Metcalf, J., Kennedy, A., Vecchione, B., & Strait, A. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658959 · Cited by 59
Check the box! How to deal with automation bias in AI-based personnel selection
Kupfer, C., Prassl, R., Fleiß, J., Malin, C., Thalmann, S., & Kubicek, B. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1118723 · Cited by 59
Carter, M., & Egliston, B. (2021) · New Media & Society · doi:10.1177/14614448211012794 · Cited by 80
The Silicon Ceiling: Auditing GPT’s Race and Gender Biases in Hiring
Armstrong, L., Liu, A., MacNeil, S., & Metaxa, D. (2024) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3689904.3694699 · Cited by 117
Corvite, S., Roemmich, K., Rosenberg, T. I., & Andalibi, N. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579600 · Cited by 96
More Capable, Less Benevolent: Trust Perceptions of AI Systems across Societal Contexts
Novozhilova, E., Mays, K. K., Paik, S., & Katz, J. E. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6010017 · Cited by 75
Investigating Gender and Racial Biases in DALL-E Mini Images
Cheong, M., Abedin, E., Ferreira, M., Reimann, R., Chalson, S., Robinson, P., Byrne, J., Ruppanner, L., Alfano, M., & Klein, C. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3649883 · Cited by 57
Köchling, A., & Wehner, M. (2022) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12412 · Cited by 79
A Survey of Bias in Machine Learning Through the Prism of Statistical Parity
Besse, P. C., del Barrio, E., Gordaliza, P., Loubes, J., & Risser, L. (2021) · The American Statistician · doi:10.1080/00031305.2021.1952897 · Cited by 105
Langer, M., Baum, K. L., König, C. J., Hähne, V., Oster, D., & Speith, T. (2021) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12325 · Cited by 69
AI and discriminative decisions in recruitment: Challenging the core assumptions
Seppälä, P., & Małecka, M. (2024) · Big Data & Society · doi:10.1177/20539517241235872 · Cited by 92
Procedural fairness in algorithmic decision-making: the role of public engagement
Decker, M. C., Wegner, L., & Leicht-Scholten, C. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09811-4 · Cited by 78
Andrus, M., & Villeneuve, S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533226 · Cited by 82
Digital Globalization: Politics, Policy, and a Governance Paradox
Weymouth, S. J. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108974158 · Cited by 64
How AI tools can—and cannot—help organizations become more ethical
Cremer, D. D., & Narayanan, D. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1093712 · Cited by 75
Karwatzki, S., Trenz, M., & Veit, D. J. (2022) · Information Systems Journal · doi:10.1111/isj.12386 · Cited by 77
Seven HCI Grand Challenges Revisited: Five-Year Progress
Stephanidis, C., Salvendy, G., Antona, M., Duffy, V. G., Gao, Q., Karwowski, W., Konomi, S., Nah, F. F., Ntoa, S., Rau, P. P., et al. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2450411 · Cited by 69
Human visual explanations mitigate bias in AI-based assessment of surgeon skills
Kiyasseh, D., Laca, J., Haque, T. F., Otiato, M., Miles, B. J., Wagner, C., Donoho, D. A., Trinh, Q.-D., Anandkumar, A., & Hung, A. J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00766-2 · Cited by 53
Working at the Intersection of Race, Disability and Accessibility
Harrington, C. N., Desai, A., Lewis, A., Moharana, S., Ross, A. S., & Mankoff, J. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3608389 · Cited by 53
People versus machines: introducing the HIRE framework
Will, P., Krpan, D., & Lordan, G. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10193-6 · Cited by 76
Naoum, R. F., Szakadáti, T., & Balogh, G. (2026) · Management Review Quarterly · doi:10.1007/s11301-025-00580-y · Cited by 75
Kassir, S., Baker, L. J., Dolphin, J., & Polli, F. E. (2022) · AI and Ethics · doi:10.1007/s43681-022-00208-x · Cited by 80
Algorithmic fairness of machine learning models for Alzheimer disease progression
Yuan, C., Linn, K. A., & Hubbard, R. A. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.42203 · Cited by 49
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603207 · Cited by 49
Self-citation
Metadata
- Authors
- Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K.
- Affiliations
- Cornell University (US)
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 469-481
- OpenAlex
- W4288083801
- Cited by
- 845
- References
- 38
- Citations by year
- 2026: 287 · 2025: 192 · 2024: 98 · 2023: 98 · 2022: 97 · 2021: 57 · 2020: 14
- FWCI
- 68.28
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- automated hiring, pre-employment assessment, algorithmic bias, bias mitigation, anti-discrimination law, employment discrimination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.