Mitigating bias in algorithmic hiring: evaluating claims and practices
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments built, validated, and examined for bias? In this work, we document and analyze the claims and practices of companies offering algorithms for employment assessment. In particular, we identify vendors of algorithmic pre-employment assessments (i.e., algorithms to screen candidates), document what they have disclosed about their development and validation procedures, and evaluate their practices, focusing particularly on efforts to detect and mitigate bias. Our analysis considers both technical and legal perspectives. Technically, we consider the various choices vendors make regarding data collection and prediction targets, and explore the risks and trade-offs that these choices pose. We also discuss how algorithmic de-biasing techniques interface with, and create challenges for, antidiscrimination law.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Audits evaluate performance relative to expected behavior, as part of a broader accountability process [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“The author attributed these shortcomings in part to management pre-screening of information and interviews for auditors.”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“One systematic analysis of the monitoring methods employed by the company PricewaterhouseCoopers (PwC), for example, found that the resulting audits omitted several major violations and contained serious deficiencies [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“An analysis of PwC's auditing practices also found that the confidential nature of PwC's audits shielded them from verification by other researchers or NGOs and limited their ability to improve the conditions of the regulated entity [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“Assessing the success of potential employees based on existing employees perpetuates a bias toward candidates who resemble those already employed (Raghavan et al., 2020).”
From Ethics and discrimination in artificial intelligence-enabled recruitment practices (2023) · cites this paper as Raghavan et al., 2020
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 3×
“. When is an assessment legally considered discriminatory? Based on existing precedent, the Uniform Guidelines provide two avenues to challenge an assessment: disparate treatment and disparate impact [6]. Disparate treatment is relatively straightforward|it is illegal to explicitly treat candidates dierently based on…”
BackgroundInfluentialSelf-citationNorman, W. T. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040291 · Cited by 2,485
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019) · Psychological Science in the Public Interest · doi:10.1177/1529100619832930 · Cited by 1,748
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Self-citationThe measurement of intelligence.
Terman, L. M. (1916) · doi:10.1037/10014-000 · Cited by 986
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706255114 · Cited by 887 · cited 1×
“We know from decades of audit studies that employers tend to discriminate against women and ethnic minorities [12, 10, 9, 52], and a recent meta-analysis suggests that little has improved over the past 25 years [75].”
BackgroundDiscrimination-aware data mining
Pedreshi, D., Ruggieri, S., & Turini, F. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401959 · Cited by 676
Research works printed but not linked: 42
- Ajunwa Ifeoma, 2020, The Paradox of Automation as Anti-Bias Intervention. Cardozo Law Review 41
- Angwin Julia, 2016, ProPublica
- Ben-David Shai, 2010, A theory of learning from different domains. Machine learning 79, 1-2
- Bent Jason R, 2020, Is Algorithmic Affirmative Action Legal? Georgetown Law Journal 108
- Bertrand Marianne, 2004, Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American economic review 94, 4
- Bornstein Stephanie, 2018, Antidiscriminatory Algorithms. Ala, L. Rev., 70, 519
- Buolamwini Joy, 2018, Conference on Fairness, Accountability and Transparency. 77--91
- Cappelli Peter, 2018, Artificial Intelligence in Human Resources Management: Challenges and a Path Forward. Available at SSRN 3263878
- Chamorro-Prezumic Tomas, 2019, Should Companies Use AI to Assess Job Candidates? Harvard Business Review
- Cohn Richard M, 1979, On the Use of Statistics in Employment Discrimination, Cases. Ind. LJ, 55, 493
- Cohn Richard M, 1979, Statistical Laws and the Use of Statistics in Law: A Rejoinder to Professor, Shoben. Ind. LJ, 55, 537
- National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press. National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press.
- National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press. National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press.
- Cowgill Bo, 2018, Bias and Productivity in Humans and Algorithms: Theory and Evidence from Resume Screening. Columbia Business School
- Dunnette Marvin D, 1979, Personnel selection and classification systems. Annual review of psychology 30, 1
- Edwards Harrison, 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2--4, 2016, Conference Track Proceedings.
- Society for Industrial, Organizational Psychology (US), and American Psychological Association., 2018, Division of Industrial-Organizational Psychology
- Friedman Jerome, The elements of statistical learning
- Gerhardt PW, 1916, Scientific selection of employees. Electric Railway Journal 47
- Grimmett Jeff, 2017, Veterinary Practitioners - personal characteristics and professional longevity. VetScript
- Guo Anhong, 2019, Hannah Wallach, and Meredith Ringel Morris.
- Hellman Deborah, 2019, Measuring Algorithmic Fairness. Virginia Public Law and Legal Theory Research Paper 2019-39
- Houser Kimberly, 2019, Can AI solve the diversity problem in the tech industry? Mitigating noise and bias in employment decision-making. Stanford Technology Law Review 22
- Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016). Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016).
- Kemble William F, 1916, Testing the fitness of your employees. Industrial Management
- Kim Pauline T, 2020, Virginia Law Review 106
- Kroll Joshua A, 2016, Accountable algorithms, U. Pa. L. Rev., 165, 633
- Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135. Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135.
- Neumark David, 1996, Sex discrimination in restaurant hiring: An audit study. The Quarterly journal of economics 111, 3
- Puri Ruchir, 2018, Mitigating Bias in AI Models. IBM Research Blog
- Rhue Lauren, 2018, Racial Influence on Automated Perceptions of Emotions. Available at SSRN 3281765
- Riach Peter A, 2002, Field experiments of discrimination in the market place. The economic journal 112, 483
- Roach John, 2018, Microsoft improves facial recognition technology to perform well across all skin tones, genders. The AI Blog
- Rodriguez Michael C, 2006, Meta-analysis of coefficient alpha. Psychological methods 11, 3
- Ruda Edward, 1968, Racial differences on selection instruments related to subsequent job performance. Personnel Psychology
- Sanchez-Monedero Javier, 2020, Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM.
- Shoben Elaine W, 1978, Differential pass-fail rates in employment testing: Statistical proof under Title VII. Harvard Law Review
- Shoben Elaine W, 1979, In defense of disparate impact analysis under Title VII: A reply to Dr, Cohn. Ind. LJ, 55, 515
- Young John W, 2001, Differential Prediction, and College Admission Testing: A Comprehensive Review and Analysis. Research Report No. 2001-6
- Zafar Muhammad Bilal, Fairness Constraints: Mechanisms for Fair Classification. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 54
- Zemel Rich, 2013, International Conference on Machine Learning. 325--333
- 10.5555/2887007.2887201 · doi:10.5555/2887007.2887201
Cited by
Items 1,001–1,028 of 1,028
Aziz, M. A. (2026) · Equity in Education & Society · doi:10.1177/27526461261496901 · Cited by 1
An End-to-End Conversational Agent for AI-Led Mock Interviews and Automated Candidate Screening
Guruprakash, J., Nagamothu, K. M., Raj, N., & Krithika, L. B. (2026) · doi:10.1109/icsl-dsga70378.2026.11736528
Yadav, V. B., Singh, A., & Tiwari, N. (2026) · International Journal of Multidisciplinary Sciences and Technology · doi:10.64137/31079911/ijmst-v2i4p101
Performance Management and Workforce Analytics in Tourism: An AI-Powered Approach
Kanwal, P., Verma, A., Subramanian, J., Thakur, S., & Hung, T. H. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-4962-4.ch007
Omidvar, M. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-1905-4.ch007
Griffith, J. A., Medeiros, K. E., & McIntosh, T. J. (2026) · Group & Organization Management · doi:10.1177/10596011261501573
Prerana, Soni, B., & Kumari, P. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-2095-1.ch004
Parashar, D. R. B. A. M. S. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-40377
The Emotional Data Economy and the Rise of Emotion AI in Algorithmic Workforce Governance
Nosios, M., Boutsiouki, S., Oraiopoulou, C., & Κουτσουπιάς, Ν. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9469-5.ch009
Ethical risks of artificial intelligence-based decision support systems in organizations
Matveev, A. (2026) · National Security and Strategic Planning · doi:10.37468/2307-1400-2026-2-5-17
Aegis Recruit: AI-Powered Recruitment CRM and Applicant Tracking System
Pradeepkumar, R., Sachin, S., Shanmugam, S., & VishnuRam, V. (2026) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem68530
Cordero, D. P., Fierro, C. S. E., Calle, R. R. R., Acosta, J. F. B., & Guarnizo, J. P. M. (2026) · doi:10.66646/educa-plus/10oct2620
Akash, S., Akshaya, R., Dharaneesh, R., & Gugan, G. (2026) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem68602
Lu, Y. (2023) · Journal of Business and Data Analytics · doi:10.63646/khol2482
The Human Stakes: Fairness Across Domains and Populations
Tavakoli, H. (2026) · Apress eBooks · doi:10.1007/979-8-8688-2885-0_3
Atasever, M., Chmielarz, W. S., & Sołtysik-Piorunkiewicz, A. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.10.118
The Limits of Awareness: From Principles to Practice
Tavakoli, H. (2026) · Apress eBooks · doi:10.1007/979-8-8688-2885-0_2
Introduction: Why AI Fairness Needs a Diagnostic Toolkit
Tavakoli, H. (2026) · Apress eBooks · doi:10.1007/979-8-8688-2885-0_1
Barbosa, A. D. S., & Souza, C. (2026) · Revista Tópicos. · doi:10.70773/revistatopicos/793464540
Barbosa, I., & de Oliveira, E. R. (2026) · Personnel Review · doi:10.1108/pr-11-2025-1277
Artificial Intelligence and Behavioural Risk: The Danger and the Saving Power
Smith, P. M. R. (2026) · Routledge eBooks · doi:10.4324/9781003785811
When AI speaks bias: DeepSeek in China's recruitment context
Xu, W., & Wu, C. (2026) · Kybernetes · doi:10.1108/k-08-2025-1966
Balchat, B. A. (2026) · Jurnal Ekonomi Manajemen Bisnis dan Akuntansi Review · doi:10.53697/emba.v6i2.4298
Dhanalakshmi, R., Akshaya, S., Chaithanya, M. K., & Jahnavi, N. (2026) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2026.85512
Role of AI in Recruitment and Employee Selection: A Review of Literature
Malkoti, A., & Mehta, C. (2026) · JOURNAL OF EMERGING TRENDS AND NOVEL RESEARCH · doi:10.56975/jetnr.v4i10.235820
徐玲, & Zhang, X. (2026) · Business Process Management Journal · doi:10.1108/bpmj-06-2026-0885
Sharma, G., & Molamohammadi, M. (2026) · arXiv · doi:10.48550/arxiv.2604.22679
Auditing a Dutch Public Sector Risk Profiling Algorithm Using an Unsupervised Bias Detection Tool
Holstege, F., Jorgensen, M., Padh, K., Parie, J., Proroković, K., Persson, J., & Snoek, L. (2025) · arXiv · doi:10.48550/arxiv.2502.01713
“A rule-based algorithm, consisting of three apparently neutral characteristics of the students (type of education, age, and distance to parents), was used to assign higher risk scores to students enrolled in vocational education, younger students, and students who lived near their parental address.”
Metadata
- Authors
- Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K.
- Affiliations
- Cornell University (US)
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 469-481
- OpenAlex
- W4288083801
- Cited by
- 845
- References
- 38
- Citations by year
- 2026: 287 · 2025: 192 · 2024: 98 · 2023: 98 · 2022: 97 · 2021: 57 · 2020: 14
- FWCI
- 68.28
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- automated hiring, pre-employment assessment, algorithmic bias, bias mitigation, anti-discrimination law, employment discrimination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.