The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Mitigating bias in algorithmic hiring: evaluating claims and practices
Open accessAbstract
There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments built, validated, and examined for bias? In this work, we document and analyze the claims and practices of companies offering algorithms for employment assessment. In particular, we identify vendors of algorithmic pre-employment assessments (i.e., algorithms to screen candidates), document what they have disclosed about their development and validation procedures, and evaluate their practices, focusing particularly on efforts to detect and mitigate bias. Our analysis considers both technical and legal perspectives. Technically, we consider the various choices vendors make regarding data collection and prediction targets, and explore the risks and trade-offs that these choices pose. We also discuss how algorithmic de-biasing techniques interface with, and create challenges for, antidiscrimination law.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Audits evaluate performance relative to expected behavior, as part of a broader accountability process [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“The author attributed these shortcomings in part to management pre-screening of information and interviews for auditors.”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“One systematic analysis of the monitoring methods employed by the company PricewaterhouseCoopers (PwC), for example, found that the resulting audits omitted several major violations and contained serious deficiencies [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“An analysis of PwC's auditing practices also found that the confidential nature of PwC's audits shielded them from verification by other researchers or NGOs and limited their ability to improve the conditions of the regulated entity [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“Assessing the success of potential employees based on existing employees perpetuates a bias toward candidates who resemble those already employed (Raghavan et al., 2020).”
From Ethics and discrimination in artificial intelligence-enabled recruitment practices (2023) · cites this paper as Raghavan et al., 2020
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 3×
“. When is an assessment legally considered discriminatory? Based on existing precedent, the Uniform Guidelines provide two avenues to challenge an assessment: disparate treatment and disparate impact [6]. Disparate treatment is relatively straightforward|it is illegal to explicitly treat candidates dierently based on…”
BackgroundInfluentialSelf-citationNorman, W. T. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040291 · Cited by 2,485
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Self-citationThe measurement of intelligence.
Terman, L. M. (1916) · doi:10.1037/10014-000 · Cited by 986
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706255114 · Cited by 887
Discrimination-aware data mining
Pedreshi, D., Ruggieri, S., & Turini, F. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401959 · Cited by 676
Raji, I. D., & Buolamwini, J. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314244 · Cited by 651
Research works printed but not linked: 43
- Ajunwa Ifeoma, 2020, The Paradox of Automation as Anti-Bias Intervention. Cardozo Law Review 41
- Angwin Julia, 2016, ProPublica
- Barrett Lisa Feldman, 2019, Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest 20, 1
- Ben-David Shai, 2010, A theory of learning from different domains. Machine learning 79, 1-2
- Bent Jason R, 2020, Is Algorithmic Affirmative Action Legal? Georgetown Law Journal 108
- Bertrand Marianne, 2004, Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American economic review 94, 4
- Bornstein Stephanie, 2018, Antidiscriminatory Algorithms. Ala, L. Rev., 70, 519
- Buolamwini Joy, 2018, Conference on Fairness, Accountability and Transparency. 77--91
- Cappelli Peter, 2018, Artificial Intelligence in Human Resources Management: Challenges and a Path Forward. Available at SSRN 3263878
- Chamorro-Prezumic Tomas, 2019, Should Companies Use AI to Assess Job Candidates? Harvard Business Review
- Cohn Richard M, 1979, On the Use of Statistics in Employment Discrimination, Cases. Ind. LJ, 55, 493
- Cohn Richard M, 1979, Statistical Laws and the Use of Statistics in Law: A Rejoinder to Professor, Shoben. Ind. LJ, 55, 537
- National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press. National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press.
- National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press. National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press.
- Cowgill Bo, 2018, Bias and Productivity in Humans and Algorithms: Theory and Evidence from Resume Screening. Columbia Business School
- Dunnette Marvin D, 1979, Personnel selection and classification systems. Annual review of psychology 30, 1
- Edwards Harrison, 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2--4, 2016, Conference Track Proceedings.
- Society for Industrial, Organizational Psychology (US), and American Psychological Association., 2018, Division of Industrial-Organizational Psychology
- Friedman Jerome, The elements of statistical learning
- Gerhardt PW, 1916, Scientific selection of employees. Electric Railway Journal 47
- Grimmett Jeff, 2017, Veterinary Practitioners - personal characteristics and professional longevity. VetScript
- Guo Anhong, 2019, Hannah Wallach, and Meredith Ringel Morris.
- Hellman Deborah, 2019, Measuring Algorithmic Fairness. Virginia Public Law and Legal Theory Research Paper 2019-39
- Houser Kimberly, 2019, Can AI solve the diversity problem in the tech industry? Mitigating noise and bias in employment decision-making. Stanford Technology Law Review 22
- Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016). Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016).
- Kemble William F, 1916, Testing the fitness of your employees. Industrial Management
- Kim Pauline T, 2020, Virginia Law Review 106
- Kroll Joshua A, 2016, Accountable algorithms, U. Pa. L. Rev., 165, 633
- Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135. Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135.
- Neumark David, 1996, Sex discrimination in restaurant hiring: An audit study. The Quarterly journal of economics 111, 3
- Puri Ruchir, 2018, Mitigating Bias in AI Models. IBM Research Blog
- Rhue Lauren, 2018, Racial Influence on Automated Perceptions of Emotions. Available at SSRN 3281765
- Riach Peter A, 2002, Field experiments of discrimination in the market place. The economic journal 112, 483
- Roach John, 2018, Microsoft improves facial recognition technology to perform well across all skin tones, genders. The AI Blog
- Rodriguez Michael C, 2006, Meta-analysis of coefficient alpha. Psychological methods 11, 3
- Ruda Edward, 1968, Racial differences on selection instruments related to subsequent job performance. Personnel Psychology
- Sanchez-Monedero Javier, 2020, Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM.
- Shoben Elaine W, 1978, Differential pass-fail rates in employment testing: Statistical proof under Title VII. Harvard Law Review
- Shoben Elaine W, 1979, In defense of disparate impact analysis under Title VII: A reply to Dr, Cohn. Ind. LJ, 55, 515
- Young John W, 2001, Differential Prediction, and College Admission Testing: A Comprehensive Review and Analysis. Research Report No. 2001-6
- Zafar Muhammad Bilal, Fairness Constraints: Mechanisms for Fair Classification. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 54
- Zemel Rich, 2013, International Conference on Machine Learning. 325--333
- 10.5555/2887007.2887201 · doi:10.5555/2887007.2887201
Cited by
Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y., & Ghassemi, M. (2021) · Nature Medicine · doi:10.1038/s41591-021-01595-0 · Cited by 928
Fairness in machine learning: A survey
Caton, S., & Haas, C. (2024) · ACM Computing Surveys · doi:10.1145/3616865 · Cited by 646
Ethical Considerations of Using ChatGPT in Health Care
Wang, C., Liu, S., Yang, H., Guo, J., Wu, Y., & Liu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/48009 · Cited by 541
Köchling, A., & Wehner, M. C. (2020) · Business Research · doi:10.1007/s40685-020-00134-w · Cited by 511
“If the companies use algorithms provided by an external service provider, the algorithms’ code and training data are not transparent for the companies (Raghavan et al. 2020; Sánchez-Monedero et al. 2020).”
BackgroundMethodInfluentialEthics and discrimination in artificial intelligence-enabled recruitment practices
Chen, Z. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02079-x · Cited by 450
Metadata
- Authors
- Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K.
- Affiliations
- Cornell University (US)
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 469-481
- OpenAlex
- W4288083801
- Cited by
- 845
- References
- 38
- Citations by year
- 2026: 287 · 2025: 192 · 2024: 98 · 2023: 98 · 2022: 97 · 2021: 57 · 2020: 14
- FWCI
- 68.28
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- automated hiring, pre-employment assessment, algorithmic bias, bias mitigation, anti-discrimination law, employment discrimination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mitigating bias in algorithmic hiring: evaluating claims and practices. https://app.cochat.ai/papers/10.1145/3351095.3372828
- The paper
- Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K. (2020). Mitigating bias in algorithmic hiring: evaluating claims and practices. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3351095.3372828
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.