CoChat

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

Mitigating bias in algorithmic hiring: evaluating claims and practices

Open access
Raghavan, Manish, Barocas, Solon, Kleinberg, Jon, Levy, Karen · 2020 · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency

Abstract

There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments built, validated, and examined for bias? In this work, we document and analyze the claims and practices of companies offering algorithms for employment assessment. In particular, we identify vendors of algorithmic pre-employment assessments (i.e., algorithms to screen candidates), document what they have disclosed about their development and validation procedures, and evaluate their practices, focusing particularly on efforts to detect and mitigate bias. Our analysis considers both technical and legal perspectives. Technically, we consider the various choices vendors make regarding data collection and prediction targets, and explore the risks and trade-offs that these choices pose. We also discuss how algorithmic de-biasing techniques interface with, and create challenges for, antidiscrimination law.

Overview

Integrity signals

Registry

Crossref · 10.1145/3351095.3372828

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

14 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Research works printed but not linked: 43

  1. Ajunwa Ifeoma, 2020, The Paradox of Automation as Anti-Bias Intervention. Cardozo Law Review 41
  2. Angwin Julia, 2016, ProPublica
  3. Barrett Lisa Feldman, 2019, Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest 20, 1
  4. Ben-David Shai, 2010, A theory of learning from different domains. Machine learning 79, 1-2
  5. Bent Jason R, 2020, Is Algorithmic Affirmative Action Legal? Georgetown Law Journal 108
  6. Bertrand Marianne, 2004, Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American economic review 94, 4
  7. Bornstein Stephanie, 2018, Antidiscriminatory Algorithms. Ala, L. Rev., 70, 519
  8. Buolamwini Joy, 2018, Conference on Fairness, Accountability and Transparency. 77--91
  9. Cappelli Peter, 2018, Artificial Intelligence in Human Resources Management: Challenges and a Path Forward. Available at SSRN 3263878
  10. Chamorro-Prezumic Tomas, 2019, Should Companies Use AI to Assess Job Candidates? Harvard Business Review
  11. Cohn Richard M, 1979, On the Use of Statistics in Employment Discrimination, Cases. Ind. LJ, 55, 493
  12. Cohn Richard M, 1979, Statistical Laws and the Use of Statistics in Law: A Rejoinder to Professor, Shoben. Ind. LJ, 55, 537
  13. National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press. National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press.
  14. National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press. National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press.
  15. Cowgill Bo, 2018, Bias and Productivity in Humans and Algorithms: Theory and Evidence from Resume Screening. Columbia Business School
  16. Dunnette Marvin D, 1979, Personnel selection and classification systems. Annual review of psychology 30, 1
  17. Edwards Harrison, 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2--4, 2016, Conference Track Proceedings.
  18. Society for Industrial, Organizational Psychology (US), and American Psychological Association., 2018, Division of Industrial-Organizational Psychology
  19. Friedman Jerome, The elements of statistical learning
  20. Gerhardt PW, 1916, Scientific selection of employees. Electric Railway Journal 47
  21. Grimmett Jeff, 2017, Veterinary Practitioners - personal characteristics and professional longevity. VetScript
  22. Guo Anhong, 2019, Hannah Wallach, and Meredith Ringel Morris.
  23. Hellman Deborah, 2019, Measuring Algorithmic Fairness. Virginia Public Law and Legal Theory Research Paper 2019-39
  24. Houser Kimberly, 2019, Can AI solve the diversity problem in the tech industry? Mitigating noise and bias in employment decision-making. Stanford Technology Law Review 22
  25. Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016). Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016).
  26. Kemble William F, 1916, Testing the fitness of your employees. Industrial Management
  27. Kim Pauline T, 2020, Virginia Law Review 106
  28. Kroll Joshua A, 2016, Accountable algorithms, U. Pa. L. Rev., 165, 633
  29. Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135. Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135.
  30. Neumark David, 1996, Sex discrimination in restaurant hiring: An audit study. The Quarterly journal of economics 111, 3
  31. Puri Ruchir, 2018, Mitigating Bias in AI Models. IBM Research Blog
  32. Rhue Lauren, 2018, Racial Influence on Automated Perceptions of Emotions. Available at SSRN 3281765
  33. Riach Peter A, 2002, Field experiments of discrimination in the market place. The economic journal 112, 483
  34. Roach John, 2018, Microsoft improves facial recognition technology to perform well across all skin tones, genders. The AI Blog
  35. Rodriguez Michael C, 2006, Meta-analysis of coefficient alpha. Psychological methods 11, 3
  36. Ruda Edward, 1968, Racial differences on selection instruments related to subsequent job performance. Personnel Psychology
  37. Sanchez-Monedero Javier, 2020, Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM.
  38. Shoben Elaine W, 1978, Differential pass-fail rates in employment testing: Statistical proof under Title VII. Harvard Law Review
  39. Shoben Elaine W, 1979, In defense of disparate impact analysis under Title VII: A reply to Dr, Cohn. Ind. LJ, 55, 515
  40. Young John W, 2001, Differential Prediction, and College Admission Testing: A Comprehensive Review and Analysis. Research Report No. 2001-6
  41. Zafar Muhammad Bilal, Fairness Constraints: Mechanisms for Fair Classification. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 54
  42. Zemel Rich, 2013, International Conference on Machine Learning. 325--333
  43. 10.5555/2887007.2887201 · doi:10.5555/2887007.2887201

Cited by

See all 1,026

Metadata

Authors
Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K.
Affiliations
Cornell University (US)
Venue
Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2020-01-27
Pages
469-481
OpenAlex
W4288083801
Cited by
845
References
38
Citations by year
2026: 287 · 2025: 192 · 2024: 98 · 2023: 98 · 2022: 97 · 2021: 57 · 2020: 14
FWCI
68.28
Type
conference paper
Language
en
Open access
Locations
ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
  • Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
Keywords
automated hiring, pre-employment assessment, algorithmic bias, bias mitigation, anti-discrimination law, employment discrimination

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.