Automated Employment Discrimination
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Even as laws have been enacted to grant equal opportunity to job applicants, new socio-technical developments have ushered in novel mechanisms for discrimination. The high bar of proof to demonstrate a disparate impact cause of action under Title VII of the Civil Rights Act, coupled with the “black box” nature of many automated hiring systems, renders the detection and redress of bias in such algorithmic systems difficult. This Article, with contributions at the intersection of administrative law, employment & labor law, and law & technology, makes the central claim that the automation of hiring both facilitates and obfuscates employment discrimination. That phenomenon and the deployment of intellectual property law as a shield against the scrutiny of automated systems combine to form an insurmountable obstacle for disparate impact claimants. The first contribution of this Article then is an eye-opening, in-depth examination of how bias is introduced, replicated, and also hidden by automated hiring systems. The second contribution is a hybrid approach to remedies that moves beyond the litigation-based paradigm in employment law to include redress mechanisms from administrative and labor law. To ensure against the identified “bias in, bias out” phenomenon associated with automated decision-making, I argue that the goal of equal opportunity in employment creates an “auditing imperative” for algorithmic hiring systems. This auditing imperative mandates both internal and external audits of automated hiring systems, as well as record-keeping initiatives for job applications. Such audit requirements have precedent in other areas of law, as they are not dissimilar to the Occupational Safety and Health Administration (OSHA) audits in labor law or the Sarbanes-Oxley Act audit requirements in securities law. Conjointly, I propose that employers that subject their automated hiring platforms to external audits could receive a certification mark, “the Fair Automated Hiring Mark,” which would serve to positively distinguish them in the labor market. I also discuss how labor law mechanisms such as collective bargaining could be an effective approach to combating the bias in automated hiring by establishing criteria for the data deployed in automated employment decision-making and creating standards for the protection and portability of said data. The Article concludes by noting that automated hiring, which captures a vast array of applicant data, merits greater legal oversight given the potential for “algorithmic blackballing,” a phenomenon that could continue to thwart an applicant’s future job bids.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Scholarship has highlighted that technical measures of risks of harm (such as bias) need to be understood in the sociotechnical context of an algorithmic system [1,47,65,67].”
From A Framework for Assurance Audits of Algorithmic Systems (2024) · cites this paper as [1]
Citations
Cites
Accountable Artificial Intelligence: Holding Algorithms to Account
Busuioc, M. (2021) · Public Administration Review · doi:10.1111/puar.13293 · Cited by 652
Privacy and Manipulation in the Digital Age
Zarsky, T. Z. (2019) · Theoretical Inquiries in Law · doi:10.1515/til-2019-0006 · Cited by 94
The American Civil Rights Tradition: Anticlassification or Antisubordination
Balkin, J. M., & Siegel, R. B. (2003) · Issues in Legal Scholarship · doi:10.2202/1539-8323.1039 · Cited by 71
Rulemaking and Inscrutable Automated Decision Tools
Strandburg, K. J. (2019) · bepress Legal Repository · Cited by 19
Research works printed but not linked: 43
- Cathy O'neil See Generally, 2016, HOW BIG DATA INCREASES INEQUALITY AND THREATENS DEMOCRACY
- Patricia G Barnes, 2017, Behind the Scenes, Discrimination by Job Search Engines
- Ifeoma Ajunwa, Platforms at Work: Data Intermediaries in the Organization of the Workplace, WORK AND LABOR IN THE DIGITAL AGE (2019) (discussing the encountered difficulty of completing an online application when applying with constrained hours of availability)
- 2000, Title VII of the Civil Rights Act of 1964 guarantees equal opportunity in employment irrespective of race, gender, and other protected characteristics
- See Sandra, Bias In, Bias Out, 128 YALE L.J. 2218, 2224 (2019) (arguing that the problem of disparate impact in predictive risk algorithms lies not in the algorithmic system but in the nature of prediction itself)
- Sonia Katyal, 2019, Private Accountability in the Age of Artificial Intelligence, 66 UCLA L. REV, 54
- Andrew Tutt, 2017, This new family of algorithms hold enormous promise, but also poses new and unusual dangers, L. REV, 83
- & Ajunwa, 2017, supra note 2; see also Pauline Kim, Data-Driven Discrimination at Work, 58 WM, & MARY L. REV, 857
- See Ifeoma Ajunwa, 2020, The Paradox of Automation as Anti-Bias Intervention
- See Ryan Calo, 2014, Digital Market Manipulation, 82 GEO. WASH. L. REV. 995, 996
- Julie E Cohen, 2017, Law for the Platform Economy, 51 U.C. DAVIS L. REV, 133
- Daniel Susser, 2019, Online Manipulation: Hidden Influences in a Digital World, 4 GEO. L. TECH. REV. 1, 2
- Pauline Kim, 2020, Manipulating Opportunity, 106 VA, L. REV, 867
- Talview: An AI-enabled video interviewing technology used by many Fortune 500 companies and clients across more than 102 countries. 110 Popular clients include Amazon, Cognizantt, Whirlpool, and Sephora, among others
- I also shared this survey in my written testimony to Congress. See The Future of Work: Protecting Workers' Rights in the Digital Age
- Janine Woodworth, 2014, The Voice of the Candidate, HIREVUE, 7
- Dandan Chen, 2018, The Growing Role of Technology in Talent Acquisition 4
- Monika, 2019, Recruiting Software -All You Need to Know, HARVER
- Josh Bersin, 2018, AI Comes to Recruiting: Will Interviews Go the Way of the Dinosaur?, JOSH BERSIN
- Top 40+ Pre-Employment Assessment Tools, ACADEMY TO INVIGORATE HR (AIHR)
- 2020, DIGITAL
- THE INST. OF INTERNAL AUDITORS, supra note 286
- Matthew Bender, 2018, 4, 5
- 2011, Federal banking regulators suggest that the internal audit function be conducted according to professional standards. See Michael E. Murphy, Assuring Responsible Risk Management in Banking: The Corporate Governance Dimension, 36 DEL, J. CORP. L, 121, 136
- See Ifeoma Ajunwa, 2014, Genetic Testing Meets Big Data: Torts and Contract Law Issues, 75 OHIO ST, L.J
- Id, 2001, 137 (citing BASEL COMM. ON BANKING SUPERVISION, INTERNAL AUDIT IN BANKS AND THE SUPERVISOR, 3
- Id, 1998, 138 (citing BASEL COMM. ON BANKING SUPERVISION, FRAMEWORK FOR INTERNAL CONTROL SYSTEMS IN BANKING ORGANISATIONS, 20
- 2017, Other scholars have detailed a revolving door of SEC employees to and from the financial sector and how it has contributed to regulatory capture of the SEC. See, e.g., Stewart L. Brown, Mutual Funds and the Regulatory Capture of the SEC, 19 U, PA. J. BUS. L, 701
- See Patrick Radden Keefe, 2017, The Family That Built an Empire of Pain, NEW YORKER
- 2019, Consider that the Trump administration attempted to suspend a pay data collection rule that had been promulgated by the Obama administration to combat the gender pay gap through encouraging transparency in pay. See Alexia Fern�ndez Campbell, Trump Tried to Sabotage a Plan to Close the Gender Pay Gap. A Judge Wouldn't Have It, 10
- Pres Daily Comp, 2014, ); see also Press Release, The White House, Sec'y, Fact Sheet: New Steps to Advance Equal Pay on the Seventh Anniversary of the Lilly Ledbetter Fair Pay Act
- See Memorandum on Advancing Pay Equality
- See Press Release, The White House, supra note 334
- See Ruchir Puri, 2018, It's Time to Start Breaking Open the Black Box of AI
- See Mark Maccarthy, 2018, Standards of Fairness for Disparate Impact Assessment of Big Data Algorithms, 48 CUMB, L. REV, 67, 77
- 2004, Equality Talk: Antisubordination and Anticlassification Values in Constitutional Struggles over Brown
- 2012, Proponents of statistical parity argue that it is more desirable because it "equalizes outcomes across protected and non-protected groups, INNOVATIONS IN THEORETICAL COMPUT. SCI. CONF, 214
- See Maccarthy, See id. at 71. Stick to "Orthodox" Sections Name your sections "Work Experience" and "Education" instead of "Career Achievements" or "Training," because AHPs are trained to search for specific information under
- 2017, See How to Beat Automated Resume Screening, WORKOPOLIS
- See Regina Borsellino, Beat the Robots: How to Get Your Resume Past the System & Into Human Hands
- See Peter Cappelli, 2012, Beat the Machines
- See Pamela Skillings, 2015, How to Get the Applicant Tracking System to Pick Your Resume, BIG INTERVIEW
- See Melanie Pinola, 2013, Format Your Resume So It Gets Past Applicant Screening Software, LIFEHACKER
Cited by
Inherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
The Silicon Ceiling: Auditing GPT’s Race and Gender Biases in Hiring
Armstrong, L., Liu, A., MacNeil, S., & Metaxa, D. (2024) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3689904.3694699 · Cited by 117
“Taken in conjunction with the results of our Resume Generation task, and with prior work on bias in LLMs which has shown that they learn biases that mirror humans’ implicit biases [19], exhibit racial and gender bias [1, 32, 50], have occupational biases [49], and make up rationalizations for bias…”
A Framework for Assurance Audits of Algorithmic Systems
Lam, K., Lange, B., Blili-Hamelin, B., Davidovic, J., Brown, S., & Hasan, A. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658957 · Cited by 75
“3 3 See [28, p. 294–296] for key questions that the audit regime has to answer.”
Ajunwa, I. (2020) · Big Data & Society · doi:10.1177/2053951720938093 · Cited by 72
Self-citationMitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603203 · Cited by 65
Metadata
- Authors
- Ajunwa, I.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Ajunwa, Ifeoma
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2019
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W2980845022
- Semantic Scholar
- 3402fb546f0dddadbd5c5fd087bda0dd1ac88933
- Cited by
- 43
- References
- 4
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 6 · 2023: 23 · 2022: 4 · 2020: 2
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Discrimination and Equality Law
- Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
- Keywords
- automated hiring, algorithmic discrimination, employment discrimination, indirect discrimination, Title VII, algorithmic auditing, intellectual property law, collective bargaining, automated decision-making, civil rights enforcement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automated Employment Discrimination. https://app.cochat.ai/papers/10.2139/ssrn.3437631
- The paper
- Ajunwa, I. (2019). Automated Employment Discrimination. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3437631
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.