CoChat

Automated Employment Discrimination

Open access
Ajunwa, Ifeoma · 2019 · SSRN Electronic Journal

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Even as laws have been enacted to grant equal opportunity to job applicants, new socio-technical developments have ushered in novel mechanisms for discrimination. The high bar of proof to demonstrate a disparate impact cause of action under Title VII of the Civil Rights Act, coupled with the “black box” nature of many automated hiring systems, renders the detection and redress of bias in such algorithmic systems difficult. This Article, with contributions at the intersection of administrative law, employment & labor law, and law & technology, makes the central claim that the automation of hiring both facilitates and obfuscates employment discrimination. That phenomenon and the deployment of intellectual property law as a shield against the scrutiny of automated systems combine to form an insurmountable obstacle for disparate impact claimants. The first contribution of this Article then is an eye-opening, in-depth examination of how bias is introduced, replicated, and also hidden by automated hiring systems. The second contribution is a hybrid approach to remedies that moves beyond the litigation-based paradigm in employment law to include redress mechanisms from administrative and labor law. To ensure against the identified “bias in, bias out” phenomenon associated with automated decision-making, I argue that the goal of equal opportunity in employment creates an “auditing imperative” for algorithmic hiring systems. This auditing imperative mandates both internal and external audits of automated hiring systems, as well as record-keeping initiatives for job applications. Such audit requirements have precedent in other areas of law, as they are not dissimilar to the Occupational Safety and Health Administration (OSHA) audits in labor law or the Sarbanes-Oxley Act audit requirements in securities law. Conjointly, I propose that employers that subject their automated hiring platforms to external audits could receive a certification mark, “the Fair Automated Hiring Mark,” which would serve to positively distinguish them in the labor market. I also discuss how labor law mechanisms such as collective bargaining could be an effective approach to combating the bias in automated hiring by establishing criteria for the data deployed in automated employment decision-making and creating standards for the protection and portability of said data. The Article concludes by noting that automated hiring, which captures a vast array of applicant data, merits greater legal oversight given the potential for “algorithmic blackballing,” a phenomenon that could continue to thwart an applicant’s future job bids.

Overview

Integrity signals

Registry

Crossref · 10.2139/ssrn.3437631

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 4 references

Research works printed but not linked: 43

  1. Cathy O'neil See Generally, 2016, HOW BIG DATA INCREASES INEQUALITY AND THREATENS DEMOCRACY
  2. Patricia G Barnes, 2017, Behind the Scenes, Discrimination by Job Search Engines
  3. Ifeoma Ajunwa, Platforms at Work: Data Intermediaries in the Organization of the Workplace, WORK AND LABOR IN THE DIGITAL AGE (2019) (discussing the encountered difficulty of completing an online application when applying with constrained hours of availability)
  4. 2000, Title VII of the Civil Rights Act of 1964 guarantees equal opportunity in employment irrespective of race, gender, and other protected characteristics
  5. See Sandra, Bias In, Bias Out, 128 YALE L.J. 2218, 2224 (2019) (arguing that the problem of disparate impact in predictive risk algorithms lies not in the algorithmic system but in the nature of prediction itself)
  6. Sonia Katyal, 2019, Private Accountability in the Age of Artificial Intelligence, 66 UCLA L. REV, 54
  7. Andrew Tutt, 2017, This new family of algorithms hold enormous promise, but also poses new and unusual dangers, L. REV, 83
  8. & Ajunwa, 2017, supra note 2; see also Pauline Kim, Data-Driven Discrimination at Work, 58 WM, & MARY L. REV, 857
  9. See Ifeoma Ajunwa, 2020, The Paradox of Automation as Anti-Bias Intervention
  10. See Ryan Calo, 2014, Digital Market Manipulation, 82 GEO. WASH. L. REV. 995, 996
  11. Julie E Cohen, 2017, Law for the Platform Economy, 51 U.C. DAVIS L. REV, 133
  12. Daniel Susser, 2019, Online Manipulation: Hidden Influences in a Digital World, 4 GEO. L. TECH. REV. 1, 2
  13. Pauline Kim, 2020, Manipulating Opportunity, 106 VA, L. REV, 867
  14. Talview: An AI-enabled video interviewing technology used by many Fortune 500 companies and clients across more than 102 countries. 110 Popular clients include Amazon, Cognizantt, Whirlpool, and Sephora, among others
  15. I also shared this survey in my written testimony to Congress. See The Future of Work: Protecting Workers' Rights in the Digital Age
  16. Janine Woodworth, 2014, The Voice of the Candidate, HIREVUE, 7
  17. Dandan Chen, 2018, The Growing Role of Technology in Talent Acquisition 4
  18. Monika, 2019, Recruiting Software -All You Need to Know, HARVER
  19. Josh Bersin, 2018, AI Comes to Recruiting: Will Interviews Go the Way of the Dinosaur?, JOSH BERSIN
  20. Top 40+ Pre-Employment Assessment Tools, ACADEMY TO INVIGORATE HR (AIHR)
  21. 2020, DIGITAL
  22. THE INST. OF INTERNAL AUDITORS, supra note 286
  23. Matthew Bender, 2018, 4, 5
  24. 2011, Federal banking regulators suggest that the internal audit function be conducted according to professional standards. See Michael E. Murphy, Assuring Responsible Risk Management in Banking: The Corporate Governance Dimension, 36 DEL, J. CORP. L, 121, 136
  25. See Ifeoma Ajunwa, 2014, Genetic Testing Meets Big Data: Torts and Contract Law Issues, 75 OHIO ST, L.J
  26. Id, 2001, 137 (citing BASEL COMM. ON BANKING SUPERVISION, INTERNAL AUDIT IN BANKS AND THE SUPERVISOR, 3
  27. Id, 1998, 138 (citing BASEL COMM. ON BANKING SUPERVISION, FRAMEWORK FOR INTERNAL CONTROL SYSTEMS IN BANKING ORGANISATIONS, 20
  28. 2017, Other scholars have detailed a revolving door of SEC employees to and from the financial sector and how it has contributed to regulatory capture of the SEC. See, e.g., Stewart L. Brown, Mutual Funds and the Regulatory Capture of the SEC, 19 U, PA. J. BUS. L, 701
  29. See Patrick Radden Keefe, 2017, The Family That Built an Empire of Pain, NEW YORKER
  30. 2019, Consider that the Trump administration attempted to suspend a pay data collection rule that had been promulgated by the Obama administration to combat the gender pay gap through encouraging transparency in pay. See Alexia Fern�ndez Campbell, Trump Tried to Sabotage a Plan to Close the Gender Pay Gap. A Judge Wouldn't Have It, 10
  31. Pres Daily Comp, 2014, ); see also Press Release, The White House, Sec'y, Fact Sheet: New Steps to Advance Equal Pay on the Seventh Anniversary of the Lilly Ledbetter Fair Pay Act
  32. See Memorandum on Advancing Pay Equality
  33. See Press Release, The White House, supra note 334
  34. See Ruchir Puri, 2018, It's Time to Start Breaking Open the Black Box of AI
  35. See Mark Maccarthy, 2018, Standards of Fairness for Disparate Impact Assessment of Big Data Algorithms, 48 CUMB, L. REV, 67, 77
  36. 2004, Equality Talk: Antisubordination and Anticlassification Values in Constitutional Struggles over Brown
  37. 2012, Proponents of statistical parity argue that it is more desirable because it "equalizes outcomes across protected and non-protected groups, INNOVATIONS IN THEORETICAL COMPUT. SCI. CONF, 214
  38. See Maccarthy, See id. at 71. Stick to "Orthodox" Sections Name your sections "Work Experience" and "Education" instead of "Career Achievements" or "Training," because AHPs are trained to search for specific information under
  39. 2017, See How to Beat Automated Resume Screening, WORKOPOLIS
  40. See Regina Borsellino, Beat the Robots: How to Get Your Resume Past the System & Into Human Hands
  41. See Peter Cappelli, 2012, Beat the Machines
  42. See Pamela Skillings, 2015, How to Get the Applicant Tracking System to Pick Your Resume, BIG INTERVIEW
  43. See Melanie Pinola, 2013, Format Your Resume So It Gets Past Applicant Screening Software, LIFEHACKER

Cited by

See all 49

Metadata

Authors
Ajunwa, I.
Affiliations
University of North Carolina at Chapel Hill (US)
Corresponding author
Ajunwa, Ifeoma
Venue
SSRN Electronic Journal
Publisher
Elsevier BV
Published
2019
ISSN
1556-5068 (ISSN-L)
OpenAlex
W2980845022
Cited by
43
References
4
Citations by year
2026: 3 · 2025: 5 · 2024: 6 · 2023: 23 · 2022: 4 · 2020: 2
Type
posted content
Language
en
Open access
Locations
SSRN Electronic Journal (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Discrimination and Equality Law
  • Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
Keywords
automated hiring, algorithmic discrimination, employment discrimination, indirect discrimination, Title VII, algorithmic auditing, intellectual property law, collective bargaining, automated decision-making, civil rights enforcement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.