Automated Employment Discrimination
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Even as laws have been enacted to grant equal opportunity to job applicants, new socio-technical developments have ushered in novel mechanisms for discrimination. The high bar of proof to demonstrate a disparate impact cause of action under Title VII of the Civil Rights Act, coupled with the “black box” nature of many automated hiring systems, renders the detection and redress of bias in such algorithmic systems difficult. This Article, with contributions at the intersection of administrative law, employment & labor law, and law & technology, makes the central claim that the automation of hiring both facilitates and obfuscates employment discrimination. That phenomenon and the deployment of intellectual property law as a shield against the scrutiny of automated systems combine to form an insurmountable obstacle for disparate impact claimants. The first contribution of this Article then is an eye-opening, in-depth examination of how bias is introduced, replicated, and also hidden by automated hiring systems. The second contribution is a hybrid approach to remedies that moves beyond the litigation-based paradigm in employment law to include redress mechanisms from administrative and labor law. To ensure against the identified “bias in, bias out” phenomenon associated with automated decision-making, I argue that the goal of equal opportunity in employment creates an “auditing imperative” for algorithmic hiring systems. This auditing imperative mandates both internal and external audits of automated hiring systems, as well as record-keeping initiatives for job applications. Such audit requirements have precedent in other areas of law, as they are not dissimilar to the Occupational Safety and Health Administration (OSHA) audits in labor law or the Sarbanes-Oxley Act audit requirements in securities law. Conjointly, I propose that employers that subject their automated hiring platforms to external audits could receive a certification mark, “the Fair Automated Hiring Mark,” which would serve to positively distinguish them in the labor market. I also discuss how labor law mechanisms such as collective bargaining could be an effective approach to combating the bias in automated hiring by establishing criteria for the data deployed in automated employment decision-making and creating standards for the protection and portability of said data. The Article concludes by noting that automated hiring, which captures a vast array of applicant data, merits greater legal oversight given the potential for “algorithmic blackballing,” a phenomenon that could continue to thwart an applicant’s future job bids.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Scholarship has highlighted that technical measures of risks of harm (such as bias) need to be understood in the sociotechnical context of an algorithmic system [1,47,65,67].”
From A Framework for Assurance Audits of Algorithmic Systems (2024) · cites this paper as [1]
Citations
Cites
Accountable Artificial Intelligence: Holding Algorithms to Account
Busuioc, M. (2021) · Public Administration Review · doi:10.1111/puar.13293 · Cited by 652
Privacy and Manipulation in the Digital Age
Zarsky, T. Z. (2019) · Theoretical Inquiries in Law · doi:10.1515/til-2019-0006 · Cited by 94
The American Civil Rights Tradition: Anticlassification or Antisubordination
Balkin, J. M., & Siegel, R. B. (2003) · Issues in Legal Scholarship · doi:10.2202/1539-8323.1039 · Cited by 71
Rulemaking and Inscrutable Automated Decision Tools
Strandburg, K. J. (2019) · bepress Legal Repository · Cited by 19
Research works printed but not linked: 43
- Cathy O'neil See Generally, 2016, HOW BIG DATA INCREASES INEQUALITY AND THREATENS DEMOCRACY
- Patricia G Barnes, 2017, Behind the Scenes, Discrimination by Job Search Engines
- Ifeoma Ajunwa, Platforms at Work: Data Intermediaries in the Organization of the Workplace, WORK AND LABOR IN THE DIGITAL AGE (2019) (discussing the encountered difficulty of completing an online application when applying with constrained hours of availability)
- 2000, Title VII of the Civil Rights Act of 1964 guarantees equal opportunity in employment irrespective of race, gender, and other protected characteristics
- See Sandra, Bias In, Bias Out, 128 YALE L.J. 2218, 2224 (2019) (arguing that the problem of disparate impact in predictive risk algorithms lies not in the algorithmic system but in the nature of prediction itself)
- Sonia Katyal, 2019, Private Accountability in the Age of Artificial Intelligence, 66 UCLA L. REV, 54
- Andrew Tutt, 2017, This new family of algorithms hold enormous promise, but also poses new and unusual dangers, L. REV, 83
- & Ajunwa, 2017, supra note 2; see also Pauline Kim, Data-Driven Discrimination at Work, 58 WM, & MARY L. REV, 857
- See Ifeoma Ajunwa, 2020, The Paradox of Automation as Anti-Bias Intervention
- See Ryan Calo, 2014, Digital Market Manipulation, 82 GEO. WASH. L. REV. 995, 996
- Julie E Cohen, 2017, Law for the Platform Economy, 51 U.C. DAVIS L. REV, 133
- Daniel Susser, 2019, Online Manipulation: Hidden Influences in a Digital World, 4 GEO. L. TECH. REV. 1, 2
- Pauline Kim, 2020, Manipulating Opportunity, 106 VA, L. REV, 867
- Talview: An AI-enabled video interviewing technology used by many Fortune 500 companies and clients across more than 102 countries. 110 Popular clients include Amazon, Cognizantt, Whirlpool, and Sephora, among others
- I also shared this survey in my written testimony to Congress. See The Future of Work: Protecting Workers' Rights in the Digital Age
- Janine Woodworth, 2014, The Voice of the Candidate, HIREVUE, 7
- Dandan Chen, 2018, The Growing Role of Technology in Talent Acquisition 4
- Monika, 2019, Recruiting Software -All You Need to Know, HARVER
- Josh Bersin, 2018, AI Comes to Recruiting: Will Interviews Go the Way of the Dinosaur?, JOSH BERSIN
- Top 40+ Pre-Employment Assessment Tools, ACADEMY TO INVIGORATE HR (AIHR)
- 2020, DIGITAL
- THE INST. OF INTERNAL AUDITORS, supra note 286
- Matthew Bender, 2018, 4, 5
- 2011, Federal banking regulators suggest that the internal audit function be conducted according to professional standards. See Michael E. Murphy, Assuring Responsible Risk Management in Banking: The Corporate Governance Dimension, 36 DEL, J. CORP. L, 121, 136
- See Ifeoma Ajunwa, 2014, Genetic Testing Meets Big Data: Torts and Contract Law Issues, 75 OHIO ST, L.J
- Id, 2001, 137 (citing BASEL COMM. ON BANKING SUPERVISION, INTERNAL AUDIT IN BANKS AND THE SUPERVISOR, 3
- Id, 1998, 138 (citing BASEL COMM. ON BANKING SUPERVISION, FRAMEWORK FOR INTERNAL CONTROL SYSTEMS IN BANKING ORGANISATIONS, 20
- 2017, Other scholars have detailed a revolving door of SEC employees to and from the financial sector and how it has contributed to regulatory capture of the SEC. See, e.g., Stewart L. Brown, Mutual Funds and the Regulatory Capture of the SEC, 19 U, PA. J. BUS. L, 701
- See Patrick Radden Keefe, 2017, The Family That Built an Empire of Pain, NEW YORKER
- 2019, Consider that the Trump administration attempted to suspend a pay data collection rule that had been promulgated by the Obama administration to combat the gender pay gap through encouraging transparency in pay. See Alexia Fern�ndez Campbell, Trump Tried to Sabotage a Plan to Close the Gender Pay Gap. A Judge Wouldn't Have It, 10
- Pres Daily Comp, 2014, ); see also Press Release, The White House, Sec'y, Fact Sheet: New Steps to Advance Equal Pay on the Seventh Anniversary of the Lilly Ledbetter Fair Pay Act
- See Memorandum on Advancing Pay Equality
- See Press Release, The White House, supra note 334
- See Ruchir Puri, 2018, It's Time to Start Breaking Open the Black Box of AI
- See Mark Maccarthy, 2018, Standards of Fairness for Disparate Impact Assessment of Big Data Algorithms, 48 CUMB, L. REV, 67, 77
- 2004, Equality Talk: Antisubordination and Anticlassification Values in Constitutional Struggles over Brown
- 2012, Proponents of statistical parity argue that it is more desirable because it "equalizes outcomes across protected and non-protected groups, INNOVATIONS IN THEORETICAL COMPUT. SCI. CONF, 214
- See Maccarthy, See id. at 71. Stick to "Orthodox" Sections Name your sections "Work Experience" and "Education" instead of "Career Achievements" or "Training," because AHPs are trained to search for specific information under
- 2017, See How to Beat Automated Resume Screening, WORKOPOLIS
- See Regina Borsellino, Beat the Robots: How to Get Your Resume Past the System & Into Human Hands
- See Peter Cappelli, 2012, Beat the Machines
- See Pamela Skillings, 2015, How to Get the Applicant Tracking System to Pick Your Resume, BIG INTERVIEW
- See Melanie Pinola, 2013, Format Your Resume So It Gets Past Applicant Screening Software, LIFEHACKER
Cited by
Inherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
The Silicon Ceiling: Auditing GPT’s Race and Gender Biases in Hiring
Armstrong, L., Liu, A., MacNeil, S., & Metaxa, D. (2024) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3689904.3694699 · Cited by 120
“Taken in conjunction with the results of our Resume Generation task, and with prior work on bias in LLMs which has shown that they learn biases that mirror humans’ implicit biases [19], exhibit racial and gender bias [1, 32, 50], have occupational biases [49], and make up rationalizations for bias…”
A Framework for Assurance Audits of Algorithmic Systems
Lam, K., Lange, B., Blili-Hamelin, B., Davidovic, J., Brown, S., & Hasan, A. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658957 · Cited by 75
“3 3 See [28, p. 294–296] for key questions that the audit regime has to answer.”
Ajunwa, I. (2020) · Big Data & Society · doi:10.1177/2053951720938093 · Cited by 72
Self-citationMitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603203 · Cited by 65
Kassir, S., Baker, L. J., Dolphin, J., & Polli, F. E. (2022) · AI and Ethics · doi:10.1007/s43681-022-00208-x · Cited by 81
An external stability audit framework to test the validity of personality prediction in AI hiring
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., Khan, F. A., & Stoyanovich, J. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00861-0 · Cited by 57
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603207 · Cited by 45
Organizing in the End of Employment: Information Sharing, Data Stewardship, and Digital Workerism
Calacci, D. (2022) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3533406.3533424 · Cited by 54
“This can be seen in the translation of increased worker surveillance in the hiring process into automated hiring tools with clear civil rights implications [3, 16].”
Hiring Fairly in the Age of AlgorithmsPreprint
Langenkamp, M., Costa, A., & Cheung, C. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3723046 · Cited by 52
Algorithmic Pluralism: A Structural Approach To Equal Opportunity
Jain, S., Suriyakumar, V., Creel, K. A., & Wilson, A. (2023) · Conference on Fairness, Accountability and Transparency · doi:10.1145/3630106.3658899 · Cited by 40
“…individuals or groups of people are on the losing side of a large number of social allocations – a phenomenon which Ifeoma Ajunwa calls “(algorithmic) blackballing” [1], Kath-leen Creel and Deborah Hellman call “systemic exclusion” [14], and Rishi Bommasani et al. call “outcome homogenization” [7].”
Mihaljević, H., Müller, I., Dill, K., Yollu-Tok, A., & von Grafenstein, M. (2023) · AI & Society · doi:10.1007/s00146-023-01726-w · Cited by 31
“Nonetheless, socio-political and legal discourse is increasingly engaging with the topic (Ajunwa 2019; Orwat 2019).”
U.S. Job-Seekers' Organizational Justice Perceptions of Emotion AI-Enabled Interviews
Pyle, C., Roemmich, K., & Andalibi, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686993 · Cited by 32
“…employees and these employees are overwhelmingly cisgender men (owing to past biases in recruitment and assessments), current training datasets are likely insufficient at encompassing a range of emotional expression across demographic differences [3, 4], as our participants also note.”
Introducing contextual transparency for automated decision systems
Sloane, M., Solano-Kamaiko, I. R., Yuan, J., Dasgupta, A., & Stoyanovich, J. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00623-7 · Cited by 28
“These professions increasingly use ADS for various business practices, ranging from out-reach to screening and assessment, and onboarding 39,40 .”
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., & Stoyanovich, J. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534189 · Cited by 26
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 22
The Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 20
Pitfalls in Machine Learning Research: Reexamining the Development CyclePreprint
Biderman, S., & Scheirer, W. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02832 · Cited by 26
“In all of these cases, the claimed functionality is not what it appears to be due to underlying problems in experimental design, data use, and evaluation [14, 3, 4].”
A Framework for Assurance Audits of Algorithmic Systems
Lange, B., Lam, K., Blili-Hamelin, B., Davidovic, J., Brown, S., & Hasan, A. (2024) · PhilPapers (PhilPapers Foundation) · Cited by 17
Hacia una gobernanza algorítmica transparente: auditoría de sesgo. Estudio de caso.
Gracia, J. L. B. (2025) · Cuadernos de Gobierno y Administración Pública · doi:10.5209/cgap.97604 · Cited by 16
Discriminación algorítmica en los procesos automatizados de reclutamiento y selección de personal
Manus, A. C. M., & Parga, R. P. (2024) · Revista Chilena de Derecho y Tecnología · doi:10.5354/0719-2584.2024.71312 · Cited by 14
“De acuerdo con el ranking Fortune 500, que evalúa a las quinientas empresas más grandes de Estados Unidos, un 90 % de ellas utiliza procesos automatizados de reclutamiento y selección de personal (Ajunwa, 2021).”
Navigating Automated Hiring: Perceptions, Strategy Use, and Outcomes Among Young Job Seekers
Armstrong, L., & Metaxa, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711038 · Cited by 17
Social context of the issue of discriminatory algorithmic decision-making systems
Varona, D., & Suarez, J. L. (2023) · AI & Society · doi:10.1007/s00146-023-01741-x · Cited by 11
“Some transatlantic studies like those of The Economic Commission for Latin America and the Caribbean (ECLAC) (2021) and the Department of Economic and Social Affairs (2013, Engerman et al. 2002) identify that the Hispanic population within the studied societies are among their least favored sectors, whose inequalities…”
The Societal Impacts of Algorithmic Decision-Making
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195 · Cited by 11
Johnson, D. K. N. (2025) · The Review of Black Political Economy · doi:10.1177/00346446251331615 · Cited by 3
“The racial problems in AI-powered employment topics are widespread (Ajunwa, 2021; Dastin, 2018; Kahn, 2021; Kammerer, 2021), showing strong bias: penalties for applicant resumes that mention activities historically associated with particular groups; analysis of applicant photos for facial…”
Towards A Global AI Auditing Framework: Assessment and Recommendations
(IPIE), I. P. O. T. I. E., Faveri, B., Johnson-León, M., Sylvester, P., Chun, W. H. K., Hannák, A., Mendoza, M., Broussard, M., Сергеевич, Е. Р., Nelson, A., et al. (2025) · doi:10.61452/zwed1485 · Cited by 6
The Constant Boss: Labor Under Digital Surveillance
Nguyen, A. (2021) · doi:10.69985/rguj5984 · Cited by 3
Practical Perspectives on Fairness In Technology-Aided Personnel Selection
Müller, I., Dill, K., & Mihaljević, H. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757647 · Cited by 6
Algorithmic Monoculture and Social Welfare
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603211 · Cited by 2
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603198 · Cited by 2
Global Approaches to Auditing Artificial Intelligence: A Literature Review
(IPIE), I. P. O. T. I. E., Sylvester, P., Chun, W. H. K., Hannák, A., Mendoza, M., Broussard, M., Сергеевич, Е. Р., Nelson, A., Sandvig, C., Sesan, G., et al. (2024) · doi:10.61452/bwym7397 · Cited by 7
Miziara, R. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.2.2024.tde-09052024-122554 · Cited by 12
Race, Labor, and the Future of Work
Ajunwa, I. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190947385.013.25 · Cited by 1
Self-citationInherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603206 · Cited by 3
New Accelerants of Inequality Regimes: AI‐Hiring Tools and Algorithmic Bias
Yarrow, E. (2026) · Gender Work and Organization · doi:10.1111/gwao.70232 · Cited by 2
The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasons
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603204 · Cited by 1
Mitigating Bias in Algorithmic Decision-making: Evaluating Claims and Practices
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603212 · Cited by 1
Algorithmic monoculture and social welfare
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603202
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603213
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603205
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603196
How Do Classifiers Induce Agents to Behave Strategically?
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603201
How Do Classifiers Induce Agents to Behave Strategically?
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603210
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603214
Sá, P., & Rodrigues, R. (2025) · Journal of Cultural Analysis and Social Change · doi:10.64753/jcasc.v10i3.2828
“Interface simplicity, clear instructions, and seamless integration with existing systems are all factors that increase user acceptance (Ajunwa, 2025).”
InfluentialThe Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603199
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603200
Artificial Intelligence as Taskmaster and Guru: Using Bossware To Curb Cyberslacking
Oravec, J. A. (2026) · Human Arenas · doi:10.1007/s42087-026-00558-6
“However comic or satisfying these efforts may be for indi - vidual employees (perhaps a form of cyberslacking in themselves), their overall impact may be less profound, since at some level “efforts to cheat or beat the system merely represent the acquiescence of humans” (Ajunwa, 2019 , p. 641).”
Jenca, A., Lee, A., & Hantula, D. A. (2026) · Journal of Organizational Behavior Management · doi:10.1080/01608061.2026.2751649
Metadata
- Authors
- Ajunwa, I.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Ajunwa, Ifeoma
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2019
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W2980845022
- Semantic Scholar
- 3402fb546f0dddadbd5c5fd087bda0dd1ac88933
- Cited by
- 43
- References
- 4
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 6 · 2023: 23 · 2022: 4 · 2020: 2
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Discrimination and Equality Law
- Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
- Keywords
- automated hiring, algorithmic discrimination, employment discrimination, indirect discrimination, Title VII, algorithmic auditing, intellectual property law, collective bargaining, automated decision-making, civil rights enforcement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.