Mitigating bias in algorithmic hiring: evaluating claims and practices
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments built, validated, and examined for bias? In this work, we document and analyze the claims and practices of companies offering algorithms for employment assessment. In particular, we identify vendors of algorithmic pre-employment assessments (i.e., algorithms to screen candidates), document what they have disclosed about their development and validation procedures, and evaluate their practices, focusing particularly on efforts to detect and mitigate bias. Our analysis considers both technical and legal perspectives. Technically, we consider the various choices vendors make regarding data collection and prediction targets, and explore the risks and trade-offs that these choices pose. We also discuss how algorithmic de-biasing techniques interface with, and create challenges for, antidiscrimination law.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Audits evaluate performance relative to expected behavior, as part of a broader accountability process [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“The author attributed these shortcomings in part to management pre-screening of information and interviews for auditors.”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“One systematic analysis of the monitoring methods employed by the company PricewaterhouseCoopers (PwC), for example, found that the resulting audits omitted several major violations and contained serious deficiencies [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“An analysis of PwC's auditing practices also found that the confidential nature of PwC's audits shielded them from verification by other researchers or NGOs and limited their ability to improve the conditions of the regulated entity [62].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [62]
In the citing paper
“Assessing the success of potential employees based on existing employees perpetuates a bias toward candidates who resemble those already employed (Raghavan et al., 2020).”
From Ethics and discrimination in artificial intelligence-enabled recruitment practices (2023) · cites this paper as Raghavan et al., 2020
14 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 3×
“. When is an assessment legally considered discriminatory? Based on existing precedent, the Uniform Guidelines provide two avenues to challenge an assessment: disparate treatment and disparate impact [6]. Disparate treatment is relatively straightforward|it is illegal to explicitly treat candidates dierently based on…”
BackgroundInfluentialSelf-citationNorman, W. T. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040291 · Cited by 2,485
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019) · Psychological Science in the Public Interest · doi:10.1177/1529100619832930 · Cited by 1,748
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Self-citationThe measurement of intelligence.
Terman, L. M. (1916) · doi:10.1037/10014-000 · Cited by 986
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1706255114 · Cited by 887 · cited 1×
“We know from decades of audit studies that employers tend to discriminate against women and ethnic minorities [12, 10, 9, 52], and a recent meta-analysis suggests that little has improved over the past 25 years [75].”
BackgroundDiscrimination-aware data mining
Pedreshi, D., Ruggieri, S., & Turini, F. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401959 · Cited by 676
Research works printed but not linked: 42
- Ajunwa Ifeoma, 2020, The Paradox of Automation as Anti-Bias Intervention. Cardozo Law Review 41
- Angwin Julia, 2016, ProPublica
- Ben-David Shai, 2010, A theory of learning from different domains. Machine learning 79, 1-2
- Bent Jason R, 2020, Is Algorithmic Affirmative Action Legal? Georgetown Law Journal 108
- Bertrand Marianne, 2004, Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. American economic review 94, 4
- Bornstein Stephanie, 2018, Antidiscriminatory Algorithms. Ala, L. Rev., 70, 519
- Buolamwini Joy, 2018, Conference on Fairness, Accountability and Transparency. 77--91
- Cappelli Peter, 2018, Artificial Intelligence in Human Resources Management: Challenges and a Path Forward. Available at SSRN 3263878
- Chamorro-Prezumic Tomas, 2019, Should Companies Use AI to Assess Job Candidates? Harvard Business Review
- Cohn Richard M, 1979, On the Use of Statistics in Employment Discrimination, Cases. Ind. LJ, 55, 493
- Cohn Richard M, 1979, Statistical Laws and the Use of Statistics in Law: A Rejoinder to Professor, Shoben. Ind. LJ, 55, 537
- National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press. National Research Council et al. 1989. Fairness in employment testing: Validity generalization minority issues and the General Aptitude Test Battery. National Academies Press.
- National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press. National Research Council et al. 2013. New directions in assessing performance potential of individuals and groups: Workshop summary. National Academies Press.
- Cowgill Bo, 2018, Bias and Productivity in Humans and Algorithms: Theory and Evidence from Resume Screening. Columbia Business School
- Dunnette Marvin D, 1979, Personnel selection and classification systems. Annual review of psychology 30, 1
- Edwards Harrison, 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2--4, 2016, Conference Track Proceedings.
- Society for Industrial, Organizational Psychology (US), and American Psychological Association., 2018, Division of Industrial-Organizational Psychology
- Friedman Jerome, The elements of statistical learning
- Gerhardt PW, 1916, Scientific selection of employees. Electric Railway Journal 47
- Grimmett Jeff, 2017, Veterinary Practitioners - personal characteristics and professional longevity. VetScript
- Guo Anhong, 2019, Hannah Wallach, and Meredith Ringel Morris.
- Hellman Deborah, 2019, Measuring Algorithmic Fairness. Virginia Public Law and Legal Theory Research Paper 2019-39
- Houser Kimberly, 2019, Can AI solve the diversity problem in the tech industry? Mitigating noise and bias in employment decision-making. Stanford Technology Law Review 22
- Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016). Amy E. Hurley-Hanson and Cristina M. Giannantonio (Eds.). 2016. Journal of Business Management. 22 1 (2016).
- Kemble William F, 1916, Testing the fitness of your employees. Industrial Management
- Kim Pauline T, 2020, Virginia Law Review 106
- Kroll Joshua A, 2016, Accountable algorithms, U. Pa. L. Rev., 165, 633
- Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135. Zachary Lipton Julian McAuley and Alexandra Chouldechova. 2018. Does mitigating ML's impact disparity require treatment disparity?. In Advances in Neural Information Processing Systems. 8125--8135.
- Neumark David, 1996, Sex discrimination in restaurant hiring: An audit study. The Quarterly journal of economics 111, 3
- Puri Ruchir, 2018, Mitigating Bias in AI Models. IBM Research Blog
- Rhue Lauren, 2018, Racial Influence on Automated Perceptions of Emotions. Available at SSRN 3281765
- Riach Peter A, 2002, Field experiments of discrimination in the market place. The economic journal 112, 483
- Roach John, 2018, Microsoft improves facial recognition technology to perform well across all skin tones, genders. The AI Blog
- Rodriguez Michael C, 2006, Meta-analysis of coefficient alpha. Psychological methods 11, 3
- Ruda Edward, 1968, Racial differences on selection instruments related to subsequent job performance. Personnel Psychology
- Sanchez-Monedero Javier, 2020, Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM.
- Shoben Elaine W, 1978, Differential pass-fail rates in employment testing: Statistical proof under Title VII. Harvard Law Review
- Shoben Elaine W, 1979, In defense of disparate impact analysis under Title VII: A reply to Dr, Cohn. Ind. LJ, 55, 515
- Young John W, 2001, Differential Prediction, and College Admission Testing: A Comprehensive Review and Analysis. Research Report No. 2001-6
- Zafar Muhammad Bilal, Fairness Constraints: Mechanisms for Fair Classification. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 54
- Zemel Rich, 2013, International Conference on Machine Learning. 325--333
- 10.5555/2887007.2887201 · doi:10.5555/2887007.2887201
Cited by
Items 101–200 of 1,028
Algorithmic fairness of machine learning models for Alzheimer disease progression
Yuan, C., Linn, K. A., & Hubbard, R. A. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.42203 · Cited by 49
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603207 · Cited by 45
Self-citationOn the Moral Justification of Statistical Parity
Hertweck, C., Heitz, C., & Loi, M. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445936 · Cited by 46
Mastering digital transformation in workforce management
Akter, S., Biswas, K., Vrontis, D., Cooper, C. L., & Tarba, S. Y. (2023) · Production Planning & Control · doi:10.1080/09537287.2023.2270465 · Cited by 76
Pitfalls of Machine Learning-Based Personnel Selection: Fairness, Transparency, and Data Quality
Goretzko, D., & Israel, L. (2021) · Journal of Personnel Psychology · doi:10.1027/1866-5888/a000287 · Cited by 66
Ehsan, U., Singh, R., Metcalf, J., & Riedl, M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533186 · Cited by 40
Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumvention
Whitney, C. D., & Norman, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659002 · Cited by 90
Mitigating Biases in Multimodal Personality Assessment
Yan, S., Huang, D., & Soleymani, M. (2020) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3382507.3418889 · Cited by 77
OK computer: Worker perceptions of algorithmic recruitment
Fumagalli, E., Rezaei, S., & Salomons, A. (2022) · Research Policy · doi:10.1016/j.respol.2021.104420 · Cited by 46
FairNeuron: improving deep neural network fairness with adversary games on selective neurons
Gao, X., Zhai, J., Ma, S., Shen, C. Q., Chen, Y., & Wang, Q. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510087 · Cited by 73
Null Compliance: NYC Local Law 144 and the challenges of algorithm accountability
Wright, L., Muenster, R. M., Vecchione, B., Qu, T., Cai, P. (., Smith, A., Comm 2450 Student Investigators, Metcalf, J., & Matias, J. N. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658998 · Cited by 43
“Algorithmic employment tools are notoriously unreliable and ill-defined, imposing significant harm on workers [46, 53, 54].”
BackgroundNull Compliance: NYC Local Law 144 and the Challenges of Algorithm Accountability
Wright, L., Muenster, R. M., Vecchione, B., Qu, T., Pika, Cai, Investigators, C. 2. S., Metcalf, J., & Matias, J. N. (2024) · arXiv · doi:10.48550/arxiv.2406.01399 · Cited by 43
Saha, K., Grover, T., Mattingly, S. M., swain, V. D., Gupta, P., Martinez, G. J., Robles-Granda, P., Mark, G., Striegel, A., & De Choudhury, M. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3448117 · Cited by 43
Chakraborty, I., Chiong, K. X., Dover, H. F., & Sudhir, K. (2024) · Marketing Science · doi:10.1287/mksc.2023.0149 · Cited by 61
Zimmermann, A., & Lee‐Stronach, C. (2021) · Canadian Journal of Philosophy · doi:10.1017/can.2021.17 · Cited by 54
Towards a multi-stakeholder value-based assessment framework for algorithmic systems
Yurrita, M., Murray-Rust, D., Balayn, A., & Bozzon, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533118 · Cited by 39
Justice, trust, and moral judgements when personnel selection is supported by algorithms
Feldkamp, T., Langer, M., Wies, L., & König, C. J. (2023) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2023.2169140 · Cited by 60
Ethical Considerations in AI Development
Singh, B. P., & Joshi, A. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-2964-1.ch010 · Cited by 47
Hou, T.-Y., Tseng, Y.-C., & Yuan, C. W. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102775 · Cited by 60
Chhibber, S., Rajkumar, S. R., & Dassanayake, S. (2025) · Blockchain Artificial Intelligence and Future Research · doi:10.70211/bafr.v1i1.178 · Cited by 54
Balayn, A., Yurrita, M., Yang, J., & Gadiraju, U. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604674 · Cited by 64
An external stability audit framework to test the validity of personality prediction in AI hiring
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., Khan, F. A., & Stoyanovich, J. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00861-0 · Cited by 57
Nee, J., Smith, G. M., Sheares, A. M., & Rustagi, I. (2022) · Big Data & Society · doi:10.1177/20539517221090930 · Cited by 50
Alabdali, M. A., Khan, S. A., Yaqub, M. Z., & Alshahrani, M. D. (2024) · Sustainability · doi:10.3390/su16114854 · Cited by 49
Ghasemaghaei, M., & Kordzadeh, N. (2024) · Information Systems Journal · doi:10.1111/isj.12572 · Cited by 46
Identifying Prediction Mistakes in Observational Data
Rambachan, A. (2024) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae013 · Cited by 57
Ethical AI in Information Technology: Navigating Bias, Privacy, Transparency, and Accountability
National Technical University of Athens, G., & Sargiotis, D. (2024) · Advances in Machine Learning & Artificial Intelligence · doi:10.33140/amlai.05.03.03 · Cited by 34
Intelligent career planning via stochastic subsampling reinforcement learning
Guo, P., Xiao, K., Ye, Z., Zhu, H., & Zhu, W. (2022) · Scientific Reports · doi:10.1038/s41598-022-11872-8 · Cited by 44
Sadeghi, S., & Niu, C. (2024) · Leadership and Policy in Schools · doi:10.1080/15700763.2024.2358303 · Cited by 44
Fairness and Risk: An Ethical Argument for a Group Fairness Definition Insurers Can Use
Baumann, J., & Loi, M. (2023) · Philosophy & Technology · doi:10.1007/s13347-023-00624-9 · Cited by 46
Ray, S., & Ray, D. P. (2024) · International Journal of Research -GRANTHAALAYAH · doi:10.29121/granthaalayah.v11.i12.2023.5464 · Cited by 40
Incorporating artificial intelligence (AI) into recruitment processes: ethical considerations
Sýkorová, Z., Hague, D., Dvouletý, O., & Procházka, D. A. (2024) · Vilakshan – XIMB Journal of Management · doi:10.1108/xjm-02-2024-0039 · Cited by 51
Understanding Potential Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. V. (2021) · doi:10.21428/2c646de5.c16a07bb · Cited by 44
Using Artificial Intelligence in the workplace: What are the main ethical risks?
Pero, A. S. D., Wyckoff, P., & Vourc'h, A. (2022) · OECD social employment and migration working papers · doi:10.1787/840a2d9f-en · Cited by 62
Lewicki, K., Lee, M. S. A., Cobbe, J., & Singh, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581463 · Cited by 30
Explainable natural language processing for corporate sustainability analysis
Ong, K., Mao, R., Satapathy, R., Filho, R. S., Cambria, E., Sulaeman, J., & Mengaldo, G. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102726 · Cited by 56
The Effects of AI on the Working Lives of Women
OECD, & Bank, I.-A. D. (2022) · OECD eBooks · doi:10.1787/14e9b92c-en · Cited by 40
Novozhilova, E., Mays, K. K., & Katz, J. E. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-02625-1 · Cited by 45
Awumey, E., Das, S., & Forlizzi, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658945 · Cited by 46
Kumar, D., Grosz, T., Rekabsaz, N., Greif, E., & Schedl, M. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1245198 · Cited by 48
The Ethics of AI in Human Resources
Dennis, M., & Aizenberg, E. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09653-y · Cited by 37
Standardization: Research Trends, Current Debates, and Interdisciplinarity
Grillo, F., Wiegmann, P. M., de Vries, H. J., Bekkers, R., Tasselli, S., Yousefi, A., & van de Kaa, G. (2024) · Academy of Management Annals · doi:10.5465/annals.2023.0072 · Cited by 38
A Sociotechnical Audit: Assessing Police Use of Facial Recognition
Radiya-Dixit, E., & Neff, G. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594084 · Cited by 45
Gender equity in hiring: examining the effectiveness of a personality-based algorithm
Kubiak, E., Efremova, M. I., Baron, S., & Frasca, K. J. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1219865 · Cited by 33
Bias in AI systems: integrating formal and socio-technical approaches
Ahmad, A., Vallès, Y., & Idaghdour, Y. (2026) · Frontiers in Big Data · doi:10.3389/fdata.2025.1686452 · Cited by 33
Fogliato, R., Chouldechova, A., & Lipton, Z. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479572 · Cited by 23
Multi-dimensional Discrimination in Law and Machine Learning - A Comparative Overview
Roy, A. G., Horstmann, J., & Ntoutsi, E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593979 · Cited by 43
Navigating a Black Box: Students’ Experiences and Perceptions of Automated Hiring
Armstrong, L., Everson, J., & Ko, A. J. (2023) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3568813.3600123 · Cited by 32
On Fair Selection in the Presence of Implicit Variance
Emelianov, V., Gast, N., Gummadi, K. P., & Loiseau, P. (2020) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3391403.3399482 · Cited by 49
Automating Automaticity: How the Context of Human Choice Affects the Extent of Algorithmic Bias
Agan, A., Davenport, D., Ludwig, J., & Mullainathan, S. (2023) · doi:10.3386/w30981 · Cited by 25
What People Think AI Should Infer From Faces
Engelmann, S., Ullstein, C., Papakyriakopoulos, O., & Großklags, J. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533080 · Cited by 35
Mimetic Models: Ethical Implications of AI that Acts Like You
McIlroy-Young, R., Kleinberg, J. M., Sen, S., Barocas, S., & Anderson, A. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534177 · Cited by 44
Self-citationHilliard, A., Kazim, E., Bitsakis, T., & Leutner, F. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10010012 · Cited by 33
A design perspective on how to tackle gender biases when developing AI-driven systems
González, A. S., & Rampino, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00386-2 · Cited by 33
The Role of Referrals in Immobility, Inequality, and Inefficiency in Labor Markets
Bolte, L., Immorlica, N., & Jackson, M. O. (2024) · Journal of Labor Economics · doi:10.1086/733048 · Cited by 31
Tian, L., Oviatt, S. L., Muszyński, M., Chamberlain, B. C., Healey, J., & Sano, A. (2022) · ACM eBooks · doi:10.1145/3502398 · Cited by 31
Beyond Algorithmic Fairness in Recommender Systems
Elahi, M., Abdollahpouri, H., Mansoury, M., & Torkamaan, H. (2021) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3450614.3461685 · Cited by 25
AI and Discrimination: Sources of Algorithmic Biases
Moussawi, S., Deng, X. N., & Joshi, K. D. (2024) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/3701613.3701615 · Cited by 38
U.S. Job-Seekers' Organizational Justice Perceptions of Emotion AI-Enabled Interviews
Pyle, C., Roemmich, K., & Andalibi, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686993 · Cited by 32
Mihaljević, H., Müller, I., Dill, K., Yollu-Tok, A., & von Grafenstein, M. (2023) · AI & Society · doi:10.1007/s00146-023-01726-w · Cited by 31
Jin, J. (2025) · Journal of Technology Informatics and Engineering · doi:10.51903/jtie.v4i3.529 · Cited by 22
BEAT Unintended Bias in Personalized Policies
Ascarza, E., & Israeli, A. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2115293119 · Cited by 28
Fairness Audit of Machine Learning Models with Confidential Computing
Park, S., Kim, S., & Lim, Y.-S. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512244 · Cited by 35
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 22
Self-citationThe Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 20
Self-citationManifestations of xenophobia in AI systems
Tomašev, N., Maynard, J. L., & Gabriel, I. (2024) · AI & Society · doi:10.1007/s00146-024-01893-4 · Cited by 25
Privacy and Fairness in Machine Learning: A Survey
Shaham, S., Hajisafi, A., Quan, M. K., Nguyen, D. C., Krishnamachari, B., Peris, C., Ghinita, G., Shahabi, C., & Pathirana, P. N. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3531326 · Cited by 34
Attribute Aware Filter-Drop for Bias-Invariant Classification
Nagpal, S., Singh, M., Singh, R., & Vatsa, M. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00024 · Cited by 20
Behrend, T. S., & Landers, R. N. (2025) · Journal of Business and Psychology · doi:10.1007/s10869-025-10035-6 · Cited by 32
Freedom and Constraint in Digital Environments: Implications for the Self
Talaifar, S., & Lowery, B. S. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221098036 · Cited by 24
Bursell, M., & Roumbanis, L. (2024) · Big Data & Society · doi:10.1177/20539517231221758 · Cited by 39
Algorithmic Pluralism: A Structural Approach To Equal Opportunity
Jain, S., Suriyakumar, V., Creel, K. A., & Wilson, A. (2023) · Conference on Fairness, Accountability and Transparency · doi:10.1145/3630106.3658899 · Cited by 40
Ethical AI in HR: A Case Study of Tech Hiring
Rao, S., & Zhao, T. (2025) · Journal of Computer Information Systems · doi:10.1080/08874417.2024.2446954 · Cited by 24
AdverTiming Matters: Examining User Ad Consumption for Effective Ad Allocations on Social Media
Saha, K., Liu, Y., Vincent, N., Chowdhury, F. A., Neves, L., Shah, N., & Bos, M. W. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445394 · Cited by 28
FairCanary: Rapid Continuous Explainable Fairness
Ghosh, A., Shanbhag, A., & Wilson, C. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534157 · Cited by 35
Examining risks of racial biases in NLP tools for child protective services
Field, A., Coston, A., Gandhi, N., Chouldechova, A., Putnam-Hornstein, E., Steier, D., & Tsvetkov, Y. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594094 · Cited by 18
Lashkari, M., & Cheng, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581548 · Cited by 24
Diversity’s Double-Edged Sword: Analyzing Race’s Effect on Remote Pair Programming Interactions
Mason, S. A., & Kuttal, S. K. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3699601 · Cited by 23
Predicting Employee Turnover: Scoping and Benchmarking the State-of-the-Art
Vos, S. D., Bockel-Rickermann, C., Belle, J. V., & Verbeke, W. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-024-00898-z · Cited by 21
In-Group Bias in Deep Learning-Based Face Recognition Models Due to Ethnicity and Age
Nagpal, S., Singh, M., Singh, R., Vatsa, M., & Ratha, N. (2023) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2023.3241010 · Cited by 20
Digital technology helps remove gender bias in academia
Fortin, J. A., Bartlett, B. R., Kantar, M. B., Tseng, M., & Mehrabi, Z. (2021) · Scientometrics · doi:10.1007/s11192-021-03911-4 · Cited by 19
Applying responsible algorithm design to neighbourhood-scale batteries in Australia
Ransan‐Cooper, H., Sturmberg, B. C. P., Shaw, M. E., & Blackhall, L. (2021) · Nature Energy · doi:10.1038/s41560-021-00868-9 · Cited by 17
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., & Stoyanovich, J. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534189 · Cited by 26
Toward A Two-Sided Fairness Framework in Search and Recommendation
Liu, J. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578332 · Cited by 27
Gender Bias in AI Recruitment Systems: A Sociological-and Data Science-based Case Study
Njoto, S., Cheong, M., Lederman, R., McLoughney, A. J., Ruppanner, L., & Wirth, A. I. (2022) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas55053.2022.10227106 · Cited by 30
Aizenberg, E., Dennis, M., & van den Hoven, J. (2023) · AI & Society · doi:10.1007/s00146-023-01783-1 · Cited by 28
Observer Effect in Social Media Use
Saha, K., Gupta, P., Mark, G. J., Kıcıman, E., & Choudhury, M. D. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642078 · Cited by 32
Zehlike, M., Loosley, A., Jonsson, H., Wiedemann, E., & Hacker, P. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2024.104280 · Cited by 28
Gaebler, J. D., Goel, S., Huq, A., & Tambe, P. (2024) · Behavioral Science & Policy · doi:10.1177/23794607251320229 · Cited by 15
Lee, C. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105439 · Cited by 16
Gender Neutralisation for Unbiased Speech Synthesising
Rizhinashvili, D., Sham, A. H., & Anbarjafari, G. (2022) · Electronics · doi:10.3390/electronics11101594 · Cited by 20
TRANSFORMATION OF RECRUITMENT PROCESS THROUGH IMPLEMENTATION OF AI SOLUTIONS
Tasheva, Z., Karpovich, V., & Economic Information Systems Analyst at IT Launchpad, U. V. (2024) · Journal of Management and Economics · doi:10.55640/jme-04-02-03 · Cited by 15
Paik, S., Novozhilova, E., Mays, K. K., & Katz, J. E. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00235-7 · Cited by 17
Achieving fairness with a simple ridge penalty
Scutari, M., Panero, F., & Proissl, M. (2022) · Statistics and Computing · doi:10.1007/s11222-022-10143-w · Cited by 27
Fair NLP Models with Differentially Private Text Encoders
Maheshwari, G., Denis, P., Keller, M., & Bellet, A. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.514 · Cited by 28
Secretary Problems with Biased Evaluations Using Partial Ordinal Information
Salem, J., & Gupta, S. (2023) · Management Science · doi:10.1287/mnsc.2023.4926 · Cited by 25
RUNNER: Responsible UNfair NEuron Repair for Enhancing Deep Neural Network Fairness
Li, T., Cao, Y., Zhang, J., Zhao, S., Huang, Y., Liu, A., Guo, Q., & Liu, Y. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623334 · Cited by 23
Bias audit laws: how effective are they at preventing bias in automated employment decision tools?
Hilliard, A., Gulley, A., Koshiyama, A., & Kazim, E. (2024) · International Review of Law Computers & Technology · doi:10.1080/13600869.2024.2403053 · Cited by 17
Measuring Fairness of Rankings under Noisy Sensitive Information
Ghazimatin, A., Kleindeßner, M., Russell, C., Abedjan, Z., & Golebiowski, J. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3534641 · Cited by 28
AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
Xu, J., Li, G., & Jiang, J. Y. (2025) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v8i3.36755 · Cited by 31
Metadata
- Authors
- Raghavan, M., Barocas, S., Kleinberg, J., & Levy, K.
- Affiliations
- Cornell University (US)
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 469-481
- OpenAlex
- W4288083801
- Cited by
- 845
- References
- 38
- Citations by year
- 2026: 287 · 2025: 192 · 2024: 98 · 2023: 98 · 2022: 97 · 2021: 57 · 2020: 14
- FWCI
- 68.28
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- automated hiring, pre-employment assessment, algorithmic bias, bias mitigation, anti-discrimination law, employment discrimination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.