Building and Auditing Fair Algorithms: A Case Study in Candidate Screening
The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Academics, activists, and regulators are increasingly urging companies to develop and deploy sociotechnical systems that are fair and unbiased. Achieving this goal, however, is complex: the developer must (1) deeply engage with social and legal facets of "fairness" in a given context, (2) develop software that concretizes these values, and (3) undergo an independent algorithm audit to ensure technical correctness and social accountability of their algorithms. To date, there are few examples of companies that have transparently undertaken all three steps.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“First-party audits are now common at large tech companies, many of which have established auditing teams within their engineering departments.”
From Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem (2022) · cites this paper as [65]
In the citing paper
“For instance, Google researchers on the internal AI team were dismissed and blocked from publishing critiques on the large-scale language models [18,27], which would later be revealed to be critical to the company's future product roadmap [23,85,87].”
From Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance (2022) · cites this paper as [87]
In the citing paper
“Transparency requires the disclosure of the information on a system, and has long been a recognized requirement in software engineering [207, 88].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [88]
In the citing paper
“Wilson et al. (2021) described a candidate-screening system that incorporated fairness evaluation and external review as part of product development.”
From The Impact of Structured Validation and Audit Frameworks on the Fairness and Efficiency of AI-Driven Hiring Systems (2025) · cites this paper as Wilson et al., 2021
In the citing paper
“By assessing the capabilities and limitations of AI systems prior to deployment, auditing helps technology providers identify and mitigate risks before harm occurs (Floridi & Strait, 2020;Wilson et al., 2021).”
From Auditing of AI: Legal, Ethical and Technical Approaches (2023) · cites this paper as Wilson et al., 2021
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,445 · cited 1×
“Each feature distribution is re-centered around zero and scaled to unit variance. pymetrics then uses a proprietary implementation of a Support Vector Machine (SVM) algorithm [12] to train predictive models.”
MethodA Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · cited 1×
“Several tools have been developed by academics to facilitate auditing of black-box ML models, including LIME [52] and SHAP [40].”
Method"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
International Organization for Standardization
(2011) · SpringerReference · doi:10.1007/springerreference_16847 · Cited by 12,534
International Organization for Standardization
(2015) · Encyclopedia of Astrobiology · doi:10.1007/978-3-662-44185-5_100574 · Cited by 6,716
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“These voices have grown louder and the concerns more acute as data-driven ML systems have seen increased adoption [5].”
BackgroundSemantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887 · cited 1×
“This includes examining broad classes of systems like search [14, 14, 25, 28, 32, 35, 36, 41, 53–55], e-commerce [10, 26], news recommendation [4, 31], online advertising [58, 60], maps [57], ridesharing [9, 30], online reviews and ratings [17, 18], natural language processing [7], and recommendation [29].”
BackgroundRaji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245 · cited 5×
“…algorithm auditing to reverse engineering by outsiders, in that the goal is to make “black-box” systems more transparent regardless of the system creator’s intent [13], this conceptualization has since been expanded to include audits carried out by ethically and morally-conscious insiders [51].”
BackgroundInfluentialCertifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827 · cited 1×
“While pre-training [19] and during-training model de-biasing methods [63] exist, they require that training data include complete demographic information, which is not always available in employment contexts.”
Background
Research works printed but not linked: 10
- Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proc. of FAT*.
- Nicholas Diakopoulos Daniel Trielli Jennifer Stark and Sean Mussenden. 2018. I Vote For---How Search Informs Our Choice of Candidate. In Digital Dominance: The Power of Google Amazon Facebook and Apple M. Moore and D. Tambini (Eds.). 22.
- Danielle Ensign, Sorelle A. Friedler, Scott Neville, Carlos Scheidegger, and Suresh Venkatasubramanian. 2018. Runaway Feedback Loops in Predictive Policing. In Proc. of FAT*.
- Pauline T. Kim. 2017. Data-Driven Discrimination at Work. William & Mary Law Review 58 (2017).
- pymetrics, inc. 2019. [Confidential] Fairness Testing Procedures.
- pymetrics, inc. 2019. [Confidential] Games, Measures and Factors: Measurement Validity.
- pymetrics, inc. 2019. [Confidential] Job Analysis Methods & Process.
- pymetrics, inc. 2019. [Confidential] Technical Brief for pymetrics, inc.
- pymetrics, inc. 2020. [Confidential] Demographic Disclosure Study.
- Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. In Proc. of Data and Discrimination: Converting Critical Concerns into Productive Inquiry, a preconference at the Annual Meeting of the International Communication Association.
Cited by
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“Besides the above representatives, designs of approaches to algorithmic auditing can be found in References [290, 356].”
BackgroundMethodInfluentialInherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem
Costanza-Chock, S., Raji, I. D., & Buolamwini, J. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533213 · Cited by 277
“A variety of individuals and organizations now conduct algorithmic audits of products ranging from hiring recommendation engines to facial recognition models, and the algorithmic audit has emerged as one of the most popular approaches to algorithmic accountability [10, 66].”
BackgroundBujold, A., Roberge‐Maltais, I., Parent‐Rocheleau, X., Boasen, J., Sénécal, S., & Léger, P. (2023) · AI and Ethics · doi:10.1007/s43681-023-00325-1 · Cited by 274
The Fallacy of AI Functionality
Raji, I. D., Kumar, I. E., Horowitz, A., & Selbst, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533158 · Cited by 251
Algorithmic fairness datasets: the story so far
Fabris, A., Messina, S., Silvello, G., & Susto, G. A. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00854-z · Cited by 224
Laine, J., Minkkinen, M., & Mäntymäki, M. (2024) · Information & Management · doi:10.1016/j.im.2024.103969 · Cited by 227
“…systems require that developers engage with social and legal facets of fairness, develop software that concretizes these values, and undergo an independent algorithm audit to ensure technical correctness and social accountability –– but few companies match these criteria transparently [149].”
InfluentialOutsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance
Raji, I. D., Xu, P., Honigsberg, C., & Ho, D. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534181 · Cited by 209
Auditing for Discrimination in Algorithms Delivering Job Ads
Imana, B., Korolova, A., & Heidemann, J. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450077 · Cited by 100
“Recent work has explored fnding a balance between independence and addressing the challenges of external auditing by suggesting a cooperative audit framework [65], where the target platform is aware of the audit and gives the auditor special access but there are certain protocols in place to ensure the auditor’s indep…”
BackgroundApplicants’ Fairness Perceptions of Algorithm-Driven Hiring Procedures
Lavanchy, M., Reichert, P., Narayanan, J., & Savani, K. (2023) · Journal of Business Ethics · doi:10.1007/s10551-022-05320-w · Cited by 167
“Future research might also investigate empirically the influence of different information disclosure about fairness, such as whether the algorithm was audited (Wilson et al., 2021) or the algorithmic fairness metric applied (Morse et al., 2021).”
BackgroundAI auditing: The Broken Bus on the Road to AI Accountability
Birhane, A., Steed, R., Ojewale, V., Vecchione, B., & Raji, I. D. (2024) · 2024 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml59370.2024.00037 · Cited by 158
“Product Audits Ecosystem Audits”
Fairness in AI-Driven Recruitment: Challenges, Metrics, Methods, and Future DirectionsPreprint
Mujtaba, D. F., & Mahapatra, N. R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.19699 · Cited by 158
“Other AI-powered services, such as Textio, BrightHire, and SeekOut [82], [84]–[86], are also available to streamline the candidate sourcing process.”
BackgroundAuditing of AI: Legal, Ethical and Technical Approaches
Mökander, J. (2023) · Digital Society · doi:10.1007/s44206-023-00074-y · Cited by 152
“By assessing the capabilities and limitations of AI systems prior to deployment, auditing helps technology providers identify and mitigate risks before harm occurs (Wilson et al., 2021).”
BackgroundAuditing Algorithms: Understanding Algorithmic Systems from the Outside In
Metaxa, D., Park, J. S., Robertson, R. E., Karahalios, K., Wilson, C., Hancock, J., & Sandvig, C. (2021) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000083 · Cited by 140
Self-citationAssembling Accountability: Algorithmic Impact Assessment for the Public Interest
Moss, E., Watkins, E. A., Singh, R., Elish, M. C., & Metcalf, J. (2021) · doi:10.69985/rswq7227 · Cited by 61
González-Sendino, R., Serrano, E., & Bajo, J. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.02.023 · Cited by 99
Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies
Vecchione, B., Levy, K., & Barocas, S. (2021) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3465416.3483294 · Cited by 51
“whether an algorithmic process is sensitive to changes in these factors [3, 31, 39, 43, 50, 90], other algorithmic audits have different goals.”
BackgroundLam, M. S., Gordon, M. L., Metaxa, D., Hancock, J. T., Landay, J. A., & Bernstein, M. S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555625 · Cited by 77
“Given that algorithmic systems are often opaque and commercially owned, audit-based approaches have proven to be incredibly impactful, revealing harmful algorithmic behavior in domains such as housing [2, 21], employment [13, 14, 72], healthcare [55], search [49, 54, 61], and technologies such as facial recognition [9…”
BackgroundInfluentialFairness and Bias in Algorithmic Hiring: A Multidisciplinary Survey
Fabris, A., Baranowska, N., Dennis, M. J., Graus, D., Hacker, P., Saldivar, J., Zuiderveen Borgesius, F., & Biega, A. J. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3696457 · Cited by 117
Park, H., Ahn, D., Hosanagar, K., & Lee, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517672 · Cited by 67
A Comprehensive Survey on Trustworthy Recommender SystemsPreprint
Fan, W., Zhao, X., Chen, X., Su, J., Gao, J., Wang, L., Liu, Q., Wang, Y., Han, X., Chen, L., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.10117 · Cited by 113
“[374] propose a five-step (scoping, mapping, artifact collection, testing, and reflection) audit method to explore fairness problems in job recommendation systems.”
BackgroundConfronting Power and Corporate Capture at the FAccT Conference
Young, M., Katell, M., & Krafft, P. M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533194 · Cited by 63
The Role of Explainable AI in the Research Field of AI Ethics
Vainio-Pekka, H., Agbese, M., Jantunen, M., Vakkuri, V., Mikkonen, T., Rousi, R. A., & Abrahamsson, P. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3599974 · Cited by 99
A Silicon Valley love triangle: Hiring algorithms, pseudo-science, and the quest for auditability
Sloane, M., Moss, E., & Chowdhury, R. (2022) · Patterns · doi:10.1016/j.patter.2021.100425 · Cited by 65
Laufer, B., Jain, S., Cooper, A. F., Kleinberg, J. M., & Heidari, H. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533107 · Cited by 88
A Review of Bias and Fairness in Artificial Intelligence.
González-Sendino, R., Serrano, E., Bajo, J., & Nováis, P. (2024) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2023.11.001 · Cited by 89
“Instead, adding fairness to the objective function is more efficient [93].”
They shall be fair, transparent, and robust: auditing learning analytics systems
Simbeck, K. (2023) · AI and Ethics · doi:10.1007/s43681-023-00292-7 · Cited by 83
“They reported, that the source code (Jupyter notebooks provided by PlyMetrics) correctly implements the adverse impact metric and that it did not use demographic features that could lead to direct discrimination [109].”
InfluentialKassir, S., Baker, L. J., Dolphin, J., & Polli, F. E. (2022) · AI and Ethics · doi:10.1007/s43681-022-00208-x · Cited by 81
Self-citationA Framework for Assurance Audits of Algorithmic Systems
Lam, K., Lange, B., Blili-Hamelin, B., Davidovic, J., Brown, S., & Hasan, A. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658957 · Cited by 75
“…norms and standardized practices, despite notable emerging efforts to perform audits as many types of engagement, including adversarial pressure testing [3, 68, 80], quantitative technical assessments [13, 16, 21, 38, 82], and qualitative assessments of risks or impacts [10, 18, 31], among others.”
Background(2024) · doi:10.1609/aies.v7i1.31748 · Cited by 74
“Wilson et al. (2021), using a cooperative audit, found that the system of interest did not exhibit adverse impact, but key assumptions make this result difficult to generalize without additional testing.”
BackgroundCertification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study
Scharowski, N., Benk, M., Kühne, S. J., Wettstein, L., & Brühlmann, F. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593994 · Cited by 75
“To account for this independence on the one hand and the structural advantages of internal audits on the other, "cooperative audits" [69] could be a way forward, balancing between the advantages and challenges of the two approaches.”
BackgroundZhang, A., Walker, O., Nguyen, K., Dai, J., Chen, A., & Lee, M. K. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579601 · Cited by 72
Sociotechnical Audits: Broadening the Algorithm Auditing Lens to Investigate Targeted Advertising
Lam, M. S., Pandit, A., Kalicki, C. H., Gupta, R., Sahoo, P., & Metaxa, D. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610209 · Cited by 39
“For example, given the challenges of limited third-party access, future auditors might develop hybrid approaches that involve partial access to a system and its users, along the lines of work on first- and second-party algorithm audits [58, 72].”
BackgroundMitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603203 · Cited by 65
Measuring Fairness Under Unawareness of Sensitive Attributes: A Quantification-Based Approach
Fabris, A., Esuli, A., Moreo, A., & Sebastiani, F. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14033 · Cited by 67
“High quality auxiliary sets may be obtained through optional surveys [65], for which response rates are highly dependent on trust (see Section 5.4.1), and can be improved by making the intended use for the data clearer [7].”
BackgroundInfluentialESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain
Zhang, M., van der Goot, R., & Plank, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.662 · Cited by 65
Balayn, A., Yurrita, M., Yang, J., & Gadiraju, U. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604674 · Cited by 64
Towards a multi-stakeholder value-based assessment framework for algorithmic systems
Yurrita, M., Murray-Rust, D., Balayn, A., & Bozzon, A. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533118 · Cited by 39
“Wilson et al. [181] described a framework that helps ensure fairness in socio-technical systems, and used it for auditing the model of the startup pymetrics .”
Using Artificial Intelligence in the workplace: What are the main ethical risks?
Pero, A. S. D., Wyckoff, P., & Vourc'h, A. (2022) · OECD social employment and migration working papers · doi:10.1787/840a2d9f-en · Cited by 62
Auditing Work: Exploring the New York City algorithmic bias audit regime
Groves, L., Metcalf, J., Kennedy, A., Vecchione, B., & Strait, A. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658959 · Cited by 59
“Existing theory and practice has informed a growing literature of algorithm audits, which also identify the need for clearly defined standards, mandatory disclosure of reports, and formalisation of algorithm auditor practice, including access powers and accreditation[5, 8, 21, 48, 56].”
BackgroundResultHartmann, D., de Pereira, J. R. L., Streitbörger, C., & Berendt, B. (2025) · AI and Ethics · doi:10.1007/s43681-024-00595-3 · Cited by 58
“Legalization of Web Scraping for AI Auditing Recognize the importance of web scraping as a valuable tool for researchers, NGOs, and investigative journalists engaged in AI auditing activities.”
An external stability audit framework to test the validity of personality prediction in AI hiring
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., Khan, F. A., & Stoyanovich, J. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00861-0 · Cited by 57
Evaluating Proposed Fairness Models for Face Recognition Algorithms
Howard, J. J., Laird, E., Rubin, R. E., Sirotin, Y. B., Tipton, J. L., & Vemury, A. R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-37660-3_31 · Cited by 55
“The fairness of software applications in general has garnered much attention in recent years from organizations across a wide swath of disciplines, including computer science, sociology, policy, and others [3, 5, 9, 17, 34].”
Background(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603207 · Cited by 45
Kumar, D., Grosz, T., Rekabsaz, N., Greif, E., & Schedl, M. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1245198 · Cited by 48
Kuehnert, B., Kim, R., Forlizzi, J., & Heidari, H. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732191 · Cited by 47
THE IMPACT OF AI ON INTERNAL AUDITING: TRANSFORMING PRACTICES AND ENSURING COMPLIANCE
Adelakun, B. O. (2022) · Finance & Accounting Research Journal · doi:10.51594/farj.v4i6.1316 · Cited by 46
A Sociotechnical Audit: Assessing Police Use of Facial Recognition
Radiya-Dixit, E., & Neff, G. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594084 · Cited by 45
“First, the auditee may make changes to the algorithmic system [28, 77, 102].”
Background(2025) · International Journal of Computer Applications Technology and Research · doi:10.7753/ijcatr1112.1028 · Cited by 40
Imana, B., Korolova, A., & Heidemann, J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579610 · Cited by 40
“An audit of Pymetrics, a startup that offers a job candidate screening service, performed by external researchers in 2020 proposes a new cooperative audit framework, where the target platform gives the auditor special access to its source code and data [102].”
FairCanary: Rapid Continuous Explainable Fairness
Ghosh, A., Shanbhag, A., & Wilson, C. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534157 · Cited by 35
“The use of algorithms to aid critical decision making processes in the government and the industry has attracted commensurate scrutiny from academia, lawmakers and social justice workers in recent times [4, 7, 71], because ML systems trained on a snapshot of the society has the unintended”
BackgroundSelf-citationCoordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities
Cattell, S., Ghosh, A., & Kaffee, L.-A. (2024) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v7i1.31635 · Cited by 34
“However, approaches like cooperative audits (Wilson et al. 2021), participatory audits (Dennler et al. 2023), and AI red teaming (OpenAI 2023; Ganguli et al. 2022) are emerging as ML stakes grow.”
Self-citationBias in AI systems: integrating formal and socio-technical approaches
Ahmad, A., Vallès, Y., & Idaghdour, Y. (2026) · Frontiers in Big Data · doi:10.3389/fdata.2025.1686452 · Cited by 33
Johri, A., & Singh, R. K. (2024) · Cogent Business & Management · doi:10.1080/23311975.2024.2344743 · Cited by 34
“…emerged as a result of the need for independent assurance following corporate frauds and scandals such as the cases involving enron and worldcom (wilson et al., 2021). the establishment of auditing standards and regulatory bodies marked a pivotal milestone in shaping contemporary auditing…”
InfluentialNezami, N., Haghighat, P., Gándara, D., & Anahideh, H. (2024) · Education Sciences · doi:10.3390/educsci14020136 · Cited by 32
Lewicki, K., Lee, M. S. A., Cobbe, J., & Singh, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581463 · Cited by 30
Mihaljević, H., Müller, I., Dill, K., Yollu-Tok, A., & von Grafenstein, M. (2023) · AI & Society · doi:10.1007/s00146-023-01726-w · Cited by 31
“In recent years, second-party audits, also referred to as cooperative audits, have been introduced in the recruitment field (O’Neil Risk Consulting and Algorithmic Auditing (ORCAA) 2020; Wilson et al. 2021).”
Lassiter, T. B., & Fleischmann, K. R. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686963 · Cited by 26
“There have been several audits that gained the attention of the public, such as the audits of two AI hiring companies, Pymetrics [17], and HireVue [18].”
Rhea, A. K., Markey, K., D’Arinzo, L., Schellmann, H., Sloane, M., Squires, P., & Stoyanovich, J. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534189 · Cited by 26
“Much of the audit literature surrounding predictive hiring technology is primarily concerned with legal liability as laid out in the Uniform Guidelines on Employee Selection Procedures [28, 42, 66].”
BackgroundInfluentialKnowles, B., Richards, J. T., & Kroeger, F. (2022) · Lancaster EPrints (Lancaster University) · doi:10.48550/arxiv.2208.00681 · Cited by 25
“While there is a growing interest in audits as a means of promoting trust [65, 118, 145], this cor-”
BackgroundInfluentialNot Even Nice Work If You Can Get It; A Longitudinal Study of Uber's Algorithmic Pay and Pricing
Binns, R., Stein, J., Datta, S., Kleek, M. G. V., & Shadbolt, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732099 · Cited by 23
“While many organisations are voluntarily engaging in audits [48], external audits remain an important tool to uncover algorithmic harms and seek redress for affected communities where internal audits and harm mitigation are not forthcoming.”
Skorburg, J. A., O’Doherty, K. C., & Friesen, P. (2024) · American Psychologist · doi:10.1037/amp0001168 · Cited by 23
Navigating AI conformity: A design framework to assess fairness, explainability, and performance
von Zahn, M., Zacharias, J., Lowin, M., Chen, J., & Hinz, O. F. (2025) · Electronic Markets · doi:10.1007/s12525-025-00770-2 · Cited by 22
“The main reasons are that AI systems are frequently retrained (Wilson et al., 2021), data and concepts can shift (as stated by the interviewed experts and, e.g., dos Reis et al. (2016)), and that regulations naturally evolve over time.”
NNOSE: Nearest Neighbor Occupational Skill Extraction
Zhang, M., van der Goot, R., Kan, M., & Plank, B. (2024) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2024.eacl-long.35 · Cited by 23
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 22
Towards an Accountable and Reproducible Federated Learning: A FactSheets ApproachPreprint
Baracaldo, N., Anwar, A., Purcell, M., Rawat, A., Sinn, M., Altakrouri, B., Balta, D., Sellami, M., Kühn, P., Schöpp, U., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.12443 · Cited by 23
“Accountability is particularly critical for the acceptance of ML in highly regulated environments, where auditing and fairness is paramount (cf. e.g. [5] ).”
The Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 20
The Challenge of Ethical Interoperability
Danks, D. J., & Trusilo, D. (2022) · Digital Society · doi:10.1007/s44206-022-00014-2 · Cited by 20
“…which provides additional measures and methods to support hiring diverse, qualified candidates. pymetrics has undergone a third-party audit (Wilson et al., 2021) to confirm that their system follows their own ethical principles, 14 but the relevant question here is whether their system…”
BackgroundInfluentialAuditing Risk Prediction of Long-Term Unemployment
Seidelin, C., Moreau, T., Shklovski, I., & Møller, N. H. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492827 · Cited by 20
Honor Ethics: The Challenge of Globalizing Value Alignment in AI
Wu, S., Demetriou, D., & Husain, R. A. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594026 · Cited by 19
“An AI system might aid the job hiring process [3, 9, 17, 32, 45, 60], apportion benefits and opportunities based on census data, or provide health benefits for its users: any biases in data, systems, or policy that systematically exclude some groups are considered unfair.”
BackgroundFair Machine Learning Under Partial Compliance
Dai, J. C., Fazelpour, S., & Lipton, Z. C. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462521 · Cited by 19
When Fair Classification Meets Noisy Protected Attributes
Ghosh, A., Kvitca, P., & Wilson, C. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604707 · Cited by 18
Self-citationA Framework for Assurance Audits of Algorithmic Systems
Lange, B., Lam, K., Blili-Hamelin, B., Davidovic, J., Brown, S., & Hasan, A. (2024) · PhilPapers (PhilPapers Foundation) · Cited by 17
Navigating Automated Hiring: Perceptions, Strategy Use, and Outcomes Among Young Job Seekers
Armstrong, L., & Metaxa, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711038 · Cited by 17
Towards gender-inclusive job postings: A data-driven comparison of augmented writing technologies
Mihaljević, H., Müller, I., Dill, K., & Yollu-Tok, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274312 · Cited by 17
High-risk artificial intelligence
Sunyaev, A., Benlian, A., Pfeiffer, J., Jussupow, E., Thiebes, S., Maedche, A., & Gawlitza, J. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00942-6 · Cited by 16
“Additionally, fairness auditing processes and tools can provide ongoing assessments of fairness as AI systems evolve, addressing the challenge that fairness is a ‘‘moving target’’ and ensuring that these systems adapt to changing societal conditions (Simbeck 2024; Wilson et al. 2021).”
Fisher, S. L., Connelly, C. E., & Bonaccio, S. (2023) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12456 · Cited by 16
Algorithmic Monocultures in Hiring
Bommasani, R., Bana, S., Creel, K. A., Jurafsky, D., & Liang, P. (2026) · Conference on Fairness, Accountability and Transparency · doi:10.1145/3805689.3812400 · Cited by 8
Studying Multi-dimensional Marginalization of Identity from Decolonial and Postcolonial Perspectives
Das, D. (2023) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3584931.3608920 · Cited by 15
“fairness, accountability, and transparency has well-established the possibility of biases in algorithmic systems [24, 42], by designing an experimental study, I will examine how NLP-based automated moderation can exhibit biases toward different intersectional identities in Bengali communities.”
BackgroundPoe, R. L., & Mestari, S. Z. E. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659015 · Cited by 14
Access Denied: Meaningful Data Access for Quantitative Algorithm Audits
Zaccour, J., Binns, R., & Rocher, L. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713963 · Cited by 14
Lynn, J., Kim, R. Y., Gao, S., Schneider, D., Pandya, S. S., & Lee, M. K. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732037 · Cited by 14
FairFare : A Tool for Crowdsourcing Rideshare Data to Empower Labor Organizers
Calacci, D., Rao, V. N., Dalal, S., Di, C., Pua, K.-W., Schwartz, A., Spitzberg, D., & Monroy‐Hernández, A. (2026) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3769680 · Cited by 14
“While researchers advocate for comprehensive public transparency reports [53–55], drawing from social media transparency practices [52, 56] and generative AI model developers’ calls for openness [9], such voluntary disclosures ultimately depend on companies’ willingness to participate and their…”
Making Algorithms Public: Reimagining Auditing from Matters of Fact to Matters of Concern
Geiger, R. S., Tandon, U., Gakhokidze, A., Song, L., & Irani, L. C. (2024) · eScholarship (California Digital Library) · Cited by 14
Fairness and Sequential Decision Making: Limits, Lessons, and OpportunitiesPreprint
Nashed, S. B., Svegliato, J., & Blodgett, S. L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.05753 · Cited by 14
“Academic [237] or community audits, such as audits of commercial image cropping”
BackgroundSubverting Fair Image Search with Generative Adversarial Perturbations
Ghosh, A., Jagielski, M., & Wilson, C. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533128 · Cited by 13
“Algorithmic decision making is permeating modern life, including high-stakes decisions like credit lending [11], bail granting [7], hiring [96], etc.”
BackgroundSelf-citationToward Comprehensive Risk Assessments and Assurance of AI-Based SystemsPreprint
Khlaaf, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.29390 · Cited by 13
“Various AI-related works have progressively looked to well-established safety and security techniques in an attempt to apply the same methodologies to ML models and their datasets [13, 26, 31, 33, 34, 45, 46].”
Algorithmic Impact Assessments at Scale: Practitioners’ Challenges and Needs
Ashar, A., Ginena, K., Cipollone, M., Barreto, R. D. C., & Cramer, H. S. M. (2024) · Journal of Online Trust and Safety · doi:10.54501/jots.v2i4.206 · Cited by 12
Assembled Bias: Beyond Transparent Algorithmic Bias
Waller, R. L., & Waller, R. L. (2022) · Minds and Machines · doi:10.1007/s11023-022-09605-x · Cited by 12
Computational Job Market Analysis with Natural Language ProcessingPreprint
Zhang, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.18977 · Cited by 12
Koivunen, S. (2024) · Tampere University Institutional Repository (Tampere University) · Cited by 12
The Societal Impacts of Algorithmic Decision-Making
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195 · Cited by 11
Auditing the Audits: Lessons for Algorithmic Accountability from Local Law 144's Bias Audits
Gerchick, M. K., Encarnación, R., Tanigawa-Lau, C., Armstrong, L., Gutiérrez, A., & Metaxa, D. (2025) · Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3715275.3732004 · Cited by 10
Malin, C. D., Fleiß, J., & Thalmann, S. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1561322 · Cited by 10
A Brief Tutorial on Sample Size Calculations for Fairness AuditsPreprint
Singh, H., Xia, F., Kim, M., Pirracchio, R., Chunara, R., & Feng, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.04745 · Cited by 9
“In some cases it is possible to leverage existing open datasets such as images of parliamentarians from across the world to audit facial image processing algorithms [2], data released under legal obligations by lenders [3], or direct sharing by the model developer under strict terms [20].”
BackgroundA Complex System Governance Theory and Conceptual Links to Cyber Diplomacy
CÎRNU, C.-E., & Georgescu, A. V. (2023) · Studies in Informatics and Control · doi:10.24846/v32i2y202312 · Cited by 8
Geiger, R. S., Tandon, U., Gakhokidze, A., Song, L., & Irani, L. C. (2023) · International journal of communication · Cited by 8
Eitzel, M. V. (2021) · Research Ideas and Outcomes · doi:10.3897/rio.7.e71553 · Cited by 8
Ethics-based auditing of automated decision-making systems: considerations, challenges, na
Mökander, J. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-z5qakao0p · Cited by 12
Metadata
- Authors
- Wilson, C., Ghosh, A., Jiang, S., Mislove, A., Baker, L., Szary, J., Trindel, K., & Polli, F.
- Affiliations
- Northeastern University (US)
- pymetrics, inc.
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 666-677
- OpenAlex
- W3133759846
- Cited by
- 133
- References
- 53
- Citations by year
- 2026: 19 · 2025: 17 · 2024: 17 · 2023: 45 · 2022: 27 · 2021: 8
- FWCI
- 21.93
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Funders
- National Science Foundation (IIS-1553088)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- algorithmic fairness, algorithmic auditing, algorithmic accountability, socio-technical systems, algorithmic bias, transparency, social accountability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.