Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing
Open accessThe DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index; 11 of the 44 sources its claims cite were checked for support.
Abstract
Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited for harm by investigators from outside the organizations deploying the algorithms. However, it remains challenging for practitioners to identify the harmful repercussions of their own systems prior to deployment, and, once deployed, emergent issues can become difficult or impossible to trace back to their source.
Overview
CoChat Summary
TL;DR
The paper proposes SMACTR, an end-to-end internal algorithmic auditing framework intended to help organizations assess AI systems against declared ethical principles throughout development. It argues that internal audits can complement external accountability by providing pre-deployment access, structured documentation, and risk analysis drawn from aerospace, medical device, and finance practices.
Key findings
- Introduces SMACTR—Scoping, Mapping, Artifact Collection, Testing, and Reflection—as five audit stages, each with documentation requirements that together form an overall audit report and assess decisions against organizational values or AI principles.
- Argues external audits are limited by lack of access to internal processes, intermediate models, and training data, while internal audits can enable proactive pre-deployment intervention and generate artifacts for external review.
- Draws lessons from other industries, citing aerospace’s one commercial airline accident per two million flights, Boeing 787 software estimated at 13 million lines of code, and a 1-in-1,000,000,000 per use hour maximum failure probability for critical aerospace systems; also cites medical-device design controls and finance internal audit infrastructure.
- Uses hypothetical cases—a child abuse screening tool and a smile-detection photo booth—to illustrate the framework; for the smile detector’s CelebA datasheet, it reports 58.1% female and 42% male labels, 77.8% aged 0–45 and 22.1% over 46, and 14.2% lighter-skinned versus 85.8% darker-skinned.
Methods
- Conceptual framework paper: develops SMACTR from auditing practices and artifacts in aerospace, medical devices, and finance, plus responsible-innovation dimensions of anticipation, reflexivity, inclusion, and responsiveness.
- Uses a hypothetical Company X Inc. consultancy with two invented client projects—a child abuse screening tool and Happy-Go-Lucky Inc.’s smile-detection photo booth—to demonstrate audit stages and artifacts; a worked example for the smile case is provided as supplementary material.
- Analysis is narrative and design-oriented, referencing existing standards and tools such as FMEA, model cards, datasheets, design controls, and design history files; no empirical sample or quantitative evaluation is reported.
Limitations
- The paper states that internal auditors necessarily share an organizational interest with the audit target, making an independent and objective viewpoint challenging; audits are not an objective “view from nowhere” and risk becoming reputation management.
- The paper states that internal audits are only one aspect of a broader system of required quality checks and balances, and that determining what systems to audit and why is not covered and is a separate research topic.
- Evident from the text: the framework is not empirically validated, the illustrative cases are hypothetical, and no real deployment outcomes or measured audit effectiveness are reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
9 Valid · 6 Not valid · 27 Not checked · 30 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“While not without faults, safety-critical and regulated industries such as aerospace and medicine have long traditions of auditable processes and design controls that have dramatically improved safety [77,81].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 3 LESSONS FROM AUDITING PRACTICES IN OTHER INDUSTRIES
What the sources say
- Not checked — no full text of the sourcecites [77] source
- Could not verifycites [81] sourceExperimental — accuracy not yet measured
The Introduction and §3 discuss biomedical ethics and standards or regulation, but do not say that aerospace or medicine has long used auditable processes and design controls, or that these dramatically improved safety. Searches for aerospace, auditable processes, design controls, and safety-critical industries found no passage addressing that claim. Page numbers are unavailable in our copy. (LLM, conf=0.76)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This is a repeatedly observed phenomenon in tax compliance auditing, where several international surveys of tax compliance demonstrate that a fixed and vetted tax audit methodology is one of the most effective strategies to convince companies to respect audit results and pay their full taxes [22,53].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 2.3 Audit Integrity and Procedural Justice
What the sources say
- Partly supportedcites [22] sourceExperimental — accuracy not yet measured
The Regression Test section reports that Malaysian respondents would be more compliant if tax authorities treated them fairly in tax procedures. The Research Methodology section describes a questionnaire of academics, not several international surveys of companies. The paper does not establish that a fixed, vetted audit methodology is especially effective at securing acceptance of audit results or full tax payment. (LLM, conf=0.86)
- Partly supportedcites [53]Experimental — accuracy not yet measured
The “Justice in the taxation context” section reports that taxpayers are generally more compliant when treated fairly and respectfully, and the General discussion links perceived unfair treatment to resistance to paying back tax (page numbers unavailable). It does not establish that a fixed, vetted audit methodology is among the most effective strategies, or report international surveys demonstrating that effect for companies. (LLM, conf=0.83)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Traditional metrics for artificial intelligence like loss may conceal fairness concerns, social impact risks or abstraction errors [69].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 4.3.2 Artifact: Ethnographic Field Study.
What the sources say
- Supportedcites [69] source
The Introduction (page not provided) says that narrow assessments of machine-learning performance abstract away social context and can miss information needed for fair outcomes—an abstraction error. The Formalism Trap section adds that mathematical measures cannot capture the full range of fairness concerns, while the Takeaways discuss unintended social consequences. The paper names AUC, precision and recall rather than loss, but the claim uses loss as an illustrative metric. (LLM, conf=0.88)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Internal auditors' direct access to systems can thus help extend traditional external auditing paradigms by incorporating additional information typically unavailable for external evaluations to reveal previously unidentifiable risks.”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 2.4 The Internal Audit
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“The essential inclusion of independent domain experts and marginalized groups in the ethical review process “has the potential to lead to more rigorous critical reflection because their experiences will often be precisely those that are most needed in identifying problematic background assumptions and revealing limitations with research questions, models, or methodologies” [33].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 4.2.1 Artifact: Ethical Review of System Use Case.
What the sources say
- Not checked — no full text of the sourcecites [33] source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
19 more claims
Create a free account to see all 72 claims and every source verdict.
- It may state two separate claims as one. 25
- Probably not a substantial claim. 37
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This disparity poses risks, as practitioners may unintentionally embed their own biases into AI system design and implementation (Martin 2019;Raji et al. 2020).”
From Accountability in Government Use of AI : Citizen Concerns and Preferences (2025) · cites this paper as Raji et al. 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Work on AI safety and reproducibility has long pointed out the crucial importance of training data for understanding model performance, ensuring reproducibility, and assessing legal exposure [2, 25, 29, 46, 58].”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [46]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While there is a growing interest in auditing algorithmic systems [125,126,128,138,154], this feld generally lacks defned standards and records could be incomplete or not relating to information needed for accountability purposes [15,127].”
From Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service” (2023) · cites this paper as [128]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Raji et al. (2020) proposed an internal algorithmic auditing framework spanning data collection, model development, testing, deployment, and monitoring, with stage-specific artifacts that enable traceability and accountability.”
From The Impact of Structured Validation and Audit Frameworks on the Fairness and Efficiency of AI-Driven Hiring Systems (2025) · cites this paper as Raji et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Practical approaches to implement such ideas typically revolve around the systematic collection and curation of data on various aspects of systems [2, 28, 46].”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [46]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747 · cited 1×
“A hypothetical datasheet for this system is filled out using studies on the CelebA dataset, with which the smile detector is built [44, 47].”
MethodThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Product development: Past research, present findings and future directions
Brown, S. L., & Eisenhardt, K. M. (1995) · The Academy of Management Review · doi:10.2307/258850 · Cited by 3,777 · cited 1×
“There are also intersections between this framework and just efective product development theory [5], as many of the components of audit design refocus the product development process to prioritize the user and their ultimate well-being, resulting in a more efective product performance outcome.”
Background(2018) · Cited by 3,510
Christiane, Druml, Wolzt, & Pleiner (2001) · Acta Scientiarum Naturalium Universitatis Sunyatseni · Cited by 3,419
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196
Developing a framework for responsible innovation
Stilgoe, J., Owen, R., & Macnaghten, P. (2013) · Research Policy · doi:10.1016/j.respol.2013.05.008 · Cited by 3,184 · cited 1×
“To design our audit procedure, we suggest complementing formal risk assessment methodologies with ideas from responsible innovation, which stresses four key dimensions: anticipation, reflexivity, inclusion and responsiveness [73], as well as system-theoretic concepts that help grapple with increasing complexity and co…”
MethodAlgorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Self-citation(2014) · Journal of the Korean Medical Association · doi:10.5124/jkma.2014.57.11.899 · Cited by 2,566
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Self-citationGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Self-citation(2016) · Cited by 2,334
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631 · cited 2×
“Traditional metrics for artificial intelligence like loss may conceal fairness concerns, social impact risks or abstraction errors [69].”
BackgroundEngineering a Safer World: Systems Thinking Applied to Safety
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6305 · Cited by 1,566 · cited 5×
“For example, a power plant can be consistently productive while causing harm to the environment through pollution [42].”
BackgroundMethodInfluentialFailure Mode and Effect Analysis: FMEA From Theory to Execution
Schneider, H. (1996) · Technometrics · doi:10.1080/00401706.1996.10484424 · Cited by 1,493
The allocation of risk in PPP/PFI construction projects in the UK
Bing, L., Akintoye, A., Edwards, P. J., & Hardcastle, C. (2005) · International Journal of Project Management · doi:10.1016/j.ijproman.2004.04.006 · Cited by 901
International Principles For Social Impact Assessment
Vanclay, F. (2003) · Impact Assessment and Project Appraisal · doi:10.3152/147154603781766491 · Cited by 824 · cited 2×
“unintended social consequences, both positive and negative, that occur when a new development, program, or policy engages with human populations and communities [79].”
BackgroundFailure Mode and Effect Analysis: FMEA from Theory to Execution
Schneider, H., & Stamatis, D. H. (1996) · Technometrics · doi:10.2307/1268911 · Cited by 816
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
Structural Vulnerability and Health: Latino Migrant Laborers in the United States
Quesada, J., Hart, L. K., & Bourgois, P. (2011) · Medical Anthropology · doi:10.1080/01459740.2011.576725 · Cited by 741 · cited 1×
“structural vulnerability in healthcare contexts, and effectively the design of an assessment tool to record the anticipated social conditions surrounding a particular remedy or medical recommendation [61]. Artificial intelligence models are equally subject to social influence and social impact, and undergoing such ass…”
BackgroundThe ethics of big data: current and foreseeable issues in biomedical contexts
Mittelstadt, B. D., & Floridi, L. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-015-9652-2 · Cited by 714 · cited 1×
“ented by anticipatory questions such as, “what if...?”. The aim is to increase ethical foresight through systematic thinking about the larger sociotechnical system in which a product will be deployed [50]. There are also intersections between this framework and just effective product development theory [5], as many of…”
BackgroundRaji, I. D., & Buolamwini, J. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314244 · Cited by 651
Self-citationEfficient Machine Learning for Big Data: A Review
Al-Jarrah, O. Y., Yoo, P. D., Muhaidat, S., Karagiannidis, G. K., & Taha, K. (2015) · Big Data Research · doi:10.1016/j.bdr.2015.04.001 · Cited by 647 · cited 1×
“With the increased access to artificial intelligence (AI) development tools and Internet-sourced datasets, corporations, nonprofits and governments are deploying AI systems at an unprecedented pace, often in massive-scale production systems impacting millions if not billions of users [1].”
BackgroundTowards Deep Neural Network Architectures Robust to Adversarial Examples
Gu, S., & Rigazio, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5068 · Cited by 622 · cited 1×
“attacking a model with human-imperceptible pixel manipulations to trick the model into misidentifying previously learned outputs [28], but these approaches can be complementary.”
BackgroundHow the Machine 'Thinks:' Understanding Opacity in Machine Learning AlgorithmsPreprint
Burrell, J. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2660674 · Cited by 511
The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions
Whittlestone, J., Nyrup, R., Alexandrova, A., & Cave, S. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314289 · Cited by 399
The Intuitive Appeal of Explainable Machines
Selbst, A. D., & Barocas, S. (2018) · doi:10.2139/ssrn.3126971 · Cited by 392
Greene, D., Hoffmann, A. L., & Stark, L. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.258 · Cited by 386 · cited 1×
“little to no means of accountability [27, 82].”
Algorithms in practice: Comparing web journalism and criminal justice
Christin, A. (2017) · Big Data & Society · doi:10.1177/2053951717718855 · Cited by 379 · cited 1×
“Large gaps between the intended and actual uses of algorithms have been found in contexts such as criminal justice and web journalism [12].”
BackgroundOf, for, and by the people: the legal lacuna of synthetic persons
Bryson, J. J., Diamantis, M. E., & Grant, T. D. (2017) · Artificial Intelligence and Law · doi:10.1007/s10506-017-9214-9 · Cited by 368 · cited 1×
“Although algorithms themselves cannot be held accountable as they are not moral or legal agents [7], the organizations designing and deploying algorithms can through governance structures.”
Background25 Years of Feminist Empiricism and Standpoint Theory: Where Are We Now?
Intemann, K. (2010) · Hypatia · doi:10.1111/j.1527-2001.2010.01138.x · Cited by 331 · cited 2×
“Thus it is not always possible for individual technology workers to identify or assess their own biases or faulty assumptions [33].”
BackgroundThe ML test score: A rubric for ML production readiness and technical debt reduction
Breck, E., Cai, S., Nielsen, E., Salib, M., & Sculley, D. (2017) · 2017 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2017.8258038 · Cited by 310 · cited 1×
“rformance metrics such as accuracy or profit [39]. Although concerns about reliability are related, and although practices for testing production AI systems are established for industry practitioners [4], issues involving social impact, downstream effects in critical domains, and ethics and fairness concerns are not t…”
BackgroundInfluentialMotivated social cognition: Principles of the interface.
Kruglanski, A. W. (1996) · Cited by 291
The internal audit function: Perceptions of internal audit roles, effectiveness and evaluation
Soh, D. S. B., & Martinov‐Bennie, N. (2011) · Managerial Auditing Journal · doi:10.1108/02686901111151332 · Cited by 279
Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments
Green, B., & Chen, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287563 · Cited by 275
Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society
Caverly, R. W. (2013) · Journal of Research Administration · Cited by 272
(2018) · Cited by 230
On the application of the Borel-Cantelli lemma
Chung, K. L., & Erdös, P. (1952) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1952-0045327-5 · Cited by 225 · cited 1×
“The Borel-Cantelli Lemmas are formalizations of this statistical phenomenon [13], which means that we can never be satisfied with safety standards.”
BackgroundAlgorithmic Accountability Reporting: On the Investigation of Black Boxes
Diakopoulos, N. A. (2014) · Columbia Academic Commons (Columbia University) · doi:10.7916/d8zk5tw2 · Cited by 221 · cited 1×
“Building from methods of external auditing in investigative journalism and research [17, 62, 65], algorithmic auditing has started to become similar in spirit to the well-established practice of bug bounties, where external hackers are paid for finding vulnerabilities and bugs in released software…”
MethodWeapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy
Verma, S. (2019) · Vikalpa: The Journal for Decision Makers · doi:10.1177/0256090919853933 · Cited by 219
Brubaker, C., Jana, S., Ray, B., Khurshid, S., & Shmatikov, V. (2014) · 2014 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2014.15 · Cited by 218 · cited 1×
“Adversarial testing is a common approach to finding vulnerabilities in both pre-release and postlaunch technology, for example in privacy and security testing [6].”
MethodMachine Learning: The High Interest Credit Card of Technical Debt
Sculley, D., Holt, G. D., Golovin, D., Davydov, E. V., Phillips, T., Ebner, D., Chaudhary, V., & Young, M. (2014) · Cited by 218
Quality Assurance of Chemical Measurements
Taylor, J. K. (2018) · doi:10.1201/9780203741610 · Cited by 213
Bias detectives: the researchers striving to make algorithms fair
Courtland, R. (2018) · Nature · doi:10.1038/d41586-018-05469-3 · Cited by 205 · cited 1×
“dit framework on two hypothetical client projects. The first (hypothetical) client wishes to develop a child abuse screening tool similar to that of the real cases extensively studied and reported on [11, 14, 15, 21, 25, 36]. This complex case intersects heavily with applications in high-risk scenarios with dire conse…”
BackgroundAI as the next GPT: a Political-Economy Perspective
Trajtenberg, M. (2018) · National Bureau of Economic Research · doi:10.3386/w24245 · Cited by 200
Byzantine Fault Tolerance, from Theory to Reality
Driscoll, K., Hall, B., Sivencrona, H., & Zumsteg, P. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39878-3_19 · Cited by 191 · cited 1×
“As modern avionic systems have increased in size and complexity (for example, the Boeing 787 software is estimated at 13 million lines of code [35]), the standard 1-in-1,000,000,000 per use hour maximum failure probability for critical aerospace systems remains an underappreciated engineering marvel [19].”
BackgroundReliability and Safety Engineering
Verma, A. K., Srividya, A., & Karanki, D. R. (2010) · Springer series in reliability engineering · doi:10.1007/978-1-84996-232-2 · Cited by 178
Runaway Feedback Loops in Predictive Policing
Ensign, D., Friedler, S. A., Neville, S., Scheidegger, C., & Venkatasubramanian, S. (2017) · arXiv · doi:10.48550/arxiv.1706.09847 · Cited by 161 · cited 1×
“By considering historical examples across industries, we make the case that such audits can be leveraged to anticipate potential negative consequences before they occur, in addition to providing decision support to design mitigations, more clearly defining and monitoring potentially adverse outcomes, and anticipating…”
BackgroundThe Ethics of Biomedical Big Data
Mittelstadt, B., & Floridi, L. (2016) · Law, governance and technology series · doi:10.1007/978-3-319-33525-4 · Cited by 159
A Risk Register Database System to aid the management of project risk
Patterson, F. D., & Neailey, K. (2002) · International Journal of Project Management · doi:10.1016/s0263-7863(01)00040-0 · Cited by 149 · cited 1×
“of heavily regulated industries tend to take a risk-based approach. They work with product teams to ask "what could go wrong" at each step of a process and use that to build a risk register [59]. This allows risks to rise to the surface in a way that is informed by the people who know these processes and sys…”
BackgroundCuccaro-Alamin, S., Foust, R., Vaithianathan, R., & Putnam-Hornstein, E. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.06.027 · Cited by 145 · cited 1×
“The first (hypothetical) client wishes to develop a child abuse screening tool similar to that of the real cases extensively studied and reported on [11, 14, 15, 21, 25, 36].”
Reliability and Safety Engineering
Verma, A. K., Ajit, S., & Karanki, D. R. (2015) · Springer series in reliability engineering · doi:10.1007/978-1-4471-6269-8 · Cited by 139 · cited 1×
“hile not without faults, safety-critical and regulated industries such as aerospace and medicine have long traditions of auditable processes and design controls that have dramatically improved safety [77, 81]. 3.1 Aerospace Globally, there is one commercial airline accident per two million flights [63]. This remarkabl…”
BackgroundInfluentialInternational Journal of Project Management
Bredillet, C. N. (2004) · International Journal of Project Management · doi:10.1016/j.ijproman.2004.03.003 · Cited by 136
Evolution of Auditing: From the Traditional Approach to the Future Audit
Byrnes, P., Alawadhi, A. S., Gullvist, B., et al. (2018) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-78743-413-420181014 · Cited by 134
(2003) · ANU Open Research (Australian National University) · Cited by 123
Ethics and the Auditing Culture: Rethinking the Foundation of Accounting and Auditing
Satava, D., Caldwell, C., & Richards, L. (2006) · Journal of Business Ethics · doi:10.1007/s10551-005-0556-y · Cited by 118 · cited 1×
“In finance, for example, it became clear that any sense of dishonesty or non-transparency in audit methodology would lead audit targets to dismiss rather than act on results [66].”
BackgroundWells, A. T. (1991) · Medical Entomology and Zoology · Cited by 111
Keddell, E. (2019) · Social Sciences · doi:10.3390/socsci8100281 · Cited by 109 · cited 1×
“The first (hypothetical) client wishes to develop a child abuse screening tool similar to that of the real cases extensively studied and reported on [11, 14, 15, 21, 25, 36].”
Shah, H. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0362 · Cited by 101 · cited 1×
“Ultimately, internal audits complement external accountability, generating artifacts or transparent information [70] that third parties can use for external auditing, or even end-user communication.”
BackgroundGiven enough eyeballs, all bugs are shallow? Revisiting Eric Raymond with bug bounty programs
Maillart, T., Zhao, M., Grossklags, J., & Chuang, J. (2017) · Journal of Cybersecurity · doi:10.1093/cybsec/tyx008 · Cited by 93 · cited 1×
“lgorithmic auditing has started to become similar in spirit to the well-established practice of bug bounties, where external hackers are paid for finding vulnerabilities and bugs in released software [46]. These audits, modeled after intervention strategies in information security and finance [62], have significantly…”
BackgroundIEEE Standard for Software Reviews and Audits
(2008) · IEEE Standards · doi:10.1109/ieeestd.2008.4601584 · Cited by 87
Perception on justice, trust and tax compliance behavior in Malaysia
Faizal, S. M., Palil, M. R., Maelah, R., & Ramli, R. (2017) · Kasetsart Journal of Social Sciences · doi:10.1016/j.kjss.2016.10.003 · Cited by 84 · cited 1×
“…is a repeatedly observed phenomenon in tax compliance auditing, where several international surveys of tax compliance demonstrate that a fixed and vetted tax audit methodology is one of the most effective strategies to convince companies to respect audit results and pay their full taxes [22, 53].”
BackgroundAI Ethics – Too Principled to Fail?
Mittelstadt, B. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3391293 · Cited by 82 · cited 2×
“However, the AI industry lacks proven methods to translate principles into practice [49], and AI principles have been criticized for being vague and providing little to no means of accountability [27, 82].”
Linking Artificial Intelligence Principles
Zeng, Y., Lu, E., & Huangfu, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04814 · Cited by 71 · cited 1×
“Nevertheless, such principles are becoming common methods to define the ethical priorities of an organization and thus the operational goals for which to aim [34, 83].”
BackgroundThe Financialization of the Firm: Managerial and Social Implications
Styhre, A. (2015) · doi:10.4337/9781783478231 · Cited by 70
Price, W. (2017) · Michigan Law Review · doi:10.36644/mlr.116.3.regulating · Cited by 64 · cited 1×
“The intended use of a “device” (or, increasingly in medicine, an algorithm—see [60] for more) determines the level of design control required: for example, a tongue depressor (a simple piece of wood) is the lowest class of risk (Class I), while a deep brain implant would be the highest (Class III).”
BackgroundImproving fairness in machine learning systems: What do industry practitioners need?
Holstein, K., Vaughan, J. W., Daumé, H., Dudík, M., & Wallach, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.05239 · Cited by 50
On the Application of the Borel-Cantelli Lemma
Chung, K. L., & Erdős, P. (1952) · Transactions of the American Mathematical Society · doi:10.2307/1990661 · Cited by 41
Lynch, A. H., & Veland, S. (2018) · The MIT Press eBooks · doi:10.7551/mitpress/10945.001.0001 · Cited by 39 · cited 1×
“In environmental studies, Lynch and Veland [45] introduced the concept of urgent governance , distinguishing between auditing for system reliability vs societal harm.”
Background(1995) · RePEc: Research Papers in Economics · Cited by 36
Unexpected challenges in large scale machine learning
Parker, C. (2012) · Proceedings of the 1st International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications · doi:10.1145/2351316.2351317 · Cited by 36 · cited 1×
“However, as [58] and [31] point out, the design, prototyping and maintenance of”
BackgroundBennaceur, A., Tun, T. T., Yu, Y., & Nuseibeh, B. (2019) · Springer eBooks · doi:10.1007/978-3-030-00262-6_2 · Cited by 36
A Broader View on Bias in Automated Decision-Making: Reflecting on Epistemology and Dynamics
Dobbe, R., Dean, S., Gilbert, T. K., & Kohli, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00553 · Cited by 35
Information Cultures in the Digital Age
(2016) · Springer eBooks · doi:10.1007/978-3-658-14681-8 · Cited by 32
Merler, M., Ratha, N., Feris, R. S., & Smith, J. R. (2019) · arXiv · doi:10.48550/arxiv.1901.10436 · Cited by 30
Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
Kiritchenko, S., & Mohammad, S. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04508 · Cited by 28
The Enterprise Risk Management and the Risk Oriented Internal Audit
Liu, J. (2012) · iBusiness · doi:10.4236/ib.2012.43036 · Cited by 26 · cited 1×
“Audits are tools for interrogating complex processes, often to determine whether they comply with company policy, industry standards or regulations [43].”
MethodFurner, J. (2016) · Information Cultures in the Digital Age · doi:10.1007/978-3-658-14681-8_17 · Cited by 26 · cited 1×
“arate from a social context is therefore to make a category error, or as we posit here, an abstraction error." What we consider data is already an interpretation, highly subjective and contested [23]. Metrics must be understood in relation to the engineering context in which they were developed and the social con…”
BackgroundResponsible Innovation in Finance: Directions and Implications
Muniesa, F., & Lenglet, M. (2013) · doi:10.1002/9781118551424.ch10 · Cited by 24 · cited 1×
“data and algorithms played a large role [52, 54, 57].”
Audits in real time for safety in critical care: Definition and pilot study
Sirgo, G., Cabases, M. O., Delgado, M. C. M., Esteban-Reboll, F., Peris, A. P., & Saera, M. B. (2014) · Medicina Intensiva · doi:10.1016/j.medin.2013.11.008 · Cited by 23
Judas, P. A., & Prokop, L. E. (2011) · Innovations in Systems and Software Engineering · doi:10.1007/s11334-011-0142-7 · Cited by 20 · cited 1×
“As modern avionic systems have increased in size and complexity (for example, the Boeing 787 software is estimated at 13 million lines of code [35]), the standard 1-in-1,000,000,000 per use hour maximum failure probability for critical aerospace systems remains an underappreciated engineering…”
BackgroundDesign Controls for the Medical Device Industry
Teixeira, M. B. (2019) · CRC Press eBooks · doi:10.1201/9781351261487 · Cited by 17
Probability: A Very Short Introduction
Haigh, J. (2012) · Cited by 13
A Taxonomy of Police Technology’s Racial Inequity Problems
Moy, L. (2019) · doi:10.2139/ssrn.3340898 · Cited by 13 · cited 1×
“However, such audits tend to be conducted after model deployment, when the system has already negatively impacted users [26, 51].”
BackgroundQuality Assurance of Chemical Measurements
Ziegel, E. R., & Taylor, J. K. (1989) · Technometrics · doi:10.2307/1270011 · Cited by 12
Probability: A Very Short Introduction
Haigh, J. (2012) · doi:10.1093/actrade/9780199588480.001.0001 · Cited by 9
Design controls for the medical device industry
Teixeira, M. B., Teixeira, M., & Bradley, R. (2013) · doi:10.1201/b16016 · Cited by 9
Lehman, J. (2020) · Genetic and evolutionary computation · doi:10.1007/978-3-030-39958-0_10 · Cited by 7
Distributed System Design Checklist
Hall, B., & Driscoll, K. R. (2014) · NASA STI Repository (National Aeronautics and Space Administration) · Cited by 5
Lehman, J. (2019) · arXiv · doi:10.48550/arxiv.1906.10189 · Cited by 3
Principles of Quality Assurance
Taylor, J. K. (2018) · Routledge eBooks · doi:10.1201/9780203741610-11 · Cited by 2
The Unfinished Business of Governance
Styhre, A. (2018) · Edward Elgar Publishing eBooks · doi:10.4337/9781788113144 · Cited by 1
The unfinished business of governance: towards new governance regimes
Styhre, A. (2018) · doi:10.4337/9781788113144.00013 · Cited by 1 · cited 1×
“assumptions and values the metrics apprehend [75].”
Artificial Intelligence: the global landscape of ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · arXiv · doi:10.48550/arxiv.1906.11668
Styhre, A. (2015) · The Financialization of the Firm · doi:10.4337/9781783478231.00007
Research works printed but not linked: 7
- Virginia Eubanks . 2018. A child abuse prediction model fails poor families. Wired Magazine ( 2018 ). Virginia Eubanks. 2018. A child abuse prediction model fails poor families. Wired Magazine (2018).
- Jeremy Goldhaber-Fiebert and Lea Prince . 2019. Impact Evaluation of a Predictive Risk Modeling Tool for Allegheny CountyâĂŹs Child Welfare Office . Pittsburgh : Allegheny County.[Google Scholar ] ( 2019 ). Jeremy Goldhaber-Fiebert and Lea Prince. 2019. Impact Evaluation of a Predictive Risk Modeling Tool for Allegheny CountyâĂŹs Child Welfare Office. Pittsburgh: Allegheny County.[Google Scholar] (2019).
- Nitin Kohli , Renata Barreto , and Joshua A Kroll . 2018 . Translation Tutorial: A Shared Lexicon for Research and Practice in Human-Centered Software Systems. In 1st Conference on Fairness, Accountability, and Transparancy . New York, NY, USA. 7. Nitin Kohli, Renata Barreto, and Joshua A Kroll. 2018. Translation Tutorial: A Shared Lexicon for Research and Practice in Human-Centered Software Systems. In 1st Conference on Fairness, Accountability, and Transparancy. New York, NY, USA. 7.
- Joshua A Kroll , Solon Barocas , Edward W Felten , Joel R Reidenberg , David G Robinson , and Harlan Yu . 2016 . Accountable algorithms . U. Pa. L. Rev. 165 (2016), 633 . Joshua A Kroll, Solon Barocas, Edward W Felten, Joel R Reidenberg, David G Robinson, and Harlan Yu. 2016. Accountable algorithms. U. Pa. L. Rev. 165 (2016), 633.
- Institute of Internal Auditors. Research Foundation and Institute of Internal Auditors . 2007 . The Professional Practices Framework. Inst of Internal Auditors . Institute of Internal Auditors. Research Foundation and Institute of Internal Auditors. 2007. The Professional Practices Framework. Inst of Internal Auditors.
- Christian Sandvig , Kevin Hamilton , Karrie Karahalios , and Cedric Langbort . 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry 22 ( 2014 ). Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry 22 (2014).
- Tim Vanderveen . 2005 . Averting highest-risk errors is first priority . Patient Safety and Quality Healthcare 2 (2005), 16 -- 21 . Tim Vanderveen. 2005. Averting highest-risk errors is first priority. Patient Safety and Quality Healthcare 2 (2005), 16--21.
Cited by
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
The false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724
Shneiderman, B. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3419764 · Cited by 768
“However, they can produce important internal efforts such as Google’s internal review and algorithmic auditing framework [92] (see Section 3.”
Background
Metadata
- Authors
- Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P.
- Affiliations
- Partnership on AI
- Google (United States) (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 33-44
- OpenAlex
- W3001807593
- Cited by
- 2,245
- References
- 83
- Citations by year
- 2026: 1097 · 2025: 454 · 2024: 243 · 2023: 177 · 2022: 149 · 2021: 99 · 2020: 24
- FWCI
- 35.91
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- AI accountability, algorithmic auditing, harm detection, algorithmic transparency, societal impact of AI, algorithmic governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.