Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing
Open accessThe DOI matches its Crossref record; 96 of the 97 references it cites were found in a registry or an index, and 1 are not checked yet; 11 of the 44 sources its claims cite were checked for support.
Abstract
Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited for harm by investigators from outside the organizations deploying the algorithms. However, it remains challenging for practitioners to identify the harmful repercussions of their own systems prior to deployment, and, once deployed, emergent issues can become difficult or impossible to trace back to their source.
Verified 2026-11-19 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
The paper proposes SMACTR, an end-to-end internal algorithmic auditing framework intended to help organizations assess AI systems against declared ethical principles throughout development. It argues that internal audits can complement external accountability by providing pre-deployment access, structured documentation, and risk analysis drawn from aerospace, medical device, and finance practices.
Key findings
- Introduces SMACTR—Scoping, Mapping, Artifact Collection, Testing, and Reflection—as five audit stages, each with documentation requirements that together form an overall audit report and assess decisions against organizational values or AI principles.
- Argues external audits are limited by lack of access to internal processes, intermediate models, and training data, while internal audits can enable proactive pre-deployment intervention and generate artifacts for external review.
- Draws lessons from other industries, citing aerospace’s one commercial airline accident per two million flights, Boeing 787 software estimated at 13 million lines of code, and a 1-in-1,000,000,000 per use hour maximum failure probability for critical aerospace systems; also cites medical-device design controls and finance internal audit infrastructure.
- Uses hypothetical cases—a child abuse screening tool and a smile-detection photo booth—to illustrate the framework; for the smile detector’s CelebA datasheet, it reports 58.1% female and 42% male labels, 77.8% aged 0–45 and 22.1% over 46, and 14.2% lighter-skinned versus 85.8% darker-skinned.
Methods
- Conceptual framework paper: develops SMACTR from auditing practices and artifacts in aerospace, medical devices, and finance, plus responsible-innovation dimensions of anticipation, reflexivity, inclusion, and responsiveness.
- Uses a hypothetical Company X Inc. consultancy with two invented client projects—a child abuse screening tool and Happy-Go-Lucky Inc.’s smile-detection photo booth—to demonstrate audit stages and artifacts; a worked example for the smile case is provided as supplementary material.
- Analysis is narrative and design-oriented, referencing existing standards and tools such as FMEA, model cards, datasheets, design controls, and design history files; no empirical sample or quantitative evaluation is reported.
Limitations
- The paper states that internal auditors necessarily share an organizational interest with the audit target, making an independent and objective viewpoint challenging; audits are not an objective “view from nowhere” and risk becoming reputation management.
- The paper states that internal audits are only one aspect of a broader system of required quality checks and balances, and that determining what systems to audit and why is not covered and is a separate research topic.
- Evident from the text: the framework is not empirically validated, the illustrative cases are hypothetical, and no real deployment outcomes or measured audit effectiveness are reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
9 Valid · 6 Not valid · 27 Not checked · 30 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“While not without faults, safety-critical and regulated industries such as aerospace and medicine have long traditions of auditable processes and design controls that have dramatically improved safety [77,81].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 3 LESSONS FROM AUDITING PRACTICES IN OTHER INDUSTRIES
What the sources say
- Not checked — no full text of the sourcecites [77] matched to “Design controls for the medical device industry” (2013) source
- Could not verifycites [81] matched to “The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions” (2019) sourceExperimental — accuracy not yet measured
The Introduction and §3 discuss biomedical ethics and standards or regulation, but do not say that aerospace or medicine has long used auditable processes and design controls, or that these dramatically improved safety. Searches for aerospace, auditable processes, design controls, and safety-critical industries found no passage addressing that claim. Page numbers are unavailable in our copy. (LLM, conf=0.76)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This is a repeatedly observed phenomenon in tax compliance auditing, where several international surveys of tax compliance demonstrate that a fixed and vetted tax audit methodology is one of the most effective strategies to convince companies to respect audit results and pay their full taxes [22,53].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 2.3 Audit Integrity and Procedural Justice
What the sources say
- Partly supportedcites [22] matched to “Perception on justice, trust and tax compliance behavior in Malaysia” (2017) sourceExperimental — accuracy not yet measured
The Regression Test section reports that Malaysian respondents would be more compliant if tax authorities treated them fairly in tax procedures. The Research Methodology section describes a questionnaire of academics, not several international surveys of companies. The paper does not establish that a fixed, vetted audit methodology is especially effective at securing acceptance of audit results or full tax payment. (LLM, conf=0.86)
- Partly supportedcites [53]Experimental — accuracy not yet measured
The “Justice in the taxation context” section reports that taxpayers are generally more compliant when treated fairly and respectfully, and the General discussion links perceived unfair treatment to resistance to paying back tax (page numbers unavailable). It does not establish that a fixed, vetted audit methodology is among the most effective strategies, or report international surveys demonstrating that effect for companies. (LLM, conf=0.83)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Traditional metrics for artificial intelligence like loss may conceal fairness concerns, social impact risks or abstraction errors [69].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 4.3.2 Artifact: Ethnographic Field Study.
What the sources say
- Supportedcites [69] matched to “Fairness and Abstraction in Sociotechnical Systems” (2019) source
The Introduction (page not provided) says that narrow assessments of machine-learning performance abstract away social context and can miss information needed for fair outcomes—an abstraction error. The Formalism Trap section adds that mathematical measures cannot capture the full range of fairness concerns, while the Takeaways discuss unintended social consequences. The paper names AUC, precision and recall rather than loss, but the claim uses loss as an illustrative metric. (LLM, conf=0.88)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Internal auditors' direct access to systems can thus help extend traditional external auditing paradigms by incorporating additional information typically unavailable for external evaluations to reveal previously unidentifiable risks.”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 2.4 The Internal Audit
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“The essential inclusion of independent domain experts and marginalized groups in the ethical review process “has the potential to lead to more rigorous critical reflection because their experiences will often be precisely those that are most needed in identifying problematic background assumptions and revealing limitations with research questions, models, or methodologies” [33].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 4.2.1 Artifact: Ethical Review of System Use Case.
What the sources say
- Not checked — no full text of the sourcecites [33] matched to “25 Years of Feminist Empiricism and Standpoint Theory: Where Are We Now?” (2010) source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
19 more claims
Create a free account to see all 72 claims and every source verdict.
- It may state two separate claims as one. 25
- Probably not a substantial claim. 37
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This disparity poses risks, as practitioners may unintentionally embed their own biases into AI system design and implementation (Martin 2019;Raji et al. 2020).”
From Accountability in Government Use of AI : Citizen Concerns and Preferences (2025) · cites this paper as Raji et al. 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Work on AI safety and reproducibility has long pointed out the crucial importance of training data for understanding model performance, ensuring reproducibility, and assessing legal exposure [2, 25, 29, 46, 58].”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [46]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While there is a growing interest in auditing algorithmic systems [125,126,128,138,154], this feld generally lacks defned standards and records could be incomplete or not relating to information needed for accountability purposes [15,127].”
From Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service” (2023) · cites this paper as [128]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Raji et al. (2020) proposed an internal algorithmic auditing framework spanning data collection, model development, testing, deployment, and monitoring, with stage-specific artifacts that enable traceability and accountability.”
From The Impact of Structured Validation and Audit Frameworks on the Fairness and Efficiency of AI-Driven Hiring Systems (2025) · cites this paper as Raji et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Practical approaches to implement such ideas typically revolve around the systematic collection and curation of data on various aspects of systems [2, 28, 46].”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [46]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747 · cited 1×
“A hypothetical datasheet for this system is filled out using studies on the CelebA dataset, with which the smile detector is built [44, 47].”
MethodThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Product development: Past research, present findings and future directions
Brown, S. L., & Eisenhardt, K. M. (1995) · The Academy of Management Review · doi:10.2307/258850 · Cited by 3,777 · cited 1×
“There are also intersections between this framework and just efective product development theory [5], as many of the components of audit design refocus the product development process to prioritize the user and their ultimate well-being, resulting in a more efective product performance outcome.”
Background(2018) · Cited by 3,510
Christiane, Druml, Wolzt, & Pleiner (2001) · Acta Scientiarum Naturalium Universitatis Sunyatseni · Cited by 3,419
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196
Developing a framework for responsible innovation
Stilgoe, J., Owen, R., & Macnaghten, P. (2013) · Research Policy · doi:10.1016/j.respol.2013.05.008 · Cited by 3,184 · cited 1×
“To design our audit procedure, we suggest complementing formal risk assessment methodologies with ideas from responsible innovation, which stresses four key dimensions: anticipation, reflexivity, inclusion and responsiveness [73], as well as system-theoretic concepts that help grapple with increasing complexity and co…”
MethodAlgorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Self-citation(2014) · Journal of the Korean Medical Association · doi:10.5124/jkma.2014.57.11.899 · Cited by 2,566
Research works printed but not linked: 7
- Virginia Eubanks. 2018. A child abuse prediction model fails poor families. Wired Magazine (2018).
- Jeremy Goldhaber-Fiebert and Lea Prince. 2019. Impact Evaluation of a Predictive Risk Modeling Tool for Allegheny CountyâĂŹs Child Welfare Office. Pittsburgh: Allegheny County.[Google Scholar] (2019).
- Nitin Kohli, Renata Barreto, and Joshua A Kroll. 2018. Translation Tutorial: A Shared Lexicon for Research and Practice in Human-Centered Software Systems. In 1st Conference on Fairness, Accountability, and Transparancy. New York, NY, USA. 7.
- Joshua A Kroll, Solon Barocas, Edward W Felten, Joel R Reidenberg, David G Robinson, and Harlan Yu. 2016. Accountable algorithms. U. Pa. L. Rev. 165 (2016), 633.
- Institute of Internal Auditors. Research Foundation and Institute of Internal Au- ditors. 2007. The Professional Practices Framework. Inst of Internal Auditors.
- Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry 22 (2014).
- Tim Vanderveen. 2005. Averting highest-risk errors is first priority. Patient Safety and Quality Healthcare 2 (2005), 16-21.
Cited by
Items 1,001–1,100 of 1,413
Personalized Bias Assessment in LLM-Based Financial Fraud Detection Systems
Win, K. Z. N. (2026) · IEEE Conference on Computer Applications (ICCA) · doi:10.1109/icca69280.2026.11485691
“In the financial domain, Raji et al. (2020) discussed that biased credit scoring or fraud detection systems can lead to discrimination against groups based on gender, region or income level [20].”
Govarthan, V., Thangamani, M., Peter, V., et al. (2026) · doi:10.1109/icoecit68303.2026.11497969
Winiarczyk, J., Dąbrowska, K., Lenkiewicz, E., Żak, J., Rybka, Z., Trynkiewicz, W., Kaczor, M., Maciejewska, A., Omiecińska, M., & Stepinska, M. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.2(50).2026.5257
Weinstein, S. (2026) · International Journal of Law and Management · doi:10.1108/ijlma-08-2025-0368 · Cited by 2
AI-Enabled Project Management: Predictive Intelligence for Decision Support and Risk Mitigation
Gahlawat, M., & Ganatra, R. G. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-1756-2.ch003
The Mirror Problem: Ai Bias As Reflected CognitionPreprint
Ziekenoppasser-Powell, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6638918
Secure Federated LLM Gateways for Metaverse-Enabled Healthcare
Vemana, V. C., Deshpande, L. K., & Saqib, M. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8889-2.ch011
Responsible Black Boxes: How Virtue Ethics Can Bridge the Responsibility Gap in AI
Hällström, H. J., & Gouveia, S. S. (2026) · Springer eBooks · doi:10.1007/978-3-032-15112-4_22
Human-Centered AI for Democracy
Mariani, I., Sacco, S., Rizzo, F., Kyrkou, D., Goga, E., Panagiotidou, G., Chadjipadelis, T. G., Gogos, C., Tzallas, A. T., Papageorgiou, X. S., et al. (2026) · Springer series in design and innovation · doi:10.1007/978-3-032-23948-8_5
Gahlot, P., Pandey, P., & Gupta, P. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-18802-1_29 · Cited by 2
Why Auditability Fails in Current Generative AI Systems: A Governance PerspectivePreprint
Dvořáčková, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6637298
YILDIRIM, A. (2026) · Dumlupınar Üniversitesi Sosyal Bilimler Dergisi · doi:10.51290/dpusbe.1879148 · Cited by 1
Job, C., Paul, C. J., Nwankwo, I. I., Okwudi, C. N., & ONWE, F. C. (2026) · International Journal of Latest Technology in Engineering Management & Applied Science · doi:10.51583/ijltemas.2026.150400055 · Cited by 1
From Classroom to Enterprise: Architectural Patterns for LLM Integration
Moriarty, B. (2026) · IEEE International Systems Conference (SysCon) · doi:10.1109/syscon66367.2026.11503623
“Cyborg architectures offer scalability and cognitive-load reduction but introduce distinct risks: errors may propagate across tightly coupled processes, and responsibility diffuses when actions distribute across components [13], [14].”
Artificial Intelligence in Smart City Governance: Case Studies of Singapore and Barcelona
Zheng, H. (2026) · Journal of Urban Technology · doi:10.1080/10630732.2026.2644136
Gamification for Inclusive Large Language Models
Samimi-Dehkordi, L., Kolahdouz-Rahimi, S., & Fatima, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6063-8.ch003
Integrating AI Into Literature Review Practices
Ayyaz, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-1458-5.ch004
Wang, P., & Taylor, J. (2026) · Journal of Cases in Educational Leadership · doi:10.1177/15554589261430684
Khlud, V. (2026) · Applied Decision Analytics · doi:10.66972/ada21202624 · Cited by 2
Safe-By-Design Clinical LLMs: Formal Risk Models and Silent-Trial Protocols for Workflow Integration
Gayapu, C. T. (2025) · Macaw International Journal of Advanced Research in Computer Science and Engineering · doi:10.70162/mijarcse/2025/v11/i2/v11i202
“Structured measures can provide structured models to quantify uncertainties and any likely harm, as opposed to contemporary models that enable real-world data validation, avoiding any direct impact on clinical data [3].”
Ethical and Legal Challenges in AI-Based Diagnosis and Treatment
Mishra, S., & Gupta, P. (2026) · Cognitive systems monographs · doi:10.1007/978-3-032-18782-6_9
Dijital Dönüşümde Adaletin Kavramsal Çerçevesi: Algoritmik Önyargı ve Yapısal Yönetişim Arayışı
Ayan, M. A. (2026) · Ankara Üniversitesi SBF Dergisi · doi:10.33630/ausbf.1812108
AI-Driven Entrepreneurship: Catalyzing Green and Inclusive Growth in Africa
Edogun, D. I. (2026) · Frontiers in African business research · doi:10.1007/978-981-95-9500-6_3
Kasneci, G., & Kasneci, E. (2026) · AI and Ethics · doi:10.1007/s43681-026-01132-0 · Cited by 5
“As AI-generated content saturates core workflows, the danger is not only error, but the weakening of traceability, contestability, expertise, and accountability across the deployment chain (Alfrink et al., 2023; Casper et al., 2024; Cobbe et al., 2021, 2023; Raji et al., 2020).”
InfluentialIrwansyah, I., Syahputri, I. W., & Syahputra, I. W. (2026) · Discover Education · doi:10.1007/s44217-026-02038-z
Hegberg, A., Setor, T. K., & Joseph, D. (2026) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/3768310.3807790 · Cited by 1
“…need lightweight controls that address both who is represented and how they are represented at the same time, consistent with lifecycle views that locate harms in early design stages rather than only in downstream allocation audits (Chien & Danks, 2024; Raji et al., 2020; Suresh & Guttag, 2021).”
InfluentialMoral Foundations for Infinite Digital Realities
Nwasra, N. M., & Alsalemi, A. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-6721-7.ch011
Ghatak, A., & Nagraj, P. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6587-9.ch002
Mitigating Bias in AI-Generated Responses
Jain, V., & Mitra, A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0250-8.ch007
Artificial Intelligence and Diversity, Equity, and Inclusion
Garard, J., Ezirigwe, J., & Ayoub, M. (2025) · Springer eBooks · doi:10.1007/978-3-031-32257-0_72-1
Ahn, M. J. (2025) · Public administration, governance and globalization · doi:10.1007/978-3-032-00514-4_21 · Cited by 1
Let’s Talk AI with Computer Science Expert Taylor T. Johnson
Johnson, T. T., & Steffen, B. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09008-9_15
Ahmadi, R., & Ghamisi, K. (2026) · Urban Science · doi:10.3390/urbansci10050275
Robo-Advisory and Auditing: Internal and External Controls
Farahani, A. H., & Nahidi, N. (2026) · Contributions to finance and accounting · doi:10.1007/978-3-032-18109-1_9
Zhu, Y., & Leonard, J. (2026) · Applied Sciences · doi:10.3390/app16104917
Preserving attribution and accountability in AI-scale systems
Gahl, F. C. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01415-9
Codecard: Leveraging LLMs to Evaluate AI Model Code Development with the System Cards Framework
Bahiru, T. K., & Kakadiaris, I. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-19865-5_22
Designing Human-Centered AI Experiences
Karthik, H., & Kore, A. (2026) · Springer eBooks · doi:10.1007/978-981-95-3658-0_33 · Cited by 2
Human-Centered and Participatory AI Auditing
Deng, W. H., Holstein, K., & Eslami, M. (2026) · Springer eBooks · doi:10.1007/978-981-95-3658-0_102 · Cited by 1
Павлов, Р., & Павлова, Т. (2026) · International Journal of Managing Projects in Business · doi:10.1108/ijmpb-08-2025-0352 · Cited by 2
AI Learns from Silence: Hierarchical Reporting, Data Quality, and Responsible AI GovernancePreprint
Harid, S. A. E. H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6748543
Vukmirović, D., Radojičić, S., Stanojević, N. D., Dragović, N., & Comic, T. (2026) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-032-20948-1_5 · Cited by 1
Gangrade, M., & Sivasamy, S. (2026) · International Conference on Smart Multidomain Integrated Learning Environments (ICSMILE) · doi:10.1109/icsmile69273.2026.11519239
Human-AI Interaction Requirements in Public Sector Procurements
Abbasi, M. A., Mikkonen, T., Pirinen, S., & Koski, A. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-26363-6_26 · Cited by 2
“Accountability & Traceability Accountability and traceability refer to the ability to reconstruct, audit, and attribute AI-supported decisions and actions to human and system actors[13].”
Critical Domains of AI Deployment: Ethical Stakes and Engineering Challenges
Andrade, R., Ayala, C., & Morillo, P. (2026) · Synthesis lectures on computer science · doi:10.1007/978-3-032-25789-5_1
Designing Innovation for Equity: Building Inclusive and Justice-Oriented Ecosystems
Singha, R., Gangwar, P., Gaur, R., Breja, M., Sharma, V., Natal, M. S., Singha, S., Ruben, V. M., & Riba, M. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-6355-4.ch006
Chheang, S., Chay, C., Huot, S., Phin, K., Loch, S., Hok, C., & Tep, P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-0467-8.ch013
Agentic AI Implementation for the Procurement: Roadmap and Lessons Learned
Nicoletti, B. (2026) · Springer eBooks · doi:10.1007/978-3-032-23024-9_14
TOXICHECK: A Unified Framework for Bias and Toxicity Evaluation in Large Language Models
Nandhakumar, C., & Vaishali, R. (2026) · International Conference on Artificial Intelligence and Machine Learning Applications Theme: Healthcare and Internet of Things (AIMLA) · doi:10.1109/aimla67915.2026.11522381
Sincerity as ethical alignment to reconstruct the moral foundation of AI ethics
Iwao, T., Nemoto, Y., Surantha, N., Suzuki, K., Takahashi, A., Ito, M., Zoka, Y., & Amau, T. (2026) · AI & Society · doi:10.1007/s00146-026-03098-3
“This operational perspective is consistent with prior work on accountable and experimentalist governance, in which ethical and institutional capacities are developed iteratively through design, deployment, auditing, and revision (Raji et al. 2020).”
AI hallucinations as enterprise risk: Governance, audit, and accountability perspectives
Agarwal, P., Sharma, N., Sati, M., -, S. R., & Didwania, M. (2026) · EDPACS · doi:10.1080/07366981.2026.2677215
Anica-Popa, I., Tudor, C. T. L. G., Anica-Popa, L.-E., & Vrîncianu, M. (2026) · Electronics · doi:10.3390/electronics15112280 · Cited by 1
Bias Beyond the Prompt: Reinforcing Stereotypes Using AI Image Generator
Nair, S. S., & Babu, S. (2026) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom70271.2026.11525730
“Through a systematic analysis of demographic, occupational and emotional stereotyping using neutral input prompts, the study challenges the assumption that input will produce output based on input and adds to the debate regarding the responsibility and fairness of algorithms [6][20].”
Vemula, S. (2026) · Artificial intelligence · doi:10.5772/intechopen.1015310
ESG-Driven Robo-Advisory Systems in Green FinTech
Rashid, A. H. A., Kumar, P. M. A., & Rekha, B. J. (2026) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom70271.2026.11525691
Applications of Behavioural Data Science
Pogrebna, G. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108939010.036
Pogrebna, G., & Hills, T. T. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108939010.035
Voß, M., & Döring, L. (2026) · Cambridge Forum on AI Law and Governance · doi:10.1017/cfl.2025.10040
Ethical Concerns and Bias in Educational Machine Learning Systems
Khan, R. S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7467-3.ch004
Rajput, A., & Tandur, S. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-2178-1.ch003
Fumega, S., & Gao, F. (2026) · Data & Policy · doi:10.1017/dap.2026.10069
“– Defining accountability: How should accountability be defined and distributed in a process heavily reliant on AI-generated content, especially when errors in assessment could have policy implications (see, e.g., Raji et al., 2020)?”
Falcon, G., & Registre, J. F. R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6850329
Cybersecurity Copilots and Digital Sovereignty in Security Operations Centers
Khan, A. U., yar, M. A., & Anshari, M. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-0288-9.ch003
Artificial Intelligence Applications in Library Technology to Student Persistence
Sharma, J. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-2168-2.ch005
Rauchfleisch, A., & Jungherr, A. M. (2026) · New Media & Society · doi:10.1177/14614448261449271 · Cited by 1
Wang, D., & Luo, T. (2026) · Journal of Responsible Innovation · doi:10.1080/23299460.2026.2675074 · Cited by 1
Gender Fairness in Audio Deepfake Detection: Performance and Disparity Analysis
Fursule, A., Kshirsagar, S., & Avila, A. R. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536294 · Cited by 5
“The authors report higher detection accuracy for female voices across several configurations, providing empirical evidence that gender characteristics influence audio deepfake detection performance.”
57Bridging the Gap Between Ethics and Algorithms: Inclusive Leadership in Big Data Environments
Kyriakidou, O. (2025) · De Gruyter eBooks · doi:10.1515/9783111662145-004
Jurisdictional gerrymandering: The Authority of Problems without Solutions
Zilberstein, S. (2026) · Social Problems · doi:10.1093/socpro/spag024
Manchuri, B. (2026) · International Conference on Artificial Intelligence, Systems, and Emerging Technologies (ICAISET) · doi:10.1109/icaiset66439.2026.11542162
Diagnosing Algorithmic Bias in AI-Powered Hiring: Toward a Fairness-Aware Framework
Fan, H., & Wang, S. (2026) · IEEE International Conference on Computing and Machine Intelligence (ICMI) · doi:10.1109/icmi68585.2026.11539889 · Cited by 2
“This approach is grounded in theoretical work that conceptualizes bias as emerging from multiple sources throughout the machine learning pipeline[15], [29], [32].”
Detecting What AI Metrics Miss: A Diagnostic Test for Value-Level Failures
Combe, C. G. (2026) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds70563.2026.00010
“Raji et al.’s accountability framework emphasizes the need for evaluation methods that detect impacts invisible to technical metrics [36].”
OpsAgent: A Governance-Aware Agentic AI Framework for Autonomous Operational Reliability
Muppuri, S., Madugundi, C., & Singh, R. (2026) · International Conference on Artificial Intelligence, Systems, and Emerging Technologies (ICAISET) · doi:10.1109/icaiset66439.2026.11541300 · Cited by 1
Almazroa, A., Alnoamani, W., Almuflih, M., Almanea, N., Alturki, J., Aljobailah, N., & Kurdi, H. A. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.04.184
Explainable Artificial Intelligence in Critical Interactive Systems: Opportunities and Challenges
Fayollas, C., Garouani, M., & Martinie, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-26051-2_6
A Hybrid AI-Blockchain Framework for Secure and Transparent Electoral Systems
Raj, R., Kumar, N., Pandey, P., Tyagi, A. D., & Singh, R. K. (2026) · International Conference on Intelligent Systems in Engineering, Secured Systems and Cybersecurity (ICISESSC) · doi:10.1109/icisessc68634.2026.11542648 · Cited by 30
Lee, G., & Kim, D. (2026) · Journal of Digital Contents Society · doi:10.9728/dcs.2026.27.5.1257
스포츠 공공기관 AI 혁신의 성립 조건과 공공 AI 거버넌스의 한계: 국민체육진흥공단 경륜⋅경정 AI Pick 사례의 성능 비교
김, 필., 이, 상., & 전, 성. (2026) · 한국체육학회지 · doi:10.23949/kjpe.2026.3.65.2.36
Sharma, K., Sharma, P., & Sharma, P. (2026) · Indian Heart Journal · doi:10.1016/j.ihj.2026.06.002 · Cited by 4
An AI-Driven Socio-Technical Framework for Performance Management in Teleworking Environments
Wafa, Y., & Longo, J. (2026) · Administrative Sciences · doi:10.3390/admsci16060272 · Cited by 3
“In this respect, the framework does not claim to empirically evaluate or validate privacy outcomes; rather, it articulates normative and design-oriented guidance informed by established responsible AI and algorithmic governance scholarship (e.g., Raji et al., 2020; Jobin et al., 2019).”
InfluentialShifting Audits Left: A Framework for Enhancing AI Auditability from an Internal Auditing Lens
Jamal, H., Faroukhi, A. Z., Elouataoui, W., Gharib, J., Gahi, Y., & El‐Khatib, K. (2026) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset68627.2026.11538661
“Raji et al. introduce SMACTR, a five-stage, end-to-end internal audit framework that generates audit artifacts at every lifecycle phase and empowers an in-house, interdisciplinary audit team to halt or re-scope high risk models before launch [19].”
AI-Augmented Cybersecurity Crisis Management: Leadership and Best Practices
Alabi, A., Eze, E. C., & Al-Nemrat, A. (2025) · International Conference on Data Analytics for Business and Industry (ICDABI) · doi:10.1109/icdabi67967.2025.11547706
Evaluating the Safety of Medical LLMs for Patient Use
Vishva, R., Fahmitha, F. F., Indhu, S., Gayathri, R., & Saranraj, P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7862-6.ch006
Addressing Challenges and Ethical Considerations in AI-Driven Faculty Development
Dey, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-1285-9.ch002
Mapping a Decade of AI in Human Resource Management (2015–2025): A Bibliometric and Thematic Review
Kirti (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6229-8.ch001
Secure Coding Best Practices for AI Application Development: A Comprehensive Framework Approach
Ramachandran, M. (2026) · Texts in computer science · doi:10.1007/978-3-032-17367-6_14
Singh, S., Kumari, A., Sinha, D., & Nayak, A. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-1674-9.ch010
Bias, Fairness, and Accountability in Forensic AI Systems
Jain, A. K., & Vijay, P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-2278-8.ch005
Tracing moral value drift across large language model generations and their societal implications
Naser, M. (2026) · Technology and Society · doi:10.1016/j.techsoc.2026.103431 · Cited by 1
AI Model Forensics, Regulatory Compliance, and Security Governance
Ramachandran, M. (2026) · Texts in computer science · doi:10.1007/978-3-032-25874-8_11
AI Ethics in Cybersecurity: Designing for Accountability, Trust, and Human Oversight
Ramachandran, M. (2026) · Texts in computer science · doi:10.1007/978-3-032-25874-8_4
Tackling Cybersecurity in the Age of Superintelligence
Ramachandran, M. (2026) · Texts in computer science · doi:10.1007/978-3-032-25874-8_18
Ethical Foundations of AI in Social Work
An, R., & Lindsey, M. A. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6_2
Rethinking corporate responsibility in the age of Artificial Intelligence
Pazdera, M. (2026) · Ethics & bioethics · doi:10.2478/ebce-2026-0006
Sekandary, I., yousafzia, T., & Sangeen, Q. (2026) · Journal of Social Science and Multidisciplinary Enquiry · doi:10.65496/jssme.2026.89
AI in Combating Poverty and Economic Inequality
Zeng, Y., & Singletary, J. E. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6_3
Dixit, A., Manocha, S., Srivastava, J. P., et al. (2025) · doi:10.1109/iccetm66557.2025.11557796
Ethical issues of large language models: a multi-level thematic synthesis of the academic literature
Pervez, H., Minkkinen, M., Jylhä, H., & Mäntymäki, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01173-5 · Cited by 5
Metadata
- Authors
- Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P.
- Affiliations
- Partnership on AI
- Google (United States) (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 33-44
- OpenAlex
- W3001807593
- Cited by
- 2,245
- References
- 83
- Citations by year
- 2026: 1097 · 2025: 454 · 2024: 243 · 2023: 177 · 2022: 149 · 2021: 99 · 2020: 24
- FWCI
- 35.91
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- AI accountability, algorithmic auditing, harm detection, algorithmic transparency, societal impact of AI, algorithmic governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.