Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing
Open accessThe DOI matches its Crossref record; 96 of the 97 references it cites were found in a registry or an index, and 1 are not checked yet; 11 of the 44 sources its claims cite were checked for support.
Abstract
Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited for harm by investigators from outside the organizations deploying the algorithms. However, it remains challenging for practitioners to identify the harmful repercussions of their own systems prior to deployment, and, once deployed, emergent issues can become difficult or impossible to trace back to their source.
Verified 2026-11-19 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
The paper proposes SMACTR, an end-to-end internal algorithmic auditing framework intended to help organizations assess AI systems against declared ethical principles throughout development. It argues that internal audits can complement external accountability by providing pre-deployment access, structured documentation, and risk analysis drawn from aerospace, medical device, and finance practices.
Key findings
- Introduces SMACTR—Scoping, Mapping, Artifact Collection, Testing, and Reflection—as five audit stages, each with documentation requirements that together form an overall audit report and assess decisions against organizational values or AI principles.
- Argues external audits are limited by lack of access to internal processes, intermediate models, and training data, while internal audits can enable proactive pre-deployment intervention and generate artifacts for external review.
- Draws lessons from other industries, citing aerospace’s one commercial airline accident per two million flights, Boeing 787 software estimated at 13 million lines of code, and a 1-in-1,000,000,000 per use hour maximum failure probability for critical aerospace systems; also cites medical-device design controls and finance internal audit infrastructure.
- Uses hypothetical cases—a child abuse screening tool and a smile-detection photo booth—to illustrate the framework; for the smile detector’s CelebA datasheet, it reports 58.1% female and 42% male labels, 77.8% aged 0–45 and 22.1% over 46, and 14.2% lighter-skinned versus 85.8% darker-skinned.
Methods
- Conceptual framework paper: develops SMACTR from auditing practices and artifacts in aerospace, medical devices, and finance, plus responsible-innovation dimensions of anticipation, reflexivity, inclusion, and responsiveness.
- Uses a hypothetical Company X Inc. consultancy with two invented client projects—a child abuse screening tool and Happy-Go-Lucky Inc.’s smile-detection photo booth—to demonstrate audit stages and artifacts; a worked example for the smile case is provided as supplementary material.
- Analysis is narrative and design-oriented, referencing existing standards and tools such as FMEA, model cards, datasheets, design controls, and design history files; no empirical sample or quantitative evaluation is reported.
Limitations
- The paper states that internal auditors necessarily share an organizational interest with the audit target, making an independent and objective viewpoint challenging; audits are not an objective “view from nowhere” and risk becoming reputation management.
- The paper states that internal audits are only one aspect of a broader system of required quality checks and balances, and that determining what systems to audit and why is not covered and is a separate research topic.
- Evident from the text: the framework is not empirically validated, the illustrative cases are hypothetical, and no real deployment outcomes or measured audit effectiveness are reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
9 Valid · 6 Not valid · 27 Not checked · 30 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“While not without faults, safety-critical and regulated industries such as aerospace and medicine have long traditions of auditable processes and design controls that have dramatically improved safety [77,81].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 3 LESSONS FROM AUDITING PRACTICES IN OTHER INDUSTRIES
What the sources say
- Not checked — no full text of the sourcecites [77] matched to “Design controls for the medical device industry” (2013) source
- Could not verifycites [81] matched to “The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions” (2019) sourceExperimental — accuracy not yet measured
The Introduction and §3 discuss biomedical ethics and standards or regulation, but do not say that aerospace or medicine has long used auditable processes and design controls, or that these dramatically improved safety. Searches for aerospace, auditable processes, design controls, and safety-critical industries found no passage addressing that claim. Page numbers are unavailable in our copy. (LLM, conf=0.76)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This is a repeatedly observed phenomenon in tax compliance auditing, where several international surveys of tax compliance demonstrate that a fixed and vetted tax audit methodology is one of the most effective strategies to convince companies to respect audit results and pay their full taxes [22,53].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 2.3 Audit Integrity and Procedural Justice
What the sources say
- Partly supportedcites [22] matched to “Perception on justice, trust and tax compliance behavior in Malaysia” (2017) sourceExperimental — accuracy not yet measured
The Regression Test section reports that Malaysian respondents would be more compliant if tax authorities treated them fairly in tax procedures. The Research Methodology section describes a questionnaire of academics, not several international surveys of companies. The paper does not establish that a fixed, vetted audit methodology is especially effective at securing acceptance of audit results or full tax payment. (LLM, conf=0.86)
- Partly supportedcites [53]Experimental — accuracy not yet measured
The “Justice in the taxation context” section reports that taxpayers are generally more compliant when treated fairly and respectfully, and the General discussion links perceived unfair treatment to resistance to paying back tax (page numbers unavailable). It does not establish that a fixed, vetted audit methodology is among the most effective strategies, or report international surveys demonstrating that effect for companies. (LLM, conf=0.83)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Traditional metrics for artificial intelligence like loss may conceal fairness concerns, social impact risks or abstraction errors [69].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 4.3.2 Artifact: Ethnographic Field Study.
What the sources say
- Supportedcites [69] matched to “Fairness and Abstraction in Sociotechnical Systems” (2019) source
The Introduction (page not provided) says that narrow assessments of machine-learning performance abstract away social context and can miss information needed for fair outcomes—an abstraction error. The Formalism Trap section adds that mathematical measures cannot capture the full range of fairness concerns, while the Takeaways discuss unintended social consequences. The paper names AUC, precision and recall rather than loss, but the claim uses loss as an illustrative metric. (LLM, conf=0.88)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Internal auditors' direct access to systems can thus help extend traditional external auditing paradigms by incorporating additional information typically unavailable for external evaluations to reveal previously unidentifiable risks.”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 2.4 The Internal Audit
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“The essential inclusion of independent domain experts and marginalized groups in the ethical review process “has the potential to lead to more rigorous critical reflection because their experiences will often be precisely those that are most needed in identifying problematic background assumptions and revealing limitations with research questions, models, or methodologies” [33].”
§ Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing > 4.2.1 Artifact: Ethical Review of System Use Case.
What the sources say
- Not checked — no full text of the sourcecites [33] matched to “25 Years of Feminist Empiricism and Standpoint Theory: Where Are We Now?” (2010) source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
19 more claims
Create a free account to see all 72 claims and every source verdict.
- It may state two separate claims as one. 25
- Probably not a substantial claim. 37
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This disparity poses risks, as practitioners may unintentionally embed their own biases into AI system design and implementation (Martin 2019;Raji et al. 2020).”
From Accountability in Government Use of AI : Citizen Concerns and Preferences (2025) · cites this paper as Raji et al. 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Work on AI safety and reproducibility has long pointed out the crucial importance of training data for understanding model performance, ensuring reproducibility, and assessing legal exposure [2, 25, 29, 46, 58].”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [46]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While there is a growing interest in auditing algorithmic systems [125,126,128,138,154], this feld generally lacks defned standards and records could be incomplete or not relating to information needed for accountability purposes [15,127].”
From Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service” (2023) · cites this paper as [128]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Raji et al. (2020) proposed an internal algorithmic auditing framework spanning data collection, model development, testing, deployment, and monitoring, with stage-specific artifacts that enable traceability and accountability.”
From The Impact of Structured Validation and Audit Frameworks on the Fairness and Efficiency of AI-Driven Hiring Systems (2025) · cites this paper as Raji et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Practical approaches to implement such ideas typically revolve around the systematic collection and curation of data on various aspects of systems [2, 28, 46].”
From Rethinking open source generative AI: open washing and the EU AI Act (2024) · cites this paper as [46]
Experimental — accuracy not yet measured
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747 · cited 1×
“A hypothetical datasheet for this system is filled out using studies on the CelebA dataset, with which the smile detector is built [44, 47].”
MethodThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Product development: Past research, present findings and future directions
Brown, S. L., & Eisenhardt, K. M. (1995) · The Academy of Management Review · doi:10.2307/258850 · Cited by 3,777 · cited 1×
“There are also intersections between this framework and just efective product development theory [5], as many of the components of audit design refocus the product development process to prioritize the user and their ultimate well-being, resulting in a more efective product performance outcome.”
Background(2018) · Cited by 3,510
Christiane, Druml, Wolzt, & Pleiner (2001) · Acta Scientiarum Naturalium Universitatis Sunyatseni · Cited by 3,419
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196
Developing a framework for responsible innovation
Stilgoe, J., Owen, R., & Macnaghten, P. (2013) · Research Policy · doi:10.1016/j.respol.2013.05.008 · Cited by 3,184 · cited 1×
“To design our audit procedure, we suggest complementing formal risk assessment methodologies with ideas from responsible innovation, which stresses four key dimensions: anticipation, reflexivity, inclusion and responsiveness [73], as well as system-theoretic concepts that help grapple with increasing complexity and co…”
MethodAlgorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Self-citation(2014) · Journal of the Korean Medical Association · doi:10.5124/jkma.2014.57.11.899 · Cited by 2,566
Research works printed but not linked: 7
- Virginia Eubanks. 2018. A child abuse prediction model fails poor families. Wired Magazine (2018).
- Jeremy Goldhaber-Fiebert and Lea Prince. 2019. Impact Evaluation of a Predictive Risk Modeling Tool for Allegheny CountyâĂŹs Child Welfare Office. Pittsburgh: Allegheny County.[Google Scholar] (2019).
- Nitin Kohli, Renata Barreto, and Joshua A Kroll. 2018. Translation Tutorial: A Shared Lexicon for Research and Practice in Human-Centered Software Systems. In 1st Conference on Fairness, Accountability, and Transparancy. New York, NY, USA. 7.
- Joshua A Kroll, Solon Barocas, Edward W Felten, Joel R Reidenberg, David G Robinson, and Harlan Yu. 2016. Accountable algorithms. U. Pa. L. Rev. 165 (2016), 633.
- Institute of Internal Auditors. Research Foundation and Institute of Internal Au- ditors. 2007. The Professional Practices Framework. Inst of Internal Auditors.
- Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry 22 (2014).
- Tim Vanderveen. 2005. Averting highest-risk errors is first priority. Patient Safety and Quality Healthcare 2 (2005), 16-21.
Cited by
Items 801–900 of 1,412
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_4 · Cited by 1
AI Regulation and EntrepreneurshipPreprint
Mulla, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4986041 · Cited by 1
Integrating AI Into Early Childhood Education: Theory to Practice
Μεταξούδης, Ε. Θ. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-6210-5.ch002 · Cited by 1
Embedded Ethics and the “Soft Impacts” of Technology
Tigard, D. W., Braun, M., Breuer, S., Fiske, A., McLennan, S., & Buyx, A. (2024) · Bulletin of Science Technology & Society · doi:10.1177/02704676241298162 · Cited by 1
“This may prove more effective than waiting for novel systems to reach implementation and forcing regulatory bodies to rush to draft new guidelines (cf. Collingridge, 1980; Raji et al., 2020).”
Volume 7 (2024) Artificial Intelligence and Responsibility
Alnajashi, A. A., DeRise, D., Frana, P. L., McGraw, D. K., Sawyer, A. G., Titareva, T., Zaini, R. M., & Zombron, A. (2024) · International Journal on Responsibility · doi:10.62365/2576-0955.1139 · Cited by 1
Navigating Originality in the Digital Age: Impacts on the Creative and Cultural Industries
Nasta, L. (2025) · Springer eBooks · doi:10.1007/978-3-031-77473-7_4
Feminist Principles for an Inclusive and Transformative Artificial Intelligence
Roupakia, Z., & Navarrete, J. C. (2025) · Canadian Journal of Communication · doi:10.3138/cjc-2024-0020
Ethical issues in data science: a special case study on K-Means clustering
Bishnu, P. S. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-33498-6.00007-8 · Cited by 1
Ethics in Natural Language Processing: Addressing Bias, Privacy, and Misinformation
Joshi, H. S., & Taherdoost, H. (2025) · International Conference on Pervasive Computational Technologies (ICPCT) · doi:10.1109/icpct64145.2025.10941029 · Cited by 1
The Trinity Pillars™ Approach: Ethical Leadership for Ai in Regulated and High-Risk EnvironmentsPreprint
Gilbert, E. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5236557
Integrating Computer Vision and the Internet of Everything (IoE) for Transformative Societal Impact
Kumar, N., Sehgal, R., & Dwivedi, Y. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-8272-1.ch003
Operationalizing AI Ethics - A Quantifiable Framework for Implementation and Assessment
Kumar, D., Singla, B. S., & Choudhary, R. K. (2025) · IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI) · doi:10.1109/iatmsi64286.2025.10985308
“The framework establishes a quantifiable approach for evaluating ethical AI implementation through metrics-driven analysis [12].”
Position: Contextual Confidence and Generative AI
Jain, S., Hitzig, Z., & Mishkin, P. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00022 · Cited by 1
How emerging technologies are reshaping audit success factors
Li, Y. (2023) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/ccnj-pe13
Bias Delayed is Bias Denied? Assessing the Effect of Reporting Delays on Disparity Assessments
Gosciak, J., Balagopalan, A., Ouyang, D., Koenecke, A., Ghassemi, M., & Ho, D. E. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732123 · Cited by 5
Trustworthy ML Regulation as a Principal-Agent Problem
Yaghini, M., Liu, P., Magnuson, A., Dullerud, N., & Papernot, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732211
“In each cell, we highlight the technical issues for each setting and below potential tools to address them. if the company allows for third-party algorithmic audits of its code-base during the training of the model [58].”
Alaali, H. M. H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5315167
Navigating the Tension Between Algorithmic and Human Ethics: Toward a Responsible Balance
Arencibia, M. G., Ordóñez, H., & González-Sanabria, J.-S. (2025) · Revista Facultad de Ingeniería · doi:10.19053/uptc.01211129.v34.n71.2025.19650 · Cited by 1
“Raji et al. [32] propose a framework for auditing algorithms that includes ethical and social impact assessments.”
Seeds of Sovereignty: Designing Regenerative AI for Plural EpistemologiesPreprint
Kadel, A. (2025) · doi:10.31235/osf.io/f9e65_v2
Núñez, R. O. (2025) · Brazilian Journal of Information Science research trends · doi:10.36311/1981-1640.2025.v19.e025020 · Cited by 2
Disruptive technology in human resource management
Savitri, C. A. (2025) · Technology Analysis and Strategic Management · doi:10.1080/09537325.2025.2531513
“For example, the potential for algorithmic bias in AI-based recruitment tools (e.g., screening based on age, gender, race) is a significant ethical concern that must be addressed through algorithmic accountability (Binns 2018; Raji et al. 2020).”
García-López, I. M., Soledad, M., & Espinosa, J. M. M. (2025) · Lecture notes in educational technology · doi:10.1007/978-981-96-5658-5_131
Appiah, J. M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5335093
Chitamba, A., Ngidi, L. Z., & Bangura, S. (2025) · International Journal of Business Ecosystem and Strategy (2687-2293) · doi:10.36096/ijbes.v7i3.823 · Cited by 1
“Researchers stress the importance of conducting fairness audits and establishing accountability measures to mitigate these risks (Raji et al., 2020).”
Accountability of Robust and Reliable AI-Enabled Systems: A Preliminary Study and Roadmap
Scaramuzza, F., Tamburri, D. A., & van den Heuvel, W. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-7423-7_23
Kilari, S. D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5357669 · Cited by 1
Code and Character: The Ethical Journey of Artificial Intelligence
Gündüz, A. Y. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-1702-1.ch001
Artificial Intelligence Ethics in Communication: Challenges and Future Perspectives
YAZICI, T. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-1702-1.ch002 · Cited by 2
Gender and Artificial Intelligence: Challenges and Imminent Possibilities
Souto-Romero, M., Arias-Oliva, M., Murata, K., & Rua, O. L. (2024) · Investigaciones Feministas · doi:10.5209/infe.98150 · Cited by 1
Towards Transparent Ethical AI: A Roadmap for Trustworthy Robotic Systems
Farooq, A., & Iqbal, K. (2025) · International Conference on Robotics, Control and Vision Engineering (RCVE) · doi:10.1145/3747393.3747400 · Cited by 2
“This lack of transparency leads to numerous challenges, such as difficulties in detecting and correcting biases, challenges in verifying compliance with ethical and legal standards, reduced public trust, and obstacles in conducting effective ethical reviews and audits [29, 33, 35].”
Unblackboxing How Sociotemporalities Inform AI Accountability: The Case of Targeted Advertising
Hardcastle, F., Henne, K., Harb, J. I., Lee, A., Viaña, J. N. M., & Halford, S. (2025) · Social Science Computer Review · doi:10.1177/08944393251365275 · Cited by 1
“As other scholars observe, operationalizing transparency requires substantial time for research, comprehension, deliberation, and implementation (Raji et al., 2020).”
The Birth of the Synthetic OutlawPreprint
Gropper, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5377943
Integrating Intelligence and Practical Applications of AI and Big Data in Modern HR Practices
Pushpalatha, S., & Duraipandian, R. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4017-3.ch008
Reyes-Sánchez, J. D. J. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-5142-1.ch006
Embedding Ethical Principles into Generative AI Workflows for Project TeamsPreprint
Viswanathan, V. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5371126
Embedded Accountability Architecture for AI Governance: The Syntactic Ethics FrameworkPreprint
Yu, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5335485
Sousa, N. M. T. (2025) · Brazilian Journal of Information Science research trends · doi:10.36311/1981-1640.2025.v19.e025023 · Cited by 1
Jain, A., Shaheen, Z., Juneja, D., & Ulhe, A. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3078-5.ch004 · Cited by 1
Ai in Strategic Leadership: Ethical Challenges and ESG Implications in the E-Retail SectorPreprint
Rezaei, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5405605 · Cited by 1
AI-fueled deception: mechanics of machine-driven manipulation
Shin, D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-16104-9.00006-3
Credibility Assessment of Human–Generative AI Interaction
Zhao, Y., Song, S., & Jing, Y. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009587877.005
Reyes-Sánchez, J. D. J., García-Camacho, M. A., Ibarra, V. M. D., Sanchez, I. H. C., & Luján, J. M. B. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-5428-6.ch005
Singh, M. V. K., & Sinha, K. (2025) · International Journal of Latest Technology in Engineering Management & Applied Science · doi:10.51583/ijltemas.2025.1409000068 · Cited by 1
Explainability Across the Spectrum: Modeling Stakeholder Goals Based on AI Complexity Levels
Mestre, A., Albert, M., Gil, M., & Pelechano, V. (2025) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re63999.2025.00065 · Cited by 2
Practical Perspectives on Fairness In Technology-Aided Personnel Selection
Müller, I., Dill, K., & Mihaljević, H. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757647 · Cited by 6
Ademowo, A. A., & Gbadegeshin, S. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5614906
Enhancing Decision-Making With AI
Trejo-Macotela, F. R., & Robles-Camarillo, D. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0598-1.ch013
Ethical AI in the Supply Chain: Driving Responsible and Sustainable Flow Optimization
Bentatou, N., & Lemqeddem, H. A. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3104-1.ch007
Alanazi, F., Alruwaili, A., & Shtayat, A. (2025) · Sustainability · doi:10.3390/su17209210 · Cited by 2
Dhillon, P. S., Gao, Y., Tian, L., & Zhang, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5616650
AI Act Compliance in Health Data Spaces: Requirement Modeling and Architectural Solutions
Ahmed, M., Khalid, M. I., & Helfert, M. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-97799-2_32
Voigt, B.-F., & Bleyer, K. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-05681-8_17 · Cited by 1
AI Ethics Advisor’s Guide to Trust: Why Perception Matters
Carnevale, A. (2025) · Springer eBooks · doi:10.1007/978-3-032-05526-2_3
Bias Mitigation in Deep Learning Models for Facial Recognition
Alvarez, T. (2025) · Scientific Journal of Artificial Intelligence and Blockchain Technologies · doi:10.63345/sjaibt.v2.i3.305 · Cited by 1
Generative AI for Computer-Assisted Language Learning
Maqsood, M., Aqil, M., Das, B. C., & Ahmad, M. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7574-8.ch007 · Cited by 1
Responsible AI for Detecting Dark Patterns: Linking Calibration With Risk Matrix
cho, S., Shin, J. W., & Yoo, J. (2026) · IEEE Technology and Society Magazine · doi:10.1109/mts.2026.3700023
“Documentation and auditing artifacts, model cards, datasheets, internal algorithmic auditing frameworks, operation-alize transparency, process accountability, and harm mapping for socio-technical systems [32], [33], [34].”
Balancing explainability and privacy in AI systems: A strategic imperative for managers
Keaney, S., & Berthon, P. R. (2025) · Business Horizons · doi:10.1016/j.bushor.2025.10.004 · Cited by 2
Becker, K., Vögele, N., Surmann, H., Lubos, D., Rogowski, T., Yildiz, M. U., Abdelazim, A., Koruhama, A. K., & Winschiers‐Theophilus, H. (2025) · African Human Computer Interaction Conference (AfriCHI) · doi:10.1145/3757232.3757266 · Cited by 1
“Notably, the work of Raji et al. [46] emphasises the importance of transparency and ethical AI development, recommending community-involved curation of datasets to ensure authenticity and cultural sensitivity.”
The strange consolation of AI ethics
Cody, M. (2025) · AI & Society · doi:10.1007/s00146-025-02724-w
Advanced Control Models for Optimizing Risk Mitigation and Organizational Efficiency
Reyes-Sánchez, J. D. J., Murillo, R. R., García-Camacho, M. A., Luján, J. M. B., & Alvarez, H. J. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3596-4.ch001
The Ethics of Artificial Intelligence
Ramachandran, M. (2025) · Springer eBooks · doi:10.1007/978-981-95-2909-4_1 · Cited by 1
Ethical AI Testing and Evaluation Against Governance and Frameworks
Ramachandran, M. (2025) · Springer eBooks · doi:10.1007/978-981-95-2909-4_11 · Cited by 1
Analysis of Ethical Frameworks for AI
Ramachandran, M. (2025) · Springer eBooks · doi:10.1007/978-981-95-2909-4_3
Ethical Design Principles for AI Applications in Healthcare
Ramachandran, M. (2025) · Springer eBooks · doi:10.1007/978-981-95-2909-4_8
Bias and Justice in Neurological AI
Rudroff, T. (2025) · Neurocultural health and wellbeing · doi:10.1007/978-3-032-11596-6_7
Co-Creating Narratives: Ludonarrative Agency and Generative AI in Digital Games
Ferreira, C. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4637-3.ch004 · Cited by 1
Boutsikaris, L., & Polykalas, S. E. (2025) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas65609.2025.11269621
Mitigating Bias in Large Language Models Associated with Occupational Stereotypes
Chakraborty, C., & Howard, A. (2025) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas65609.2025.11269614
AI-powered LCNC implementations and gender: a comparative study of role attribution bias
Tsoukalas, S., Voutyrakou, D. A., Karelis, M., Skordoulis, C. D., Κατσιαμπούρα, Γ., Avlonitis, M., & Mikalef, P. (2025) · AI and Ethics · doi:10.1007/s43681-025-00843-0
Taming AI through Human-in-the-Loop Control and Ethical Supervision
Mathur, T., Jain, R., Dubey, S., & Singh, T. (2025) · IEEE International Conference on Advances in Computing Research on Science Engineering and Technology (ACROSET) · doi:10.1109/acroset66531.2025.11281062
“Additionally, internal and external audits were conducted to evaluate the fairness, bias, and safety of the model under different use cases [41].”
Navigating Ethical Frontiers in Automation and Human-Robot Synergy for Organizational Transformation
Pushpalatha, S., & Pandian, R. D. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3404-2.ch007
Evaluation of AI ethics tools in language models: a developers’ perspective case study
Silva, J., Moreira, D. A. B., dos Santos, G. O., Ferreira, A., Maia, H., Avila, S., & Pedrini, H. (2026) · AI and Ethics · doi:10.1007/s43681-025-00914-2 · Cited by 2
Guardrails, Not Guesswork: A Framework for Trustworthy AI Adoption
Vaidya, S. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4969-6_23 · Cited by 1
The FAIR framework: ethical hybrid peer review
Grünebaum, A., Dudenhausen, J., & Chervenak, F. A. (2025) · Journal of Perinatal Medicine · doi:10.1515/jpm-2025-0658
Signals, systems, and strategy: understanding responsible AI in autonomous environments
nedunuri, U., Gupta, A., & Guha, D. (2025) · AI and Ethics · doi:10.1007/s43681-025-00896-1
“These benefits often manifest as enhanced user trust, regulatory alignment, and greater system reliability [15, 38].”
Aithal, P. S. (2025) · Poornaprajna International Journal of Teaching & Research Case Studies (PIJTRCS) · doi:10.64818/pijtrcs.3107.8494.0020 · Cited by 3
Ethical AI Implementation Frameworks for Triple-Bottom-Line Organizational PerformancePreprint
Westover, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5701142
Vincent, V., Indra, R., Pathan, R., & Parthasarathy, P. D. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-14583-3_4 · Cited by 1
The AI Paradox: Marketing Missteps in the Age of Artificial Intelligence
Gani, M. O., Ariffin, A. A. M., & Rafi, K. N. (2025) · Springer eBooks · doi:10.1007/978-3-031-75316-9_78-1
Beyond Universal Metrics: A Global South-Centered Framework for Ethical AI DevelopmentPreprint
Abdullah, X., & Siddiqui, F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5792282
Ethical challenges of using artificial intelligence in internal auditing
CERNOVSCHI, C.-R., Ciubotariu, M.-S., & Mihăilă, S. (2025) · Învățământul superior contabil: provocări și soluții · doi:10.53486/isc2025.33 · Cited by 1
Paradigma, A. M. F. (2025) · AI Law Politics · doi:10.5709/alp-01.02.2025-02
Andrès, F., Knoppers, J. V. T., & Dhungana, S. R. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2235-3.ch006
Safeguarding Freedoms in the Age of Automation
Puranik, P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6598-5.ch018
AI-Powered Military Logistics and Strategy
Pandey, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3611-4.ch002 · Cited by 1
Sato, T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.5911063
Govarthan, V., Bakiyalakshmi, S., Banu, R., & S, D. D. K. (2025) · International Conference on Digital Innovations for Sustainable Solutions (ICDISS) · doi:10.1109/icdiss68238.2025.11320699
Malpani, A., Panigrahi, A., Bhosale, V. P., Mahalle, A., Alsailawi, H. A., & Mudhafar, M. (2025) · IEEE International Conference on ICT in Business Industry & Government (ICTBIG) · doi:10.1109/ictbig68706.2025.11323785 · Cited by 1
“In addition, empirical investigations have shown that with adequate audit interventions and algorithmic training, AI systems can help reduce the subjective bias in candidate evaluations, although the results vary based on context and implementation [9].”
RetractedTrust and Ethics in Chatbots: A Framework for Responsible AI Interactions
Sowmya, P., & Vasudeva (2026) · IEEE Access · doi:10.1109/access.2026.3653763 · Cited by 6
Algorithmic fairness in context: liberty, opportunity, and well-being as ethical anchors
Perdana, A., Li, P., & Wangge, G. (2026) · AI and Ethics · doi:10.1007/s43681-025-00963-7 · Cited by 1
Value Co-Creation and Artificial Intelligence: Towards Responsible Innovation
Reda, L. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2597-2.ch007
Judijanto, L. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-13177-5_13
Karanxha, G., & Ofem, P. O. (2025) · South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM) · doi:10.1109/seeda-cecnsm68644.2025.11330146
Kumar, R., Kumar, G., Sharma, S., & Pandey, A. K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6731-6.ch013
Нейросетевой аудит рекламных кампаний: обзор и концептуальный фреймворк
Алексеев, Д. В. (2026) · Regional and Branch Economy · doi:10.47576/2949-1916.2025.9.9.027
Castillo-Villar, K. K., Dai, H., Medina, G. M., & Mehrzadi, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6116931
AuditingAI: Explainability-Driven Verification of Machine Learning Models
Tripathi, A. (2025) · International Conference on Responsible, Generative and Explainable AI (ResGenXAI) · doi:10.1109/resgenxai64788.2025.11343999
“More systematic efforts like datasheets [17], model cards [18], and process-level audits [19] have emerged, but lack theoretical guarantees.”
From Tokens to Tactics: Operationalizing Generative AI in Enterprise Workflows
Hassan, S. Z., Deshapaga, M., Bansod, M., Soni, H., & Rajendran, R. (2025) · IEEE International Conference on Information Technology, Electronics and Intelligent Communication Systems (ICITEICS) · doi:10.1109/iciteics64870.2025.11340834 · Cited by 1
“The idea of AI governance has become essential, and systems have been formulated to do with information lineage, audibility, timely safety and interpretability of output [13].”
Retrospective Quality Analysis of a Clinical RAG Chatbot: Observable Signals and Lessons LearnedPreprint
Khashei, I., Presciani, D., Martinelli, L. P., et al. (2026) · medRxiv · doi:10.64898/2026.01.26.26344757
Artificial Intelligence and Human Resource Management: A Counterfactual Analysis of Productivity
Ditta, G. (2026) · Academicus International Scientific Journal · doi:10.7336/academicus.2026.33.01
Metadata
- Authors
- Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P.
- Affiliations
- Partnership on AI
- Google (United States) (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 33-44
- OpenAlex
- W3001807593
- Cited by
- 2,245
- References
- 83
- Citations by year
- 2026: 1097 · 2025: 454 · 2024: 243 · 2023: 177 · 2022: 149 · 2021: 99 · 2020: 24
- FWCI
- 35.91
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- AI accountability, algorithmic auditing, harm detection, algorithmic transparency, societal impact of AI, algorithmic governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.