The DOI matches its DataCite record; 146 of the 230 references it cites were found in a registry or an index.
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Open accessAbstract
With the recent wave of progress in artificial intelligence (AI) has come a growing awareness of the large-scale impacts of AI systems, and recognition that existing regulations and norms in industry and academia are insufficient to ensure responsible AI development. In order for AI developers to earn trust from system users, customers, civil society, governments, and other stakeholders that they are building AI responsibly, they will need to make verifiable claims to which they can be held accountable. Those outside of a given organization also need effective means of scrutinizing such claims. This report suggests various steps that different stakeholders can take to improve the verifiability of claims made about AI systems and their associated development processes, with a focus on providing evidence about the safety, security, fairness, and privacy protection of AI systems. We analyze ten mechanisms for this purpose--spanning institutions, software, and hardware--and make recommendations aimed at implementing, exploring, or improving those mechanisms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Provenance records may contain sensitive timestamps or workflow traces”
From Designing automated audit mechanisms to evaluate compliance of generative AI platforms with federal authorship and ownership disclosure requirements. (2023) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Where external model providers or plug-ins are used, vendor audits ensure provenance capture and persistence obligations are met across integrated systems [37,34].”
From Designing automated audit mechanisms to evaluate compliance of generative AI platforms with federal authorship and ownership disclosure requirements. (2023) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides governmental organizations, a wealth of companies also release their guidelines or principles to demonstrate their compliance with AI trustworthiness [27, 58, 37, 15, 14, 82].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [14]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“To ensure that the provenance is tamper proof, the blockchain has been recently considered as a promising tool to certify data provenance in AI [96, 14].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 1×
“Training data can be rigorously evaluated for representativeness [63] [64]; assumptions can be characterized by evaluating modular components of an AI model and by clearly communicating output uncertainties; and performance can be characterized by measuring generalization, fairness, and performance heterogeneity acros…”
BackgroundVisualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“This lack of interpretability in AI systems has raised concerns about using AI models in high stakes decision-making contexts where human welfare may be compromised [73].”
BackgroundExplaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381 · cited 1×
“• This system is robust even to adversarial examples [57] [58];”
BackgroundThe future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143 · cited 1×
“• This system is robust even to adversarial examples [57] [58];”
BackgroundIntroduction: epistemic communities and international policy coordination
Haas, P. M. (1992) · International Organization · doi:10.1017/s0020818300001442 · Cited by 7,891
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · cited 2×
“, service provider), while keeping the training data decentralized [94].”
BackgroundSelf-citationCalibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Flagged first, then by citations
84 of the 230 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Items 101–200 of 315
Lessons Learned from Assessing Trustworthy AI in Practice
Vetter, D., Amann, J., Bruneault, F., Coffee, M., Düdder, B., Gallucci, A., Gilbert, T., Hagendorff, T., van Halem, I., Hickman, E., et al. (2022) · Digital Society · doi:10.1007/s44206-023-00063-1 · Cited by 25
Self-citationPerformance enhancement of artificial intelligence: A survey
Krichen, M., & Abdalzaher, M. S. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.104034 · Cited by 35
From Machine Learning to Artificial General Intelligence: A Roadmap and Implications
Obaid, O. I. (2023) · Mesopotamian Journal of Big Data · doi:10.58496/mjbd/2023/012 · Cited by 34
On the Way to SBOMs: Investigating Design Issues and Solutions in Practice
Bi, T., Xia, B., Xing, Z., Lu, Q., & Zhu, L. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3654442 · Cited by 31
Kuppan, K., Acharya, D. B., & Divya, B. (2024) · IEEE Access · doi:10.1109/access.2024.3509918 · Cited by 39
Competing narratives in AI ethics: a defense of sociotechnical pragmatism
Watson, D., Mökander, J., & Floridi, L. (2024) · AI & Society · doi:10.1007/s00146-024-02128-2 · Cited by 45
“In contrast, external audits help technology providers verify claims about the systems they design and deploy (Brundage et al. 2020).”
Requirements Engineering in Machine Learning Projects
Gjorgjevikj, A., Mishev, K., Antovski, L., & Trajanov, D. (2023) · IEEE Access · doi:10.1109/access.2023.3294840 · Cited by 33
“[92] point to trade-offs between the privacy benefits, the model quality, the developers’ experience, and the costs in computation, communication, or energy consumption.”
BackgroundShould Users Trust Advanced AI Assistants? Justified Trust As a Function of Competence and Alignment
Manzini, A., Keeling, G., Marchal, N., McKee, K. R., Rieser, V., & Gabriel, I. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658964 · Cited by 28
AI Challenges for Society and Ethics
Whittlestone, J., & Clarke, S. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197579329.013.3 · Cited by 35
Software engineering practices for machine learning — Adoption, effects, and team assessment
Serban, A., van der Blom, K., Hoos, H. H., & Visser, J. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111907 · Cited by 34
Explainable AI for Sensor Signal Interpretation to Revolutionize Human Health Monitoring: A Review
Alharthi, A. S., Alqurashi, A., Alharbi, T. E. A., Alammar, M. M., Aldosari, N., Bouchekara, H. R. E. H., Sha’aban, Y. A., Shahriar, M. S., & Ayidh, A. A. (2025) · IEEE Access · doi:10.1109/access.2025.3585764 · Cited by 36
“XAI aims to address this issue by providing clarity and trustworthiness, regardless of users’ technical backgrounds, ensuring AI systems are robust, efficient, transparent, and understandable [18].”
Systematic analysis of 32,111 AI model cards characterizes documentation practice in AI
Liang, W., Rajani, N. F., Yang, X., Ozoani, E., Wu, E., Chen, Y. T., Smith, D. S., & Zou, J. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00857-z · Cited by 73
Towards a robust and trustworthy machine learning system development: An engineering perspective
Xiong, P., Buffett, S., Iqbal, S., Lamontagne, P., Mamun, M., & Molyneaux, H. (2022) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2022.103121 · Cited by 36
“A recent report, “Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims" [15], represents a joint effort of academia and industry to move beyond the ethic principles by proposing a set of mechanisms as a toolbox that AI practitioners can adopt to make and verify claims about AI systems.”
BackgroundReliability Testing for Natural Language Processing Systems
Tan, S., Joty, S., Baxter, K., Taeihagh, A., Bennett, G. A., & Kan, M. (2021) · doi:10.18653/v1/2021.acl-long.321 · Cited by 31
Implementing Ai Principles: Frameworks, Processes, and ToolsPreprint
Boza, P., & Evgeniou, T. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3783124 · Cited by 23
Opportunities and Challenges of Foundation Models in Industrial Manufacturing
Ayyat, M., Osman, M., & Nadeem, T. (2025) · IEEE Access · doi:10.1109/access.2025.3589777 · Cited by 25
“These concerns are particularly acute in industrial contexts, where algorithmic decisions affect not only efficiency but also worker safety, regulatory compliance, and social equity [197].”
On the Controllability of Artificial Intelligence: An Analysis of Limitations
Yampolskiy, R. V. (2022) · Journal of Cyber Security and Mobility · doi:10.13052/jcsm2245-1439.1132 · Cited by 58
International governance of civilian AI: a jurisdictional certification approachPreprint
Trager, R., Harack, B., Reuel, A., Carnegie, A. S., Heim, L., Ho, L., Kreps, S. E., Lall, R., Larter, O., hÉigeartaigh, S. Ó., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4579899 · Cited by 55
Self-citationIdentifying Roles, Requirements and Responsibilities in Trustworthy AI Systems
Barclay, I., & Abramson, W. (2021) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3460418.3479344 · Cited by 24
“XAI covers a wide scope, and providing information and “audit trails”[5] on the parts and processes that have led to the generation of a model is recognised as a valuable component.”
BackgroundIntroduction to Interpretability and Explainability
Kamath, U., & Liu, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-83356-5_1 · Cited by 24
Harnessing Prior Knowledge for Explainable Machine Learning: An Overview
Beckh, K., Müller, S., Jakobs, M., Toborek, V., Tan, H., Fischer, R., Welke, P., Houben, S., & von Rueden, L. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00038 · Cited by 23
“With trustworthy artificial intelligence becoming more important [37], another purpose of IML is to ensure knowledge conformity or to improve the interpretability of a model [17].”
BackgroundThe arcanum of artificial intelligence in enterprise applications: Toward a unified framework
Herrmann, H. (2022) · Journal of Engineering and Technology Management · doi:10.1016/j.jengtecman.2022.101716 · Cited by 26
Li, X., Chen, D., Xu, W., Chen, H., Li, J., & Mo, F. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01505-4 · Cited by 19
“All the concerns discussed above reflect our human needs in pursuing explicit knowledge; that is, we need to know how the machine works before trusting them (Brundage et al., 2020).”
BackgroundNeuro-Symbolic AI for Military Applications
Hagos, D. H., & Rawat, D. B. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3444746 · Cited by 24
“To prevent a global arms race in AI-powered weapons, establishing clear international regulations and agreements governing their use in conflicts is crucial [132], [133].”
BackgroundBarclay, I., Preece, A. D., Taylor, I., Radha, S. K., & Nabrzyski, J. (2022) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6997 · Cited by 23
Wang, Y. (2023) · doi:10.36227/techrxiv.23968311.v1 · Cited by 23
CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations
Salewski, L., Koepke, A. S., Lensch, H. P. A., & Akata, Z. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-04083-2_5 · Cited by 20
“For a comprehensive overview of research on explainability and interpretability, we refer to recent surveys [7,10,17].”
ResultSheir, S., Manzini, A., Smith, H., & Ives, J. (2024) · AI & Society · doi:10.1007/s00146-024-01938-8 · Cited by 17
“Artificial intelligence (AI) is increasingly spoken of in the language of trust and trustworthiness, both in academic and policy vernacular (Brundage et al. 2020; Department for Science, Innovation and Technology 2023; Independent High-Level Expert Group on Artificial Intelligence 2019; Mökander…”
Ain, Q. U., Nazir, R., Nawaz, A., Shahbaz, H., Dilshad, A., Mufti, I. U., & Iftikhar, M. (2024) · Journal of Clinical and Translational Pathology · doi:10.14218/jctp.2023.00061 · Cited by 21
“52 Consequently, reducing uncertainties and coping with the blood demand, avoiding blood wast-age are the primary goals.”
Connectome-based machine learning models are vulnerable to subtle data manipulations
Rosenblatt, M., Rodriguez, R. X., Westwater, M. L., Dai, W., Horien, C. L., Greene, A. S., Constable, R. T., Noble, S., & Scheinost, D. (2023) · Patterns · doi:10.1016/j.patter.2023.100756 · Cited by 18
Bickmore, T., Ólafsson, S., & O’Leary, T. K. (2021) · Journal of Medical Internet Research · doi:10.2196/30704 · Cited by 17
“Other researchers have called for formal model review procedures or bounties for the independent identification of model failures [21].”
BackgroundOn the Road to Designing Responsible AI Systems in Military Cyber Operations
Maathuis, C. (2022) · European Conference on Cyber Warfare and Security · doi:10.34190/eccws.21.1.204 · Cited by 16
Training on the Test Set: Mapping the System-Problem Space in AI
Hernández‐Orallo, J., Schellaert, W., & Martínez‐Plumed, F. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21487 · Cited by 16
“Actually, not being able to provide a good assessor for an AI system telling the operating conditions where it succeeds and fails could be a reason to deny the authorisation to release a system (Brundage et al. 2020; Falco et al. 2021).”
BackgroundMaking Smart Contracts Predict and Scale
Badruddoja, S., Dantu, R., He, Y., et al. (2022) · International Conference on Blockchain Computing and Applications (BCCA) · doi:10.1109/bcca55292.2022.9922480 · Cited by 16
“One of the crucial problems in recent development involves the trust of data and model [1], [2].”
BackgroundAxes for Sociotechnical Inquiry in AI Research
Dean, S., Gilbert, T. K., Lambert, N., & Zick, T. (2021) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3074097 · Cited by 20
Self-citationStix, C. (2021) · AI and Ethics · doi:10.1007/s43681-021-00093-w · Cited by 25
“2021), testing procedures (Brundage et al. 2020), or setting out shared definitions of ‘meaningful human control’ across diverse contexts.”
BackgroundSelf-citationAutomation levels for nuclear reactor operations: A revised perspective
Alberti, A. L., Agarwal, V., Gutowska, I., et al. (2023) · Progress in Nuclear Energy · doi:10.1016/j.pnucene.2022.104559 · Cited by 15
Yes we care!-Certification for machine learning methods through the care label framework
Morik, K. J., Kotthaus, H., Fischer, R., Mücke, S., Jakobs, M., Piatkowski, N., Pauly, A., Heppe, L., & Heinrich, D. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.975029 · Cited by 15
“Miles Brundage and colleagues argue that descriptions must be verifiable claims (Brundage et al., 2020).”
BackgroundAccountable Federated Machine Learning in Government: Engineering and Management Insights
Balta, D., Sellami, M., Kuhn, P., Schöpp, U., Buchinger, M., Baracaldo, N., Anwar, A., Ludwig, H., Sinn, M., Purcell, M., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-82824-0_10 · Cited by 15
Both eyes open: Vigilant Incentives help auditors improve AI safety
Bova, P., Stefano, A. D., & Han, T. A. (2024) · Journal of Physics Complexity · doi:10.1088/2632-072x/ad424c · Cited by 15
“Instead, reputation systems should focus on directly promoting truthfulness, as well as considering other insights from the literature that are more specific to reputation systems (Barton 2005, Brundage et al 2020, Cihon et al 2021).”
BackgroundInternational AI Institutions: A Literature Review of Models, Examples, and ProposalsPreprint
Maas, M. M., & Villalobos, J. J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4579773 · Cited by 15
Santhi, T. M., & Srinivasan, K. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3417252 · Cited by 18
“To achieve this, techniques and standards have been devised to reduce the generation of false statements by AI [31], while also analyzing mechanisms to ensure responsible AI development [32].”
BackgroundTowards Faster Functional Encryption for Privacy-preserving Machine Learning
Panzade, P. P., & Takabi, D. (2021) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tpsisa52974.2021.00003 · Cited by 14
Trust Metrics for Medical Deep Learning Using Explainable-AI Ensemble for Time Series Classification
Siddiqui, K., & Doyle, T. E. (2022) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece49351.2022.9918458 · Cited by 15
“Fairness as an element of trust it’s easy to grasp that an individual would be more trusting of an AI that makes fair decisions [32] [33] [3] [4] [30].”
BackgroundHavrda, M., & Klocek, A. (2023) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2023.102294 · Cited by 14
Zaimah, N. R., Hartanto, E. B., & Zahro, F. (2023) · Mantiqu Tayr Journal of Arabic Language · doi:10.25217/mantiqutayr.v4i1.3951 · Cited by 21
MMPF: Multimodal Purification Fusion for Automatic Depression Detection
Yang, B., Cao, M., Zhu, X., Wang, S.-H., Yang, C., Ni, R., & Liu, X. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3411616 · Cited by 15
“Moreover, they may not satisfy doctors’ constraints during the diagnostic process, such as paying more attention to the psychological state of depressed patients [8].”
AI Development for the Public Interest: From Abstraction Traps to Sociotechnical Risks
Andrus, M., Dean, S., Gilbert, T. K., Lambert, N., & Zick, T. (2020) · IEEE International Symposium on Technology and Society (ISTAS) · doi:10.1109/istas50296.2020.9462193 · Cited by 15
Self-citationAuditing Metaverse Requires Multimodal Deep Learning
Upadhyay, K., Dantu, R., He, Y., Badruddoja, S., & Salau, A. (2022) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa56441.2022.00015 · Cited by 14
“For example, data poisoning attacks create untrustworthy applications where input data, the machine learning model, and output data can be questioned [9].”
BackgroundBurr, C., & Leslie, D. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3937983 · Cited by 13
Legal Priorities Research: A Research AgendaPreprint
Winter, C. K., Schuett, J., Martínez, E., Arsdale, S. V., Araújo, R., Hollman, N., Sebo, J., Stawasz, A., O’Keefe, C., & Rotola, G. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3931256 · Cited by 12
Self-citationCausal Analysis for Robust Interpretability of Neural Networks
Ahmad, O. S., Béreux, N., Baret, L., Hashemi, V., & Lécué, F. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00462 · Cited by 12
“As reported in [6], it is difficult to verify claims about black-box models without explanations of their inner workings.”
BackgroundZhou, J., & Joachims, T. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593972 · Cited by 16
“Outside of the model creation and usage process themselves, explanations have been suggested and critiqued as potential tools for auditing model performance and final decisions [6].”
MethodWang, Y. (2023) · doi:10.36227/techrxiv.23968311 · Cited by 13
Hashlamoun, N. A., Barghuthi, N. B. A., & Tamimi, H. (2023) · International Conference on Information Technology Trends (ITT) · doi:10.1109/itt59889.2023.10184228 · Cited by 11
“[12] emphasized the need for ethical and responsible AI applications to avoid unintended consequences and ensure equitable outcomes.”
BackgroundEmpowering autonomous indoor navigation with informed machine learning techniques
Uganya, G., Bremnavas, I., Prashanth, K. V., Rajkumar, M., Lalitha, R. V. S., & Singh, C. (2023) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2023.108918 · Cited by 12
The EU AI Act: A pioneering effort to regulate frontier AI?
Graells, G. B., Salinas, C., Tinoco, R., & Sevilla, J. (2024) · INTELIGENCIA ARTIFICIAL · doi:10.4114/intartif.vol27iss73pp55-64 · Cited by 12
Ethics Auditing Framework for Trustworthy AI: Lessons from the IT Audit Literature
Zinda, N. (2022) · Digital ethics lab yearbook · doi:10.1007/978-3-031-09846-8_12 · Cited by 12
Deepfakes: A Review on Technologies, Applications and Strategies
Kaswan, K. S., Malik, K., Dhatterwal, J. S., Naruka, M. S., & Govardhan, D. (2023) · International Conference on Power Energy, Environment and Intelligent Control (PEEIC) · doi:10.1109/peeic59336.2023.10450604 · Cited by 14
“More advanced detection approaches, legal frameworks, and responsible AI development may be in the future [15].”
BackgroundGonzalez, J. A. H., & Colom, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1491823 · Cited by 20
“According to Brundage et al. (2020), RaaS could be labeled as any third-party service made of tools that allow the reproducibility of scientific work.”
A vision of human–AI collaboration for enhanced biological collection curation and research
Stenhouse, A., Fisher, N., Lepschi, B. J., Schmidt‐Lebuhn, A. N., Rodríguez, J., Turco, F., Reeson, A. F., Paris, C. L., & Thrall, P. H. (2025) · BioScience · doi:10.1093/biosci/biaf021 · Cited by 12
“To address these issues, explainable AI and other interpretability and mitigation methods should be considered for the evaluation of and building trust in AI systems (Adadi and Berrada 2018 , Brundage et al. 2020 , Ali et al. 2023 , Gallegos et al. 2024 ).”
Li, Y., & Goel, S. (2025) · Advances in Accounting · doi:10.1016/j.adiac.2025.100842 · Cited by 21
Ethics Auditing: Lessons from Business Ethics for Ethics Auditing of AI
Schöppl, N., Taddeo, M., & Floridi, L. (2022) · Digital ethics lab yearbook · doi:10.1007/978-3-031-09846-8_13 · Cited by 12
Designing an ML Auditing Criteria Catalog as Starting Point for the Development of a Framework
Schwarz, M., Hinske, L. C., Mansmann, U., & Albashiti, F. (2024) · IEEE Access · doi:10.1109/access.2024.3375763 · Cited by 13
“Brundage et al. [7, p. 11] mention that AI systems are intransparent and often closed source.”
BackgroundA Trustworthy Framework of Artificial Intelligence for Power Grid Dispatching Systems
Zhang, K., Xu, P., Gao, T., et al. (2021) · IEEE International Conference on Digital Twins and Parallel Intelligence (DTPI) · doi:10.1109/dtpi52967.2021.9540198 · Cited by 10
Akula, R., & Garibay, I. I. (2021) · arXiv.org · doi:10.48550/arxiv.2107.14046 · Cited by 10
“Explainability, fairness, privacy, governance, and robustness are currently hot topics among researchers and adopters of AI, and they are grouped under the umbrella term ”Trustworthy AI” [2].”
BackgroundAwareness of Unethical Artificial Intelligence and its Mitigation Measures
HÖLLER, S., Dilger, T., Spieß, T., Ploder, C., & Bernsteiner, R. C. (2023) · European Journal of Interdisciplinary Studies · doi:10.24818/ejis.2023.17 · Cited by 9
Value Alignment for Advanced Artificial Judicial Intelligence
Winter, C. K., Hollman, N., & Manheim, D. (2023) · American Philosophical Quarterly · doi:10.5406/21521123.60.2.06 · Cited by 12
“Brundage et al. (2020) survey a number of specific mechanisms at the software, hardware, and institutional level that could be used for verification purposes.”
Trustworthy AI Inference Systems: An Industry Research View
Cammarota, R., Schunter, M., Rajan, A., Boemer, F., Kiss, Á., Treiber, A., Weinert, C., Schneider, T., Stapf, E., Sadeghi, A.-R., et al. (2020) · arXiv · doi:10.48550/arxiv.2008.04449 · Cited by 9
“Finally, there is also a need for the development of global standards and best practices such as definitions, technical foundations and application standards to facilitate the broad deployment of advanced cryptographicmechanisms [24].”
BackgroundSelf-citationAligning AI Regulation to Sociotechnical ChangePreprint
Maas, M. M. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3871635 · Cited by 9
Avinash, A., & Nene, M. J. (2024) · ITU Kaleidoscope Academic Conference (ITU K) · doi:10.23919/ituk62727.2024.10772925 · Cited by 8
“Sharing AI incidents improves the verifiability of claims in AI development, highlights overlooked risks, and enhances the effectiveness of external scrutiny by increasing common knowledge of potential AI system behaviors [19].”
Seeds of SEED: NMT-Stroke: Diverting Neural Machine Translation through Hardware-based Faults
Cai, K., Chowdhuryy, M. H. I., Zhang, Z., & Yao, F. (2021) · International Symposium on Secure and Private Execution Environment Design (SEED) · doi:10.1109/seed51797.2021.00019 · Cited by 8
“strated the use of security enclaves to build tamper-resistant ML systems [48], which can be applied to guard against NMT model tampering by NMT-Stroke.”
MethodAligning AI Regulation to Sociotechnical Change
Maas, M. M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197579329.013.22 · Cited by 19
A Decentralized Approach towards Responsible AI in Social Ecosystems
Chu, W. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19274 · Cited by 9
On Controllability of AIPreprint
Yampolskiy, R. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.04071 · Cited by 8
A Dataset of Coordinated Cryptocurrency-Related Social Media Campaigns
Zilius, K., Spiliotopoulos, T., & van Moorsel, A. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22219 · Cited by 8
“2012) and verifying the bias and safety of AI systems (Brundage et al. 2020).”
BackgroundA Cognitive Walkthrough of Multiple Drone Delivery Operations
Smith, C. L., Sadler, G. G., Tyson, T. L., Brandt, S. L., Rorie, R. C., Keeler, J. N., Monk, K. J., Viramontes, J., & Dolgov, I. (2021) · AIAA AVIATION Forum · doi:10.2514/6.2021-2330 · Cited by 7
“During a time of increased automation, the amount of control that is still afforded to human operators is often a source of contention [20].”
BackgroundAdvanced AI Governance: A Literature Review of Problems, Options, and ProposalsPreprint
Maas, M. M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4629460 · Cited by 7
Luna, D. S., Broer, I., Bilandzić, H., Taddicken, M., Schuller, B. W., & Bürger, M. (2025) · Public Understanding of Science · doi:10.1177/09636625251328854 · Cited by 15
“This includes disclosing methodologies, data sources, and algorithmic functions used in ComAI processes (Floridi et al., 2018), as well as potential conflicts of interest, uncertainties and risks (Brundage et al., 2020).”
Managing Artificial Intelligence Algorithmic Discrimination: The Internal Audit Function Role
Nzama, L. (2023) · Accounting, finance, sustainability, governance & fraud · doi:10.1007/978-981-99-6327-0_14 · Cited by 6
An Interactive Framework for Querying Data from Large Pdf Files
Vishnu, B. V., Rao, S. S., & Netravathi, B. (2023) · International Conference on Recent Advances in Information Technology for Sustainable Development (ICRAIS) · doi:10.1109/icrais59684.2023.10367090 · Cited by 6
“[2] The language model GPT (Generative Pre-trained Trans-former) series from Open AI, which has raised the bar for natural language processing, is one of their best-known products.”
BackgroundThe Digital Siren’s Call: Accepting Unethical AI Advice
Xu, C., Xu, H., Sun, Y.-Q., & Xiong, W. (2024) · International journal of human computer interactions · doi:10.1080/10447318.2024.2400396 · Cited by 9
“Moreover, these findings contribute to the literature on human–computer interaction by highlighting the importance of ethical considerations in the design and implementation of AI systems for business contexts (Brundage et al., 2020).”
Chakraborty, A., Singh, G., Meenakshi, Sirvastava, V., & Dhondiyal, S. A. (2024) · International Conference on Data Intelligence and Cognitive Informatics (ICDICI) · doi:10.1109/icdici62993.2024.10810927 · Cited by 6
The Role of AI in Shaping Modern Legal Frameworks: A Political Science Perspective
Khalifa, M., & Sabry, M. (2024) · International Conference on Decision Aid Sciences and Applications (DASA) · doi:10.1109/dasa63652.2024.10836624 · Cited by 6
Human In Command Machine Learning
Holmberg, L. (2021) · doi:10.24834/isbn.9789178771875 · Cited by 8
Connectome-based machine learning models are vulnerable to subtle data manipulationsPreprint
Rosenblatt, M., Rodriguez, R. X., Westwater, M. L., Horien, C. L., Greene, A. S., Constable, R. T., Noble, S., & Scheinost, D. (2021) · doi:10.31219/osf.io/ptuwe · Cited by 6
What is AI safety? What do we want it to be?
Harding, J., & Kirk‐Giannini, C. D. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02367-z · Cited by 21
“In other words, while The Safety Conception may capture something close to the manifest concept of AI safety among AI safety researchers, it does not capture the concept of AI safety that is operative among AI safety researchers or AI safety governance organizations.”
Trust in Artificial Intelligence: Clinicians Are Essential
Bhatt, U., & Shams, Z. (2021) · Health informatics · doi:10.1007/978-3-030-81030-6_10 · Cited by 5
Assurance levels for decision making in autonomous intelligent systems and their safety
Fourastier, Y., Baron, C., Thomas, C., & Esteban, P. (2020) · International Conference on Dependable Systems, Services and Technologies (DESSERT) · doi:10.1109/dessert50317.2020.9125079 · Cited by 5
“A/I system accountability is based on the verifiable claims of the system designer and developers as [33] comments.”
BackgroundArtificial Intelligence in Medicine and Privacy Preservation
Ziller, A., Passerat‐Palmbach, J., Trask, A., Braren, R., Rueckert, D., & Kaissis, G. A. (2021) · Springer eBooks · doi:10.1007/978-3-030-58080-3_261-1 · Cited by 6
Self-citationJangseung: A Guardian for Machine Learning Algorithms to Protect Against Poisoning Attacks
Wolf, S., Gamboa, W., & Borowczak, M. (2021) · IEEE International Smart Cities Conference (ISC2) · doi:10.1109/isc253183.2021.9562816 · Cited by 5
An Overview of Medical Electronic Hardware Security and Emerging Solutions
Taheri, S., & Asadizanjani, N. (2022) · Electronics · doi:10.3390/electronics11040610 · Cited by 5
Application of ethical AI requirements to an AI solution use-case in healthcare domain
Pourzolfaghar, Z., Alfano, M., & Helfert, M. (2023) · American Journal of Business · doi:10.1108/ajb-12-2022-0201 · Cited by 6
A Unified Framework of Ethical Principles for AI
Floridi, L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780198883098.003.0004 · Cited by 9
Ethical Considerations and Best Practices for Using Large Language Models in Decision - Making
Saxena, A. K. (2024) · International Journal of Science and Research (IJSR) · doi:10.21275/sr24710062038 · Cited by 6
“Any alerts would need someone to review them given the nature and consequences involved (Brundage et al., 2020).”
InfluentialGLUECons: A Generic Benchmark for Learning under Constraints
Faghihi, H. R., Nafar, A., Chen, Z., Mirzaee, R., Zhang, Y., Uszok, A., Wan, A., Premsri, T., Roth, D., & Kordjamshidi, P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26143 · Cited by 7
AI Governance for Businesses.Preprint
Schneider, J., Abraham, R., & Meske, C. (2020) · arXiv (Cornell University) · Cited by 5
Artificial Intelligence and Privacy Concerns: Balancing Innovation With Security
Viswanath, V., M., T., & Naganandh, S. (2025) · Cureus Journal of Computer Science · doi:10.7759/s44389-025-03689-z · Cited by 5
“The increasing reliance on AI amplifies risks such as unauthorized access, data security breaches, discrimination, and algorithmic bias, making privacy and security central to AI governance discussions [3].”
Examining trends in AI ethics across countries and institutions via quantitative discourse analysis
Bar-Gil, O. (2025) · Ai & Society · doi:10.1007/s00146-025-02673-4 · Cited by 10
A Survey on Conversational Search and Applications in Biomedicine
Adatrao, N. S. K., Gadireddy, G. R., & Noh, J. (2023) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/3564746.3587001 · Cited by 4
“Developing systems with the properties of interpretability and privacy-preserving mechanisms is a crucial topic in biomedical ConvSearch [2, 9].”
Background
Metadata
- Authors
- Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., Yang, J., Toner, H., Fong, R., Maharaj, T., Koh, P. W., Hooker, S., Leung, J., Trask, A., Bluemke, E., Lebensold, J., O'Keefe, C., Koren, M., Ryffel, T., Rubinovitz, J., Besiroglu, T., Carugati, F., Clark, J., Eckersley, P., de Haas, S., Johnson, M., Laurie, B., Ingerman, A., Krawczuk, I., Askell, A., Cammarota, R., Lohn, A., Krueger, D., Stix, C., Henderson, P., Graham, L., Prunkl, C., Martin, B., Seger, E., Zilberman, N., hÉigeartaigh, S. Ó., Kroeger, F., Sastry, G., Kagan, R., Weller, A., Tse, B., Barnes, E., Dafoe, A., Scharre, P., Herbert-Voss, A., Rasser, M., Sodhani, S., Flynn, C., Gilbert, T. K., Dyer, L., Khan, S., Bengio, Y., & Anderljung, M.
- Affiliations
- Stanford University (US)
- Centre Universitaire de Mila (DZ)
- University of Toronto (CA)
- Adelard (GB)
- Center for Security and Emerging Technology (US)
- University of Oxford (GB)
- École Normale Supérieure - PSL (FR)
- University of Cambridge (GB)
- Google (United States) (US)
- École Polytechnique Fédérale de Lausanne (CH)
- RAND Corporation (US)
- Eindhoven University of Technology (NL)
- Coventry University (GB)
- Center for a New American Security (US)
- University of California, Berkeley (US)
- ORCID
- Avin, Shahar
- Belfield, Haydn
- Hadfield, Gillian
- Yang, Jingying
- Fong, Ruth
- Maharaj, Tegan
- Koh, Pang Wei
- Hooker, Sara
- Trask, Andrew
- Bluemke, Emma
- Ryffel, Théo
- Besiroglu, Tamay
- Carugati, Federica
- Laurie, Ben
- Ingerman, Alex
- Krawczuk, Igor
- Cammarota, Rosario
- Lohn, Andrew
- Krueger, David
- Stix, Charlotte
- Henderson, Peter
- Prunkl, Carina
- Seger, Elizabeth
- Zilberman, Noa
- hÉigeartaigh, Seán Ó
- Kroeger, Frens
- Weller, Adrian
- Barnes, Elizabeth
- Dafoe, Allan
- Sodhani, Shagun
- Gilbert, Thomas Krendl
- Khan, Saif
- Bengio, Yoshua
- Anderljung, Markus
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2004.07213
- OpenAlex
- W4287552728
- Cited by
- 306
- References
- 230
- Citations by year
- 2026: 11 · 2025: 39 · 2024: 52 · 2023: 80 · 2022: 42 · 2021: 65 · 2020: 16
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- Pure (Coventry University) (submittedVersion)
- TU/e Research Portal (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- trustworthy AI, responsible AI development, accountability, AI safety, AI security, algorithmic fairness, privacy preservation, stakeholder scrutiny, verification methods, AI governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
