The DOI matches its DataCite record; 146 of the 230 references it cites were found in a registry or an index.
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Open accessAbstract
With the recent wave of progress in artificial intelligence (AI) has come a growing awareness of the large-scale impacts of AI systems, and recognition that existing regulations and norms in industry and academia are insufficient to ensure responsible AI development. In order for AI developers to earn trust from system users, customers, civil society, governments, and other stakeholders that they are building AI responsibly, they will need to make verifiable claims to which they can be held accountable. Those outside of a given organization also need effective means of scrutinizing such claims. This report suggests various steps that different stakeholders can take to improve the verifiability of claims made about AI systems and their associated development processes, with a focus on providing evidence about the safety, security, fairness, and privacy protection of AI systems. We analyze ten mechanisms for this purpose--spanning institutions, software, and hardware--and make recommendations aimed at implementing, exploring, or improving those mechanisms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Provenance records may contain sensitive timestamps or workflow traces”
From Designing automated audit mechanisms to evaluate compliance of generative AI platforms with federal authorship and ownership disclosure requirements. (2023) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Where external model providers or plug-ins are used, vendor audits ensure provenance capture and persistence obligations are met across integrated systems [37,34].”
From Designing automated audit mechanisms to evaluate compliance of generative AI platforms with federal authorship and ownership disclosure requirements. (2023) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides governmental organizations, a wealth of companies also release their guidelines or principles to demonstrate their compliance with AI trustworthiness [27, 58, 37, 15, 14, 82].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [14]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“To ensure that the provenance is tamper proof, the blockchain has been recently considered as a promising tool to certify data provenance in AI [96, 14].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 1×
“Training data can be rigorously evaluated for representativeness [63] [64]; assumptions can be characterized by evaluating modular components of an AI model and by clearly communicating output uncertainties; and performance can be characterized by measuring generalization, fairness, and performance heterogeneity acros…”
BackgroundVisualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“This lack of interpretability in AI systems has raised concerns about using AI models in high stakes decision-making contexts where human welfare may be compromised [73].”
BackgroundExplaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381 · cited 1×
“• This system is robust even to adversarial examples [57] [58];”
BackgroundThe future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143 · cited 1×
“• This system is robust even to adversarial examples [57] [58];”
BackgroundIntroduction: epistemic communities and international policy coordination
Haas, P. M. (1992) · International Organization · doi:10.1017/s0020818300001442 · Cited by 7,891
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · cited 2×
“, service provider), while keeping the training data decentralized [94].”
BackgroundSelf-citationCalibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“uncovered racial bias in a widely used algorithm affecting millions of patients [47].”
BackgroundTowards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602 · cited 1×
“45 Currently, the security balance is tilted in favor of attacks rather than defenses, with only adversarial training [65] having stood the test of multiple years of attack research.”
BackgroundThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“Further, they are amenable to various interpretations [13][14] and agreement on them can mask deeper disagreements [5].”
BackgroundLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 1×
“Characterizing desiderata for interpretable models is a helpful way to formalize interpretability [74] [75].”
BackgroundDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Axiomatic attribution for deep networks
Sundararajan, M., Taly, A., & Yan, Q. (2017) · arXiv · doi:10.48550/arxiv.1703.01365 · Cited by 4,087 · cited 1×
“Characterizing desiderata for interpretable models is a helpful way to formalize interpretability [74] [75].”
BackgroundInfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial NetsPreprint
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03657 · Cited by 3,557
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 1×
“, studying the efficacy of interpretability tools or exploring possible interfaces–would be welcome, as would further exploration of how practitioners currently use such tools [81] [82] [83] [78] [84].”
BackgroundModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 3×
“(18)Model cards for model reporting [28] and data sheets for datasets [29] reveal information about AI systems publicly, and future work in third party auditing could build on such tools, as advocated by Raji and Smart et al.”
BackgroundMethodGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 3×
“(18)Model cards for model reporting [28] and data sheets for datasets [29] reveal information about AI systems publicly, and future work in third party auditing could build on such tools, as advocated by Raji and Smart et al.”
BackgroundMethodCooperation under the security dilemma
Jervis, R. (1978) · World Politics · doi:10.2307/2009958 · Cited by 2,305
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245 · cited 3×
“[36] for a discussion of some lessons for AI from auditing in other industries.”
BackgroundEthics Guidelines for Trustworthy AI
Cannarsa, M. (2021) · The Cambridge Handbook of Lawyering in the Digital Age · doi:10.1017/9781108936040.022 · Cited by 2,095
Buchanan, J. (1965) · Economica · doi:10.2307/2552442 · Cited by 1,957 · cited 1×
“Voluntary membership organizations with stricter rules and norms have been implemented in other industries and might also be a useful model for AI developers [31].”
BackgroundImbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine LearningPreprint
Lemaître, G., Nogueira, F., & Aridas, C. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.06570 · Cited by 1,923 · cited 1×
“Training data can be rigorously evaluated for representativeness [63] [64]; assumptions can be characterized by evaluating modular components of an AI model and by clearly communicating output uncertainties; and performance can be characterized by measuring generalization, fairness, and performance heterogeneity acros…”
BackgroundAnanny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01303-4 · Cited by 1,752
Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks
Katz, G., Barrett, C., Dill, D. L., Julian, K., & Kochenderfer, M. J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-63387-9_5 · Cited by 1,706 · cited 1×
“Without approximation, certificates are computationally prohibitive for all but the smallest real world tasks [69].”
BackgroundRISE: Randomized Input Sampling for Explanation of Black-box ModelsPreprint
Petsiuk, V., Das, A., & Saenko, K. (2018) · British Machine Vision Conference · doi:10.48550/arxiv.1806.07421 · Cited by 1,702
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Self-citationNetwork Dissection: Quantifying Interpretability of Deep Visual Representations
Bau, D., Zhou, B., Khosla, A., Oliva, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.354 · Cited by 1,389
Concrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314 · cited 2×
“Algorithms or models that are purported to have favorable safety properties, such as enabling safe exploration or robustness to distributional shifts [49], could be scrutinized via bounty programs.”
BackgroundSanity Checks for Saliency Maps
Adebayo, J., Gilmer, J., Muelly, M., Goodfellow, I., Hardt, M., & Kim, B. (2018) · arXiv · doi:10.48550/arxiv.1810.03292 · Cited by 1,294 · cited 1×
“, the reliability of existing methods is an active area of research [85] [86] [87] [88] [89] [90] [91] [92] [93].”
BackgroundCertified Adversarial Robustness via Randomized SmoothingPreprint
Cohen, J. M., Rosenfeld, E., & Kolter, J. Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02918 · Cited by 1,232 · cited 1×
“not generalizing well to unseen data [66] [67] [68]).”
BackgroundInnovative instructions and software model for isolated execution
Mckeen, F., Alexandrovich, I., Berenzon, A., Rozas, C. V., Shafi, H., Shanbhogue, V., & Savagaonkar, U. R. (2013) · Hardware and Architectural Support for Security and Privacy · doi:10.1145/2487726.2488368 · Cited by 1,103 · cited 1×
“A secure enclave is a set of software and hardware features that together provide an isolated execution environment that enables a set of strong guarantees regarding security for applications running inside the enclave [109].”
BackgroundInterpretable Explanations of Black Boxes by Meaningful Perturbation
Fong, R. C., & Vedaldi, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.371 · Cited by 1,097
Self-citationDota 2 with Large Scale Deep Reinforcement Learning
OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.06680 · Cited by 1,065
BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
Gu, T., Dolan-Gavitt, B., & Garg, S. (2017) · arXiv · doi:10.48550/arxiv.1708.06733 · Cited by 1,061 · cited 1×
“, the reliability of existing methods is an active area of research [85] [86] [87] [88] [89] [90] [91] [92].”
BackgroundThe Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation
Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., Filar, B., et al. (2018) · Apollo - University of Cambridge Repository · doi:10.17863/cam.22520 · Cited by 849
Self-citationInterpretable Convolutional Neural Networks
Zhang, Q., Wu, Y. N., & Zhu, S.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00920 · Cited by 833
Barth, S., & de Jong, M. D. T. (2017) · Telematics and Informatics · doi:10.1016/j.tele.2017.04.013 · Cited by 798 · cited 1×
“, a concern for personal privacy) because other factors such as convenience and brand loyalty also play a role in influencing their behavior [127].”
BackgroundCertified Robustness to Adversarial Examples with Differential Privacy
Lecuyer, M., Atlidakis, V., Geambasu, R., Hsu, D., & Jana, S. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00044 · Cited by 750 · cited 1×
“not generalizing well to unseen data [66] [67] [68]).”
BackgroundThe (Un)reliability of Saliency Methods
Kindermans, P.-J., Hooker, S., Adebayo, J., Alber, M., Schütt, K. T., Dähne, S., Erhan, D., & Kim, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_14 · Cited by 741 · cited 1×
“, the reliability of existing methods is an active area of research [85] [86] [87] [88] [89] [90] [91] [92].”
BackgroundSelf-citationManipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728 · cited 2×
“This is already the case in regulated domains such as finance [78].”
BackgroundWhitman, N. A. (1999) · Academic medicine : journal of the Association of American Medical Colleges · doi:10.1097/00001888-199901000-00001 · Cited by 689
Interpretable Decision Sets: A Joint Framework for Description and Prediction
Lakkaraju, H., Bach, S. H., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939874 · Cited by 687
Fairness in Machine Learning: Lessons from Political Philosophy
Binns, R. (2017) · arXiv · doi:10.48550/arxiv.1712.03586 · Cited by 676
Ross, A. S., & Doshi‐Velez, F. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11504 · Cited by 647
Explainable machine learning in deployment
Bhatt, U., Xiang, A., Sharma, S., Weller, A., Taly, A., Jia, Y., Ghosh, J., Puri, R., Moura, J. M. F., & Eckersley, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375624 · Cited by 633 · cited 1×
“, studying the efficacy of interpretability tools or exploring possible interfaces–would be welcome, as would further exploration of how practitioners currently use such tools [81] [82] [83] [78] [84].”
BackgroundSelf-citationThe Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks
Carlini, N., Liu, C., Erlingsson, Ú., Kos, J., & Song, D. (2018) · arXiv · doi:10.48550/arxiv.1802.08232 · Cited by 629 · cited 1×
“These measures include quantifying the degree to which models memorize training data [95], and incorporating differential privacy techniques to limit the contribution of individual clients in the federated setting [96].”
BackgroundA Multiscale Visualization of Attention in the Transformer Model
Vig, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.18653/v1/p19-3007 · Cited by 600
The Building Blocks of Interpretability
Olah, C., Satyanarayan, A., Johnson, I., Carter, S., Schubert, L., Ye, K., & Mordvintsev, A. (2018) · Distill · doi:10.23915/distill.00010 · Cited by 591
Formal Guarantees on the Robustness of a Classifier against Adversarial ManipulationPreprint
Hein, M., & Andriushchenko, M. (2017) · Neural Information Processing Systems · doi:10.48550/arxiv.1705.08475 · Cited by 566 · cited 1×
“not generalizing well to unseen data [66] [67] [68]).”
BackgroundA Benchmark for Interpretability Methods in Deep Neural NetworksPreprint
Hooker, S., Erhan, D., Kindermans, P.-J., & Kim, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.10758 · Cited by 531 · cited 1×
“, the reliability of existing methods is an active area of research [85] [86] [87] [88] [89] [90] [91] [92].”
BackgroundSelf-citationActionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501 · cited 1×
“, bank loans) [77];”
Artificial Intelligence: American Attitudes and Trends
Zhang, B., & Dafoe, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3312874 · Cited by 464 · cited 1×
“Indeed, studies [17], surveys [18], and trends in worker and community organizing [2] [3] make clear that large swaths of the public are concerned about the risks of AI development, and do not trust the organizations currently dominating such development to self-regulate effectively.”
BackgroundSelf-citationSynthesizing the preferred inputs for neurons in neural networks via deep generator networksPreprint
Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T., & Clune, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09304 · Cited by 453
Calibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Kobbi Nissim, B., & Smith, A. (2017) · Journal of Privacy and Confidentiality · doi:10.29012/jpc.v7i3.405 · Cited by 438 · cited 1×
“Differential privacy [97] is a system for publicly sharing information derived from a dataset by describing the patterns of groups within the dataset, while withholding information about individuals in the dataset; it allows for precise measurements of privacy risks for current and potential data owners, and can addre…”
BackgroundAdler, E. (1992) · International Organization · doi:10.1017/s0020818300001466 · Cited by 428
Real Time Image Saliency for Black Box ClassifiersPreprint
Dabkowski, P., & Gal, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07857 · Cited by 421
The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions
Whittlestone, J., Nyrup, R., Alexandrova, A., & Cave, S. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314289 · Cited by 399 · cited 2×
“Further, they are amenable to various interpretations [13][14] and agreement on them can mask deeper disagreements [5].”
BackgroundSlalom: Fast, Verifiable and Private Execution of Neural Networks in Trusted HardwarePreprint
Tramèr, F., & Boneh, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03287 · Cited by 373 · cited 1×
“67 Demonstrations to date have been carried out on commodity hardware (CPUs [112] [113] and GPUs [114]) or have secure and verifiable outsourcing of parts of the computation to less secure hardware [115] [116], rather than on hardware directly optimized for machine learning (such as TPUs).”
BackgroundInterpreting CNNs via Decision Trees
Zhang, Q., Yang, Y., Ma, H., & Wu, Y. N. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00642 · Cited by 361
Trust: Making and Breaking Cooperative Relations.
Barber, B., & Gambetta, D. (1992) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2076328 · Cited by 340
Algorithms for Verifying Deep Neural Networks
Liu, C., Arnon, T., Lazarus, C., Strong, C. A., Barrett, C., & Kochenderfer, M. J. (2020) · Foundations and Trends® in Optimization · doi:10.1561/2400000035 · Cited by 336
Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNet
Brendel, W., & Bethge, M. (2019) · arXiv · doi:10.48550/arxiv.1904.00760 · Cited by 323
On the importance of single directions for generalization
Morcos, A. S., Barrett, D. G. T., Rabinowitz, N. C., & Botvinick, M. (2018) · arXiv · doi:10.48550/arxiv.1803.06959 · Cited by 305
The relationship between trust in AI and trustworthy machine learning technologies
Toreini, E., Aitken, M., Coopamootoo, K., Elliott, K., Zelaya, C. G., & van Moorsel, A. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372834 · Cited by 296
Release Strategies and the Social Impacts of Language Models
Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., Krueger, G., Kim, J. W., Kreps, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1908.09203 · Cited by 292 · cited 3×
“, "Threat Modeling AI/ML Systems and Dependencies" [43] (25)In the context of language models, for example, 2019 saw a degree of communication and coordination across AI developers to assess the relative risks of different language understanding and generation systems [10].”
BackgroundSelf-citationWho Cares about Auditor Reputation
Barton, J. (2005) · Contemporary Accounting Research · doi:10.1506/c27u-23k8-e1vl-20r0 · Cited by 279 · cited 1×
“Reputational considerations help to ensure auditing integrity in the case of financial accounting, where firms prefer to engage with credible auditors [38].”
An Abstraction-Refinement Approach to Verification of Artificial Neural Networks
Pulina, L., & Tacchella, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14295-6_24 · Cited by 276
The Ethical Algorithm: The Science of Socially Aware Algorithm Design
Kearns, M. J., & Roth, A. (2021) · Perspectives on Science and Christian Faith · doi:10.56315/pscf3-21kearns · Cited by 273 · cited 2×
“For an accessible discussion of the ideas behind differential privacy and its applications, from which this short summary was adapted, see [99].”
Artificial Intelligence and National Security
Cimbala, S. (1986) · doi:10.1007/978-3-031-06709-9 · Cited by 273
Irresistible: The Rise of Addictive Technology and the Business of Keeping Us Hooked
Hunter, M. T., & Morganstein, J. (2021) · Psychiatry · doi:10.1080/00332747.2021.1925508 · Cited by 272
Amershi, S., Chickering, M., Drucker, S. M., Lee, B., Simard, P., & Suh, J. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702509 · Cited by 270
Hohman, F., Head, A., Caruana, R., DeLine, R. A., & Drucker, S. M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300809 · Cited by 252 · cited 1×
“, studying the efficacy of interpretability tools or exploring possible interfaces–would be welcome, as would further exploration of how practitioners currently use such tools [81] [82] [83] [78] [84].”
BackgroundPrivacy-preserving Machine Learning as a Service
Hesamifard, E., Takabi, H., Ghasemi, M., & Wright, R. N. (2018) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2018-0024 · Cited by 250 · cited 1×
“67 Demonstrations to date have been carried out on commodity hardware (CPUs [113] [114] and GPUs [115]) or have secure and verifiable outsourcing of parts of the computation to less secure hardware [116] [117], rather than on hardware directly optimized for machine learning (such as TPUs).”
BackgroundLeike, J., Martic, M., Krakovna, V., Ortega, P. A., Everitt, T., Lefrancq, A., Orseau, L., & Legg, S. (2017) · arXiv · doi:10.48550/arxiv.1711.09883 · Cited by 240 · cited 1×
“• This system is robust to ’natural’ distributional shifts [49] [56];”
BackgroundInterpreting CNN Knowledge via an Explanatory Graph
Zhang, Q., Cao, R., Shi, F., Wu, Y. N., & Zhu, S. C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11819 · Cited by 222
Semantic photo manipulation with a generative image prior
Bau, D., Strobelt, H., Peebles, W., Wulff, J., Zhou, B., Zhu, J.-Y., & Torralba, A. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323023 · Cited by 207 · cited 1×
“, while limited in treatment, has primarily centered on comparing methods using human surveys [80].”
"The human body is a black box": supporting clinical decision-making with deep learning
Sendak, M., Elish, M. C., Gao, M., Futoma, J., Ratliff, W., Nichols, M., Bedoya, A., Balu, S., & O'Brien, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372827 · Cited by 196 · cited 1×
“[76] which focuses on building trust in a hospital context, and contextualizes the role of interpretability in this process.”
BackgroundRaji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · arXiv · doi:10.48550/arxiv.2001.00973 · Cited by 179
Programmatically Interpretable Reinforcement LearningPreprint
Verma, A., Murali, V., Singh, R., Kohli, P., & Chaudhuri, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.02477 · Cited by 178
Narayanan, M., Chen, E., He, J., Kim, B., Gershman, S., & Doshi-Velez, F. (2018) · arXiv · doi:10.48550/arxiv.1802.00682 · Cited by 153 · cited 1×
“, studying the efficacy of interpretability tools or exploring possible interfaces–would be welcome, as would further exploration of how practitioners currently use such tools [81] [82] [83] [78] [84].”
BackgroundCarter, S., Armstrong, Z., Schubert, L., Johnson, I., & Olah, C. (2019) · Distill · doi:10.23915/distill.00015 · Cited by 147
Artificial Intelligence: A Revolution in Strategic Affairs?
Payne, K. (2018) · Survival · doi:10.1080/00396338.2018.1518374 · Cited by 142
Fooling Neural Network Interpretations via Adversarial Model ManipulationPreprint
Heo, J., Joo, S., & Moon, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02041 · Cited by 137 · cited 1×
“, the reliability of existing methods is an active area of research [85] [86] [87] [88] [89] [90] [91] [92].”
BackgroundErrudite: Scalable, Reproducible, and Testable Error Analysis
Wu, T., Ribeiro, M. T., Heer, J., & Weld, D. S. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1073 · Cited by 137
Increasing Trust in AI Services through Supplier's Declarations of Conformity
Hind, M., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv.org · doi:10.48550/arxiv.1808.07261 · Cited by 134
SafetyNets: Verifiable Execution of Deep Neural Networks on an Untrusted CloudPreprint
Ghodsi, Z., Gu, T., & Garg, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10268 · Cited by 128 · cited 1×
“For example, one could have assurances that a cloud-based AI service is not skimping on computations by running a less powerful model than advertised, operating on private data in a disallowed fashion, or compromised by malware [107].”
BackgroundLost Causes: Agenda Vetting in Global Issue Networks and the Shaping of Human Security
Carpenter, C. (2014) · doi:10.7591/cornell/9780801448850.001.0001 · Cited by 127
Interpreting Blackbox Models via Model ExtractionPreprint
Bastani, O., Kim, C., & Bastani, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08504 · Cited by 126
Representer Point Selection for Explaining Deep Neural NetworksPreprint
Yeh, C., Kim, J. S., Yen, I. E.-H., & Ravikumar, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09720 · Cited by 125
Salient Deconvolutional Networks
Mahendran, A., & Vedaldi, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46466-4_8 · Cited by 124 · cited 1×
“, the reliability of existing methods is an active area of research [85] [86] [87] [88] [89] [90] [91] [92] [93].”
BackgroundThe Role of Cooperation in Responsible AI DevelopmentPreprint
Askell, A., Brundage, M., & Hadfield, G. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04534 · Cited by 110 · cited 3×
“Greater verifiability of claims about AI development would help enable more effective oversight and reduce pressure to cut corners for the sake of gaining a competitive edge [1].”
BackgroundSelf-citationComputational Power and the Social Impact of Artificial IntelligencePreprint
Hwang, T. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3147971 · Cited by 107 · cited 1×
“Hardware relevant to AI development ranges from sensors, networking, and memory, to, perhaps most crucially, processing power [102].”
BackgroundUnderstanding Image Representations by Measuring Their Equivariance and Equivalence
Lenc, K., & Vedaldi, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1098-y · Cited by 98
SGX-LKL: Securing the Host OS Interface for Trusted ExecutionPreprint
Priebe, C., Muthukumaran, D., Lind, J., Zhu, H., Cui, S., Sartakov, V. A., & Pietzuch, P. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.11143 · Cited by 96 · cited 1×
“67 Demonstrations to date have been carried out on commodity hardware (CPUs [112] [113] and GPUs [114]) or have secure and verifiable outsourcing of parts of the computation to less secure hardware [115] [116], rather than on hardware directly optimized for machine learning (such as TPUs).”
BackgroundLinking Artificial Intelligence PrinciplesPreprint
Zeng, Y., Lu, E.-M., & Huangfu, C. (2018) · SafeAI@AAAI · doi:10.48550/arxiv.1812.04814 · Cited by 95 · cited 1×
“[16] for examples of non-Western AI principles.”
Political Realism and Political Idealism: a Study in Theories and Realities
GanzH., F. (1952) · doi:10.2307/2604027 · Cited by 94
Efficient Deep Learning on Multi-Source Private DataPreprint
Hynes, N., Cheng, R., & Song, D. X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06689 · Cited by 93 · cited 2×
“4% [112].”
BackgroundTowards a program logic for JavaScript
Gardner, P., Maffeis, S., & Smith, G. (2012) · ACM-SIGACT Symposium on Principles of Programming Languages · doi:10.1145/2103656.2103663 · Cited by 92
Understanding Deep Networks via Extremal Perturbations and Smooth Masks
Fong, R., Patrick, M., & Vedaldi, A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00304 · Cited by 89
Self-citationRutherford, K. R. (2000) · World Politics · doi:10.1017/s0043887100009382 · Cited by 87
Differential Adaptive Stress Testing of Airborne Collision Avoidance Systems
Lee, R., Mengshoel, O. J., Saksena, A., et al. (2018) · 2018 AIAA Modeling and Simulation Technologies Conference · doi:10.2514/6.2018-1923 · Cited by 87 · cited 1×
“For example, adaptive stress testing (AST) of an AI system allows users to find the most likely failure of a system for a given scenario using reinforcement learning [61], and is being used by to validate the next generation of aircraft collision avoidance software [62].”
MethodCoe, A. J., & Vaynman, J. (2019) · American Political Science Review · doi:10.1017/s000305541900073x · Cited by 87
AI Ethics – Too Principled to Fail?
Mittelstadt, B. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3391293 · Cited by 82 · cited 3×
“Over 80 AI organizations [5], including technology companies such as Google [22], OpenAI [23], and Microsoft [24] have publicly stated the principles they will follow in developing AI.”
Repeatability, reproducibility, and rigor in systems research
Vítek, J., & Kalibera, T. (2011) · ACM International Conference on Embedded Software (EMSOFT) · doi:10.1145/2038642.2038650 · Cited by 80 · cited 1×
“, Vitek & Kalibera [123] and Hoefler & Belli [124].”
BackgroundPolitical Realism and Political Idealism: A Study in Theories and Realities.
Flechtheim, O. K., & Herz, J. H. (1951) · doi:10.2307/2087376 · Cited by 79
The Antitrust Consumer Welfare Paradox
Orbach, B. (2011) · doi:10.1093/joclec/nhq019 · Cited by 78
Schwartz, R., Dodge, J., Smith, N. A., & Etzioni, O. (2019) · arXiv · doi:10.48550/arxiv.1907.10597 · Cited by 73 · cited 1×
“have recommended that researchers always publish financial and computational costs alongside performance increases [121].”
BackgroundFinding Influential Training Samples for Gradient Boosted Decision Trees
Sharchilev, B., Ustinovsky, Y., Serdyukov, P., et al. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1802.06640 · Cited by 73
Arms Control, Stability, and Causes of War
Jervis, R. (1993) · doi:10.2307/2152010 · Cited by 67
Developing Bug-Free Machine Learning Systems With Formal MathematicsPreprint
Selsam, D., Liang, P., & Dill, D. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1706.08605 · Cited by 66
Regulatory Markets for AI SafetyPreprint
Clark, J., & Hadfield, G. K. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2001.00078 · Cited by 65 · cited 1×
“One way that third party auditing could connect to government policies, and be funded, is via a "regulatory market" [42].”
BackgroundSelf-citationRobustness testing of autonomy software
Hutchison, C., Zizyte, M., Lanigan, P. E., Guttendorf, D., Wagner, M., Goues, C. L., & Koopman, P. J. (2018) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3183519.3183534 · Cited by 63
Interpreting Black Box Predictions using Fisher KernelsPreprint
Khanna, R., Kim, B., Ghosh, J., & Koyejo, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.10118 · Cited by 61
You shouldn’t trust me: Learning models which conceal unfairness from multiple explanation methods.
Dimanov, B., Bhatt, U., Jamnik, M., & Weller, A. (2020) · Apollo (University of Cambridge) · doi:10.17863/cam.48825 · Cited by 58 · cited 1×
“, the reliability of existing methods is an active area of research [85] [86] [87] [88] [89] [90] [91] [92] [93].”
BackgroundSelf-citationThe battle for ethical AI at the world’s biggest machine-learning conference
Gibney, E. (2020) · Nature · doi:10.1038/d41586-020-00160-y · Cited by 54 · cited 1×
“Nor are they able to hold developers to account when principles and behavior diverge, fueling accusations of "ethics washing" [4].”
BackgroundBelfield, H. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375814 · Cited by 52
Self-citationToward Scalable Verification for Safety-Critical Deep NetworksPreprint
Kuper, L., Katz, G., Gottschlich, J., Julian, K. D., Barrett, C., & Kochenderfer, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05950 · Cited by 48
A Safety Framework for Critical Systems Utilising Deep Neural Networks
Zhao, X., Banks, A., Sharp, J. J., Robu, V., Flynn, D., Fisher, M., & Huang, X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-54549-9_16 · Cited by 46
Chen, H., Fu, C., Rouhani, B. D., Zhao, J., & Koushanfar, F. (2019) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3307650.3322251 · Cited by 45 · cited 1×
“Remote attestation is often used to attest that a certain version of software is currently running, or that a computation took a certain amount of time (which can then be compared to a reference by the remote party to detect tampering) [106].”
BackgroundSurvey of Attacks and Defenses on Edge-Deployed Neural Networks
Isakov, M., Gadepally, V. N., Gettings, K., & Kinsy, M. A. (2019) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec.2019.8916519 · Cited by 43 · cited 1×
“56 These techniques do not, however, protect the model itself from theft [100].”
BackgroundAutonomous Weapons Systems: Law, Ethics, Policy
Bhuta, N., Beck, S., Geis, R., Liu, H.-Y., & Kress, C. (2016) · doi:10.1017/cbo9781316597873 · Cited by 40
The Windfall Clause: Distributing the Benefits of AI for the Common Good
O'Keefe, C., Cihon, P., Garfinkel, B., Flynn, C., Leung, J., & Dafoe, A. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375842 · Cited by 38 · cited 1×
“The Windfall Clause [30] is one proposal along these lines, and involves an ex ante commitment by AI firms to donate a significant amount of any eventual extremely large profits.”
BackgroundSelf-citationRaji, I. D., & Yang, J. (2019) · arXiv · doi:10.48550/arxiv.1912.06166 · Cited by 36 · cited 2×
“Inspiration might be taken from recent work on internal algorithmic auditing [36] and ongoing work on the documentation of AI systems more generally, such as the ABOUT ML project [27].”
BackgroundSelf-citationRobust artificial intelligence and robust human organizations
Dietterich, T. G. (2018) · Frontiers of Computer Science · doi:10.1007/s11704-018-8900-4 · Cited by 36
On the Legal Compatibility of Fairness Definitions
Xiang, A., & Raji, I. D. (2019) · arXiv · doi:10.48550/arxiv.1912.00761 · Cited by 34
Encyclopedia of arms control and disarmament
Cohen, E., & Burns, R. (1993) · doi:10.2307/20045731 · Cited by 33
Autonomous Weapons: Regulation Tolerant or Regulation Resistant?
Watts, S. (2015) · doi:10.2139/ssrn.2681283 · Cited by 30
Monitoring Misuse for Accountable 'Artificial Intelligence as a Service'
Javadi, S. A., Cloete, R., Cobbe, J., Lee, M. S. A., & Singh, J. P. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375873 · Cited by 29 · cited 1×
“These mechanisms could be extended to cover AI misuse [107].”
BackgroundInterpretable & Explorable Approximations of Black Box Models
Lakkaraju, H., Kamar, E., Caruana, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01154 · Cited by 23
Disruptive Innovations and Disruptive Assurance: Assuring Machine Learning and Autonomy
Bloomfield, R., Khlaaf, H., Ryan Conmy, P., & Fletcher, G. (2019) · Computer · doi:10.1109/mc.2019.2914775 · Cited by 23
Self-citationThe Role of Civilian Innovation in the Development of Lethal Autonomous Weapon Systems
Verbruggen, M. (2019) · Global Policy · doi:10.1111/1758-5899.12663 · Cited by 22
(1974) · International Legal Materials · doi:10.1017/s0020782900039085 · Cited by 18
Ovadya, A., & Whittlestone, J. (2019) · arXiv · doi:10.48550/arxiv.1907.11274 · Cited by 15 · cited 1×
“Incident sharing is closely related to but distinct from responsible publication practices in AI and coordinated disclosure of cybersecurity vulnerabilities [55].”
BackgroundImbrie, A., & Kania, E. B. (2019) · doi:10.51593/20190051 · Cited by 15
The Adaptive Stress Testing Formulation
Koren, M., Corso, A., & Kochenderfer, M. J. (2020) · arXiv.org · doi:10.48550/arxiv.2004.04293 · Cited by 12 · cited 1×
“For example, adaptive stress testing (AST) of an AI system allows users to find the most likely failure of a system for a given scenario using reinforcement learning [61], and is being used by to validate the next generation of aircraft collision avoidance software [62].”
MethodSelf-citationBurns, R. (2009) · doi:10.5040/9798400648540 · Cited by 10
Goldblat, J. (2020) · doi:10.4324/9781003053491 · Cited by 8
Civil Society Responds to the AWS : Growing Activist Networks and Shifting Frames
Bahçecik, Ş. O. (2019) · Global Policy · doi:10.1111/1758-5899.12671 · Cited by 7
Barner-Barry, C. (1990) · Politics and the life sciences · doi:10.1017/s0730938400010352 · Cited by 7
Daniloff, N. (2016) · Journal of Cold War Studies · doi:10.1162/jcws_r_00693 · Cited by 1
Cited by
Sorted by citations
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
“(8) The development of auditable and objectively trustworthy systems 99 (that is, not relying on subjective assertions—for example, by governments) will promote the universal acceptance of secure and private AI solutions by individuals and policymakers.”
BackgroundGenerative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Interpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958
“It is universally agreed that interpretability is a key element of trust for AI models (Wagstaff, 2012; Rudin and Wagstaff, 2014; Lo Piano, 2020; Ashoori and Weisz, 2019; Thiebes et al., 2020; Spiegelhalter, 2020; Brundage et al., 2020).”
Background
Metadata
- Authors
- Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., Yang, J., Toner, H., Fong, R., Maharaj, T., Koh, P. W., Hooker, S., Leung, J., Trask, A., Bluemke, E., Lebensold, J., O'Keefe, C., Koren, M., Ryffel, T., Rubinovitz, J., Besiroglu, T., Carugati, F., Clark, J., Eckersley, P., de Haas, S., Johnson, M., Laurie, B., Ingerman, A., Krawczuk, I., Askell, A., Cammarota, R., Lohn, A., Krueger, D., Stix, C., Henderson, P., Graham, L., Prunkl, C., Martin, B., Seger, E., Zilberman, N., hÉigeartaigh, S. Ó., Kroeger, F., Sastry, G., Kagan, R., Weller, A., Tse, B., Barnes, E., Dafoe, A., Scharre, P., Herbert-Voss, A., Rasser, M., Sodhani, S., Flynn, C., Gilbert, T. K., Dyer, L., Khan, S., Bengio, Y., & Anderljung, M.
- Affiliations
- Stanford University (US)
- Centre Universitaire de Mila (DZ)
- University of Toronto (CA)
- Adelard (GB)
- Center for Security and Emerging Technology (US)
- University of Oxford (GB)
- École Normale Supérieure - PSL (FR)
- University of Cambridge (GB)
- Google (United States) (US)
- École Polytechnique Fédérale de Lausanne (CH)
- RAND Corporation (US)
- Eindhoven University of Technology (NL)
- Coventry University (GB)
- Center for a New American Security (US)
- University of California, Berkeley (US)
- ORCID
- Avin, Shahar
- Belfield, Haydn
- Hadfield, Gillian
- Yang, Jingying
- Fong, Ruth
- Maharaj, Tegan
- Koh, Pang Wei
- Hooker, Sara
- Trask, Andrew
- Bluemke, Emma
- Ryffel, Théo
- Besiroglu, Tamay
- Carugati, Federica
- Laurie, Ben
- Ingerman, Alex
- Krawczuk, Igor
- Cammarota, Rosario
- Lohn, Andrew
- Krueger, David
- Stix, Charlotte
- Henderson, Peter
- Prunkl, Carina
- Seger, Elizabeth
- Zilberman, Noa
- hÉigeartaigh, Seán Ó
- Kroeger, Frens
- Weller, Adrian
- Barnes, Elizabeth
- Dafoe, Allan
- Sodhani, Shagun
- Gilbert, Thomas Krendl
- Khan, Saif
- Bengio, Yoshua
- Anderljung, Markus
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2004.07213
- OpenAlex
- W4287552728
- Cited by
- 306
- References
- 230
- Citations by year
- 2026: 11 · 2025: 39 · 2024: 52 · 2023: 80 · 2022: 42 · 2021: 65 · 2020: 16
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, other-oa)
- Pure (Coventry University) (submittedVersion)
- TU/e Research Portal (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- trustworthy AI, responsible AI development, accountability, AI safety, AI security, algorithmic fairness, privacy preservation, stakeholder scrutiny, verification methods, AI governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
