Accountability of AI Under the Law: The Role of Explanation
Open accessThe DOI matches its Crossref record; 24 of the 26 references it cites were found in a registry or an index; none of the 17 sources its claims cite is checked for support yet.
Abstract
The ubiquity of systems using artificial intelligence or "AI" has brought increasing attention to how those systems should be regulated. The choice of how to regulate AI systems will require care. AI systems have the potential to synthesize large amounts of data, allowing for greater levels of personalization and precision than ever before|applications range from clinical decision support to autonomous driving and predictive policing. That said, common sense reasoning [McCarthy, 1960] remains one of the holy grails of AI, and there exist legitimate concerns about the intentional and unintentional negative consequences of AI systems [Bostrom, 2003, Amodei et al., 2016, Sculley et al., 2014]. There are many ways to hold AI systems accountable. In this work, we focus on one: explanation. Questions about a legal right to explanation from AI systems was recently debated in the EU General Data Protection Regulation [Goodman and Flaxman, 2016, Wachter et al., 2017], and thus thinking carefully about when and how explanation from AI systems might improve accountability is timely. Good choices about when to demand explanation can help prevent negative consequences from AI systems, while poor choices may not only fail to hold AI systems accountable but also hamper the development of much-needed beneficial AI systems. Below, we briefly review current societal, moral, and legal norms around explanation, and then focus on the different contexts under which explanation is currently required under the law. We find that there exists great variation around when explanation is demanded, but there also exists important consistencies: when demanding explanation from humans, what we typically want to know is how and whether certain input factors affected the final decision or outcome. These consistencies allow us to list the technical considerations that must be considered if we desired AI systems that could provide kinds of explanations that are currently required of humans under the law. Contrary to popular wisdom of AI systems as indecipherable black boxes, we find that this level of explanation should often be technically feasible but may sometimes be practically onerous|there are certain aspects of explanation that may be simple for humans to provide but challenging for AI systems, and vice versa. As an interdisciplinary team of legal scholars, computer scientists, and cognitive scientists, we recommend that for the present, AI systems can and should be held to a similar standard of explanation as humans currently are; in the future we may wish to hold an AI to a different standard.
Overview
CoChat Summary
TL;DR
The paper argues that legally operative explanations from AI systems—human-interpretable information about factors and weights or counterfactual answers—are technically feasible and should initially be demanded of AI systems to the same extent as humans. It reviews legal contexts in the United States, United Kingdom, France, and Germany and proposes treating explanation systems as distinct from AI predictors.
Key findings
- The paper defines an explanation as human-interpretable information about the logic by which a decision-maker reached a conclusion, and says it should let an observer determine the extent to which a particular input was determinative or influential, via either important factors and their relative weight or answers to counterfactual questions.
- Society tends to demand explanations based on three factors: the impact of the decision, the possibility of contesting/correcting/compensating for error, and reason to believe an error has occurred or will occur; no single factor is dispositive.
- The legal survey finds variation: judges are generally required to give reasoned decisions in the UK, France, and Germany, while juries rarely explain; administrative agencies must explain decisions; the U.S. Fair Credit Reporting Act requires key negative credit factors; France’s Digital Republic Act creates a right to explanation for algorithmic public-sector decisions; GDPR Articles 13–15 and 22 address automated decision-making information and rights.
- Technically, local explanation and local counterfactual faithfulness can map to legally operative explanations without full transparency; an explanation system can be separate from the AI system and need not affect predictive accuracy, though concept-mapping and ex post term determination remain challenges; alternatives include empirical evidence and theoretical guarantees.
Methods
- Conceptual, legal, and technical analysis produced from over a dozen meetings of the Berkman Klein Center Working Group on AI Interpretability, a collaboration among legal scholars, computer scientists, and cognitive scientists.
- Comparative legal survey of explanation from two perspectives—the legal system as a decision-maker and as an enforcer of accountability—across the United States, United Kingdom, France, and Germany; the paper states the survey is far from comprehensive.
- No empirical dataset or quantitative experiment is reported; the analysis maps legal explanation requirements to AI technical concepts and offers recommendations.
Limitations
- The paper states there is little data to determine the actual costs of requiring AI systems to generate explanations, so the role of explanation must be re-evaluated as technology changes.
- The paper states technical challenges: mapping high-dimensional inputs to human-interpretable concepts, determining relevant terms ex post in litigation, and reverse-engineering risk from access to many explanations.
- Evident from the text: there is no empirical validation or cost measurement; the legal survey is explicitly not comprehensive; and the recommendations are normative and may not generalize across all AI contexts.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 15 Not valid · 15 Not checked · 138 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across both perspectives and countries, we find variations regarding the role of the explanation, who is obligated to provide it, and what type or amount of evidence is needed to trigger that obligation.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across all of the jurisdictions we surveyed, adjudication of individual claims often requires one or both parties to generate explanations.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Society is more likely explanation where the explanation can be acted on in some way.”
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By isolating the determinative factors of a decision, which can then be contested, counterfactual explanations promote accountability.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and access to an explanation might decrease observers' trust in some decisions.”
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
45 more claims
Create a free account to see all 168 claims and to verify the 17 references still open.
- Probably not a substantial claim. 107
- It may state two separate claims as one. 33
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The use of “high dimensional” or “black box” prediction techniques typically favored in the machine learning community are generally problematic (since these approaches can predict race through other variables, whether or not race is explicitly encoded)—although methods that have been proposed to make these models more transparent have recently been adapted to address fairness46.”
From Predictably unequal: understanding and addressing concerns that algorithmic clinical prediction may increase health disparities (2020) · cites this paper as [46]
Experimental — accuracy not yet measured
Citations
Cites
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317
(2012) · Cited by 9,062
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01228-7 · Cited by 6,909
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
SmoothGrad: removing noise by adding noise
Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467
Concrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx005 · Cited by 1,308
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Rationalizing Neural Predictions
Lei, T., Barzilay, R., & Jaakkola, T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1011 · Cited by 777
Research works printed but not linked: 1
- , 60 BUS. LAW. 737, 744 (2005).
Cited by
Items 101–200 of 443
Defining Locality for Surrogates in Post-hoc Interpretablity
Laugel, T., Renard, X., Lesot, M., Marsala, C., & Detyniecki, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07498 · Cited by 44
“…individual predictions made by a black-box classifier aims at providing to a human-user the rationale, or at least intuitions, about the factors leading to this prediction and, eventually, showing how the prediction can be altered by changing some of these factors (Doshi-Velez et al., 2017).”
BackgroundSAM: The Sensitivity of Attribution Methods to Hyperparameters
Bansal, N., Agarwal, C., & Nguyen, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00870 · Cited by 44
“Why did a self-driving car decide to run into a truck [29]? Why is a patient being predicted to have breast cancer [59] or to be a future criminal [2]? The explanations for such predictions made by machine learning (ML) models can impact our lives in many ways, under scientific [53, 37], social [18] or legal [24, 19]…”
BackgroundBayamlıoğlu, E. (2022) · Regulation & Governance · doi:10.1111/rego.12391 · Cited by 44
A Harm-Reduction Framework for Algorithmic Fairness
Altman, M., Wood, A., & Vayena, E. (2018) · IEEE Security & Privacy · doi:10.1109/msp.2018.2701149 · Cited by 56
Self-citationDong, F., She, R., Cui, C., Shi, S., Hu, X., Zeng, J., Wu, H., Xu, J., & Zhang, Y. (2021) · European Radiology · doi:10.1007/s00330-020-07561-7 · Cited by 43
Economic patterns in a world with artificial intelligence
Wagner, D. N. (2020) · Evolutionary and Institutional Economics Review · doi:10.1007/s40844-019-00157-x · Cited by 62
Generative Artificial Intelligence: Fundamentals
Corchado, J. M., Sebastian López, F., V., J., Raul Garcia, S., & Chamoso, P. (2023) · ADCAIJ ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL · doi:10.14201/adcaij.31704 · Cited by 62
SELFEXPLAIN: A Self-Explaining Architecture for Neural Text Classifiers
Rajagopal, D., Balachandran, V., Hovy, E. H., & Tsvetkov, Y. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.64 · Cited by 40
Naveed, S., Stevens, G., & Robin-Kern, D. (2024) · Applied Sciences · doi:10.3390/app142311288 · Cited by 89
Artificial intelligence in oncologic imaging
Chen, M., Terzic, A., Becker, A. S., Johnson, J. M., Wu, C. C., Wintermark, M., Wald, C., & Wu, J. (2022) · European Journal of Radiology Open · doi:10.1016/j.ejro.2022.100441 · Cited by 46
Profiling tax and financial behaviour with big data under the GDPR
Politou, E., Alepis, E., & Patsakis, C. (2019) · Computer law & security review · doi:10.1016/j.clsr.2019.01.003 · Cited by 65
Mitigating belief projection in explainable artificial intelligence via Bayesian teaching
Yang, S. C.-H., Vong, W. K., Sojitra, R. B., Folke, T., & Shafto, P. (2021) · Scientific Reports · doi:10.1038/s41598-021-89267-4 · Cited by 36
Many hands make many fingers to point: challenges in creating accountable AI
Slota, S. C., Fleischmann, K. R., Greenberg, S. R., Verma, N., Cummings, B., Li, L., & Shenefiel, C. (2021) · AI & Society · doi:10.1007/s00146-021-01302-0 · Cited by 65
Monroe, D. (2018) · Communications of the ACM · doi:10.1145/3276742 · Cited by 41
Extending a Human-AI Collaboration Framework with Dynamism and Sociality
Muller, M., & Weisz, J. (2022) · 2022 Symposium on Human-Computer Interaction for Work · doi:10.1145/3533406.3533407 · Cited by 37
Alawamleh, M., Shammas, N., Alawamleh, K. J., & Ismail, L. B. (2024) · Journal of Open Innovation Technology Market and Complexity · doi:10.1016/j.joitmc.2024.100338 · Cited by 67
Froomkin, A. M., Kerr, I. R., & Pineau, J. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3114347 · Cited by 41
A Practical Guide to Conversation Research: How to Study What People Say to Each Other
Yeomans, M., Boland, F. K., Collins, H. K., Abi-Esber, N., & Brooks, A. W. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231183919 · Cited by 59
AI employment decision-making: integrating the equal opportunity merit principle and explainable AI
Chan, G. K. Y. (2022) · AI & Society · doi:10.1007/s00146-022-01532-w · Cited by 53
Modularized Textual Grounding for Counterfactual Resilience
Fang, Z., Kong, S., Fowlkes, C. C., & Yang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00654 · Cited by 36
Nandutu, I., Atemkeng, M., & Okouma, P. (2021) · AI & Society · doi:10.1007/s00146-021-01285-y · Cited by 37
Explainability of vision-based autonomous driving systems: Review and challenges.Preprint
Zablocki, É., Ben-younes, H., Pérez, P., & Cord, M. (2021) · arXiv (Cornell University) · Cited by 32
Towards Consumer-Empowering Artificial Intelligence
Contissa, G., Lagioia, F., Lippi, M., Micklitz, H., Pałka, P., Sartor, G., & Torroni, P. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/714 · Cited by 40
On the path to the future: mapping the notion of transparency in the EU regulatory framework for AI
Varošanec, I. (2022) · International Review of Law Computers & Technology · doi:10.1080/13600869.2022.2060471 · Cited by 58
Towards an effective transnational regulation of AI
Gervais, D. J. (2021) · AI & Society · doi:10.1007/s00146-021-01310-0 · Cited by 46
Using Expert Patterns in Assisted Interactive Machine Learning: A Study in Machine Teaching
Wall, E., Ghorashi, S., & Ramos, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29387-1_34 · Cited by 37
Machine learning in the EU health care context: exploring the ethical, legal and social issues
Beriaín, Í. D. M., Sanz, B., & Moratinos, G. L. (2020) · Information Communication & Society · doi:10.1080/1369118x.2020.1719185 · Cited by 31
A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?
Wang, Z., Huang, C., & Yao, X. (2024) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3702004 · Cited by 51
Word embeddings for biomedical natural language processing: A survey
Chiu, B., & Baker, S. (2020) · Language and Linguistics Compass · doi:10.1111/lnc3.12402 · Cited by 37
Metaverse ethics: exploring the social implications of the metaverse
Yasuda, A. (2025) · AI and Ethics · doi:10.1007/s43681-024-00507-5 · Cited by 27
Legal responsibility for errors caused by artificial intelligence (AI) in the public sector
AL-Dulaimi, A. O. M., & Mohammed, M. A.-A. W. (2025) · International Journal of Law and Management · doi:10.1108/ijlma-08-2024-0295 · Cited by 69
Chazette, L., Karras, O., & Schneider, K. A. (2019) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2019.00032 · Cited by 46
Emerging Perspectives in Human-Centered Machine Learning
Ramos, G., Suh, J., Ghorashi, S., Meek, C., Banks, R., Amershi, S., Fiebrink, R., Smith-Renner, A., & Bansal, G. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3299014 · Cited by 26
State-of-the-Art in Responsible, Explainable, and Fair AI for Medical Image Analysis
Amirian, S., Gao, F., Littlefield, N. G., Hill, J. H., Yates, A. J., Plate, J. F., Pantanowitz, L., Rashidi, H. H., & Tafti, A. P. (2025) · IEEE Access · doi:10.1109/access.2025.3555543 · Cited by 37
Auditing Deep Learning processes through Kernel-based Explanatory Models
Croce, D., Rossini, D., & Basili, R. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1415 · Cited by 31
Li, Y., Zeng, X., & Shi, Y. (2022) · Optical Fiber Technology · doi:10.1016/j.yofte.2022.102868 · Cited by 27
Barbosa, S. D. J., Barbosa, G. D. J., de Souza, C. S., & Leitão, C. F. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445900 · Cited by 31
Palmiotto, F. (2020) · Data science, machine intelligence, and law · doi:10.1007/978-3-030-50559-2_3 · Cited by 67
Towards explainable motion prediction using heterogeneous graph representations
Limeros, S. C., Majchrowska, S., Johnander, J., Petersson, C., & Llorca, D. F. (2023) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2023.104405 · Cited by 43
Nguyen, G., Kim, D., & Nguyen, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14944 · Cited by 102
We and It: An Interdisciplinary Review of the Experimental Evidence on Human-Machine InteractionPreprint
Chugunova, M., & Sele, D. (2020) · SSRN Electronic Journal · doi:10.3929/ethz-b-000442053 · Cited by 30
Explainability of Predictive Process Monitoring Results: Can You See My Data Issues?
Elkhawaga, G., Abu-Elkheir, M., & Reichert, M. (2022) · Applied Sciences · doi:10.3390/app12168192 · Cited by 30
Using Artificial Intelligence in the workplace: What are the main ethical risks?
Pero, A. S. D., Wyckoff, P., & Vourc'h, A. (2022) · OECD social employment and migration working papers · doi:10.1787/840a2d9f-en · Cited by 61
Towards a Responsible AI Metrics Catalogue: A Collection of Metrics for AI Accountability
Xia, B., Lu, Q., Zhu, L., Lee, S. U., Liu, Y., & Xing, Z. (2024) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1145/3644815.3644959 · Cited by 74
Barclay, I., Taylor, H., Preece, A. D., Taylor, I., Verma, D. C., & de Mel, G. R. (2020) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6129 · Cited by 20
Issues with post-hoc counterfactual explanations: a discussionPreprint
Laugel, T., Lesot, M., Marsala, C., & Detyniecki, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04774 · Cited by 65
The Concept of Accountability in AI Ethics and Governance
Lechterman, T. M. (2022) · The Oxford Handbook of AI Governance · doi:10.1093/oxfordhb/9780197579329.013.10 · Cited by 23
s-LIME: Reconciling Locality and Fidelity in Linear Explanations
Gaudel, R., Galárraga, L., Delaunay, J., Rozé, L., & Bhargava, V. (2022) · International Symposium on Intelligent Data Analysis · doi:10.1007/978-3-031-01333-1_9 · Cited by 22
Gambo, I., Massenon, R., Lin, C., Ogundokun, R. O., Agarwal, S., & Pak, W. (2024) · IEEE Access · doi:10.1109/access.2024.3443527 · Cited by 22
Explainable AI applications in the Medical Domain: a systematic review
Prentzas, N., Kakas, A., & Pattichis, C. S. (2023) · arXiv · doi:10.48550/arxiv.2308.05411 · Cited by 19
O uso da inteligência artificial na saúde pela Administração Pública brasileira
Lemes, M. M., & Lemos, A. N. L. E. (2020) · CADERNOS IBERO-AMERICANOS DE DIREITO SANITÁRIO · doi:10.17566/ciads.v9i3.684 · Cited by 97
Towards Generating Consumer Labels for Machine Learning Models
Seifert, C., Scherzinger, S., & Wiese, L. (2019) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi48466.2019.00033 · Cited by 31
Language agents reduce the risk of existential catastrophe
Goldstein, S., & Kirk‐Giannini, C. D. (2023) · AI & Society · doi:10.1007/s00146-023-01748-4 · Cited by 28
Knowledge representation and acquisition for ethical AI: challenges and opportunities
Belle, V. (2023) · Ethics and Information Technology · doi:10.1007/s10676-023-09692-z · Cited by 26
SAM: The Sensitivity of Attribution Methods to Hyperparameters
Bansal, N., Agarwal, C., & Nguyen, A. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00009 · Cited by 27
An Assurance Case Pattern for the Interpretability of Machine Learning in Safety-Critical Systems
Ward, F. R., & Habli, I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55583-2_30 · Cited by 31
Disruptive technologies and future societies: Perspectives and forecasts based on Q-methodology
Choi, S., & Moon, M. J. (2022) · Futures · doi:10.1016/j.futures.2022.103059 · Cited by 30
A Formal Framework to Characterize Interpretability of ProceduresPreprint
Dhurandhar, A., Iyengar, V. S., Luss, R., & Shanmugam, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02952 · Cited by 57
Interpretable artificial intelligence: Closing the adoption gap in healthcare
Sethi, T., Kalia, A., Sharma, A., & Nagori, A. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-817133-2.00001-x · Cited by 21
Madsen, A., Meade, N., Adlakha, V., & Reddy, S. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.125 · Cited by 56
Risk and Trust Perceptions of the Public of Artifical Intelligence Applications
Crockett, K. A., Garratt, M., Latham, A., Colyer, E., & Goltz, N. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207654 · Cited by 21
Foundations of Explainable Knowledge-Enabled SystemsPreprint
Chari, S., Gruen, D. M., Seneviratne, O. W., & McGuinness, D. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07520 · Cited by 17
TED: Teaching AI to Explain its DecisionsPreprint
Hind, M., Wei, D., Campbell, M. S., Codella, N., Dhurandhar, A., Mojsilović, A., Ramamurthy, K. N., & Varshney, K. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04896 · Cited by 30
Role of Regulatory Sandboxes and MLOps for AI-Enabled Public Sector Services
Torres, A. P. G., & Sawhney, N. (2023) · The Review of Socionetwork Strategies · doi:10.1007/s12626-023-00146-y · Cited by 33
Safety Assurance Concepts for Automated Driving Systems
Ballingall, S., Sarvi, M., & Sweatman, P. F. (2020) · SAE International Journal of Advances and Current Practices in Mobility · doi:10.4271/2020-01-0727 · Cited by 19
Algorithmic Accountability in Context. Socio-Technical Perspectives on Structural Causal Models
Poechhacker, N., & Kacianka, S. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2020.519957 · Cited by 25
Explanation and Agency: exploring the normative-epistemic landscape of the “Right to Explanation”
Jongepier, F., & Keymolen, E. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09654-x · Cited by 27
Artificial Intelligence and Administrative Decisions Under Uncertainty
Hermstrüwer, Y. (2019) · Springer eBooks · doi:10.1007/978-3-030-32361-5_9 · Cited by 25
Explicabilidad (de la inteligencia artificial)
Alcarazo, L. O. D. Z. (2022) · EUNOMÍA Revista en Cultura de la Legalidad · doi:10.20318/eunomia.2022.6819 · Cited by 38
AI, data governance and privacy: Synergies and areas of international co-operation
OECD (2024) · OECD artificial intelligence papers · doi:10.1787/2476b1a4-en · Cited by 94
Deriving Simulation Models from Data: Steps of Simulation Studies Revisited
Lazarova‐Molnar, S., & Li, X. (2019) · Winter Simulation Conference · doi:10.1109/wsc40007.2019.9004697 · Cited by 15
Rationale Discovery and Explainable AI
Steging, C., Renooij, S., & Verheij, B. (2021) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia210341 · Cited by 14
Toward a taxonomy of trust for probabilistic machine learning
Broderick, T., Gelman, A., Meager, R., Smith, A. L., & Zheng, T. (2023) · Science Advances · doi:10.1126/sciadv.abn3999 · Cited by 25
Cracking the AI recruitment code: Striving for transparency in finding the right person–job fit
Chen, A., Han, F., Zhang, X., & Lu, Y. (2025) · Information & Management · doi:10.1016/j.im.2025.104156 · Cited by 30
LLaMA-UTP: Knowledge-Guided Expert Mixture for Analyzing Uncertain Tax Positions
Tan, Y., Wu, B., Cao, J., & Jiang, B. (2025) · IEEE Access · doi:10.1109/access.2025.3571502 · Cited by 60
Accelerating human–computer interaction through convergent conditions for LLM explanation
Raikov, A., Giretti, A., Pirani, M., Spalazzi, L., & Guo, M. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1406773 · Cited by 18
Algorithms and Discrimination: The Case of Credit Scoring in Brazil
Mendes, L. S., & Mattiuzzo, M. (2022) · Ius gentium · doi:10.1007/978-3-030-90331-2_17 · Cited by 14
Perceived Trustworthiness of Natural Language Generators
Cabrero‐Daniel, B., & Cabrero, Á. (2023) · International Symposium on Trustworthy Autonomous Systems (TAS) · doi:10.1145/3597512.3599715 · Cited by 19
Mirror to Companion: Exploring Roles, Values, and Risks of AI Self-Clones through Story Completion
Huang, J., Kim, I.-J., & Yoon, D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713587 · Cited by 26
Autonomous Justification for Enabling Explainable Decision Support in Human-Robot Teaming
Luebbers, M. B., Tabrez, A., Ruvane, K., & Hayes, B. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.002 · Cited by 15
Understanding and Formalizing Accountability for Cyber-Physical Systems
Kacianka, S., & Pretschner, A. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00536 · Cited by 14
Directions for Explainable Knowledge-Enabled Systems
Chari, S., Gruen, D. M., Seneviratne, O. W., & McGuinness, D. L. (2020) · Studies on the semantic web · doi:10.3233/ssw200022 · Cited by 19
Zhang, Z., Kmoth, L., Luo, X., & He, Z. (2021) · JMIR Human Factors · doi:10.2196/26017 · Cited by 15
Evaluating Explanations by Cognitive Value
Chander, A., & Srinivasan, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99740-7_23 · Cited by 17
From Poisons to Antidotes: Algorithms as Democracy Boosters
Cavaliere, P., & Romeo, G. (2022) · European Journal of Risk Regulation · doi:10.1017/err.2021.57 · Cited by 19
Building Knowledge through Action: Considerations for Machine Learning in the Workplace
Lindley, S. E., & Wilkins, D. J. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3584947 · Cited by 18
DoCarmo, T. E., Rea, S. C., Conaway, E., Emery, J. R., & Raval, N. (2021) · Law & Policy · doi:10.1111/lapo.12164 · Cited by 21
Zhou, J., & Joachims, T. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593972 · Cited by 23
Skeja, A., & Sadiku-Dushi, N. (2025) · Leadership & Organization Development Journal · doi:10.1108/lodj-06-2025-0530 · Cited by 22
Explainable AI for Medical Imaging: Knowledge Matters
Bourdon, P., Ahmed, O. B., Urruty, T., Djemal, K., & Fernández-Maloigne, C. (2012) · Springer eBooks · doi:10.1007/978-3-030-74478-6_11 · Cited by 14
Ethical considerations of AI in financial decision
Wang, Y. (2024) · Computing and artificial intelligence. · doi:10.59400/cai.v2i1.1290 · Cited by 27
The EPOCH of AI: Human-Machine Complementarities at WorkPreprint
Loaiza, I., & C, R. R. B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5028371 · Cited by 41
Predicting and understanding residential water use with interpretable machine learning
Rachunok, B., Verma, A., & Fletcher, S. M. (2023) · Environmental Research Letters · doi:10.1088/1748-9326/ad1434 · Cited by 21
Sustainable transparency on recommender systems: Bayesian ranking of images for explainability
Paz-Ruza, J., Alonso‐Betanzos, A., Guijarro‐Berdiñas, B., Cancela, B., & Eiras‐Franco, C. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102497 · Cited by 14
Understanding the Effects of Explanation Types and User Motivations on Recommender System Use
Li, Q., Chu, S. L., Rao, N., & Nourani, M. (2020) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v8i1.7466 · Cited by 14
Ethical and Socially-Aware Data Labels
Beretta, E., Vetrò, A., Lepri, B., & De Martin, J. C. (2019) · Communications in Computer and Information Science · doi:10.1007/978-3-030-11680-4_30 · Cited by 6
Preference-based and local post-hoc explanations for recommender systems
Brunot, L., Canovas, N., Chanson, A., Labroche, N., & Verdeaux, W. (2022) · Information Systems · doi:10.1016/j.is.2022.102021 · Cited by 16
Safir, A. H., McInerney, K., Blackwell, A. F., & Debnath, R. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732136 · Cited by 17
Metadata
- Authors
- Doshi-Velez, F., Kortz, M., Budish, R., Bavitz, C., Gershman, S. J., O'Brien, D., Scott, K., Shieber, S., Waldo, J., Weinberger, D., Weller, A., & Wood, A.
- Affiliations
- Harvard University (US)
- University of Manchester (GB)
- University of Cambridge (GB)
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2017
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W2765811634
- Cited by
- 457
- References
- 26
- Citations by year
- 2026: 36 · 2025: 56 · 2024: 64 · 2023: 49 · 2022: 58 · 2021: 64 · 2020: 55 · 2019: 51 · 2018: 21 · 2017: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Keywords
- AI accountability, legal explanation, right to explanation, AI regulation, General Data Protection Regulation, explainable AI, black box problem, human-AI comparison, AI decision transparency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.