The DOI matches its DataCite record; 43 of the 44 references it cites were found in a registry or an index.
Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI
Open accessAbstract
This is an integrative review that address the question, "What makes for a good explanation?" with reference to AI systems. Pertinent literatures are vast. Thus, this review is necessarily selective. That said, most of the key concepts and issues are expressed in this Report. The Report encapsulates the history of computer science efforts to create systems that explain and instruct (intelligent tutoring systems and expert systems). The Report expresses the explainability issues and challenges in modern AI, and presents capsule views of the leading psychological theories of explanation. Certain articles stand out by virtue of their particular relevance to XAI, and their methods, results, and key points are highlighted. It is recommended that AI/XAI researchers be encouraged to include in their research reports fuller details on their empirical or experimental methods, in the fashion of experimental psychology research reports: details on Participants, Instructions, Procedures, Tasks, Dependent Variables (operational definitions of the measures and metrics), Independent Variables (conditions), and Control Conditions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Explainability is a prerequisite of AI customization, but an explanation is not only the result of algorithmic support (Adadi and Berrada 2018;Mueller et al. 2019).”
From Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence (2023) · cites this paper as Mueller et al. 2019
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“researchers have discussed the importance of an AI explanation to communicate an AI output to a user [5, 20, 29] and realize human-AI collaboration [48] for a decision-making task [15, 42].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [48]
The cited source says what the claim attributes to it.
In the citing paper
“Explainability is a prerequisite of AI customization, but an explanation is not only the result of algorithmic support (Adadi and Berrada 2018;Mueller et al. 2019).”
From Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence (2023) · cites this paper as Mueller et al. 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering
Goyal, Y., Khot, T., Summers-Stay, D., Batra, D., & Parikh, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.670 · Cited by 2,287
Flagged first, then by citations
1 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [9]9. Bibliography 109 APPENDIX: Evaluations of XAI System Performance Using Human Participants 170 5 DARPA XAI Literature Review p.
Cited by
Sorted by citations
Items 201–220 of 220
INVESTIGATING THE IMPACT OF ONLINE HUMAN COLLABORATION IN EXPLANATION OF AI SYSTEMS
Mamun, T. I. (2021) · doi:10.37099/mtu.dc.etdr/1331 · Cited by 1
Collaboration of Dermatologists and ML Models to Obtain Improved PredictionsPreprint
Schanbacher, P. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4055225 · Cited by 1
Félix, E., Amadieu, F., & Broisin, J. (2024) · Research Square · doi:10.21203/rs.3.rs-3888008/v1 · Cited by 1
The Impact of Transparency and Expert-Framing on Trust in Conversational AiPreprint
Wienrich, C., & Obremski, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4715193 · Cited by 1
Explainable Artificial Intelligence across Domains: Refinement of SHAP and Practical Applications
Kovvuri, V. R. R. (2024) · Cronfa (Swansea University) · doi:10.23889/suthesis.67149 · Cited by 2
Making Things Explainable vs Explaining: Requirements and Challenges Under the GDPR
Sovrano, F., Vitali, F., & Palmirani, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-89811-3_12
Unified framework of Explainable AI to enhance classifier performance
Manjunath, R., Chandrashekar, B., Vinutha, B. N., Arya, R., & Chatterjee, A. R. (2019) · Grace Hopper Celebration India (GHCI) · doi:10.1109/ghci47972.2019.9071811
An Architecture for Low Overhead Grid, HPC, and Cloud-Based Simulation as a Service
McMahon, M. T., Wickham, B., & Page, E. H. (2020) · Simulation foundations, methods and applications · doi:10.1007/978-3-030-51909-4_13
The Explainable Business Process (XBP) - An Exploratory Research
Alhomsi, R., & Vivacqua, A. S. (2021) · Revista de Informática Teórica e Aplicada · doi:10.22456/2175-2745.107964
Интуиция: опыт формального исследованияPreprint
Прокопчук, Ю. А. (2022) · doi:10.31219/osf.io/u6fsx
Chen, Y.-H., Sharma, C., Sharma, S., Sharma, K., & Sethi, G. K. (2023) · Research Square · doi:10.2139/ssrn.4573960
Paasch‐Colberg, S., Strippel, C., Laugwitz, L. L., Emmer, M., Trebbe, J., van Aken, B., Löser, A., & Trömel, M. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/785ud
AI with Consciousness: Advancing Explainability in the Healthcare Sector
Ticku, A., Gupta, S. K., & Gupta, B. (2023) · International Conference on Communication, Security and Artificial Intelligence (ICCSAI) · doi:10.1109/iccsai59793.2023.10421388
Irandoust, H., & Ghajar-Khosravi, S. (2024) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555660
Approaching Principles of XAI: A Systematization
Ronge, R., Bauer, B., & Rathgeber, B. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3515937 · Cited by 1
Letrache, K., & Ramdani, M. (2026) · Applied Computational Intelligence and Soft Computing · doi:10.1155/acis/4006556
Towards a Design Theory of Discourse Strategies for Conversational Agents
Gregor, S. D., Maedche, A., & Morana, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-28316-0_13
Metadata
- Authors
- Mueller, S. T., Hoffman, R. R., Clancey, W., Emrey, A., & Klein, G.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1902.01876
- OpenAlex
- W2913693384
- Cited by
- 215
- References
- 44
- Citations by year
- 2026: 4 · 2025: 13 · 2024: 25 · 2023: 43 · 2022: 35 · 2021: 57 · 2020: 32 · 2019: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- explainable AI, human-AI interaction, explanation quality, intelligent tutoring systems, expert systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
