Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AI

Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization

Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513

Distilling the Knowledge in a Neural Network

Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204

Playing Atari with Deep Reinforcement Learning

Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471

Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps

Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370

Explanation in artificial intelligence: Insights from the social sciences

Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302

Striving for Simplicity: The All Convolutional Net

Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447

Towards A Rigorous Science of Interpretable Machine Learning

Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121

Building machines that learn and think like people

Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550

Explaining Explanations: An Overview of Interpretability of Machine Learning

Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

Goyal, Y., Khot, T., Summers-Stay, D., Batra, D., & Parikh, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.670 · Cited by 2,287

Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI

Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423

Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence

Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762

Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale

Wang, B., Rau, P.-L. P., & Yuan, T. (2023) · Behaviour & Information Technology · doi:10.1080/0144929x.2022.2072768 · Cited by 1,036

The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies

Markus, A. F., Kors, J. A., & Rijnbeek, P. R. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103655 · Cited by 811

Explainable AI (XAI): A systematic meta-survey of current challenges and future opportunities

Saeed, W., & Omlin, C. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110273 · Cited by 783

What do we want from Explainable Artificial Intelligence (XAI)? – A stakeholder perspective on XAI and a conceptual model guiding interdisciplinary XAI research

Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652

Explainable Deep Learning: A Field Guide for the Uninitiated

Ras, G., Xie, N., van Gerven, M. A. J., & Doran, D. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13200 · Cited by 551

A historical perspective of explainable Artificial Intelligence

Confalonieri, R., Çoba, L., Wagner, B., & Besold, T. R. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1391 · Cited by 431

Transitioning to Human Interaction with AI Systems: New Challenges and Opportunities for HCI Professionals to Enable Human-Centered AI

Xu, W., Dainoff, M. J., Ge, L., & Gao, Z. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2041900 · Cited by 363

Bias and Discrimination in AI: A Cross-Disciplinary Perspective

Ferrer, X., Nuenen, T. V., Such, J. M., Cote, M., & Criado, N. (2021) · IEEE Technology and Society Magazine · doi:10.1109/mts.2021.3056293 · Cited by 308

Measures for explainable AI: Explanation goodness, user satisfaction, mental models, curiosity, trust, and human-AI performance

Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1096257 · Cited by 272

Four principles of explainable artificial intelligence

Phillips, P. J., Hahn, C. A., Fontana, P. C., Yates, A. N., Greene, K., Broniatowski, D. A., & Przybocki, M. A. (2021) · doi:10.6028/nist.ir.8312 · Cited by 262

A Survey of Data-driven and Knowledge-aware eXplainable AI

Li, X.-H., Cao, C. C., Shi, Y., Bai, W., Gao, H., Qiu, L., Wang, C., Gao, Y., Zhang, S., Xue, X., et al. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2983930 · Cited by 224

Explaining black-box classifiers using post-hoc explanations-by-example: The effect of explanations and error-rates in XAI user studies

Kenny, E. M., Ford, C., Quinn, M., & Keane, M. T. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103459 · Cited by 211

The role of shared mental models in human-AI teams: a theoretical review

Andrews, R. W., Lilly, J. M., Srivastava, D., & Feigh, K. M. (2022) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2022.2061080 · Cited by 231

Influencing human–AI interaction by priming beliefs about AI can increase perceived trustworthiness, empathy and effectiveness

Pataranutaporn, P., Liu, R., Finn, E., & Maes, P. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00720-7 · Cited by 192

Trust in artificial intelligence: From a foundational trust framework to emerging research opportunities

Lukyanenko, R., Maass, W., & Storey, V. C. (2022) · Electronic Markets · doi:10.1007/s12525-022-00605-4 · Cited by 171

Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence

Herrmann, T., & Pfeiffer, S. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01391-5 · Cited by 173

Explainable Artificial Intelligence by Genetic Programming: A Survey

Mei, Y., Chen, Q., Lensen, A., Xue, B., & Zhang, M. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3225509 · Cited by 182

I Think I Get Your Point, AI! The Illusion of Explanatory Depth in Explainable AI

Chromik, M., Eiband, M., Buchner, F., Krüger, A., & Butz, A. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450644 · Cited by 144

Four Principles of Explainable Artificial Intelligence

Phillips, P. J., Hahn, C. A., Fontana, P. C., Broniatowski, D. A., & Przybocki, M. A. (2020) · doi:10.6028/nist.ir.8312-draft · Cited by 136

Artificial cognition: How experimental psychology can help generate explainable artificial intelligence

Taylor, J. E. T., & Taylor, G. W. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01825-5 · Cited by 154

Levels of explainable artificial intelligence for human-aligned conversational explanations

Dazeley, R., Vamplew, P. W., Foale, C., Young, C., Aryal, S., & Cruz, F. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103525 · Cited by 138

A survey on artificial intelligence assurance

Batarseh, F. A., Freeman, L., & Huang, C. (2021) · Journal Of Big Data · doi:10.1186/s40537-021-00445-7 · Cited by 132

The effects of domain knowledge on trust in explainable AI and task performance: A case of peer-to-peer lending

Dikmen, M., & Burns, C. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102792 · Cited by 116

Collaborating with technology-based autonomous agents

Seeber, I., Waizenegger, L., Seidel, S., Morana, S., Benbasat, I., & Lowry, P. B. (2020) · Internet Research · doi:10.1108/intr-12-2019-0503 · Cited by 127

Don’t Just Tell Me, Ask Me: AI Systems that Intelligently Frame Explanations as Questions Improve Human Logical Discernment Accuracy over Causal AI explanations

Danry, V., Pataranutaporn, P., Mao, Y., & Maes, P. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580672 · Cited by 110

Explainable Artificial Intelligence Approaches: A SurveyPreprint

Islam, S. R., Eberle, W., Ghafoor, S., & Ahmed, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.09429 · Cited by 168

Explainable artificial intelligence in information systems: A review of the status quo and future research directions

Brasse, J., Broder, H. R., Förster, M., Klier, M., & Sigler, I. (2023) · Electronic Markets · doi:10.1007/s12525-023-00644-5 · Cited by 121

Explainable Artificial Intelligence (XAI)

Ridley, M. (2022) · Information Technology and Libraries · doi:10.6017/ital.v41i2.14683 · Cited by 115

Examining the effect of explanation on satisfaction and trust in AI diagnostic systems

Alam, L., & Mueller, S. T. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01542-6 · Cited by 89

“That's (not) the output I expected!” On the role of end user expectations in creating explanations of AI systems

Riveiro, M., & Thill, S. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103507 · Cited by 93

Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making

Lee, M. H., & Chew, C. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610218 · Cited by 78

Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions

Petersen, E., Potdevin, Y., Mohammadi, E., Zidowitz, S., Breyer, S., Nowotka, D., Henn, S., Pechmann, L., Leucker, M., Rostalski, P., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3178382 · Cited by 92

Rule extraction in unsupervised anomaly detection for model explainability: Application to OneClass SVM

Barbado, A., Corcho, Ó., & Benjamins, R. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116100 · Cited by 77

An Agile New Research Framework for Hybrid Human-AI Teaming: Trust, Transparency, and Transferability

Caldwell, S., Sweetser, P., O’Donnell, N., Knight, M. J., Aitchison, M., Gedeon, T., Johnson, D. M., Brereton, M. F., Gallagher, M. R., & Conroy, D. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3514257 · Cited by 92

The Effects of Explanations in Automated Essay Scoring Systems on Student Trust and Motivation

Conijn, R., Kahr, P. K., & Snijders, C. C. P. (2023) · Journal of Learning Analytics · doi:10.18608/jla.2023.7801 · Cited by 114

Scenario-Based Requirements Elicitation for User-Centric Explainable AI - A Case in Fraud Detection

Cirqueira, D., Nedbal, D., Helfert, M., & Bezbradica, M. (2020) · International Cross-Domain Conference on Machine Learning and Knowledge Extraction · doi:10.1007/978-3-030-57321-8_18 · Cited by 74

Cultural Bias in Explainable AI Research: A Systematic Analysis

Peters, U., & Carman, M. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14888 · Cited by 95

Strategic interactions between humans and artificial intelligence: lessons from experiments with computer players

March, C. (2021) · Journal of Economic Psychology · doi:10.1016/j.joep.2021.102426 · Cited by 72

Beyond explainability: justifiability and contestability of algorithmic decision systems

Henin, C., & Le Métayer, D. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01251-8 · Cited by 71

Interpretable machine learning for genomics

Watson, D. (2021) · Human Genetics · doi:10.1007/s00439-021-02387-9 · Cited by 87

Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI

Liao, Q. V., Zhang, Y., Luss, R., Doshi-Velez, F., & Dhurandhar, A. (2022) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v10i1.21995 · Cited by 69

A Survey on Explainable Artificial Intelligence Techniques and Challenges

Hanif, A., Zhang, X., & Wood, S. (2021) · IEEE International Enterprise Distributed Object Computing Conference Workshops (EDOCW) · doi:10.1109/edocw52865.2021.00036 · Cited by 76

Explainable AI In Education : Current Trends, Challenges, And Opportunities

Rachha, A., & Seyam, M. (2023) · SoutheastCon 2023 · doi:10.1109/southeastcon51012.2023.10115140 · Cited by 68

Toward Explainable Affective Computing: A Review

Cortiñas-Lorenzo, K., & Lacey, G. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3270027 · Cited by 87

Explainable Multivariate Time Series Classification

Hsieh, T.-Y., Wang, S., Sun, Y., & Honavar, V. (2021) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3437963.3441815 · Cited by 65

An explanation framework and method for AI-based text emotion analysis and visualisation

Li, Y., Chan, J., Peko, G. M., & Sundaram, D. (2023) · Decision Support Systems · doi:10.1016/j.dss.2023.114121 · Cited by 58

Accessible Cultural Heritage through Explainable Artificial Intelligence

Díaz-Rodríguez, N., & Pisoni, G. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3386392.3399276 · Cited by 55

Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI Interaction

Li, T., Vorvoreanu, M., DeBellis, D., & Amershi, S. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511605 · Cited by 70

Survey of XAI in Digital Pathology

Pocevičiūtė, M., Eilertsen, G., & Lundström, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50402-1_4 · Cited by 53

Implementing Machine Learning in Interventional Cardiology: The Benefits Are Worth the Trouble

Ali, W. B., Pesaranghader, A., Avram, R., Overtchouk, P., Perrin, N., Laffite, S., Cartier, R., Ibrahim, R., Modine, T., & Hussin, J. (2021) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.711401 · Cited by 56

An objective metric for Explainable AI: How and why to estimate the degree of explainability

Sovrano, F., & Vitali, F. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110866 · Cited by 60

Exploring Explainable AI in the Financial Sector: Perspectives of Banks and Supervisory Authorities

Kuiper, O. X., van den Berg, M., van der Burgt, J., & Leijnen, S. (2022) · Communications in computer and information science · doi:10.1007/978-3-030-93842-0_6 · Cited by 68

A Review of Machine Learning for Convective Weather

McGovern, A., Chase, R. J., Flora, M. L., Gagne, D. J., Lagerquist, R., Potvin, C. K., Snook, N., & Loken, E. D. (2023) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-22-0077.1 · Cited by 61

Explainable AI for Deep Learning Based Disease Detection

Kinger, S., & Kulkarni, V. Y. (2021) · International Conference on Contemporary Computing · doi:10.1145/3474124.3474154 · Cited by 49

Explainable AI: The Effect of Contradictory Decisions and Explanations on Users’ Acceptance of AI Systems

Ebermann, C., Selisky, M., & Weibelzahl, S. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2126812 · Cited by 54

Explainable Student Agency Analytics

Saarela, M., Heilala, V., Jääskelä, P., Rantakaulio, A., & Kärkkäinen, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116664 · Cited by 48

A Taxonomy for Human Subject Evaluation of Black-Box Explanations in XAI.

Chromik, M., & Schuessler, M. (2020) · Cited by 39

Towards Design Principles for User-Centric Explainable AI in Fraud Detection

Cirqueira, D., Helfert, M., & Bezbradica, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77772-2_2 · Cited by 43

Human‐centered explainable artificial intelligence: An Annual Review of Information Science and Technology (ARIST) paper

Ridley, M. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24889 · Cited by 61

Explaining Naive Bayes and Other Linear Classifiers with Polynomial Time and DelayPreprint

Marques-Silva, J. P., Gerspacher, T., Cooper, M., Ignatiev, A., & Narodytska, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05803 · Cited by 37

Contrastive Explanations of Plans through Model Restrictions

Krarup, B., Krivić, S., Magazzeni, D., Long, D. P., Cashmore, M., & Smith, D. E. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12813 · Cited by 36

Meta-analysis informed machine learning: Supporting cytokine storm detection during CAR-T cell Therapy

Bogatu, A., Wysocka, M., Wysocki, O., Butterworth, H., Pillai, M. R., Allison, J., Landers, D., Kilgour, E., Thistlethwaite, F. C., & Freitas, A. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104367 · Cited by 38

Tractable Explanations for d-DNNF Classifiers

Huang, X., Izza, Y., Ignatiev, A., Cooper, M., Asher, N. M., & Marques-Silva, J. P. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i5.20514 · Cited by 32

Cognitive Anthropomorphism of AI: How Humans and Computers Classify Images

Mueller, S. T. (2020) · Ergonomics in Design The Quarterly of Human Factors Applications · doi:10.1177/1064804620920870 · Cited by 32

Model-based contrastive explanations for explainable planning

Krarup, B., Cashmore, M., Magazzeni, D., & Miller, T. (2019) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · Cited by 29

DeepView: Visualizing Classification Boundaries of Deep Neural Networks as Scatter Plots Using Discriminative Dimensionality Reduction

Schulz, A., Hinder, F., & Hammer, B. (2020) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 27

A Trustworthy Human–Machine framework for collective decision making in Food–Energy–Water management: The role of trust sensitivity

Uslu, S., Kaur, D., Rivera, S. J., Arjan Durresi, A., Babbar‐Sebens, M., & Tilt, J. H. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106683 · Cited by 26

Perceived artificial intelligence literacy and employability of university students

Wut, T. M., Chan, E. A.-H., Wong, H. S.-M., & Chan, J. K. Y. (2025) · Education + Training · doi:10.1108/et-06-2024-0272 · Cited by 40

Interpretable machine learning models for predicting and explaining vehicle fuel consumption anomalies

Barbado, A., & Corcho, Ó. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105222 · Cited by 33

Algorithmic fog of war: When lack of transparency violates the law of armed conflict

Kwik, J., & van Engers, T. (2021) · Journal of Future Robot Life · doi:10.3233/frl-200019 · Cited by 24

Increasing the Value of XAI for Users: A Psychological Perspective

Hoffman, R. R., Miller, T., Klein, G. A., Mueller, S. T., & Clancey, W. J. (2023) · Künstliche Intell. · doi:10.1007/s13218-023-00806-9 · Cited by 24

A New Perspective on Evaluation Methods for Explainable Artificial Intelligence (XAI)

Speith, T., & Langer, M. (2023) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew57809.2023.00061 · Cited by 25

What Would You Ask the Machine Learning Model? Identification of User Needs for Model Explanations Based on Human-Model Conversations

Kuźba, M., & Biecek, P. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-65965-3_30 · Cited by 23

A Meta Survey of Quality Evaluation Criteria in Explanation Methods

Löfström, H., Hammar, K., & Johansson, U. (2022) · Lecture notes in business information processing · doi:10.1007/978-3-031-07481-3_7 · Cited by 31

A Theoretical Framework for AI Models Explainability with Application in Biomedicine

Rizzo, M., Veneri, A., Albarelli, A., Lucchese, C., Nobile, M. S., & Conati, C. (2023) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb56990.2023.10264877 · Cited by 23

Calibrated explanations: With uncertainty information and counterfactuals

Löfström, H., Löfström, T., Johansson, U., & Sönströd, C. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123154 · Cited by 30

Work with AI and Work for AI: Autonomous Vehicle Safety Drivers’ Lived Experiences

Chu, M., Zong, K., Shu, X., Gong, J., Lu, Z., Guo, K., Dai, X., & Zhou, G. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581564 · Cited by 31

New research paradigms and agenda of human factors science in the intelligence era

Wei, X. U., Gao, Z., & Ge, L. (2023) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2024.00363 · Cited by 28

ContrXT: Generating contrastive explanations from any text classifier

Malandri, L., Mercorio, F., Mezzanzanica, M., Nobani, N., & Seveso, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.11.016 · Cited by 20

Defect Reduction Planning (Using TimeLIME)

Peng, K., & Menzies, T. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3062968 · Cited by 20

DeepView: Visualizing Classification Boundaries of Deep Neural Networks as Scatter Plots Using Discriminative Dimensionality Reduction

Schulz, A., Hinder, F., & Hammer, B. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/319 · Cited by 19

NSF AI Institute for Research on Trustworthy AI in Weather, Climate, and Coastal Oceanography (AI2ES)

McGovern, A., Bostrom, A., Davis, P., Demuth, J. L., Ebert‐Uphoff, I., He, R., Hickey, J. J., Gagne, D. J., Snook, N., Stewart, J. Q., et al. (2022) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-21-0020.1 · Cited by 19

Psychology and AI at a Crossroads: How Might Complex Systems Explain Themselves?

Hoffman, R. R., Miller, T., & Clancey, W. J. (2022) · The American Journal of Psychology · doi:10.5406/19398298.135.4.01 · Cited by 19

Roadmap of Designing Cognitive Metrics for Explainable Artificial Intelligence (XAI)

Hsiao, J. H.-W., Ngai, H. H. T., Qiu, L., Yang, Y., & Cao, C. C. (2021) · arXiv · doi:10.48550/arxiv.2108.01737 · Cited by 45

Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)

Keane, M. T., & Smyth, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58342-2_11 · Cited by 158

Introduction to Explainable AI and Intelligent Transportation

Gaur, L., & Sahoo, B. M. (2022) · Springer eBooks · doi:10.1007/978-3-031-09644-0_1 · Cited by 19

An Assurance Case Pattern for the Interpretability of Machine Learning in Safety-Critical Systems

Ward, F. R., & Habli, I. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55583-2_30 · Cited by 18

A call for more explainable AI in law enforcement

Matulionytė, R., & Hanif, A. (2021) · IEEE International Enterprise Distributed Object Computing Conference Workshops (EDOCW) · doi:10.1109/edocw52865.2021.00035 · Cited by 20

Explainable AI in Finance: Addressing the Needs of Diverse Stakeholders

Wilson, C. H. (2025) · doi:10.56227/25.1.25 · Cited by 18

Color for Characters - Effects of Visual Explanations of AI on Trust and Observability

Schrills, T., & Franke, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-50334-5_8 · Cited by 17

Evaluating the impact of explainable AI on clinicians’ decision-making: A study on ICU length of stay prediction

Jung, J., Kang, S., Choi, J., El-Kareh, R. E., Lee, H., & Kim, H. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105943 · Cited by 19

Trustworthy AI: AI developers’ lens to implementation challenges and opportunities

Cousineau, C., Dara, R. A., & Chowdhury, A. H. (2024) · Data and Information Management · doi:10.1016/j.dim.2024.100082 · Cited by 17

Exploring limits to tree planting as a natural climate solution

Rana, P., & Varshney, L. R. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.135566 · Cited by 17

Applications of explainable artificial intelligence in renewable energy research

Perr‐Sauer, J., Ugirumurera, J., Gafur, J., Bensen, E. A., Nguyen, T., Paul, S., Severino, J., Nag, A., Vijayshankar, S., Gasper, P. J., et al. (2025) · Energy Reports · doi:10.1016/j.egyr.2025.08.046 · Cited by 20

Integrating AI literacy into the TAM-TPB model to explain students’ intention to use educational AI through MASEM approach

Yang, H., Xu, N., Lin, X., & Zhang, W. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100833 · Cited by 22

Evaluating machine-generated explanations: a “Scorecard” method for XAI measurement science

Hoffman, R. R., Jalaeian, M., Tate, C., Klein, G. A., & Mueller, S. T. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1114806 · Cited by 15

A unified and practical user-centric framework for explainable artificial intelligence

Kaplan, S., Uusitalo, H. M. T., & Lensu, L. T. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111107 · Cited by 21

To whom to explain and what? : Systematic literature review on empirical studies on Explainable Artificial Intelligence (XAI)

Tiainen, M. (2021) · UTUPub (University of Turku) · Cited by 1

Explanation Perspectives from the Cognitive Sciences---A Survey

Srinivasan, R., & Chander, A. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/670 · Cited by 33

Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations

Rong, Y., Leemann, T., Nguyen, T.-T., Fiedler, L., Qian, P., Unhelkar, V., Seidel, T., Kasneci, G., & Kasneci, E. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3331846 · Cited by 278

Explanation in AI systems

Tešić, M., & Hahn, U. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780198862536.003.0006 · Cited by 2

What Are People Doing About XAI User Experience? A Survey on AI Explainability Research and Practice

Ferreira, J. J., & Monteiro, M. S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-49760-6_4 · Cited by 68