A Review of Explainable Artificial Intelligence from the Perspectives of Challenges and Opportunities
Open accessThe DOI matches its Crossref record; 172 of the 185 references it cites were found in a registry or an index, and 13 are not checked yet.
Abstract
The widespread adoption of Artificial Intelligence (AI) in critical domains, such as healthcare, finance, law, and autonomous systems, has brought unprecedented societal benefits. Its black-box (sub-symbolic) nature allows AI to compute prediction without explaining the rationale to the end user, resulting in lack of transparency between human and machine. Concerns are growing over the opacity of such complex AI models, particularly deep learning architectures. To address this concern, explainability is of paramount importance, which has triggered the emergence of Explainable Artificial Intelligence (XAI) as a vital research area. XAI is aimed at enhancing transparency, trust, and accountability of AI models. This survey presents a comprehensive overview of XAI from the dual perspectives of challenges and opportunities. We analyze the foundational concepts, definitions, terminologies, and taxonomy of XAI methods. We then review several application domains of XAI. Special attention is given to various challenges of XAI, such as no universal definition, trade-off between accuracy and interpretability, and lack of standardized evaluation metrics. We conclude by outlining the future research directions of human-centric design, interactive explanation, and standardized evaluation frameworks. This survey serves as a resource for researchers, practitioners, and policymakers to navigate the evolving landscape of interpretable and responsible AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“2012 Deep Learning [41] Despite high predictive accuracy, DNN is an opaque black-box model.”
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · International Journal of Surgery · doi:10.1016/j.ijsu.2021.105906 · Cited by 11,748
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“These models offer transparency by exposing the internal logic directly to the user [54].”
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
The Mythos of Model Interpretability
Lipton, Z. C. (2016) · arXiv · doi:10.48550/arxiv.1606.03490 · Cited by 5,422 · cited 7×
“Furthermore, as deep learning continues to evolve and becomes more complex, model-agnostic XAI approaches need to be improved to provide consistent explanations [20].”
InfluentialDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“For example, Gradient-weighted Class Activation Mapping (Grad-CAM), a saliency map technique, produces a heatmap to show which regions of the image contributed the most to the predicted class [73].”
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
Privacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356 · cited 1×
“The future of XAI will involve the development of explainability methods for these next-generation AI models [196].”
The Journal Coverage of Web of Science, Scopus and Dimensions: A Comparative Analysis
Singh, V. K., Singh, P., Karmakar, M., Leta, J., & Mayr, P. (2021) · Scientometrics · doi:10.1007/s11192-021-03948-5 · Cited by 2,342 · cited 1×
“To perform the literature search, we selected two databases, Scopus and Web of Science (WOS), because of their extensive coverage of peer-reviewed XAI articles published in leading international journals and conference proceedings [51].”
Anchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162 · cited 2×
“Anchors are applied locally around an instance to capture the conditions of an if-then rule [57].”
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 5×
““Right to Explanation” in GDPR [32] The EU established legal grounds for demanding explanations of automated decisions.”
InfluentialIntelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685
A model of inexact reasoning in medicine
Shortliffe, E. H., & Buchanan, B. G. (1975) · Mathematical Biosciences · doi:10.1016/0025-5564(75)90047-4 · Cited by 1,447
Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks
Wang, H., Wang, Z., Du, M., Yang, F., Zhang, Z., Ding, S., Mardziel, P., & Hu, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00020 · Cited by 1,424
Explainable AI: Interpreting, Explaining and Visualizing Deep Learning
(2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6 · Cited by 1,377
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Agrawal, R., Gollapudi, S., Halverson, A., & Ieong, S. (2009) · Proceedings of the Second ACM International Conference on Web Search and Data Mining · doi:10.1145/1498759.1498766 · Cited by 1,020
Attention is not not Explanation
Wiegreffe, S., & Pinter, Y. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1002 · Cited by 966 · cited 1×
“…as attention visualization [146], prompt attribution [147], explanation with exemplar-based reasoning (e.g., in-context learning) [147], chain-of-thought prompting [148], and self-explaining models [149] are being investigated to provide a transparent view of the model’s internal logic [150,151].”
Interpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958
Interpretable Convolutional Neural Networks
Zhang, Q., Wu, Y. N., & Zhu, S.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00920 · Cited by 833
Ponce‐Bobadilla, A. V., Schmitt, V., Maier, C. S., Mensing, S., & Stodtmann, S. (2024) · Clinical and Translational Science · doi:10.1111/cts.70056 · Cited by 826
Explainable AI (XAI): A systematic meta-survey of current challenges and future opportunities
Saeed, W., & Omlin, C. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110273 · Cited by 783
Three naive Bayes approaches for discrimination-free classification.
Calders, T., & Verwer, S. (2010) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0190-x · Cited by 764
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Albahri, A. S., Duhaim, A. M., Fadhel, M. A., Alnoor, A., Baqer, N. S., Alzubaidi, L., Albahri, O. S., Alamoodi, A. H., Bai, J., Salhi, A., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.03.008 · Cited by 716 · cited 1×
“For instance, in the healthcare domain, disease prediction by an AI model has to be both accurate and transparent [11].”
Explainability for Large Language Models: A Survey
Zhao, H., Chen, H., Yang, F., Liu, N., Deng, H., Cai, H., Wang, S., Yin, D., & Du, M. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3639372 · Cited by 681 · cited 4×
“Moreover, LLMs can be further enhanced through Reinforcement Learning from Human Feedback (RLHF) to refine responses and align with human preferences [147].”
InfluentialRaji, I. D., & Buolamwini, J. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314244 · Cited by 651
A Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629 · cited 2×
“Global explanation describes the overall behavior of a model across the entire input space, allowing insights into feature importance and model structure [53].”
Longo, L., Brcic, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102301 · Cited by 626
An Introductory Review of Deep Learning for Prediction Models With Big Data
Emmert-Streib, F., Yang, Z., Feng, H., Tripathi, S., & Dehmer, M. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00004 · Cited by 604
Notions of explainability and evaluation approaches for explainable artificial intelligence
Vilone, G., & Longo, L. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.009 · Cited by 598 · cited 2×
“All synonymous but semantically different terms require to be standardized, so that the same notions are not referred to using different names [187].”
A Review of Explainable Artificial Intelligence in Healthcare
Sadeghi, Z., Alizadehsani, R., CIFCI, M. A., Kausar, S., Rehman, R., Mahanta, P., Bora, P. K., Almasri, A., Alkhawaldeh, R. S., Hussain, S., et al. (2024) · Computers and Electrical Engineering · doi:10.1016/j.compeleceng.2024.109370 · Cited by 598 · cited 2×
“MIMIC, CheXpert, ERASER, and controlled synthetic datasets [206].”
Survey of Explainable AI Techniques in Healthcare
Chaddad, A., Peng, J., Xu, J., & Bouridane, A. (2023) · Sensors · doi:10.3390/s23020634 · Cited by 591
ERASER: A Benchmark to Evaluate Rationalized NLP Models
DeYoung, J., Jain, S., Rajani, N. F., Lehman, E., Xiong, C., Socher, R., & Wallace, B. C. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.408 · Cited by 561
Federated learning review: Fundamentals, enabling technologies, and future applications
Banabilah, S., Aloqaily, M., Alsayed, E., Malik, N., & Jararweh, Y. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103061 · Cited by 556
Knockoff Nets: Stealing Functionality of Black-Box Models
Orekondy, T., Schiele, B., & Fritz, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00509 · Cited by 549
DARPA's explainable artificial intelligence (XAI) program
Gunning, D. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3308446 · Cited by 546
Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?
Jacovi, A., & Goldberg, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.386 · Cited by 503
Interpretable deep learning: interpretation, interpretability, trustworthiness, and beyond
Li, X., Xiong, H., Li, X., Wu, X., Zhang, X., Liu, J., Bian, J., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01756-8 · Cited by 497
What is "critical" about critical design?
Bardzell, J., & Bardzell, S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466451 · Cited by 494
Counterfactual explanations and how to find them: literature review and benchmarking
Guidotti, R. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00831-6 · Cited by 471
Transformer Feed-Forward Layers Are Key-Value Memories
Geva, M., Schuster, R., Berant, J., & Levy, O. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.446 · Cited by 353
Transformer Feed-Forward Layers Are Key-Value Memories
Geva, M., Schuster, R., Berant, J., & Levy, O. (2020) · arXiv · doi:10.48550/arxiv.2012.14913 · Cited by 353
A Review of Trustworthy and Explainable Artificial Intelligence (XAI)
Chamola, V., Hassija, V., Sulthana, A. R., Ghosh, D., Dhingra, D., & Sikdar, B. (2023) · IEEE Access · doi:10.1109/access.2023.3294569 · Cited by 352 · cited 1×
“XAI should also protect privacy while dealing with people’s personal data [179].”
Dai, E., Zhao, T., Zhu, H., Xu, J., Guo, Z., Liu, H., Tang, J., & Wang, S. (2024) · Machine Intelligence Research · doi:10.1007/s11633-024-1510-8 · Cited by 324
On the Robustness of Interpretability Methods
Alvarez-Melis, D., & Jaakkola, T. S. (2018) · arXiv · doi:10.48550/arxiv.1806.08049 · Cited by 310
Deep learning models for predictive maintenance: a survey, comparison, challenges and prospects
Serradilla, O., Zugasti, E., Rodriguez, J., & Zurutuza, U. (2022) · Applied Intelligence · doi:10.1007/s10489-021-03004-y · Cited by 302
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, A. V. (2024) · doi:10.20944/preprints202402.0357.v1 · Cited by 296
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, V. (2024) · Applied Sciences · doi:10.3390/app14052074 · Cited by 290
Explainable artificial intelligence (XAI) in finance: a systematic literature review
Černevičienė, J., & Kabašinskas, A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10854-8 · Cited by 289
The explanation game: Explaining machine learning models using shapley values
Merrick, L., & Taly, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-57321-8_2 · Cited by 277
Algorithmic recourse: From counterfactual explanations to interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445899 · Cited by 274
Bujold, A., Roberge‐Maltais, I., Parent‐Rocheleau, X., Boasen, J., Sénécal, S., & Léger, P. (2023) · AI and Ethics · doi:10.1007/s43681-023-00325-1 · Cited by 272
Benchmarking saliency methods for chest X-ray interpretation
Saporta, A., Gui, X., Agrawal, A., Pareek, A., Truong, S. Q. H., Nguyen, C. D. T., Ngo, V.-D., Seekins, J., Blankenberg, F. G., Ng, A. Y., et al. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00536-x · Cited by 270 · cited 2×
“This demonstrates that saliency heat maps are useful but not fully reliable as a standalone clinical explanation [74].”
Sonkavde, G., Dharrao, D. S., Bongale, A. M., Deokate, S. T., Doreswamy, D., & Bhat, S. K. (2023) · International Journal of Financial Studies · doi:10.3390/ijfs11030094 · Cited by 262
Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information Processing
Bauer, K., von Zahn, M., & Hinz, O. (2023) · Information Systems Research · doi:10.1287/isre.2023.1199 · Cited by 261
Survey on Explainable AI: From Approaches, Limitations and Applications Aspects
Yang, W., Wei, Y., Wei, H., Chen, Y., Huang, G., Li, X., Li, R., Yao, N., Wang, X., Gu, X., et al. (2023) · Human-Centric Intelligent Systems · doi:10.1007/s44230-023-00038-y · Cited by 240
OpenXAI: Towards a Transparent Evaluation of Model ExplanationsPreprint
Agarwal, C., Ley, D., Krishna, S., Saxena, E., Pawelczyk, M., Johnson, N., Puri, I., Zitnik, M., & Lakkaraju, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.11104 · Cited by 223
Explaining deep neural networks: A survey on the global interpretation methods
Saleem, R., Yuan, B., Kurugöllü, F., Anjum, A., & Liu, L. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.129 · Cited by 219
Alkhanbouli, R., Matar Abdulla Almadhaani, H., Alhosani, F., & Simsekler, M. C. E. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-02944-6 · Cited by 214
The adoption of artificial intelligence in human resources management practices
Nawaz, N., Arunachalam, H., Pathi, B. K., & Gajenderan, V. (2024) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2023.100208 · Cited by 208
Post-hoc vs ante-hoc explanations: xAI design guidelines for data scientists
Retzlaff, C. O., Angerschmid, A., Saranti, A., Schneeberger, D., Röttger, R., Müller, H., & Holzinger, A. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2024.101243 · Cited by 194
Challenges in building large-scale information retrieval systems: invited talk
Dean, J. (2009) · Proceedings of the Second ACM International Conference on Web Search and Data Mining · doi:10.1145/1498759.1498761 · Cited by 191
Explainable AI for Credit Assessment in Banks
de Lange, P. E., Melsom, B., Vennerød, C. B., & Westgaard, S. (2022) · Journal of risk and financial management · doi:10.3390/jrfm15120556 · Cited by 188
Enhancing brain tumor detection in MRI images through explainable AI using Grad-CAM with Resnet 50
M, M. M., T. R, M., V, V. K., & Guluwadi, S. (2024) · BMC Medical Imaging · doi:10.1186/s12880-024-01292-7 · Cited by 187
From explainable to interactive AI: A literature review on current trends in human-AI interaction
Raees, M., Meijerink, I., Lykourentzou, I., Khan, V.-J., & Papangelis, K. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103301 · Cited by 180 · cited 10×
“Change in human task performance (“Model + XAI” versus “Model-only”) [190].”
InfluentialInterpretable machine learning models for crime prediction
Zhang, X., Liu, L., Lan, M., Song, G., Xiao, L., & Chen, J. (2022) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2022.101789 · Cited by 177
Towards Data-And Knowledge-Driven AI: A Survey on Neuro-Symbolic Computing
Wang, W., Yang, Y., & Wu, F. Q. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3483273 · Cited by 166
Bifarin, O. O. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284315 · Cited by 161
CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation AlgorithmsPreprint
Pawelczyk, M., Bielawski, S., Heuvel, J. V. D., Richter, T., & Kasneci, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.00783 · Cited by 153
Classification of Explainable Artificial Intelligence Methods through Their Output Formats
Vilone, G., & Longo, L. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3030032 · Cited by 152
Khan, F. S., Mazhar, S. S., Mazhar, K., AlSaleh, D., & Mazhar, A. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11215-9 · Cited by 150
A Hybrid Model for Identity Obfuscation by Face Replacement
Sun, Q., Tewari, A., Xu, W., Fritz, M., Theobalt, C., & Schiele, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_34 · Cited by 145
Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review
Kuznietsov, A., Gyevnar, B., Wang, C., Peters, S., & Albrecht, S. V. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3474469 · Cited by 144
Faceless Person Recognition: Privacy Implications in Social Media
Oh, S. J., Benenson, R., Fritz, M., & Schiele, B. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_2 · Cited by 143
Can language models learn from explanations in context?
Lampinen, A., Dasgupta, I., Chan, S., Mathewson, K., Tessler, M., Creswell, A., McClelland, J., Wang, J., & Hill, F. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.38 · Cited by 142
Diversity in Big Data: A Review
Drosou, M., Jagadish, H. V., Pitoura, E., & Stoyanovich, J. (2017) · Big Data · doi:10.1089/big.2016.0054 · Cited by 140 · cited 1×
“Consequently, XAI fairness is linked with data diversity [176], which refers to a model’s ability to represent all types of objects in its output.”
AI Reasoning in Deep Learning Era: From Symbolic AI to Neural–Symbolic AI
Liang, B., Wang, Y., & Tong, C. (2025) · Mathematics · doi:10.3390/math13111707 · Cited by 133
Artificial intelligence and the value of transparency
Walmsley, J. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-01066-z · Cited by 131
Graziani, M., Dutkiewicz, L., Calvaresi, D., Amorim, J. P., Yordanova, K., Vered, M., Nair, R., Abreu, P. H., Blanke, T., Pulignano, V., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10256-8 · Cited by 126
Explaining machine learning models with interactive natural language conversations using TalkToModel
Slack, D., Krishna, S., Lakkaraju, H., & Singh, S. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00692-8 · Cited by 125 · cited 1×
“Interactive natural-language explanatory interfaces, such as TalkToModel [77] also increase non-expert users’ performance and comprehension in applied settings.”
Mertes, S., Huber, T., Weitz, K., Heimerl, A., & André, E. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.825565 · Cited by 119 · cited 1×
“[72] introduced GANterfactual, an adversarial image-to-image translation method, which generates realistic counterfactual chest X-rays to flip a pneumonia classifier’s decision.”
AI in Finance: Challenges, Techniques and OpportunitiesPreprint
Cao, L. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3869625 · Cited by 118
Dong, J., Chen, S., Miralinaghi, M., Chen, T., Li, P., & Labi, S. (2023) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2023.104358 · Cited by 117
XAI for intrusion detection system: comparing explanations based on global and local scope
Hariharan, S., Robinson, R. R. R., Prasad, R. R., Thomas, C., & Balakrishnan, N. (2022) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-022-00441-2 · Cited by 116
XAI Systems Evaluation: A Review of Human and Computer-Centred Methods
Lopes, P., Silva, E., Braga, C., Oliveira, T., & Rosado, L. (2022) · Applied Sciences · doi:10.3390/app12199423 · Cited by 112 · cited 3×
“Moreover, the future of XAI will encompass the development of standardized evaluation protocols [21], which can be used across different models, domains, and use cases.”
InfluentialHassan, S. U., Abdulkadir, S. J., Zahid, M. S. M., & Al-Selwi, S. M. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109569 · Cited by 108
I-Pic: A Platform for Privacy-Compliant Image Capture
Aditya, P., Sen, R., Druschel, P., Joon Oh, S., Benenson, R., Fritz, M., Schiele, B., Bhattacharjee, B., & Wu, T. T. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906412 · Cited by 104
Nazat, S., Li, L., & Abdallah, M. (2024) · IEEE Access · doi:10.1109/access.2024.3383431 · Cited by 103
OpenXAI: Towards a Transparent Evaluation of Model Explanations
Agarwal, C., Krishna, S., Saxena, E., Pawelczyk, M., Johnson, N., Puri, I., Žitnik, M., & Lakkaraju, H. (2022) · neural information processing systems · doi:10.52202/068431-1148 · Cited by 98
Alessandrini, A., Cattivera, A., Holguin, C., & Stam, D. (2014) · Lecture notes in mobility · doi:10.1007/978-3-319-05990-7 · Cited by 96
Hofeditz, L., Clausen, S., Rieß, A., Mirbabaie, M., & Stieglitz, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00600-9 · Cited by 95
Alonso, J. M., Castiello, C., Magdalena, L., & Mencar, C. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-71098-9 · Cited by 95
A Comparison of Machine Learning Approaches for Predicting Employee Attrition
Guerranti, F., & Dimitri, G. M. (2022) · Applied Sciences · doi:10.3390/app13010267 · Cited by 92
Inavolu, S. M. (2024) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2024.v06i03.22283 · Cited by 92
Zhao, Z., & Bai, T. (2022) · Entropy · doi:10.3390/e24081157 · Cited by 92
A user-centered explainable artificial intelligence approach for financial fraud detection
Zhou, Y. J., Li, H., Xiao, Z., & Qiu, J. L. (2023) · Finance research letters · doi:10.1016/j.frl.2023.104309 · Cited by 91
Cremades, A., Hoyas, S., & Vinuesa, R. (2024) · International Journal of Heat and Fluid Flow · doi:10.1016/j.ijheatfluidflow.2024.109662 · Cited by 90
A Hybrid XGBoost-MLP Model for Credit Risk Assessment on Digital Supply Chain Finance
Li, Y., Stasinakis, C., & Yeo, W. M. (2022) · Forecasting · doi:10.3390/forecast4010011 · Cited by 85
The Explainability of Transformers: Current Status and Directions
Fantozzi, P., & Naldi, M. (2024) · Computers · doi:10.3390/computers13040092 · Cited by 83
A comprehensive study on fidelity metrics for XAI
Miró-Nicolau, M., Jaume-i-Capó, A., & Moyà-Alcover, G. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103900 · Cited by 82
The performance-interpretability trade-off: a comparative study of machine learning models
Assis, A., Dantas, J. R., & Andrade, E. (2024) · Journal of Reliable Intelligent Environments · doi:10.1007/s40860-024-00240-0 · Cited by 81
Interpretable AI for bio-medical applications
Sathyan, A., Weinberg, A. I., & Cohen, K. D. O. (2022) · Complex Engineering Systems · doi:10.20517/ces.2022.41 · Cited by 81
Evaluation Metrics for XAI: A Review, Taxonomy, and Practical Applications
Kadir, M. A., Mosavi, A. H., & Sonntag, D. (2023) · IEEE International Conference on Intelligent Engineering Systems (INES) · doi:10.1109/ines59282.2023.10297629 · Cited by 81
Algorithmic Recourse: from Counterfactual Explanations to Interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2020) · arXiv · doi:10.48550/arxiv.2002.06278 · Cited by 76
Using Captum to Explain Generative Language Models
Miglani, V., Yang, A., Markosyan, A. H., García-Olano, D., & Kokhlikyan, N. (2023) · Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/2023.nlposs-1.19 · Cited by 75
CLARUS: An interactive explainable AI platform for manual counterfactuals in graph neural networks
Metsch, J. M., Saranti, A., Angerschmid, A., Pfeifer, B., Klemt, V., Holzinger, A., & Hauschild, A.-C. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104600 · Cited by 75
Freeborough, W., & van Zyl, T. L. (2022) · Applied Sciences · doi:10.3390/app12031427 · Cited by 72
Bertrand, A., Viard, T., Belloum, R., Eagan, J. R., & Maxwell, W. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581314 · Cited by 71
Ethical Considerations in AI Addressing Bias and Fairness in Machine Learning Models
Sreerama, J., & Krishnamoorthy, G. (2022) · Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online) · doi:10.60087/jklst.vol1.n1.p138 · Cited by 68
Attention-based Saliency Maps Improve Interpretability of Pneumothorax Classification
Wollek, A., Graf, R., Čečatka, S., Fink, N., Willem, T., Sabel, B. O., & Lasser, T. (2023) · Radiology: Artificial Intelligence · doi:10.1148/ryai.220187 · Cited by 68
Hauptman, A. I., Schelble, B. G., Duan, W., Flathmann, C., & McNeese, N. J. (2024) · Cognition Technology & Work · doi:10.1007/s10111-024-00765-7 · Cited by 67
Fernandez-Quilez, A. (2023) · AI and Ethics · doi:10.1007/s43681-022-00161-9 · Cited by 66
Shi, H., Yang, N., Yang, X., & Tang, H. (2023) · Remote Sensing · doi:10.3390/rs15020358 · Cited by 65
Farayola, M. M., Tal, I., Connolly, R., Saber, T., & Bendechache, M. (2023) · Information · doi:10.3390/info14080426 · Cited by 63
Explainable Machine Learning in Critical Decision Systems: Ensuring Safe Application and Correctness
Wiggerthale, J., & Reich, C. (2024) · AI · doi:10.3390/ai5040138 · Cited by 61
Enhancing Chain of Thought Prompting in Large Language Models via Reasoning Patterns
Zhang, Y., Wang, X., Wu, L., & Wang, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i24.34793 · Cited by 60
Risk-Adjusted Deep Reinforcement Learning for Portfolio Optimization: A Multi-reward Approach
Choudhary, H., Orra, A., Sahoo, K., & Thakur, M. (2025) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-025-00875-8 · Cited by 60
Necula, S.-C., Dumitriu, F., & Greavu-Șerban, V. (2024) · Electronics · doi:10.3390/electronics13112055 · Cited by 52
Vanitha, K., Mahesh, T. R., Kumar, V., & Guluwadi, S. (2025) · BMC Medical Imaging · doi:10.1186/s12880-025-01630-3 · Cited by 52
Explainable AI chatbots towards XAI ChatGPT: A review
Kővári, A. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e42077 · Cited by 51
Research on customer churn prediction and model interpretability analysis
Peng, K., Peng, Y. P., & Li, W. (2023) · PLoS ONE · doi:10.1371/journal.pone.0289724 · Cited by 50
Javaid, S., Khan, M. A., Fahim, H., He, B., & Saeed, N. (2025) · Frontiers in Sustainable Cities · doi:10.3389/frsc.2025.1561404 · Cited by 49
Fine, A., & Marsh, S. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00142-3 · Cited by 47
Evaluation Metrics in Explainable Artificial Intelligence (XAI)
Coroama, L., & Groza, A. P. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-20319-0_30 · Cited by 45
Explaining Static Analysis - A Perspective
Nachtigall, M., Quang, L. N., & Bodden, E. (2019) · IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW) · doi:10.1109/asew.2019.00023 · Cited by 45
The Past, Present, and Prospective Future of XAI: A Comprehensive Review
Islam, M. U., Mottalib, M. M., Hassan, M., Alam, Z. I., Zobaed, S., & Rabby, M. F. (2022) · Studies in computational intelligence · doi:10.1007/978-3-030-96630-0_1 · Cited by 45
Saleh, Y., Talib, M. W. A., Nasir, Q., & Dakalbab, F. M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1523699 · Cited by 45
Interpretable machine learning for predicting sepsis risk in emergency triage patients
Liu, Z., Shu, W., Li, T., Zhang, X., & Chong, W. (2025) · Scientific Reports · doi:10.1038/s41598-025-85121-z · Cited by 43
Counterfactual explanations for misclassified images: How human and machine explanations differ
Delaney, E. D., Pakrashi, A., Greene, D., & Keane, M. T. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103995 · Cited by 43
A meta-learning based stacked regression approach for customer lifetime value prediction
Gadgil, K., Gill, S. S., & Abdelmoniem, A. M. (2023) · Journal of Economy and Technology · doi:10.1016/j.ject.2023.09.001 · Cited by 43
Miró-Nicolau, M., Jaume-i-Capó, A., & Moyà-Alcover, G. (2024) · Artificial Intelligence · doi:10.1016/j.artint.2024.104179 · Cited by 40
Cesario, E., Lindia, P., & Vinci, A. (2024) · Journal Of Big Data · doi:10.1186/s40537-024-00935-4 · Cited by 39
Rahevar, M., & Darji, S. (2024) · International Journal of Management, Economics and Commerce. · doi:10.62737/m1vpdq75 · Cited by 39
Lu, S., Chen, R., Wei, W., & Lu, X. (2021) · PubMed Central · doi:10.48550/arxiv.2103.11254 · Cited by 37
Introduction to Machine Learning and Artificial Intelligence in Banking and Finance
Mishra, A. K., Tyagi, A. K., Richa, R., & Patra, S. R. (2024) · Financial Mathematics and Fintech · doi:10.1007/978-3-031-47324-1_14 · Cited by 37
Explainable Bayesian networks applied to transport vulnerability
de Waal, A., & Joubert, J. W. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118348 · Cited by 34
Context-dependent choice and evaluation in real-world consumer behavior
Otto, A. R., Devine, S., Schulz, E., Bornstein, A. M., & Louie, K. (2022) · Scientific Reports · doi:10.1038/s41598-022-22416-5 · Cited by 34
Federated Learning of Explainable Artificial Intelligence (FED-XAI): A Review
López-Blanco, R., Alonso, R. S., Arrieta, A. G., Chamoso, P., & Prieto, J. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-38333-5_32 · Cited by 34
Perceptual user interfaces: affective perception
Picard, R. W. (2000) · Communications of the ACM · doi:10.1145/330534.330539 · Cited by 29
Bashir, Z., Lin, M., Feragen, A., Mikolaj, K. W., Taksøe‐Vester, C., Christensen, A. N., Svendsen, M. B. S., Fabricius, M. H., Andreasen, L. A., Nielsen, M., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-86536-4 · Cited by 29
Chen, Y., Liu, H., Wen, Z., & Lin, W. (2023) · Systems · doi:10.3390/systems11060312 · Cited by 28
Artificial intelligence as structural estimation: Deep Blue, Bonanza, and AlphaGo
Igami, M. (2020) · The Econometrics Journal · doi:10.1093/ectj/utaa005 · Cited by 28
Butz, R., Schulz, R., Hommersom, A., & van Eekelen, M. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102438 · Cited by 27
Ford, C., & Keane, M. T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-37731-0_15 · Cited by 27
SHAP-based Explanations are Sensitive to Feature Representation
Hwang, H., Bell, A. S., Fonseca, J., Pliatsika, V., Stoyanovich, J., & Whang, S. E. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732105 · Cited by 26
A Comparative Analysis of Model Agnostic Techniques for Explainable Artificial Intelligence
Wang, Y. (2024) · Research Reports on Computer Science · doi:10.37256/rrcs.3220244750 · Cited by 26
How much do we see? On the explainability of partial dependence plots for credit risk scoring
Szepannaek, G., & Lübke, K. (2023) · Argumenta Oeconomica · doi:10.15611/aoe.2023.1.07 · Cited by 25
Manipulation Risks in Explainable AI: The Implications of the Disagreement Problem
Goethals, S., Martens, D., & Evgeniou, T. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-74633-8_12 · Cited by 25
Feng, J., Liang, J., Qiang, Z., Hao, Y., Li, X., Li, L., Chen, Q., Liu, G., & Wei, H. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02378-y · Cited by 23
Jain, N., & Jana, P. K. (2022) · Information Sciences · doi:10.1016/j.ins.2022.09.040 · Cited by 21
Explainable artificial intelligence
Mahto, M. K. (2024) · CRC Press eBooks · doi:10.1201/9781003502432-2 · Cited by 20
Using Captum to Explain Generative Language Models
Miglani, V., Yang, A., Markosyan, A. H., Garcia-Olano, D., & Kokhlikyan, N. (2023) · arXiv · doi:10.48550/arxiv.2312.05491 · Cited by 20
Understanding Disparities in Post Hoc Machine Learning Explanation
Mhasawade, V., Rahman, S., Haskell-Craig, Z., & Chunara, R. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659043 · Cited by 19
Wang, T., Fu, Y., Cheng, X., Li, L., He, Z., & Xiao, Y. (2025) · Sensors · doi:10.3390/s25041024 · Cited by 19
Mu, D., Zhang, S., Zhu, T., Zhou, Y., & Zhang, W. (2024) · Social Science Computer Review · doi:10.1177/08944393241226607 · Cited by 15
The Role of Explainable AI (XAI) in Forensic Investigations
Shamoo, Y. (2024) · Advances in digital crime, forensics, and cyber terrorism book series · doi:10.4018/979-8-3373-0857-9.ch002 · Cited by 13
An Advanced Explainable Belief Rule-Based Framework to Predict the Energy Consumption of Buildings
Kabir, S., Hossain, M. S., & Andersson, K. (2024) · Energies · doi:10.3390/en17081797 · Cited by 11
Self-citationExplainability, Quantified: Benchmarking XAI Techniques
Perotti, A., Borile, C., Miola, A., Nerini, F. P., Baracco, P., & Panisson, A. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63787-2_22 · Cited by 11
Wang, W., & Shang, K. (2024) · Advances in computer science research · doi:10.2991/978-94-6463-447-1_4 · Cited by 11
Deep Learning Opacity, and the Ethical Accountability of AI Systems. A New Perspective
Basti, G., & Vitiello, G. (2023) · Studies in applied philosophy, epistemology and rational ethics · doi:10.1007/978-3-031-39113-2_2 · Cited by 10
Eren, Ö., & Owens, E. G. (2023) · Journal of Quantitative Criminology · doi:10.1007/s10940-023-09571-2 · Cited by 10
Challenges and Opportunities in Deploying Explainable AI for Financial Risk Assessment
Akkalkot, A. I., Kulshrestha, N., Sharma, G., Sidhu, K. S., Palimkar, S. S., & Nethravathi, K. (2025) · International Conference on Pervasive Computational Technologies (ICPCT) · doi:10.1109/icpct64145.2025.10940643 · Cited by 10
The Evolution of Reinforcement Learning
Hougen, D. F., & Shah, S. N. H. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9003146 · Cited by 9
Improving Recidivism Forecasting With a Relaxed Naïve Bayes Classifier
Lee, Y., SooHyun, O., & Eck, J. E. (2023) · Crime & Delinquency · doi:10.1177/00111287231186093 · Cited by 7
AI Explainability 360 Toolkit for Time-Series and Industrial Use Cases
Ganapavarapu, G., Mukherjee, S., Gil, N. M., Sarpatwar, K., Rajasekharan, A., Dhurandhar, A., Arya, V., & Vaculín, R. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599182 · Cited by 7
Khan, A., Ali, A., Khan, J., Ullah, F., & Faheem, M. (2025) · IEEE Access · doi:10.1109/access.2025.3558913 · Cited by 7
Fuzzy Logic and Technology, and Aggregation Operators
Massanet, S., Montes, S., Ruiz-Aguilera, D., & González-Hidalgo, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-39965-7 · Cited by 6
On the interpretability of the SVM model for predicting infant mortality in Bangladesh
Sayeed, M. A., Rahman, A., Rahman, A., & Rois, R. (2024) · Journal of Health Population and Nutrition · doi:10.1186/s41043-024-00646-9 · Cited by 6
Deep Learning-Based Point Cloud Classification of Obstacles for Intelligent Vehicles
Xu, Y., Wu, D., Zhou, M., & Yang, J. (2025) · World Electric Vehicle Journal · doi:10.3390/wevj16020080 · Cited by 4
Kabir, S., Hossain, M. S., & Andersson, K. (2025) · Algorithms · doi:10.3390/a18060305 · Cited by 4
Self-citationMartín, R. R. D. S., Morales-Hernández, C., Barberá, C., Martínez-Cortés, C., Banegas‐Luna, A. J., Segura-Méndez, F. J., Pérez‐Sánchez, H., Moreno, I. M., & Morante, J. J. H. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6030080 · Cited by 3
Decision trees with short explainable rules
Souza, V. F., Cicalese, F., Laber, E., & Molinaro, M. (2025) · Theoretical Computer Science · doi:10.1016/j.tcs.2025.115344 · Cited by 3
Unsupervised Discrete Representation Learning
Hu, W., Miyato, T., Tokui, S., Matsumoto, E., & Sugiyama, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_6 · Cited by 3
Erdoğanyılmaz, C. (2024) · Innovations in Intelligent Systems and Applications Conference (ASYU) · doi:10.1109/asyu62119.2024.10757009 · Cited by 2
A Multi-Model Approach to Legal Judgment Prediction Using Advanced Knowledge Integration Techniques
Leung, C., & Mehrnia, B. (2024) · Journal of Computer Science and Artificial Intelligence · doi:10.54097/sbh1pg04 · Cited by 1
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.00069
Research works printed but not linked: 27
- Lundberg, S.M., and Lee, S.I. (2017, January 4–9). A Unified Approach to Interpreting Model Predictions. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA. Available online: https://arxiv.org/abs/1705.07874. · arXiv
- Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
- Kulesza, T., Stumpf, S., Burnett, M., Wong, W.K., and Striegel, A. (May, January 27). Principles of Explanatory Debugging to Assist Machine Learning. Proceedings of the 2013 CHI Conference on Human Factors in Computing Systems (CHI ’13), Paris, France.
- Stumpf, S., Rajaram, V., Li, L., Burnett, M., Dietterich, T.G., Sullivan, E., and Drummond, R. (2009, January 8–11). Interacting with Machine Learning Systems: The Case for Explanation and Beyond. Proceedings of the 14th International Conference on Intelligent User Interfaces (IUI ’09), Sanibel Island, FL, USA.
- Shortliffe, E. (2012). Computer-Based Medical Consultations: MYCIN, Elsevier.
- Barocas, S., Friedler, S., Hardt, M., Kroll, J., Venkatasubramanian, S., and Wallach, H. (2025, June 09). The FAT-ML Workshop Series on Fairness, Accountability, and Transparency in Machine Learning. Available online: http://www.fatml.org/.
- Binns, R. (2018, January 23–24). Fairness in Machine Learning: Lessons from Political Philosophy. Proceedings of the 2018 Conference on Fairness, Accountability and Transparency (FAT), New York, NY, USA.
- Goldstein, A., Kapelner, A., Bleich, J., and Pitkin, E. (2015, January 10–13). Predicting Consumer Choices from Complex Behavioral Data. Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, Australia.
- Amershi, S., Chickering, M., Drucker, S.M., Lee, B., Simard, P., and Suh, J. (May, January 26). ModelTracker: Redesigning Performance Analysis Tools for Machine Learning. Proceedings of the CHI ’14: SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada.
- Sarti, G., Feldhus, N., Qi, J., Nissim, M., and Bisazza, A. (2024, January 17–19). Democratizing Advanced Attribution Analyses of Generative Language Models with the Inseq Toolkit. Proceedings of the Joint of the 2nd World Conference on eXplainable Artificial Intelligence Late-Breaking Work, Demos and Doctoral Consortium, xAI-2024: LB/D/DC, Valletta, Malta.
- Simuni, 2024, Explainable AI in ML: The Path to Transparency and Accountability, Int. J. Recent Adv. Multidiscip. Res., 11, 10531
- Rajkomar, 2019, Ensuring Fairness in Machine Learning for Healthcare, Lancet, 393, 110
- Uchida, S., Barney, E., and Eglin, V. (2022). Sequence-to-Sequence Models for Extracting Information from Registration and Legal Documents. Document Analysis Systems. DAS 2022, Springer. Lecture Notes in Computer Science, Vol. 13237.
- Zafar, 2024, Artificial Intelligence in Autonomous Systems: Challenges and Opportunities, Res. Corrid. J. Eng. Sci., 1, 182
- Gartner, 2017, Autonomy and Accountability in Autonomous Systems, IEEE Intell. Syst., 32, 8
- Dastin, J. (2025, August 28). Amazon Scraps Secret AI Recruiting Tool That Showed Bias Against Women. Reuters, 10 October 2018. Available online: https://www.taylorfrancis.com/chapters/edit/10.1201/9781003278290-44/amazon-scraps-secret-ai-recruiting-tool-showed-bias-women-jeffrey-dastin. · doi:10.1201/9781003278290-44/amazon-scraps-secret-ai-recruiting-tool-showed-bias-women-jeffrey-dastin
- Veeramachaneni, 2025, Large Language Models: A Comprehensive Survey on Architectures, Applications, and Challenges, Adv. Innov. Comput. Program. Lang., 7, 20
- Polignano, 2024, XAI.it 2024: An Overview on the Future of AI in the Era of Large Language Models, XAI.it, 3839, 1
- Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q.V., and Zhou, D. (2022). Chain of Thought Prompting Elicits Reasoning in Large Language Models. arXiv.
- Krause, S., and Stolzenburg, F. Commonsense Reasoning and Explainable Artificial Intelligence Using Large Language Models. Proceedings of the European Conference on Artificial Intelligence.
- Randl, K., Pavlopoulos, J., Henriksson, A., and Lindgren, T. Evaluating the Reliability of Self-Explanations in Large Language Models. Proceedings of the International Conference on Discovery Science.
- Chen, J., Song, L., and Yoon, J. (2018, January 3–8). Explaining Explanations: Axiomatic Feature Interactions for Deep Networks. Proceedings of the 32nd Conference on Neural Information Processing Systems (NeurIPS 2018), Montreal, QC, Canada.
- Molnar, C. (2020). Interpretable Machine Learning, Springer. [2nd ed.].
- Ziethmann, P., Stieler, F., Pfrommer, R., Schlögl-Flierl, K., and Bauer, B. (July, January 29). Towards a Framework for Interdisciplinary Studies in Explainable Artificial Intelligence. Proceedings of the International Conference on Human-Computer Interaction, Washington, DC, USA.
- Lei, Y., Li, Z., Li, Y., Zhang, J., and Shan, H. (2023, January 10–16). LICO: Explainable Models with Language-Image Consistency. Proceedings of the Thirty-Seventh Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, LA, USA. Available online: https://arxiv.org/abs/2310.09821. · arXiv
- Serrurier, 2023, On the Explainable Properties of 1-Lipschitz Neural Networks: An Optimal Transport Perspective, Adv. Neural Inf. Process. Syst., 36, 54645
- Burger, C., Walter, C., and Le, T. (2024). The Effect of Similarity Measures on Accurate Stability Estimates for Local Surrogate Models in Text-Based Explainable AI. arXiv.
Cited by
Aravindkumar, A., Ramadoss, M., Ahmed, S. A. F., Sampath, V., & Lakshminarayanan, K. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1749527 · Cited by 50
Öz, M., Üstüner, E., Çifci, S., Budak, F., İleri, E., & Dikel, S. (2025) · Aquaculture International · doi:10.1007/s10499-025-02352-7 · Cited by 33
Khajavian, M., Jang, J.-H., Kwon, J.-Y., Lee, J.-M., Lee, S., Hwang, M.-H., Yang, E., Jang, J., & Chae, K. (2026) · Inorganic Chemistry Communications · doi:10.1016/j.inoche.2026.116269 · Cited by 25
Machine Learning in Next-Generation Polymer Composites: Recent Advances and Perspectives
Olhan, S., Antil, B., & Maimí, P. (2026) · Applied Composite Materials · doi:10.1007/s10443-025-10437-y · Cited by 26
Dang, M., Liu, B., Chen, Y., & Zhang, Z. (2026) · Psychoradiology · doi:10.1093/psyrad/kkag007 · Cited by 10
Metadata
- Authors
- Kabir, S., Hossain, M. S., & Andersson, K.
- Affiliations
- Luleå University of Technology (SE)
- University of Chittagong (BD)
- Corresponding author
- Kabir, Sami
- Andersson, Karl
- Venue
- Algorithms
- Publisher
- MDPI AG
- Published
- 2025-09-03
- Volume
- 18
- Issue
- 9
- Pages
- 556
- ISSN
- 1999-4893 (ISSN-L)
- OpenAlex
- W4413951932
- Cited by
- 44
- References
- 167
- Citations by year
- 2026: 42 · 2025: 2
- FWCI
- 17.65
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Algorithms (publishedVersion, cc-by)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- VINNOVA (Sweden’s Innovation Agency) through the Digital Stadsutveckling Campus Skellefteå project (2022-01188)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- explainable AI, interpretability, black-box models, trust in AI, accountability, accuracy-interpretability trade-off, evaluation metrics, interactive explanations, human-centered design, responsible AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.