Survey of Explainable AI Techniques in Healthcare
Open accessThe DOI matches its Crossref record; 119 of the 120 references it cites were found in a registry or an index, and 1 are not checked yet; 8 of the 50 sources its claims cite were checked for support.
Abstract
Artificial intelligence (AI) with deep learning models has been widely applied in numerous domains, including medical imaging and healthcare tasks. In the medical field, any judgment or decision is fraught with risk. A doctor will carefully judge whether a patient is sick before forming a reasonable explanation based on the patient’s symptoms and/or an examination. Therefore, to be a viable and accepted tool, AI needs to mimic human judgment and interpretation skills. Specifically, explainable AI (XAI) aims to explain the information behind the black-box model of deep learning that reveals how the decisions are made. This paper provides a survey of the most recent XAI techniques used in healthcare and related medical imaging applications. We summarize and categorize the XAI types, and highlight the algorithms used to increase interpretability in medical imaging topics. In addition, we focus on the challenging XAI problems in medical applications and provide guidelines to develop better interpretations of deep learning models using XAI concepts in medical image and text analysis. Furthermore, this survey provides future directions to guide developers and researchers for future prospective investigations on clinical topics, particularly on applications with medical imaging.
Verified 2026-10-05 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This survey reviews recent explainable AI (XAI) techniques for healthcare and medical imaging, categorizing them by interpretation type, model specificity, explanation scope, and explanation form. It highlights commonly used methods such as Grad-CAM, LIME, SHAP, attention, prototypes, and radiomics, and discusses human-centered, deployment, quality, and future challenges.
Key findings
- XAI methods are categorized as intrinsic vs. post hoc, model-specific vs. model-agnostic, local vs. global, and feature-based/textual/example-based; post hoc methods such as CAM/Grad-CAM and LIME are most commonly used in medical imaging.
- The paper reports that clinician satisfaction with LIME chart interpretation reached 78%, though many low-satisfaction clinicians gave low scores despite recognizing the explanations.
- In an evaluation of saliency maps, eight interpretable methods (+ Grad-CAM, guided backpropagation, and guided Grad-CAM) were assessed, but performance on the testing datasets was not competitive.
- For Trojan attack detection, backpropagation had a high success rate, CAM detected the entire trigger region but not always accurate localization, and LIME had high success for small triggers; LIME and SHAP showed unstable explanations with limited examples.
Methods
- Design: narrative survey of recent XAI techniques used in healthcare and related medical imaging, summarizing and categorizing XAI types and algorithms.
- Data/sample: literature and tables (Table 1, Table 2, Table 3) covering XAI methods, modalities, and explanations; no primary dataset or systematic review protocol is reported.
- Analysis: qualitative synthesis of principles, deployment, performance, and challenges, including discussion of radiomics and future directions.
Limitations
- The paper states that the definition of XAI is not clear enough and that explainability depends on the prediction task and target users rather than uniform standards.
- The paper states that post hoc application in the medical field requires more effort; TCAV needs more investigation; trainable attention needs more work; SHAP applications are limited to specific problems; LIME’s low repeatability limits interpretability; and evaluating XAI explanations remains a challenge.
- Evident from the text: the survey does not report a systematic search strategy, inclusion/exclusion criteria, or quantitative meta-analysis; it is a narrative overview.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Flowchart of visual comparison between black-box and explainable artificial intelligence, and how the results affect the user. The top branch shows the process of a black-box model. Typically, it provides only results such as classes (e.g., COVID or non-COVID). The other two branches (middle and bottom) represent two XAI methods, referred to in Section 3.1. Specifically, the XAI model (middle) shows the example of saliency map, and the second one (bottom) is the prototype method, as explained in Section 4.1 and Section 4.6, respectively. An example of a CT image obtained from the COVID-19 CT scan dataset [10].](https://figures.cochat.ai/paper-figures/7410cd2efd4c4f5c87ab22ce2e01ec4c/survey-of-explainable-ai-techniques-in-healthcare-figure-1.jpg)

![Figure 3 Categorization of explainable AI methods used in this paper. These criteria and categories are summarized from [25,26,27]. The orange and blue grids represent the criteria and categories, respectively.](https://figures.cochat.ai/paper-figures/89dcecc050d5476e8f47abead15c4155/survey-of-explainable-ai-techniques-in-healthcare-figure-3.jpg)
Verification
Claims the paper makes
5 Valid · 2 Not valid · 36 Not checked · 19 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Notably, the bias may be derived from data, algorithms, and user interactions [24].”
§ Survey of Explainable AI Techniques in Healthcare > 2. XAI Techniques Related to Medical Imaging > 2.3. Bias and Fairness
What the sources say
- Supportedcites [24] Mehrabi N. Morstatter F. Saxena N. Lerman K. Galstyan A. A survey on bias and fairness in machine learning ACM Comput. Surv. (CSUR) 2021 54 1 35 10.1145/3457607 source
Section 3 of Mehrabi et al. is titled 'BIAS IN DATA, ALGORITHMS, AND USER EXPERIENCES' (p. heading, passage [3]), and its opening text (passage [2]) states that biases in training data are learned and amplified by algorithms, that algorithms can display biased behaviour from design choices even on unbiased data, and that user interactions feed back into new biased data. Subsections 3.1.2 and 3.1.3 (passages [1], [6], [7]) explicitly define algorithmic bias and user interaction bias and describe user-generated data as a bias source, matching the claim's three origins. (LLM, conf=0.92)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In [15], the authors identified three types of security risks related to black-box AI: network attacks, system bias, and mismatch attacks.”
§ Survey of Explainable AI Techniques in Healthcare > 2. XAI Techniques Related to Medical Imaging > 2.1. Confidentiality and Privacy
What the sources say
- Partly supportedcites [15] Kiener M. Artificial intelligence in medicine and the disclosure of risks AI Soc. 2021 36 705 713 10.1007/s00146-020-01085-w 33110296 PMC7580986 sourceExperimental — accuracy not yet measured
The “Three risks of black box AI” section identifies cyber-attacks, systematic bias, and mismatch as risks; page numbers are unavailable in our copy. But it describes mismatch as an AI recommendation that fails to fit a patient’s circumstances, not as an attack, and does not classify all three as security risks. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, there are many practical problems related to the speed of operation and implementation [106].”
§ Survey of Explainable AI Techniques in Healthcare > 6. Discussion, Challenges, and Prospects > 6.2. AI System Deployment
What the sources say
- Partly supportedcites [106] Sutton R.T. Pincock D. Baumgart D.C. Sadowski D.C. Fedorak R.N. Kroeker K.I. An overview of clinical decision support systems: Benefits, risks, and strategies for success NPJ Digit. Med. 2020 3 17 10.1038/s41746-020-0221-y 32047862 PMC7005290 sourceExperimental — accuracy not yet measured
The Introduction says AI-based clinical decision support systems face challenges with explainability and have yet to reach widespread implementation. “Fragmented workflows” says such systems can increase the time clinicians need to complete tasks. These passages support practical implementation and time-related problems for clinical decision support, but do not establish a problem with the operating speed of XAI itself. (LLM, conf=0.83)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“For example, CAM is effective in detecting the entire trigger region, but may not always provide the accurate localization of the trigger [112].”
§ Survey of Explainable AI Techniques in Healthcare > 6. Discussion, Challenges, and Prospects > 6.3. Quality of Explanation
What the sources say
- Partly supportedcites [112] Lin Y.S. Lee W.C. Celik Z.B. What do you see? Evaluation of explainable artificial intelligence (XAI) interpretability through neural backdoors arXiv 2020 2009.10639 sourceExperimental — accuracy not yet measured
Section 4.3 reports that Grad-CAM completely covers the trigger region for ResNet50 models, but highlights only a small area inside the trigger for VGG16 and AlexNet. This supports the localization caveat, not an unqualified claim that it detects the entire region. Section 2 also distinguishes Grad-CAM, the method evaluated, from CAM. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most of the recently proposed medical imaging works use post-interpretation rather than model-based interpretation (e.g., CAM and GCAM models are widely used).”
§ Survey of Explainable AI Techniques in Healthcare > 6. Discussion, Challenges, and Prospects
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
18 more claims
Create a free account to see all 62 claims and to verify the 42 references still open.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 13
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Explainable AI in healthcare has been surveyed extensively, yet no existing review addresses the challenges posed by decoder-based LLMs.”
From Explainability of decoder-only clinical large language models: A scoping review (2026) · cites this paper as [46]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These dimensions were categorized according to established and previously validated XAI taxonomies [12,17,18], which were adapted to the context of agentic AI systems as a provisional analytic schema to enable consistent classification across heterogeneous implementations.”
From Explainable Agentic Artificial Intelligence in Healthcare: A Scoping Review (2026) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nonetheless, these reviews consistently highlight persistent challenges relating to faithfulness, stability, and standardized evaluation of explanations.”
From Explainable and Interpretable AI for Voice and Speech Analysis in Clinical Care: Systematic Review (2026) · cites this paper as [62]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Survey of Explainable AI Techniques in Healthcare > 4. Introduction of the Explainable AI Method: A Brief Overview > 4.5. Triplet Networks
“the other two samples are randomly chosen from the training set in the same “Positive” and different “Negative” categories.”
§ Survey of Explainable AI Techniques in Healthcare > 4. Introduction of the Explainable AI Method: A Brief Overview > 4.5. Triplet Networks
“Since labeling is not necessary, this method can be used for unsupervised learning.”
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“Typically, this approach combines CNNs and long short-term memory networks (LSTM) for encoding the image and text, respectively [81].”
BackgroundGrad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · cited 3×
“[28] BP * * * [29] Guided-BP * * * [30] Deconv Network * * * [31] LRP * * * [32] CAM * * * [33] Grad-CAM * * * [34] LIME * * * [35] GraphLIME * * * [36] SHAP * * * Feature”
Method"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · cited 3×
“[28] BP * * * [29] Guided-BP * * * [30] Deconv Network * * * [31] LRP * * * [32] CAM * * * [33] Grad-CAM * * * [34] LIME * * * [35] GraphLIME * * * [36] SHAP * * * Feature”
BackgroundGauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428 · cited 3×
“For example, backpropagation [28], class activation mapping [32], and layer-wise relevance propagation [31] are all post hoc interpretation techniques.”
MethodArrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321 · cited 1×
“Typically, XAI is an explainable model providing insights into how the predictions are made to achieve trustworthiness, causality, transferability, confidence, fairness, accessibility, and interactivity [5,6].”
BackgroundRudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 2×
“However, it is suggested to develop an interpretable model for any high-risk medical situation [8].”
BackgroundBarredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · cited 1×
“Typically, XAI is an explainable model providing insights into how the predictions are made to achieve trustworthiness, causality, transferability, confidence, fairness, accessibility, and interactivity [5,6].”
Background
Research works printed but not linked: 6
- Devlin J. Chang M. Lee K. Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding arXiv 2018 1810.04805
- Yang X. He X. Zhao J. Zhang Y. Zhang S. Xie P. COVID-CT-dataset: A CT scan dataset about COVID-19 arXiv 2020 2003.13865
- Simonyan K. Vedaldi A. Zisserman A. Deep inside convolutional networks: Visualising image classification models and saliency maps arXiv 2013 1312.6034
- Jiang C. Chen Y. Chang J. Feng M. Wang R. Yao J. Fusion of medical imaging and electronic health records with attention and multi-head machanisms arXiv 2021 2112.11710
- Shapley L.S. 17. A value for n-person games Contributions to the Theory of Games (AM-28), Volume II Princeton University Press Princeton, NJ, USA 2016 307 318
- Nguyen H.T.T. Cao H.Q. Nguyen K.V.T. Pham N.D.K. Evaluation of Explainable Artificial Intelligence: SHAP, LIME, and CAM Proceedings of the FPT AI Conference 2021 Ha Noi, Viet Nam 6–7 May 2021 1 6
Cited by
Items 401–500 of 631
Artificial Intelligence in Orthopaedic Research: A Technical Report on Opportunities and Pitfalls
Dwajan, A. (2026) · Cureus · doi:10.7759/cureus.104159 · Cited by 1
“Such misuse undermines the credibility of research and poses ethical challenges for academic publishing [14].”
Shehada, D. J. M., Tawfik, H., Bouridane, A., & Hussain, A. (2026) · Computers · doi:10.3390/computers15030139 · Cited by 1
Self-citationNicolăescu, C.-G., Enescu, F. M., Mazare, A. G., Bizon, N., & Toma, C. V. (2026) · Algorithms · doi:10.3390/a19040244 · Cited by 2
Saeedi, M., Wei, L., Edoho, M. E., & Mooney, C. (2026) · Applied Sciences · doi:10.3390/app16073444 · Cited by 2
Ethical Considerations for Artificial Intelligence Tools in Small Animal Veterinary Medicine
Coghlan, S., & Quinn, T. (2026) · Veterinary Clinics of North America Small Animal Practice · doi:10.1016/j.cvsm.2026.03.001 · Cited by 1
Kosna, S. R. (2026) · International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA) · doi:10.1109/acdsa67686.2026.11467989 · Cited by 1
Unified time series classification framework for explainable artificial intelligence
Bragança, H. L. D. S., & Souto, E. (2026) · Scientific Reports · doi:10.1038/s41598-026-49467-2 · Cited by 1
Rezaee, K., & Fakhrabadi, A. K. (2026) · Brain and Behavior · doi:10.1002/brb3.71457 · Cited by 2
“…and clinical variables, where explainable AI tools such as SHAP, LIME, and related attribution methods are increasingly used to improve interpretability (Tabashum et al. 2024 ; Rabie and Akhloufi 2025 ; Esan et al. 2025 ; Jin et al. 2025 ; Egbo et al. 2025 ; Aladhadh 2025 ; Chaddad et al. 2023 ).”
Zhang, S., Xu, Y., & Xiao, Y. (2026) · PLoS ONE · doi:10.1371/journal.pone.0348508 · Cited by 1
“Chaddad et al. [28] reviewed technical frameworks of explainable AI in healthcare, emphasizing the importance of multimodal attention and local feature attribution.”
Aliyu, L. J., Umar, A. B., Sani, S. K., Haruna, U. A., Danjuma, A. H., Zubairu, M., & Yahaya, H. (2026) · BMC Artificial Intelligence · doi:10.1186/s44398-026-00036-7 · Cited by 1
“In the healthcare sector, where trust, accountability, and accuracy are critical, XAI plays a vital role in ensuring that AI predictions are interpretable to both clinicians and patients [66].”
Alkafaween, E., Moshref, M., & Dmour, M. (2026) · Electronics · doi:10.3390/electronics15091965 · Cited by 1
Explainable AI-Based Deep Learning Model for Banana Disease Identification
Jaiswal, P., Shrivastava, P. C., Ansari, M. T., Bhukya, R. K., & Tushar, T. (2025) · IEEE International Conference on Recent Trends in Computing and Smart Mobility (RCSM) · doi:10.1109/rcsm67767.2025.11506806 · Cited by 1
“…which can explain globally why certain types of data contribute to predictions, and approximate the decision boundary given a training set, but in terms of global interpretability, it may not be reliable due to its sensitivity across datasets [25], and computational efficiency for larger models.”
Kamil, M. H., Farma, E. P. T., & Basuki, S. (2026) · Journal of Electronics Electromedical Engineering and Medical Informatics · doi:10.35882/jeeemi.v8i2.1506
Empowering healthcare 5.0 with deep learning: techniques, trends, and future directions
Maji, P. K., Chakraborty, S., Sadiq, A., Basu, S., & Ghosh, K. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11593-8 · Cited by 1
Jain, K., Vora, D., Benslimane, A., & Khairnar, V. D. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10610-x · Cited by 1
Gutiérrez-Esparza, G. O., Martínez-García, M., Amezcua-Guerra, L. M., Rivera, M. M., & Lemus, E. H. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1805107 · Cited by 1
“This in turn, may allow the medical personnel to better understand what factors are contributing to the estimated risk and, in consequence, orient them for early specific interventions (62, 63).”
Lai, C.-Y., Yu, J., Lee, C., Wang, G., Perdana, S. A., Chen, T.-H., & Yeh, T. (2026) · Service Science · doi:10.1287/serv.2025.0067 · Cited by 1
Moncher, M., Traboulsi, V., Kofler, F., Müller, S., Steinbauer, F., & von See, C. (2026) · Journal of Imaging · doi:10.3390/jimaging12070285 · Cited by 1
“Although Grad-CAM can provide exploratory localization of attention [33], saliency methods in medical imaging have recognized limitations and may fail to localize subtle or clinically relevant features reliably [29,30].”
Explainable AI for malaria classification: Enhancing transparency and trust in clinical diagnostics
Savarimuthu, X., Ruban, S., Varenya, V., Shanthini, H., Mahmoud, A., Rai, S., & Subramani, S. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-45374-8.00003-4 · Cited by 1
Trustworthy and explainable lightweight facial emotion recognition for mental health monitoring
Shehada, D. J. M., Tawfik, H., Bouridane, A., & Hussain, A. (2026) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2026.101788 · Cited by 1
Self-citationExplainable and Trustworthy AI in Oncology: A Systematic Review Across Major Organ Systems
Hassan, M., Zubair, M., Ibrahim, R., Mahmood, T., Hussain, M., & Umair, M. (2026) · IEEE Access · doi:10.1109/access.2026.3717851 · Cited by 2
“The framework group these methods into coherent categories that makes it easier for clinicians [22], [31] and developers to develop and select the approach that aligns with their application requirements.”
InfluentialGulum, M. A., Kantardzic, M. M., Trombley, C. M., Turner, J., & Gürpinar, T. (2026) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2026.109607 · Cited by 1
Use of Wearable Devices to Detect Sedentary Behaviour in an Office Environment
Rahman, D., & García-Constantino, M. (2026) · Majestic International Journal of AI Innovations · doi:10.65080/mjai.v1.cm2601105005 · Cited by 10
Explainable Artificial Intelligence: Point and Counterpoint
Knox, A. T., Khakoo, Y., & Gombolay, G. Y. (2023) · Pediatric Neurology · doi:10.1016/j.pediatrneurol.2023.08.010 · Cited by 1
Radiomics for a Comprehensive Assessment of Glioblastoma Multiforme
Chaddad, A., Wang, Y., & Feng, J.-J. (2023) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom56612.2023.10472352 · Cited by 1
“The specific meanings of “interpretability” and “explainability” are not the same, and sometimes people confuse the two, but it is important to distinguish between the two [38].”
BackgroundSelf-citationKumar, A. K., Sarveswaran, S., Dheerthi, N., & Murugarajan, A. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-5767-5.ch015 · Cited by 1
Modelling Activities of Daily Living Using Local Interpretable Model-Agnostic Explanation Algorithm
Onyekwe, H., Ekerete, I., García-Constantino, M., & Nugent, C. (2024) · Irish Signals and Systems Conference · doi:10.1109/issc61953.2024.10602854 · Cited by 1
Kaduskar, V. P., Mhetre, H. V., Khatavkar, S. M., Chougule, P. A., Patil, M. V., Moje, R., & Naik, N. (2024) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-7452-8.ch016 · Cited by 2
Explainable AI techniques used in healthcare
Ticku, A., Qureshi, R., Jha, S., & Kumar, V. S. (2024) · AIP conference proceedings · doi:10.1063/5.0221511 · Cited by 1
Patricio, M. A., Granados, N., Molina, J. M., & Berlanga, A. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109359 · Cited by 1
Application of artificial intelligence in immuno-oncology
Monfort‐Lanzas, P., Gronauer, R., Balaz, M., Floriani, G., & Hackl, H. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-14064-8.00017-5 · Cited by 1
A Computational Protocol for the Knowledge-Based Assessment and Capture of Pathologies
Page, J., Moore, N., & Broderick, G. (2024) · Methods in molecular biology · doi:10.1007/978-1-0716-4200-9_14 · Cited by 1
Image Captioning for Coronary Artery Disease Diagnosis
Magalhães, B., Pedrosa, J., Renna, F., Paredes, H., & Filipe, V. M. D. J. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822385 · Cited by 3
Case Study to Role of Large Language Models in Prediction of the Future Illness
Thakar, H. A., Pradhan, V., Sarda, J. S., Brahma, B., & Bhoi, A. K. (2025) · Studies in computational intelligence · doi:10.1007/978-3-031-82516-3_13 · Cited by 2
Using Machine Learning to Identify Autism Spectrum Disorder Across All Ages
Kumar, A., & Jaiswal, U. C. (2024) · International Conference on IoT, Communication and Automation Technology (ICICAT) · doi:10.1109/icicat62666.2024.10923404 · Cited by 2
“Data is stored by its originating association [55].”
Enhancing Interpretability: The Role of Explainable AI in Healthcare Diagnostics
Zade, N., Langote, M., & Verma, P. (2025) · International Conference on Electronics and Renewable Systems (ICEARS) · doi:10.1109/icears64219.2025.10940671 · Cited by 1
“Post-hoc XAI methods can be used in any AI model regardless of the latter's structure and in the case of black box algorithms widely used in healthcare systems [9].”
Leveraging explainable AI in deep learning for brain tumor detection
Kothadiya, D., Chaudhari, A., Faldu, P., & Gajjar, D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-23979-3.00014-2 · Cited by 2
Karakasidis, E. (2025) · Health and Technology · doi:10.1007/s12553-025-00997-1 · Cited by 1
Sartaz, M. S., Masnun, R., Atik, M. M. A., Ahmed, M. S., Intakhab, B., Islam, M. M., & Ahad, A. (2025) · International Conference on Computer Systems and Technologies (CompSysTech) · doi:10.1109/compsystech65493.2025.11137257 · Cited by 1
“This state-of-the-art interpretability technique quantifies feature importance and provides insights into the decision-making process of ML models [13].”
Koyyada, S. P., & Singh, T. P. (2023) · Journal of Intelligent Systems · doi:10.1515/jisys-2023-0163 · Cited by 2
Reinforcement Learning for Medical Image Classification Based on Deep Deterministic Policy Gradients
Chaddad, A., & Jiang, Y. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635454 · Cited by 2
“XAI is currently being used to assist in medical diagnosis and treatment [4, 5].”
MethodSelf-citationAhamed, S. M., & Jabez, J. (2025) · Wiley eBooks · doi:10.1002/9781394249312.ch16 · Cited by 1
Spinal Metastasis—Imaging Using XAI and RAI Techniques
Bagada, A. A., & Patel, P. V. (2025) · Wiley eBooks · doi:10.1002/9781394302444.ch5 · Cited by 1
Qin, P., Du, Z., Zhang, L., Zhai, S., Lei, Z., Zhou, Y., Yu, D., Yan, C. C., Yuan, X., Ji, J., et al. (2025) · Research Square · doi:10.21203/rs.3.rs-5731226/v1 · Cited by 1
Elgazzar, K., Wadie, P., Eissa, C., Alsbakhi, A., & Alhejaily, A.-M. (2025) · doi:10.2196/preprints.80928 · Cited by 1
Babatunde, A. O., Togunwa, T. O., Oyebanji, T. E., Babatunde, Y. O., Ajibade, A., Ogunlana, O. E., Okeke, M. F., & Nwaozuru, U. (2025) · Research Square · doi:10.21203/rs.3.rs-6999902/v1 · Cited by 2
Li, Z., Zhang, J., Wang, Y., You, J., Zhong, J., & Dev, S. (2025) · Qeios · doi:10.32388/nb9j6f · Cited by 1
Improving FAIRness of Geospatial data using Large Language Models
Kavhu, B., Mäkinen, V., Muhli, P., & Oksanen, J. (2026) · Scientific Data · doi:10.1038/s41597-026-07575-8 · Cited by 1
“Drawing from explainable AI research in health and legal domains 152–156 , LLM systems for geospatial data should provide explicit references for ontology choices, structured rationales for documented links between provenance narratives and underlying workflow logs.”
Disha, J. F., Dehan, M. F. Z., & Anzum, K. M. T. (2026) · Advanced Intelligent Systems · doi:10.1002/aisy.70487
Explainability of decoder-only clinical large language models: A scoping review
Mishra, N., Abu-Hanna, A., & Calixto, I. (2026) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2026.103501
Explainable and Interpretable AI for Voice and Speech Analysis in Clinical Care: Systematic Review
Ebraheem, M., Toghranegar, J., Bridge2AI-Voice Consortium, Bensoussan, Y., & Templeton, J. M. (2026) · Journal of Medical Internet Research · doi:10.2196/83790
Punzi, C., Maslennikova, A., Gezici, G., Pellungrini, R., & Giannotti, F. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44067-0_31
A NON-PARAMETRIC APPROACH TO EXPLAINABLE ARTIFICIAL INTELLIGENCE AND ITS APPLICATION IN MEDICINE
Klyushin, D. A., & Maistrenko, O. S. (2023) · Journal of Numerical and Applied Mathematics · doi:10.17721/2706-9699.2023.2.02
AI with Consciousness: Advancing Explainability in the Healthcare Sector
Ticku, A., Gupta, S. K., & Gupta, B. (2023) · International Conference on Communication, Security and Artificial Intelligence (ICCSAI) · doi:10.1109/iccsai59793.2023.10421388
“This helps specialists in going with additional educated choices and improves their confidence in artificial intelligence suggestions [28].”
BackgroundKatagiri, Y., Ozaku, H., & Kondo, K. (2024) · Frontiers in Sensors · doi:10.3389/fsens.2024.1382152
“Thus, explainable arti fi cial intelligence has attracted much attention to overcome this problem (Nor et al., 2021; Chaddad et al., 2023; Duckworth et al., 2024).”
Explainable AI for the Classification of Brain MRIsPreprint
Blake, N., Kelly, D. M., Peña, S., Chanchal, A., & Chockler, H. (2024) · Research Square · doi:10.21203/rs.3.rs-4619245/v1 · Cited by 2
Machine learning for early prediction of preterm birth
Teshome, F., Gidi, N. W., Choe, S., Kong, J. D., & Ayana, G. (2026) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-026-09784-w · Cited by 2
Saluja, S., Rao, M., Kumar, K. V., Apune, S., & Gutte, V. S. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-9158-7.ch011
Genome Data‐Based Explainable Recommender Systems
Chetana, V. L., & Seetha, H. (2024) · Wiley eBooks · doi:10.1002/9781394268832.ch7
Advanced Deep Learning Framework for Early Alzheimer’s Disease Classification and Disease MonitoringPreprint
Nathani, P., & Bharadwaj, A. (2024) · Preprints.org · doi:10.20944/preprints202411.1964.v1
Computer-Aided Lung Auscultation Screening and Radiographic Evaluation of Pediatric Pneumonia
Kala, A., Chong, D. Y., Baqui, A. H., Ahmed, S., Islam, M. A., Chowdhury, N. H., Roy, A. D., McCollum, E. D., & Elhilali, M. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10781834 · Cited by 2
“Important contributions have been made to provide more nuance in computer-aided interpretation and develop algorithms that are clinically transparent and explainable [16], as well as address the issues of domain generalization that comes with a medical setting [17].”
Tsutsui, S., Maruko, I., Kawai, M., Kato, Y., & Ohya, J. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10781926
“To address this issue, research on XAI (Explainable AI) has rapidly increased, especially in the medical field [4].”
An Explainable Machine Learning Framework for Prediction of Recurrent Lumbar Disc Herniation
Mani, S., Thakar, S., & Rachakonda, R. S. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-7571-2_24
Explainable Multi-Label Classification Framework for Behavioral Health Based on Domain Concepts
Nweke, F., Azmee, A. A., Khan, M. A. A. H., Pei, Y., Thomas, D., & Nandan, M. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825682
“This has resulted in the development of a variety of XAI strategies [4], [5] targeted at making AI systems easier for humans to comprehend and understand.”
Arantes, R. F. M. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.18.2024.tde-13012025-162657 · Cited by 2
INTERPRETOVATELNOST A VYSVĚTLITELNOST SYSTÉMŮ UMĚLÉ INTELIGENCE
Hendl, J. (2024) · Medsoft · doi:10.35191/medsoft_2024_1_36_hendl
Chhetri, T. R. (2025) · Springer eBooks · doi:10.1007/978-3-658-45877-5_6
Deep Learning Detection of Autism Spectrum Disorder in Children and Adults
Sucharitha, M., Jyothi, B., Madupu, A., & Vanitha, P. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-97-8355-7_43
Predicting Prostate Cancer Without a Prostate: A Potential Problem with AIPreprint
Provenzano, D., Loew, M. H., Rao, Y. J., Batheja, V., & Haji-Momenian, S. (2025) · medRxiv · doi:10.1101/2025.03.04.25323311
The Synergy of Explainable AI and Evolutionary Computation: Real-World Applications
van Stein, B., Huang, Q., & Raponi, E. (2025) · Natural computing series · doi:10.1007/978-981-96-2540-6_8
Humanizing AI: A Human-Centered Architecture to Developing Trustworthy Intelligent SystemsPreprint
Akmal, M. U., Mathias, S. G., Asif, S., Koval, L., Knollmeyer, S., & Großmann, D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5246744 · Cited by 3
Conceptualizing Validation Systems for Explainable AI: A Design Approach
Fasouli, P., Bahnasawi, M. E., Gebser, M., & Kyamakya, K. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-89274-5_2 · Cited by 2
XAI with Different Methods and Applications in Healthcare
Motiramani, M., Patel, N., & Singh, A. K. (2025) · Wiley eBooks · doi:10.1002/9781394305292.ch20
Designing For Data: How Front-End Developer Can Optimize UIs for AI-Powered Apps
Kapoor, S. (2025) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2025.v07i03.46168
“Recent research shows that transparency helps with AI recommendations, increasing user involvement and trust (Chaddad et al., 2023).”
InfluentialFastMS-CDA: speeding up adversarial sample generation with multistage diffusion model
Zhu, L., Wang, S., Chen, Z., & Zhang, Y. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07480-8
“To overcome these limitations, researchers have explored adversarial sample generation using generative adversarial network (GAN)-based approaches [13].”
ARTIFICIAL INTELLIGENCE FROM A TECHNICAL PERSPECTIVE
Соколов, А. В. (2025) · doi:10.69635/978-1-0690482-4-0-ch5
Practical Guidelines for Building Explainable, Efficient, and Robust Machine Learning SystemsPreprint
Zheng, H., & Ru, Z. (2025) · Engineering Archive (engrXiv) · doi:10.31224/4744
User Trust in Artificial Intelligence–Guided Lung Ultrasound—Reply
Baloescu, C., Bailitz, J. M., & Gottlieb, M. A. (2025) · JAMA Cardiology · doi:10.1001/jamacardio.2025.2056
Explainable Artificial Intelligence: A Literature ReviewPreprint
Melo, V. H. P., & de Moura, W. M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5338183
Integrating Machine Learning with Explainable AI in Healthcare Analytics for Diabetes Prediction
Bamfo, K. A., Zeidan, D., & Terán, L. (2025) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg65568.2025.11081581
“The literature describes different XAI techniques and frameworks in health care [15], [16], [17], [18].”
Exploring Explainable AI (EXAI) – An Emerging Trend in Healthcare Sector
Pal, C., Yashvanth, M., & Rao, K. S. S. (2024) · Communications in Mathematics and Applications · doi:10.26713/cma.v15i4.3279
A Survey on Diabetic Retinopathy Detection
Fulara, V., Thakur, P., Chahar, S., Tyagi, S., & Sharma, P. (2025) · International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV) · doi:10.1109/icicv64824.2025.11085549
“In a world where diabetes-related complications, including vision loss, impact many lives, this project brings a sense of optimism [13].”
Gradient-Weighted Class Activation Mapping for Malaria Microscopy Visual Explanations
Brian, A. S., Mark, W. G., Jackson, K., Nakazzi, S., Kasauli, R., & Marvin, G. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-2724-0_29
EYE and EYE-WD: Clinically Validated, Interpretable Ensemble Learning for Women's DiabetesPreprint
Alghamdi, S., Mehmood, R., Alqurashi, F. A., Alghamdi, T., AlAhmadi, A., & Ghazali, S. M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5386582 · Cited by 3
Multi-objective Learning for Training Interpretable and Sparse Neural Networks
Feng, Y., Zhang, P., & Gao, B. J. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.08.171
An Overview of Artificial Intelligence in Neurology
Parker, T., & Brush, B. (2025) · Seminars in Neurology · doi:10.1055/a-2693-0547 · Cited by 2
“Ultimately, these tools will not replace but rather augment clinical judgement, aiding neurologists in providing accurate and personalized patient care.”
Lopukhova, E. A., Yusupov, E. S., Ibragimova, R. R., Маратовна, И. Г., Рафаэльевич, М. Т., Grakhova, E. P., & Kutluyarov, R. V. (2025) · Applied Sciences · doi:10.3390/app151810197
AI and Computational Intelligence in Healthcare
Kapoor, S., Parmar, R., Sharma, N., Garg, P., & Singh, N. J. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3311-3.ch001 · Cited by 25
Explainable Xgboost for Clinician-Acceptable Diabetes Risk Prediction
Ammar, A., & Bassam, A. A. (2025) · IEEE International Conference on Quantum Photonics, Artificial Intelligence & Networking (QPAIN) · doi:10.1109/qpain66474.2025.11172226
“● Local transparency: Clinicians can audit individual decisions [2] thanks to LIME's patient-specific explanations [7].”
InfluentialDie Rolle der künstlichen Intelligenz im Rahmen der Patientenkommunikation
Meister, S., & Strube, T. (2025) · Springer eBooks · doi:10.1007/978-3-662-71034-0_9
Unravelling Colorectal Cancer Survival Factors through Explainable AI in Clinical Data
Kumar, A., & Kaur, S. (2025) · International Conference on Computing, Intelligence, and Application (CIACON) · doi:10.1109/ciacon65473.2025.11189664
“The algorithms, Random Forest and XGBoost, have unparalleled predictive capability for survival outcomes owing to these algorithms being able to process clinical data in a well-structured, organized pattern [2].”
Siamese Neural Networks for Detecting Short-Term ECG Changes in Life-Threatening Cases
Vatian, A. S., Gusarova, N., Ulizko, M., Sukachev, P., & Golubev, A. (2025) · Signals and communication technology · doi:10.1007/978-3-031-94973-9_14
Hegel, L., Weirauch, V., & Strube, T. (2025) · Springer eBooks · doi:10.1007/978-3-658-48573-3_37
EXPLAINABLE DEEP LEARNING MODELS FOR MEDICAL IMAGE DIAGNOSIS BRIDGING ACCURACY AND INTERPRETABILITY
Nguyen, S. (2025) · International Journal of Apllied Mathematics · doi:10.12732/ijam.v38i7s.531
“As a result, there has been an increased focus on explainability, making the decision-making in a model transparent and understandable as a research priority in AI in healthcare (Holzinger, 2021; Chaddad et al., 2023).”
EXPLAINABLE DEEP LEARNING MODELS FOR MEDICAL IMAGE DIAGNOSISBRIDGING ACCURACY AND INTERPRETABILITY
Nguyen, S. (2025) · International Journal of Apllied Mathematics · doi:10.12732/ijam.v38i8s.582
Hossain, E., Aziz, M. N., Alam, M. J., Kakon, M. I., & Haque, F. (2025) · Journal of Computer Science and Information Technology · doi:10.61424/jcsit.v2i2.469
“Biases in training data, and specifically biases that privilege some populations, could undermine the fair treatment of all patients (Chaddad et al., 2023; Jiang et al., 2017; Saraswat et al., 2022).”
Du, C., Zhang, S., Li, G., Cao, X., & He, T. (2025) · Research Square · doi:10.21203/rs.3.rs-7841940/v1
Alayón-Miranda, S. (2024) · Revista Canaria de Administración Pública · doi:10.36151/rcap.3.5
An Optimized Feature Selection Approach for Enhanced Model Performance in Multi Disease Prediction
Juneja, S., Devi, R., Gupta, S., Akanksha, A., & Arora, A. (2025) · International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) · doi:10.1109/icrito66076.2025.11241371
“…system is further refined, more sophisticated methods such as explainable AI (XAI) might be able to improve the transparency of the predictions, [17] and provide clinicians a better understanding of how the models came to a certain conclusion and could improve their confidence when using the…”
Metadata
- Authors
- Chaddad, A., Peng, J., Xu, J., & Bouridane, A.
- Affiliations
- Guilin University of Electronic Technology (CN)
- University of Sharjah (AE)
- Corresponding author
- Chaddad, Ahmad
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2023-01-05
- Volume
- 23
- Issue
- 2
- Pages
- 634
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC9862413
- OpenAlex
- W4313648826
- Cited by
- 591
- References
- 111
- Citations by year
- 2026: 144 · 2025: 211 · 2024: 159 · 2023: 76
- FWCI
- 12.33
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- NATIONAL NATURAL SCIENCE FOUNDATION (82260360, QN2021033002L)
- FOREIGN YOUNG TALENTS PROGRAM (82260360, QN2021033002L)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Keywords
- explainable AI, health care, diagnostic imaging, deep learning interpretability, black-box models, medical image analysis, clinical decision support
- MeSH terms
- Algorithms, Artificial Intelligence, Humans, Judgment, Physicians, Research Personnel
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.