The DOI matches its Crossref record; 218 of the 315 references it cites were found in a registry or an index, and 1 are not checked yet; 3 of the 278 sources its claims cite were checked for support.
Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks
Open accessAbstract
Artificial Intelligence (AI) techniques of deep learning have revolutionized the disease diagnosis with their outstanding image classification performance. In spite of the outstanding results, the widespread adoption of these techniques in clinical practice is still taking place at a moderate pace. One of the major hindrance is that a trained Deep Neural Networks (DNN) model provides a prediction, but questions about why and how that prediction was made remain unanswered. This linkage is of utmost importance for the regulated healthcare domain to increase the trust in the automated diagnosis system by the practitioners, patients and other stakeholders. The application of deep learning for medical imaging has to be interpreted with caution due to the health and safety concerns similar to blame attribution in the case of an accident involving autonomous cars. The consequences of both a false positive and false negative cases are far reaching for patients' welfare and cannot be ignored. This is exacerbated by the fact that the state-of-the-art deep learning algorithms comprise of complex interconnected structures, millions of parameters, and a 'black box' nature, offering little understanding of their inner working unlike the traditional machine learning algorithms. Explainable AI (XAI) techniques help to understand model predictions which help develop trust in the system, accelerate the disease diagnosis, and meet adherence to regulatory requirements. This survey provides a comprehensive review of the promising field of XAI for biomedical imaging diagnostics. We also provide a categorization of the XAI techniques, discuss the open challenges, and provide future directions for XAI which would be of interest to clinicians, regulators and model developers.
Verified 2026-10-07 · 1 reference not checked yet
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This survey reviews explainable AI (XAI) techniques for deep neural network–based biomedical imaging, categorizing methods and mapping them to imaging modalities and medical specialties. It finds Grad-CAM is the most widely used XAI method, while evaluation standards, definitions, and clinical validation remain open challenges.
Key findings
- The survey categorizes XAI techniques into visualization (perturbation-based and gradient/backpropagation-based) and explanation by example, further classified by scope (local/global), applicability (model-specific/model-agnostic), and usage (intrinsic/post hoc).
- Across biomedical imaging, Grad-CAM is the most common and preferred XAI method, followed by LRP, LIME, and SHAP; use is increased in neurology, respiratory, and ophthalmic studies, with MRI dominant in neurology, CXR in respiratory, and fundus images in ophthalmology.
- Reported modality-specific performance examples include COVID-19 CXR with EfficientNet-B7 at 95.01% accuracy and AUC 0.950; COVID-19 CT/CXR with VGG-19 at 95.61% accuracy; low-quality CT with ResNet-50 at 99.87% accuracy and 99.58% sensitivity; Parkinson’s disease 3D CNN at 95.29% accuracy and ROC-AUC 0.98; neonatal MRI brain dysmaturation at 98.5% accuracy; coronary CTA atherosclerosis AUC 0.91; and coronary artery calcium detection AUC 0.9627 with 0.9272 accuracy.
- Evaluation of explainability remains unsettled: the paper states there is no agreement on measuring or evaluating explainability, and it reviews quantitative metrics such as deletion/insertion, CLEVR, and MSFI alongside qualitative human evaluation.
Methods
- Literature survey; papers were selected by searching Web of Science, ScienceDirect, IEEE Explore, and Google Scholar for articles on explainable, interpretable, and trustworthy XAI techniques for biomedical applications.
- No primary experiments or new data are reported; the paper synthesizes XAI techniques, tools/frameworks, evaluation methods, and applications grouped by imaging modality and medical specialty.
- Techniques are categorized by scope, applicability, and usage/nature, with summaries provided in tables.
Limitations
- Stated: there is no universally agreed definition of “explanation”; no agreement on evaluation metrics; lack of algorithm standardization; most explainability techniques are visualization-based and qualitative; current definitions lack consistency and may represent a false hope for patient-level decision support; model-highlighted features may differ from human-identified features.
- Stated: the paper calls for inherently interpretable and accurate models, human-in-the-loop systems, regulatory benchmarks, and federated learning, implying these are not yet resolved.
- Evident from the text: the survey does not report a systematic review protocol, search dates, inclusion/exclusion counts, or formal quality appraisal, and it does not independently validate the XAI methods it reviews.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
251 Not checked yet · 30 Own interpretation · 9 No basis given · 4 Own result · 3 Partly supported · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The image pre-processing using contrast-to-noise ratio, removing irrelevant regions etc. improved the DNN performance [267].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Partly supportedcites [267] Heidari, 2020, Improving the performance of CNN to predict the likelihood of COVID-19 using chest X-ray images with preprocessing algorithms, Int. J. Med. Inf. sourceExperimental — accuracy not yet measured
The Image preprocessing section describes removing the diaphragm region, reducing noise with bilateral filtering, and normalizing contrast with histogram equalization. The Discussion reports improved CNN classification accuracy from these preprocessing approaches. However, the paper does not describe using a contrast-to-noise ratio; that specific method is not supported. (LLM, conf=0.87)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The most used explainable technique for X-rays seems to be Grad-CAM, as evidenced by Table 4.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Again, Grad-CAM seems to be the most favored approach as evidenced by Table 4.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There are different XAI techniques used for different medical imaging modalities but Grad-CAM seems to be the most widely used as evidenced by Table 4.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although use of Grad-CAM and other XAI techniques have been reported in Table 4 but there is not a predominant single XAI technique used across the various imaging modalities.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.4. Ultrasound imaging
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the most common and preferred XAI method across the various medical imaging modalities seems to be Grad-CAM (Table 4), followed by LRP, LIME and SHAP and other methods.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The explainability techniques are mostly based on visualizations that provide a qualitative indication by highlighting the significance of the image areas contributing to a model's decision.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
In the paper
“The biases in the algorithms, data, or humans can result in misdiagnosis of certain patient groups further compounding the inequalities [39].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.1. DNN in medical applications
What the sources say
- Not checked yetcites [39] Norori, 2021, Addressing bias in big data and AI for health care: a call for open science, Patterns source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Hence, false negative error may be costlier compared to a false positive in relation to medical image classification [37].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.1. DNN in medical applications
What the sources say
- Not checked yetcites [37] Singh, 2021
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Convolutional Neural Networks (CNN) are state-of-the-art models for image segmentation and classification [2], although encoder-decoder transformer architectures have also been proposed [3][4][5].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 1. Introduction
What the sources say
- Not checked yetcites [2] Barredo Arrieta, 2020, Explainable Artificial Intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI, Inf. Fusion source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 81
- Probably not a substantial claim. 102
- The quote only partly states this claim. 4
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It was shown that LRP was useful for explainability of Alzheimer's classification predictions and applicable to similar disease diagnosis using MRI data [144].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
What the sources say
- Partly supportedcites [144] Böhle, 2019, Layer-wise relevance propagation for explaining deep neural network decisions in MRI-based Alzheimer's disease classification, Front. Aging Neurosci. sourceExperimental — accuracy not yet measured
The Discussion and Conclusion show that LRP helped explain individual CNN decisions in MRI-based Alzheimer’s classification. The Conclusion says the framework *might* be useful for other disease-classification studies, but the paper does not demonstrate its applicability to diagnosing other diseases. (LLM, conf=0.85)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The clinical acceptance of AI techniques would be aided by multi-modality and information fusion of both imaging and non-imaging data [34,170].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.7. Hybrid/fusion imaging for XAI
What the sources say
- Not checked yetcites [34] Karthik, 2021, AI for COVID-19 detection from radiographs: incisive analysis of state of the art techniques, IRBM source
- Partly supportedcites [170] Dunnmon, 2019, Assessment of convolutional neural networks for automated classification of chest radiographs, Radiology sourceExperimental — accuracy not yet measured
The Introduction and Discussion report that combining a chest-radiograph CNN score with a clinician’s assessment improved triage performance and could be useful in clinical practice. They do not assess multimodal imaging, fusion with non-imaging patient data, or whether either would increase clinical acceptance of AI. (LLM, conf=0.82)
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The increased use of XAI techniques is seen in neurology, respiratory and ophthalmic studies.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“CXR images are most favored for respiratory studies due to the ease with which these can be obtained, with Grad-CAM as the most prevalent XAI methods.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In ophthalmic studies, fundus images seem to be the dominant modality.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In neurology, the most prevalent image modality is MRI.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Due to the paucity of the medical data, some research is focused on addressing the associated challenges [140,227].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
What the sources say
- Not checked yetcites [140] Choi, 2020, Cognitive signature of brain FDG PET based on deep learning: domain transfer from Alzheimer's disease to Parkinson's disease, Eur. J. Nucl. Med. Mol. Imag. source
- Not checked yetcites [227] Rajpurkar, 2020, AppendiXNet: deep learning for diagnosis of appendicitis from a small dataset of CT exams using video pretraining, Sci. Rep. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The problem of bias can be addressed by an open sharing of the research process, methods, data and results, with such open sharing across institutions and funding agencies enabling open science [39].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.1. DNN in medical applications
What the sources say
- Not checked yetcites [39] Norori, 2021, Addressing bias in big data and AI for health care: a call for open science, Patterns source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“AI can potentially transform the image-based diagnosis in radiology [8].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 1. Introduction
What the sources say
- Not checked yetcites [8] Folke, 2021, Explainable AI for medical imaging: explaining pneumothorax diagnoses with Bayesian teaching, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications III
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“Neural networks require a lot of training data and time before they can produce acceptable results but are like a 'black-box' providing little or no insight into the decision-making process [13].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 1. Introduction
What the sources say
- Not checked yetcites [13] McCarthy, 2021, Enterprise imaging and big data: a review from a medical physics perspective, Phys. Med. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Convolutional Neural Networks (CNN) are state-of-the-art models for image segmentation and classification [2], although encoder-decoder transformer architectures have also been proposed [3][4][5].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 1. Introduction
What the sources say
- Not checked yetcites [3] Ahamed, 2022, Joint learning with local and global consistency for improved medical image segmentation
- Not checked yetcites [4] Dosovitskiy, 2010
- Not checked yetcites [5] Strudel, 2021, Segmenter: transformer for semantic segmentation
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The open models can be trained with local data from, for example, hospitals across the globe to mitigate bias and boost sample size [39].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.1. DNN in medical applications
What the sources say
- Not checked yetcites [39] Norori, 2021, Addressing bias in big data and AI for health care: a call for open science, Patterns source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Algorithm or model bias can be a risk in AI as the models can generate a wrongful output based on an intentional or unintentional bias [40].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.1. DNN in medical applications
What the sources say
- Not checked yetcites [40] Meske, 2020
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Disease diagnosis through these techniques is inevitable to help overcome the shortage of, for example, 2000 radiologists in UK [9].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 1. Introduction
What the sources say
- Not checked yetcites [9]
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“The performance of IBM Watson system for oncology had very successful performance and agreements with oncologists in some areas but poor in other areas, indicating adaptations to local practices and not extensible at a global scale [38].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.1. DNN in medical applications
What the sources say
- Not checked yetcites [38] Durán, 2021
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Clinicians are the primary users of XAI systems and they may have differing views but all have a need for the explainability for the patient [27].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.3. Medical practitioners
What the sources say
- Not checked yetcites [27] Antoniadi, 2021, Current challenges and future opportunities for XAI in machine learning-based clinical decision support systems: a systematic review, Appl. Sci. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Most XAI work is by the AI experts which might help engineers to build better AI systems but may be limited for other stakeholders especially the end-user [8].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.1. AI experts and application developers
What the sources say
- Not checked yetcites [8] Folke, 2021, Explainable AI for medical imaging: explaining pneumothorax diagnoses with Bayesian teaching, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications III
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The regulators would most likely be interested in an overall performance and a combination of explanations of the model rather than specific cases of individual patients [25].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.2. Regulators
What the sources say
- Not checked yetcites [25] W. Samek and K. R. Müller, “Towards explainable artificial intelligence,” in Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Lecture Notes in Computer Science, vol. vol. 11700, Springer, Cham..
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The models with an intrinsic interpretability provide better explainability at lower predictive performance compared to post-hoc methods that in contrast have less explainability but a higher predictive performance [59].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.5. Accuracy and interpretability trade-off
What the sources say
- Not checked yetcites [59] Bauer, 2021, Expl(AI)n it to me – explainable AI and information systems research, Business & Information Systems Engineering source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“It was demonstrated that the proposed 2D capsule network system provided better visualizations and malignancy predictions compared to 3D CNN and achieved better diagnostic accuracy [15].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [15] R. LaLonde, D. Torigian and U. Bagci, “Encoding visual attributes in capsules for explainable medical diagnoses,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. source
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“For example, VGG-16 model requires 15.5 billion floating-point operations for a single image classification with approximately 138 million parameters [56].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.5. Accuracy and interpretability trade-off
What the sources say
- Not checked yetcites [56] Yeom, 2021, Pruning by explaining: a novel criterion for deep neural network pruning, Pattern Recogn. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Failure to identify and address the concerns of the system users can lead to another “AI Winter”, where a small market segment could change the research and development focus from XAI [61].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.3. Medical practitioners
What the sources say
- Not checked yetcites [61] A. Preece, D. Harborne, D. Braines, R. Tomsett and S. Chakraborty, “Stakeholders in Explainable AI,” [Online]. Available: https://doi.org/10.48550/arXiv.1810.00184. [Accessed 15 September 2022].
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Natural Image Compression and Explanation (NICE) uses a mask over the entire image for each pixel in the image that captures the saliency based on its contribution to the prediction.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [75] Li, 2020, Neural image compression and explanation, IEEE Access source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“While trustworthiness should be a property of every explainable system, this does not mean that every trustworthy system should also be explainable [2].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.4. Trustworthy AI
What the sources say
- Not checked yetcites [2] Barredo Arrieta, 2020, Explainable Artificial Intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI, Inf. Fusion source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Self-explaining AI is proposed that produces a decision and an explanation.It provides a human understandable explanation and confidence level for each decision and which was deemed to motivate and lead towards trustworthy AI [55].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.4. Trustworthy AI
What the sources say
- Not checked yetcites [55] Elton, 2020, Self-explaining AI as an alternative to interpretable AI
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The heatmaps are commonly used to explain AI models and the quality of heatmaps can be appreciated using perturbation analysis [25].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3. Explainability techniques for DNN
What the sources say
- Not checked yetcites [25] W. Samek and K. R. Müller, “Towards explainable artificial intelligence,” in Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Lecture Notes in Computer Science, vol. vol. 11700, Springer, Cham..
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The introduction of a hierarchy excluded the regions with less important features [74].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [74] Monroe, 2021, HihO: accelerating artificial intelligence interpretability for medical imaging in IoT applications using hierarchical occlusion, Neural Comput. Appl. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Similar to ISO 13485:2016 Medical devices standard for Quality management systems that prescribes the medical devices regulatory requirements, there is a need for certifications of DNN models for clinical adoption [64].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.2. Regulators
What the sources say
- Not checked yetcites [64] 2018
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“Local Interpretable Modelagnostic Explanations (LIME) was proposed to explain any classifier's predictions by approximating it locally around the prediction [70].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [70] Ribeiro, 2016, Why should i trust you?': explaining the predictions of any classifier
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The patients require simplified explanations for the clinical decision as the DNN models are very complex and cannot be explained to a lay user [49].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.4. Patients
What the sources say
- Not checked yetcites [49] Gryz, 2021, Black box algorithms and the rights of individuals: no easy solution to the ‘explainability’ problem, Internet Policy Review source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Similarly, formal mathematical notations and techniques can unambiguously provide explanations for domain experts but are not targeted to the end users [63].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.1. AI experts and application developers
What the sources say
- Not checked yetcites [63] Heuillet, 2021, Explainability in deep reinforcement learning, Knowl. Base Syst. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The application developers would like to use the XAI techniques to understand the inner working and model improvement [62].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.1. AI experts and application developers
What the sources say
- Not checked yetcites [62] Wang, 2020, CNN hyperparameter optimization based on CNN visualization and perception hash algorithm
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Certification frameworks for a formal validation of models could testify the model operation statistically and ensure that the model predictions meet the required regulatory standards such as ISO/IEC CD 23053 (2020) for establishing a framework for use of AI systems [49].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3.2. Regulators
What the sources say
- Not checked yetcites [49] Gryz, 2021, Black box algorithms and the rights of individuals: no easy solution to the ‘explainability’ problem, Internet Policy Review source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Randomized Input Sampling for Explanation of Black-box Models (RISE) generates an importance map based on the importance of each pixel to the prediction [72].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [72] V. Petsiuk, A. Das and K. Saenko, “RISE: Randomized Input Sampling for Explanation of Black-box Models,” [Online]. Available: https://doi.org/10.48550/arXiv.1806.07421. [Accessed 15 September 2022].
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A novel hierarchical occlusion algorithm is proposed and is based on two observations; that the important features are localized in an image, and features collection in multiple scales can affect the prediction outcome [74].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [74] Monroe, 2021, HihO: accelerating artificial intelligence interpretability for medical imaging in IoT applications using hierarchical occlusion, Neural Comput. Appl. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“Iterative and Adaptive Sampling with Spatial Attention (IASSA) was proposed that used an iterative and adaptive sampling module to determine the saliency map of each pixel for the model prediction [73].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [73] Vasu, 2020, Iterative and adaptive sampling with spatial attention for black-box model explanations
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“An interpretable model can obtain transparency by providing the reasons behind their output [52].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.2. Interpretable AI
What the sources say
- Not checked yetcites [52] Abeyrathna, 2021, Extending the tsetlin machine with integer-weighted clauses for increased interpretability, IEEE Access source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A novel hierarchical occlusion algorithm is proposed and is based on two observations; that the important features are localized in an image, and features collection in multiple scales can affect the prediction outcome [74].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [74] Monroe, 2021, HihO: accelerating artificial intelligence interpretability for medical imaging in IoT applications using hierarchical occlusion, Neural Comput. Appl. source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“There is little agreement on what is an interpretable ML system and how it should be evaluated [51].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.2. Interpretable AI
What the sources say
- Not checked yetcites [51] Doshi-Velez, 2017
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“There is a need to have a more formalized definition of interpretability in the context of DNNs [51].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.2. Interpretable AI
What the sources say
- Not checked yetcites [51] Doshi-Velez, 2017
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“A lack of consensus in the meaning of explainability originates due to different stakeholders, each having their own understanding of the terms [61].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.3. XAI stakeholders
What the sources say
- Not checked yetcites [61] A. Preece, D. Harborne, D. Braines, R. Tomsett and S. Chakraborty, “Stakeholders in Explainable AI,” [Online]. Available: https://doi.org/10.48550/arXiv.1810.00184. [Accessed 15 September 2022].
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“There is a trade-off between the accuracy and interpretability of the models, as shown in Fig. 2, where non-linear models with better performance, such as DNNs are less explainable, and linear models which are least accurate, such as decision trees, are more explainable [2,21,45].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.5. Accuracy and interpretability trade-off
What the sources say
- Not checked yetcites [2] Barredo Arrieta, 2020, Explainable Artificial Intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI, Inf. Fusion source
- Not checked yetcites [21] Adadi, 2018, Peeking inside the black-box: a survey on explainable artificial intelligence (XAI), IEEE Access source
- Not checked yetcites [45] Gunning, 2019
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The model during training ideally should learn the discriminating image features of the various classes but instead can also learn extraneous features [42].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.1. DNN in medical applications
What the sources say
- Not checked yetcites [42] Zech, 2018, Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study, PLoS Med. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“For domains with a lack of knowledge about the underlying causal process, such as healthcare, it is prudent not to prefer explainability over diagnostic or predictive accuracy as this may affect the health and well-being of patients with some who get additional investigations and treatment and similarly those who are mjs-or undiagnosed [57].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 2.2.5. Accuracy and interpretability trade-off
What the sources say
- Not checked yetcites [57] London, 2019, Artificial intelligence and black-box medical decisions: accuracy versus explainability, Hastings Cent. Rep. source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“The proposed technique exploited learned attention for better interpretability, well-aligned to human intuition on the datasets with METEOR and BLEU metrics [92].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.4. Explanation by example
What the sources say
- Not checked yetcites [92] Xu, 2015
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The LRP has some limitations such as the heatmaps were noisy and could be non-discriminative [84].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [84] Jung, 2021, Explaining CNN and RNN using selective layer-wise relevance propagation, IEEE Access source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Among the evaluated XAI methods on the evaluation task, Deconvnet and Grad-CAM were found to be least accurate, whereas LRP, Integrated Gradients and Guided Backpropagation were found to be the most accurate methods [130].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.6. Evaluation of explainability
What the sources say
- Not checked yetcites [130] Arras, 2022, CLEVR-XAI: a benchmark dataset for the ground truth evaluation of neural network explanations, Inf. Fusion source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The evaluation of proposed technique was found to be more consistent with human understanding and intuition with an improved computational efficiency compared to the other selected approaches [90].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [90] Lundberg, 2017, A unified approach to interpreting model predictions, Adv. Neural Inf. Process. Syst.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Gradient-weighted Class Activation Mapping (Grad-CAM) was proposed for producing visual explanations by using the gradients in the final model layer to identify and highlight the important image regions [79].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [79] Selvaraju, 2017, Visual explanations from deep networks via gradient-based localization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“It was demonstrated that the proposed method could work in the presence of adversarial noise and irrespective of the model accuracy [82].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [82] Muhammad, 2020, Eigen-CAM: class activation map using principal components
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The method was motivated by Grad-CAM and RISE, however, unlike Grad-CAM it was gradient-free, and unlike RISE, it used a combined final mask instead of a random mask [76].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [76] S. M. Muddamsetty, N. S. J. Mohammad and T. B. Moeslund, “SIDU: similarity difference and uniqueness method for explainable AI,” in IEEE International Conference on Image Processing (ICIP).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The model was evaluated through a comparison with LRP, Contrastive LRP (CLRP), and Softmax Gradient LRP (SGLRP), and found to provide less noise, better class discrimination and held entire target objects [84].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [84] Jung, 2021, Explaining CNN and RNN using selective layer-wise relevance propagation, IEEE Access source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“It was shown that the combined approach achieved better attention maps and a higher classification accuracy [114].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.4. Explanation by example
What the sources say
- Not checked yetcites [114] Kashyap, 2020, Looking in the right place for anomalies: explainable ai through automatic location learning
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The interface was evaluated using surveys for both experts of DNN and non-experts and showed the approach to be effective [126].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.5. Libraries, tools, and frameworks
What the sources say
- Not checked yetcites [126] Vyas, 2020, An interactive graphical visualization approach to CNNs and RNNs
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“It was argued that the Gradient-Based methods are lacking as the neurons' gradients do not relate to the top-down saliency [85].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [85] Zhang, 2018, Top-down neural attention by excitation Backprop, Int. J. Comput. Vis. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Grad-CAM++ was proposed as a method to build on Grad-CAM and provided better visual explanations compared to it and was better in explaining multiple occurrences of the same class objects in a single image [80].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [80] Chattopadhay, 2018, Grad-CAM++: generalized gradient-based visual explanations for deep convolutional networks
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The best performing individual DNN architectures were VGG-19 and DenseNet-161 and the heatmaps generated by Grad-CAM++ were the most reliable in comparison with Grad-CAM and LRP [162].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [162] Karim, 2020, Deepcovidexplainer: explainable COVID-19 diagnosis from chest X-ray images
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“A Hierarchical Feature Network (HFnet) was proposed that showed that the low-level layer features are superior in comparison to low-level semantic questions [115].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.4. Explanation by example
What the sources say
- Not checked yetcites [115] Hong, 2019, Exploiting hierarchical visual features for visual question answering, Neurocomputing source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“It was found that any foreign substance in the lung cavity resulted in misclassification of images, and sometimes a correct classification was due to the wrong reasons [164].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [164] Lee, 2020, Evaluation of scalability and degree of fine-tuning of deep convolutional neural networks for COVID-19 screening on chest X-ray images using explainable deep-learning algorithm, J. Personalized Med. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The model performance was more accurate on CT compared to CXR images, and had an accuracy of 95.61% in COVID-19 detection.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [158] Panwar, 2020
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
In the paper
“Thus, the gradient based methods lack in generalizability and robustness [85].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [85] Zhang, 2018, Top-down neural attention by excitation Backprop, Int. J. Comput. Vis. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Compared to qualitative approaches through visual observations and comparisons, quantitative approaches can provide more objectivity and reliability in the process.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.6. Evaluation of explainability
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“The framework was qualitatively evaluated on MNIST dataset with different types of human users and received very positive feedback [124].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.5. Libraries, tools, and frameworks
What the sources say
- Not checked yetcites [124] Spinner, 2020, IEEE Trans. Visual. Comput. Graph.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“It was shown through visualizations that the features are not random or uninterpretable patterns but rather have class discrimination and increasing invariance between layers [87].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.3. Visualization by gradient/backpropagation
What the sources say
- Not checked yetcites [87] Zeiler, 2014, Visualizing and understanding convolutional networks
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“A visual explainable system Similarity Difference and Uniqueness Method (SIDU) was proposed to estimate pixel saliency by extracting feature maps from the last CNN layer, and creating a difference mask to form the visual explanation of the prediction [76].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [76] S. M. Muddamsetty, N. S. J. Mohammad and T. B. Moeslund, “SIDU: similarity difference and uniqueness method for explainable AI,” in IEEE International Conference on Image Processing (ICIP).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The proposed scheme was evaluated on clinical and general datasets and showed better visual explanations with a greater trust for the human expert [76].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.2. Visualization by perturbation
What the sources say
- Not checked yetcites [76] S. M. Muddamsetty, N. S. J. Mohammad and T. B. Moeslund, “SIDU: similarity difference and uniqueness method for explainable AI,” in IEEE International Conference on Image Processing (ICIP).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“COVID-19 detection on CXR images with a fine tuned EfficientNet-B7 achieved an accuracy of 95.01% and AUC scores of 0.950, which were better in comparison to many other DNN approaches for COVID-19 detection [161].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [161] Chetoui, 2021, Deep efficient neural networks for explainable COVID-19 detection on CXR images
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Despite the large number of existing explainable models, there is no agreement on techniques for measuring or evaluating the explainability performance of an AI model.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 3.6. Evaluation of explainability
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“The two explainability approaches are complementary, in that, saliency map highlights the pixels with significant contribution to the model prediction and explanation-by-examples selects the training images likely for prediction in Bayesian Teaching [8].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > Model Agnostic Globally Interpretable Explanations (MAGIX)
What the sources say
- Not checked yetcites [8] Folke, 2021, Explainable AI for medical imaging: explaining pneumothorax diagnoses with Bayesian teaching, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications III
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“An adapted ResNet architecture was used on MR CLEAN Registry dataset of CT angiography images and determined that the automated DNN method was better than radiological image biomarkers for stroke outcome prediction and was helpful in the treatment selection [136].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [136] Hilbert, 2019, Data-efficient deep learning of radiological image data for outcome prediction after endovascular treatment of patients with acute ischemic stroke, Comput. Biol. Med. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The feature map showed positive values for the portions with significant influence on the disease diagnosis [236].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [236] Yoo, 2021, Diagnosis support model of cardiomegaly based on CNN using ResNet and explainable feature map, IEEE Access source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The CT images from multiple sources were mixed to avoid overfitting and bias [175].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [175] Wu, 2021, JCS: an explainable COVID-19 diagnosis system by Joint classification and segmentation, IEEE Trans. Image Process. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The XAI can help in identifying all such factors which form the basis of a particular decision.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The method provided insights of the high-level feature importance in the trained CNN model [224].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [224] Couteaux, 2019, Towards interpretability of segmentation networks by analyzing deepdreams
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
In the paper
“The proposed architecture provided better insights into the model's decisions and achieved better performance compared to the considered approaches.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [182] Kumar, 2019, SISC: end-to-end interpretable discovery radiomics-driven lung cancer prediction via stacked interpretable sequencing cells, IEEE Access source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The ensemble was found to improve the classification of the system and achieved an AUC of 90.29% in predicting nodules that would probably be diagnosed as cancerous in two years.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [179] Paul, 2020, Convolutional Neural Network ensembles for accurate lung nodule malignancy prediction 2 years in the future, Comput. Biol. Med. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“However, the dataset was small with low-resolution images [167].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [167] Liz, 2021, Ensembles of Convolutional Neural Network models for pediatric pneumonia diagnosis, Future Generat. Comput. Syst. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Emergent Symbolic language are the cornerstones of Good Old-Fashioned AI (GOFAI) systems which are explainable [252].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [252] Chowdhury, 2021, Emergent Symbolic language based deep medical image classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“CXR images were used for lung cancer prediction using the proposed X-Caps XAI technique generating malignancy scores with explanations at human-level that were better interpretable by the radiologists [15].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [15] R. LaLonde, D. Torigian and U. Bagci, “Encoding visual attributes in capsules for explainable medical diagnoses,” in Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The JSC identified and segmented the opacification areas, a basic CT feature of COVID-19 [175].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [175] Wu, 2021, JCS: an explainable COVID-19 diagnosis system by Joint classification and segmentation, IEEE Trans. Image Process. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Emergent languages involve multi-agent communication games with a sender/ receiver coordinate to complete a task and have been shown to enhance the neural network capabilities [252].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
What the sources say
- Not checked yetcites [252] Chowdhury, 2021, Emergent Symbolic language based deep medical image classification
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The model performance was found comparable to similar 3D CNN models and had a high diagnostic performance for acute appendicitis detection [227].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [227] Rajpurkar, 2020, AppendiXNet: deep learning for diagnosis of appendicitis from a small dataset of CT exams using video pretraining, Sci. Rep. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The proposed radiomic sequencer achieved correct predictions that can potentially improve clinical adoption [182].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [182] Kumar, 2019, SISC: end-to-end interpretable discovery radiomics-driven lung cancer prediction via stacked interpretable sequencing cells, IEEE Access source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The proposed system achieved an AUC of 0.9627 and a detection accuracy of 0.9272 [240].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [240] Huo, 2019, Coronary calcium detection using 3D attention identical dual deep network based on weakly supervised learning, Med. Imaging Image Process.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This can also help in overcoming the challenges associated with the limited information present in an X-ray and actually highlighting how the density, shape, size and location of abnormalities affect the final diagnosis.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.1. Conventional imaging/X-rays
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“RFGB found simpler rules for modelling the features and could be easily compared to a large single highly accurate model [219].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [219] Kunapuli, 2018, A decision-support tool for renal mass classification,” journal of digital imaging, J. Digit. Imag. source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“An average classification accuracy of 94.78% was achieved.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.2. Computed Tomography (CT)
What the sources say
- Not checked yetcites [177] Xu, 2019, Pulmonary textures classification via a multi-scale attention network, IEEE journal of biomedical and health informatics source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
In the paper
“It was shown that the hierarchical diagnosis performed better than the other models for classification, and identified the relevant image regions with attention maps [217].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5. Optical imaging 4.5.1. Dermatology
What the sources say
- Not checked yetcites [217] Barata, 2021, Explainable skin lesion diagnosis using taxonomies, Pattern Recogn. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The ABCD-rule of dermoscopy is known to outperform other methods [212].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5. Optical imaging 4.5.1. Dermatology
What the sources say
- Not checked yetcites [212] Stieler, 2021, Towards domain-specific explainable AI:model interpretation of a skin image classifier using a human approach
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The study concluded that by embedding model explainability in the early model training can save time and help clinicians in using a model's prediction for the clinical decisions [152].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
What the sources say
- Not checked yetcites [152] Windisch, 2020, Implementation of model explainability for a basic brain tumor detection using convolutional neural networks on MRI slices, Neuroradiology source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
In the paper
“Four CNN models were used and visualizations by heatmaps determined the important features which were compared against the expert's judgement [187].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5.2. Diabetic retinopathy
What the sources say
- Not checked yetcites [187] Reguant, 2021, Understanding inherent image features in CNN-based assessment of diabetic retinopathy, Sci. Rep. source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“From the aggregated explanations it was concluded that cisterns and ventricles governed the age predictions [146].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
What the sources say
- Not checked yetcites [146] Levakov, 2020, From a deep learning model back to the brain—identifying regional predictors and their relation to aging, Hum. Brain Mapp. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“It can be difficult to control the image quality due to manual operation, operator dependency and acoustic shadows [253].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.4. Ultrasound imaging
What the sources say
- Not checked yetcites [253] Komatsu, 2021, Towards clinical application of artificial intelligence in ultrasound imaging, Biomedicines source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“CA-Net also provided better explainability by visualizing the attention weight maps, although it had around 15 times smaller model size [153].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
What the sources say
- Not checked yetcites [153] Lopatina, 2020, Investigation of deep-learning-driven identification of multiple sclerosis patients based on susceptibility-weighted images using relevance analysis, Front. Neurosci. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The significant features for the prediction were identified by isolating the neuron activation patterns [192].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5.2. Diabetic retinopathy
What the sources say
- Not checked yetcites [192] Niu, 2021, Explainable diabetic retinopathy detection and retinal image generation, IEEE journal of biomedical and health informatics
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Grad-CAM was used for visualisations and helped to identify the tumor location.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
What the sources say
- Not checked yetcites [152] Windisch, 2020, Implementation of model explainability for a basic brain tumor detection using convolutional neural networks on MRI slices, Neuroradiology source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
In the paper
“The video data was converted to a barcode type timeline to aid the explainability which made it easier to identify the substructures [243].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.4. Ultrasound imaging
What the sources say
- Not checked yetcites [243] Komatsu, 2021, Detection of cardiac structural abnormalities in fetal ultrasound videos using deep learning, Appl. Sci. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The datasets EyePACS and DIARETDB1 were used and although different CNN models had a consistent classification performance, the image feature disagreement between different architectures was 70% as the highest value [187].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5.2. Diabetic retinopathy
What the sources say
- Not checked yetcites [187] Reguant, 2021, Understanding inherent image features in CNN-based assessment of diabetic retinopathy, Sci. Rep. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The choice of the MRI slice/image is important and the authors proposed selecting the best MRI slice for improved model performance [220].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
What the sources say
- Not checked yetcites [220] Hassan, 2022, Prostate cancer classification from ultrasound and MRI images using deep learning based Explainable Artificial Intelligence, Future Generat. Comput. Syst. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Breast ultrasound and MRI can provide additional information for the mammographic diagnosis [254].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.4. Ultrasound imaging
What the sources say
- Not checked yetcites [254] Le, 2019, Artificial intelligence in breast imaging, Clin. Radiol. source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The system achieved an accuracy of 95.29% and Receiver Operating Characteristics (ROC)-AUC of 0.98 for both classes.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.3. Magnetic resonance imaging (MRI)
What the sources say
- Not checked yetcites [148] Chakraborty, 2020, Detection of Parkinson's disease from 3T T1 weighted MRI scans using 3D convolutional neural network, Diagnostics source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“These postulates provided the association between the disease and the pathogens [192].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5.2. Diabetic retinopathy
What the sources say
- Not checked yetcites [192] Niu, 2021, Explainable diabetic retinopathy detection and retinal image generation, IEEE journal of biomedical and health informatics
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The results demonstrated a high classification accuracy and explainability [191].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5.2. Diabetic retinopathy
What the sources say
- Not checked yetcites [191] Quellec, 2021, ExplAIn: explanatory artificial intelligence for diabetic retinopathy diagnosis, Med. Image Anal. source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Similarly, the use of frameworks combining the automated segmentation and classification could for example, can use the segmentation results to guide the classification process [214].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
What the sources say
- Not checked yetcites [214] Xie, 2020, A mutual bootstrapping model for automated skin lesion segmentation and classification, IEEE Trans. Med. Imag. source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This can provide a degree of confidence in the model but without a standard way of evaluating the different models and their outcomes cannot be trusted for medical imaging.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Large and high-quality data is required by DNN for better results without which the model may overfit, that is, becomes closely aligned to the limited set of datapoints [265].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Not checked yetcites [265] Tayarani-N, 2020
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The XAI techniques can help in understanding the predictions of a deep learning model yet there are challenges to be overcome before these techniques become mainstream for healthcare applications.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5. Challenges and future directions
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Most of the studies relating to cancer detection use a post-hoc explainability technique whereas a development of intrinsic explanation techniques would be advantageous for adoption and explainability [258].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.2. Understanding and improving explainability
What the sources say
- Not checked yetcites [258] Gulum, 2021, A review of explainable deep learning cancer detection models in medical imaging, Appl. Sci. source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The system was considered useful for mass screening as it could be run without an Internet connection on a mobile device [193].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5.2. Diabetic retinopathy
What the sources say
- Not checked yetcites [193] Martins, 2020, Offline computer-aided diagnosis for Glaucoma detection using fundus images targeted at mobile devices, Comput. Methods Progr. Biomed. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The adoption of AI in clinical practice would thus take more effort in making the XAI techniques to be more comprehensible.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.2. Understanding and improving explainability
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The creation of quantitative metrics for model comparison for explainability will give rise to the successful application of relevant explainability techniques to different image modalities.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“XAI techniques using multimodal DNN models can help with the hidden patterns related to each modality in segmentation and classification tasks.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Without sufficient data, the AI models can suffer from overfitting and the data from different hospitals differ due to the variety of data collection policies and protocols [265].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Not checked yetcites [265] Tayarani-N, 2020
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Ophthalmology is one of the most widely used application of AI and there are efforts towards explainability in this area but are still at very basic level.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.5.2. Diabetic retinopathy
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Explanatory Interactive Learning (XIL) which adds the human in the model training loop [259] can also help to increase the adoption of the XAI techniques.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
What the sources say
- Not checked yetcites [259] Schramowski, 2020, Making deep neural networks right for the right scientic reasons by interacting with their explanations, Nat. Mach. Intell. source
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The quality of images improves the performance of DNN algorithms in correctly predicting a disease and therefore can reduce the explainability gap.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The term 'explanation' as used in XAI is not very well defined [60,260,261].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.2. Understanding and improving explainability
What the sources say
- Not checked yetcites [60] Páez, 2019, The pragmatic turn in explainable artificial intelligence (XAI), Minds Mach. source
- Not checked yetcites [260] Payrovnaziri, 2020, Explainable artificial intelligence models using real-world electronic health record data: a systematic scoping review, J. Am. Med. Inf. Assoc. source
- Not checked yetcites [261] Gillmann, 2021, Ten open challenges in medical visualization, Comput. Graphics Appl. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A universally agreed definition of explanations is lacking and there has been some efforts in this direction by developing mathematical methods [25].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.2. Understanding and improving explainability
What the sources say
- Not checked yetcites [25] W. Samek and K. R. Müller, “Towards explainable artificial intelligence,” in Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Lecture Notes in Computer Science, vol. vol. 11700, Springer, Cham..
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“This differs for the different perspectives of a patient, clinician and engineer and the current definitions lack consistency with explainable AI representing a false hope to provide a patient level decision support [19].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.2. Understanding and improving explainability
What the sources say
- Not checked yetcites [19] Ghassemi, 2021, The false hope of current approaches to explainable artificial intelligence in health care, The Lancet Digital Health source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“There is no agreement on what is meant by 'explanation' [262].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.2. Understanding and improving explainability
What the sources say
- Not checked yetcites [262] Guidotti, 2018, A survey of methods for explaining black box models, ACM Comput. Surv. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The development of DNN and then having attempts to identify their internal workings and decision-making process has resulted in development of many useful techniques.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.2. Understanding and improving explainability
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Such metrics can also meet the needs for the regulations and standards in assessing and approving the XAI techniques for the clinical practice.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.1. XAI applications in medical imaging
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Various techniques can be employed to address the lack of data, such as, data augmentation [34,37].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Not checked yetcites [34] Karthik, 2021, AI for COVID-19 detection from radiographs: incisive analysis of state of the art techniques, IRBM source
- Not checked yetcites [37] Singh, 2021
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The ultimate responsibility would still be with the human radiologists [5].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.5. Human-in-the-loop
What the sources say
- Not checked yetcites [5] Strudel, 2021, Segmenter: transformer for semantic segmentation
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: The final decision for image-based disease diagnosis would rest with the specialist, whereas XAI model insights should be used only to aid the decision.
In the paper
“It is aimed at translating the algorithmic model research to the actual practice in domains such as healthcare [275].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [275]
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Such automated workflows are expected to make the process of incorporating XAI easier into clinical decisions by making it possible to select the best visualizations in response to a few simple questions.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“DNN systems have sensitivity similar to radiologists but often times these DNN can detect different lesion characteristics [6].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.5. Human-in-the-loop
What the sources say
- Not checked yetcites [6] Chan, 2020, Deep learning in medical image analysis, Adv. Exp. Med. Biol. source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The funders and governments are emphasizing an open sharing of data for AI model training but most data are not representative, interoperable, and sufficiently diverse [39].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Not checked yetcites [39] Norori, 2021, Addressing bias in big data and AI for health care: a call for open science, Patterns source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The model architecture has many hyperparameters that need to be tried and re-tried for designing an architecture with an optimum performance.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The automation will not only make these XAI techniques widely available but will enable medical practitioners to make better and informed decisions by leveraging the insights through XAI.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The use of sufficient, representative, and diverse type of data for DNN models can help to reduce bias and enhance generalizability.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“A framework for trustworthy and XAI combined selected features of trusted oracles, blockchain and smart contracts to reduce adversarial attacks and bias [11].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [11] M. Nassar, K. Salah, M. ur Rehman and D. Svetinovic, “Blockchain for explainable and trustworthy artificial intelligence,” Wiley Interdisciplinary Reviews: Data Min. Knowl. Discov., vol. 10, no. 1. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“End to end automated XAI applications, such as, combining segmentation and classification, will help XAI adoption in clinical practice.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Certification of DNN models by agencies external to the developer or user could help to eliminate risk of unauthorized changes to how the system works and can prove beneficial in case of litigation to prove the correctness of the system [49].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.6. Incorporating stakeholders in XAI
What the sources say
- Not checked yetcites [49] Gryz, 2021, Black box algorithms and the rights of individuals: no easy solution to the ‘explainability’ problem, Internet Policy Review source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“In order to use AI successfully requires a multi-disciplinary effort encompassing guarantees of ethical, legal and social aspects of AI and increasing awareness [5].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.6. Incorporating stakeholders in XAI
What the sources say
- Not checked yetcites [5] Strudel, 2021, Segmenter: transformer for semantic segmentation
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“Few-shot learning can work with very few training samples [13].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Not checked yetcites [13] McCarthy, 2021, Enterprise imaging and big data: a review from a medical physics perspective, Phys. Med. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The CNN fixation method was applied to detect an adversarial attack on sets of images with a clean and perturbed image, and even despite the labels being changed, the proposed method could still localize the regions correctly in both images [69].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [69] Mopuri, 2019, An unraveling approach to visualize the discriminative image regions, IEEE Trans. Image Process. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“This can in future help towards models' certifications and standardizations such as by Food and Drug Administration (FDA) [274].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [274] Proposed Regulatory Framework for Modifications to Artificial Intelligence/Machine Learning (AI/ML)-Based Software as a Medical Device (SaMD) -Discussion Paper and Request for Feedback”.
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“The decisions affecting patients' lives cannot be entrusted fully to an algorithm”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.5. Human-in-the-loop
What the sources say
- Not checked yetcites [261] Gillmann, 2021, Ten open challenges in medical visualization, Comput. Graphics Appl. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Rests on an assumption: DNN predictions comparable to human experts are not sufficient to fully delegate medical diagnosis to an algorithm.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The adversarial inputs comprising a modified image can drive a model to misclassify and is termed as an adversarial attack.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Biomedical imaging datasets sometime suffer from noise, whereas CT images are commonly affected by noise [265].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Not checked yetcites [265] Tayarani-N, 2020
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“A counterfactual approach, Global Explanations for Bias Identification (GEBI) was proposed for identification of bias in the data for image classification although it can be applied to other problems [279].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [279] Mikołajczyk, 2020
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“AutoML is a step towards the direction of automatically creating an optimum architecture and making it possible for the architectures to be reproducible and comparable.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This would provide opportunities for measuring the accuracy and explainability of DNN against the same dataset and mitigate the different biases in the model and data.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Undetectable adversarial attacks can be devised to change the importance maps dramatically and interpretations of breast ultrasound images were shown to be susceptible to adversarial attacks similar to other image modalities [203].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [203] Rasaee, 2021, Explainable AI and susceptibility to adversarial attacks: a case study in classification of breast ultrasound images
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The use of XAI techniques such as visualizations are helpful to identify the model bias and an experienced clinicians can identify any unsupported or bad DNN decisions.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Similarly, Google's What-If Tool can be used for optimizing the model's AI fairness [276].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [276]
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Most ML studies on medical images use trained models that are often based on a single unit or hospital which brings in a selective bias and sometimes inclusion of low-quality scans [273].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.4. Model centric XAI
What the sources say
- Not checked yetcites [273] Hampe, 2019
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Additional realistic data could be generated through GANs using the latent data distributions [13,34,37].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.3. Data-centric XAI
What the sources say
- Not checked yetcites [13] McCarthy, 2021, Enterprise imaging and big data: a review from a medical physics perspective, Phys. Med. source
- Not checked yetcites [34] Karthik, 2021, AI for COVID-19 detection from radiographs: incisive analysis of state of the art techniques, IRBM source
- Not checked yetcites [37] Singh, 2021
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Explainable AI coupled with deep neural network models can help with both the detection and diagnosis of disease, by providing additional insights to the clinician.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 6. Conclusion
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Rests on an assumption: Trained DNN models can provide predictions comparable to human experts in a fraction of the time.
In the paper
“The black box and opaque nature of deep neural networks precludes their usefulness despite excellent performance of multimodal methods [288].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.7. Hybrid/fusion imaging for XAI
What the sources say
- Not checked yetcites [288] Joshi, 2021, A review on explainability in multimodal deep neural nets, IEEE Access source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Two significant issues faced for multimodal imaging are the class imbalances and lack of sufficient labelled data [35].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.7. Hybrid/fusion imaging for XAI
What the sources say
- Not checked yetcites [35] O'Sullivan, 2020, Developments in AI and machine learning for neuroimaging
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We see a lack of algorithm standardization for biomedical imaging with diverse and independent efforts for improvements.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 6. Conclusion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
- Rests on an assumption: Currently, image-based diagnosis and prognosis in biomedical imaging require expert opinion of practitioners who are already overburdened.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The overcoming of challenges to clinical adoption of XAI will foster growth of the field, and result in better health and safety measures for the patients through timely interventions by building trust in the model's predictions.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 6. Conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
- Rests on an assumption: Increasingly, there are health and legal regulations that mandate approval and compliance for deep learning techniques.
In the paper
“It was shown with the proposed deconvnet that the model visualizations can be used to determine model problems and can help improve the models [87].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.9. Explainability to improve models
What the sources say
- Not checked yetcites [87] Zeiler, 2014, Visualizing and understanding convolutional networks
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Graph Neural Networks can learn from graph structures and can represent information capturing different types of relationships rather than just an ordered grid structure [100].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.8. Mathematical and graph based XAI approaches
What the sources say
- Not checked yetcites [100] Holzinger, 2021, Towards multi-modal causability with Graph Neural Networks enabling information fusion for explainable AI, Inf. Fusion source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“The mathematical approaches can improve the interpretability of models, however, may not be suitable as concrete examples for the enduser [63].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.8. Mathematical and graph based XAI approaches
What the sources say
- Not checked yetcites [63] Heuillet, 2021, Explainability in deep reinforcement learning, Knowl. Base Syst. source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Federated learning is also promising for biomedical applications with different hospitals contributing their data to train and improve a deep learning model without violating data privacy.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 6. Conclusion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“Influence functions have basis in statistics and were demonstrated to be useful for generation of visually similar training set attacks, determining dataset errors, understanding, and debugging the model behavior [104].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 5.9. Explainability to improve models
What the sources say
- Not checked yetcites [104] Koh, 2017
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We consider a human-in-the-loop as a pre-requisite for any XAI application based clinical decision.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 6. Conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
- Rests on an assumption: Trained DNN models can provide predictions comparable to human experts in a fraction of the time.
- Rests on an assumption: DNN predictions comparable to human experts are not sufficient to fully delegate medical diagnosis to an algorithm.
- Rests on an assumption: Human expertise cannot be dispensed, and only simple and time-consuming tasks should be directed to AI.
- Rests on an assumption: The final decision for image-based disease diagnosis would rest with the specialist, whereas XAI model insights should be used only to aid the decision.
The paper relies on this without support.
XAI techniques help to understand model predictions which help develop trust in the system, accelerate the disease diagnosis, and meet adherence to regulatory requirements.
“Explainable AI (XAI) techniques help to understand model predictions which help develop trust in the system, accelerate the disease diagnosis, and meet adherence to regulatory requirements.”
The paper relies on this without support.
There is often an explainability gap between the model's prediction and its explanations being understandable to a human.
“However, there is often an explainability gap between the model's prediction and its explanations being understandable to a human.”
The paper relies on this without support.
Incorporating explainability into a model takes time and effort, and may affect its prediction accuracy.
“Incorporating explainability into a model takes time and effort, and may affect its prediction accuracy.”
The paper relies on this without support.
The use of XAI techniques can reduce the workload of the clinicians, help to make better diagnosis, and reduce the complications associated with a false positive and a false negative outcome.
“The use of XAI techniques can reduce the workload of the clinicians, help to make better diagnosis, and reduce the complications associated with a false positive and a false negative outcome.”
The paper relies on this without support.
Medical practitioners are more likely to employ and trust a system if they can understand the reasoning of a prediction by a model.
“They are more likely to employ and trust a system if they can understand the reasoning of a prediction by a model.”
The paper relies on this without support.
Patients require assurance that the XAI methods can be trusted, and are providing a valid and consistent prediction.
“Patients require assurance that the XAI methods can be trusted, and are providing a valid and consistent prediction.”
The paper relies on this without support.
DNN can provide very accurate predictive performance but are hard to interpret or explain.
“DNN can provide very accurate predictive performance but owing to a large number of trainable parameters, layers, and the performance determined through the hyperparameters, these are hard to interpret or explain.”
The paper relies on this without support.
CXR is the most commonly used imaging modality for detecting COVID-19 or lung infections, but it is less accurate than CT.
“CXR is the most commonly used imaging modality for detecting COVID-19, or lung infections, however, in comparison to CT, it is less accurate.”
The paper relies on this without support.
MRI is the most favored imaging modality for neurology and is particularly useful for neurodegenerative diseases.
“MRI is the most favored imaging modality for neurology and particularly useful for the neurodegenerative diseases.”
The paper relies on this without support.
Ophthalmologists are interested in finding the parameters responsible for a specific finding, rather than just knowing the final diagnosis.
“The ophthalmologists are interested in finding out the parameters responsible for a specific finding, rather than just knowing the final diagnosis.”
The paper relies on this without support.
In fundus images, the actual variations in landmarks (blood vessels, optic disc, fovea/macula) along with appearances of any new lesion are important.
“In fundus images, the actual variations in landmarks i.e. blood vessels, optic disc and fovea/macula region along with appearances of any new lesion are important.”
The paper relies on this without support.
For OCT images, it is important to look into layer variants and lesions appearing in those layers.
“For OCT images, it is important to look into layer variants and lesions appearing in those layers.”
The paper relies on this without support.
The labelled datasets used to train DNNs are often from multiple sources or maintained by different organisations owning the data.
“The labelled datasets used to train DNNs are often from multiple sources or maintained by different organisations owning the data.”
The paper relies on this without support.
One of the stated advantages of DNN is automated learning of image features and overcoming problems associated with hand-crafted features.
“One of the stated advantages of DNN is that of an automated learning of the image features and overcoming the problems associated with the hand-crafted features.”
The paper relies on this without support.
Trained DNN models can provide predictions comparable to human experts in a fraction of the time.
“The trained DNN model can provide predictions comparable to human expert in a fraction of the time”
The paper relies on this without support.
DNN predictions comparable to human experts are not sufficient to fully delegate medical diagnosis to an algorithm.
“however, this is not sufficient to fully delegate the medical diagnosis to an algorithm”
The paper relies on this without support.
Human expertise cannot be dispensed, and only simple and time-consuming tasks should be directed to AI.
“However, human expertise cannot be dispensed and only simple, and time-consuming tasks should be directed to AI.”
The paper relies on this without support.
The ultimate beneficiary of model explainability is a human user.
“The ultimate beneficiary of the model explainability is a human user.”
The paper relies on this without support.
The final decision for image-based disease diagnosis would rest with the specialist, whereas XAI model insights should be used only to aid the decision.
“Similar to the role of an autonomous car driver, the final decision for image-based disease diagnosis would rest with the specialist whereas the XAI model insights should be used only to aid the decision.”
The paper relies on this without support.
Currently, image-based diagnosis and prognosis in biomedical imaging require expert opinion of practitioners who are already overburdened.
“Currently, the image-based diagnosis and prognosis in the different disciplines of biomedical imaging such as radiology and ophthalmology require expert opinion of practitioners who are already overburdened.”
The paper relies on this without support.
Increasingly, there are health and legal regulations that mandate approval and compliance for deep learning techniques.
“Increasingly, there are health and legal regulations that mandate approval and compliance for the deep learning techniques which can be helped using XAI techniques.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The “black box” nature of DL remains a fundamental barrier to clinical trust [153,154,155,156,157].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [153]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.6. Nuclear imaging
“SHAP was found to generate better heatmaps out of the six interpretation methods for the four selected DNN models.”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.6. Nuclear imaging
“The Guided backpropagation performed best amongst the six selected interpretation methods [138].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 4.7. clinical/observational data
“Transthoracic Echocardiography images were used for an automatic Carpentier's functional classification of mitral valve diseases with eight deep CNN models [246].”
§ Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks > 6. Conclusion
“| | ECG video data | Deep CNN, Grad-CAM | Morphological classification of mitral valve disease using eight | [246] |”
Citations
Cites
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1993.341010 · Cited by 14,475
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · cited 7×
“2, where non-linear models with better performance, such as DNNs are less explainable, and linear models which are least accurate, such as decision trees, are more explainable [2,21,45].”
BackgroundInfluentialThe graph neural network model
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Monfardini, G. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005605 · Cited by 9,582 · cited 3×
“The model and the learning al-gorithm, output functions, comparison with Random Walks and Recursive Neural Networks, and complexity were derived mathematically [99].”
BackgroundMethodInfluentialShow, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · cited 5×
“The proposed technique exploited learned attention for better interpretability, well-aligned to human intuition on the datasets with METEOR and BLEU metrics [92].”
BackgroundMethodInfluentialPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 4×
“A study provided a taxonomy and evaluation techniques for XAI [21].”
BackgroundMethodInfluentialProceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 2×
“It used saliency maps for both convolution and deconvolution, and a gradient-based visualization technique [77].”
MethodOn Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524 · cited 2×
“[83].”
Method2013 IEEE International Conference on Computer Vision
(2013) · doi:10.1109/iccv19984.2013 · Cited by 4,232
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136 · cited 1×
“There has been a renewed interest in applications of AI techniques for imaging classification and segmentation for biomedical applications [1].”
BackgroundTowards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · cited 4×
“Functionally-grounded evaluations does not involve humans and uses proxies for explanation quality with formal definition of interpretability [51].”
BackgroundMethodInfluentialExplainable AI: a review of machine learning interpretability methods
Linardatos, P., Papastefanopoulos, V., & Kotsiantis, S. (2020) · Entropy · doi:10.3390/e23010018 · Cited by 2,922 · cited 1×
“Some of the reviews have covered Machine Learning (ML) interpretability [23], trustwor-thiness for DNN [24], explanations types [25], objective quality evaluation of explanations [25], responsible AI [2], post-hoc explainability techniques [2], and evaluation of the model explanation [26].”
Background2011 International Conference on Computer Vision
(2011) · doi:10.1109/iccv17851.2011 · Cited by 2,895
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524 · cited 1×
“…in machine learning based clinical decision support system (CDSS) [27], medical image analysis [28,29], interpretable methods for neural networks [30], AI interpretability in radiology [31], trustworthy AI for healthcare [32], AI techniques for COVID-19 [33,34] neuroimaging [35], and oncological…”
MethodEuropean Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 1×
“The EU legislation is likely to increase the focus of computer scientists towards developing algorithms and systems that will enable explanations and avoid discrimination [50].”
BackgroundUnderstanding Neural Networks Through Deep VisualizationPreprint
Yosinski, J., Clune, J., Nguyen, A. M., Fuchs, T. J., & Lipson, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06579 · Cited by 1,918
Goldstein, A., Kapelner, A., Bleich, J., & Pitkin, E. (2015) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.907095 · Cited by 1,861 · cited 4×
“PDP was extended to propose a toolbox, Individual Conditional Expectation (ICE) plots [68].”
MethodInfluentialThe false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724 · cited 3×
“The model ’ s highlighted features might also differ in relevance to human identified features and decisions [19].”
BackgroundInfluentialZech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719 · cited 2×
“The evaluation of deep learning techniques was performed across different hospitals, and for pneumonia screening it was found that the models had better internal (of hospitals) results compared to external [42].”
BackgroundResult2013 IEEE 10th International Symposium on Biomedical Imaging
(2013) · doi:10.1109/isbi20048.2013 · Cited by 1,637
2013 IEEE International Conference on Big Data
(2013) · doi:10.1109/bigdata21311.2013 · Cited by 1,406
DARPA's Explainable Artificial Intelligence Program
Gunning, D., & Aha, D. W. (2019) · AI Magazine · doi:10.1609/aimag.v40i2.2850 · Cited by 1,360 · cited 6×
“2, where non-linear models with better performance, such as DNNs are less explainable, and linear models which are least accurate, such as decision trees, are more explainable [2,21,45].”
BackgroundMethodInfluentialExplaining nonlinear classification decisions with deep taylor decomposition
Montavon, G., Lapuschkin, S., Binder, A., Samek, W., & Müller, K.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.008 · Cited by 1,357 · cited 4×
“The method was evaluated on MNIST and a large convolutional network [89].”
BackgroundMethodInfluentialExplainable artificial intelligence (XAI) in deep learning-based medical image analysis
van der Velden, B. H. M., Kuijf, H. J., Gilhuijs, K. G. A., & Viergever, M. A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102470 · Cited by 1,328 · cited 2×
“The explainability techniques can be categorized depending on the scope, applicability and nature [21,29] as under: The XAI techniques for understanding of image-based models are described next and are summarized in Table 1.”
MethodExplainable AI: From black box to glass box
Rai, A. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00710-5 · Cited by 1,317 · cited 2×
“The advances in post-hoc interpretability is helpful by approximating the black box models [58].”
BackgroundMethodIEEE Winter Conference on Applications of Computer Vision
(2014) · doi:10.1109/wacv31811.2014 · Cited by 1,009
Addressing bias in big data and AI for health care: A call for open science
Norori, N., Hu, Q., Aellen, F. M., Faraci, F. D., & Tzovara, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100347 · Cited by 903 · cited 4×
“The funders and governments are emphasizing an open sharing of data for AI model training but most data are not representative, interoperable, and sufficiently diverse [39].”
BackgroundMethodInfluentialDeep Learning in Medical Image Analysis
Chan, H., Samala, R. K., Hadjiiski, L. M., & Zhou, C. (2020) · Advances in experimental medicine and biology · doi:10.1007/978-3-030-33128-3_1 · Cited by 848 · cited 10×
“In deep learning models the features can be learnt automatically [6].”
BackgroundMethodInfluentialTop-Down Neural Attention by Excitation Backprop
Zhang, J., Bargal, S. A., Lin, Z., Brandt, J., Shen, X., & Sclaroff, S. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1059-x · Cited by 815 · cited 4×
“The model was evaluated by measuring accuracy of localization task on MS COCO, PASCAL VOC07 and ImageNet datasets [85].”
BackgroundMethodInfluentialMarkus, A. F., Kors, J. A., & Rijnbeek, P. R. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103655 · Cited by 811 · cited 1×
“…image analysis [28,29], interpretable methods for neural networks [30], AI interpretability in radiology [31], trustworthy AI for healthcare [32], AI techniques for COVID-19 [33,34] neuroimaging [35], and oncological radiomics, feature extraction basics and major interpretability methods…”
MethodArtificial Intelligence and Black‐Box Medical Decisions: Accuracy versus Explainability
London, A. J. (2019) · Hastings Center Report · doi:10.1002/hast.973 · Cited by 801 · cited 3×
“For increasing accountability, the use of machine learning models should be limited by regulators to only the ones that have been empirically validated to ensure that these are not used as mere tools for arbitrary interference by the stakeholders [57].”
BackgroundInfluentialGu, R., Wang, G., Song, T., Huang, R., Aertsen, M., Deprest, J. A., Sebastien Ourselin, A., Vercauteren, T. K., & Zhang, S. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3035253 · Cited by 780 · cited 6×
“The dataset comprised of 150 stacks of T2-weighted fetal MRI scans [211].”
BackgroundMethodResultInfluentialExplainable Deep Learning Models in Medical Image Analysis
Singh, A., Sengupta, S., & Lakshminarayanan, V. (2020) · Journal of Imaging · doi:10.3390/jimaging6060052 · Cited by 718 · cited 2×
“It is easy to understand a model ’ s prediction by a user if similar example images can be provided from the dataset [28].”
BackgroundMethodYang, G., Ye, Q., & Xia, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.07.016 · Cited by 717 · cited 5×
“Dice scores were used for evaluating the segmentation results [141].”
BackgroundMethodInfluentialTowards Explainable Artificial Intelligence
Samek, W., & Müller, K. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_1 · Cited by 704 · cited 5×
“All of the implemented methods perform backpropagation and a quantitative evaluation using perturbation analysis [25] is provided [123].”
BackgroundMethodInfluentialHuang, X., Kroening, D., Ruan, W., Sharp, J. J., Sun, Y., Thamo, E., Wu, M., & Yi, X. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100270 · Cited by 641
AI for radiographic COVID-19 detection selects shortcuts over signal
DeGrave, A. J., Janizek, J. D., & Lee, S.-I. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00338-7 · Cited by 631 · cited 1×
“It was demonstrated that deep learning models on chest X-ray image datasets were not relying on medical pathology but instead on confounding factors for COVID-19 detection [41,43].”
BackgroundA Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629 · cited 1×
“There is no agreement on what is meant by ‘explanation ’ [262].”
BackgroundAntoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021) · Applied Sciences · doi:10.3390/app11115088 · Cited by 629 · cited 3×
“Clinicians are the primary users of XAI systems and they may have differing views but all have a need for the explainability for the patient [27].”
BackgroundMethodExplainable Deep Learning for Pulmonary Disease and Coronavirus COVID-19 Detection from X-rays
Brunese, L., Mercaldo, F., Reginelli, A., & Santone, A. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105608 · Cited by 623
Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study
Hosny, A., Parmar, C., Coroller, T. P., Grossmann, P., Zeleznik, R., Kumar, A., Bussink, J., Gillies, R. J., Mak, R. H., & Aerts, H. J. W. L. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002711 · Cited by 579
2011 International Joint Conference on Neural Networks
(2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2051284 · Cited by 569
Medical Imaging 2012: Image Processing
Haynor, D. R., & Sebastien Ourselin, A. (2012) · SPIE eBooks · Cited by 563
2007 IEEE International Conference on Image Processing
SABRI, A., Boonært, J., Lecoeuche, S., & MOUADDIB, E. M. (2007) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2007.4379496 · Cited by 547
Mahmud, T., Rahman, M. A., & Fattah, S. A. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103869 · Cited by 525 · cited 2×
“A CNN model CovXNet was used for binary and multiclass classification with depth-wise convolution with varying dilation rates that aided extraction of diverse features from CXR [160].”
MethodDeep learning interpretation of echocardiograms
Ghorbani, A., Ouyang, D., Abid, A., He, B., Chen, J. H., Harrington, R. A., Liang, D. H., Ashley, E. A., & Zou, J. Y. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0216-8 · Cited by 518 · cited 2×
“Grad-CAM was used for visualizations and identified RoI for predicting the systemic phenotypes which are otherwise considered difficult for the human experts [245].”
MethodJCS: An Explainable COVID-19 Diagnosis System by Joint Classification and Segmentation
Wu, Y.-H., Gao, S.-H., Mei, J., Xu, J., Fan, D.-P., Zhang, R.-G., & Cheng, M.-M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3058783 · Cited by 516 · cited 5×
“Activation maps were used for explainability of the predictions and Dice scores for segmentation [175].”
MethodInfluentialOpportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey
Das, A., & Rad, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11371 · Cited by 504 · cited 1×
“Some of the reviews have covered Machine Learning (ML) interpretability [23], trustwor-thiness for DNN [24], explanations types [25], objective quality evaluation of explanations [25], responsible AI [2], post-hoc explainability techniques [2], and evaluation of the model explanation [26].”
BackgroundCausal Interpretations of Black-Box Models
Zhao, Q., & Hastie, T. J. (2019) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2019.1624293 · Cited by 490 · cited 1×
“The Partial Dependence Plot (PDP) is a popular tool for visualizing black box models and can highlight the feature importance [67].”
MethodOn the interpretability of artificial intelligence in radiology: challenges and opportunities
Reyes, M., Meier, R., Pereira, S., Silva, C. A., Dahlweid, F.-M., Tengg-Kobligk, H. V., Summers, R. M., & Wiest, R. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020190043 · Cited by 484 · cited 1×
“…support system (CDSS) [27], medical image analysis [28,29], interpretable methods for neural networks [30], AI interpretability in radiology [31], trustworthy AI for healthcare [32], AI techniques for COVID-19 [33,34] neuroimaging [35], and oncological radiomics, feature extraction basics…”
MethodTransparency in artificial intelligence
Larsson, S., & Heintz, F. (2020) · Internet Policy Review · doi:10.14763/2020.2.1469 · Cited by 458 · cited 1×
“A multidisciplinary approach can develop understanding of the AI application in the society and markets [285].”
BackgroundInternational conference on pattern recognition
(1983) · Computers in Industry · doi:10.1016/0166-3615(83)90028-3 · Cited by 444
Heidari, M., Mirniaharikandehei, S., Khuzani, A. Z., Danala, G., Qiu, Y., & Zheng, B. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104284 · Cited by 423
Sayres, R., Taly, A., Rahimy, E., Blumer, K., Coz, D., Hammel, N., Krause, J., Narayanaswamy, A., Rastegar, Z., Wu, D., et al. (2019) · Ophthalmology · doi:10.1016/j.ophtha.2018.11.016 · Cited by 418 · cited 2×
“The grading time was found to decrease across the automated grading, however, in general the grades plus heatmaps were found to be as effective as only grades [189].”
MethodA Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification
Xie, Y., Zhang, J., Xia, Y., & Shen, C. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2972964 · Cited by 412 · cited 2×
“Similarly, the use of frameworks combining the automated segmentation and classification could for example, can use the segmentation results to guide the classification process [214].”
MethodExplainability in deep reinforcement learning
Heuillet, A., Couthouis, F., & Díaz-Rodríguez, N. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106685 · Cited by 374 · cited 2×
“Similarly, formal mathematical notations and techniques can unambiguously provide explanations for domain experts but are not targeted to the end users [63].”
BackgroundExplainable artificial intelligence: Objectives, stakeholders, and future research opportunities
Meske, C., Bunde, E., Schneider, J., & Gersch, M. (2022) · Information Systems Management · doi:10.1080/10580530.2020.1849465 · Cited by 365 · cited 2×
“Algorithm or model bias can be a risk in AI as the models can generate a wrongful output based on an intentional or unintentional bias [40].”
BackgroundHolzinger, A., Malle, B., Saranti, A., & Pfeifer, B. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.01.008 · Cited by 352 · cited 6×
“These questions are termed counterfactuals and are gaining in importance for XAI [100].”
BackgroundInfluentialHossain, M. S., Muhammad, G., & Guizani, N. (2020) · IEEE Network · doi:10.1109/mnet.011.2000458 · Cited by 347 · cited 1×
“A cloud-based healthcare framework for COVID-19 like pandemics combined imaging data such as CXR, CT, PET with blood pressure, cough sound, and body temperature, for training a DNN model [287].”
MethodPayrovnaziri, S. N., Chen, Z., Rengifo‐Moreno, P., Miller, T., Bian, J., Chen, J. H., Liu, X., & He, Z. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa053 · Cited by 335 · cited 2×
“It was argued that XAI systems are being developed by the DNN scientists for themselves whereas these should be focused on the end-user [260, 284].”
BackgroundWhat Does Explainable AI Really Mean? A New Conceptualization of Perspectives
Doran, D., Schulz, S., & Besold, T. R. (2017) · arXiv · doi:10.48550/arxiv.1710.00794 · Cited by 333 · cited 1×
“…as: (1) Opaque, where the input to output mappings are invisible to the user, (2) Interpretable system, where a user can both see and understand how the inputs are mapped to output, and (3) Comprehensible systems, that provides some additional output, such as visualizations, text etc. [44].”
BackgroundImpact of a deep learning assistant on the histopathologic classification of liver cancer
Kiani, A., Uyumazturk, B., Rajpurkar, P., Wang, A., Gao, R., Jones, E., Yu, Y., Langlotz, C. P., Ball, R. L., Montine, T. J., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0232-8 · Cited by 325 · cited 3×
“Using the XAI techniques to assist the clinician can help to produce better diagnosis than the model or clinician alone [204,212,233,234].”
MethodResultMagesh, P. R., Myloth, R. D., & Tom, R. J. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104041 · Cited by 295 · cited 5×
“The proposed model was found to be useful for early diagnosis of Parkinson disease based on the accuracy and interpretability [137].”
BackgroundMethodInfluentialBöhle, M., Eitel, F., Weygandt, M., & Ritter, K. (2019) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2019.00194 · Cited by 291 · cited 2×
“The ADNI MRI dataset was used for explaining Alzheimer ’ s classification using LRP for visualizing CNN decisions [144].”
MethodKnowledge graphs as tools for explainable machine learning: A survey
Tiddi, I., & Stefan Schlobach, A. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103627 · Cited by 287 · cited 4×
“A survey of knowledge graphs as a tool for XAI is provided covering rule-based machine learning, image recognition, recommender system, predictive tasks, and NLP [117].”
BackgroundMethodInfluentialArtificial intelligence in breast imaging
Le, E., Wang, Y., Huang, Y., Hickman, S. E., & Gilbert, F. J. (2019) · Clinical Radiology · doi:10.1016/j.crad.2019.02.006 · Cited by 283 · cited 4×
“Some studies reporting DNN medical imaging performance exceeding the radiologists were often using small datasets and can be considered a significant limitation [6,254].”
BackgroundMethodInfluentialExplainable artificial intelligence for breast cancer: A visual case-based reasoning approach
Lamy, J.-B., Sekar, B., Guezennec, G., Bouaud, J., & Séroussi, B. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.01.001 · Cited by 282 · cited 2×
“The explainability was provided using a visual interface for similarities between the query and similar cases, with scatter plots for quantitative, and rainbow boxes for qualitative similarities [205].”
MethodKo, H., Chung, H., Kang, W. S., Kim, K. W., Shin, Y., Kang, S., Lee, J. H., Kim, Y. J., Kim, N. Y., Jung, H., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/19569 · Cited by 279 · cited 3×
“The framework was tested on low-quality CT images, and ResNet-50 performed best amongst the selected DNNs with an accuracy of 99.87% and a sensitivity of 99.58% [183].”
MethodInfluentialPruning by explaining: A novel criterion for deep neural network pruning
Yeom, S.-K., Seegerer, P., Lapuschkin, S., Binder, A., Wiedemann, S. M., Müller, K., & Samek, W. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107899 · Cited by 277 · cited 5×
“LRP has been used in different computer vision applications and originally assigned importance scores or relevancies to the different input dimension contributions to the model decision [56].”
BackgroundMethodInfluentialQian, X., Pei, J., Zheng, H., Xie, X., Lin, Y., Zhang, H., Han, C., Gao, X., Zhang, H., Zheng, W., et al. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00711-2 · Cited by 257 · cited 3×
“Using the XAI techniques to assist the clinician can help to produce better diagnosis than the model or clinician alone [204,212,233,234].”
MethodExplanation Methods in Deep Learning: Users, Values, Concerns and Challenges
Ras, G., van Gerven, M., & Haselager, P. (2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4_2 · Cited by 255 · cited 3×
“Future approaches may see a combination of intrinsic, rule-extraction and attri-bution methods to provide answers in a human interpretable language [10].”
BackgroundExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems
Kitamura, Y., Kitamura, Y., Quigley, A., Isbister, K., Igarashi, T., Japan, C. '. C. C. O. H. F. I. C. S. 2. Y., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Computer-Human Interaction, & SIGs, A. (2021) · doi:10.1145/3411763 · Cited by 245
Tang, Z., Chuang, K. V., DeCarli, C. S., Jin, L., Beckett, L. A., Keiser, M. J., & Dugger, B. N. (2019) · Nature Communications · doi:10.1038/s41467-019-10212-1 · Cited by 234 · cited 3×
“Immunohistochemically-stained archival slides were used for Alz-heimer ’ s disease classification with CNN [156].”
MethodPredictive markers for Parkinson's disease using deep neural nets on neuromelanin sensitive MRI
Shinde, S., Prasad, S., Saboo, Y., Kaushick, R., Saini, J. S., Pal, P. K., & Ingalhalikar, M. (2019) · NeuroImage Clinical · doi:10.1016/j.nicl.2019.101748 · Cited by 230 · cited 2×
“CNN was used to create the biomarkers for Parkinson ’ s disease from Neuromelanin Sensitive Magnetic Resonance Imaging (NMS-MRI) and achieved better test accuracy compared to contrast ratio-based classification [147].”
The Pragmatic Turn in Explainable Artificial Intelligence (XAI)
Páez, A. (2019) · Minds and Machines · doi:10.1007/s11023-019-09502-w · Cited by 229 · cited 2×
“Owing to a large variety of AI models and their intended purposes, a single strategy for explainability will probably not work well for the different stakeholders in the system [60].”
BackgroundPapadimitroulas, P., Brocki, L., Christopher Chung, N., Marchadour, W., Vermet, F., Gaubert, L., Eleftheriadis, V., Plachouris, D., Visvikis, D., Kagadis, G. C., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.03.009 · Cited by 226 · cited 4×
“…image analysis [28,29], interpretable methods for neural networks [30], AI interpretability in radiology [31], trustworthy AI for healthcare [32], AI techniques for COVID-19 [33,34] neuroimaging [35], and oncological radiomics, feature extraction basics and major interpretability methods [36].”
BackgroundMethodInfluentialCLEVR-XAI: A benchmark dataset for the ground truth evaluation of neural network explanations
Arras, L., Osman, A., & Samek, W. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.11.008 · Cited by 226 · cited 4×
“Although heatmaps can be evaluated qualitatively, there is a requirement for an objective comparison [130].”
BackgroundMethodInfluentialExplainable COVID-19 Detection Using Chest CT Scans and Deep Learning
Alshazly, H. A., Linse, C., Barth, E., & Martinetz, T. (2021) · Sensors · doi:10.3390/s21020455 · Cited by 222 · cited 1×
“CNN model for COVID-19 classification of CT images used t-SNE (dimensionality reduction) and Grad-CAM showing well separated clusters for COVID-19 and non-COVID-19 cases [173].”
MethodA survey of visual analytics for Explainable Artificial Intelligence methods
Alicioglu, G., & Sun, B. (2022) · Computers & Graphics · doi:10.1016/j.cag.2021.09.002 · Cited by 221 · cited 1×
“A survey of visual analytics techniques covered the XAI adoption for interpreting DL models [22].”
MethodMiller, T., Howe, P., & Sonenberg, L. (2017) · arXiv · doi:10.48550/arxiv.1712.00547 · Cited by 218 · cited 2×
“The models should be based on the explanations based on lessons from social sciences and psychology and developed jointly [284].”
BackgroundSchramowski, P., Stammer, W., Teso, S., Brugger, A., Herbert, F., Shao, X., Luigs, H.-G., Mahlein, A.-K., & Kersting, K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0212-3 · Cited by 207 · cited 3×
“The focus shifted to correcting the underlying reasons for a wrong model decision which can aid in understanding the confounding factors in image classification [259].”
BackgroundInfluentialAssessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs
Dunnmon, J. A., Yi, D., Langlotz, C. P., Ré, C., Rubin, D. L., & Lungren, M. P. (2019) · Radiology · doi:10.1148/radiol.2018181422 · Cited by 206 · cited 1×
“The clinical acceptance of AI techniques would be aided by multi-modality and information fusion of both imaging and non-imaging data [34,170].”
BackgroundA Review on Explainability in Multimodal Deep Neural Nets
Joshi, G., Walambe, R., & Kotecha, K. (2021) · IEEE Access · doi:10.1109/access.2021.3070212 · Cited by 204 · cited 2×
“The black box and opaque nature of deep neural networks precludes their usefulness despite excellent performance of multimodal methods [288].”
BackgroundExplainable Artificial Intelligence for Human Decision Support System in the Medical Domain
Knapič, S., Malhi, A. K., Saluja, R., & Främling, K. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3030037 · Cited by 179 · cited 3×
“The explanations of the three XAI methods were evaluated by a human expert and the study was aimed at developing a human decision support system [230].”
MethodInfluentialGeçer, B., Aksoy, S., Mercan, E., Shapiro, L. G., Weaver, D. L., & Elmore, J. G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.022 · Cited by 176 · cited 2×
“The histopathology images were used for multi-scale localization of relevant RoI with four CNN trained on samples from pathologists ’ screenings, followed by a CNN for classification into four diagnostic classes [209].”
MethodEitel, F., Soehler, E., Bellmann-Strobl, J., Brandt, A. U., Ruprecht, K., Giess, R. M., Kuchling, J., Asseyer, S., Weygandt, M., Haynes, J.-D., et al. (2019) · NeuroImage: Clinical · doi:10.1016/j.nicl.2019.102003 · Cited by 171 · cited 2×
“The study concluded that the framework and LRP provided transparency in the model ’ s decision [142].”
BackgroundMethodGuided Soft Attention Network for Classification of Breast Cancer Histopathology Images
Yang, H., Kim, J., Kim, H., & Adhikari, S. P. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2948026 · Cited by 169 · cited 2×
“Histopathology images were used for breast cancer classification on BACH microscopy dataset using a proposed RoI guided soft attention network [207].”
MethodResultNguyen, T. T. (2020) · doi:10.36227/techrxiv.12743933 · Cited by 168
Detection of Parkinson’s Disease from 3T T1 Weighted MRI Scans Using 3D Convolutional Neural Network
Chakraborty, S., Aich, S., & Kim, H. (2020) · Diagnostics · doi:10.3390/diagnostics10060402 · Cited by 165 · cited 2×
“CAM method was used for the explainability of the model ’ s predictions in selecting the relevant areas [148].”
MethodBlockchain for explainable and trustworthy artificial intelligence
Nassar, M., Salah, K., Rehman, M. H. U., & Svetinović, D. (2019) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1340 · Cited by 164 · cited 2×
“A framework for trustworthy and XAI combined selected features of trusted oracles, blockchain and smart contracts to reduce adversarial attacks and bias [11].”
BackgroundDeep Learning Enables Automatic Classification of Emphysema Pattern at CT
Humphries, S. M., Notary, A. M., Centeno, J. P., Strand, M. J., Crapo, J. D., Silverman, E. K., Lynch, D. A., & For the Genetic Epidemiology of COPD (COPDGene) Investigators (2019) · Radiology · doi:10.1148/radiol.2019191022 · Cited by 160 · cited 3×
“A CNN and LSTM were used for classification of emphysema pattern on COPDGene CT dataset [178].”
MethodResultInfluentialLocal interpretable model-agnostic explanations for classification of lymph node metastases
Palatnik de Sousa, I., Maria Bernardes Rebuzzi Vellasco, M., & Costa da Silva, E. (2019) · Sensors · doi:10.3390/s19132969 · Cited by 155 · cited 3×
“LIME was used for explainability of histological images for lymph node metastases classification of CNN on the Patch Camelyon (P-CAM) dataset [255].”
MethodInfluentialWang, C. J., Hamm, C. A., Savic, L. J., Ferrante, M., Schobert, I. T., Schlachter, T. R., Lin, M., Weinreb, J. C., Duncan, J. S., Chapiro, J., et al. (2019) · European Radiology · doi:10.1007/s00330-019-06214-8 · Cited by 154 · cited 2×
“Liver cancer diagnosis used MRI images and CNN for lesion classification [228].”
MethodExplainable skin lesion diagnosis using taxonomies
Barata, C., Celebi, M. E., & Marques, J. S. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107413 · Cited by 153 · cited 3×
“The incorporation of the supplementary information in the model training can help to improve the model ’ s prediction and explainability [156,217,226].”
BackgroundMethodA Review of Explainable Deep Learning Cancer Detection Models in Medical Imaging
Gulum, M. A., Trombley, C. M., & Kantardzic, M. M. (2021) · Applied Sciences · doi:10.3390/app11104573 · Cited by 152 · cited 3×
“A review of XAI approaches for cancer detection with MRI for DNNs concluded that explainability can be improved with counter examples, and intrinsically explainable models [258].”
BackgroundInfluentialDetection of Cardiac Structural Abnormalities in Fetal Ultrasound Videos Using Deep Learning
Komatsu, M., Sakai, A., Komatsu, R., Matsuoka, R., Yasutomi, S., Shozu, K., Dozen, A., Machino, H., Hidaka, H., Arakaki, T., et al. (2021) · Applied Sciences · doi:10.3390/app11010371 · Cited by 151 · cited 2×
“The video data was converted to a bar-code type timeline to aid the explainability which made it easier to identify the substructures [243].”
MethodGaur, M., Faldu, K., & Sheth, A. (2021) · IEEE Internet Computing · doi:10.1109/mic.2020.3031769 · Cited by 149 · cited 1×
“A knowledge infused learning (K-iL) proposed for knowledge graphs can be used with DNN [118].”
MethodHassan, M. R., Islam, M. F., Uddin, M. Z., Ghoshal, G., Hassan, M. M., Huda, S., & Fortino, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.09.030 · Cited by 147 · cited 5×
“The choice of the MRI slice/image is important and the authors proposed selecting the best MRI slice for improved model performance [220].”
BackgroundMethodInfluentialAhsan, M. M., Gupta, K. D., Islam, M. M., Sen, S., Rahman, M. L., & Hossain, M. S. (2020) · Machine Learning and Knowledge Extraction · doi:10.3390/make2040027 · Cited by 146 · cited 2×
“Eight CNN models were used for COVID-19 CT image classification with LIME to help identify specific differentiating features [157].”
MethodClinical Interpretable Deep Learning Model for Glaucoma Diagnosis
Liao, W., Zou, B., Zhao, R., Chen, Y., He, Z., & Zhou, M. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2949075 · Cited by 144 · cited 3×
“The proposed EAMNet achieved glaucoma diagnosis with 0.88 AUC and accurate optic disc segmentation (0.9 Adisc and 0.278 Edisc) [196].”
BackgroundMethodInfluentialLiu, H., Wang, L., Nan, Y., Jin, F., Wang, Q., & Pu, J. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.05.005 · Cited by 135 · cited 2×
“The method achieved better classification performance compared to the other approaches based on ROC [169].”
MethodZ-Inspection ® : A Process to Assess Trustworthy AI
Zicari, R. V., Brodersen, J., Brusseau, J., Dudder, B., Eichhorn, T., Ivanov, T., Kararigas, G., Kringen, P., McCullough, M., Moslein, F., et al. (2021) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2021.3066209 · Cited by 134 · cited 2×
“It was proposed for evaluating trustworthy AI and can help inform the stakeholders about the technical, ethical and legal risks before the production of an AI system [134].”
BackgroundDR|GRADUATE: uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images
Araújo, T., Aresta, G., Mendonça, L., Penas, S., Maia, C., Carneiro, Â., Mendonça, A. M., & Campilho, A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101715 · Cited by 133 · cited 3×
“An uncertainty-aware system for severity grading of the retinal fundus images were proposed to aid the expert with the trust in the model ’ s decision [190].”
BackgroundMethodKamal, M. S., Northcote, A., Chowdhury, L., Dey, N., Crespo, R. A. G., & Herrera‐Viedma, E. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3107056 · Cited by 131 · cited 6×
“Multimodality technique was observed to provide better specificity compared to each of the modalities alone [143].”
BackgroundMethodInfluentialHilbert, A., Ramos, L. A., van Os, H. J. A., Olabarriaga, S. D., Tolhuisen, M. L., Wermer, M. J. H., Barros, R. S., van der Schaaf, I. C., Dippel, D. W. J., Roos, Y. B. W. E. M., et al. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103516 · Cited by 130 · cited 2×
“Grad-CAM ++ was used for visualization and the model was found to be useful for predicting stroke outcome [136].”
MethodChest Radiographs in Congestive Heart Failure: Visualizing Neural Network Learning
Seah, J. C. Y., Tang, J. S. N., Kitchen, A., Gaillard, F., & Dixon, A. F. R. (2018) · Radiology · doi:10.1148/radiol.2018180887 · Cited by 128 · cited 2×
“CXR images for Congestive Heart Failure (CHF) were used to train a neural network on a labelled dataset, and a generative model trained on unlabelled dataset to estimate B-type natriuretic peptide BNP as a marker for CHF [237].”
MethodRajpurkar, P., Park, A., Irvin, J., Chute, C. G., Bereket, M. D., Mastrodicasa, D., Langlotz, C. P., Lungren, M. P., Ng, A. Y., & Patel, B. N. (2020) · Scientific Reports · doi:10.1038/s41598-020-61055-6 · Cited by 126 · cited 4×
“A 3D DNN, AppendiXNet was proposed for detection of appendicitis with a small CT exam dataset [227].”
BackgroundMethodResultInfluentialExplainable Prediction of Acute Myocardial Infarction Using Machine Learning and Shapley Values
Ibrahim, L., Mesinovic, M., Yang, K.-W. K., & Eid, M. A. (2020) · IEEE Access · doi:10.1109/access.2020.3040166 · Cited by 125 · cited 2×
“CNN, RNN and XGBoost frameworks were used for diagnosing the risk of Acute Myocardial Infarction (AMI) using the ECG-ViEW II dataset [248].”
MethodChereda, H., Bleckmann, A., Menck, K., Perera‐Bel, J., Stegmaier, P., Auer, F., Krämer, F., Leha, A., & Beißbarth, T. (2021) · Genome Medicine · doi:10.1186/s13073-021-00845-7 · Cited by 124 · cited 4×
“GLRP provided explanations for Graph-CNN that were consistent with the clinical knowledge and identified drivers of tumor progression [210].”
MethodResultInfluentialDomain-invariant interpretable fundus image quality assessment
Shen, Y., Sheng, B., Fang, R., Li, H., Dai, L., Stolte, S. E., Qin, J., Jia, W., & Shen, D. G. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101654 · Cited by 122 · cited 2×
“The proposed system was found to be useful for the DR screening program [188].”
MethodTowards Clinical Application of Artificial Intelligence in Ultrasound Imaging
Komatsu, M., Sakai, A., Dozen, A., Shozu, K., Yasutomi, S., Machino, H., Asada, K., Kaneko, S., & Hamamoto, R. (2021) · Biomedicines · doi:10.3390/biomedicines9070720 · Cited by 122 · cited 2×
“Ultrasound images have not been used as extensively in clinical AI analysis as the other imaging modalities [253].”
BackgroundMethodCOVID-19 infection map generation and detection from chest X-ray images
Degerli, A., Ahishali, M., Yamaç, M., Serkan Kiranyaz, B., Chowdhury, M. E. H., Hameed, K., Hamid, T., Mazhar, R., & Gabbouj, M. (2021) · Health Information Science and Systems · doi:10.1007/s13755-021-00146-8 · Cited by 120 · cited 5×
“A human-machine collaboration approach was introduced for the image segmentation, subsequently reducing the work done by the clinicians, to speed-up the process, and have better segmentation masks [159].”
MethodInfluentialInterpretable heartbeat classification using local model-agnostic explanations on ECGs
Neves, I., Folgado, D., Santos, S., Barandas, M., Campagner, A., Ronzio, L., Cabitza, F., & Gamboa, H. F. S. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104393 · Cited by 118 · cited 3×
“An ECG interpretation solution for heartbeat classification was proposed using several model-agnostic methods, PSI, LIME and SHAP [244].”
MethodInfluentialHealthXAI: Collaborative and explainable AI for supporting early diagnosis of cognitive decline
Khodabandehloo, E., Riboni, D., & Alimohammadi, A. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.030 · Cited by 112 · cited 4×
“Early detection of cognitive decline was investigated in a smart home equipped with various sensors to monitor the occupants ’ behavior [257].”
BackgroundMethodInfluentialConfalonieri, R., Weyde, T., Besold, T. R., & Martı́n, F. M. D. P. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103471 · Cited by 112 · cited 4×
“An ontology describes a domain of interest using an appropriate logical language [98].”
MethodInfluentialDeep Learning Local Descriptor for Image Splicing Detection and Localization
Rao, Y., Ni, J., & Zhao, H. (2020) · IEEE Access · doi:10.1109/access.2020.2970735 · Cited by 109 · cited 3×
“The Class Activation Map (CAM) approach used global average pooling for generation class activation maps [78].”
BackgroundMethodInfluentialTeramoto, A., Yamada, A., Kiriyama, Y., Tsukamoto, T., Yan, K., Zhang, L., Imaizumi, K., Saito, K., & Fujita, H. (2019) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2019.100205 · Cited by 109 · cited 2×
“A CNN model was used for automatic classification of malignant lung cells with cytological images and the results were found comparable to a cystopathologist [184].”
MethodMursch‐Edlmayr, A. S., Ng, W. S., Diniz‐Filho, A., Sousa, D. C., Arnould, L., Schlenker, M. B., Dueñas-Ángeles, K., Keane, P. A., Crowston, J. G., & Jayaram, H. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.2.55 · Cited by 109 · cited 1×
“The use of XAI for a binary decision regarding presence or absence of a disease is of great help, allowing more complex cases which are difficult to classify to be determined in a clinical setting by a human expert [281].”
BackgroundMartins, J., Cardoso, J. S., & Soares, F. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105341 · Cited by 107
ExAID: A multimodal explanation framework for computer-aided diagnosis of skin lesions
Lucieri, A., Bajwa, M. N., Braun, S. A., Malik, M. I., Dengel, A. R., & Ahmed, S. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106620 · Cited by 107 · cited 1×
“…ExAID was proposed for malignancy of skin lesions using Concept Activation Vectors (CAV) The framework used two classifiers, a concept-level classifier for dermatological concepts; and a disease level classifier for lesion diagnosis which were evaluated on PH2 and Derm7pt public datasets [218].”
MethodDemystifying Brain Tumor Segmentation Networks: Interpretability and Uncertainty Analysis
Natekar, P., Kori, A., & Krishnamurthi, G. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00006 · Cited by 103
The augmented radiologist: artificial intelligence in the practice of radiology
Sorantin, E., Grasser, M. G., Hemmelmayr, A., Tschauner, S., Hržić, F., Weiss, V., Lacekova, J., & Holzinger, A. (2021) · Pediatric Radiology · doi:10.1007/s00247-021-05177-7 · Cited by 102 · cited 1×
“AI can aid biomedical imaging as it can “ see ” additional and superior detailed information regarding tumor size, texture, shape etc. compared to, for example, human radiologists [7].”
BackgroundLevakov, G., Rosenthal, G., Shelef, I., Raviv, T. R., & Avidan, G. (2020) · Human Brain Mapping · doi:10.1002/hbm.25011 · Cited by 101 · cited 3×
“From the aggregated explanations it was concluded that cisterns and ventricles governed the age predictions [146].”
BackgroundMethodInfluentialDeep learning enables pathologist-like scoring of NASH models
Heinemann, F., Birk, G., & Stierstorfer, B. (2019) · Scientific Reports · doi:10.1038/s41598-019-54904-6 · Cited by 100 · cited 3×
“Using the XAI techniques to assist the clinician can help to produce better diagnosis than the model or clinician alone [204,212,233,234].”
MethodExplainable Diabetic Retinopathy Detection and Retinal Image Generation
Niu, Y., Gu, L., Zhao, Y., & Lu, F. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3110593 · Cited by 97 · cited 4×
“A methodology similar to Koch ’ s Postulates for Evidence-Based Medicine (EBM) was used for interpretability [192].”
BackgroundMethodInfluential2013 IEEE International Conference on Bioinformatics and Biomedicine
(2013) · IEEE Transactions on NanoBioscience · doi:10.1109/tnb.2013.2265418 · Cited by 97
Windisch, P. Y., Weber, P., Fürweger, C., Ehret, F., Kufeld, M., Zwahlen, D. R., & Muacevic, A. (2020) · Neuroradiology · doi:10.1007/s00234-020-02465-1 · Cited by 94 · cited 2×
“A pre-trained ResNet50 model was used on IXI dataset of MRI slices for a multiclass classification into a glioblastoma, vestibular schwannoma, or no tumor [152].”
BackgroundMethodSabol, P., Sinčák, P., Hartono, P., Kočan, P., Benetinová, Z., Blichárová, A., Verbóová, Ľ., Štammová, E., Antónia, S. F., & Anna, J. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103523 · Cited by 93 · cited 2×
“It provided threefold explanations, semantic explanation of misclassification possibility, training sample for the prediction, and training samples from conflicting classes [232].”
BackgroundMethodShape and margin-aware lung nodule classification in low-dose CT images via soft activation mapping
Lei, Y., Tian, Y., Shan, H., Zhang, J., Wang, G., & Kalra, M. K. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101628 · Cited by 91 · cited 2×
“Lung nodule localization and classification on low-dose CT images (LIDC-IDRI public dataset) was implemented using soft activation mapping for fine-grained features analysis with a CNN [180].”
BackgroundMethodExplAIn: Explanatory artificial intelligence for diabetic retinopathy diagnosis
Quellec, G., Hajj, H. A., Lamard, M., Conze, P.-H., Massin, P., & Cochener, B. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102118 · Cited by 91 · cited 5×
“The authors proposed and applied the ExplAIn algorithm to multiclass classification of DR fundus images [191].”
BackgroundMethodInfluentialUnderstanding and Interpreting Machine Learning in Medical Image Computing Applications
Pereira, S., Meier, R., Alves, V., Reyes, M., & Silva, C. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-02628-8 · Cited by 85
Chen, B., Li, J., Lu, G., & Zhang, D. D. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2952597 · Cited by 85 · cited 2×
“An attention guided network was proposed for lesion locations for multi-label thoracic disease classification in CXR images [168].”
BackgroundInitiative, A. D. N., Choi, H., Kim, Y. K., Yoon, E. J., Lee, J., & Lee, D. S. (2019) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-019-04538-7 · Cited by 82 · cited 3×
“A deep learning based cognitive signature was developed for brain PET for Alzheimer ’ s and Parkinson ’ s disease [140].”
BackgroundMethodAdoui, M. E., Drisis, S., & Benjelloun, M. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02209-9 · Cited by 82 · cited 3×
“The use of multiple scales can increase the localization and explainability [167,196,200,221].”
BackgroundMethodExpl(AI)n It to Me – Explainable AI and Information Systems Research
Bauer, K., Hinz, O. F., van der Aalst, W. M. P., & Weinhardt, C. (2021) · Business & Information Systems Engineering · doi:10.1007/s12599-021-00683-2 · Cited by 82 · cited 3×
“It is critical to focus on the needs of users while developing the model explainability [59].”
BackgroundMethodInfluentialThe Missing Pieces of Artificial Intelligence in Medicine
Gilvary, C. M., Madhukar, N. S., Elkhader, J. A., & Elemento, O. (2019) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2019.06.001 · Cited by 78 · cited 1×
“The clinicians are more likely to use a DNN for diagnosis if the model provides insights into its decision and can be understood to be not being driven by any artifacts [283].”
BackgroundExplaining CNN and RNN Using Selective Layer-Wise Relevance Propagation
Jung, Y., Han, S. H., & Choi, H. (2021) · IEEE Access · doi:10.1109/access.2021.3051171 · Cited by 77 · cited 4×
“The LRP has some limitations such as the heatmaps were noisy and could be non-discriminative [84].”
BackgroundMethodInfluentialPsychological foundations of explainability and interpretability in artificial intelligence
Broniatowski, D. A. (2021) · doi:10.6028/nist.ir.8367 · Cited by 76 · cited 2×
“In contrast, explanation refers to the ability to accurately describe the mechanism, or implementation, that led to an algorithm ’ s output, often so that the algorithm can be improved in some way ” [47].”
BackgroundCandemir, S., White, R. D., Demirer, M., Gupta, V., Bigelow, M. T., Prevedello, L. M. S., & Erdal, B. S. (2020) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2020.101721 · Cited by 74 · cited 3×
“Coronary CT angiography (CCTA) images were used for coronary artery atherosclerosis detection and localization on CCTA datasets with 3D-CNN [239].”
MethodInfluentialUnderstanding inherent image features in CNN-based assessment of diabetic retinopathy
Reguant, R., Brunak, S., & Saha, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-89225-0 · Cited by 74 · cited 3×
“DR affects millions of people in the world and is one of the leading causes of blindness [187].”
BackgroundMethodInfluentialde Souza, L. A., Jr., Mendel, R., Sophia, S., Ebigbo, A., Probst, A., Messmann, H., Papa, J. P., & Palm, C. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104578 · Cited by 73 · cited 3×
“The focus was on the early detection and on clarifying the image regions important for the classification [229].”
BackgroundMethodInfluentialLee, K.-S., Kim, J., Jeon, E., Choi, W. S., Kim, N. H., & Lee, K. Y. (2020) · Journal of Personalized Medicine · doi:10.3390/jpm10040213 · Cited by 70 · cited 2×
“A multiclass classification of NIH CXR dataset images into three classes, COVID-19, pneumonia, and normal used VGG-16 and VGG-19 CNN architecture for classification and Grad-CAM for interpretability [164].”
BackgroundMethod2015 IEEE International Conference on Fuzzy Systems
(2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2351332 · Cited by 67
Computer-aided diagnosis for fetal brain ultrasound images using deep convolutional neural networks
Xie, B., Lei, T., Wang, N., Cai, H., Xian, J., He, M., Zhang, L., & Xie, H. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02182-3 · Cited by 65 · cited 2×
“Fetal brain abnormalities can contribute to mental retardation and neurodevelopmental delay [155].”
BackgroundMethod2015 International Conference on Healthcare Informatics
(2015) · doi:10.1109/ichi35764.2015 · Cited by 64
CNN Fixations: An Unraveling Approach to Visualize the Discriminative Image Regions
Mopuri, K. R., Garg, U., & Babu, R. V. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2881920 · Cited by 63 · cited 5×
“A visual explanation method termed CNN Fixations utilized feature dependencies across the layers during the forward pass to uncover the discriminative image locations that dictate the model prediction [69].”
BackgroundMethodInfluentialVisualizing Convolutional Neural Networks to Improve Decision Support for Skin Lesion Classification
Molle, P. V., Strooper, M. D., Verbelen, T., Vankeirsbilck, B., Simoens, P., & Dhoedt, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-02628-8_13 · Cited by 63 · cited 2×
“Another study used ISIC dataset for binary classification of skin lesions [215].”
MethodTowards robust explanations for deep neural networks
Dombrowski, A.-K., Anders, C. J., Müller, K., & Kessel, P. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108194 · Cited by 62 · cited 1×
“It is important to devise techniques that can identify or prevent an adversarial attack [277].”
BackgroundLee, E., Choi, J.-S., Kim, M., & Suk, H.-I. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116113 · Cited by 61 · cited 3×
“The method was validated on a weighted MRI dataset and provided better performance over Regional Mean Volume (RMV), and Hierarchical Feature Fusion (HFF) methods using the four metrics (accuracy, sensitivity, specificity, and AUC) for the binary and multiclass classification [145].”
MethodInfluentialEnsembles of Convolutional Neural Network models for pediatric pneumonia diagnosis
Liz-López, H., Sánchez-Montañés, M. A., Tagarro, A., Domínguez‐Rodríguez, S., Dagan, R., & Camacho, D. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.04.007 · Cited by 59 · cited 9×
“The use of multiple scales can increase the localization and explainability [167,196,200,221].”
BackgroundMethodResultInfluentialA Decision-Support Tool for Renal Mass Classification
Kunapuli, G., Varghese, B. A., Ganapathy, P., Desai, B., Cen, S., Aron, M., Gill, I., & Duddalwar, V. (2018) · Journal of Digital Imaging · doi:10.1007/s10278-018-0100-0 · Cited by 58 · cited 4×
“The radiomics based features comprised mean, contrast, image intensities, Fourier frequencies etc. RFGB found simpler rules for modelling the features and could be easily compared to a large single highly accurate model [219].”
BackgroundMethodInfluentialMartín‐Noguerol, T., Paulano‐Godino, F., López-Ortega, R., Górriz, J. M., Riascos, R., & Luna, A. (2020) · Clinical Radiology · doi:10.1016/j.crad.2020.11.113 · Cited by 57 · cited 3×
“The skillsets of each are relevant for the other in order to better understand the viewpoints and limitations [286].”
BackgroundInfluentialAn Explainable Deep Learning Ensemble Model for Robust Diagnosis of Diabetic Retinopathy Grading
Shorfuzzaman, M., Hossain, M. S., & Saddik, A. E. (2021) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3469841 · Cited by 57 · cited 3×
“Three datasets (APTOS, IDRiD, MESSIDOR) were used for the model evaluation [186].”
MethodInfluentialMedinoid: Computer-Aided Diagnosis and Localization of Glaucoma Using Deep Learning †
Kim, M., Han, J. C., Hyun, S. H., Janssens, O., Hoecke, S. V., Kee, C., & Neve, W. D. (2019) · Applied Sciences · doi:10.3390/app9153064 · Cited by 56
Rajaraman, S., Thoma, G. R., Antani, S., & Candemir, S. (2019) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2512752 · Cited by 55 · cited 2×
“The model activations were visualized using LIME and Grad-CAM and found to highlight the discriminative regions in the CXR [171].”
MethodVolumetric breast density estimation on MRI using explainable deep learning regression
van der Velden, B. H. M., Janse, M. H. A., Ragusi, M. A. A., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-75167-6 · Cited by 55 · cited 2×
“The method ’ s main advantage was concluded as not requiring voxel-level 3D segmentations [202].”
MethodRen, H., Wong, A. B., Lian, W., Cheng, W., Zhang, Y., He, J., Liu, Q., Yang, J., Zhang, C., Wu, K., et al. (2021) · IEEE Access · doi:10.1109/access.2021.3090215 · Cited by 54 · cited 4×
“A Bayesian network, termed MulNet was proposed for pneumonia detection by exploiting multisource data combining DNN and an explainable model [166].”
BackgroundMethodInfluentialSafety and Trustworthiness of Deep Neural Networks: A SurveyPreprint
Huang, X., Kroening, D., Kwiatkowska, M., Ruan, W., Sun, Y.-C., Thamo, E., Wu, M., & Yi, X. (2018) · arXiv.org · doi:10.48550/arxiv.1812.08342 · Cited by 53
Nazari, M., Kluge, A., Apostolova, I. I., Klutmann, S., Kimiaei, S., Schroeder, M., & Buchert, R. (2021) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-021-05569-9 · Cited by 53 · cited 3×
“It was recommended that as LRP provides explainability for CNN predictions on DAT-SPECT, it could be used for clinical practice [139].”
BackgroundMethodInfluentialJanik, A., Dodd, J. D., Ifrim, G., Sankaran, K., & Curran, K. M. (2021) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.2582227 · Cited by 50 · cited 2×
“The study used MICCAI 2017 dataset with the U-Net architecture [241].”
MethodAutomated semantic labeling of pediatric musculoskeletal radiographs using deep learning
Yi, P. H., Kim, T. K., Wei, J., Shin, J., Hui, F. K., Sair, H. I., Hager, G. D., & Fritz, J. M. (2019) · Pediatric Radiology · doi:10.1007/s00247-019-04408-2 · Cited by 49 · cited 2×
“Five deep CNN models were used for automatic classification of paediatric musculoskeletal radiographs of the five anatomical area (shoulder, elbow, pelvis, hand, and knee) and achieved a classification rate of 33 radiographs per second [235].”
MethodEncoding Visual Attributes in Capsules for Explainable Medical Diagnoses
LaLonde, R., Torigian, D. A., & Bağcı, U. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59710-8_29 · Cited by 49 · cited 6×
“An explainable capsule network, X-Caps was proposed to predict based on human interpretable features by encoding high-level image attributes within the capsule vectors [15].”
BackgroundMethodInfluentialLopatina, A., Ropele, S., Sibgatulin, R., Reichenbach, J. R., & Güllmar, D. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.609468 · Cited by 49 · cited 5×
“Multiple sclerosis is a neurological disease, usually assessed using MRI images to detect lesions in brain white matter [153].”
BackgroundMethodInfluentialKenny, E. M., & Keane, M. T. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107530 · Cited by 49 · cited 2×
“Evaluation of the proposed twin system was extensively carried out by creating four different twin models, such as CNN-case based reasoning (CNN-CBR) [113].”
MethodExtending the Tsetlin Machine With Integer-Weighted Clauses for Increased Interpretability
Abeyrathna, K. D., Granmo, O., & Goodwin, M. (2021) · IEEE Access · doi:10.1109/access.2021.3049569 · Cited by 48 · cited 2×
“An interpretable model can obtain transparency by providing the reasons behind their output [52].”
BackgroundParkinson’s Disease Recognition Using SPECT Image and Interpretable AI: A Tutorial
Pianpanit, T., Lolak, S., Sawangjai, P., Sudhawiyangkul, T., & Wilaiprasitporn, T. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3077949 · Cited by 47 · cited 2×
“For evaluating the interpretation, a commonly used technique, DICE coefficient was used for the Parkinson ’ s Progression Markers Initiative (PPMI) database [138].”
MethodAn explainable AI system for automated COVID-19 assessment and lesion categorization from CT-scans
Pennisi, M., Kavasidis, I., Spampinato, C., Schininà, V., Palazzo, S., Salanitri, F. P., Bellitto, G., Rundo, F., Aldinucci, M., Cristofaro, M., et al. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102114 · Cited by 46 · cited 2×
“A COVID-19 detection and lesion categorization system were proposed for CT-scans by combining segmentation and classification networks [174].”
BackgroundMethodCeschin, R. C., Zahner, A., Reynolds, W., Gaesser, J. M., Zuccoli, G., Lo, C. W. Y., Gopalakrishnan, V., & Panigrahy, A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.05.049 · Cited by 43 · cited 1×
“A framework used volumetric neonatal MRI for classification of brain dysmaturation with 3D CNN and CAM reporting a classification accuracy of 98.5% [242].”
MethodInfluentialYoo, J., Jun, T. J., & Kim, Y. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106281 · Cited by 43 · cited 3×
“The model evaluation showed better classification performance compared to the other state of the art methods and provided an improved visualization of Cardiac Arrhythmia (CA) types [247].”
MethodInfluentialKumar, A., Manikandan, R., Köse, U., Gupta, D. K., & Satapathy, S. C. (2021) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3457187 · Cited by 42 · cited 3×
“The malignant tumor cells were divided into five classes [149].”
BackgroundMethodInfluentialBlack box algorithms and the rights of individuals: no easy solution to the “explainability” problem
Gryz, J., & Rojszczak, M. (2021) · Internet Policy Review · doi:10.14763/2021.2.1564 · Cited by 40 · cited 6×
“Certification of DNN models by agencies external to the developer or user could help to eliminate risk of unauthorized changes to how the system works and can prove beneficial in case of litigation to prove the correctness of the system [49].”
BackgroundMethodInfluentialLaterality Classification of Fundus Images Using Interpretable Deep Neural Network
Jang, Y., Son, J., Park, K. H., et al. (2018) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-018-0099-2 · Cited by 39 · cited 3×
“CNN was used to classify the laterality of the fundus images and Grad-CAM was used for identifying the significant image regions for the classification [194].”
BackgroundMethodResultMAGIX: Model Agnostic Globally Interpretable ExplanationsPreprint
Puri, N., Gupta, P., Agarwal, P., Verma, S., & Krishnamurthy, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.07160 · Cited by 39 · cited 4×
“Model Agnostic Globally Interpretable Explanations (MAGIX) technique learns the if-then rules for explainability of models for classification problems [96].”
MethodInfluentialSuzuki, K., Reyes, M., Syeda-Mahmood, T. F., Ender Konukoglu, A., Glocker, B., Wiest, R., Gur, Y., Greenspan, H. K., & Madabhushi, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33850-3 · Cited by 38
Mitigating belief projection in explainable artificial intelligence via Bayesian teaching
Yang, S. C., Vong, W. K., Sojitra, R. B., Folke, T., & Shafto, P. (2021) · Scientific Reports · doi:10.1038/s41598-021-89267-4 · Cited by 37 · cited 3×
“Bayesian teaching is a method for selecting examples and is based on the interactions between a teacher that provides examples to explain, and a learner explainee that draws inferences [105].”
MethodInfluentialMikołajczyk, A., Grochowski, M., & Kwasigroch, A. (2020) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2021-0004 · Cited by 35 · cited 1×
“A counterfactual approach, Global Explanations for Bias Identification (GEBI) was proposed for identification of bias in the data for image classification although it can be applied to other problems [279].”
MethodTen Open Challenges in Medical Visualization
Gillmann, C., Smit, N. N., Groller, E. M., Preim, B., Vilanova, A., & Wischgoll, T. (2021) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2021.3094858 · Cited by 35 · cited 2×
“The term ‘explanation ’ as used in XAI is not very well defined [60, 260,261].”
Background2008 IEEE International Ultrasonics Symposium
(2008) · IEEE Transactions on Ultrasonics Ferroelectrics and Frequency Control · doi:10.1109/tuffc.2008.707 · Cited by 34
Paul, R., Schabath, M. B., Gillies, R. J., Hall, L., & Goldgof, D. B. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103882 · Cited by 33 · cited 4×
“A CNN ensemble was used for lung nodule malignancy prediction with three CNN architectures, each trained with seven different seeds for the initial weights [179].”
BackgroundMethodInfluentialDiagnosis Support Model of Cardiomegaly Based on CNN Using ResNet and Explainable Feature Map
Yoo, H., Han, S., & Chung, K. (2021) · IEEE Access · doi:10.1109/access.2021.3068597 · Cited by 33 · cited 4×
“Cardiomegaly was diagnosed using CNN and explainable feature map for explainability with CXR images [236].”
BackgroundMethodInfluentialArtifactID: Identifying artifacts in low-field MRI of the brain using deep learning
Jimeno, M. M., Ravi, K. S., Jin, Z., Oyekunle, D., Ogbole, G. I., & Geethanath, S. (2022) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2022.02.002 · Cited by 32 · cited 1×
“Grad-CAM was used for visual explanations of the wrap-around model in low-field brain MRI images on two datasets showing an agreement between the radiologists and the models using Cohen ’ s kappa values [154].”
Method1982 IEEE international conference on acoustics, speech and signal processing
(1981) · Signal Processing · doi:10.1016/0165-1684(81)90055-4 · Cited by 31
Karthik, R., Menaka, R., Hariharan, M., & Kathiresan, G. S. (2021) · IRBM · doi:10.1016/j.irbm.2021.07.002 · Cited by 30 · cited 4×
“The clinical acceptance of AI techniques would be aided by multi-modality and information fusion of both imaging and non-imaging data [34,170].”
BackgroundMethodInfluentialMeng, Q., Hashimoto, Y., & Satoh, S. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3011805 · Cited by 29 · cited 3×
“A human intervention step was included to improve the localization accuracy and a qualitative evaluation was performed to verify the classification and localization results [197].”
MethodGuided Zoom: Zooming into Network Evidence to Refine Fine-Grained Model Decisions
Bargal, S. A., Zunino, A., Petsiuk, V., Zhang, J., Saenko, K., Murino, V., & Sclaroff, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3054303 · Cited by 29 · cited 2×
“The results on four datasets demonstrated that the Guided Zoom improved the model ’ s classification accuracy [290].”
MethodResultSchorr, C., Goodarzi, P., Chen, F., & Dahmen, T. (2021) · Applied Sciences · doi:10.3390/app11052199 · Cited by 29 · cited 3×
“Different visualization methods can be selected for classification and segmentation, such as Grad-CAM, activation map and saliency map [125].”
BackgroundMethodInfluentialVafaeezadeh, M., Behnam, H., Hosseinsabet, A., & Gifani, P. (2021) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-021-02542-7 · Cited by 29 · cited 2×
“In visualization with Grad-CAM, ResNeXt50 provided the best explainable results highlighting the RoI [246].”
MethodShapira, N., Fokuhl, J., Schultheiß, M., Beck, S., Kopp, F. K., Pfeiffer, D., Dangelmaier, J., Pahn, G., Sauter, A. P., Renger, B. C., et al. (2020) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/ab6e18 · Cited by 28 · cited 4×
“The incorporation of the supplementary information in the model training can help to improve the model ’ s prediction and explainability [156,217,226].”
MethodInfluentialKatzmann, A., Taubmann, O., Ahmad, S., Mühlberg, A., Sühling, M., & Groß, H. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.05.081 · Cited by 28 · cited 3×
“A lung lesion malignancy classification was proposed using CycleGAN activation maximization for visualizations of the classifier ’ s decision LIDC-IDRI dataset [176].”
MethodInfluentialExplainable AI for medical imaging: explaining pneumothorax diagnoses with Bayesian teaching
Folke, T., Yang, S. C., Anderson, S. P., et al. (2021) · doi:10.1117/12.2585967 · Cited by 27 · cited 9×
“AI can potentially transform the image-based diagnosis in radiology [8].”
BackgroundMethodInfluentialEmbedding deep networks into visual explanations
Qi, Z., Khorram, S., & Li, F. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103435 · Cited by 26 · cited 5×
“The DNN for prediction was associated with an XNN attached to the DNN intermediate layer [95].”
BackgroundMethodInfluentialKumar, D., Sankar, V., Clausi, D., Taylor, G. W., & Wong, A. (2019) · IEEE Access · doi:10.1109/access.2019.2945524 · Cited by 26 · cited 2×
“The proposed radiomic sequencer achieved correct predictions that can potentially improve clinical adoption [182].”
BackgroundMethodTian, J., Li, C., Shi, Z., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_78 · Cited by 22 · cited 2×
“The public MICCAI 2017 LiTS challenge dataset was used for evaluating a supervised attention model for captioning [223].”
Method
Research works printed but not linked: 10
- Durán, 2021, vol. 297
- A. Preece, D. Harborne, D. Braines, R. Tomsett and S. Chakraborty, “Stakeholders in Explainable AI,” [Online]. Available: https://doi.org/10.48550/arXiv.1810.00184. [Accessed 15 September 2022]. · DOI · Paper page
- V. Petsiuk, A. Das and K. Saenko, “RISE: Randomized Input Sampling for Explanation of Black-box Models,” [Online]. Available: https://doi.org/10.48550/arXiv.1806.07421. [Accessed 15 September 2022]. · DOI
- Adebayo, 2018, Sanity checks for saliency maps, Adv. Neural Inf. Process. Syst., 31
- Alber, 2019, iNNvestigate neural networks, J. Mach. Learn. Res., 20, 1
- Spinner, 2020, IEEE Trans. Visual. Comput. Graph., 26, 1064
- Panwar, 2020, vol. 140
- Liz, 2021, Ensembles of Convolutional Neural Network models for pediatric pneumonia diagnosis, Future Generat. Comput. Syst., 122, 220, 10.1016/j.future.2021.04.007 · DOI
- Kim, 2018, ICADx: interpretable computer aided diagnosis of breast masses, Medical Imaging 2018: Computer-Aided Diagnosis, 10575, 450
- Hampe, 2019, vol. 6
Cited by
Sorted by citations
Muhammad, D., & Bendechache, M. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.08.005 · Cited by 325
Dixon, D., Sattar, H., Moros, N., Kesireddy, S. R., Ahsan, H., Lakkimsetti, M., Fatima, M., Doshi, D., Sadhu, K., & Hassan, M. J. (2024) · Cureus · doi:10.7759/cureus.59954 · Cited by 249
“Reproduced under the terms of the Creative Commons CC-BY license from Nazir et al. [19].”
BackgroundMethodAmiri, Z., Heidari, A., Navimipour, N. J., Esmaeilpour, M., & Yazdani, Y. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09366-3 · Cited by 191
Wani, N. A., Kumar, R., Mamta, ., Bedi, J., & Rida, I. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102472 · Cited by 172
Federated Learning for Medical Image Analysis with Deep Neural Networks
Nazir, S., & Kaleem, M. (2023) · Diagnostics · doi:10.3390/diagnostics13091532 · Cited by 163
“Medical image modalities, such as ultrasound, X-rays, Magnetic Resonance Imaging (MRI), play a crucial role in disease diagnosis, and are used for diagnosing human body ailments, diseases, and various forms of cancers [1,2].”
BackgroundSelf-citation
Metadata
- Authors
- Nazir, S., Dickson, D. M., & Akram, M. U.
- Affiliations
- Glasgow Caledonian University (GB)
- National University of Sciences and Technology (PK)
- Corresponding author
- Nazir, Sajid
- Venue
- Computers in Biology and Medicine
- Publisher
- Elsevier BV
- Published
- 2023-04
- Volume
- 156
- Pages
- 106668
- ISSN
- 0010-4825 (ISSN-L)
- OpenAlex
- W4321350922
- Semantic Scholar
- 77d942cfa2d4b9266080258943048825e7449ad2
- Cited by
- 283
- References
- 315
- Citations by year
- 2026: 70 · 2025: 104 · 2024: 70 · 2023: 37
- FWCI
- 5.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Computers in Biology and Medicine (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ResearchOnline (acceptedVersion, cc-by)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- ResearchOnline (Glasgow Caledonian University) (submittedVersion, cc-by)
- Funders
- Glasgow Caledonian University (10386)
- Defense Advanced Research Projects Agency
- Global Challenges Research Fund
- Office of Defense Nuclear Nonproliferation
- Alzheimer's Disease Neuroimaging Initiative
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Keywords
- explainable AI, biomedical imaging, deep neural network, medical image classification, diagnosis, model interpretability, regulatory compliance, black-box models
- MeSH terms
- Machine Learning, Algorithms, Artificial Intelligence, Diagnostic Imaging, Humans, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review