The DOI matches its Crossref record; 47 of the 51 references it cites were found in a registry or an index.
Evaluating the Visualization of What a Deep Neural Network Has Learned
Abstract
Deep neural networks (DNNs) have demonstrated impressive performance in complex machine learning tasks such as image classification or speech recognition. However, due to their multilayer nonlinear structure, they are not transparent, i.e., it is hard to grasp what makes them arrive at a particular classification or recognition decision, given a new unseen data sample. Recently, several approaches have been proposed enabling one to understand and interpret the reasoning embodied in a DNN for a single test image. These methods quantify the “importance” of individual pixels with respect to the classification decision and allow a visualization in terms of a heatmap in pixel/input space. While the usefulness of heatmaps can be judged subjectively by a human, an objective quality measure is missing. In this paper, we present a general methodology based on region perturbation for evaluating ordered collections of pixels such as heatmaps. We compare heatmaps computed by three different methods on the SUN397, ILSVRC2012, and MIT Places data sets. Our main result is that the recently proposed layer-wise relevance propagation algorithm qualitatively and quantitatively provides a better explanation of what made a DNN arrive at a particular classification decision than the sensitivity-based approach or the deconvolution method. We provide theoretical arguments to explain this result and discuss its practical implications. Finally, we investigate the use of heatmaps for unsupervised assessment of the neural network performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 8,354
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Flagged first, then by citations
4 of the 51 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- jia, 2013, Caffe An Open Source Convolutional Architecture for Fast Feature Embedding
Cited by
Sorted by citations
Items 801–900 of 1,000
Transferring Information Between Neural Networks
Ehmann, C., & Samek, W. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461511 · Cited by 3
Self-citationMulti-Convolution Neural Networks-Based Deep Learning Model for Emotion Understanding
Chen, L., Wu, M., Su, W., & Hirota, K. (2018) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2018.8483607 · Cited by 3
Logic Negation with Spiking Neural P Systems
Rodríguez-Chavarría, D., Gutiérrez-Naranjo, M. Á., & Borrego‐Díaz, J. (2020) · Neural Processing Letters · doi:10.1007/s11063-020-10324-6 · Cited by 3
Data-Independent Feature Learning with Markov Random Fields in Convolutional Neural Networks
Peng, Y., Hankins, R., & Yin, H. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.03.107 · Cited by 3
Large Scale Evaluation of Importance Maps in Automatic Speech Recognition
Trinh, V. A., & Mandel, M. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2883 · Cited by 3
A self-explanatory contrastive logical knowledge learning method for sentiment analysis
Chen, Y., Yuan, B., Liao, B., & Gabbay, D. M. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110863 · Cited by 3
Why Lethal autonomous weapon systems are unacceptable
Šimák, V., Gregor, M., Hruboš, M., Nemec, D., & Hrbček, J. (2017) · IEEE World Symposium on Applied Machine Intelligence and Informatics (SAMI) · doi:10.1109/sami.2017.7880334 · Cited by 3
Improving the Performance and Explainability of Mammogram Classifiers with Local Annotations
Ness, L., Barkan, E., & Ozery-Flato, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61166-8_4 · Cited by 3
Visual Explanation by Unifying Adversarial Generation and Feature Importance Attributions
Charachon, M., Cournède, P.-H., Hudelot, C., & Ardon, R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87444-5_5 · Cited by 4
Computational Methods and Deep Learning for Elucidating Protein Interaction Networks
Vora, D. S., Kalakoti, Y., & Sundar, D. (2022) · Methods in molecular biology · doi:10.1007/978-1-0716-2617-7_15 · Cited by 3
The Implication of Deep Neural Networks in Solving Optimization Problems for Network Security
Hassan, S. (2020) · International Journal of Computer Applications · doi:10.5120/ijca2020920154 · Cited by 3
Assessing the Reliability of Visual Explanations of Deep Models with Adversarial Perturbations
Valle, D., Pimentel, T., & Veloso, A. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206795 · Cited by 3
VisualBackProp for learning using privileged information with CNNsPreprint
Bisla, D., & Choromanska, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09474 · Cited by 6
Understanding Patch-Based Learning by Explaining PredictionsPreprint
Anders, C. J., Montavon, G., Samek, W., & Müller, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.06926 · Cited by 3
Self-citationIntroducing and assessing the explainable AI (XAI)method: SIDUPreprint
Muddamsetty, S. M., Jahromi, M. N. S., Ciontos, A. E., Fenoy, L. M., & Moeslund, T. B. (2021) · arXiv (Cornell University) · Cited by 3
GANMEX: One-vs-One Attributions Guided by GAN-based Counterfactual Explanation BaselinesPreprint
Shih, S.-M., Tien, P.-J., & Karnin, Z. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06015 · Cited by 3
Bießmann, F., & Refiano, D. I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02033 · Cited by 3
Robust Malware Detection using Residual Attention NetworkPreprint
Ganesan, S., Vinayakumar, R., Krichen, M., Sowmya, V., & Soman, K. (2020) · doi:10.36227/techrxiv.13385291.v1 · Cited by 3
Monteiro, W. R., & Reynoso-Meza, G. (2022) · doi:10.36227/techrxiv.21707261 · Cited by 3
ASMOD: Adaptive Saliency Map on Object Detection
Xu, Z., Jiang, Y., Li, G., & Zhu, R. (2022) · IEEE International Conference on Information, Communication and Networks (ICICN) · doi:10.1109/icicn56848.2022.10006535 · Cited by 2
Neural dynamics of robust legged robots
Rush, E. R., Heckman, C., Jayaram, K., & Humbert, J. S. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1324404 · Cited by 2
A Guided Tour of Post-hoc XAI Techniques in Image Segmentation
Hasany, S. N., Mériaudeau, F., & Petitjean, C. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63797-1_9 · Cited by 3
Fast gradient-free activation maximization for neurons in spiking neural networks
Pospelov, N., Chertkov, A., Beketov, M., Oseledets, I. V., & Anokhin, K. V. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129070 · Cited by 3
SA-CAM: Semantic-aware visual explanations for deep convolutional networks
Yu, A., Zhang, Q., Rao, L., & Yang, Y.-B. (2025) · Machine Learning · doi:10.1007/s10994-024-06688-8 · Cited by 2
Apicella, A., Giugliano, S., Isgrò, F., Pollastro, A., & Prevete, R. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11564-z · Cited by 2
Jiang, L., Xie, R., Yang, B., He, J., Huang, H., Pan, Y. F., & Cai, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128129 · Cited by 3
TIPS: A text interaction evaluation metric for learning model interpretation
Nie, Z., Xiao, Z., Wang, T., Chronopoulos, A. T., Andonie, R., & Mosavi, A. A. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128184 · Cited by 2
Chen, Y., Yuan, B., Liao, B., Gabbay, D. M., & Cheng, L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129337 · Cited by 2
Sarkar, S., Bora, R. P., Kaushal, B., George, S. N., & Raja, K. B. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105717 · Cited by 2
DQSA: Dynamic Quantized Self-Attention for Multi-Task Encrypted Network Traffic Classification
Chen, Y., Lan, H., Gwee, B., Cao, Q. P., Razul, S. G., & Lin, Z. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3647211 · Cited by 2
Deep learning for predicting stem cell efficiency for use in beta cell differentiation
Schob, F., Binder, A., Zamarian, V., Sordi, V., Scholz, H., Malthe-Sørenssen, A., & Dysthe, D. K. (2026) · Scientific Reports · doi:10.1038/s41598-026-42830-3 · Cited by 2
Self-citationWu, Y., Zhu, J., Yuan, J., & Huang, K. (2026) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2026.108991 · Cited by 2
Nwazelibe, V. E., Abdulkarim, M., Agbasi, J. C., Okpala, E. C., Pande, C. B., Abba, S. I., & Egbueri, J. C. (2026) · Natural Hazards · doi:10.1007/s11069-026-08182-x · Cited by 2
A quantitative framework for explainability assessment in medical imaging
Fanale, R., Caldelli, R., Martini, B., & Sciarrone, F. (2026) · Frontiers in Imaging · doi:10.3389/fimag.2026.1846414 · Cited by 2
Explainable AI for Deep Visual Recognition: Evaluation, Methods, and Open Challenges
Alharbi, K. N. (2026) · Electronics · doi:10.3390/electronics15143222 · Cited by 2
AnchorMoE: Interpretable Time Series Classification via Anchor-Routed MoE
Xie, T., Tan, Z., Xiao, H., Li, M., Zhang, Y., Lu, Y., Yang, C., & Cheung, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817786 · Cited by 2
Erklärbare KI in der medizinischen Diagnose – Erfolge und Herausforderungen
Lucieri, A., Bajwa, M. N., Dengel, A. R., & Ahmed, S. (2022) · Springer eBooks · doi:10.1007/978-3-658-33597-7_35 · Cited by 2
SSA-CAE-Based Abnormal Data Classification Method in Edge Intelligence Device of CNC Machine
Kim, D., Oh, S., Lee, J., & Jeong, J. (2022) · Applied Sciences · doi:10.3390/app12125864 · Cited by 2
A maximum-entropy-attention-based convolutional neural network for image perception
Chen, Q., Zhang, A., & Pan, G. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07564-z · Cited by 2
Research on Music Genre Recognition Based on Improved Naive Bayes Algorithm
Liu, X. (2022) · Mobile Information Systems · doi:10.1155/2022/1909928 · Cited by 2
An, H., An, J. S., Li, M.-J., Kim, Y., & Kim, T. W. (2022) · Advanced Electronic Materials · doi:10.1002/aelm.202200876 · Cited by 2
A Systematic Approach for Tracking the Evolution of XAI as a Field of Research
Jamshidi, S., Nowaczyk, S., Fanaee‐T, H., & Rahat, M. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-23633-4_31 · Cited by 2
Li, J. (2023) · Soft Computing · doi:10.1007/s00500-023-08208-7 · Cited by 2
RetractedHierarchical multi-scale parametric optimization of deep neural networks
Zhang, S., Vassiliadis, V. S., Dorneanu, B., & Arellano‐García, H. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04745-8 · Cited by 2
Maximum Entropy Baseline for Integrated Gradients
Tan, H. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191554 · Cited by 2
Feature Importance for Clustering
Nápoles, G., Griffioen, N., Khoshrou, S., & Güven, Ç. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-49018-7_3 · Cited by 2
Selective Presentation of AI Object Detection Results While Maintaining Human Reliance
Fukuchi, Y., & Yamada, S. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341684 · Cited by 2
Accelerating the Global Aggregation of Local Explanations
Mor, A., Belinkov, Y., & Kimelfeld, B. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29845 · Cited by 3
Knof, H., Boerger, M., & Tcholtchev, N. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63803-9_9 · Cited by 2
Locally Testing Model Detections for Semantic Global Concepts
Motzkus, F., Mikriukov, G., Hellert, C., & Schmid, U. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63787-2_8 · Cited by 2
Meta-evaluating Stability Measures: MAX-Sensitivity and AVG-Sensitivity
Miró-Nicolau, M., Jaume-i-Capó, A., & Moyà-Alcover, G. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63787-2_18 · Cited by 2
Guo, X., Lu, X., & Li, Y. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad7a14 · Cited by 2
Structured Gradient-Based Interpretations via Norm-Regularized Adversarial Training
Gong, S., Dou, Q., & Farnia, F. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01047 · Cited by 3
Interpretation with baseline shapley value for feature groups on tree models
Xu, F., Zhou, Z., Ni, J., & Gao, W. D. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40117-2 · Cited by 2
Borkenhagen, L. K., & Runstadler, J. A. (2024) · Influenza and Other Respiratory Viruses · doi:10.1111/irv.70044 · Cited by 2
SwinLeafExplain: Interpretable Cotton Disease Classification with SWIN Transformer
Mariyappan, S., Thomas, J., & Raj, E. D. (2024) · International Conference on Advances in Computing and Communications (ICACC) · doi:10.1109/icacc63692.2024.10845618 · Cited by 2
Less Is More: The Influence of Pruning on the Explainability of CNNs
Merkle, F., Weber, D., Schöttle, P., Schlögl, S., & Nocker, M. (2025) · IEEE Access · doi:10.1109/access.2025.3569575 · Cited by 9
FRIES: Framework for inconsistency estimation of saliency metrics
Bora, R. P., Terhörst, P., Veldhuis, R. N. J., Ramachandra, R., & Raja, K. B. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112136 · Cited by 2
Convolutional neural net learns promoter sequence features driving transcription strength
Leiby, N., Hossain, A., & Salis, H. M. (2020) · EPiC series in computing · doi:10.29007/8fmw · Cited by 2
Evaluation of Importance Estimators in Deep Learning Classifiers for Computed Tomography
Brocki, L., Marchadour, W., Maison, J., Badic, B., Papadimitroulas, P., Hatt, M., Vermet, F., & Chung, N. C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-15565-9_1 · Cited by 2
Dividing and Conquering a BlackBox to a Mixture of Interpretable Models: Route, Interpret, Repeat
Ghosh, S., Yu, K., Arabshahi, F., & Batmanghelich, K. N. (2023) · PubMed · doi:10.48550/arxiv.2307.05350 · Cited by 2
Object Boundary Detection and Classification with Image-Level Labels
Koh, J. Y., Samek, W., Müller, K., & Binder, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66709-6_13 · Cited by 2
Self-citationSemi-Automatic Reliable Explanations for Prediction in Graphs
Todoriki, M., Shingu, M., Yano, S., Tolmachev, A., Komikado, T., & Maruhashi, K. (2021) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc51732.2021.9375922 · Cited by 2
On the conditions for integrating deep learning into the study of visual politics
Magnani, M., & Segerberg, A. (2021) · ACM Web Science Conference (WebSci) · doi:10.1145/3447535.3462511 · Cited by 2
Improving Explanations of Image Classification with Ensembles of Learners
Ahamed, A., Alipour, K., Kumar, S., Soltani, S., & Pazzani, M. J. (2022) · doi:10.5121/csit.2022.121801 · Cited by 2
Explanation of Multi-Label Neural Networks with Layer-Wise Relevance Propagation
Bello, M., Nápoles, G., Vanhoof, K., García, M. M., & Bello, R. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892239 · Cited by 2
The Solvability of Interpretability Evaluation Metrics
Zhou, Y., & Shah, J. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.182 · Cited by 12
Extensive evaluation of image classifiers’ interpretations
Poštić, S., & Subašić, M. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10273-4 · Cited by 2
Weight-Adapted Convolution Neural Network for Facial Expression Recognition
Chen, L., Wu, M., Witold Pedrycz, C., & Hirota, K. (2020) · Studies in computational intelligence · doi:10.1007/978-3-030-61577-2_5 · Cited by 2
Supporting DNN Safety Analysis and Retraining through Heatmap-based Unsupervised Learning
Fahmy, H. M., Pastore, F., Bagherzadeh, M., & Briand, L. (2021) · Figshare · doi:10.5281/zenodo.4725302 · Cited by 2
Measuring and improving the quality of visual explanationsPreprint
Grabska‐Barwińska, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08774 · Cited by 2
Explainable Adversarial Attacks in Deep Neural Networks Using Activation ProfilesPreprint
Cantareira, G. D., de Mello, R. F., & Paulovich, F. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.10229 · Cited by 9
Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group MasksPreprint
Chen, H., Feng, S., Ganhotra, J., Wan, H., Gunasekara, C., Joshi, S., & Ji, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04488 · Cited by 2
Reachability Analysis of Convolutional Neural NetworksPreprint
Yang, X.-D., Yamaguchi, T., Tran, H.-D., Hoxha, B., Johnson, T. T., & Prokhorov, D. (2021) · arXiv.org · doi:10.48550/arxiv.2106.12074 · Cited by 6
Discriminative Attribution from CounterfactualsPreprint
Eckstein, N., Bates, A. S., Jefferis, G. S. X. E., & Funke, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.13412 · Cited by 2
Quantifying Trustworthiness of Explainability in Medical AIPreprint
Zhang, J., Chao, H., Dasegowda, G., Wang, G., Kalra, M. K., & Yan, P. (2022) · Research Square · doi:10.21203/rs.3.rs-1897856/v1 · Cited by 2
The worst graph layout algorithm everPreprint
Bartolomeo, S. D., Lang, M., & Dunne, C. (2022) · doi:10.31219/osf.io/4hfy9 · Cited by 2
Artificial Intelligence and Applications
(2022) · doi:10.5121/csit.2022.1218 · Cited by 2
Scantlebury, J., Vost, L., Carbery, A., Hadfield, T. E., Turnbull, O. M., Brown, N., Chenthamarakshan, V., Das, P., Grosjean, H., von Delft, F., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.10.28.511712 · Cited by 2
Kernel-based Algorithms for Image Classification: A ReviewPreprint
Liang, X., Du, S., Duan, Y., Chen, Y., Zhu, K., Yin, Y., & Jian, L. (2023) · Research Square · doi:10.21203/rs.3.rs-3576956/v1 · Cited by 3
Jin, W., Li, X., & Hamarneh, G. (2022) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v36i11.21452 · Cited by 79
Stand-in Backdoor: A Stealthy and Powerful Backdoor Attack
Li, S., Li, H., & Chen, H. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685762 · Cited by 1
Femtosecond pulse parameter estimation from photoelectron momenta using machine learning
Szołdra, T., Ciappina, M. F., Werby, N., Bucksbaum, P. H., Lewenstein, M., Zakrzewski, J., & Maxwell, A. (2023) · New Journal of Physics · doi:10.1088/1367-2630/acee19 · Cited by 1
TIF: Threshold Interception and Fusion for Compact and Fine-Grained Visual Attribution
Zheng, G., Sang, J., & Xu, C. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3324808 · Cited by 1
Ganesh, A., & Ramachandiran, R. (2023) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-235503 · Cited by 1
RetractedChen, X., Li, J., Liu, J., Peters, S., Liu, L., Le, T. D., & Walsh, A. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386271 · Cited by 1
PXPermute reveals staining importance in multichannel imaging flow cytometry
Boushehri, S. S., Kornivetc, A., Winter, D. J. E., Kazeminia, S., Essig, K., Schmich, F., & Marr, C. (2024) · Cell Reports Methods · doi:10.1016/j.crmeth.2024.100715 · Cited by 1
Matich, H., & Mousannif, H. (2024) · Sustainable civil infrastructures · doi:10.1007/978-3-031-76557-5_5 · Cited by 1
Towards Boosting Out-of-Distribution Detection from a Spatial Feature Importance Perspective
Zhu, Y. T., Yan, X. J., & Xie, C. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02347-0 · Cited by 1
Quantifying Explainability: Essential Guidelines for Evaluating XAI Methods
Djellikh, S., Youkana, I., Ammari, A., & Saouli, R. (2025) · International Symposium on iNnovative Informatics of Biskra (ISNIB) · doi:10.1109/isnib64820.2025.10983231 · Cited by 1
Nonami, R., & Kitamura, M. (2025) · Transactions of the JSME (in Japanese) · doi:10.1299/transjsme.25-00020 · Cited by 1
Pinto, W. N., & Shin, J. (2025) · Journal of Educational Measurement · doi:10.1111/jedm.12438 · Cited by 1
Serbetci, O., Blüher, S., Gellert, P. R., & Leser, U. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf064 · Cited by 1
Spectral Occlusion - Attribution Beyond Spatial Relevance Heatmaps
Schmeisser, F., Lucieri, A., Dengel, A. R., & Ahmed, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08333-3_8 · Cited by 1
Explaining word embeddings with perfect fidelity: a case study in predicting research impact
Dvořáčková, L., Joachimiak, M. P., Černý, M., Kubecová, A., Sklenák, V., & Kliegr, T. (2025) · Machine Learning · doi:10.1007/s10994-025-06870-6 · Cited by 2
An Efficient and Explainable KAN Framework for Wireless Radiation Field Prediction
Shen, J., & Wang, X. (2025) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass66014.2025.00021 · Cited by 1
A Literature Review on Example-Based Explanations in Medical Image Analysis
Montenegro, H., & Cardoso, J. S. (2025) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-025-00227-3 · Cited by 1
Multilayer machine learning with visual knowledge discovery
Kovalerchuk, B., & Huber, L. (2025) · Information Visualization · doi:10.1177/14738716251363233 · Cited by 1
Qi, R., Liu, G., Zhang, J., & Hsiao, J. H. (2026) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2026.103773 · Cited by 1
Mai, A.-T., Nicolas, M. M., Ladret, P., & Caplier, A. (2025) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip67698.2025.11396834 · Cited by 1
Metadata
- Authors
- Samek, W., Binder, A., Montavon, G., Lapuschkin, S., & Muller, K.-R.
- Affiliations
- Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute (DE)
- Singapore University of Technology and Design (SG)
- Technische Universität Berlin, Berlin, Germany
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2017-11
- Volume
- 28
- Issue
- 11
- Pages
- 2660-2673
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2240067561
- Cited by
- 1,164
- References
- 51
- Citations by year
- 2026: 120 · 2025: 105 · 2024: 139 · 2023: 163 · 2022: 147 · 2021: 171 · 2020: 123 · 2019: 92 · 2018: 66 · 2017: 26
- FWCI
- 53.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) (submittedVersion)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- Funders
- Brain Korea 21 Plus Program through the National Research Foundation of Korea Funded by the Ministry of Education
- DFG (MU 987/17-1)
- German Ministry for Education and Research as Berlin Big Data Center (01IS14013A)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- deep neural network interpretability, layer-wise relevance propagation, deconvolution, explainable AI, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review