The DOI matches its DataCite record; 7 of the 7 references it cites were found in a registry or an index.
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Open accessAbstract
This paper addresses the visualisation of image classification models, learnt using deep Convolutional Networks (ConvNets). We consider two visualisation techniques, based on computing the gradient of the class score with respect to the input image. The first one generates an image, which maximises the class score [Erhan et al., 2009], thus visualising the notion of the class, captured by a ConvNet. The second technique computes a class saliency map, specific to a given image and class. We show that such maps can be employed for weakly supervised object segmentation using classification ConvNets. Finally, we establish the connection between the gradient-based ConvNet visualisation methods and deconvolutional networks [Zeiler et al., 2013].
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“saliency maps (Simonyan et al., 2013), simple representations reporting the gradient of a target class score with respect to each input pixel, have been recently transposed to P300 decoding (Farahat et al., 2019).”
From A Lightweight Multi-Scale Convolutional Neural Network for P300 Decoding: Analysis of Training Strategies and Uncovering of Network Decision (2021) · cites this paper as Simonyan et al., 2013
In the citing paper
“Barring a few exceptions (Caruana et al., 2015; Lundberg et al., 2018b; Ustun et al., 2019; Jesus et al., 2021), much of the existing work is designed and developed for benchmark classification problems, often with synthetic data and usually validated with user studies limited to users in research settings such as Amazon Mechanical Turk (AMT; Simonyan et al., 2013; Zeiler and Fergus, 2014; Bach et”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Simonyan et al., 2013
In the citing paper
“Borzoi enables direct characterization of tissue-specific cis-regulatory TF motifs by applying attribution methods to the predicted RNA-seq coverage statistics45–50.”
From Predicting RNA-seq coverage from DNA sequence as a unifying model of gene regulation (2025) · cites this paper as [46]
In the citing paper
“Another common approach that is used to shed light on the predictions of Deep CNN is based on creating saliency maps [132] and guided backpropagation [133], [134].”
From AI in Medical Imaging Informatics: Current Challenges and Future Directions (2020) · cites this paper as [132]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images
Boykov, Y. Y., & Jolly, M.-P. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937505 · Cited by 3,674
A discriminatively trained, multiscale, deformable part model
Felzenszwalb, P. F., McAllester, D., & Ramanan, D. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587597 · Cited by 2,972
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588
Building high-level features using large scale unsupervised learning
Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., Le, Q. V., & Ng, A. Y. (2012) · International Conference on Machine Learning · Cited by 646
Visualizing and Understanding Convolutional Networks
Zeiler, M. D., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1311.2901 · Cited by 522
Research works printed but not linked: 4
- [1][1] D. Baehrens, T. Schroeter, S. Harmeling, M. Kawanabe, K. Hansen, and K.-R. M¨ uller. How to explain individual classification decisions. JMLR , 11:1803-1831, 2010. -
- [4][4] D. C. Ciresan, U. Meier, and J. Schmidhuber. Multi-column deep neural networks for image classification. In Proc. CVPR , pages 3642-3649, 2012. -
- [8][8] A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet classification with deep convolutional neural networks. In NIPS , pages 1106-1114, 2012. -
- [12][12] K. Simonyan, A. Vedaldi, and A. Zisserman. Deep Fisher networks and class saliency maps for object classification and localisation. In ILSVRC workshop , 2013. URL http://image-net.org/ challenges/LSVRC/2013/slides/ILSVRC\_az.pdf . -
Cited by
Sorted by citations
Items 701–800 of 1,056
Robust Explainability: A tutorial on gradient-based attribution methods for deep neural networks
Nielsen, I. E., Dera, D., Rasool, G., Ramachandran, R. P., & Bouaynaya, N. C. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2022.3142719 · Cited by 135
Scale-Invariant Convolutional Neural NetworksPreprint
Xu, Y., Xiao, T., Zhang, J., Yang, K., & Zhang, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.6369 · Cited by 115
Attacks Meet Interpretability: Attribute-steered Detection of Adversarial SamplesPreprint
Tao, G., Ma, S., Liu, Y., & Zhang, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11580 · Cited by 116
Improving Spatiotemporal Self-supervision by Deep Reinforcement Learning
Büchler, U., Brattoli, B., & Ommer, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_47 · Cited by 116
Acharya, D., Khoshelham, K., & Winter, S. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.02.020 · Cited by 114
Ensemble learning with 3D convolutional neural networks for functional connectome-based prediction
Khosla, M., Jamison, K. W., Kuceyeski, A. F., & Sabuncu, M. R. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.06.012 · Cited by 114
Improving the Interpretability of Deep Neural Networks with Knowledge Distillation
Liu, X., Wang, X., & Matwin, S. (2018) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2018.00132 · Cited by 120
Choe, J., Lee, S., & Shim, H. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2999099 · Cited by 119
(2018) · arXiv (Cornell University) · Cited by 113
A character-based convolutional neural network for language-agnostic Twitter sentiment analysis
Wehrmann, J., Becker, W., Cagnini, H. E. L., & Barros, R. C. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966145 · Cited by 116
ResTS: Residual Deep interpretable architecture for plant disease detection
Shah, D., Trivedi, V., Sheth, V., Shah, A., & Chauhan, U. (2021) · Information Processing in Agriculture · doi:10.1016/j.inpa.2021.06.001 · Cited by 115
Guided Integrated Gradients: an Adaptive Path Method for Removing Noise
Kapishnikov, A., Venugopalan, S., Avci, B., Wedin, B., Terry, M. A., & Bolukbasi, T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00501 · Cited by 133
Deep learning on fundus images detects glaucoma beyond the optic disc
Hemelings, R., Elen, B., Barbosa‐Breda, J., Blaschko, M. B., Boever, P. D., & Stalmans, I. (2021) · Scientific Reports · doi:10.1038/s41598-021-99605-1 · Cited by 120
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
Chen, Y., Yan, J., Jiang, M., Zhang, T., Zhao, Z., Zhao, W., Zheng, J., Yao, D., Zhang, R., Kendrick, K. M., et al. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3154755 · Cited by 113
Explainable artificial intelligence for spectroscopy data: a review
Contreras, J., & Bocklitz, T. W. (2024) · Pflügers Archiv - European Journal of Physiology · doi:10.1007/s00424-024-02997-y · Cited by 118
Deep Neural Network for Real-Time Autonomous Indoor NavigationPreprint
Kim, D. K., & Chen, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.04668 · Cited by 113
Learning What and Where to TransferPreprint
Jang, Y., Lee, H., Hwang, S. J., & Shin, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05901 · Cited by 117
Towards Better Explanations of Class Activation Mapping
Jung, H., & Oh, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00137 · Cited by 112
Enlarged perivascular spaces in brain MRI: Automated quantification in four regions
Dubost, F., Yilmaz, P., Adams, H. H. H., Bortsova, G., Ikram, M. A., Niessen, W. J., Vernooij, M. W., & de Bruijne, M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.10.026 · Cited by 117
Ghaoui, L. E., Gu, F., Travacca, B., Askari, A., & Tsai, A. Y. (2021) · SIAM Journal on Mathematics of Data Science · doi:10.1137/20m1358517 · Cited by 149
Representation learning of genomic sequence motifs with convolutional neural networks
Koo, P. K., & Eddy, S. R. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007560 · Cited by 112
Streaming Convolutional Neural Networks for End-to-End Learning With Multi-Megapixel Images
Pinckaers, H., van Ginneken, B., & Litjens, G. J. S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3019563 · Cited by 112
Inter-Image Communication for Weakly Supervised Localization
Zhang, X., Wei, Y., & Yang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_17 · Cited by 114
Do Feature Attribution Methods Correctly Attribute Features?
Zhou, Y., Booth, S., Ribeiro, M. T., & Shah, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21196 · Cited by 132
A Theoretical Explanation for Perplexing Behaviors of Backpropagation-based VisualizationsPreprint
Nie, W., Zhang, Y., & Patel, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07039 · Cited by 115
On the Connection Between Adversarial Robustness and Saliency Map InterpretabilityPreprint
Etmann, C., Lunz, S., Maaß, P., & Schönlieb, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.04172 · Cited by 131
Understanding Deep Features with Computer-Generated Imagery
Aubry, M., & Russell, B. C. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.329 · Cited by 111
Jang, H., Plis, S., Calhoun, V. D., & Lee, J. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.003 · Cited by 114
Lakhani, P. C. (2017) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-017-9980-7 · Cited by 111
Combining Bottom-Up, Top-Down, and Smoothness Cues for Weakly Supervised Image Segmentation
Roy, A., & Todorović, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.770 · Cited by 111
Hemelings, R., Elen, B., Barbosa‐Breda, J., Lemmens, S., Meire, M., POURJAVAN, S., Vandewalle, E., de Veire, S. V., Blaschko, M. B., Boever, P. D., et al. (2019) · Acta Ophthalmologica · doi:10.1111/aos.14193 · Cited by 115
Universal Adversarial Attack on Attention and the Resulting Dataset DAmageNet
Chen, S., He, Z., Sun, C., Yang, J., & Huang, X. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3033291 · Cited by 114
Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions
Han, X., Wallace, B., & Tsvetkov, Y. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.492 · Cited by 164
A Comprehensive Review of Explainable Artificial Intelligence (XAI) in Computer Vision
Cheng, Z. Q., Wu, Y. P., Li, Y., Cai, L., & Ihnaini, B. (2025) · Sensors · doi:10.3390/s25134166 · Cited by 122
Recognizing Facial Expressions Using a Shallow Convolutional Neural Network
Miao, S., Xu, H., Han, Z., & Zhu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2921220 · Cited by 110
Pereira, S., Meier, R., McKinley, R., Wiest, R., Alves, V., Silva, C. A., & Reyes, M. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.12.009 · Cited by 113
Object-sensitive Deep Reinforcement Learning
Li, Y., Sycara, K. P., & Iyer, R. (2018) · EPiC series in computing · doi:10.29007/xtgm · Cited by 110
A visual attention based ROI detection method for facial expression recognition
Sun, W., Zhao, H., & Jin, Z. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.034 · Cited by 110
Verisimilar Image Synthesis for Accurate Detection and Recognition of Texts in Scenes
Zhan, F., Lu, S., & Xue, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_16 · Cited by 110
Deep Learning With EEG Spectrograms in Rapid Eye Movement Behavior Disorder
Ruffini, G., Ibañez, D. P., Castellano, M., Dubreuil-Vall, L., Soria‐Frisch, A., Postuma, R., Gagnon, J., & Montplaisir, J. Y. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.00806 · Cited by 116
Motion Classification Using Kinematically Sifted ACGAN-Synthesized Radar Micro-Doppler Signatures
Erol, B., Gürbüz, S. Z., & Amin, M. G. (2020) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2020.2969579 · Cited by 110
Deep Learning in Visual Tracking: A Review
Jiao, L., Wang, D., Bai, Y., Chen, P., & Liu, F. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136907 · Cited by 113
TransMix: Attend to Mix for Vision Transformers
Chen, J.-N., Sun, S., Ju, H., Torr, P. H. S., Yuille, A., & Bai, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01182 · Cited by 117
NBDT: Neural-Backed Decision TreesPreprint
Wan, A., Dunlap, L., Ho, D., Yin, J., Lee, S., Jin, H., Petryk, S., Bargal, S. A., & Gonzalez, J. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00221 · Cited by 137
Horikawa, T., & Kamitani, Y. (2017) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2017.00004 · Cited by 114
Co-Mixup: Saliency Guided Joint Mixup with Supermodular DiversityPreprint
Kim, J.-H., Choo, W., Jeong, H., & Song, H. O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03065 · Cited by 129
Eigen-CAM: Visual Explanations for Deep Convolutional Neural Networks
Muhammad, M. B., & Yeasin, M. (2021) · SN Computer Science · doi:10.1007/s42979-021-00449-3 · Cited by 117
L-Shapley and C-Shapley: Efficient Model Interpretation for Structured DataPreprint
Chen, J., Song, L., Wainwright, M. J., & Jordan, M. I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.02610 · Cited by 141
Interpretable Deep Learning under FirePreprint
Zhang, X., Wang, N., Shen, H., Ji, S., Luo, X., & Wang, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00891 · Cited by 111
Benchmarking Attribution Methods with Relative Feature ImportancePreprint
Yang, M., & Kim, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09701 · Cited by 108
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
Linder, J., Bogard, N., Rosenberg, A. B., & Seelig, G. (2020) · Cell Systems · doi:10.1016/j.cels.2020.05.007 · Cited by 107
Predicting enhancers with deep convolutional neural networks
Xu, M., Zeng, W., Chen, S., Chen, N., Chen, T., & Jiang, R. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1878-3 · Cited by 107
The Limitations of Deep Learning in Adversarial SettingsPreprint
Papernot, N., McDaniel, P. D., Jha, S., Fredrikson, M., Celik, Z. B., & Swami, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.07528 · Cited by 160
HUMAN‐CENTERED DESIGN OF ARTIFICIAL INTELLIGENCE
Margetis, G., Ntoa, S., Antona, M., & Stephanidis, C. (2021) · Wiley eBooks · doi:10.1002/9781119636113.ch42 · Cited by 113
TITER: predicting translation initiation sites by deep learning
Zhang, S., Hu, H., Jiang, T., Zhang, L., & Zeng, J. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx247 · Cited by 107
Generative Counterfactual Introspection for Explainable Deep Learning
Liu, S., Kailkhura, B., Loveland, D., & Han, Y. (2019) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip45357.2019.8969491 · Cited by 114
Withnell, E., Zhang, X., Sun, K., & Guo, Y. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab315 · Cited by 106
Digra, M., Dhir, R., & Sharma, N. (2022) · Arabian Journal of Geosciences · doi:10.1007/s12517-022-10246-8 · Cited by 110
Gradients of CounterfactualsPreprint
Sundararajan, M., Taly, A., & Yan, Q. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.02639 · Cited by 122
Siddiquee, M. M. R., Zhou, Z., Tajbakhsh, N., Feng, R., Gotway, M. B., Bengio, Y., & Liang, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00028 · Cited by 105
Automatic detection of rare pathologies in fundus photographs using few-shot learning
Quellec, G., Lamard, M., Conze, P.-H., Massin, P., & Cochener, B. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101660 · Cited by 105
Noninterpretive Uses of Artificial Intelligence in Radiology
Richardson, M. L., Garwood, E. R., Lee, Y. Z., Li, M., Lo, H. S., Nagaraju, A., Nguyen, X. V., Probyn, L. J., Rajiah, P. S., Sin, J. M., et al. (2020) · Academic Radiology · doi:10.1016/j.acra.2020.01.012 · Cited by 105
Tag N’ Train: a technique to train improved classifiers on unlabeled data
Amram, O., & Mantilla, C. (2021) · Journal of High Energy Physics · doi:10.1007/jhep01(2021)153 · Cited by 105
Haupt, S. E., Chapman, W. E., Adams, S. V., Kirkwood, C., Hosking, J. S., Robinson, N., Lerch, S., & Subramanian, A. C. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0091 · Cited by 111
Explaining the Black-box Smoothly- A Counterfactual Approach
Singla, S., Eslami, M., Pollack, B., Wallace, S., & Batmanghelich, K. N. (2021) · Medical Image Analysis · doi:10.1016/j.media.2022.102721 · Cited by 126
Understanding Deep Image Representations by Inverting ThemPreprint
Mahendran, A., & Vedaldi, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.0035 · Cited by 145
Self-citationInterpretable Spatio-Temporal Attention for Video Action Recognition
Meng, L., Zhao, B., Chang, B., Huang, G. M., Sun, W. M., Tung, F., & Sigal, L. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00189 · Cited by 104
Extract interpretability-accuracy balanced rules from artificial neural networks: A review
He, C., Ma, M., & Wang, P. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.036 · Cited by 104
End-to-End Autonomous Driving Through Dueling Double Deep Q-Network
Peng, B., Sun, Q., Li, S. E., Kum, D., Yin, Y., Wei, J., & Gu, T. (2021) · Automotive Innovation · doi:10.1007/s42154-021-00151-3 · Cited by 107
Machine Learning as a Tool for Hypothesis Generation
Ludwig, J., & Mullainathan, S. (2024) · The Quarterly Journal of Economics · doi:10.1093/qje/qjad055 · Cited by 118
Investigating the influence of noise and distractors on the interpretation of neural networksPreprint
Kindermans, P.-J., Schütt, K. T., Müller, K., & Dähne, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07270 · Cited by 104
De novo protein design by inversion of the AlphaFold structure prediction network
Goverde, C. A., Wolf, B., Khakzad, H., Rosset, S., & Correia, B. E. (2023) · Protein Science · doi:10.1002/pro.4653 · Cited by 103
He, X., & Peng, Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11223 · Cited by 105
Explaining and Interpreting LSTMs
Arras, L., Arjona-Medina, J., Widrich, M., Montavon, G., Gillhofer, M., Müller, K.-R., Hochreiter, S., & Samek, W. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_11 · Cited by 111
Opening the Black Box: A systematic review on explainable artificial intelligence in remote sensing
Höhl, A., Obadić, I., Fernández‐Torres, M., Najjar, H., Oliveira, D. A. B., Akata, Z., Dengel, A. R., & Zhu, X. X. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3467001 · Cited by 116
Revisiting the Importance of Individual Units in CNNs via AblationPreprint
Zhou, B., Sun, Y., Bau, D., & Torralba, A. B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02891 · Cited by 103
Öksüz, İ., Ruijsink, B., Anton, E. P., Clough, J. R., da Cruz, G. J. L., Bustin, A., Prieto, C., Botnar, R. M., Rueckert, D., Schnabel, J. A., et al. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.04.009 · Cited by 102
Weichenthal, S., Hatzopoulou, M., & Brauer, M. D. (2018) · Environment International · doi:10.1016/j.envint.2018.11.042 · Cited by 106
Wang, J., Zheng, Y., Ma, J., Li, X., Wang, C., Gee, J. C., Wang, H., & Huang, W. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102687 · Cited by 105
M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities
Liu, H. Q., Wei, D., Lu, D., Sun, J., Wang, L., & Zheng, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25253 · Cited by 102
Graph Neural Networks in Modern AI-Aided Drug Discovery
Zhang, O., Lin, H., Zhang, X., Wang, X., Wu, Z., Ye, Q., Zhao, W., Wang, J., Ying, K., Kang, Y., et al. (2025) · Chemical Reviews · doi:10.1021/acs.chemrev.5c00461 · Cited by 110
Towards explaining anomalies: A deep Taylor decomposition of one-class models
Kauffmann, J., Müller, K., & Montavon, G. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107198 · Cited by 103
Understanding Individual Decisions of CNNs via Contrastive Backpropagation
Gu, J., Yang, Y., & Volker Tresp, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20893-6_8 · Cited by 106
ML-LOO: Detecting Adversarial Examples with Feature Attribution
Yang, P., Chen, J., Hsieh, C., Wang, J.-L., & Jordan, M. I. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6140 · Cited by 106
Controlling gene expression with deep generative design of regulatory DNA
Zrimec, J., Fu, X., Muhammad, A. S., Skrekas, C., Jauniškis, V., Speicher, N. K., Börlin, C. S., Verendel, V., Chehreghani, M. H., Dubhashi, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-32818-8 · Cited by 113
Weakly Supervised Summarization of Web Videos
Panda, R., Das, A., Wu, Z., Ernst, J., & Roy–Chowdhury, A. K. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.395 · Cited by 103
Local Explanation Methods for Deep Neural Networks Lack Sensitivity to Parameter ValuesPreprint
Adebayo, J., Gilmer, J., Goodfellow, I., & Kim, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03307 · Cited by 101
Explaining Predictions of Non-Linear Classifiers in NLP
Arras, L., Horn, F., Montavon, G., Müller, K., & Samek, W. (2016) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w16-1601 · Cited by 118
Structure-Preserving Neural Style Transfer
Cheng, M., Liu, X.-C., Wang, J., Lu, S.-P., Lai, Y., & Rosin, P. L. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2936746 · Cited by 101
Teuwen, J., & Moriakov, N. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-816176-0.00025-9 · Cited by 106
Levakov, G., Rosenthal, G., Shelef, I., Raviv, T. R., & Avidan, G. (2020) · Human Brain Mapping · doi:10.1002/hbm.25011 · Cited by 101
Ahmed, M. T., Ahmed, M. W., & Kamruzzaman, M. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110354 · Cited by 102
How Important Is a Neuron?Preprint
Dhamdhere, K., Sundararajan, M., & Yan, Q. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12233 · Cited by 125
Image Synthesis with a Single (Robust) ClassifierPreprint
Santurkar, S., Tsipras, D., Tran, B., Ilyas, A., Engstrom, L., & Mądry, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09453 · Cited by 114
Sutton, R. T., Zai͏̈ane, O. R., Goebel, R., & Baumgart, D. C. (2022) · Scientific Reports · doi:10.1038/s41598-022-06726-2 · Cited by 99
Liu, J., Zhao, G., Fei, Y., Zhang, M., Wang, Y., & Yu, Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01073 · Cited by 99
Evaluating local explanation methods on ground truth
Guidotti, R. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103428 · Cited by 99
Bridging a Gap in SAR-ATR: Training on Fully Synthetic and Testing on Measured Data
Inkawhich, N., Inkawhich, M. J., Davis, E. K., Majumder, U., Tripp, E. E., Capraro, C., & Chen, Y. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3059991 · Cited by 102
Metadata
- Authors
- Simonyan, K., Vedaldi, A., & Zisserman, A.
- Affiliations
- University of Oxford (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1312.6034
- OpenAlex
- W2169393322
- Cited by
- 5,370
- References
- 7
- Citations by year
- 2026: 53 · 2025: 259 · 2024: 513 · 2023: 605 · 2022: 584 · 2021: 1000 · 2020: 776 · 2019: 650 · 2018: 434 · 2017: 250 · 2016: 150 · 2015: 73 · 2014: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- image classification, saliency maps, class activation maps, deconvolutional networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
