Cited by 903Explainable Artificial Intelligence (XAI)Advanced Neural Network ApplicationsVisual Attention and Saliency Detection

The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.

Transformer Interpretability Beyond Attention Visualization

Open access

Chefer, Hila, Gur, Shir, Wolf, Lior·2021·2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

DOI 10.1109/cvpr46437.2021.00084

Open this paper in CoChat — free account Open PDF

Abstract

Self-attention techniques, and specifically Transformers, are dominating the field of text processing and are becoming increasingly popular in computer vision classification tasks. In order to visualize the parts of the image that led to a certain classification, existing methods either rely on the obtained attention maps or employ heuristic propagation along the attention graph. In this work, we propose a novel way to compute relevancy for Transformer networks. The method assigns local relevance based on the Deep Taylor Decomposition principle and then propagates these relevancy scores through the layers. This propagation involves attention layers and skip connections, which challenge existing methods. Our solution is based on a specific formulation that is shown to maintain the total relevancy across layers. We benchmark our method on very recent visual Transformer networks, as well as on a text classification problem, and demonstrate a clear advantage over the existing explainability methods. Our code is available at: https://github.com/hila-chefer/Transformer-Explainability.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1109/cvpr46437.2021.00084

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839

Show all 52 references

Research works printed but not linked: 3

radford, 2019, Language Models are Unsupervised Multitask Learners
erhan, 2009, Visualizing higher-layer features of a deep network, University of Montreal, 1341, 1
10.1109/ICCV.2019.00304 · DOI

Sorted by citations

Items 701–800 of 903

Explanation Alignment: Quantifying the Correctness of Model Reasoning at Scale
Bang, H., Boggust, A., & Satyanarayan, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92648-8_18
Development and validation of a deep learning–based automatic classification algorithm for the medial temporal lobe atrophy score using a multimodality cascade transformer
Lee, S. J., Lee, D., Suh, C. H., Jeong, S. Y., Shin, H. M., Jung, W., Kim, J.-H., Lim, J.-S., Kim, H.-S., Kim, S. J., et al. (2025) · Clinical Radiology · doi:10.1016/j.crad.2025.106993
A Meaningful Perturbation Metric for Evaluating Explainability Methods
Cohen, D., Chefer, H., & Wolf, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-95918-9_22
Self-citation
Geometry Meets Attention: Interpretable Transformers via SVD Inspiration
Arampatzakis, V., Pavlidis, G. P., Mitianoudis, N., & Papamarkos, N. (2025) · IEEE Access · doi:10.1109/access.2025.3586739
Class Activation Values: Lucid and Faithful Visual Interpretations for CLIP-based Text-Image Retrievals
Chen, P., Liu, H., Ding, J., Huang, X., Zou, S., & Yang, L. T. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729923
AHT-ViT: Adaptive Halting Transformer with Planned Depth Execution
Shutov, V., & Asadulaev, A. (2025) · International Journal on Cybernetics & Informatics · doi:10.5121/ijci.2025.140404
Explainability of Language Models (XAI and LLM)
Cecco, A. D., & Gianfagna, L. (2025) · Springer eBooks · doi:10.1007/978-3-031-92229-9_8
Visualizing and Interpreting Neural Network Focus Regions: A Comparative Study of Vision Transformers on Synthetic and Real Data
Trescher, D., Haag, W., & Schröder, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02813-6_22
Enhancing Interpretability of NesT Model Using NesT‐Shapley and Feature‐Weight‐Augmentation Method
Xu, L., Li, L., Cong, X., & Song, H. (2025) · IET Computer Vision · doi:10.1049/cvi2.70039
Enhancing Vision Transformer Explainability using Artificial Astrocytes
Echevarrieta-Catalan, N., Ribas-Rodriguez, A., Cedrón, F., Schwartz, O., & Aguiar‐Pulido, V. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00011
Design and Evaluation of Spatio-Temporal Deep Learning Models for Urban Road Flood Detection
Noh, H., Kang, N., Hwang, S., & Park, K.-H. (2025) · Journal of Digital Contents Society · doi:10.9728/dcs.2025.26.8.2249
SimEx-ViT: Explainable Vision Transformer with Similarity-Based Attention Modulation
Selventhiran, R., Rajalingam, V., & Das, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05060-1_11
Enhancing Robustness and Interpretability in Transformer Networks through Fuzzification
Cui, J., Yang, J., & Gao, T. (2024) · International Conference on Mechanical, Control and Computer Engineering (ICMCCE) · doi:10.1109/icmcce63640.2024.11163485
FDF-VQVAE: A Frequency Disentanglement and Fusion Learning Framework for Multi-sequence MRI Enhancement
Xie, X., Han, L., Sun, Y., Lam, C. K., Zheng, J., Tong, T., Ke, W., Lam, C., & Tan, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04947-6_18
On the Risk of Misleading Reports: Diagnosing Textual Biases in Multimodal Clinical AI
Restrepo, D. S., Ktena, S. I., Vakalopoulou, M., Christodoulidis, S., & Ferrante, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06004-4_32
Do Protein Transformers Have Biological Intelligence?
Lin, F., Du, W., Liu, J., Milon, T. I., Meche, S., Xu, W., Qin, X., & Yuan, X. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06118-8_22
Unveiling the physical meaning of transformer attention in neural network quantum states: A conditional mutual information perspective
阮, T. 天. R., Kan, B., 孙, Y. 艺. S., Shang, H., Zhang, S., & Yang, J. (2025) · Chinese Physics B · doi:10.1088/1674-1056/ae1118
Authors’ reply to: "Enhancing generalizability and clinical translation of ViT-CNA fusion for ASD diagnosis"
Gao, X., & Xu, Y. (2025) · Japanese Journal of Radiology · doi:10.1007/s11604-025-01892-5
High Adversarial Robustness Network: Adaptive Positional Encoding and Parallel Attention for Obstacle Recognition in Autonomous Driving
He, M., Bai, Y., Liu, H., Yang, A., & Wang, L. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3584813
Consolidating Explanation Stability Metrics
Bogaert, J., Descampe, A., & Standaert, F. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08327-2_15
Strongly Connected Components Are All You Need: Graph-Theoretic Interpretability and Optimization for Vision Transformers
Garg, D. (2025) · Indian Conference on Computer Vision, Graphics and Image Processing · doi:10.1145/3774521.3774581
RadLAS: A Foundation Model for Interpretable Radiography Image Analysis with Lesion-Aware Self-Supervised Pre-training
Liu, Y., Wen, Y., Yang, L., He, L., & Shen, H. T. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754915
SCENE-Net: Geometric induction for interpretable and low-resource 3D pole detection with Group-Equivariant Non-Expansive Operators
Lavado, D., Micheletti, A., Bocchi, G., Frosini, P., & Soares, C. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104531
CAPNet: Context-Aware Prompt Network for Weakly-Supervised Open-World Phrase-Grounding
Yuan, H. L., Yu, N., Lu, Z., Huang, Y., Yang, J., Yan, J., Zhang, Z., & Wang, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3729-7_16
Explainable Schizophrenia Classification from rs-fMRI Using SwiFT and TransLRP
Weaver, J., Zhang, E., Sarma, N. V. N. S., Melek, A., & Castillo, E. M. (2025) · Algorithms · doi:10.3390/a18110701
Vision Transformer Explainability: Enhancing Class Activation Map of Every Heads Using Confidence Scores with Perturbation
Tran, D.-N., Nguyen, C.-K., & Pham, T.-N. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-10202-7_16
Visibility Improvement in Grad-CAM via High-Resolution Feature Maps with FeatUp
Kadowaki, K., & Kameya, Y. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4575-9_14
Attention Lattice Adapter: Visual Explanation Generation for Visual Foundation Models
Hirano, S., Wada, Y., Iida, T., & Sugiura, K. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4097-6_27
PresenceLens: Interpreting Dynamic Presence in Virtual Reality
Kim, H., & Lee, I. (2025) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar67309.2025.00075
ChatSeek: Open-Vocabulary Object Seeking with LLM-Informed Belief Field and Vehicle-Arm Cooperation
Chen, B., Liu, L., Yang, H., Cui, Y., Yan, S., Zhong, P., & Sheng, Y. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229205
ConceptVQ: Visual Model Interpreter
Zhang, J., Zhang, L., & Li, S. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229124
Explaining Vision Transformers Through Similarity-based Graphs
Marchetti, M., Traini, D., Domenico Ursino, A., & Virgili, L. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229129
Integrating Gradient and Mask-based Approaches for Vision Transformer Explainability
Marchetti, M., Traini, D., Domenico Ursino, A., & Virgili, L. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228361
An Accurate, Explainable and Efficient Vision Transformer with Feature Selection and Class Activation Mapping
Zhang, L. M. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228354
Development of a Novel Interpretable Transformer‐Based Deep Learning Model for Predicting Postoperative Hypokalemia in Pituitary Adenomas
Li, Z., Wang, J., Wang, Y.-F., Peng, Z., Li, X.-J., Chen, C., Yan, H., Jin, W., Lu, Y., Zhuang, Z., et al. (2025) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.70089
Global trends and hotspots in AI applications for CT detection of chronic obstructive pulmonary disease: A bibliometric analysis from 2012 to 2024
Yao, Q., Zhang, Y.-K., Zhou, L.-Y., Yang, W.-X., & Wu, K. (2025) · Lasers in Medical Science · doi:10.1007/s10103-025-04748-6
From explanation to unsupervised segmentation: fusion of multiple explanation maps for vision transformers
Hogea, E., Onchiş, D. M., Coporan, A., Florea, A. M., & Istin, C. (2025) · Machine Vision and Applications · doi:10.1007/s00138-025-01766-w · Cited by 1
A Global Dataset-Specific Any-Order Minimal Expectation Baseline for Saliency Scores
Schwenke, L., & Atzmueller, M. (2025) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa65442.2025.11247975
Tiny ViT-Batten: Few-Shot Vision Transformer with Explainable Attention for Early Batten-Disease Detection on Pediatric MRI
Uppalapati, K., Yimenicioglu, B., Abdulkareem, S., Eftekhari, A., Uppalapati, B., & Kamath, V. (2025) · doi:10.1109/cises66934.2025.11265234
Inductive Bias versus Emergent Semantics: Architectural Scaling Modulates Saliency in Self-Supervised Vision ModelsPreprint
Li, G., & Zha, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5830803
Detecting Airway Invasion in Variable-Length Videofluoroscopic Swallowing Studies: A Vision Transformer Approach for Oropharyngeal Dysphagia
Abdolmotalleby, H., Reinhardt, J. M., & Daele, D. J. V. (2025) · Diagnostics · doi:10.3390/diagnostics15243180
Developing and Evaluating an Explainable Deep Learning–Based User Interface for Libyan Currency Authentication.
Mohammed, M. M., Masbah, A. I. G., & Elmansori, M. M. (2025) · The Scientific Journal of University of Benghazi · doi:10.37376/sjuob.v38i2.7470
XTC-Net: an explainable hybrid model for automated atelectasis detection from chest radiographs
Rajpoot, R., Jain, S., & Semwal, V. B. (2025) · Scientific Reports · doi:10.1038/s41598-025-28694-z
Semantic Pathway: An Interactive Visualization of Hidden States and Token Influence in LLMs
Singh, M. K., & Mueller, K. D. (2025) · Visualization · doi:10.1109/vis60296.2025.00017
Enhancing Interpretability and Gaining Insights into Robustness in Vision-Language Models Through Core and Spurious Feature Detection via Counterfactuals
Basak, A., & Raglin, A. J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13184-3_8
Is Attention All Security Domain Needs? A Systematic Review of Self-attention Mechanism in Cybersecurity
Dong, H. (2025) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa66935.2025.11315233
Multivariate fault isolation by robust Mallows’ C p : A mixed integer nonlinear programming approach
Liu, L., Zheng, Y., Wang, Z., & Wong, D. S. (2026) · Journal of the Taiwan Institute of Chemical Engineers · doi:10.1016/j.jtice.2025.106583
LatentZoom: Seamless Scaling in Generative Latent Space for Visual Exploration of Local Performance in Deep Neural Networks
Ma, X., & Li, J. (2026) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2026.3654030 · Cited by 2
COP: CrOss-View Attention Prompt for Zero-Shot Sketch-Based Image Retrieval
Zheng, J., Tang, Y. J., Luo, Y., Chen, N., Zeng, D., & Wu, D. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3654420
Research on the Explainability Evaluation of Large Power Models by Integrating Feature Importance and Visualization Techniques
Zhao, X., Liang, L., Cao, S., Yu, J., & Zhou, R. (2025) · International Conference on Intelligent Power and Systems (ICIPS) · doi:10.1109/icips67876.2025.11332197
Scale-aware Multi-head Attention with Explainability for Image Captioning
Guo, Y. O., Zhang, X., Jia, A., & Wang, B. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-5696-0_7
CrimeXplain: A Comparative Study of Deep and Transformer Models with Explainable AI for Crime Headline Classification
Firdoos, S., Hassan, M. S. U., & Masih, A. (2025) · Horizons of Information Technology and Engineering (HITE) · doi:10.1109/hite68444.2025.11363978
Integrating Deep Learning Nodes into an Augmented Decision Tree for Automated Medical Coding
Bhat, S. S., Bandi, V. S., Xu, H., & Carberry, J. (2026) · Analytics · doi:10.3390/analytics5010011
MATEX: Multi-scale Attention and Text-Guided Explainability of Medical Vision-Language Models
Imran, M., Lee, C., & Lee, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-17611-0_14
Dissecting Deepfake Artifacts via Multimodal Explanations
Bai, Y., Wang, D., Tang, S., Cao, J., & Li, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6950-2_3
Beyond accuracy: calibration and uncertainty in multi-architecture ensembles for MedMNIST classification
Sanap, H. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12521-1
UrbanPAT: Adapting Part-Aware Transformers For Long-Term Urban Element Re-Identification
Phunjanna, K., & Ahmed, S. (2025) · IEEE International Conference on Image Processing Workshops (ICIPW) · doi:10.1109/icipw68931.2025.11386350
Core Tokensets for Data-Efficient Sequential Training of Transformers
Paul, S., Brack, M., Schramowski, P., Kersting, K., & Mundt, M. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00545
Interpretable Open-Vocabulary Referring Object Detection with Reverse Contrast Attention
Juanico, D. E., Atienza, R., & Go, J. K. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00081
SLOTMFound: foundation-based diagnosis of multiple sclerosis using retinal SLO imaging and OCT thickness-maps
Esmailizadeh, R., Aghababaei, A., Mirzaei, S., Arian, R., & Kafieh, R. (2026) · International Conference on Machine Vision · doi:10.1117/12.3090443
CausalProto-CLIP:Fine-Grained and Interpretable Vision-Language Modeling via Causal Prototypes
Meng, Y., Wei, Q., Pei, Z., Miao, P., Tan, C., & Meng, Z. (2025) · International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) · doi:10.1109/cei66465.2025.11398612
Independent Block-Wise Attribution for Vision Transformer Interpretability Through Semantic Relevance
Qi, N., Zhao, P. F., Gui-qin, W., Zhao, C., & Yang, S. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3668476
Hierarchical STFT Based Transformer for Causality Discovery
Semsarha, S., & Shamsollahi, M. B. (2025) · National and International Iranian Conference on Biomedical Engineering (ICBME) · doi:10.1109/icbme68496.2025.11392370
Benford-Constrained Multimodal Learning for Few-Shot Fake Image Detection
Astraikis, J., Martin, R., van Es, A., Kottam, S., & Sun, Y. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401004
Compute-Efficient Prediction of Rhetorical Relations via Late Fusion of Semantic Perturbation and Attention Features
Duddukuri, Y. H. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00278
Generation of Explanatory Content and Requirements for Social XAI
Främling, K., Thommes, K., & Wrede, B. (2025) · Springer eBooks · doi:10.1007/978-981-96-5290-7_15
Layer-Wise Relevance Propagation (LRP)-Guided Clustering-Based Compression Framework for Deploying Deep Neural Network Models on Memory-Constrained Devices
Sahoo, D., Ravi, N., Ghose, D., & Ganesan, S. (2025) · IEEE International Conference on High Performance Computing, Data, and Analytics · doi:10.1109/hipc66333.2025.00018
Information Bottleneck Scores for Identifying Causally Informative Attention Heads in Vision–Language Models
Zhang, Y., & Ma, L. (2026) · Algorithms · doi:10.3390/a19030238
Prompt is All You Need: Prompting Foundation Models for Large-Scale Self-Supervised Semantic Segmentation
Su, J., Luo, Q., Sun, S., Hou, Y., Zhang, X., Heikkilä, J., Yang, C., & Liu, L. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3673339
Paying Attention to Cause and Effect: A Prototype Framework for Analyzing Mechanical Causality Attention Patterns in Transformer Models
Punchihewa, Y. (2026) · International Conference on Advanced Research in Computing (ICARC) · doi:10.1109/icarc68737.2026.11454006
KG-XNN: Knowledge-Graph-Guided Explainable Neural Network for Image Classification
Jiang, Z. (2025) · International Conference on Power, Electrical Engineering, Electronics and Control (PEEEC) · doi:10.1109/peeec67807.2025.00015
Learn to Rank: Visual Attribution by Learning Importance Ranking
Schinagl, D., Fruhwirth-Reisinger, C., Prutsch, A., Schulter, S., & Possegger, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37592-6_20
Multimodal deep learning for audiovisual production
Ouenniche, K. (2023) · theses.fr (ABES) · doi:10.70675/a01becf4z4ed9z4955z940cz49c821c1b8a8
Learning discriminative representations to interpret image recognition models
Figueroa, F. T. (2024) · theses.fr (ABES) · doi:10.70675/b1004b04z42a5z4eb1z9006z898e627b47c5
Explainable algorithms for anomaly detection and time series forecasting
Kong, L. (2024) · theses.fr (ABES) · doi:10.70675/f3f56534zcb22z4c9fzb5fez6b38e2066740 · Cited by 1
Machine learning for fetal ultrasound image analysis using privileged information
Bonnard, J. (2024) · doi:10.70675/757deec5zd6a5z4b44za558zcc352c74d04f
Taking advantages of new technologies, from deep-learning to Spatial omics : Toward a clinically relevant novel morpho-molecular classification of lung neuroendocrine tumours
Mathian, É. (2023) · theses.fr (ABES) · doi:10.70675/7463e286z9101z4a1dz8343z315aa5e81e0a
Explainable Deep Learning for the Application to Multimodal Data
Mallick, R. (2023) · theses.fr (ABES) · doi:10.70675/84d86f53z6799z4da8z9847z16ce10bbfdb5
Towards explainable and interpretable deep neural networks
Jeanneret, G. (2024) · theses.fr (ABES) · doi:10.70675/ed07566bze7a3z4daazb9d7z03fd028f66ce
Image Mining via Synthesis
Siglidis, I. (2025) · theses.fr (ABES) · doi:10.70675/c09ef138zb2dfz4a0bz973fz1e85fb419f7c
Interpretable Bird Classification Using Audio Spectrogram Transformer
Pillai, R., Pillai, P., Nair, T., Gavhankar, A., & Kale, D. (2026) · International Conference on Communication, Computing and Emerging Technologies (IC3ET) · doi:10.1109/ic3et64989.2026.11467233
Transcriptomics data generation with deep generative models
Lacan, A. (2025) · theses.fr (ABES) · doi:10.70675/4bbb4d4fzed5ez4f41z86f4zf6f892f9e3e8
X-RLHF: An Explainable Reinforcement Learning from Human Feedback Framework
Serban, G.-C. (2025) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc69064.2025.00077
FAO-Former: Learning Disentangled Semantic Representations with Frequency-Aware Orthogonal Transformer
Yang, K., Niu, Z., Deng, M., Tang, Z., & Xiao, G. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461856
RAIN: An embarrassingly simple approach to debiasing attribution evaluation
Duan, J., Song, J., Zhang, H., Xue, M., Wang, H., & Song, M. (2026) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2026.104773
Systematic Vulnerability Audit of Post-Hoc XAI under Common Corruptions: A Factor Analysis Across Vision BenchmarksPreprint
Kim, M. (2026) · Research Square · doi:10.21203/rs.3.rs-9501010/v1
FlowKPE: Unsupervised Keyphrase Extraction via Residual-Aware Attention Flow
Zhao, Z., & Si, Y. (2026) · International Symposium on Big Data and Applied Statistics (ISBDAS) · doi:10.1109/isbdas69350.2026.11484387
An Empirical Evaluation of Faithfulness Metrics in Explainable AI for Vision Transformers
Shingne, S., Shaikh, A. A., Khairnar, S., Puranik, B., & Gotmare, V. (2026) · International Conference on Emerging Smart Computing and Informatics (ESCI) · doi:10.1109/esci68015.2026.11493185
Hybrid Vi+ECNN framework for advanced ADHD diagnostic accuracy in medical imaging
Sorour, S. E., Hassan, L., Elwasila, O., Mine, T., & Elmaadaway, M. A. N. (2026) · Scientific Reports · doi:10.1038/s41598-026-50791-w
On Vision Transformer Explainability for Personal Protective Equipment Detection: A Qualitative and Quantitative Analysis
Renzo, M. D., Niro, F., Agnello, P., Petyx, M., Martinelli, F., Cesarelli, M., Santone, A., & Mercaldo, F. (2026) · Journal of Imaging · doi:10.3390/jimaging12050195
Scendi Score: Prompt-Aware Diversity Evaluation Via Schur Complement of Clip Embeddings
Ospanov, A., Jalali, M., & Farnia, F. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01572 · Cited by 2
Knowledge Transfer from Interaction Learning
Gao, Y., Chen, K., Peng, Z., Lu, H., & Xu, S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00342 · Cited by 1
Class-disentangled attribution with gradient guidance for CLIP
Li, F., Meng, Z., Tan, C., & Yin, Y. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00779-3
Soft Local Completeness: Rethinking Completeness in XAI
Haddad, Z. W., Barkan, O., Elisha, Y., & Koenigstein, N. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01841
SSplain: Sparse and Smooth Explainer for Retinopathy of Prematurity Classification
Sunger, E., Imbiriba, T., Campbell, P., Deniz Erdogmus, B., Ioannidis, S., & Dy, J. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00171
VulFocus: Interpret AI Models in Software Vulnerability Detection
Guo, Y., Dong, Z., & Tang, Q. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-21177-4_3
A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotations
Cardullo, D., Teglia, S., & Amerini, I. (2026) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2026.104929
FusionBridge: Enhancing Multi-View Multi-Modal Sensing and Perception for Edge Intelligence
Wanniarachchige, D., Jayarajah, K., Abdelzaher, T., & Misra, A. (2026) · doi:10.1145/3774906.3802747
Consistent attributions for transformer-based reversible comparison classifiers
Le, T.-P., & Lauw, H. W. (2026) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-026-01205-y
Automated Detection of Patent Ductus Arteriosus in Pediatric Patients Using Doppler Ultrasonography Videos Based on a Transformer Model
Hong, W., Xu, X., Yuan, J., Wu, L., Wang, X., Kong, L., Zhang, X., Chen, L., Liu, Y., Wang, A., et al. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-01916-0

Authors: Chefer, H., Gur, S., & Wolf, L.
Affiliations: Tel Aviv University (IL)
ORCID: Chefer, Hila
Wolf, Lior
Venue: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher: IEEE
Published: 2021-06
Pages: 782-791
ISSN: 1063-6919 (ISSN-L)
DOI: 10.1109/cvpr46437.2021.00084
OpenAlex: W3112516115
Cited by: 903
References: 52
Citations by year: 2026: 185 · 2025: 226 · 2024: 193 · 2023: 178 · 2022: 90 · 2021: 31
FWCI: 56.82
Type: conference paper
Language: en
Open access: green
arxiv.org
Licence: cc-by
ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
arXiv (Cornell University) (submittedVersion, cc-by)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University) (cc-by)
Funders: European Research Council
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords: transformer interpretability, vision transformer, attention visualization, local relevance, relevance propagation, attention layers, skip connections, explainable AI, text classification, image classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Transformer Interpretability Beyond Attention Visualization

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks