Cited by 903Explainable Artificial Intelligence (XAI)Advanced Neural Network ApplicationsVisual Attention and Saliency Detection

The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.

Transformer Interpretability Beyond Attention Visualization

Open access

Chefer, Hila, Gur, Shir, Wolf, Lior·2021·2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

DOI 10.1109/cvpr46437.2021.00084

Open this paper in CoChat — free account Open PDF

Abstract

Self-attention techniques, and specifically Transformers, are dominating the field of text processing and are becoming increasingly popular in computer vision classification tasks. In order to visualize the parts of the image that led to a certain classification, existing methods either rely on the obtained attention maps or employ heuristic propagation along the attention graph. In this work, we propose a novel way to compute relevancy for Transformer networks. The method assigns local relevance based on the Deep Taylor Decomposition principle and then propagates these relevancy scores through the layers. This propagation involves attention layers and skip connections, which challenge existing methods. Our solution is based on a specific formulation that is shown to maintain the total relevancy across layers. We benchmark our method on very recent visual Transformer networks, as well as on a text classification problem, and demonstrate a clear advantage over the existing explainability methods. Our code is available at: https://github.com/hila-chefer/Transformer-Explainability.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1109/cvpr46437.2021.00084

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839

Show all 52 references

Research works printed but not linked: 3

radford, 2019, Language Models are Unsupervised Multitask Learners
erhan, 2009, Visualizing higher-layer features of a deep network, University of Montreal, 1341, 1
10.1109/ICCV.2019.00304 · DOI

Sorted by citations

Items 801–900 of 903

VISAGE-X: Interpretable Graph-Based and Explainable Scene Reasoning for Vision-Language Understanding
Uday Kiran, G., Srilakshmi, V., Padmini, G., Siva Praneetha, K., Anvith Reddy, G., & Sai Shivani, B. (2026) · IEEE International Conference for Convergence in Computing Technology (I3CTCON) · doi:10.1109/i3ctcon68242.2026.11507403
Emoception: Selective Affective Layer Fine-Tuning of Video Vision Transformers for Player Arousal Change Recognition From Gameplay Footage
Xia, Y., Khan, I., Dewantoro, M. F., Ouyang, W., & Thawonmas, R. (2026) · IEEE Transactions on Games · doi:10.1109/tg.2026.3691772
InterScale reveals multi-scale cellular interaction programs in spatial transcriptomicsPreprint
Drummer, F., Jiménez, S., Marco, F. D., Schaar, A. C., Pentimalli, T. M., Beckmann, J., Rajewsky, N., & Theis, F. J. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.07.723456
Scaling vision models does not consistently improve localisation-based explanation quality
Cedro, M., & Chlebus, M. (2026) · Scientific Reports · doi:10.1038/s41598-026-68191-5
Decision Flow Tracing and Word Impact Analysis in Hybrid Transformer-Conditioned Diffusion Models for Text-to-Image Generation
Thomas, A. P., George, S., Raj, N. A., Ajaz, S. M., Shaju, M., & Nasim, V. A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-22914-4_13
LAVA-ViT: lesion-aware vision transformer for explainable and uncertainty aware diabetic retinopathy analysis
Kanaparthi, L., & Rao, G. M. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110374
Clinician-Centered Evaluation Framework for Explainable AI Heatmaps in OCT-Based Retinal Disease Classification
Maliagkani, E., Georgalas, I., Datseris, I., Papageorgiou, E. I., & Apostolopoulos, I. D. (2026) · Journal of Imaging · doi:10.3390/jimaging12050211
Explainable Transformer Models for Human Emotion Recognition: A Multi-Method Explainability Study in the Context of Mental Health
Azhar, M. H., Riaz, N., Azeem, W., Dewi, D. A., Amjad, A., & Arman, M. (2026) · Information · doi:10.3390/info17050496
CascadePanc-ViTUNet: A Cascaded Transformer Framework for Pancreatic Tumor Segmentation and Clinical T-Staging
Arjungirinath, M., Logeshwaran, M., & Lakkshmanan, A. (2026) · International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE) · doi:10.1109/rmkmate69073.2026.11518817
X-MedVIT: Interpretable Vision Transformers for Clinically Reliable Medical Imaging
Akshaya, V. S., G, K. V., Harshini, M., & Hemanth Kumar, J. (2026) · International Conference on Artificial Intelligence and Machine Learning Applications Theme: Healthcare and Internet of Things (AIMLA) · doi:10.1109/aimla67915.2026.11522430
Swin-BART: An Explainable Transformer-Based Approach for Chest X-Ray Report Generation
Kumari, A. V. S. R., & Pappala, L. K. (2026) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom70271.2026.11525559
BERT-HIT: A Transformer-Based Approach for Hardware Trojan Detection in Gate-Level Netlists
Zhang, L., Tehrani, N. N., Davoodi, A., & Topaloglu, R. O. (2026) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed69900.2026.11534692
Classification-Driven Contribution Analysis with Median Calibration for fault class and variable co-identification
Liu, L., Zheng, Y., & Yang, Y. (2026) · Journal of Process Control · doi:10.1016/j.jprocont.2026.103729
Explainable Hybrid CNN-Transformer Framework for Papaya Leaf Disease Classification with Layer-Wise Grad-CAM Analysis
Tawhid, S. M., Amit, A. P., Kader, M. A., & Nandi, D. (2026) · AIUB Journal of Science and Engineering (AJSE) · doi:10.53799/vxkj7t08
NeuroCLR-ViT: Neuro-Symbolic Self-Supervised Learning with Explainable Vision Transformers for Brain Tumor Classification and Glioma Grading
Ali, T., Sheihan, M., Ahmad, F., & Ahmad, M. (2026) · International Conference on Device Intelligence, Computing and Communication Technologies (DICCT) · doi:10.1109/dicct69099.2026.11535989
Promoting Interpretability in Image Captioning Through Attribution Segmentation Alignment
Catanpatan, W. Y., Aballe, Z., & Maderazo, C. V. (2026) · International Conference on Multi-scale Artificial Intelligence (MAI) · doi:10.1109/mai69289.2026.11543767
Multimodal Explainable AI (XAI) for Hateful Meme Classification: A Comprehensive Framework for Transparent Content Moderation
Nwasra, N. M., & Alharthy, A. (2026) · International Conference on Computational Intelligence Approaches and Applications (ICCIAA) · doi:10.1109/icciaa68481.2026.11543858
An Explainable Hybrid CNN–ViT Model for Detecting Leaf Diseases: A Dual-Interpretability Approach Using Heatmaps and SHAP on Coconut, Banana, and Sugarcane
Villagomez, J. M. D., Montecillo, M. B. D., & Maderazo, C. V. (2026) · International Conference on Multi-scale Artificial Intelligence (MAI) · doi:10.1109/mai69289.2026.11544025
Multi-Modal Fine-Grained Discriminative Cues Transfer for Efficient Person Re-Identification
Xu, S., Liu, B., Zhang, H., Li, H., & Wei, Y. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3701704
An Interpretable Hybrid CNN-Vision Transformer Framework for Pneumonia Detection from Chest X-Ray Images
Saha, M. K., Hosain, M. S., Hossain, M. N., & Uddin, M. (2026) · IEEE International Conference on Quantum Photonics, Artificial Intelligence & Networking (QPAIN) · doi:10.1109/qpain69676.2026.11546173
A Hybrid Deep Learning Framework For Multi-modal PV Fault Detection
Osei, S., Bamisile, O., & Christopher, W. C. (2026) · Asia Energy and Electrical Engineering Symposium (AEEES) · doi:10.1109/aeees69423.2026.11556798
ATTN-FIQA: Interpretable Attention-based Face Image Quality Assessment with Vision Transformers
Ozgur, G., Chettaoui, T., Caldeira, E., Kolf, J. N., Huber, M., Atzori, A., Damer, N., & Boutros, F. (2026) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg67764.2026.11557043
Modeling day-long ECG signals to predict heart failure risk with explainable AI
Zvuloni, E., Almog, R., Glikson, M., Biton, S. B., Green, I., Laufer, I., Amir, O., & Behar, J. A. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02835-8 · Cited by 1
XTrail-ID: An Explainable AI Human Footprint Trail Identification on Soil Substrate Using Unsupervised Machine Learning from UAV Imagery
Mmereki, W., Jamisola, R. S., Jewell, Z. C., Petso, T., Matsebe, O., & Alibhai, S. K. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8060168
Representation space evaluation of feature extractors for model transferability in fine-grained recognition
Shahaliyev, I., & Hasanov, J. (2026) · Signal Image and Video Processing · doi:10.1007/s11760-026-05474-4
What Helps—and What Hurts: Bidirectional Explanations for Vision Transformers
Su, Q., & Luo, T. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1947-6_41
DnA: Denoising Attention for Visual Tasks
Campos, R., Maity, S., Li, X., Das, S., & Dutta, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37422-6_2
HYDRA-XAI dual-backbone disaster scene recognition using ResNet50-Swin transformer feature fusion, explainable evidence, and an operational recommender
Raju, A. S. N., Geetha, G., Subashini, B., Venkatesh, K., Neelima, S., Gatla, R. K., Rakhimova, M., Smerat, A., & Teferi, S. D. (2026) · Scientific Reports · doi:10.1038/s41598-026-59683-5
Eliciting CLIP’s intrinsic attribute knowledge through a dual-cache guided mechanism for class-incremental learning
Ye, S., Wang, Z., Huang, Y., Fang, F., & Zhang, G. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116525
Explainability-Driven Analysis of AI-Generated Image Detectors: Insights into Generalization and Failure Modes
Abate, A. F., Bisogni, C., Cimmino, L., Pero, C., & Polsinelli, M. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-032-23347-9_28
GoldFormer: A Texture-Aware Vision Transformer-Based Algorithm for Detecting Near-Identical Images
Raisi, Z. (2026) · Algorithms · doi:10.3390/a19070530
Dynamic Modal Attention Visualization for Interpretable Driver Drowsiness Prediction
Theivadas, J. R., & Ponnan, S. (2025) · IEEE International Conference on Cybernetics, Cognition and Machine Learning Applications (ICCCMLA) · doi:10.1109/icccmla66092.2025.11580500
Assessing the Causal Reliability of AI-Generated Emergency Explanations: An Intervention-Based Evaluation Framework
Basak, A., & Raglin, A. J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30860-3_1
Benchmarking CAM-Based Explainable AI for Olive Cultivar Classification
Morais, M., Santos, M. F. D., Mendes, J., Lima, J., Pereira, A. I., & Mercorelli, P. (2026) · International Carpathian Control Conference · doi:10.1109/iccc71363.2026.11593265
Beyond Token Attention: Contiguous and Interpretable Payload Identification for Web Attacks
Yang, Y., Zhao, J. Z., Pei, C., Wan, W., Long, C., Du, G., Liu, Y., & Li, J. (2026) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn69566.2026.00044
Perspective Chapter: Artificial Intelligence-assisted Screening Systems in Ophthalmology – Deep Learning Architectures, Clinical Validation and Implementation Strategies
Chakravarthy, K. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1015014
A deep learning perception framework for farm digital twins: weed species classification, semantic segmentation, and gradient-based visual interpretability
Manoj, A., Kumar, A. R., Remya, S., Ramasubbareddy, S., & Cho, Y. Y. (2026) · Frontiers in Sustainable Food Systems · doi:10.3389/fsufs.2026.1841305
X-Distill: Cross-Architecture Vision Distillation for Visuomotor Learning
Shao, M., Zhang, F., Zhang, G., Cheng, B. H., Xue, Z., & Xu, H. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3711479 · Cited by 2
Transformer-based classification with enhanced causal explainability from otoscopic images
Şeker, D., & Yildiz, A. (2026) · Scientific Reports · doi:10.1038/s41598-026-59412-y
Robust Transcription Factor Binding Site Prediction and Explainability Using a Heterogeneous Mixture of Experts Architecture
Tripathi, A. G., Nielsen, I. E., Umer, M., Ramachandran, R. P., & Rasool, G. (2026) · Mathematics · doi:10.3390/math14142489
A Neural-Symbolic Approach to Automated Essay Scoring: Integrating BERT and Hidden Markov Models for Interpretable Assessment
Amin, A. E. (2026) · Journal of Advances in Information Technology · doi:10.12720/jait.17.6.1177-1187
If attention scaled intelligence, can it scale morality?
Bombaerts, G. J. T., Delisse, B., & Kaymak, U. (2026) · AI and Ethics · doi:10.1007/s43681-026-01239-4
Explainable 3D vision transformer framework for detecting brain anomalies in neuropsychiatric subtypes of Parkinson's disease
Jiménez-Farfán, C., Constantine-Macías, A., León, I., Pisco-Jordán, J., Ramos-Pozo, L., Peláez, E., Tapia-Rosero, A., Añazco, E. V., Obeso, I., Chonillo, A. B., et al. (2026) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2026.1810223
Do deep chest X-ray classifiers explain where they look? A multi-architecture faithfulness benchmark with false-positive attribution audit on VinDr-CXR
Zain, S. M., Mahamud, E., Assaduzzaman, M., Fahad, N., & Liew, T. H. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100431
See/Saw: Embodied Probing of Vision Transformer Attention in Virtual Reality
Xie, Z., & Lin, S. (2026) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3799825.3818748
GRAD: Gradient-based Robustness Audit for Multimodal Diffusion Models
He, Z., Wang, Y., Pan, Z., & Ying, Z. (2026) · International Conference on Big Data and Privacy Computing (BDPC) · doi:10.1109/bdpc69980.2026.11608049
Adversarial Robustness and Explainability in AI-Generated Face Detection
Kotov, G., Nakov, P., & Nakov, O. (2026) · International Conference on Engineering, Technologies and Systems (TechSys) · doi:10.3390/engproc2026150052
A Comparative Performance and Explainability Study of ConvNeXt and Swin Transformer Models for Skin Lesion Classification
Abhyankar, J., & Pacharaney, U. (2026) · IEEE International Conference on Intelligent Technologies for a Sustainable and Inclusive Future (ICITSIF) · doi:10.1109/icitsif69060.2026.11608442
Understanding Optical and SAR Feature Interactions through Explainable Transformer-Based Fusion Models*
Salee, A., Kumaran, S., Rama, P., Kalaivani, J., & Angayarkanni, V. (2026) · International Conference on Intelligent Technologies (CONIT) · doi:10.1109/conit69683.2026.11621670
Brix Index and Anthocyanin Prediction in Grapes Using Multispectral Imaging with MobileViT: An Application Case From Edge to Cloud and MLOps
Chowdhury, A. G., Niemann, S., Smith, A., & Atzmueller, M. (2026) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm71479.2026.00061
Towards Concept-Based Explanations in Vision–Language Models
Voicu, L.-L., Negru, V.-A., Lemnaru, C., & Potolea, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31927-2_40
An Explainable Fuzzy Based Approach for Embeddings in Generative AI Transformer Models
Makar, J., Hagras, H., Andreu-Pérez, J., Payton, S., & Golden, T. (2026) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz69877.2026.11626397
LiteViT-CAM: A Lightweight and Intrinsically Explainable Framework for Realtime Clinical Video Analysis on Edge Devices
Thota, G., Nagaraju, K., Korra, S. B., & Pulabaigari, V. (2026) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw68408.2026.00038
Artificial Intelligence Applications in Pathology
Ercan, A. T., & Güzeliş, İ. (2026) · Springer eBooks · doi:10.1007/978-3-032-24420-8_20
A Method for Privacy-Preserving and Explainable Facial Emotion Recognition by Means of Vision Transformer
Lucarelli, J., Cesarelli, M., Santone, A., Martinelli, F., Niro, F., Renzo, M. D., & Mercaldo, F. (2026) · International Conference on Revolutionary Artificial Intelligence and Future Applications (Rev-AI) · doi:10.1109/rev-ai70456.2026.11622055
Neural Correlates of Visual Saliency: Do AI Explanation Methods Align with Human Visual Cortex?
Kadam, S. A., Dhule, V., Karkun, J., Katore, H., & Pathare, P. (2026) · International Conference on Inventive Computation and Information Technologies (ICICIT) · doi:10.1109/icicit69063.2026.11634140
Enhancing Lung Cancer Detection with Vision Transformers
Shyam, R., Chaturvedi, M., & Kumar, D. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-29325-1_8
A Rationale-Conditioned Image-Contrast Audit of OCT Dependence in Vision-Language Models for Anti-VEGF Treatment-Response Prediction
Jang, W., Jo, G. Y., Lee, S. Y., Yoon, S. J., Lee, G. Y., Lee, H.-E., Kim, T. H., Baek, J. W., & Kim, J. H. (2026) · Bioengineering · doi:10.3390/bioengineering13080912
Evolutionary Feature Construction for Tabular Transformers via Gradient-Enhanced Attention Rollout
Byun, H. J., Yook, J., Koo, H., & Moon, B.-R. (2026) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3795101.3805282
Self Explaining Vision Transformer using Large Language Models for Trustworthy Image Classification
Thangavelu, K., Yakkanti, B., Gajendran, R., Surampudi, Y., Selvaraj, A., & Bharath Kumara, J. (2026) · International Conference on Intelligent and Sustainable AI Systems (ICOSAAS) · doi:10.1109/icosaas68663.2026.11649134
Shape Descriptors for Image Classification: A Survey of Feature Representation and Learning Approaches
Neethu, C. T., Mary, L., & Thampi, L. L. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10768-4
A generalizability analysis framework for bias resilience in convolution neural network and transformer models for diabetic retinopathy screening
Kazmi, M., Imran, B., Qazi, S. A., & Siddiqui, M. A. R. (2026) · PLoS ONE · doi:10.1371/journal.pone.0351225
Vision-Language Models for medical imaging: A survey on anomaly detection and multimodal applications
Arzu, G. E., Umar, M., Fayaz, M., Ali, U., Dang, L. M., & Moon, H. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116901
Hybrid Convolutional, Transformer and Physics-Encoding Networks for Multiphase Flow Pattern Identification in Vertical Pipelines
Brantson, E. T., Abdulkadir, M., Yeboah, R., Abakah, E. K., Otubuah, E. W., & Afirim, M. L. (2026) · Fluids · doi:10.3390/fluids11090210
A Universal Transformer-Based Algorithm for Rain Estimation Using Commercial Microwave Links Across Different Sampling Intervals
Machlev, B., Habi, H. V., Messer, H., & Ostrometzky, J. (2026) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2026.3726261
A Feasibility Study of Concept-Based XAI Classification Methods on Chart Images
Knize, J., Davila, K., & Song, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36207-0_5
Lightweight deep learning models for histopathological image analysis in resource-constrained healthcare environments
Ahmed, A. A., Adeshina, S. A., Aleshinloye, Y. A., Ogundokun, R. O., & Owolawi, P. A. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100475
Layer-Wise Suppressors for ViT Interpretation
Babiker, H. K. B., Rahman, M. A., Kim, M.-Y., & Goebel, R. G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37664-0_24
Vision Transformer (ViT) Based Image Recognition with Explainable AI & Self-Supervised Pretraining
Sarika, N., Jyoshna, A., Ajmat, M., & Lalitha, B. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20269001018
XViT-Net: An Explainable Self-Supervised Vision Transformer Framework for Image Recognition
Thilagavathi, P., Kumar, P., Kumar, P., & Kumar, G. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20269001016
Explainable AI for Image Classification Errors Using Grad-CAM and Attention Metrics
Kour, M., Jain, N., Gupta, N., & Verma, B. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-30438-4_16
Comparative Evaluation of Image Classification Architectures for Surti Buffalo Muzzle Recognition With CAM-Based Explainability Analysis
Khalid, F., Singh, R. R., Mustaffa, M. R., Ahlawat, T. R., Sankanur, M., Agrawal, A., & Ghorpade, P. P. (2026) · Journal of Intelligent Media Computing · doi:10.47836/jimc.1.1.03
DINOv2-Pretrained Vision Transformers for Stroke and Heart Failure Detection from Chest X-rays with Limited Labeled Data
Tsai, M.-H., Veda, J., Leu, J., & Tsai, C. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02133-5
A Fine-Grained Semantic Steganography Framework with Cross-Modal Drift Regularization
Alrawashdeh, K. (2026) · Mathematics · doi:10.3390/math14183285
Explainable AI for clove quality grading: Benchmarking post hoc XAI and compositional interpretability under domain shift
Nyalala, I., & Ndowo, P. V. (2026) · ETRI Journal · doi:10.4218/etrij.2026-0225
ASAP: Visual analytics for identifying and analyzing image patterns in AI-generated images
Huang, J., Ueno, Y., Chen, C., Mishra, A., Kwon, B. C., Liu, Z., & Bryan, C. (2026) · Information Visualization · doi:10.1177/14738716261481077 · Cited by 7
The Evolution of Vision Transformers: A Multi‐Dimensional Analysis of Architectural Innovation and Application Domains
Tyagi, S., Rawat, P., Yadav, D., & Upadhyay, P. (2026) · Expert Systems · doi:10.1111/exsy.70422
SCIMITAR: Spatially interpretable Cross-Architecture IoT malware detection via multi-head attention transformers
Nauman, M., & Khan, S. R. (2026) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2026.102291
An Image-Based Approach for Grape Yield Estimation During Mechanical Harvesting Using Pre-Trained Visual Embeddings
Vitali, G., Terzi, F., Arru, M., Pelusi, F., Fragassa, C., Gatti, M., & Mattetti, M. (2026) · AgriEngineering · doi:10.3390/agriengineering8090402
A comparative evaluation of explainable AI techniques across CNN and vision transformer architectures for mango leaf disease detection
Prabhu, O., Manoj, T., & Shetty, S. (2026) · Systems Science & Control Engineering · doi:10.1080/21642583.2026.2734417
ARFU-IDS: Robust Federated Unlearning for Transformer-Based Intrusion Detection in IoT and Sensor Networks
Yang, X., Zhang, Z., Li, Q., Jing, Z., Lu, X., Zhang, Y., & Chen, J. (2026) · Sensors · doi:10.3390/s26185911
Artificial intelligence in food bioactive peptide discovery: An integrated dual-workflow for predictive screening and generative design, advances, challenges, and future directions
Li, X., Gao, J., Xia, X., Cao, W., Lin, H., Zheng, H., & Zheng, Z. (2026) · Food Bioscience · doi:10.1016/j.fbio.2026.110064
DGC-CSWin: Dynamic Global Context-Enhanced CSWin for Fine-Grained Food Image Recognition
Guo, Y., & Xiao, Z. (2026) · Applied Sciences · doi:10.3390/app16199616
Uncertainty-aware and interpretable deep learning in cytopathology: toward trustworthy AI-powered diagnostics
Mehmood, S., Hussain, M., & Khan, M. A. (2026) · Archiv für Pathologische Anatomie und Physiologie und für Klinische Medicin · doi:10.1007/s00428-026-04727-4
Wildfire Detection in Satellite Imagery via Weakly Supervised Contrastive Learning
Haranaka, J., Marcato, J., Gonçalves, W., Ribas, L. C., Matsubara, E. T., & Silva, J. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39904-5_24
SPARTA: Sparse Patch Attack for Revealing Transformer Attention Vulnerabilities
Thanh, T. D., Pham, T. T. T., & Doan, H.-G. (2026) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.20412
From Saliency Maps to Circuits: An Integrative Survey of Explainable AI and Mechanistic Interpretability
Dugăeșescu, A., & Florea, A. M. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8100315
Explainable Multimodal Brain Tumor Classification via Co-Attention Gated Fusion
Syed, A. A., & kumar, K. R. V. G. (2026) · International Conference on Soft Computing for Security Applications (ICSCSA) · doi:10.1109/icscsa69367.2026.11708114
Learning to Walk the Right Paths: Task-Responsive Graph Reasoning for Multimodal Inference
Li, X., Jia, W., & Zheng, Y. (2026) · doi:10.1109/cvprf71909.2026.00580
MSGLF-Refine: Text-Guided Global–Local Fusion with Adaptive Gating for Fine-Grained Crisis Information Mining
Zhang, Y., Li, S., Pan, Z., Liu, Q., & Li, G. (2026) · Applied Sciences · doi:10.3390/app16199951
Transformer-Based Spatiotemporal Modelling of EEG Signals for Early Alzheimer’s Diagnosis
Premnath, K. N., Pandiaraj, S., Abbi, K., & Swedha, V. (2026) · International Conference on Computer, Mechatronics, Robotics & Artificial Intelligence (ICCMRAI) · doi:10.1109/iccmrai67732.2026.11723554
A ViT–CNN hybrid generative framework for ultrasound image enhancement with paired supervision
Choi, Y., Yoo, M., Park, J., & Ahn, C. Y. (2026) · Biomedical Engineering Letters · doi:10.1007/s13534-026-00621-9
A multi-feature dueling DDQN model for robust and interpretable malware detection
Gopi, A. P., Naik, K. J., Rao, K. S., & Challa, R. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08895-7
GLM-Based: CAM Based on Gradient Local Mean for Enhanced Explainability in Visual Transformer
Wang, K., Ren, Y., Kong, L., & Zhang, Z. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11730048
HCG-Vit: A Hierarchical Cooperative Game Approach for Interpreting Remote Sensing Vision Transformers
Zhu, K., Qiu, S., Shi, K., Liu, S., You, Y., & Qiao, Y. (2026) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss60577.2026.11730450
Grounded Self-Attention an Multi-Head Attention: A Quantitative Study of Whether Attention Explains Sentiment Predictions
Kochery, S. T., Das, D., & Kanna, R. R. (2026) · International Conference on Next-Gen Intelligent Computing and Applications (ICONICA) · doi:10.1109/iconica70605.2026.11736848
Explainable CNN-Transformer hybrid deep learning for weld defect detection in structural connections
JungHoon, S., Helwig, T. A., & Salamone, S. (2026) · NDT & E International · doi:10.1016/j.ndteint.2026.103921
Spatially Grounded Neurosymbolic AI for Explainable Retinal Disease Classification From OCT Images
Inferrera, L., Biscontin, A., Ajčević, M., Accardo, A., Drigo, A., Tognetto, D., & Miladinović, A. (2026) · Translational Vision Science & Technology · doi:10.1167/tvst.15.10.36
Light-Weight Transformer Layers and Prediction Consistency Loss for Source-Free Unsupervised Domain Adaptation
Kim, Y., & Lee, G. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.115176
An Interpretable MobileViT Framework for Attention-Guided Plant Disease Classification on Edge Devices
Ataş, İ. (2026) · International Artificial Intelligence and Data Processing Symposium (IDAP) · doi:10.1109/idap71869.2026.11728180

Authors: Chefer, H., Gur, S., & Wolf, L.
Affiliations: Tel Aviv University (IL)
ORCID: Chefer, Hila
Wolf, Lior
Venue: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher: IEEE
Published: 2021-06
Pages: 782-791
ISSN: 1063-6919 (ISSN-L)
DOI: 10.1109/cvpr46437.2021.00084
OpenAlex: W3112516115
Cited by: 903
References: 52
Citations by year: 2026: 185 · 2025: 226 · 2024: 193 · 2023: 178 · 2022: 90 · 2021: 31
FWCI: 56.82
Type: conference paper
Language: en
Open access: green
arxiv.org
Licence: cc-by
ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
arXiv (Cornell University) (submittedVersion, cc-by)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University) (cc-by)
Funders: European Research Council
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords: transformer interpretability, vision transformer, attention visualization, local relevance, relevance propagation, attention layers, skip connections, explainable AI, text classification, image classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Transformer Interpretability Beyond Attention Visualization

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks