The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.
Transformer Interpretability Beyond Attention Visualization
Open accessAbstract
Self-attention techniques, and specifically Transformers, are dominating the field of text processing and are becoming increasingly popular in computer vision classification tasks. In order to visualize the parts of the image that led to a certain classification, existing methods either rely on the obtained attention maps or employ heuristic propagation along the attention graph. In this work, we propose a novel way to compute relevancy for Transformer networks. The method assigns local relevance based on the Deep Taylor Decomposition principle and then propagates these relevancy scores through the layers. This propagation involves attention layers and skip connections, which challenge existing methods. Our solution is based on a specific formulation that is shown to maintain the total relevancy across layers. We benchmark our method on very recent visual Transformer networks, as well as on a text classification problem, and demonstrate a clear advantage over the existing explainability methods. Our code is available at: https://github.com/hila-chefer/Transformer-Explainability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Research works printed but not linked: 3
- radford, 2019, Language Models are Unsupervised Multitask Learners
- erhan, 2009, Visualizing higher-layer features of a deep network, University of Montreal, 1341, 1
- 10.1109/ICCV.2019.00304 · DOI
Cited by
Sorted by citations
Items 301–400 of 903
DoA-ViT: Dual-objective Affine Vision Transformer for Data Insufficiency
Ren, Q., & Wang, J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128896 · Cited by 10
Masri, S., Hasasneh, A., Tami, M. A., & Tadj, C. (2024) · Information · doi:10.3390/info15120751 · Cited by 10
Visualizing Paired Image Similarity in Transformer Networks
Black, S., Stylianou, A., Pless, R. B., & Souvenir, R. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00160 · Cited by 11
Rasoulian, A., Salari, S., & Xiao, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17899-3_7 · Cited by 10
Dual-Feature Aggregation Network for No-Reference Image Quality Assessment
Chen, Y., Chen, Z., Yu, M., & Tang, Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-27077-2_12 · Cited by 10
Explainability of Speech Recognition Transformers via Gradient-Based Attention Visualization
Sun, T., Chen, H., Hu, G., He, L., & Zhao, C. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3282488 · Cited by 9
Center-bridged Interaction Fusion for hyperspectral and LiDAR classification
Huo, L., Xia, J., Zhang, L., Zhang, H., & Xu, M. G. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127757 · Cited by 9
Interpretable Machine Learning for TabPFN
Rundel, D., Kobialka, J., von Crailsheim, C., Feurer, M., Nagler, T., & Rügamer, D. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63797-1_23 · Cited by 9
Li, J., Gong, R., & Wang, G. (2024) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.07.068 · Cited by 9
Understanding Video Transformers via Universal Concept Discovery
Kowal, M. D., Dave, A., Ambruş, R., Gaidon, A., Derpanis, K. G., & Tokmakov, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01041 · Cited by 9
Vision transformer introduces a new vitality to the classification of renal pathology
Zhang, J., Lu, J. D., Chen, B., Pan, S., Jin, L., Zheng, Y., & Pan, M. (2024) · BMC Nephrology · doi:10.1186/s12882-024-03800-x · Cited by 9
Unveiling spatiotemporal patterns of wildfire risk: a transformer-based earth system analysis
Zhu, J., Liu, X., Cheng, P., Wang, M., & Huang, Y. J. (2024) · Climate Dynamics · doi:10.1007/s00382-024-07481-y · Cited by 9
Do Transformers and CNNs Learn Different Concepts of Brain Age?
Siegel, N. T., Kainmueller, D., Deniz, F., Ritter, K., & Schulz, M.-A. (2025) · Human Brain Mapping · doi:10.1002/hbm.70243 · Cited by 12
Zhong, Z., Zhang, H., Ozaki, J., Zhou, Y., Zhao, X., Dan, D., & Wang, C. (2025) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2025.130791 · Cited by 9
Blaha, L. M., Abrams, M., Bibyk, S., Bonial, C., Hartzler, B. M., Hsu, C. D., Khemlani, S., King, J. M., Amant, R. S., Trafton, J. G., et al. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.800280 · Cited by 17
Understanding microbiome dynamics via interpretable graph representation learning
Melnyk, K., Weimann, K., & Conrad, T. (2023) · Scientific Reports · doi:10.1038/s41598-023-29098-7 · Cited by 8
Self-Supervised Learning for Seismic Data: Enhancing Model Interpretability With Seismic Attributes
Salazar, J. J., Maldonado-Cruz, E., Ochoa, J., & Pyrcz, M. J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3285820 · Cited by 10
Bui-Thi, D., Liu, Y., Lippens, J. L., Laukens, K., & Vijlder, T. D. (2024) · Journal of Cheminformatics · doi:10.1186/s13321-024-00858-5 · Cited by 9
Peer, M., Kleber, F., & Sablatnig, R. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21648-0_9 · Cited by 9
Cervical cell classification based on attention mechanism and multi-resolution feature fusion
Yu, J., Wang, G., & Cheng, S. (2022) · International Conference on Information Science, Parallel and Distributed Systems (ISPDS) · doi:10.1109/ispds56360.2022.9874093 · Cited by 9
Kasukurthi, A., & Davuluri, R. L. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19360-z · Cited by 8
Suh, J., Kim, J., Kwon, S., Jung, E., Ahn, H., Lee, K.-Y., Choi, E., & Rhee, W. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109088 · Cited by 9
Prototype-guided cross-task knowledge distillation
Li, D., Li, P., Wu, A., & Han, Y. (2025) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.2400383 · Cited by 12
Prompt-CAM: Making Vision Transformers Interpretable for Fine-Grained Analysis
Chowdhury, A. R., Paul, D., Mai, Z., Gu, J., Zhang, Z., Mehrab, K. S., Campolongo, E., Rubenstein, D. I., Stewart, C. V., Karpatne, A., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00413 · Cited by 8
Milyani, A. H., & Attar, E. T. (2025) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2025.1668935 · Cited by 9
Husnain, G., Ali, A. B. M., Khan, A., Junaid, A., Usman, M., Awwad, E. M., & Telba, A. A. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3643884 · Cited by 10
Djoumessi, K., Mensah, S. O., & Berens, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-17611-0_11 · Cited by 8
Agarwal, S., Raj, A., Chowdhury, A., Aich, G., Chatterjee, R., & Ghosh, K. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17962-7 · Cited by 11
C2F-Explainer: Explaining Transformers Better Through a Coarse-to-Fine Strategy
Ding, W., Cheng, X., Geng, Y., Huang, J., & Ju, H. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3443888 · Cited by 11
Barkan, O., Elisha, Y., Weill, J., Asher, Y., Eshel, A., & Koenigstein, N. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614836 · Cited by 10
Yeganeh, Y., Farshad, A., Weinberger, P., Ahmadi, S., Adeli, E., & Navab, N. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00244 · Cited by 9
Park, S. J., Kim, G., Oh, Y., Seo, J. B., Lee, S. M., Kim, J. H., Moon, S.-J., Lim, J., & Ye, J. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07235 · Cited by 8
Explainable Connectionist-Temporal-Classification-Based Scene Text Recognition
Buoy, R., Iwamura, M., Srun, S., & Kise, K. (2023) · Journal of Imaging · doi:10.3390/jimaging9110248 · Cited by 10
DIML: Deep Interpretable Metric Learning via Structural Matching
Zhao, W., Rao, Y., Zhou, J., & Lu, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3336668 · Cited by 8
Han, C., Yang, T., Cui, Z., & Sun, X. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3583764 · Cited by 8
TransCNN: A Hybrid Framework for Aircraft Wake Vortex Detection and Safety Interval Assessment
Deng, L., Pan, W., Zhao, P., Chen, K., & Wang, X. (2025) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2025.3578555 · Cited by 7
LRP-QViT: Mixed-Precision Vision Transformer Quantization Using Layer Importance Score
Ranjan, N., & Savakis, A. E. (2025) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/dsp65409.2025.11075195 · Cited by 8
Enhancing Descriptive Image Quality Assessment With a Large-Scale Multi-Modal Dataset
You, Z., Gu, J., Cai, X., Li, Z., Zhu, K., Dong, C., & Xue, T. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3639998 · Cited by 82
Explainability of vision transformers: a comprehensive review and new perspectives
Kashefi, R., Barekatain, L., Sabokrou, M., & Aghaeipoor, F. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21313-7 · Cited by 10
Zhang, G., & Abdulla, W. H. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.113947 · Cited by 11
Uncertainty Estimation in Unsupervised MR-CT Synthesis of Scoliotic Spines
Karthik, E. N., Farida Cheriet, A., & Laporte, C. (2023) · IEEE Open Journal of Engineering in Medicine and Biology · doi:10.1109/ojemb.2023.3262965 · Cited by 7
Attention-Guided Deep Learning Framework For Movement Quality Assessment
Kanade, A., Sharma, M., & Manivannan, M. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095031 · Cited by 9
Alam, M. U., Hollmén, J., Baldvinsson, J. R., & Rahmani, R. (2023) · Nordic Machine Intelligence · doi:10.5617/nmi.10471 · Cited by 8
Calligraphy Font Generation via Explicitly Modeling Location-Aware Glyph Component Deformations
Zhao, M., Qi, X., Hu, Z., Li, L., Zhang, Y., Huang, Z. H., & Yu, X. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3342690 · Cited by 7
Modeling Visual Impairments with Artificial Neural Networks: a Review
Schiatti, L., Gori, M., Schrimpf, M., Cappagli, G., Morelli, F., Signorini, S. G., Katz, B., & Barbu, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00213 · Cited by 7
Automated Diagnosis of Alzheimer’s Disease Using OCT and OCTA: A Systematic Review
Turkan, Y., Faik Boray, T. E. K., Arpaci, F., Arslan, O., Toslak, D., Bulut, M., & Yaman, A. (2024) · IEEE Access · doi:10.1109/access.2024.3434670 · Cited by 14
Towards Explainable Visual Vessel Recognition Using Fine-Grained Classification and Image Retrieval
Karus, H., Schwenker, F., Münz, M., & Teutsch, M. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00013 · Cited by 7
AttExplainer: Explain Transformer via Attention by Reinforcement Learning
Niu, R., Wei, Z., Wang, Y., & Wang, Q. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/102 · Cited by 7
Fine-Grained Visual Entailment
Thomas, C., Zhang, Y., & Chang, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20059-5_23 · Cited by 7
Ding, K., Chen, S., Zeng, Y., Wang, Y., & Yan, X. (2023) · Applied Sciences · doi:10.3390/app13031815 · Cited by 7
Prediction With Visual Evidence: Sketch Classification Explanation via Stroke-Level Attributions
Liu, S., Li, J., Zhang, H., Xu, L., & Cao, X. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3297404 · Cited by 7
D3Former: Debiased Dual Distilled Transformer for Incremental Learning
Mohamed, A., Grandhe, R., Joseph, K. J., Khan, S. H., & Khan, F. S. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00240 · Cited by 9
Similarity Maps for Self-Training Weakly-Supervised Phrase Grounding
Shaharabany, T., & Wolf, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00669 · Cited by 7
Self-citationMallick, R., Benois‐Pineau, J., & Zemmari, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53302-0_9 · Cited by 7
Vukadin, D., Afrić, P., Šilić, M., & Delač, G. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3649458 · Cited by 7
FovEx: Human-Inspired Explanations for Vision Transformers and Convolutional Neural Networks
Panda, M. P., Tiezzi, M., Vilas, M. G., Roig, G., Eskofier, B. M., & Zanca, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02543-y · Cited by 6
Multi-regional control of amygdalar dynamics reliably reflects fear memory age
Makino, Y., Wang, Y., & McHugh, T. J. (2024) · Nature Communications · doi:10.1038/s41467-024-54273-3 · Cited by 6
Vision Transformers for Counterfeit IC Detection
Bhure, C., Aklekar, D. V., Che, W., & Saqib, F. (2024) · IEEE Physical Assurance and Inspection of Electronics (PAINE) · doi:10.1109/paine62042.2024.10792793 · Cited by 6
ABIET: An explainable transformer for identifying functional groups in biological active molecules
Pereira, T., Abbasi, M., & Arrais, J. P. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109740 · Cited by 6
Denoised and Dynamic Alignment Enhancement for Zero-Shot Learning
Ge, J., Liu, Z., Li, P., Xie, L., Zhang, Y., Tian, Q. C., & Xie, H. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3544481 · Cited by 6
Gong, X., Tian, B., Xue, M., Wu, Y. L., Chen, Y., & Wang, Q. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3548970 · Cited by 7
Towards Understanding How Knowledge Evolves in Large Vision-Language Models
Wang, S., Zhang, Y., Zhu, Y. T., Li, J., Wang, Z., Liu, Y., & Ji, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02779 · Cited by 6
Şeker, D., & Yildiz, A. (2025) · Diagnostics · doi:10.3390/diagnostics15182354 · Cited by 6
Few-Shot Adaptation of Foundation Vision Models for PCB Defect Inspection
Lee, S.-J. (2025) · Journal of Imaging · doi:10.3390/jimaging11110415 · Cited by 6
CGA: Curvature-Guided Attention for Remote Sensing Image Super-Resolution
Aslam, M. W., REHMAN, S. U., Tayyab, A. M. M., Hamza, M., Li, X., & Yao, L. (2026) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2026.3661098 · Cited by 6
Video-based cattle behaviour detection for digital twin development in precision dairy systems
Rao, S., Garcia, E. R. M., & Neethirajan, S. R. (2026) · npj Veterinary Sciences · doi:10.1038/s44433-026-00004-x · Cited by 9
OCIE: Augmenting model interpretability via Deconfounded Explanation-Guided Learning
Dong, L., Chen, L., Zheng, C., Fu, Z., Zukaib, U., Cui, X., & Shen, Z. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112390 · Cited by 6
Distributed Data Privacy Protection via Collaborative Anomaly Detection
Zeng, F., Wang, M., Pan, Y., Lyu, S., Miao, H., Han, H., & Yuan, X. (2025) · Electronics · doi:10.3390/electronics14020295 · Cited by 7
Identifying somatic driver mutations in cancer with a language model of the human genome
Zeng, G., Zhao, C., Li, G., Huang, Z., Zhuang, J., Liang, X., Yu, X., & Fang, S. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.01.011 · Cited by 6
Zhao, J., Duan, J., Qiao, L., He, T., Shi, X., & Yan, B. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07003-5 · Cited by 6
Not all temporal shift modules are profitable
Zhang, Y., Li, Y., Guo, S., & Liang, Q. (2022) · Journal of Electronic Imaging · doi:10.1117/1.jei.31.4.043030 · Cited by 6
Decker, T. W., Gross, R., Koebler, A., Lebacher, M., Schnitzer, R., & Weber, S. H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35891-3_13 · Cited by 7
Adversarial Normalization: I Can visualize Everything (ICE)
Choi, H.-Y., Jin, S., & Han, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01166 · Cited by 6
WegFormer : Transformers for weakly supervised semantic segmentation
Liu, C., & Li, G. (2023) · Expert Systems · doi:10.1111/exsy.13495 · Cited by 6
Machmeier, S., Hoecker, M., & Heuveline, V. (2023) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci52147.2023.10371980 · Cited by 6
ExpPoint-MAE: Better Interpretability and Performance for Self-Supervised Point Cloud Transformers
Romanelis, I., Fotis, V., Μουστάκας, Κ., & Munteanu, A. (2024) · IEEE Access · doi:10.1109/access.2024.3388155 · Cited by 7
R-Cut: Enhancing Explainability in Vision Transformers with Relationship Weighted Out and Cut
Niu, Y., Ding, M., Ge, M., Karlsson, R., Zhang, Y., Carballo, A., & Takeda, K. (2024) · Sensors · doi:10.3390/s24092695 · Cited by 9
Multi-Layer Attention-Based Explainability via Transformers for Tabular Data
Gavito, A. T., Klabjan, D., & Utke, J. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00010 · Cited by 6
Explainability Enhanced Object Detection Transformer With Feature Disentanglement
Yu, W. W. H., Liu, R., Chen, D., & Hu, Q. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3492733 · Cited by 5
Irrelevant Patch-Masked Autoencoders for Enhancing Vision Transformers under Limited Data
Ren, Q., & Wang, J. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112936 · Cited by 5
Explainability of Protein Deep Learning Models
Fazel, Z., de Souza, C. P. E., Golding, G. B., & Ilie, L. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26115255 · Cited by 5
Cheng, X., Ding, W., Huang, J., Ju, H., Zhou, T., Guo, J., & Witold Pedrycz, C. (2025) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2025.3583819 · Cited by 7
G 2 V 2 former: Graph Guided Video Vision Transformer for Face Anti-Spoofing
Yang, J., Yu, Z., Jia, H., Ni, X., Zhang, L., Li, H., & Cao, X. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3586506 · Cited by 10
Ouyang, C., Liu, H., Ma, T., Xu, S., & Xi, X. (2025) · Physics of Fluids · doi:10.1063/5.0278647 · Cited by 5
A Multimodal Voice Phishing Detection System Integrating Text and Audio Analysis
Kim, J., Gu, S., Kim, Y.-M., Lee, S., & Kang, C. (2025) · Applied Sciences · doi:10.3390/app152011170 · Cited by 5
Wang, Y., Huang, H., Hao, R., Luo, L., & He, H.-D. (2025) · Technologies · doi:10.3390/technologies13110493 · Cited by 5
PiPViT: Patch-based Visual Interpretable Prototypes for retinal image analysis
Oghbaie, M., Araújo, T., Reiter, G. S., & Bogunović, H. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.109545 · Cited by 5
Zuo, X., Zhao, N., Wang, K., & Hu, J. (2026) · Micromachines · doi:10.3390/mi17020192 · Cited by 5
Mancazzo, V., Sibilano, E., Buongiorno, D., Carli, R., Bevilacqua, V., & Brunetti, A. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.109811 · Cited by 9
Explainable AI-based analysis of human pancreas sections identifies traits of type 2 diabetes
Klein, L., Ziegler, S., Gerst, F., Morgenroth, Y., Gotkowski, K., Schöniger, E., Heni, M., Kipke, N., Friedland, D., Seiler, A., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-69295-2 · Cited by 6
Evaluating the Explainability of Vision Transformers in Medical Imaging
Barekatain, L., & Glocker, B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-17611-0_10 · Cited by 5
B-Cos Aligned Transformers Learn Human-Interpretable Features
Tran, M., Lahiani, A., Cid, Y. D., Boxberg, M., Lienemann, P., Matek, C., Wagner, S. J., Theis, F. J., Klaiman, E., & Peng, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43993-3_50 · Cited by 5
Empathy Intent Drives Empathy Detection
Jiang, L., Wu, D., Mao, B., Li, Y., & Slamu, W. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.386 · Cited by 5
Layer-Wise Relevance Propagation with Conservation Property for ResNet
Otsuki, S., Iida, T., Doublet, F., Hirakawa, T., Yamashita, T., Fujiyoshi, H., & Sugiura, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72775-7_20 · Cited by 8
Syed, T. A., Nauman, M., Khan, S. R., Jan, S., & Zuhairi, M. F. (2024) · Sensors · doi:10.3390/s24206690 · Cited by 6
Kapuria, S., Ikoma, N., Chinchali, S., & Alambeigi, F. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110633 · Cited by 5
Li, Z., Wang, Y., Qiang, W., Wu, X., Zhang, Y., Gu, Y., Chen, K., Qi, D., Xiu, L., Sun, Y., et al. (2025) · Research · doi:10.34133/research.0711 · Cited by 6
TrueType Transformer: Character and Font Style Recognition in Outline Format
Nagata, Y., Otao, J., Haraguchi, D., & Uchida, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-06555-2_2 · Cited by 5
Facial Expression Recognition: One Attention-Modulated Contextual Spatial Information Network
Li, X., Zhu, C., & Zhou, F. (2022) · Entropy · doi:10.3390/e24070882 · Cited by 5
More Than Accuracy: An Empirical Study of Consistency Between Performance and Interpretability
Du, Y., Liang, D., Quan, R., Ду, С., & Yan, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20868-3_43 · Cited by 5
Metadata
- Authors
- Chefer, H., Gur, S., & Wolf, L.
- Affiliations
- Tel Aviv University (IL)
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 782-791
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3112516115
- Cited by
- 903
- References
- 52
- Citations by year
- 2026: 185 · 2025: 226 · 2024: 193 · 2023: 178 · 2022: 90 · 2021: 31
- FWCI
- 56.82
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- European Research Council
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- transformer interpretability, vision transformer, attention visualization, local relevance, relevance propagation, attention layers, skip connections, explainable AI, text classification, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review