The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.
Transformer Interpretability Beyond Attention Visualization
Open accessAbstract
Self-attention techniques, and specifically Transformers, are dominating the field of text processing and are becoming increasingly popular in computer vision classification tasks. In order to visualize the parts of the image that led to a certain classification, existing methods either rely on the obtained attention maps or employ heuristic propagation along the attention graph. In this work, we propose a novel way to compute relevancy for Transformer networks. The method assigns local relevance based on the Deep Taylor Decomposition principle and then propagates these relevancy scores through the layers. This propagation involves attention layers and skip connections, which challenge existing methods. Our solution is based on a specific formulation that is shown to maintain the total relevancy across layers. We benchmark our method on very recent visual Transformer networks, as well as on a text classification problem, and demonstrate a clear advantage over the existing explainability methods. Our code is available at: https://github.com/hila-chefer/Transformer-Explainability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Research works printed but not linked: 3
- radford, 2019, Language Models are Unsupervised Multitask Learners
- erhan, 2009, Visualizing higher-layer features of a deep network, University of Montreal, 1341, 1
- 10.1109/ICCV.2019.00304 · DOI
Cited by
Sorted by citations
Han (2023) · doi:10.1109/tpami.2022.3152247 · Cited by 4,682
Transformers in Vision: A Survey
Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595
Transformers in medical imaging: A survey
Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102802 · Cited by 1,523
A foundation model for generalizable disease detection from retinal images
Zhou, Y., Chia, M. A., Wagner, S. K., Ayhan, M. S., Williamson, D. J., Struyven, R. R., Liu, T., Xu, M., Lozano, M. G., Woodward-Court, P., et al. (2023) · Nature · doi:10.1038/s41586-023-06555-x · Cited by 1,014
Explainability for Large Language Models: A Survey
Zhao, H., Chen, H., Yang, F., Liu, N., Deng, H., Cai, H., Wang, S., Yin, D., & Du, M. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3639372 · Cited by 681
Interpretable deep learning: interpretation, interpretability, trustworthiness, and beyond
Li, X., Xiong, H., Li, X., Wu, X., Zhang, X., Liu, J., Bian, J., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01756-8 · Cited by 579
Advances in medical image analysis with vision Transformers: A comprehensive review
Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.103000 · Cited by 557
TransPose: Keypoint Localization via Transformer
Yang, S., Quan, Z., Nie, M., & Yang, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01159 · Cited by 490
Li, J., Chen, J., Tang, Y., Wang, C., Landman, B. A., & Zhou, S. K. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102762 · Cited by 454
TransFER: Learning Relation-aware Facial Expression Representations with Transformers
Xue, F., Wang, Q., & Guo, G. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00358 · Cited by 346
CLIP-ReID: Exploiting Vision-Language Model for Image Re-identification without Concrete Text Labels
Li, S., Li, S., & Li, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25225 · Cited by 367
DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
Rao, Y., Zhao, W., Liu, B., Lu, J., Zhou, J., & Hsieh, C.-J. (2021) · arXiv · doi:10.48550/arxiv.2106.02034 · Cited by 448
“(c) visualizes the impact of each spatial location on the final prediction in the DeiT-S model [25] using the visualization method proposed in [3].”
MethodGeneric Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers
Chefer, H., Gur, S., & Wolf, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00045 · Cited by 313
Self-citationCTformer: convolution-free Token2Token dilated vision transformer for low-dose CT denoising
Wang, D., Fan, F., Wu, Z., Liu, R., Wang, F., & Yu, H. (2023) · Physics in Medicine and Biology · doi:10.1088/1361-6560/acc000 · Cited by 268
A Graph-Transformer for Whole Slide Image Classification
Zheng, Y., Gindra, R. H., Green, E. J., Burks, E. J., Betke, M., Beane, J. E., & Kolachalama, V. B. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3176598 · Cited by 255
Mersha, M. A., Lâm, K. N., Wood, J., AlShami, A. K., & Kalita, J. K. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128111 · Cited by 346
Survey on Explainable AI: From Approaches, Limitations and Applications Aspects
Yang, W., Wei, Y.-C., Wei, H., Chen, Y., Huang, G., Li, X., Li, R., Yao, N., Wang, X., Gu, X., et al. (2023) · Human-Centric Intelligent Systems · doi:10.1007/s44230-023-00038-y · Cited by 303
Machine learning in point-of-care testing: innovations, challenges, and opportunities
Han, G., Goncharov, A., Eryılmaz, M., Ye, S., Palanisamy, B., Ghosh, R., Lisi, F., Rogers, E., Guzmán, D., Yigci, D., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-58527-6 · Cited by 262
Transformers and large language models in healthcare: A review
Nerella, S., Bandyopadhyay, S., Zhang, J., Contreras, M., Siegel, S., Bumin, A., Silva, B., Sena, J., Shickel, B., Bihorac, A., et al. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102900 · Cited by 281
Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer
Xu, Y., Zhang, Z., Zhang, M., Sheng, K., Li, K., Dong, W., Zhang, L., Xu, C., & Sun, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20202 · Cited by 226
Transformer-based deep learning for predicting protein properties in the life sciences
Chandra, A. A., Tünnermann, L., Löfstedt, T., & Gratz, R. (2023) · eLife · doi:10.7554/elife.82819 · Cited by 202
ISTVT: Interpretable Spatial-Temporal Video Transformer for Deepfake Detection
Zhao, C., Wang, C., Hu, G., Chen, H., Liu, C., & Tang, J. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3239223 · Cited by 184
CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation
Gadre, S. Y., Wortsman, M., Ilharco, G., Schmidt, L., & Song, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02219 · Cited by 278
SPViT: Enabling Faster Vision Transformers via Latency-Aware Soft Token Pruning
Kong, Z., Dong, P., Ma, X., Meng, X., Niu, W., Sun, M., Shen, X., Yuan, G., Ren, B., Tang, H., et al. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20083-0_37 · Cited by 169
Transforming Conversations with AI—A Comprehensive Study of ChatGPT
Bansal, G., Chamola, V., Hussain, A., Guizani, M., & Niyato, D. T. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10236-2 · Cited by 198
POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognition
Zheng, C., Mendieta, M., & Chen, C. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00339 · Cited by 170
SpaText: Spatio-Textual Representation for Controllable Image Generation
Avrahami, O., Hayes, T., Gafni, O., Gupta, S., Taigman, Y., Parikh, D., Lischinski, D., Fried, O., & Yin, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01762 · Cited by 202
Vision Transformer With Attentive Pooling for Robust Facial Expression Recognition
Xue, F., Wang, Q., Tan, Z., Ma, Z., & Guo, G. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3226473 · Cited by 183
Su, Y., Liu, Q., Xie, W., & Hu, P. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106903 · Cited by 167
Jiang, R., Yin, X., Yang, P., Cheng, L., Hu, J., Jiao, Y., Wang, Y., Fu, X., Shang, L., Li, L., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00868-w · Cited by 165
Interpretable machine learning for dementia: a systematic review
Martin, S. A., Townend, F. J., Barkhof, F., & Cole, J. H. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.12948 · Cited by 149
Zhu, H., Lin, M., Xu, Z., Yao, Z., Chen, H., Alhudhaif, A., & Alenezi, F. S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.06.091 · Cited by 142
Abibullaev, B., Keutayeva, A., & Zollanvari, A. (2023) · IEEE Access · doi:10.1109/access.2023.3329678 · Cited by 164
KVT: k-NN Attention for Boosting Vision Transformers
Wang, P., Wang, X., Wang, F., Lin, M., Chang, S., Li, H., & Jin, R. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20053-3_17 · Cited by 142
Transformers in computational visual media: A survey
Xu, Y., Wei, H., Lin, M., Deng, Y., Sheng, K., Zhang, M., Tang, F., Dong, W., Huang, F., & Xu, C. (2021) · Computational Visual Media · doi:10.1007/s41095-021-0247-3 · Cited by 144
xViTCOS: Explainable Vision Transformer Based COVID-19 Screening Using Radiography
Mondal, A. K., Bhattacharjee, A., Singla, P., & Prathosh, A. P. (2021) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2021.3134096 · Cited by 143
Automatic detection of glaucoma via fundus imaging and artificial intelligence: A review
Coan, L. J., Williams, B. M., Adithya, V. K., Upadhyaya, S., Kafri, A. S. A., Czanner, S., Venkatesh, R., Willoughby, C. E., Kavitha, S., & Czanner, G. (2022) · Survey of Ophthalmology · doi:10.1016/j.survophthal.2022.08.005 · Cited by 143
M3T: three-dimensional Medical image classifier using Multi-plane and Multi-slice Transformer
Jang, J., & Hwang, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02006 · Cited by 133
XAIR: A Systematic Metareview of Explainable AI (XAI) Aligned to the Software Development Process
Clement, T., Kemmerzell, N., Abdelaal, M., & Amberg, M. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5010006 · Cited by 131
Towards Faithful Model Explanation in NLP: A Survey
Lyu, Q., Apidianaki, M., & Callison-Burch, C. (2024) · Computational Linguistics · doi:10.1162/coli_a_00511 · Cited by 196
On the Effectiveness of Vision Transformers for Zero-shot Face Anti-Spoofing
George, A., & Marcel, S. (2021) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484333 · Cited by 127
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124
Park, S. J., Kim, G., Oh, Y., Seo, J. B., Lee, S. M., Kim, J. H., Moon, S.-J., Lim, J., & Ye, J. C. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102299 · Cited by 127
Zhang, Q., & Wang, T. (2024) · Remote Sensing · doi:10.3390/rs16081344 · Cited by 136
A closer look at the explainability of Contrastive language-image pre-training
Li, Y., Wang, H., Duan, Y., Zhang, J., & Li, X. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111409 · Cited by 205
A Comprehensive Survey of Transformers for Computer Vision
Jamil, S., Piran, M. J., & Kwon, O. (2023) · Drones · doi:10.3390/drones7050287 · Cited by 128
Hierarchical Frequency-Assisted Interactive Networks for Face Manipulation Detection
Miao, C., Tan, Z., Chu, Q., Yu, N., & Guo, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3198275 · Cited by 117
Huang, P., He, P., Tian, S., Ma, M., Feng, P., Xiao, H., Mercaldo, F., Santone, A., & Qin, J. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3202248 · Cited by 113
A foundation model to predict and capture human cognition
Binz, M., Akata, E., Bethge, M., Brändle, F., Callaway, F., Coda-Forno, J., Dayan, P., Demircan, C., Eckstein, M. K., Éltető, N., et al. (2025) · Nature · doi:10.1038/s41586-025-09215-4 · Cited by 119
FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofing
Liu, A., Tan, Z., Yu, Z., Zhao, C., Wan, J., Liang, Y., Lei, Z., Zhang, D., Li, S. Z., & Guo, G. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3296330 · Cited by 114
Taxonomic classification of DNA sequences beyond sequence similarity using deep neural networks
Mock, F., Kretschmer, F., Kriese, A., Böcker, S., & Marz, M. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2122636119 · Cited by 111
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data
Fu, S., Tamir, N., Sundaram, S., Chai, L., Zhang, R., Dekel, T., & Isola, P. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2208 · Cited by 108
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks
Räuker, T., Ho, A., Casper, S., & Hadfield-Menell, D. (2023) · 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00039 · Cited by 122
Fast aerodynamics prediction of laminar airfoils based on deep attention network
Zuo, K., Ye, Z., Zhang, W., Yuan, X., & Zhu, L. (2023) · Physics of Fluids · doi:10.1063/5.0140545 · Cited by 105
FlexiViT: One Model for All Patch Sizes
Beyer, L., Izmailov, P., Kolesnikov, A., Caron, M., Kornblith, S., Zhai, X., Minderer, M., Tschannen, M., Alabdulmohsin, I., & Pavetic, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01393 · Cited by 132
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification
Xiao, J., Bai, Y., Yuille, A., & Zhou, Z. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00358 · Cited by 110
ZigMa: A DiT-style Zigzag Mamba Diffusion Model
Hu, V. T., Baumann, S. A., Gui, M., Grebenkova, O., Ma, P., Fischer, J., & Ommer, B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72664-4_9 · Cited by 159
A Comprehensive Review of Explainable Artificial Intelligence (XAI) in Computer Vision
Cheng, Z. Q., Wu, Y. P., Li, Y., Cai, L., & Ihnaini, B. (2025) · Sensors · doi:10.3390/s25134166 · Cited by 122
Transformers and genome language models
Consens, M. E., Dufault, C., Wainberg, M., Forster, D., Karimzadeh, M., Goodarzi, H., Theis, F. J., Moses, A. M., & Wang, B. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01007-9 · Cited by 170
Focused Attention in Transformers for interpretable classification of retinal images
Playout, C., Duval, R., Boucher, M. C., & Farida Cheriet, A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102608 · Cited by 98
Adaptive Transformers for Robust Few-shot Cross-domain Face Anti-spoofing
Huang, H., Sun, D., Liu, Y., Chu, W., Xiao, T., Yuan, J., Adam, H., & Yang, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19778-9_3 · Cited by 106
Is Attention all You Need in Medical Image Analysis? A Review
Papanastasiou, G., Δικαίος, Ν., Huang, J., Wang, C., & Yang, G. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3348436 · Cited by 107
Li, J., Zhang, P., Wang, T., Zhu, L., Liu, R., Yang, X., Wang, K., Shen, D. G., & Sheng, B. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3289859 · Cited by 90
Predicting cellular responses to perturbation across diverse contexts with State
Adduri, A. K., Gautam, D., Bevilacqua, B., Naghipourfar, M., Imran, A., Shah, R., Teyssier, N., Verma, R., Carpenter, C., Eraslan, B., et al. (2026) · Cell · doi:10.1016/j.cell.2026.07.052 · Cited by 100
MuIT: An End-to-End Multitask Learning Transformer
Bhattacharjee, D., Zhang, T., Susstrunk, S. E., & Salzmann, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01172 · Cited by 101
Retrieval Augmented Classification for Long-Tail Visual Recognition
Long, A., Yin, W., Ajanthan, T., Nguyen, D.-V., Purkait, P., Garg, R., Blair, A., Shen, C., & van den Hengel, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00683 · Cited by 97
A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future
Zhu, C., & Chen, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3413013 · Cited by 113
Artificial intelligence applications in histopathology
Bahadir, C. D., Omar, M., Rosenthal, J., Marchionni, L., Liechty, B., Pisapia, D. J., & Sabuncu, M. R. (2024) · Nature Reviews Electrical Engineering · doi:10.1038/s44287-023-00012-7 · Cited by 93
Recent Advances in Automatic Modulation Classification Technology: Methods, Results, and Prospects
Zheng, Q., Tian, X., Yu, L., Elhanashi, A., & Saponara, S. (2025) · International Journal of Intelligent Systems · doi:10.1155/int/4067323 · Cited by 89
X-Pruner: eXplainable Pruning for Vision Transformers
Lu, Y., & Xiang, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02333 · Cited by 96
AttentionViz: A Global View of Transformer Attention
Yeh, C. V., Chen, Y., Wu, A., Chen, C., Viégas, F. B., & WATTENBERG, M. P. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327163 · Cited by 105
Generative AI for self-adaptive systems: State of the art and research roadmap
Li, J., Zhang, M., Li, N., Weyns, D., Jin, Z., & Tei, K. (2024) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3686803 · Cited by 77
Multi-Channel Vision Transformer for Epileptic Seizure Prediction
Hussein, R., Lee, S., & Ward, R. K. (2022) · Biomedicines · doi:10.3390/biomedicines10071551 · Cited by 76
Sun, L., Lian, Z., Liu, B., & Tao, J. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102382 · Cited by 92
Explainable multimodal trajectory prediction using attention models
Zhang, K., & Li, L. (2022) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2022.103829 · Cited by 81
Hallmarks of artificial intelligence contributions to precision oncology
Chang, T., Park, S., Schäffer, A. A., Jiang, P., & Ruppin, E. (2025) · Nature Cancer · doi:10.1038/s43018-025-00917-2 · Cited by 83
Vision transformer-based weakly supervised histopathological image analysis of primary brain tumors
Li, Z., Cong, Y., Chen, X., Qi, J., Sun, J., Yan, T., Yang, H., Liu, J., Lu, E., Wang, L., et al. (2023) · iScience · doi:10.1016/j.isci.2022.105872 · Cited by 82
Hu, W., Li, X., Li, C., Li, R., Jiang, T., Sun, H., Huang, X., Grzegorzek, M., & Li, X. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107034 · Cited by 86
Quinoa Phenotyping Methodologies: An International Consensus
Stanschewski, C. S., Rey, E., Fiene, G. M., Craine, E. B., Wellman, G. B., Melino, V. J., Patiranage, D. S. R., Johansen, K., Schmöckel, S. M., Bertero, D., et al. (2021) · Plants · doi:10.3390/plants10091759 · Cited by 76
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space
Chavan, A., Shen, Z., Liu, Z., Liu, Z., Cheng, K.-T., & Xing, E. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00488 · Cited by 72
He, K., Mao, R., Lin, Q., Ruan, Y., Lan, X., Feng, M., & Cambria, E. (2024) · doi:10.2139/ssrn.4809363 · Cited by 69
Learning Multi-Granularity Temporal Characteristics for Face Anti-Spoofing
Wang, Z., Wang, Q., Deng, W., & Guo, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3158062 · Cited by 73
Word-As-Image for Semantic Typography
Iluz, S., Vinker, Y., Hertz, A., Berio, D., Cohen‐Or, D., & Shamir, A. (2023) · ACM Transactions on Graphics · doi:10.1145/3592123 · Cited by 97
Zhang, E. Y., Cheok, A. D., Pan, Z., Cai, J., & Yan, Y. (2023) · Sci · doi:10.3390/sci5040046 · Cited by 84
A Survey on Attention Mechanisms for Medical Applications: are we Moving Toward Better Algorithms?
Gonçalves, T., Rio-Torto, I., Teixeira, L. F., & Cardoso, J. S. (2022) · IEEE Access · doi:10.1109/access.2022.3206449 · Cited by 83
TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers
Liu, J., Liu, B., Zhou, H., Li, H., & Liu, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_26 · Cited by 72
Attention for Vision-Based Assistive and Automated Driving: A Review of Algorithms and Datasets
Kotseruba, I., & Tsotsos, J. K. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3186613 · Cited by 65
Dynamic Spatial Sparsification for Efficient Vision Transformers and Convolutional Neural Networks
Rao, Y., Liu, Z., Zhao, W., Zhou, J., & Lu, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263826 · Cited by 75
Learning Bottleneck Concepts in Image Classification
Wang, B., Li, L., Nakashima, Y., & Nagahara, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01055 · Cited by 73
Comprehensive review of Transformer‐based models in neuroscience, neurology, and psychiatry
Cong, S., Wang, H., Zhou, Y., Wang, Z., Yao, X., & Yang, C. (2024) · Brain‐X · doi:10.1002/brx2.57 · Cited by 75
Lai, T. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4010008 · Cited by 74
Schramowski, P., Tauchmann, C., & Kersting, K. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533192 · Cited by 86
TopicFM: Robust and Interpretable Topic-Assisted Feature Matching
Giang, K. T., Song, S., & Jo, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25341 · Cited by 64
Attention-based Saliency Maps Improve Interpretability of Pneumothorax Classification
Wollek, A., Graf, R., Čečatka, S., Fink, N., Willem, T., Sabel, B. O., & Lasser, T. (2023) · Radiology: Artificial Intelligence · doi:10.1148/ryai.220187 · Cited by 68
Face Anti-Spoofing Using Transformers With Relation-Aware Mechanism
Wang, Z., Wang, Q., Deng, W., & Guo, G. (2022) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2022.3184500 · Cited by 62
Deep learning approaches for seizure video analysis: A review
Ahmedt‐Aristizabal, D., Armin, M. A., Hayder, Z., Garcia‐Cairasco, N., Petersson, L., Fookes, C., Denman, S., & McGonigal, A. (2024) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2024.109735 · Cited by 65
Large language models in psychiatry: Opportunities and challenges
Volkmer, S., Meyer‐Lindenberg, A., & Schwarz, E. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116026 · Cited by 68
Artificial intelligence in COPD CT images: identification, staging, and quantitation
Wu, Y., Xia, S., Liang, Z., Chen, R., & Qi, S. (2024) · Respiratory Research · doi:10.1186/s12931-024-02913-z · Cited by 66
Multi-Modal Multi-Instance Learning for Retinal Disease Recognition
Li, X., Zhou, Y., Wang, J., Lin, H., Zhao, J., Ding, D., Yu, W., & Chen, Y. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475418 · Cited by 57
“This Is My Unicorn, Fluffy”: Personalizing Frozen Vision-Language Representations
Cohen, N., Gal, R., Meirom, E. A., Chechik, G., & Atzmon, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20044-1_32 · Cited by 68
Metadata
- Authors
- Chefer, H., Gur, S., & Wolf, L.
- Affiliations
- Tel Aviv University (IL)
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 782-791
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3112516115
- Cited by
- 903
- References
- 52
- Citations by year
- 2026: 185 · 2025: 226 · 2024: 193 · 2023: 178 · 2022: 90 · 2021: 31
- FWCI
- 56.82
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- European Research Council
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- transformer interpretability, vision transformer, attention visualization, local relevance, relevance propagation, attention layers, skip connections, explainable AI, text classification, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
