The DOI matches its DataCite record, with a small difference in title or year; 56 of the 56 references it cites were found in a registry or an index.
Transformer in Transformer
Open accessAbstract
Transformer is a new kind of neural architecture which encodes the input data as powerful features via the attention mechanism. Basically, the visual transformers first divide the input images into several local patches and then calculate both representations and their relationship. Since natural images are of high complexity with abundant detail and color information, the granularity of the patch dividing is not fine enough for excavating features of objects in different scales and locations. In this paper, we point out that the attention inside these local patches are also essential for building visual transformers with high performance and we explore a new architecture, namely, Transformer iN Transformer (TNT). Specifically, we regard the local patches (e.g., 16$\times$16) as "visual sentences" and present to further divide them into smaller patches (e.g., 4$\times$4) as "visual words". The attention of each word will be calculated with other words in the given visual sentence with negligible computational costs. Features of both words and sentences will be aggregated to enhance the representation ability. Experiments on several benchmarks demonstrate the effectiveness of the proposed TNT architecture, e.g., we achieve an 81.5% top-1 accuracy on the ImageNet, which is about 1.7% higher than that of the state-of-the-art visual transformer with similar computational cost. The PyTorch code is available at https://github.com/huawei-noah/CV-Backbones, and the MindSpore code is available at https://gitee.com/mindspore/models/tree/master/research/cv/TNT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, in multi-tenant architectures, system prompts are shared across multiple requests and frequently contain detailed instructions or examples to guide the model [19].”
From HotPrefix: Hotness-Aware KV Cache Scheduling for Efficient Prefix Sharing in LLM Inference Systems (2025) · cites this paper as [19]
In the citing paper
“PromptCache [19] proposes modular reuse beyond prefixes but sacrifices accuracy, with reported performance drops of up to 43% [72], making it unsuitable for tasks requiring high precision.”
From HotPrefix: Hotness-Aware KV Cache Scheduling for Efficient Prefix Sharing in LLM Inference Systems (2025) · cites this paper as [19]
In the citing paper
“related experiments results further demonstrate ViT also has remarkable representation capacity when dealing with images and videos [19].”
From Deepfake Video Detection with Spatiotemporal Dropout Transformer (2022) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 6×
“Compared to CNNs, TNT can outperform the widely-used ResNet and RegNet.”
BackgroundMethodInfluentialVaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 3×
“The effect of #heads in standard transformer has been investigated in multiple works [21, 35] and a head width of 64 is recommended for visual tasks [9, 31].”
BackgroundMethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“In the past decade, the mainstream deep neural architectures used in the computer vision (CV) are mainly established on convolutional neural networks (CNNs) [17, 12, 11].”
BackgroundFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 1×
“As a general backbone network, TNT can also be applied with multi-scale vision models like Faster RCNN [29].”
MethodBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472 · cited 7×
“The recent transformerbased models like ViT [9] and DeiT [31] are compared.”
MethodInfluentialImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 3×
“ImageNet ILSVRC 2012 [26] is an image classification benchmark consisting of 1.”
BackgroundInfluentialSqueeze-and-Excitation NetworksPreprint
Hu, J., Shen, L., & Sun, G. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.01507 · Cited by 37,845 · cited 1×
“Inspired by squeeze-and-excitation (SE) network for CNNs [16], we propose to explore channel-wise attention for transformers.”
MethodPyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939 · cited 2×
“We evaluate TNT-S and DeiT-S on Faster RCNN with FPN [21].”
BackgroundMethod
Research works printed but not linked: 5
- [6][6] Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, and Ilya Sutskever. Generative pretraining from pixels. In ICML , 2020. -
- [11][11] Kai Han, Yunhe Wang, Hanting Chen, Xinghao Chen, Jianyuan Guo, Zhenhua Liu, Yehui Tang, An Xiao, Chunjing Xu, Yixing Xu, et al. A survey on vision transformer. arXiv preprint arXiv:2012.12556 , 2020. - · arXiv
- [23][23] Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 , 2017. - · arXiv
- [26][26] Omkar M Parkhi, Andrea Vedaldi, Andrew Zisserman, and CV Jawahar. Cats and dogs. In CVPR , pages 3498-3505. IEEE, 2012. -
- [37][37] Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-sne. Journal of machine learning research , 9(11), 2008. -
Cited by
Sorted by citations
Items 101–200 of 1,009
Mo, Y., Han, C., Liu, Y., Liu, M., Shi, Z., Lin, J., Zhao, B., Huang, C., Qiu, B., Cui, Y., et al. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3236011 · Cited by 184
“VGG16 [40], three vision transformer models ViT [32], TNT-s [42] and Swin-B [33] and two CNN-based models tailored”
BackgroundSelf-citationYao, T., Li, Y., Pan, Y., Wang, Y., Zhang, X.-P. S., & Mei, T. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3268446 · Cited by 194
Self-citationPointMixer: MLP-Mixer for Point Cloud UnderstandingPreprint
Choe, J., Park, C., Rameau, F., Park, J., & Kweon, I.-S. (2021) · European Conference on Computer Vision · doi:10.48550/arxiv.2111.11187 · Cited by 148
“Transformerbased architecture has recently become a game changer in both natural language processing [8, 36, 41, 46] and computer vision [4, 9, 14, 27, 30, 38, 45, 58].”
BackgroundPaçal, İ. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111482 · Cited by 158
Inverted Pyramid Multi-task Transformer for Dense Scene Understanding
Ye, H.-R., & Xu, D. (2022) · European Conference on Computer Vision · doi:10.48550/arxiv.2203.07997 · Cited by 147
“Visual Transformer Research interest in visual transformers grows rapidly nowadays inspired by the recent success of transformers [42] in multi-modal learning [31,33], 2D [29,14,6,7,18,8] and 3D computer vision tasks [28,26,52].”
BackgroundDPT: Deformable Patch-based Transformer for Visual Recognition
Chen, Z., Zhu, Y., Zhao, C., Hu, G., Zeng, W., Wang, J., & Tang, M. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475467 · Cited by 132
“This object is obtained by combining convolution blocks and self-attention layers together [3, 22], maintaining high-resolution feature maps [10, 17, 26], adding parameters biased for locality [6, 9] or re-designing the brute-force patch-embedding module [30].”
BackgroundMethodTransformers in computational visual media: A survey
Xu, Y., Wei, H., Lin, M., Deng, Y., Sheng, K., Zhang, M., Tang, F., Dong, W., Huang, F., & Xu, C. (2021) · Computational Visual Media · doi:10.1007/s41095-021-0247-3 · Cited by 144
“[16], c (cid:2) The Author(s) 2021. is initialized as 1 for all layers and all heads in MSA.”
BackgroundMethodInfluentialSelf-citationFully transformer network for skin lesion analysis
He, X., Tan, E.-L., Bi, H., Zhang, X., Zhao, S., & Lei, B. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102357 · Cited by 143
Are we ready for a new paradigm shift? A survey on visual deep MLP
Liu, R., Li, Y., Tao, L., Liang, D., & Zheng, H.-T. (2022) · Patterns · doi:10.1016/j.patter.2022.100520 · Cited by 110
“8 True TNT-B [28] 2021 Single-stage 82.”
BackgroundI-ViT: Integer-only Quantization for Efficient Vision Transformer Inference
Li, Z., & Gu, Q. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01565 · Cited by 141
“Thanks to the global receptive fields captured by the attention mechanism, ViTs have shown superior performance on various computer vision tasks [13, 42, 14].”
BackgroundA Deep Learning Framework for Infrared and Visible Image Fusion Without Strict Registration
Li, H.-F., Liu, J., Zhang, Y.-F., & Liu, Y. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01948-x · Cited by 140
“In particular, Han et al. (2021) Since Transformer has a stronger ability to model long-range dependencies, it is suitable to extract global image features.”
Li, W., Peng, Y. J., Zhang, M., Ding, L., Hu, H., & Shen, L. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3628666 · Cited by 161
“such as vision transformers (ViT) [79] and GPT [17], etc.”
Safe Self-Refinement for Transformer-based Domain Adaptation
Sun, T., Lu, C., Zhang, T., & Ling, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00705 · Cited by 131
“Following that, many ViT variants have been proposed [7,13,30,41].”
BackgroundMulti-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model
Shi, Y., Dong, M.-J., & Xu, C. (2024) · Neural Information Processing Systems · doi:10.48550/arxiv.2405.14174 · Cited by 137
“In response, subsequent research has focused on developing more efficient training strategies [44, 46, 25], hierarchical network structures [33, 32, 5, 51, 52, 16], refined spatial attention mechanisms [58, 60, 53, 47, 17, 5] and convolution-based design [2, 30, 15, 37] to address these issues.”
BackgroundSelf-citationLightweight transformer image feature extraction network
Zheng, W., Lu, S., Yang, Y., Yin, Z., & Yin, L. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1755 · Cited by 167
“In the experiment, six selected benchmark models including DeiT ( Touvron et al., 2021a ), PVT ( Wang et al., 2021 ), Swin Transformer ( Huang et al., 2021 ), TNT ( Han et al., 2021 ), T2T-ViT ( Yuan et al., 2021 ) and CaiT ( Touvron et al., 2021b ).”
CrossFormer++: A Versatile Vision Transformer Hinging on Cross-Scale Attention
Wang, W., Chen, W., Qiu, Q., Chen, L., Wu, B., Lin, B., He, X., & Liu, W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3341806 · Cited by 348
“The competitors are all competitive vision transformers, including DeiT [2], PVT [3], T2T-ViT [8], TNT [29], CViT [30], Twins [31], Swin [4], S3 [24], NesT [32], CvT [17], ViL [33], CAT [5], ResT [34], TransCNN [35], Shuffle [36], BoTNet [37], RegionViT [38], ViTAEv2 [39], MPViT [40], ScalableViT…”
BackgroundNot All Patches are What You Need: Expediting Vision Transformers via Token Reorganizations
Liang, Y., Ge, C., Tong, Z., Song, Y., Wang, J., & Xie, P. (2022) · arXiv · doi:10.48550/arxiv.2202.07800 · Cited by 131
“The comparing methods include DeiT (Touvron et al., 2021a), CaiT (Touvron et al., 2021b), LV-ViT (Jiang et al., 2021), CoaT (Xu et al., 2021), Swin (Liu et al., 2021), Twins (Chu et al., 2021), Visformer (Chen et al., 2021), ConViT (d’Ascoli et al., 2021), TNT (Han et al., 2021a), Efficient-Net (Tan & Le, 2019), and PV…”
Multi-Modal Feature Pyramid Transformer for RGB-Infrared Object Detection
Zhu, Y.-H., Sun, X., Wang, M., & Huang, H. (2023) · IEEE transactions on intelligent transportation systems (Print) · doi:10.1109/tits.2023.3266487 · Cited by 130
“[40] propose two transformer blocks: inner transformer block and outer transformer block, where the inner transformer block is conducted over local fine-grained tokens and the outer transformer block is conducted on coarse-grained tokens.”
BackgroundHeatViT: Hardware-Efficient Adaptive Token Pruning for Vision Transformers
Dong, P., Sun, M., Lu, A., Xie, Y., Liu, K., Kong, Z., Meng, X., Li, Z., Lin, X., Fang, Z., et al. (2023) · 2023 IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca56546.2023.10071047 · Cited by 128
Self-citationHire-MLP: Vision MLP via Hierarchical Rearrangement
Guo, J., Tang, Y., Han, K., Chen, X., Wu, H., Xu, C., Xu, C., & Wang, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00090 · Cited by 113
“TNT [15] embedded small transformer blocks in original modules to capture local information.”
BackgroundMethodInfluentialSelf-citationVision Transformers for Computational Histopathology
Xu, H., Xu, Q., Cong, F., Kang, J., Han, C., Liu, Z., Madabhushi, A., & Lu, C. Y. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2023.3297604 · Cited by 153
“To address data-hungry limitations, one solution would be to reduce the model size and optimize the scale, similarly to the strategies employed in approaches like DeiT [40], tokens-to-token ViT [22] and transformer in transformer [120].”
MethodCF-ViT: A General Coarse-to-Fine Method for Vision Transformer
Chen, M., Lin, M., Li, K., Shen, Y., Wu, Y., Chao, F., & Ji, R. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25860 · Cited by 90
Ye, J., Tian, J., Yan, M., Yang, X., Wang, X., Zhang, J., He, L., & Lin, X. A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01506 · Cited by 117
“Some recent works [9, 18] modify the ViT architecture for better performance.”
BackgroundCAS-ViT: Convolutional Additive Self-Attention Vision Transformers for Efficient Mobile Applications
Zhang, T., Li, L., Zhou, Y., Liu, W., Qian, C., Hwang, J., & Ji, X. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3655121 · Cited by 99
“In practice, token mixer is widely implemented as Multi-head Self-Attention (MSA), which operates on the entire input sequence, compensating for the limitations of CNNs with restricted receptive fields, and providing unique advantages in terms of model scalability and adaptability [9]–[11].”
Systematic Review of Hybrid Vision Transformer Architectures for Radiological Image Analysis
Kim, J. W., Khan, A. U., & Banerjee, I. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-024-01322-4 · Cited by 99
“To detect anomalies in anatomical imaging, the local correlation among the neighboring pixels is important for identification of shape and regional texture difference with neighboring tissue in addition to the long-range dependencies to understand anatomical location of the anomaly [10].”
Long, S., Tan, J., Mao, B., Tang, F., Li, Y., Zhao, M., & Kato, N. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3526606 · Cited by 139
“Furthermore, Google introduced the Transformer model [76], [77], [78], [79], [80], which introduced self-attention mechanisms, further enhancing performance in translation and language generation tasks.”
GET: Group Event Transformer for Event-Based Vision
Peng, Y., Zhang, Y., Xiong, Z., Sun, X., & Wu, F. H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00555 · Cited by 77
“Although these networks have fair performance, they are still limited by their reliance on image-based feature extraction designs [16, 33, 25, 43].”
BackgroundParameterNet: Parameters are All You Need for Large-Scale Visual Pretraining of Mobile Networks
Han, K., Wang, Y., Guo, J., & Wu, E. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01491 · Cited by 124
“Sparse-activated Mixture-of-Experts (MoE) models [43], initially introduced in the NLP domain, allow for a substantial increase in the number of parameters while maintaining the computational load per token or sample unchanged.”
BackgroundSelf-citationXie, E., Yao, L., Shi, H., Liu, Z., Zhou, D., Liu, Z., Li, J., & Li, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00390 · Cited by 97
Point Cloud Classification Using Content-Based Transformer via Clustering in Feature Space
Liu, Y., Wang, B., Lv, Y.-S., Li, L., & Wang, F. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123432 · Cited by 113
“Transformer in Transformer (TNT) [50] extends the ViT baseline with sub-patch-wise attention within patches.”
BackgroundShip detection with deep learning: a survey
Er, M. J., Zhang, Y., Chen, J., & Gao, W. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10455-x · Cited by 137
“Several techniques have been proposed to demonstrate versatile Transformer-based backbones (Beal et al. 2020; Wang et al. 2021; Han et al. 2021; Liu et al. 2021; Chu et al. 2021).”
MethodGlobal Vision Transformer Pruning with Hessian-Aware Saliency
Yang, H., Yin, H., Shen, M., Molchanov, P. A., Li, H. H., & Kautz, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01779 · Cited by 92
“Notable methods include adding convolutional layers [13, 44], using multiple ViT stages with different feature scales [3, 6, 41, 52], and explore novel attention mechanisms [15,16,23,48].”
BackgroundMethodVision HGNN: An Image is More than a Graph of Nodes
Han, Y., Wang, P., Kundu, S., Ding, Y., & Wang, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01820 · Cited by 97
“The major improvements include pyramid architecture [62, 41], local attention [19, 41] and position encoding [67].”
BackgroundRobust Multi-tab Website Fingerprinting Attacks in the Wild
Deng, X., Yin, Q., Liu, Z., Zhao, X., Li, Q., Xu, M., Xu, K., & Wu, J. (2023) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46215.2023.10179464 · Cited by 81
“The self-attention mechanism is widely applied in natural language processing and computer vision [30], [32], [33], [34], which can capture the dependencies within a sequence.”
BackgroundBridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets
Lu, Z., Xie, H.-T., Liu, C.-B., & Zhang, Y. (2022) · Neural Information Processing Systems · doi:10.48550/arxiv.2210.05958 · Cited by 110
Cui, B., Liu, M., Li, S., Jin, Z., Zeng, Y., & Lin, X. (2023) · Atmospheric Pollution Research · doi:10.1016/j.apr.2023.101833 · Cited by 129
Transferable Adversarial Attacks on Vision Transformers with Token Gradient Regularization
Zhang, J., Huang, Y., Wu, W., & Lyu, M. R.-T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01575 · Cited by 101
“In addition to the four source ViT models, the target ViT models contain four more ViTs: DeiT-B [25], TNT-S [9], LeViT-256 [8], and ConViT-B [6].”
BackgroundMethodJiang, L., Zhang, T., Wei, L., Zhuang, K., & Li, Y. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.101966 · Cited by 105
Wu, W., Wang, X., Luo, H., Wang, J., Yang, Y., & Ouyang, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00640 · Cited by 136
Are Vision Transformers Robust to Patch Perturbations?
Gu, J., Tresp, V., & Qin, Y. (2021) · European Conference on Computer Vision · doi:10.48550/arxiv.2111.10659 · Cited by 104
“Recently, Vision Transformer (ViT) has demonstrated impressive performance [10,47,49,50,14,8,15,7,25], which makes it become a potential alternative to convolutional neural networks (CNNs).”
BackgroundLearning Efficient Vision Transformers via Fine-Grained Manifold Distillation
Hao, Z.-W., Guo, J.-Y., Jia, D., Han, K., Tang, Y.-H., Zhang, C., Hu, H., & Wang, Y.-H. (2021) · Neural Information Processing Systems · doi:10.52202/068431-0666 · Cited by 104
“Inspired by the design of splitting the whole image into patches as input, various vision transformers have been proposed, including Swin [5], T2T [6], Twins [7], and TNT [8].”
BackgroundMethodSelf-citationAn overview of large AI models and their applications
Tu, X., He, Z., Huang, Y., Zhang, Z., Yang, M., & Zhao, J. C. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00065-8 · Cited by 106
“…have applied the Transformer architecture to various CV domains, including image classification algorithms such as iGPT [84], BiT [85], TNT [86], typical object detection algorithms such as DETR [87], UP-DETR [88], and ACT [89], and typical video processing algorithms such as MEGA [90],…”
Li, D., Li, Y., Wang, C., Chen, M., & Wu, Q. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.120452 · Cited by 111
Vision-Language Models in medical image analysis: From simple fusion to general large models
Li, X., Li, L., Jiang, Y., Wang, H., Qiao, X., Feng, T., Luo, H., & Zhao, Y. J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102995 · Cited by 93
Object Detection in Traffic Videos: A Survey
Ghahremannezhad, H., Shi, H., & Liu, C. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3258683 · Cited by 126
“2) Transformer Backbone With CNN Head: Another group of studies [78], [156], [157], [158] tends to use transformers as the backbone with a CNN-based detection head.”
TrEP: Transformer-Based Evidential Prediction for Pedestrian Intention with Uncertainty
Zhang, Z.-M., Tian, R., & Ding, Z. (2023) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25463 · Cited by 100
“RNN-based encoder-decoder captures the temporal correlation through model parameters (like memories), transformer-based model (Vaswani et al. 2017a; Han et al. 2021; Xu et al. 2021; Yi and Qu 2022; Wu et al. 2023) design attention modules to capture all the possible relationships.”
LCPFormer: Towards Effective 3D Point Cloud Analysis via Local Context Propagation in Transformers
Huang, Z., Zhao, Z., Li, B., & Han, J. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3247506 · Cited by 97
“Since then, transformer structure has been successfully applied to computer vision, and many improvements [26], [27], [29], [30], [32], [33], [55]–[60] have been proposed.”
BackgroundLarge language models for medicine: a survey
Zheng, Y., Gan, W., Chen, Z., Qi, Z., Liang, Q., & Yu, P. S. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02318-w · Cited by 90
“Furthermore, through validation on the CASP14 and CAMEO data-sets, as for targets characterized by a substantial number of homologous protein families, the HelixFold-Single method has been demonstrated to achieve accuracy comparable to MSA-based methods.”
InfluentialCST: Convolutional Swin Transformer for detecting the degree and types of plant diseases
Guo, Y., Lan, Y., & Chen, X. D. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107407 · Cited by 108
MatteFormer: Transformer-Based Image Matting via Prior-Tokens
Park, G., Son, S., Yoo, J., Kim, S.-H., & Kwak, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01140 · Cited by 101
“With the potential of ViT [11] and its follow-ups [7, 14, 41, 55], researchers have studied applying transformers to typical vision tasks.”
BackgroundVISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attention
Deng, S., Liang, Z., Sun, L., & Jia, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00826 · Cited by 98
“Thanks to the capability of effectively capturing longrange dependencies of features in the input feature sequences, transformer [26] have been widely transferred into computer vision task [3,8,13,14,21,24,34].”
MethodShehzad, A. H., Xia, F., Abid, S., Peng, C., Yu, S., Zhang, D., & Verspoor, K. M. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3646122 · Cited by 138
“Drawing on relative positional encoding in NLP and CV [51], these methods must account for the fact that graph distances can be ambiguous due to multiple paths with varying lengths or weights.”
Moutik, O., Sekkat, H., Tigani, S., Chehri, A., Saadane, R., Tchakoucht, T. A., & Paul, A. (2023) · Sensors · doi:10.3390/s23020734 · Cited by 114
“For instance, TNT [70] splits the original patch into several sub-patches, and it introduces a new architecture, “Transformer in Transformer”, which uses an internal transformer block to map the relationship of the sub-patches and an external transformer block for the exchange of information at the patch location.”
BackgroundMulticlass skin lesion classification in dermoscopic images using swin transformer model
Ayas, S. (2022) · Neural computing & applications (Print) · doi:10.1007/s00521-022-08053-z · Cited by 95
“Recently, several excellent studies, Tokens-to-token ViT (T2T-ViT) [28], Transformer-iN-Transformer (TNT) [29], Pyramid Vision Transformer (PVT) [30] and swin transformer [31], have been developed based on ViT.”
BackgroundAdversarial Robustness Comparison of Vision Transformer and MLP-Mixer to CNNs
Benz, P., Ham, S., Zhang, C.-N., Karjauv, A., & Kweon, I.-S. (2021) · British Machine Vision Conference · doi:10.48550/arxiv.2110.02797 · Cited by 95
“Further works are attempting to extend the ViT architecture to increase the efficiency and performance of transformer architectures [11, 22, 41, 74].”
BackgroundA Survey on Transformer CompressionPreprint
Tang, Y., Wang, Y., Guo, J., Tu, Z., Han, K., Hu, H., & Tao, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.05964 · Cited by 102
“TNT [197] further divides original ViT’s 16 × 16 patches into smaller 4 × 4 patches for capturing local information.”
BackgroundSelf-citationQian, X., Zhang, C., Chen, L., & Li, K. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.864486 · Cited by 110
“Multilayer perceptron (MLP) obtains nonlinearity and transformation (Han et al., 2021), benefiting from the linear layer and the activation function Gaussian error linear units (GELU) (Hendrycks and Gimpel, 2016).”
BackgroundMethodWang, L., Zhang, M., Gao, X., & Shi, W. (2024) · Remote Sensing · doi:10.3390/rs16050804 · Cited by 100
An Explainable Transformer-based Model for Phishing Email Detection: A Large Language Model ApproachPreprint
Uddin, M. A., Mahiuddin, M., & Sarker, I. H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.13871 · Cited by 37
“The transformer is an innovative neural design that uses the attention mechanism to encode incoming data into powerful characteristics (Han, Xiao, Wu, Guo, Xu, and Wang, 2021).”
Vision Transformer With Quadrangle Attention
Zhang, Q., Zhang, J., Xu, Y., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3347693 · Cited by 106
MVSTT: A Multiview Spatial-Temporal Transformer Network for Traffic-Flow Forecasting
Pu, B., Liu, J., Kang, Y., Chen, J., & Yu, P. S. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3223918 · Cited by 97
“Today, transformer networks have gone on to great success in the natural language processing and computer vision fields [33], [34], and some scholars are beginning to explore the use of transformer networks for traffic-flow prediction.”
BackgroundPale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention
Wu, S.-T., Wu, T., Tan, H. H., & Guo, G. (2021) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2112.14000 · Cited by 89
“Such design is followed by many works afterward (Liu et al. 2021; Huang et al. 2021; Yang et al. 2021; Dong et al. 2021 (Chen, Fan, and Panda 2021) or cooperating with local attention (Han et al. 2021; Zhang et al. 2021; Chu et al. 2021a; Li et al. 2021a; Yuan et al. 2021b).”
BackgroundLi, X., & Li, S. (2022) · Agriculture · doi:10.3390/agriculture12060884 · Cited by 88
Wang, Y., Liu, Z., Liu, J., Xu, S., & Liu, S. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.01207 · Cited by 87
“We would like to point out that the work [9] aiming at high-level tasks proposes a TNT structure to explore local attention to assist global attention.”
BackgroundMethodSelf-citationDeep learning for visible-infrared cross-modality person re-identification: A comprehensive review
Huang, N.-C., Liu, J.-N., Miao, Y., Zhang, Q., & Han, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.10.024 · Cited by 87
ProcessGPT: Transforming Business Process Management with Generative Artificial Intelligence
Beheshti, A., Yang, J., Sheng, Q. Z., Benatallah, B., Casati, F., Dustdar, S., Nezhad, H. R. M., Zhang, X.-Y., & Xue, S. (2023) · 2023 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws60048.2023.00099 · Cited by 85
Oriented object detection in optical remote sensing images using deep learning: a survey
Wang, K., Wang, Z., Li, Z., Su, A., Teng, X., Pan, E., Liu, M., & Yu, Q. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11256-0 · Cited by 103
“…and summarize RS object detection, they either lack of in-depth analysis for oriented object detection (Cheng and Han, 2016; Li et al., 2020, 2021; Han et al., 2021b; Wu et al., 2022) or categorize the sub-categories belonging to RS object detection as oriented (Jiao et al., 2019) ACCESS A survey…”
InfluentialRevisiting Token Pruning for Object Detection and Instance Segmentation
Liu, Y., Gehrig, M., Messikommer, N., Cannici, M., & Scaramuzza, D. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00264 · Cited by 54
“Since then, several improvements have been proposed to the ViT architecture, including improved tokens’ aggregation schemes [23, 26, 50, 65], multi-scale hierarchical designs [7,13,36,55–58], and hybrid architectures combining CNNs [64, 69, 70] .”
AFR-Net: Attention-Driven Fingerprint Recognition Network
Grosz, S. A., & Jain, A. K. (2022) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2023.3317303 · Cited by 84
“More recently, motivated by the success of attention-based Transformers [11] in natural language processing, the computer vision field has seen an influx of the use of the vision transformer (ViT) architecture for various computer vision tasks [12], [13], [14], [15].”
Background3D Object Tracking with TransformerPreprint
Cui, Y., Fang, Z., Shan, J., Gu, Z., & Zhou, S. (2021) · British Machine Vision Conference · doi:10.48550/arxiv.2110.14921 · Cited by 84
Ma, W., Li, Y., Jia, X., & Xu, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00427 · Cited by 51
“For target models, we use three CNNs including DenseNet-201 (DN201) [17], ResNet50-BiT-M (BiT) [20], and state-of-the-art Con-vNeXt (CNeXt) [25], as well as five ViT models: ViT-S, ViT-B, ViT-L [11], Transformer iN Transformer (TNT) [15] and advanced Swin-Transformer (Swin) [24].”
MethodJi, X.-Y., Dong, Z., Han, Y., Lai, C., Zhou, G., & Qi, D.-L. (2023) · IEEE transactions on consumer electronics · doi:10.1109/tce.2023.3263672 · Cited by 81
“According to [22], Visual Transformer (ViT) and its variants based on a self-attention module have proved effective in many computers vision tasks.”
MethodEfficient Federated Learning for Modern NLP
Cai, D., Wu, Y., Wang, S., Lin, F. X., & Xu, M. (2023) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3570361.3592505 · Cited by 83
DropKey for Vision Transformer
Li, B., Hu, Y., Nie, X., Han, C., Jiang, X., Guo, T., & Liu, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02174 · Cited by 106
“Vision Transformer (ViT) [6] has achieved great success for various vision tasks, e.g. , image recognition [7, 12, 20, 34, 35], object detection [1], human body shape estimation [18], etc. Prior works mainly focus on researches of patch division, architecture design and task extension.”
BackgroundVision transformers for dense prediction: A survey
Zuo, S., Xiao, Y., Chang, X., & Wang, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109552 · Cited by 84
SG-Former: Self-guided Transformer with Evolving Token Reallocation
Ren, S., Yang, X., Liu, S., & Wang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00552 · Cited by 74
Evaluation of Vision Transformers for Traffic Sign Classification
Zheng, Y., & Jiang, W. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/3041117 · Cited by 90
“The key idea of Transformer in Transformer (TNT) [13] is to use two Transformer blocks for both the patch embedding and pixel embeddings, as shown in Figure 5.”
BackgroundMethodInfluentialTransformer: A General Framework from Machine Translation to Others
Zhao, Y., Zhang, J., & Zong, C. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1393-5 · Cited by 77
Dynamic Unary Convolution in Transformers
Duan, H., Long, Y., Wang, S., Zhang, H., Willcocks, C. G., & Shao, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3233482 · Cited by 45
“For excavating local information in different scales and locations, TNT [9] further divides the patch used in ViT into multiple sub-patches, where a transformer-in-transformer architecture was developed to capture the relationship between such inner transformer blocks, and for patch-level…”
MethodLong, S., Zhao, Z. W., Pi, J., Wang, S., & Wang, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00996 · Cited by 53
“Also, as discussed in [9, 11–13, 25, 27], the token diversity is very critical to optimize transformer structures.”
BackgroundYu, B. X. B., Chang, J., Wang, H., Liu, L., Wang, S., Wang, Z., Lin, J., Xie, L., Li, H., Lin, Z., et al. (2024) · ACM Computing Surveys · doi:10.1145/3657632 · Cited by 58
“Early Transformer models for vision are Vision Transformer ( ViT ) [49], Data-efficient image transformer ( DeiT ) [221], while their representative variations are TNT [73], T2T [271], PVT [237], Swin-Vit [146], Video Swin Transformer [147], CPVT [39].”
Zhai, Z., Zhao, J., Long, C., Xu, W., He, S., & Zhao, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02115 · Cited by 110
“The input frames are split into evenly divided [13] and Swin Transformer [29], we take AU regions as input to our Transformer Fusion to extract local features and learn global information.”
MethodMasked Image Modeling with Local Multi-Scale Reconstruction
Wang, H., Tang, Y., Wang, Y., Guo, J., Deng, Z., & Han, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00211 · Cited by 73
“With the development of vision transformers [16, 20, 33, 42, 45], Masked Image Modeling (MIM) gradually replaces the dominant position of contrastive learning [10, 22, 44] in visual self-supervised representation learning due to its superior fine-tuning performance in various visual downstream tasks.”
BackgroundSelf-citationLiu, S., Wang, L., & Yue, W. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111323 · Cited by 87
Transformers in Single Object Tracking: An Experimental Survey
Kugarajeevan, J., Thanikasalam, K., Ramanan, A., & Fernando, S. (2023) · IEEE Access · doi:10.1109/access.2023.3298440 · Cited by 89
“The TNT [94] Transformer further subdivides a 16 × 16 image patch into 4 × 4 sub-patches using a Transformer-in-Transformer framework.”
MethodSimple, Effective and General: A New Backbone for Cross-view Image Geo-localization
Zhu, Y., Yang, H., Lu, Y.-X., & Huang, Q. (2023) · arXiv.org · doi:10.48550/arxiv.2302.01572 · Cited by 77
“Although our SAIG-D is slightly inferior to TNT-S and Swin-T by 1% in terms of Top-1 accuracy, our SAIG-D has only 67% and 55% of the model parameters of TNT-S and Swin-T.”
MethodJamal, S., Wimmer, H., & Sarker, I. H. (2024) · Security and Privacy · doi:10.1002/spy2.402 · Cited by 102
Scene Adaptive Sparse Transformer for Event-based Object Detection
Peng, Y., Li, H., Zhang, Y., Sun, X., & Wu, F. H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01589 · Cited by 58
“Other works [17, 29, 36, 54, 62] introduce localized self-attention or hierarchical Transformer architectures.”
BackgroundWang, H., Zhang, Q.-X., Li, Y., & Li, X.-M. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52733.2024.00348 · Cited by 76
“Most recently, Vision Transformers (ViTs) [2, 3, 10, 13, 29, 43, 47, 51, 53] have remarkably reformed this field.”
BackgroundCNN-LSTM and transfer learning models for malware classification based on opcodes and API calls
Bensaoud, A., & Kalita, J. K. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111543 · Cited by 79
“The Transformer learns global features, but lacks inductive bias and often overfits the training set, unlike CNN, which learns inductive bias but does not learn global features [31].”
BackgroundS2WAT: Image Style Transfer via Hierarchical Vision Transformer using Strips Window Attention
Zhang, C., Xu, X.-G., Wang, L., Dai, Z., & Yang, J. (2022) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2210.12381 · Cited by 76
VSA: Learning Varied-Size Window Attention in Vision Transformers
Zhang, Q.-M., Xu, Y.-F., Zhang, J., & Tao, D.-C. (2022) · European Conference on Computer Vision · doi:10.48550/arxiv.2204.08446 · Cited by 76
MH-DETR: Video Moment and Highlight Detection with Cross-modal Transformer
Xu, Y., Sun, Y., Zhai, B., Jia, Y., & Du, S. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650814 · Cited by 55
“Given that transformer is capable of effectively modeling long-range information, a multitude of works [9], [27] emphasize the importance of attention mechanisms and focus on designing various attention-based token mixer components for encoder.”
BackgroundTowards Data-Efficient Detection Transformers
Wang, W., Zhang, J., Cao, Y., Shen, Y., & Tao, D.-C. (2022) · European Conference on Computer Vision · doi:10.48550/arxiv.2203.09507 · Cited by 75
“Vision Transformers [11,50,18,32,45,48,12,7] (ViTs) are emerging as an alternative to CNN for feature extractors and visual recognition.”
BackgroundVSSD: Vision Mamba With Non-Causal State Space Duality
Shi, Y., Li, M., Dong, M., & Xu, C. L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01007 · Cited by 49
“To address this issue, different solutions have been proposed, including hierarchical architectures [8, 20, 35, 36, 51, 53], windowed attention [21, 35, 49, 66], and variants of self-attention [52, 55, 63].”
Self-citationThe Lie Derivative for Measuring Learned EquivariancePreprint
Gruver, N., Finzi, M., Goldblum, M., & Wilson, A. G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.02984 · Cited by 37
“), RegNets (Ra-dosavovic et al., 2020), ResNet-RS, (Bello et al., 2021), ResNets with new training recipes (Wightman et al., 2021), ResNeSts (Zhang et al., 2020), RexNet (Han et al., 2021a), Res2Net (Gao et al., 2019), RepVGG (Ding et al., 2021), NFNets (Brock et al., 2021), XNect (Mehta et al., 2020), MixNets (Tan &…”
BackgroundA Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning
Shou, Y.-T., Meng, T., Ai, W., Fu, F., Yin, N., & Li, K.-Q. (2023) · ACM Trans. Inf. Syst. · doi:10.1145/3786343 · Cited by 73
“Word embedding technology then uses a shallow neural network to learn the semantic information of words and uses Euclidean distance to measure the similarity between words.”
A deep learning method for the prediction of 6-DoF ship motions in real conditions
Zhang, M., Taimuri, G., Zhang, J., & Hirdaris, S. E. (2023) · Proceedings of the Institution of Mechanical Engineers Part M Journal of Engineering for the Maritime Environment · doi:10.1177/14750902231157852 · Cited by 70
“44,45 In this section, we propose a transformer-based deep learning method.”
MethodDynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoning
Xu, C., Wei, Y., Tang, B., Yin, S., Zhang, Y., Chen, S.-H., & Wang, Y.-F. (2022) · Neural Networks · doi:10.48550/arxiv.2206.13114 · Cited by 73
Self-citationViTKD: Feature-based Knowledge Distillation for Vision Transformers
Yang, Z., Li, Z., Zeng, A., Li, Z., Yuan, C., & Li, Y. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00145 · Cited by 50
“Recently, Vision Transformer (ViT) [10] has achieved great success in image classification and inspired various transformers [11, 22, 30, 45].”
Background
Metadata
- Authors
- Han, K., Xiao, A., Wu, E., Guo, J., Xu, C., & Wang, Y.
- Affiliations
- Huawei Technologies (China) (CN)
- University of Macau (MO)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- Volume
- 34
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2103.00112
- OpenAlex
- W3133696297
- Cited by
- 1,394
- References
- 56
- Citations by year
- 2026: 14 · 2025: 276 · 2024: 457 · 2023: 387 · 2022: 186 · 2021: 74
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (0015/2019/AKP, 62072449, 61632003, 0018/2019/AKP)
- Fundo para o Desenvolvimento das Ciências e da Tecnologia (0018/2019/AKP, 0015/2019/AKP)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- vision transformer, attention mechanism, local patches, visual words, image classification, feature aggregation, computational efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
