The DOI matches its Crossref record; 79 of the 84 references it cites were found in a registry or an index.
SPViT: Enabling Faster Vision Transformers via Latency-Aware Soft Token Pruning
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some pruning methods dynamically vary the number of tokens (e.g., Kong et al. (2022)). This increases accuracy but is generally impractical, as it prevents batched inference or training without padding tokens.”
From Token Merging: Your ViT But Faster (2022) · cites this paper as Kong et al. (2022)
In the citing paper
“We omit DeiT-Ti results from the main paper because we are not able to reproduce the baseline accuracy in SPViT (Kong et al., 2022).”
From Token Merging: Your ViT But Faster (2022) · cites this paper as Kong et al., 2022
In the citing paper
“Pruning methods require token padding during training, and thus don't improve training speed, while ToMe at r = 13 trains 1.5 × faster than the baseline DeiT-S.”
From Token Merging: Your ViT But Faster (2022) · cites this paper as Kong et al., 2022
In the citing paper
“Moreover, most token pruning works are forced to use padding tokens or attention masking during training, negating the benefits of pruning in the first place.”
From Token Merging: Your ViT But Faster (2022) · cites this paper as Kong et al., 2022
In the citing paper
“In vision transformers, it has primarily been used to reduce computational cost by removing visually redundant tokens [12, 13, 31, 49, 73, 76, 85, 111].”
From Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodality (2025) · cites this paper as [73]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Advances in neural information processing systems 7
Cios, K. J., & Shields, M. E. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,093
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,865
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00061 · Cited by 5,259 · cited 4×
“We compare our method with several representative methods including DynamicViT [69], IA-RED2 [64], RegNetY [67], CrossViT [7], VTP [112], ATS [28], CvT [85], PVT [83], T2T-ViT [104], UP-DeiT [95], PS-ViT [78], Evo-ViT [89], TNT [34], HVT [65], Swin [49], CoaT [88], CPVT [18], EViT [46], UVC [97], MD-DeiT [39],and S2Vi…”
BackgroundMethodInfluentialRethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · cited 1×
“former (ViT), which solely exploits the self-attention mechanism that inherits from the Transformer architecture, has set up many state-of-the-art (SOTA) records in image classifications [22,79,7], object detection [3,19,1,60], tracking [15,91,59], semantic segmentation [110,16], depth estimation [94,45], image retrie…”
BackgroundSelf-citationZhao, H., Jiang, L., Jia, J., Torr, P. H. S., & Koltun, V. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01595 · Cited by 3,005
Research works printed but not linked: 33
- Bao, H., Dong, L., Piao, S., Wei, F.: BEit: BERT pre-training of image transformers. In: International Conference on Learning Representations (2022). https://openreview.net/forum?id=p-BhZSz59o4
- Chen, B., et al.: Psvit: better vision transformer via token pooling and attention sharing. arXiv preprint arXiv:2108.03428 (2021) · arXiv
- Chen, P., Chen, Y., Liu, S., Yang, M., Jia, J.: Exploring and improving mobile level vision transformers. arXiv preprint arXiv:2108.13015 (2021) · arXiv
- Chen, T., Chen, X., Ma, X., Wang, Y., Wang, Z.: Coarsening the granularity: towards structurally sparse lottery tickets. In: Proceedings of the International Conference on Machine Learning (ICML) (2022)
- Chen, T., Saxena, S., Li, L., Fleet, D.J., Hinton, G.: Pix2seq: a language modeling framework for object detection. arXiv preprint arXiv:2109.10852 (2021) · arXiv
- Chen, X., Hsieh, C.J., Gong, B.: When vision transformers outperform resnets without pre-training or strong data augmentations. In: International Conference on Learning Representations (2022). https://openreview.net/forum?id=LtKcMgGOeLt
- Cheng, B., Schwing, A., Kirillov, A.: Per-pixel classification is not all you need for semantic segmentation. In: Beygelzimer, A., Dauphin, Y., Liang, P., Vaughan, J.W. (eds.) Advances in Neural Information Processing Systems (2021). https://openreview.net/forum?id=0lz69oI5iZP
- Chu, X., et al.: Conditional positional encodings for vision transformers. arXiv preprint arXiv:2102.10882 (2021) · arXiv
- Dosovitskiy, A., et al.: An image is worth 16 $$\times $$ 16 words: transformers for image recognition at scale. In: International Conference on Learning Representations (2021). https://openreview.net/forum?id=YicbFdNTTy
- El-Nouby, A., Neverova, N., Laptev, I., Jégou, H.: Training vision transformers for image retrieval. arXiv preprint arXiv:2102.05644 (2021) · arXiv
- Fayyaz, M., et al.: Ats: adaptive token sampling for efficient vision transformers. arXiv preprint arXiv:2111.15667 (2021) · arXiv
- Gao, P., Lu, J., Li, H., Mottaghi, R., Kembhavi, A.: Container: context aggregation network. arXiv preprint arXiv:2106.01401 (2021) · arXiv
- Jia, D., et al.: Efficient vision transformers via fine-grained manifold distillation. arXiv preprint arXiv:2107.01378 (2021) · arXiv
- Jiang, Z., et al.: All tokens matter: token labeling for training better vision transformers. arXiv preprint arXiv:2104.10858 (2021) · arXiv
- Kornblith, S., Norouzi, M., Lee, H., Hinton, G.: Similarity of neural network representations revisited. In: International Conference on Machine Learning, pp. 3519–3529. PMLR (2019)
- Liang, Y., GE, C., Tong, Z., Song, Y., Wang, J., Xie, P.: EVit: expediting vision transformers via token reorganizations. In: International Conference on Learning Representations (2022). https://openreview.net/forum?id=BjyvwnXXVn_
- Liu, N., et al.: Lottery ticket preserves weight correlation: is it desirable or not? In: International Conference on Machine Learning (ICML), pp. 7011–7020. PMLR (2021)
- Liu, Y., Sangineto, E., Bi, W., Sebe, N., Lepri, B., De Nadai, M.: Efficient training of visual transformers with small-size datasets. arXiv preprint arXiv:2106.03746 (2021) · arXiv
- Ma, X., et al.: Sanity checks for lottery tickets: Does your winning ticket really win the jackpot? In: Advances in Neural Information Processing Systems (NeurIPS) 34 (2021)
- Pan, B., Jiang, Y., Panda, R., Wang, Z., Feris, R., Oliva, A.: Ia-red$$^2$$: Interpretability-aware redundancy reduction for vision transformers. In: Advances in Neural Information Processing Systems (2021)
- Prillo, S., Eisenschlos, J.: Softsort: a continuous relaxation for the argsort operator. In: International Conference on Machine Learning, pp. 7793–7802. PMLR (2020)
- Raghu, M., Unterthiner, T., Kornblith, S., Zhang, C., Dosovitskiy, A.: Do vision transformers see like convolutional neural networks? arXiv preprint arXiv:2108.08810 (2021) · arXiv
- Rao, Y., Zhao, W., Liu, B., Lu, J., Zhou, J., Hsieh, C.J.: Dynamicvit: efficient vision transformers with dynamic token sparsification. In: Advances in Neural Information Processing Systems (2021)
- Renggli, C., Pinto, A.S., Houlsby, N., Mustafa, B., Puigcerver, J., Riquelme, C.: Learning to merge tokens in vision transformers. arXiv preprint arXiv:2202.12015 (2022) · arXiv
- Ryoo, M.S., Piergiovanni, A., Arnab, A., Dehghani, M., Angelova, A.: Tokenlearner: what can 8 learned tokens do for images and videos? In: Advances in Neural Information Processing Systems (2021)
- Sanh, V., Wolf, T., Rush, A.M.: Movement pruning: adaptive sparsity by fine-tuning. arXiv preprint arXiv:2005.07683 (2020) · arXiv
- Steiner, A., Kolesnikov, A., Zhai, X., Wightman, R., Uszkoreit, J., Beyer, L.: How to train your vit? data, augmentation, and regularization in vision transformers. arXiv preprint arXiv:2106.10270 (2021) · arXiv
- Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., J’egou, H.: Training data-efficient image transformers & distillation through attention. In: ICML (2021)
- Wu, B., et al.: Visual transformers: token-based image representation and processing for computer vision. arXiv preprint arXiv:2006.03677 (2020) · arXiv
- Yu, H., Wu, J.: A unified pruning framework for vision transformers. arXiv preprint arXiv:2111.15127 (2021) · arXiv
- Yu, Q., Xia, Y., Bai, Y., Lu, Y., Yuille, A., Shen, W.: Glance-and-gaze vision transformer. In: Advances in Neural Information Processing Systems (2021)
- Yuan, L., et al.: Tokens-to-token vit: training vision transformers from scratch on imagenet. arXiv preprint arXiv:2101.11986 (2021) · DOI · Paper page
- Zhu, M., Han, K., Tang, Y., Wang, Y.: Visual transformer pruning. In: KDD 2021 Workshop on Model Mining (2021)
Cited by
Sorted by citations
Items 101–172 of 172
HASS: Hardware-Aware Sparsity Search for Dataflow DNN Accelerator
Yu, Z., Sreeram, S., Agrawal, K., Wu, J., Montgomerie-Corcoran, A., Zhang, C., Cheng, J., Bouganis, C.-S., & Zhao, Y. (2024) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl64840.2024.00043 · Cited by 2
AToM: Adaptive Token Merging for Efficient Acceleration of Vision Transformer
Shin, J., Kang, M., Han, Y., Park, J., & Kim, L. (2025) · IEEE Transactions on Computers · doi:10.1109/tc.2025.3540638 · Cited by 4
Eliopoulos, N., Jajal, P., Davis, J. C., Liu, G., Thiravathukal, G. K., & Lu, Y.-H. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00695 · Cited by 4
Wang, A., Chen, H., Lin, Z., Zhao, S., Han, J., & Ding, G. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3616854 · Cited by 12
Analysis Towards Deployment and Acceleration for ViT on a Lightweight RISC- V Processor
Kaneko, H., & Meng, L. (2024) · International Conference on Industrial Artificial Intelligence (IAI) · doi:10.1109/iai63275.2024.10730301 · Cited by 1
TA-ASF: Attention-Sensitive Token Sampling and Fusing for Visual Transformer Models on the Edge
Chen, J., Zhang, X., Zhou, W., & Shi, W. (2024) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec62691.2024.00018 · Cited by 1
Zhang, Q., Yang, Z., Shao, M., & Liang, H. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-06927-2 · Cited by 1
Hardware Accelerators for Hyperspectral Image Classification in Space
Viel, F., Zeferino, C. A., & Bezerra, E. A. (2025) · Intelligent systems reference library · doi:10.1007/978-3-031-83123-2_3 · Cited by 1
Zou, Z., Yan, X., Zhang, C., Chen, S., Yang, G. Q., Han, Y., Cai, H., & Liu, B. (2025) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2025.3565468 · Cited by 1
Spatial correlation guided cross scale feature fusion for age and gender estimation
Jiang, S., Ji, Q., Shi, H., Chen, C., & Yang, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-03081-w · Cited by 1
Efficient Distortion-Minimized Layerwise Pruning
Xu, K., Wang, Z., Huang, R., Geng, X., Lin, J., Yang, X., Wu, M., Li, X., & Lin, W. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3586418 · Cited by 2
LKCA-Net: Hybrid large kernel and clustering attention network for medical image segmentation
Ji, Z., & Nie, M. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108432 · Cited by 1
Yang, L., Shen, D., Cai, C., Chen, K., Yang, F., Gao, T., Zhang, D., & Li, X. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00878 · Cited by 1
Vote & Mix: Plug-and-Play Token Reduction for Efficient Vision Transformer
Peng, S., Fu, D., Wei, B., Gao, L., & Tang, Z. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209953 · Cited by 8
TF-ATM: Training-Free Adaptive Token Merging
Zhang, X., Xie, W., Li, Y., Chen, X., Hui, T., Ma, J., & Fang, L. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754503 · Cited by 1
Where Do Tokens Go? Understanding Pruning Behaviors in STEP at High Resolutions
Szczepanski, M., Poreba, M., & Haroun, K. (2026) · SN Computer Science · doi:10.1007/s42979-025-04707-6 · Cited by 1
Deniz, O. F., Mao, R., Li, R., Tian, Y., & Khan, L. R. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402394 · Cited by 1
SaTPhys: Sandglass Transformer for Efficient Video-Based Remote Physiological Measurement
Chu, S., Shi, J., Yuan, M., Li, X., Jiang, Z., & Zhao, G. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3686300 · Cited by 1
Aduvuku, V., Andogah, G., & Habibu, T. (2026) · Journal of Future Artificial Intelligence and Technologies · doi:10.62411/faith.3048-3719-354 · Cited by 1
DynaSlim: Dynamic Slimming for Vision Transformers
Shi, D., Gao, J., Liu, T., & Fu, Y. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00251 · Cited by 1
Token Merging with Class Importance Score
Seol, K., Roh, S.-D., & Chung, K. (2023) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon51785.2023.10312420 · Cited by 2
Ma, Z., & Li, K. (2023) · Mathematics · doi:10.3390/math12010057 · Cited by 1
Memory-Efficient Vision Transformers: An Activation-Aware Mixed-Rank Compression Strategy
Azizi, S., Nazemi, M., & Pedram, M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91979-4_6 · Cited by 1
Shifted Window Fourier Transform and Retention for Image Captioning
Hu, J. C., Cavicchioli, R., & Capotondi, A. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6596-9_12 · Cited by 2
Efficient 3D human pose estimation via spatio-temporal graph transformer with token pruning
Li, Z., Chen, H., Wang, F., Xu, G., Liu, Q., & Pan, Y. (2025) · Multimedia Systems · doi:10.1007/s00530-025-01987-z · Cited by 1
Kong, Z., Li, Y., Zeng, F., Xin, L., Messica, S., Lin, X., Zhao, P., Kellis, M., Tang, H., & Zitnik, M. (2025) · arXiv · doi:10.48550/arxiv.2505.18227 · Cited by 51
“SPViT [73] introduces a soft pruning technique, which integrates the less informative tokens generated by the selector module into a package token that will participate in subsequent Efficiency ✓ ⇒ Future ? calculations rather than being completely discarded.”
Self-citationMultimodal Promptable Token Merging for Diffusion Models
Hong, C.-Y., & Liu, T.-L. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i16.33894
Automatic Hyper-Parameter Search for Vision Transformer Pruning
Feng, J., Zhao, S., Peng, L., Pan, S., Chen, H., Li, Z., Ke, G., Wang, G., & Long, Y. (2023) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1109/prai59366.2023.10332058
Ph.D. Project: Modernizing High-Level Hardware Design Workflows
Sarkar, R., & Hao, C. (2024) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm60383.2024.00057
Su, D., Fei, C., & Luo, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73220-1_19 · Cited by 1
Multistage Compression Optimization Strategies for Accelerating Diffusion Models
Huang, W., & Chen, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-8487-5_16
Unified Local-Cloud Decision-Making via Reinforcement Learning
Sengupta, K., Shangguan, Z., Bharadwaj, S., Arora, S., Ohn-Bar, E., & Mancuso, R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72940-9_11
Human Body Segmentation in Wide-Angle Images Based on Fast Vision Transformers
Yu, X. Y., Hua, Y., Zhang, S., & Xu, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3507272
Target-specific and Temporal Transformer for Visual Tracking
Hu, J., Zhao, H., Jia, J., Chen, Y., Zhao, L., Han, Y., & Wang, M. (2024) · International Conference on Virtual Reality · doi:10.1109/icvr62393.2024.10868675
Fang, H., Wu, Z., Zou, X., Huang, J., Cao, J., & Tang, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888167
Learning Content-Aware Multi-Modal Joint Input Pruning via Birds'-Eye-View Representation
Li, Y., Li, Y., Yang, X., Yu, M., Huang, Z., Wu, X., & Yeo, C. K. (2024) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc58415.2024.10920182
Patch Ranking: Token Pruning as Ranking Prediction for Efficient CLIP
Wu, C.-E. R., Lin, J., Hu, Y. H., & Morgado, P. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00570 · Cited by 1
Hybrid Token Selector based Accelerator for ViTs
Yadav, A., Goyal, A., & Das, P. (2025) · Design, Automation, and Test in Europe · doi:10.23919/date64628.2025.10992869
Language-Guided Adaptive Vision Token Pruning for Efficient Multimodal Large Language Models
Deniz, O. F., Arici, T., Sheikholeslami, F., Gozluklu, B., Trabelsi, A., Khan, S. A., Tian, Y., & Khan, L. R. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8186-0_9
Exploring the Neural Burden in Pruned Models: An Insight Inspired by Neuroscience
Wang, Z., Dai, W., Zhou, X., Qi, J., & Zhou, Y. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6954-7_31
Refining visual token sequence for efficient image captioning
Xian, T., Zhou, Z., Zhou, W., & Zhang, Z. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107759
PAT-ViT: Token Pruning-based Adversarial Tuning for Robust Vision Transformers
Yang, Y., Luo, Y.-J., Chen, W., Wu, A.-Y. A., Huang, S.-H., & Bereković, M. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11044207
Selective Targeting for Enhanced Salient Object Detection
Cao, X. L., & Ma, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9863-9_2
Midframe-centric token merging for efficient video transformer
Zhang, Q., Yang, Z., Shao, M., & Liang, H. (2025) · Cluster Computing · doi:10.1007/s10586-025-05478-8
Window Token Concatenation for Efficient Visual Large Language Models
Li, Y., Bao, W., Ye, B., Tan, Z., Chen, T., Liu, H., & Kong, Y. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00301 · Cited by 1
Secure Token Pruning Mechanism and Accelerator for Vision Transformer
Li, Q., Yang, J., Xu, F., Zhang, F., Zhang, X., Li, Z., Shao, J., & Wang, Y. (2025) · doi:10.1109/iccad66269.2025.11240783 · Cited by 1
Self-citationTask-Oriented Token Pruning for Efficient Object Detection and Segmentation
Liang, H. Z., Kan, M., Shan, S., & Chen, X. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246298
Token Compression Meets Compact Vision Transformers: a Survey and Comparative Evaluation for Edge AI
Nguyen, P., & Cheung, N. M. (2025) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc65261.2025.11249396 · Cited by 3
Hierarchical Indexing with Knowledge Enrichment for Multilingual Video Corpus Retrieval
Wang, Y., Tan, T., & Wang, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3352-7_33
Self-citationQuery-based Collaborative Multimodal Token Pruning for Audio-Visual Question Answering
Qin, X., Hong, D., Chen, W., Ye, C., Liu, X., Song, P., & Zhang, L. (2025) · International Conference on Artificial Intelligence, Human-Computer Interaction and Robotics (AIHCIR) · doi:10.1109/aihcir67580.2025.11405267
Xie, B., Shi, Z., Li, L., Hu, L., Fang, C., & Zhou, H. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.115018
2K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Prediction
Zhang, T., Liang, Z., Song, Z., Wang, N., Zhang, X., Cai, X., Zhu, Z., Wu, K., Wang, G., & Fan, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37550-6_9
Foveated Reasoning: Stateful, Action-Based Visual Focusing for Vision-Language Models
Min, J., Valkov, L., Petsiuk, V., Souri, H., & Mohan, D. D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36969-7_1
Comparing Deep Learning Models for the Recognition of Leaf Diseases in Cucurbit Crops
Osama, A. U., Iftee, I. K., Jobaier, M. H., & Mashfi, M. O. (2025) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit68739.2025.11491534
Progressive Token Pruning with Feature-Aware Distillation for ViTs
M, O. T., Mokashi, S. S., Harsha, B., K, S. H., & Jain, P. (2026) · International Conference on Recent Advancement in Electrical, Computer and Communication Technologies (IECCT) · doi:10.1109/iecct68664.2026.11541604
Liu, Y., Wang, T., Zhang, X., Wang, L., Zhao, Y., Ding, C., & Song, Q. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00607-8
RIFT: A Single-Bitstream, Runtime-Adaptive FPGA-Based Accelerator for Multimodal AI
Oh, H., Chen, H., Yun, S., Ni, Y., Jang, S., Khaleghi, B., Wen, F., & Imani, M. (2026) · Design, Automation, and Test in Europe · doi:10.23919/date69613.2026.11539726
Sarkar, R., & Hao, C. (2026) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm68464.2026.00082
Mercury: Towards Optimal Accuracy-Latency Trade-off for Collaborative Transformer Inference
Liang, Y., Chang, J., Li, S., Zang, M., & Wu, J. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571669
HypTM: Efficient Vision Transformers With Hyperbolic Token Merging
Chen, X. W., Zhang, X., Xie, W., Ma, J., Li, Y., & Fang, L. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3709249
Nguyen, T.-P., & Cheung, N. M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37174-4_6
Less Tokens, Better Forecasts: Sparse Residual Routing for Efficient Weather Prediction
Wang, J., Zhang, Y., Zhao, L., Xiao, X., Hamm, J., & Wang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37359-5_6 · Cited by 1
A Hardware Efficient Joint Compression Framework for Vision Transformers
Fan, X., Ma, Y., Chen, Z., & Liu, H. (2026) · IEEE Access · doi:10.1109/access.2026.3712528
Rényi Attention Entropy for Patch Pruning
Aizawa, H., & Igaue, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31441-3_2 · Cited by 1
Liao, W., Lou, J., & Xiong, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3780283 · Cited by 1
Khan, A., Junaid, A., Iqbal, A., Husnain, G., Shin, W., & Lim, S. (2026) · IEEE Access · doi:10.1109/access.2026.3720106 · Cited by 1
Joint MLP and Token Pruning for Personalizing Vision Transformers
Li, Z., Liu, T., Huang, F., Huang, X., & Zou, Z. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10080265
Rho, S., Park, S., Park, S., Kim, K., Song, M.-G., & Chung, K. (2026) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/3816440.3818568
Accelerating SAM2 With Efficient Memory Attention Module via Spatiotemporal Token Pruning
Puspitasari, F. D., Zhang, C., Mandal, A., Zheng, S., Qin, C., Kim, T.-H., Lee, J., Wang, G., Yang, Y., & Shen, H. T. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3723878
Seeing Like Humans: Task-Driven Token Reduction for Efficient ViT in Robotic Navigation
Liang, H., Kan, M., Shan, S., & Xilin, C. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3741774
MPM: Mutual Pair Merging for Efficient Vision Transformers
Ravé, S., Rasti, P., & Rousseau, D. (2026) · doi:10.1109/cvprf71909.2026.00292
SPOT: Sparsification with Attention Dynamics via Token Relevance in Vision Transformers
Schlesinger, O., Farzam, A., Martino, J. M. D., & Sapiro, G. (2026) · doi:10.1109/cvprf71909.2026.00228
Metadata
- Authors
- Kong, Z., Dong, P., Ma, X., Meng, X., Niu, W., Sun, M., Shen, X., Yuan, G., Ren, B., Tang, H., Qin, M., & Wang, Y.
- Affiliations
- Northeastern University (US)
- Clemson University (US)
- Peking University (CN)
- William & Mary (US)
- ETH Zurich (CH)
- Corresponding author
- Wang, Yanzhi
- ORCID
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer Nature Switzerland
- Published
- 2022
- Pages
- 620-640
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W4312910119
- Cited by
- 169
- References
- 84
- Citations by year
- 2026: 25 · 2025: 61 · 2024: 55 · 2023: 25 · 2022: 3
- FWCI
- 13.06
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Lecture notes in computer science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- vision transformer, token selection, multi-head attention, edge deployment, mobile devices, FPGA, real-time inference, DeiT, Swin Transformer, computation cost reduction, accuracy-latency trade-off
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
