Mobile-Former: Bridging MobileNet and Transformer
Open accessAbstract
We present Mobile-Former, a parallel design of MobileNet and transformer with a two-way bridge in between. This structure leverages the advantages of MobileNet at local processing and transformer at global interaction. And the bridge enables bidirectional fusion of local and global features. Different from recent works on vision transformer, the transformer in Mobile-Former contains very few tokens (e.g. 6 or fewer tokens) that are randomly initialized to learn global priors, resulting in low computational cost. Combining with the proposed light-weight cross attention to model the bridge, Mobile-Former is not only computationally efficient, but also has more representation power. It outperforms MobileNetV3 at low FLOP regime from 25M to 500M FLOPs on ImageNet classification. For instance, Mobile-Former achieves 77.9% top-1 accuracy at 294M FLOPs, gaining 1.3% over MobileNetV3 but saving 17% of computations. When transferring to object detection, Mobile-Former outperforms MobileNetV3 by 8.6 AP in RetinaNet framework. Furthermore, we build an efficient end-to-end detector by replacing backbone, encoder and decoder in DETR with Mobile-Former, which outperforms DETR by 1.3 AP but saves 52% of computational cost and 36% of parameters. Code will be released at https://github.com/aaboys/mobileformer.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Mobile-former exceeds MobileNetV3 accuracy by 1.3 percentage points on ImageNet.
“exceeds MobileNetV3 accuracy by 1.3 percentage points on the ImageNet dataset.”
From A Survey of Techniques for Optimizing Transformer Inference (2023) · cites this paper as [178]
Mobile-former outperforms DETR by 1.1 AP on object detection.
“The network also outperforms DETR [8] by 1.1 AP on the object detection task.”
From A Survey of Techniques for Optimizing Transformer Inference (2023) · cites this paper as [178]
Mobile-former employs parallel MobileNetV2 and Transformer modules with two-way bridges.
“The Mobile-former network [178] employs parallel MobileNetV2 and Transformer modules with twoway bridges (Mobile → Former and Mobile ← Former).”
From A Survey of Techniques for Optimizing Transformer Inference (2023) · cites this paper as [178]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667 · see citing works
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534 · see citing works
Self-citationFeature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939 · see citing works
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581 · see citing works
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755 · see citing works
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015 · see citing works
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285 · see citing works
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072 · see citing works
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522 · see citing works
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157 · see citing works
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982 · see citing works
EfficientDet: Scalable and Efficient Object Detection
Tan, M., Pang, R., & Le, Q. V. (2019) · arXiv · Cited by 9,841 · see citing works
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708 · see citing works
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356 · see citing works
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831 · see citing works
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00061 · Cited by 5,259 · see citing works
GhostNet: More Features From Cheap Operations
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00165 · Cited by 5,222 · see citing works
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00020 · Cited by 4,026 · see citing works
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617 · see citing works
CvT: Introducing Convolutions to Vision Transformers
Wu, H., Xiao, B., Codella, N., Liu, M., Dai, X., Yuan, L., & Zhang, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00009 · Cited by 2,649 · see citing works
Self-citationTokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F. E. H., Feng, J., & Yan, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00060 · Cited by 2,415 · see citing works
Self-citationCrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification
Chen, C.-F. R., Fan, Q., & Panda, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00041 · Cited by 2,242 · see citing works
MLP-Mixer: An all-MLP Architecture for Vision
Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., Uszkoreit, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2105.01601 · Cited by 2,087 · see citing works
Dynamic Convolution: Attention Over Convolution Kernels
Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., & Liu, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01104 · Cited by 1,582 · see citing works
Self-citationCSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows
Dong, X., Bao, J., Chen, D., Zhang, W., Yu, N., Yuan, L., Chen, D., & Guo, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01181 · Cited by 1,458 · see citing works
Self-citationBottleneck Transformers for Visual Recognition
Srinivas, A., Lin, T.-Y., Parmar, N., Shlens, J., Abbeel, P., & Vaswani, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01625 · Cited by 1,385 · see citing works
Going deeper with Image Transformers
Touvron, H., Cord, M., Sablayrolles, A., Synnaeve, G., & Jegou, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00010 · Cited by 1,259 · see citing works
LeViT: a Vision Transformer in ConvNet’s Clothing for Faster Inference
Graham, B., El-Nouby, A., Touvron, H., Stock, P., Joulin, A., Jegou, H., & Douze, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01204 · Cited by 935 · see citing works
Mixup: Beyond empirical risk minimizationPreprint
Zhang, H. (2024) · arXiv (Cornell University) · doi:10.57702/dcy1c3gw · Cited by 923 · see citing works
Conformer: Local Features Coupling Global Representations for Visual Recognition
Peng, Z., Huang, W. F., Gu, S., Xie, L., Wang, Y., Jiao, J., & Ye, Q. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00042 · Cited by 900 · see citing works
ConViT: improving vision transformers with soft convolutional inductive biases
d’Ascoli, S., Touvron, H., Leavitt, M. L., Morcos, A. S., Biroli, G., & Sagun, L. (2022) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/ac9830 · Cited by 782 · see citing works
CondConv: Conditionally Parameterized Convolutions for Efficient InferencePreprint
Yang, B., Bender, G., Le, Q. V., & Ngiam, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04971 · Cited by 573 · see citing works
Early Convolutions Help Transformers See BetterPreprint
Xiao, T., Singh, M., Mintun, E., Darrell, T., Dollár, P., & Girshick, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14881 · Cited by 565 · see citing works
Scaling Local Self-Attention for Parameter Efficient Visual Backbones
Vaswani, A., Ramachandran, P., Srinivas, A., Parmar, N., Hechtman, B. A., & Shlens, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01270 · Cited by 483 · see citing works
(2021) · International Conference on Learning Representations · Cited by 449 · see citing works
Co-Scale Conv-Attentional Image Transformers
Xu, W., Xu, Y., Chang, T. A., & Tu, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00983 · Cited by 425 · see citing works
MixConv: Mixed Depthwise Convolutional KernelsPreprint
Tan, M., & Le, Q. V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09595 · Cited by 421 · see citing works
DeepViT: Towards Deeper Vision Transformer
Zhou, D., Kang, B., Jin, X., Yang, L., Lian, X., Jiang, Z., Hou, Q., & Feng, J. (2021) · arXiv · doi:10.48550/arxiv.2103.11886 · Cited by 398 · see citing works
Rethinking Bottleneck Structure for Efficient Mobile Network Design
Zhou, D., Hou, Q., Chen, Y., Feng, J., & Yan, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_40 · Cited by 292 · see citing works
Self-citationAdderNet: Do We Really Need Multiplications in Deep Learning?
Chen, H., Wang, Y., Xu, C., Shi, B., Xu, C., Tian, Q., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00154 · Cited by 199 · see citing works
Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., & Liu, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_21 · Cited by 189 · see citing works
Self-citationHow to Represent Part-Whole Hierarchies in a Neural Network
Hinton, G. E. (2022) · Neural Computation · doi:10.1162/neco_a_01557 · Cited by 173 · see citing works
MicroNet: Improving Image Recognition with Extremely Low FLOPs
Li, Y., Chen, Y., Dai, X., Chen, D., Liu, M., Yuan, L., Liu, Z., Zhang, L., & Vasconcelos, N. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00052 · Cited by 122 · see citing works
Self-citationWeightNet: Revisiting the Design Space of Weight Networks
Ma, N., Zhang, X., Huang, J., & Sun, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_46 · Cited by 105 · see citing works
LeViT: a Vision Transformer in ConvNet's Clothing for Faster InferencePreprint
Graham, B. V., El-Nouby, A., Touvron, H., Stock, P., Joulin, A., Jeǵou, H., & Douze, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01136 · Cited by 88 · see citing works
ConTNet: Why not use convolution and transformer at the same time?Preprint
Yan, H., Li, Z., Li, W., Wang, C., Wu, M., & Zhang, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.13497 · Cited by 79 · see citing works
Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNetsPreprint
Han, K., Wang, Y., Zhang, Q., Zhang, W., Xu, C., & Zhang, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14819 · Cited by 63 · see citing works
Refiner: Refining Self-attention for Vision TransformersPreprint
Zhou, D., Shi, Y., Kang, B., Yu, W., Jiang, Z., Li, Y., Jin, X., Hou, Q., & Feng, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03714 · Cited by 53 · see citing works
Butterfly Transform: An Efficient FFT Based Neural Architecture Design
Alizadeh, K., Prabhu, A., Farhadi, A., & Rastegari, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01204 · Cited by 46 · see citing works
Flagged first, then by citations
2 of the 55 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks
Chen, J., Kao, S.-H., He, H., Zhuo, W., Song, W., Lee, C.-H., & Chan, S.-H. G. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01157 · Cited by 2,556 · see citing works
A review of convolutional neural networks in computer vision
Zhao, X., Wang, L., Zhang, Y., Han, X., Deveci, M., & Parmar, M. D. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10721-6 · Cited by 1,326 · see citing works
Transfer learning for medical image classification: a literature review
Kim, H. E., Cosa‐Linan, A., Santhanam, N., Jannesari, M., Maros, M. E., & Ganslandt, T. (2022) · BMC Medical Imaging · doi:10.1186/s12880-022-00793-7 · Cited by 1,036 · see citing works
EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention
Liu, X., Peng, H., Zheng, N., Yang, Y., Hu, H., & Yuan, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01386 · Cited by 956 · see citing works
SCConv: Spatial and Channel Reconstruction Convolution for Feature Redundancy
Li, J., Wen, Y., & He, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00596 · Cited by 823 · see citing works
MobileNetV4: Universal Models for the Mobile Ecosystem
Qin, D., Leichner, C., Delakis, M., Fornoni, M., Luo, S., Yang, F., Wang, W., Banbury, C., Ye, C., Akin, B., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73661-2_5 · Cited by 746 · see citing works
Rep ViT: Revisiting Mobile CNN From ViT Perspective
Wang, A., Chen, H., Lin, Z., Han, J., & Ding, G. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01506 · Cited by 752 · see citing works
Ma, X., Dai, X., Bai, Y., Wang, Y., & Fu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00544 · Cited by 663 · see citing works
Self-citationUniFormer: Unifying Convolution and Self-Attention for Visual Recognition
Li, K., Wang, Y., Zhang, J., Gao, P., Song, G., Liu, Y., Li, H., & Qiao, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3282631 · Cited by 636 · see citing works
MedViT: A robust vision transformer for generalized medical image classification
Manzari, O. N., Ahmadabadi, H., Kashiani, H., Shokouhi, S. B., & Ayatollahi, A. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106791 · Cited by 537 · see citing works
TinyViT: Fast Pretraining Distillation for Small Vision Transformers
Wu, K., Zhang, J., Peng, H., Liu, M., Xiao, B., Fu, J., & Yuan, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19803-8_5 · Cited by 480 · see citing works
Self-citationA survey of the vision transformers and their CNN-transformer based variants
Khan, A., Rauf, Z., Sohail, A., Khan, A. R., Asif, H., Asif, A., & Farooq, U. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10595-0 · Cited by 496 · see citing works
MobileOne: An Improved One millisecond Mobile Backbone
Vasu, P. K. A., Gabriel, J., Zhu, J. X., Tuzel, O., & Ranjan, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00764 · Cited by 450 · see citing works
Edgenext: Efficiently amalgamated CNN-transformer architecture for mobile vision applications
Maaz, M., Shaker, A., Cholakkal, H., Khan, S., Zamir, S. W., Anwer, R. M., & Shahbaz Khan, F. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-25082-8_1 · Cited by 407 · see citing works
DilateFormer: Multi-Scale Dilated Transformer for Visual Recognition
Jiao, J., Tang, Y.-M., Lin, K.-Y., Gao, Y., Ma, A. J., Wang, Y., & Zheng, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3243616 · Cited by 412 · see citing works
Li, J., Chen, J., Tang, Y., Wang, C., Landman, B. A., & Zhou, S. K. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102762 · Cited by 426 · see citing works
A review of convolutional neural network architectures and their optimizations
Cong, S., & Zhou, Y. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10213-5 · Cited by 397 · see citing works
TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation
Zhang, W., Huang, Z., Luo, G., Chen, T., Wang, X., Liu, W., Yu, G., & Shen, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01177 · Cited by 374 · see citing works
Rethinking Vision Transformers for MobileNet Size and Speed
Li, Y., Ju, H., Wen, Y., Evangelidis, G., Salahi, K., Wang, Y., Tulyakov, S., & Ren, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01549 · Cited by 369 · see citing works
FLatten Transformer: Vision Transformer using Focused Linear Attention
Han, D., Pan, X., Han, Y., Song, S., & Huang, G. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00548 · Cited by 359 · see citing works
Rethinking Mobile Block for Efficient Attention-based Models
Zhang, J., Li, X., Li, J., Liu, L., Xue, Z., Zhang, B., Jiang, Z., Huang, T., Wang, Y., & Wang, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00134 · Cited by 346 · see citing works
EfficientViT: Lightweight Multi-Scale Attention for High-Resolution Dense Prediction
Cai, H., Li, J., Hu, M., Gan, C., & Han, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01587 · Cited by 356 · see citing works
Spatially-Adaptive Feature Modulation for Efficient Image Super-Resolution
Sun, L., Dong, J., Tang, J., & Pan, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01213 · Cited by 308 · see citing works
SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applications
Shaker, A., Maaz, M., Rasheed, H., Khan, S., Yang, M., & Khan, F. S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01598 · Cited by 299 · see citing works
ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond
Zhang, Q., Xu, Y., Zhang, J., & Tao, D. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-022-01739-w · Cited by 465 · see citing works
Lightweight Deep Learning for Resource-Constrained Environments: A Survey
Liu, H.-I., Galindo, M., Xie, H., Wong, L.-K., Shuai, H.-H., Li, Y., & Cheng, W.-H. (2024) · ACM Computing Surveys · doi:10.1145/3657282 · Cited by 296 · see citing works
A Transformer-Based Feature Segmentation and Region Alignment Method for UAV-View Geo-Localization
Dai, M., Hu, J., Zhuang, J., & Zheng, E. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3135013 · Cited by 254 · see citing works
Conv2Former: A Simple Transformer-Style ConvNet for Visual Recognition
Hou, Q., Lu, C.-Z., Cheng, M., & Feng, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3401450 · Cited by 256 · see citing works
BEVT: BERT Pretraining of Video Transformers
Wang, R., Chen, D., Wu, Z., Chen, Y., Dai, X., Liu, M., Jiang, Y.-G., Zhou, L., & Yuan, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01432 · Cited by 234 · see citing works
Self-citationEmotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240 · see citing works
Omni Aggregation Networks for Lightweight Image Super-Resolution
Wang, H., Chen, X., Ni, B., Liu, Y., & Liu, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02143 · Cited by 227 · see citing works
Scale-Aware Modulation Meet Transformer
Lin, W., Wu, Z., Chen, J., Huang, J., & Jin, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00553 · Cited by 229 · see citing works
SHViT: Single-Head Vision Transformer with Memory Efficient Macro Design
Yun, S., & Ro, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00550 · Cited by 208 · see citing works
Protecting Celebrities from DeepFake with Identity Consistency Transformer
Dong, X., Bao, J., Chen, D., Zhang, T., Zhang, W., Yu, N., Chen, D., Wen, F., & Guo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00925 · Cited by 181 · see citing works
Self-citationReview of Lightweight Deep Convolutional Neural Networks
Chen, F., Li, S., Han, J., Ren, F., & Yang, Z. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-10032-z · Cited by 172 · see citing works
Lite Vision Transformer with Enhanced Self-Attention
Yang, C., Wang, Y., Zhang, J., Zhang, H., Wei, Z., Lin, Z., & Yuille, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01169 · Cited by 164 · see citing works
Convolution Transformer Mixer for Hyperspectral Image Classification
Zhang, J., Meng, Z., Zhao, F., Liu, H., & Chang, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3208935 · Cited by 157 · see citing works
Zheng, Q., Tian, X., Yu, Z., Ding, Y., Elhanashi, A., Saponara, S., & Kpalma, K. (2023) · Drones · doi:10.3390/drones7100596 · Cited by 157 · see citing works
A Survey of Techniques for Optimizing Transformer Inference
Chitty-Venkata, K. T., Mittal, S., Emani, M., Vishwanath, V., & Somani, A. K. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102990 · Cited by 154 · see citing works
SeaFormer++: Squeeze-Enhanced Axial Transformer for Mobile Visual Recognition
Wan, Q., Huang, Z., Lu, J., Yu, G., & Zhang, L. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02345-2 · Cited by 173 · see citing works
He, Y., Nath, V., Yang, D., Tang, Y., Myronenko, A., & Xu, D. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43901-8_40 · Cited by 134 · see citing works
Head-Free Lightweight Semantic Segmentation with Linear Transformer
Dong, B., Wang, P., & Wang, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25126 · Cited by 125 · see citing works
PMVT: a lightweight vision transformer for plant disease identification on mobile devices
Li, G., Wang, Y., Zhao, Q. Q., Yuan, P., & Chang, B. (2023) · Frontiers in Plant Science · doi:10.3389/fpls.2023.1256773 · Cited by 139 · see citing works
Adaptive Frequency Filters As Efficient Global Token Mixers
Huang, Z., Zhang, Z., Lan, C., Zha, Z.-J., Lu, Y. Q., & Guo, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00556 · Cited by 116 · see citing works
Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolution
Yoo, J., Kim, T., Lee, S., Kim, S. H., Lee, H., & Kim, T. H. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00493 · Cited by 115 · see citing works
DBCTNet: Double Branch Convolution-Transformer Network for Hyperspectral Image Classification
Rui, X., Dong, X., Li, W., Peng, J., Sun, W., & Xu, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3368141 · Cited by 112 · see citing works
Self-citationSpectral super-resolution meets deep learning: Achievements and challenges
He, J., Yuan, Q., Li, J., Xiao, Y., Liu, D., Shen, H., & Zhang, L. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101812 · Cited by 115 · see citing works
SRConvNet: A Transformer-Style ConvNet for Lightweight Image Super-Resolution
Li, F., Cong, R., Wu, J., Bai, H., Wang, M., & Zhao, Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02147-y · Cited by 108 · see citing works
Reduce Information Loss in Transformers for Pluralistic Image Inpainting
Liu, Q., Tan, Z., Chen, D., Chu, Q., Dai, X., Chen, Y., Liu, M., Yuan, L., & Yu, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01106 · Cited by 107 · see citing works
Self-citationWang, A., Chen, H., Lin, Z., Han, J., & Ding, G. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00908 · Cited by 109 · see citing works
EdgeFace: Efficient Face Recognition Model for Edge Devices
George, A., Ecabert, C., Shahreza, H. O., Kotwal, K., & Marcel, S. (2024) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2024.3352164 · Cited by 122 · see citing works
MobileMamba: Lightweight Multi-Receptive Visual Mamba Network
He, H., Zhang, J., Cai, Y., Chen, H., Hu, X., Gan, Z., Wang, Y., Wang, C., Wu, Y., & Xie, L. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00424 · Cited by 109 · see citing works
TransCAM: Transformer attention-based CAM refinement for Weakly supervised semantic segmentation
Li, R., Mai, Z., Zhang, Z., Jang, J., & Sanner, S. (2023) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2023.103800 · Cited by 95 · see citing works
Tian, Y., Li, X., Zhang, H., Zhao, C., Li, B., Wang, X., Wang, X., & Wang, F. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3307012 · Cited by 98 · see citing works
BCU-Net: Bridging ConvNeXt and U-Net for medical image segmentation
Zhang, H., Zhong, X., Li, G., Liu, W., Liu, J., Ji, D., Li, X., & Wu, J. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106960 · Cited by 86 · see citing works
Hydra Attention: Efficient Attention with Many Heads
Bolya, D., Fu, C.-Y., Dai, X., Zhang, P., & Hoffman, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25082-8_3 · Cited by 85 · see citing works
Self-citationParC-Net: Position Aware Circular Convolution with Merits from ConvNets and Transformer
Zhang, H., Hu, W., & Wang, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_35 · Cited by 83 · see citing works
EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality
Lee, S., Choi, J., & Kim, H. J. (2024) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52734.2025.01390 · Cited by 88 · see citing works
A Lightweight Transformer Network for Hyperspectral Image Classification
Zhang, X., Su, Y., Gao, L., Bruzzone, L., Gu, X., & Tian, Q. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3297858 · Cited by 75 · see citing works
Dong, X., Shi, P., Liang, T., & Yang, A. (2024) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/03611981241258753 · Cited by 75 · see citing works
Self-citationChannel-Layer-Oriented Lightweight Spectral–Spatial Network for Hyperspectral Image Classification
Li, C., Rasti, B., Tang, X., Duan, P., Li, J., & Peng, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3350055 · Cited by 72 · see citing works
Image recognition based on lightweight convolutional neural network: Recent advances
Liu, Y., Xue, J., Li, D., Zhang, W., Chiew, T. K., & Xu, Z. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105037 · Cited by 81 · see citing works
A review of AI edge devices and lightweight CNN and LLM deployment
Sun, K., Wang, X., Miao, X., & Zhao, Q. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128791 · Cited by 76 · see citing works
Efficient deep learning-based tomato leaf disease detection through global and local feature fusion
Sun, H., Fu, R., Wang, X., Wu, Y., Al-Absi, M. A., Cheng, Z., Chen, Q., & Sun, Y. (2025) · BMC Plant Biology · doi:10.1186/s12870-025-06247-w · Cited by 72 · see citing works
DPNet: Dual-Path Network for Real-Time Object Detection With Lightweight Attention
Zhou, Q., Shi, H., Xiang, W., Kang, B., & Latecki, L. J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3376563 · Cited by 72 · see citing works
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer
Chen, X., Liu, Z., Tang, H., Yi, L., Zhao, H., & Han, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00205 · Cited by 74 · see citing works
Self-citationAdaptive and Background-Aware Vision Transformer for Real-Time UAV Tracking
Li, S., Yang, Y., Zeng, D., & Wang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01286 · Cited by 76 · see citing works
High-Order Structure Based Middle-Feature Learning for Visible-Infrared Person Re-identification
Qiu, L., Chen, S., Yan, Y., Xue, J., Wang, D., & Zhu, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28259 · Cited by 68 · see citing works
TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
Liu, R., Yang, K., Roitberg, A., Zhang, J., Peng, K., Liu, H., Wang, Y., & Stiefelhagen, R. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3455416 · Cited by 81 · see citing works
Haruna, Y., Qin, S., Chukkol, A. H. A., Yusuf, A. A., Bello, I., & Lawan, A. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110057 · Cited by 95 · see citing works
Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention
Wu, S., Wu, T., Tan, H., & Guo, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20176 · Cited by 65 · see citing works
Similarity-Guided Layer-Adaptive Vision Transformer for UAV Tracking
Xue, C., Zhong, B., Liang, Q., Zheng, Y., Li, N., Xue, Y., & Song, S. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00631 · Cited by 68 · see citing works
Transformer Meets Remote Sensing Video Detection and Tracking: A Comprehensive Survey
Jiao, L., Zhang, X., Liu, X., Liu, F., Yang, S., Ma, W., Li, L., Chen, P., Feng, Z., Guo, Y., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3289293 · Cited by 66 · see citing works
LW-CTrans: A lightweight hybrid network of CNN and Transformer for 3D medical image segmentation
Kuang, H., Wang, Y., Tan, X., Yang, J., Sun, J., Liu, J., Qiu, W., Zhang, J., Wang, J., Yang, C., et al. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103545 · Cited by 64 · see citing works
Self-citationFan, J., Gao, B., Ge, Q., Ran, Y., Zhang, J., & Chu, H. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3313982 · Cited by 63 · see citing works
CRA-Net: Transformer guided category-relation attention network for diabetic retinopathy grading
Zang, F., & Ma, H. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.107993 · Cited by 59 · see citing works
Leveraging Local and Global Cues for Visual Tracking via Parallel Interaction Network
Zheng, Y., Zhong, B., Liang, Q., Tang, Z., Ji, R., & Li, X. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3212987 · Cited by 59 · see citing works
Small object detection using deep feature learning and feature fusion network
Tong, K., & Wu, Y. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.107931 · Cited by 58 · see citing works
Few-shot learning based on deep learning: A survey
Zeng, W., & Xiao, Z.-Y. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2024029 · Cited by 57 · see citing works
GhostFormer: Efficiently amalgamated CNN-transformer architecture for object detection
Xie, X., Wu, D., Xie, M., & Li, Z. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110172 · Cited by 55 · see citing works
TextGT: A Double-View Graph Transformer on Text for Aspect-Based Sentiment Analysis
Yin, S., & Zhong, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29911 · Cited by 55 · see citing works
Depth-Wise Convolutions in Vision Transformers for efficient training on small datasets
Zhang, T., Xu, W., Luo, B., & Wang, G. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128998 · Cited by 58 · see citing works
Chen, Z., Yang, J., Chen, L., Feng, Z., & Jia, L. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105069 · Cited by 53 · see citing works
Road Traffic Sign Recognition Algorithm Based on Cascade Attention-Modulation Fusion Mechanism
An, F., Wang, J., & Liu, R. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3439699 · Cited by 55 · see citing works
A lightweight hybrid vision transformer network for radar-based human activity recognition
Huan, S., Wang, Z., Wang, X., Wu, L., Yang, X., Huang, H., & Dai, G. (2023) · Scientific Reports · doi:10.1038/s41598-023-45149-5 · Cited by 52 · see citing works
HIRI-ViT: Scaling Vision Transformer With High Resolution Inputs
Yao, T., Li, Y., Pan, Y., & Mei, T. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3379457 · Cited by 54 · see citing works
Wang, X., Jin, Y., Cen, Y.-G., Wang, T., Tang, B., & Li, Y.-D. (2022) · IEEE transactions on multimedia · doi:10.1109/tmm.2023.3318073 · Cited by 54 · see citing works
Dual Encoder–Decoder Network for Land Cover Segmentation of Remote Sensing Image
Zhong-chen, W., Xia, M., Weng, L., Hu, K., & Lin, H. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3347595 · Cited by 50 · see citing works
TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models
Ren, S., Wei, F., Zhang, Z., & Hu, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00359 · Cited by 49 · see citing works
Transformer-based multi-attention hybrid networks for skin lesion segmentation
Dong, Z.-W., Li, J., & Hua, Z. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123016 · Cited by 47 · see citing works
A survey of unmanned aerial vehicles and deep learning in precision agriculture
Wang, D., Zhao, M., Li, Z., Xu, S., Wu, X., Ma, X., & Liu, X. (2024) · European Journal of Agronomy · doi:10.1016/j.eja.2024.127477 · Cited by 52 · see citing works
EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm
Zhang, J., Li, X., Wang, Y., Wang, C., Yang, Y., Liu, Y., & Tao, D. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02034-6 · Cited by 53 · see citing works
Enhanced hybrid CNN and transformer network for remote sensing image change detection
Yang, J., Wan, H., & Shang, Z. (2025) · Scientific Reports · doi:10.1038/s41598-025-94544-7 · Cited by 45 · see citing works
AdaDet: An Adaptive Object Detection System Based on Early-Exit Neural Networks
Yang, L., Zheng, Z., Wang, J., Song, S., Huang, G. M., & Li, F. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3274214 · Cited by 44 · see citing works
A real-time and accurate convolutional neural network for fabric defect detection
Li, X., & Zhu, Y. T. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01317-8 · Cited by 44 · see citing works
Improved real-time object detection method based on YOLOv8: a refined approach
Zhong, J., Qian, H., Wang, H., Wang, W., & Zhou, Y. (2024) · Journal of Real-Time Image Processing · doi:10.1007/s11554-024-01585-8 · Cited by 44 · see citing works
METER: A Mobile Vision Transformer Architecture for Monocular Depth Estimation
Papa, L., Russo, P., & Amerini, I. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3260310 · Cited by 43 · see citing works
DBCT-Net:A dual branch hybrid CNN-transformer network for remote sensing image fusion
Wang, Q., Jin, X., Jiang, Q., Wu, L., Zhang, Y., & Zhou, W. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120829 · Cited by 43 · see citing works
Mobile Foundation Model as Firmware
Yuan, J., Yang, C., Cai, D., Wang, S., Yuan, X., Zhang, Z., Li, X., Zhang, D., Mei, H., Jia, X., et al. (2024) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3636534.3649361 · Cited by 51 · see citing works
RingMo-Lite: A Remote Sensing Lightweight Network With CNN-Transformer Hybrid Framework
Wang, Y., Zhang, T., Zhao, L., Hu, L., Wang, Z., Niu, Z., Cheng, P., Chen, K., Zeng, X., Wang, Z., et al. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3360447 · Cited by 48 · see citing works
- Authors
- Chen, Y., Dai, X., Chen, D., Liu, M., Dong, X., Yuan, L., & Liu, Z.
- Affiliations
- Microsoft (United States) (US)
- University of Science and Technology of China (CN)
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 5260-5269
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3190492058
- Cited by
- 731
- References
- 55
- Citations by year
- 2026: 71 · 2025: 196 · 2024: 238 · 2023: 178 · 2022: 44 · 2021: 4
- FWCI
- 59.48
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- MobileNet, vision transformer, global-local feature fusion, cross-attention, DETR, RetinaNet, ImageNet classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review