The DOI matches its Crossref record; 112 of the 112 references it cites were found in a registry or an index.
Model Compression for Deep Neural Networks: A Survey
Open accessAbstract
Currently, with the rapid development of deep learning, deep neural networks (DNNs) have been widely applied in various computer vision tasks. However, in the pursuit of performance, advanced DNN models have become more complex, which has led to a large memory footprint and high computation demands. As a result, the models are difficult to apply in real time. To address these issues, model compression has become a focus of research. Furthermore, model compression techniques play an important role in deploying models on edge devices. This study analyzed various model compression methods to assist researchers in reducing device storage space, speeding up model inference, reducing model complexity and training costs, and improving model deployment. Hence, this paper summarized the state-of-the-art techniques for model compression, including model pruning, parameter quantization, low-rank decomposition, knowledge distillation, and lightweight model design. In addition, this paper discusses research challenges and directions for future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356 · cited 1×
“ShuffleNetV2 [133] • Replacing 1 × 1 group convolution with 1 × 1 dense convolution.”
GhostNet: More Features From Cheap Operations
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00165 · Cited by 5,222
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Image segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416
FitNets: Hints for Thin Deep Nets
Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.6550 · Cited by 2,859
Learning Efficient Convolutional Networks through Network Slimming
Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., & Zhang, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.298 · Cited by 2,761
BinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Designing Network Design Spaces
Radosavovic, I., Kosaraju, R. P., Girshick, R., He, K., & Dollar, P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01044 · Cited by 2,084
Buciluǎ, C., Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150464 · Cited by 2,068
Zagoruyko, S., & Komodakis, N. (2016) · arXiv · doi:10.48550/arxiv.1612.03928 · Cited by 2,027
A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning
Yim, J., Joo, D., Bae, J., & Kim, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.754 · Cited by 1,570
(1993) · CaltechAUTHORS (California Institute of Technology) · Cited by 1,498
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
Denton, R., Zaremba, W., Bruna, J., LeCun, Y., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1404.0736 · Cited by 1,414
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search
Wu, B., Keutzer, K., Dai, X., Zhang, P., Wang, Y., Sun, F., Wu, Y., Tian, Y., Vajda, P., & Jia, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01099 · Cited by 1,261
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration
He, Y., Liu, P., Wang, Z., Hu, Z., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00447 · Cited by 1,217
Quantized Convolutional Neural Networks for Mobile Devices
Wu, J., Leng, C., Wang, Y., Hu, Q., & Cheng, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.521 · Cited by 1,212
Speeding up Convolutional Neural Networks with Low Rank Expansions
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.88 · Cited by 1,164
Similarity-Preserving Knowledge Distillation
Tung, F., & Mori, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00145 · Cited by 1,079
ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
Mehta, S., Rastegari, M., Caspi, A., Shapiro, L., & Hajishirzi, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_34 · Cited by 1,029
Importance Estimation for Neural Network Pruning
Molchanov, P., Mallya, A., Tyree, S., Frosio, I., & Kautz, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01152 · Cited by 983
CondenseNet: An Efficient DenseNet Using Learned Group Convolutions
Huang, G., Liu, S., Maaten, L. V. D., & Weinberger, K. Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00291 · Cited by 904
Predicting Parameters in Deep Learning
Denil, M., Shakibi, B., Dinh, L., Ranzato, M., & de Freitas, N. (2013) · arXiv · doi:10.48550/arxiv.1306.0543 · Cited by 853
Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning
Yang, T.-J., Chen, Y.-H., & Sze, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.643 · Cited by 732
Structured Pruning of Deep Convolutional Neural Networks
Anwar, S., Hwang, K., & Sung, W. (2017) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3005348 · Cited by 698
Variational Information Distillation for Knowledge Transfer
Ahn, S., Hu, S. X., Damianou, A., Lawrence, N. D., & Dai, Z. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00938 · Cited by 671
SkipNet: Learning Dynamic Routing in Convolutional Networks
Wang, X., Yu, F., Dou, Z.-Y., Darrell, T., & Gonzalez, J. E. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_25 · Cited by 625
Low-rank matrix factorization for Deep Neural Network training with high-dimensional output targets
Sainath, T. N., Kingsbury, B., Sindhwani, V., Arisoy, E., & Ramabhadran, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638949 · Cited by 593
NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applications
Yang, T.-J., Howard, A., Chen, B., Zhang, X., Go, A., Sandler, M., Sze, V., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_18 · Cited by 572
ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network
Mehta, S., Rastegari, M., Shapiro, L., & Hajishirzi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00941 · Cited by 551
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons
Heo, B., Lee, M., Yun, S., & Choi, J. Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013779 · Cited by 522
Data-Free Quantization Through Weight Equalization and Bias Correction
Nagel, M., Baalen, M. V., Blankevoort, T., & Welling, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00141 · Cited by 500
Comparing Biases for Minimal Network Construction with Back-Propagation
Hanson, S. J., & Pratt, L. (1988) · neural information processing systems · Cited by 480
Towards Accurate Binary Convolutional Neural Network
Lin, X., Zhao, C., & Pan, W. (2017) · arXiv · doi:10.48550/arxiv.1711.11294 · Cited by 453
Low-bit Quantization of Neural Networks for Efficient Inference
Choukroun, Y., Kravchik, E., Yang, F., & Kisilev, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00363 · Cited by 404
On Compressing Deep Models by Low Rank and Sparse Decomposition
Yu, X., Liu, T., Wang, X., & Tao, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.15 · Cited by 403
ZeroQ: A Novel Zero Shot Quantization Framework
Cai, Y., Yao, Z., Dong, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01318 · Cited by 381
A review of convolutional neural network architectures and their optimizations
Cong, S., & Zhou, Y. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10213-5 · Cited by 381
Lu, Y., Kumar, A., Zhai, S., Cheng, Y., Javidi, T., & Feris, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.126 · Cited by 371
SqueezeNext: Hardware-Aware Neural Network Design
Gholami, A., Kwon, K., Wu, B., Tai, Z., Yue, X., Jin, P., Zhao, S., & Keutzer, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00215 · Cited by 350
Convolutional neural networks with low-rank regularization
Tai, C., Xiao, T., Zhang, Y., Wang, X., & Weinan, E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06067 · Cited by 341
Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeon
Dong, X., Chen, S., & Pan, S. J. (2017) · arXiv · doi:10.48550/arxiv.1705.07565 · Cited by 339
Interleaved Group Convolutions
Zhang, T., Qi, G.-J., Xiao, B., & Wang, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.469 · Cited by 323
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions
Wan, A., Dai, X., Zhang, P., He, Z., Tian, Y., Xie, S., Wu, B., Yu, M., Xu, T., Chen, K., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01298 · Cited by 305
Knowledge Distillation via Instance Relationship Graph
Liu, Y., Cao, J., Li, B., Yuan, C., Hu, W., Li, Y., & Duan, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00726 · Cited by 303
Tomato detection based on modified YOLOv3 framework
Lawal, M. O. (2021) · Scientific Reports · doi:10.1038/s41598-021-81216-5 · Cited by 289
Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition
Lebedev, V., Ganin, Y., Rakhuba, M., Oseledets, I. V., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6553 · Cited by 283
Less Is More: Towards Compact CNNs
Zhou, H., Alvarez, J. M., & Porikli, F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_40 · Cited by 279
ThiNet: Pruning CNN Filters for a Thinner Net
Luo, J.-H., Zhang, H., Zhou, H.-Y., Xie, C.-W., Wu, J., & Lin, W. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858232 · Cited by 262
Up or Down? Adaptive Rounding for Post-Training Quantization
Nagel, M., Amjad, R. A., van Baalen, M., Louizos, C., & Blankevoort, T. (2020) · arXiv · doi:10.48550/arxiv.2004.10568 · Cited by 252
Gysel, P., Pimentel, J., Motamedi, M., & Ghiasi, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2808319 · Cited by 250
Post training 4-bit quantization of convolutional networks for rapid-deployment
Banner, R., Nahshan, Y., & Soudry, D. (2019) · neural information processing systems · Cited by 250
Improving Neural Network Quantization without Retraining using Outlier Channel Splitting
Zhao, R., Hu, Y., Dotzel, J., De Sa, C., & Zhang, Z. (2019) · arXiv · doi:10.48550/arxiv.1901.09504 · Cited by 231
CondConv: Conditionally Parameterized Convolutions for Efficient Inference
Yang, B., Bender, G., Le, Q. V., & Ngiam, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04971 · Cited by 208
Rigamonti, R., Sironi, A., Lepetit, V., & Fua, P. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.355 · Cited by 205
Accelerating Convolutional Networks via Global & Dynamic Filter Pruning
Lin, S., Ji, R., Li, Y., Wu, Y., Huang, F., & Zhang, B. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/336 · Cited by 201
Efficient Medical Image Segmentation Based on Knowledge Distillation
Qin, D., Bu, J.-J., Liu, Z., Shen, X., Zhou, S., Gu, J.-J., Wang, Z.-H., Wu, L., & Dai, H.-F. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3098703 · Cited by 201
BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstruction
Li, Y., Gong, R., Tan, X., Yang, Y., Hu, P., Zhang, Q., Yu, F., Wang, W., & Gu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.05426 · Cited by 190
Post-training Piecewise Linear Quantization for Deep Neural Networks
Fang, J., Shafiee, A. R., Abdel-Aziz, H. A., Thorsley, D., Georgiadis, G., & Hassoun, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_5 · Cited by 183
Learning to Prune Filters in Convolutional Neural Networks
Huang, Q., Zhou, K., You, S., & Neumann, U. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00083 · Cited by 170
Self-supervised Knowledge Distillation Using Singular Value Decomposition
Lee, S., Kim, D. H., & Song, B. C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_21 · Cited by 168
Holistic CNN Compression via Low-Rank Decomposition with Knowledge Transfer
Lin, S., Ji, R., Chen, C., Tao, D., & Luo, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2873305 · Cited by 164
Distilling the Knowledge From Handcrafted Features for Human Activity Recognition
Chen, Z., Zhang, L., Cao, Z., & Guo, J. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2789925 · Cited by 160
Sparse low rank factorization for deep neural network compression
Swaminathan, S., Garg, D., Kannan, R., & Andrès, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.02.035 · Cited by 159
FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining
Dai, X., Wan, A., Zhang, P., Wu, B., He, Z., Wei, Z., Chen, K., Tian, Y., Yu, M., Vajda, P., et al. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01601 · Cited by 147
Interleaved Structured Sparse Convolutional Neural Networks
Xie, G., Wang, J., Zhang, T., Lai, J., Hong, R., & Qi, G.-J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00922 · Cited by 146
MicroNet: Improving Image Recognition with Extremely Low FLOPs
Li, Y., Chen, Y., Dai, X., Chen, D., Liu, M., Yuan, L., Liu, Z., Zhang, L., & Vasconcelos, N. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00052 · Cited by 131
Learning Metrics From Teachers: Compact Networks for Image Embedding
Yu, L., Yazici, V. O., Liu, X., van de Weijer, J., Cheng, Y., & Arnau Ramisa, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00302 · Cited by 121
IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural NetworksPreprint
Sun, K., Li, M., Liu, D., & Wang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00178 · Cited by 119
WeightNet: Revisiting the Design Space of Weight Networks
Ma, N., Zhang, X., Huang, J., & Sun, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_46 · Cited by 108
High Performance CNN Accelerators Based on Hardware and Algorithm Co-Optimization
Yuan, T., Liu, W., Han, J., & Lombardi, F. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3030663 · Cited by 92
SAR Target Image Classification Based on Transfer Learning and Model Compression
Zhong, C., Mu, X., He, X., Wang, J., & Zhu, M. B. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2876378 · Cited by 90
Attention-Guided Pyramid Context Network for Polyp Segmentation in Colonoscopy Images
Yue, G., Li, S., Cong, R., Zhou, T., Lei, B., & Wang, T. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3244219 · Cited by 85
ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions
Gao, H., Wang, Z., Cai, L., & Ji, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2975796 · Cited by 81
Graph-based Knowledge Distillation by Multi-head Attention NetworkPreprint
Lee, S., & Song, B. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.02226 · Cited by 78
Zhang, C., & Peng, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/158 · Cited by 74
An architecture-level analysis on deep learning models for low-impact computations
Li, H., Wang, Z., Yue, X., Wang, W., Tomiyama, H., & Meng, L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10221-5 · Cited by 72
Self-citationYOLO-GD: A Deep Learning-Based Object Detection Algorithm for Empty-Dish Recycling Robots
Yue, X., Li, H., Shimizu, M., Kawamura, S., & Meng, L. (2022) · Machines · doi:10.3390/machines10050294 · Cited by 70
Self-citationDynamic Dataset Augmentation for Deep Learning-based Oracle Bone Inscriptions Recognition
Yue, X., Li, H., Fujikawa, Y., & Meng, L. (2022) · Journal on Computing and Cultural Heritage · doi:10.1145/3532868 · Cited by 67
Self-citationOnly Train Once: A One-Shot Neural Network Training And Pruning FrameworkPreprint
Chen, T., Ji, B., Ding, T., Fang, B., Wang, G., Zhu, Z., Liang, L., Shi, Y., Yi, S., & Tu, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07467 · Cited by 63
Same, Same But Different - Recovering Neural Network Quantization Error Through Weight Factorization
Meller, E., Finkelstein, A., Almog, U., & Grobman, M. (2019) · arXiv · doi:10.48550/arxiv.1902.01917 · Cited by 60
DisCo: Remedying Self-supervised Learning on Lightweight Models with Distilled Contrastive Learning
Gao, Y., Zhuang, J., Lin, S., Cheng, H., Sun, X., Li, K., & Shen, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19809-0_14 · Cited by 56
Automatic channel pruning via clustering and swarm intelligence optimization for CNN
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03508-1 · Cited by 55
Xiang, Q., Wang, X., Song, Y., Lei, L., Li, R., & Lai, J. (2020) · International Journal of Intelligent Systems · doi:10.1002/int.22302 · Cited by 42
Optimizing the Deep Neural Networks by Layer-Wise Refined Pruning and the Acceleration on FPGA
Li, H., Yue, X., Wang, Z., Chai, Z., Wang, W., Tomiyama, H., & Meng, L. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/8039281 · Cited by 32
Self-citationHFPQ: deep neural network compression by hardware-friendly pruning-quantization
Fan, Y., Pang, W., & Lu, S. (2021) · Applied Intelligence · doi:10.1007/s10489-020-01968-x · Cited by 27
Li, H., Yue, X., Wang, Z., Wang, W., Tomiyama, H., & Meng, L. (2021) · Measurement Sensors · doi:10.1016/j.measen.2021.100080 · Cited by 21
Self-citationGroup channel pruning and spatial attention distilling for object detection
Chu, Y., Li, P., Bai, Y., Hu, Z., Chen, Y., & Lü, J. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03293-x · Cited by 19
An optimal-score-based filter pruning for deep convolutional neural networks
Sawant, S. S., Bauer, J., Erick, F. X., Ingaleshwar, S., Holzer, N., Ramming, A., Lang, E. W., & Götz, T. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03229-5 · Cited by 17
A Comprehensive Analysis of Low-Impact Computations in Deep Learning Workloads
Li, H., Wang, Z., Yue, X., et al. (2021) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3453688.3461747 · Cited by 16
Self-citationNetwork pruning via probing the importance of filters
Kuang, J., Shao, M., Wang, R., Zuo, W., & Ding, W. (2022) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01530-w · Cited by 15
Enhanced mechanisms of pooling and channel attention for deep learning feature maps
Li, H., Yue, X., & Meng, L. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.1161 · Cited by 15
Self-citationRisso, M., Burrello, A., Pagliari, D. J., Conti, F., Lamberti, L., Macii, E., Benini, L., & Poncino, M. (2021) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586187 · Cited by 12
The early Japanese books reorganization by combining image processing and deep learning
Lyu, B., Li, H., Tanaka, A., & Meng, L. (2022) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12104 · Cited by 12
Self-citationFeature Map Analysis-Based Dynamic CNN Pruning and the Acceleration on FPGAs
Li, Q., Li, H., & Meng, L. (2022) · Electronics · doi:10.3390/electronics11182887 · Cited by 9
Self-citationResearch on Deep Learning-based Cross-disciplinary Applications
Li, Z., & Meng, L. (2022) · International Conference on Advanced Mechatronic Systems · doi:10.1109/icamechs57222.2022.10003391 · Cited by 7
Self-citationYOLO-GG: a slight object detection model for empty-dish recycling robot
Ge, Y., Yue, X., & Meng, L. (2022) · International Conference on Advanced Mechatronic Systems · doi:10.1109/icamechs57222.2022.10003347 · Cited by 7
Self-citationFilter pruning by image channel reduction in pre-trained convolutional neural networks
Chung, G. S., & Won, C. S. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09373-9 · Cited by 6
Aligned Weight Regularizers for Pruning Pretrained Neural Networks
Neill, J. O., Dutta, S., & Assem, H. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.267 · Cited by 4
Deep Learning Based Real-time Visual Inspection for Harvesting Apples
Matsui, A., Iinuma, M., & Meng, L. (2022) · International Conference on Advanced Mechatronic Systems · doi:10.1109/icamechs57222.2022.10003376 · Cited by 3
Self-citation
Cited by
Badgujar, C. M., Poulose, A., & Gan, H. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109090 · Cited by 411
A Survey on Model Compression for Large Language Models
Zhu, X., Li, J., Liu, Y., Ma, C., & Wang, W. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00704 · Cited by 273
A comprehensive review of model compression techniques in machine learning
Dantas, P. V., Sabino da Silva, W., Cordeiro, L. C., & Carvalho, C. B. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05747-w · Cited by 261
AI-Empowered Management and Orchestration of Vehicular Systems in the Beyond 5G Era
Slamnik-Kriještorac, N., Camelo, M., Chang, C.-Y., Soto, P., Cominardi, L., De Vleeschauwer, D., Latré, S., & Marquez-Barja, J. M. (2023) · IEEE Network · doi:10.1109/mnet.008.2300024 · Cited by 14
Raza, S. M., Abidi, S. M. H., Masuduzzaman, M., & Shin, S. Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131357 · Cited by 13
Metadata
- Authors
- Li, Z., Li, H., & Meng, L.
- Venue
- Computers
- Publisher
- MDPI AG
- Published
- 2023-03-12
- Volume
- 12
- Issue
- 3
- Pages
- 60
- ISSN
- 2073-431X (ISSN-L)
- OpenAlex
- W4324057834
- Cited by
- 296
- References
- 112
- FWCI
- 26.82
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.