DMCP: Differentiable Markov Channel Pruning for Neural Networks
Open accessAbstract
Recent works imply that the channel pruning can be regarded as searching optimal sub-structure from unpruned networks. However, existing works based on this observation require training and evaluating a large number of structures, which limits their application. In this paper, we propose a novel differentiable method for channel pruning, named Differentiable Markov Channel Pruning (DMCP), to efficiently search the optimal sub-structure. Our method is differentiable and can be directly optimized by gradient descent with respect to standard task loss and budget regularization (e.g. FLOPs constraint). In DMCP, we model the channel pruning as a Markov process, in which each state represents for retaining the corresponding channel during pruning, and transitions between states denote the pruning process. In the end, our method is able to implicitly select the proper number of channels in each layer by the Markov process with optimized transitions. To validate the effectiveness of our method, we perform extensive experiments on Imagenet with ResNet and MobilenetV2. Results show our method can achieve consistent improvement than state-of-the-art pruning methods in various FLOPs settings.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Wang et al. [55] provided an unlearning procedure via channel pruning [97], followed by a fine-tuning process to recover the performance of the pruned model.
“An unlearning procedure via channel pruning [97] was also provided, followed by a fine-tuning process to recover the performance of the pruned model.”
From Machine Unlearning: A Survey (2024) · cites this paper as [97]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755 · see citing works
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,091 · see citing works
DARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248 · see citing works
(1989) · Cited by 3,214 · see citing works
Pruning Filters for Efficient ConvNets
Li, H., Kadav, A., Durdanovic, I., Samet, H., & Graf, H. P. (2016) · arXiv · doi:10.48550/arxiv.1608.08710 · Cited by 2,928 · see citing works
Learning Efficient Convolutional Networks through Network Slimming
Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., & Zhang, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.298 · Cited by 2,761 · see citing works
ProxylessNAS: Direct Neural Architecture Search on Target Task and HardwarePreprint
Cai, H., Zhu, L., & Han, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00332 · Cited by 1,652 · see citing works
Pruning Convolutional Neural Networks for Resource Efficient InferencePreprint
Molchanov, P. A., Tyree, S., Karras, T., Aila, T., & Kautz, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06440 · Cited by 1,487 · see citing works
AMC: AutoML for Model Compression and Acceleration on Mobile Devices
He, Y., Lin, J., Liu, Z., Wang, H., Li, L.-J., & Han, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_48 · Cited by 1,400 · see citing works
Rethinking the Value of Network PruningPreprint
Liu, Z., Sun, M., Zhou, T., Huang, G. M., & Darrell, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05270 · Cited by 1,225 · see citing works
Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep ArchitecturesPreprint
Hu, H., Peng, R., Tai, Y., & Tang, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.03250 · Cited by 792 · see citing works
Howard, A., Zhmoginov, A., Chen, L.-C., Sandler, M., & Zhu, M. (2018) · arXiv (Cornell University) · Cited by 671 · see citing works
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning
Liu, Z., Mu, H., Zhang, X., Guo, Z., Yang, X. Y., Cheng, K.-T. T., & Sun, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00339 · Cited by 585 · see citing works
Towards Optimal Structured CNN Pruning via Generative Adversarial Learning
Lin, S., Ji, R., Yan, C., Zhang, B., Cao, L., Ye, Q., Huang, F., & Doermann, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00290 · Cited by 582 · see citing works
Universally Slimmable Networks and Improved Training Techniques
Yu, J., & Huang, T. S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00189 · Cited by 366 · see citing works
Accelerating Convolutional Networks via Global & Dynamic Filter Pruning
Lin, S., Ji, R., Li, Y., Wu, Y., Huang, F., & Zhang, B. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/336 · Cited by 201 · see citing works
AutoSlim: Towards One-Shot Architecture Search for Channel NumbersPreprint
Yu, J., & Huang, T. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11728 · Cited by 164 · see citing works
Approximated Oracle Filter Pruning for Destructive CNN Width Optimization
Ding, X., Ding, G., Guo, Y., Han, J., & Yan, C. (2019) · arXiv · doi:10.48550/arxiv.1905.04748 · Cited by 96 · see citing works
Pruning Filter via Geometric Median for Deep Convolutional Neural Networks Acceleration.Preprint
He, Y., Liu, P., Wang, Z., & Yang, Y. (2018) · arXiv (Cornell University) · Cited by 22 · see citing works
Progressive Deep Neural Networks Acceleration via Soft Filter PruningPreprint
He, Y. M., Dong, X., Kang, G., Fu, Y., & Yang, Y. (2018) · arXiv (Cornell University) · Cited by 14 · see citing works
Flagged first, then by citations
1 of the 23 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Morgan Kaufmann, 1990. 1
- Babak Hassibi, David G. Stork, Gregory Wolff, and Takahiro Watanabe. Optimal brain surgeon: Extensions and perfor- mance comparisons. In Proceedings of the 6th Interna- tional Conference on Neural Information Processing Sys- tems, NIPS'93, pages 263-270, San Francisco, CA, USA, 1993. Morgan Kaufmann Publishers Inc. 1
- Hao Li, Asim Kadav, Igor Durdanovic, Hanan Samet, and Hans Peter Graf. Pruning filters for efficient convnets. CoRR, abs/1608.08710, 2016. 1 · arXiv
- Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, San- jeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. ImageNet Large Scale Visual Recognition Chal- lenge. International Journal of Computer Vision (IJCV), 115(3):211-252, 2015. 2
Cited by
Sorted by citations
A Survey on Deep Neural Network Pruning: Taxonomy, Comparison, Analysis, and Recommendations
Cheng, H., Zhang, M., & Shi, Q. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3447085 · Cited by 554 · see citing works
FFCA-YOLO for Small Object Detection in Remote Sensing Images
Zhang, Y., Ye, M., Zhu, G., Liu, Y., Guo, P., & Yan, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3363057 · Cited by 439 · see citing works
Self-citationStructured Pruning for Deep Convolutional Neural Networks: A Survey
He, Y., & Xiao, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3334614 · Cited by 398 · see citing works
Xu, H., Zhu, T., Zhang, L., Zhou, W., & Yu, P. S. (2024) · ACM Computing Surveys · doi:10.1145/3603620 · Cited by 164 · see citing works
“An unlearning procedure via channel pruning [97] was also provided, followed by a fine-tuning process to recover the performance of the pruned model.”
MethodStructured Pruning Learns Compact and Accurate Models
Xia, M., Zhong, Z., & Chen, D. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.107 · Cited by 136 · see citing works
CHEX: CHannel EXploration for CNN Model Compression
Hou, Z., Qin, M., Sun, F., Ma, X., Yuan, K., Xu, Y. T., Chen, Y.-K., Jin, R., Xie, Y., & Kung, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01197 · Cited by 91 · see citing works
CHIP: CHannel Independence-based Pruning for Compact Neural NetworksPreprint
Sui, Y., Yin, M., Xie, Y., Phan, H., Zonouz, S., & Yuan, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13981 · Cited by 91 · see citing works
Pruning Filter in FilterPreprint
Meng, F., Cheng, H., Li, K., Luo, H., Guo, X., Lu, G., & Sun, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.14410 · Cited by 83 · see citing works
Image recognition based on lightweight convolutional neural network: Recent advances
Liu, Y., Xue, J., Li, D., Zhang, W., Chiew, T. K., & Xu, Z. (2024) · Image and Vision Computing · doi:10.1016/j.imavis.2024.105037 · Cited by 81 · see citing works
Chen, R., Qi, H., Liang, Y., & Yang, M. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.1023515 · Cited by 70 · see citing works
SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Features Recombining
Qiu, J., Chen, C., Liu, S., Zhang, H.-Y., & Zeng, B. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3093795 · Cited by 68 · see citing works
Model Compression Based on Differentiable Network Channel Pruning
Zheng, Y.-J., Chen, S.-B., Ding, C. H. Q., & Luo, B. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3165123 · Cited by 64 · see citing works
1xN Pattern for Pruning Convolutional Neural Networks
Lin, M., Zhang, Y., Li, Y., Chen, B., Chao, F., Wang, M., Li, S., Tian, Y., & Ji, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195774 · Cited by 54 · see citing works
Advancements in Accelerating Deep Neural Network Inference on AIoT Devices: A Survey
Cheng, L., Gu, Y., Liu, Q., Yang, L., Liu, C., & Wang, Y. (2024) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2024.3353176 · Cited by 56 · see citing works
Self-citationHessian-Aware Pruning and Optimal Neural Implant
Yu, S., Yao, Z., Gholami, A., Dong, Z., Kim, S., Mahoney, M. W., & Keutzer, K. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00372 · Cited by 54 · see citing works
Automatic channel pruning via clustering and swarm intelligence optimization for CNN
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03508-1 · Cited by 49 · see citing works
HRel: Filter pruning based on High Relevance between activation maps and class labels
Sarvani, C. H., Ghorai, M., Dubey, S. R., & Basha, S. H. S. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.12.017 · Cited by 48 · see citing works
Adaptive Filter Pruning via Sensitivity Feedback
Zhang, Y., & Freris, N. M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3246263 · Cited by 48 · see citing works
DiffRate : Differentiable Compression Rate for Efficient Vision Transformers
Chen, M., Shao, W., Xu, P., Lin, M., Zhang, K., Chao, F., Ji, R., Qiao, Y., & Luo, P. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01574 · Cited by 43 · see citing works
Iterative clustering pruning for convolutional neural networks
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110386 · Cited by 42 · see citing works
Deng, Y., Lu, H., & Zhou, W. (2021) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2021.07.022 · Cited by 40 · see citing works
Li, Y., Zhao, P., Yuan, G., Lin, X., Wang, Y., & Chen, X. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/449 · Cited by 43 · see citing works
Self-citationJointPruning: Pruning Networks Along Multiple Dimensions for Efficient Point Cloud Processing
Guo, J., Liu, J., & Xu, D. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3105820 · Cited by 38 · see citing works
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization
Guo, Y., Yuan, H., Tan, J., Wang, Z., Yang, S., & Liu, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00519 · Cited by 40 · see citing works
Interpretable Task-inspired Adaptive Filter Pruning for Neural Networks Under Multiple Constraints
Guo, Y., Gao, W., & Li, G. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01972-x · Cited by 37 · see citing works
BCNet: Searching for Network Width with Bilaterally Coupled Network
Su, X. Q., You, S., Wang, F., Qian, C., Zhang, C., & Xu, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00221 · Cited by 37 · see citing works
Filter Pruning via Learned Representation Median in the Frequency Domain
Zhang, X., Xie, W., Li, Y., Lei, J., & Du, Q. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3124284 · Cited by 34 · see citing works
Zheng, Y., Sun, P., Ren, Q., Xu, W., & Zhu, D. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127124 · Cited by 33 · see citing works
Network pruning via resource reallocation
Hou, Y., Ma, Z., Liu, C., Wang, Z., & Loy, C. C. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109886 · Cited by 30 · see citing works
Efficient federated learning on resource-constrained edge devices based on model pruning
Wu, T., Song, C., & Zeng, P. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01120-5 · Cited by 29 · see citing works
AKECP: Adaptive Knowledge Extraction from Feature Maps for Fast and Efficient Channel Pruning
Zhang, H., Liu, L., Zhou, H., Hou, W., Sun, H., & Zheng, N. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475228 · Cited by 29 · see citing works
Compiler-Aware Neural Architecture Search for On-Mobile Real-time Super-Resolution
Wu, Y., Gong, Y., Zhao, P., Li, Y., Zhan, Z., Niu, W., Tang, H., Qin, M., Ren, B., & Wang, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19800-7_6 · Cited by 30 · see citing works
Self-citationLocally Free Weight Sharing for Network Width SearchPreprint
Su, X. Q., You, S., Huang, T., Wang, F., Qian, C., Zhang, C., & Xu, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05258 · Cited by 28 · see citing works
SOKS: Automatic Searching of the Optimal Kernel Shapes for Stripe-Wise Network Pruning
Liu, G., Zhang, K., & Lv, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3162067 · Cited by 27 · see citing works
Exploring Structural Sparsity in CNN via Selective Penalty
Zhao, M., Peng, J., Yu, S., Liu, L., & Wu, N. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3071532 · Cited by 26 · see citing works
Tmamna, J., Ayed, E. B., Fourati, R., Hussain, A., & Ayed, M. B. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111978 · Cited by 25 · see citing works
Zhong, Z., Bao, W., Wang, J., Zhang, S., Zhou, J., Lyu, L., & Lim, W. Y. B. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02855 · Cited by 26 · see citing works
Filter pruning with uniqueness mechanism in the frequency domain for efficient neural networks
Zhang, S., Gao, M., Ni, Q., & Han, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.02.004 · Cited by 24 · see citing works
Continual Learning with Deep Neural Networks in Physiological Signal Data: A Survey
Li, A., Li, H., & Yuan, G. (2024) · Healthcare · doi:10.3390/healthcare12020155 · Cited by 24 · see citing works
Sensitivity pruner: Filter-Level compression algorithm for deep neural networks
Guo, S., Lai, B., Yang, S., Zhao, J., & Shen, F. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109508 · Cited by 23 · see citing works
Self-citationPruning Parameterization with Bi-level Optimization for Efficient Semantic Segmentation on the Edge
Yang, C., Zhao, P., Li, Y., Niu, W., Guan, J., Tang, H., Qin, M., Ren, B., Lin, X., & Wang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01478 · Cited by 23 · see citing works
Self-citationLi, C., Li, H., Gao, G., Liu, Z., & Liu, P. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110326 · Cited by 22 · see citing works
Zhu, S., Shang, R., Yuan, B., Zhang, W., Li, W., Li, Y., & Jiao, L. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110545 · Cited by 21 · see citing works
Holistic Filter Pruning for Efficient Deep Neural Networks
Enderich, L., Timm, F., & Burgard, W. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00264 · Cited by 21 · see citing works
Attentive Fine-Grained Structured Sparsity for Image Restoration
Oh, J., Kim, H., Nah, S., Hong, C., Choi, J., & Lee, K. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01715 · Cited by 21 · see citing works
Learning to Explore Distillability and Sparsability: A Joint Framework for Model Compression
Liu, Y., Cao, J., Li, B., Hu, W., & Maybank, S. J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3185317 · Cited by 20 · see citing works
3D-Pruning: A Model Compression Framework for Efficient 3D Action Recognition
Guo, J., Liu, J., & Xu, D. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3197395 · Cited by 20 · see citing works
PSViT: Better Vision Transformer via Token Pooling and Attention SharingPreprint
Chen, B., Li, P., Li, B., Li, C., Bai, L., Chen, L., Sun, M., Yan, J., & Ouyang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.03428 · Cited by 30 · see citing works
Self-citation$V_{k}D$: Improving Knowledge Distillation Using Orthogonal Projections
Miles, R., Elezi, I., & Deng, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01488 · Cited by 21 · see citing works
An efficient sparse pruning method for human pose estimation
Wang, M., Sun, T., Song, K., Li, S., Jiang, J., & Sun, L. (2021) · Connection Science · doi:10.1080/09540091.2021.2012423 · Cited by 19 · see citing works
DMPP: Differentiable multi-pruner and predictor for neural network pruning
Li, J., Zhao, B., & Liu, D. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.12.020 · Cited by 19 · see citing works
Adaptive Search-and-Training for Robust and Efficient Network Pruning
Lu, X., Dong, W., Li, X., Wu, J., Li, L., & Shi, G. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3248612 · Cited by 20 · see citing works
Update Selective Parameters: Federated Machine Unlearning Based on Model Explanation
Xu, H. Y., Zhu, T., Zhang, L., Zhou, W., & Yu, P. S. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3409947 · Cited by 21 · see citing works
Weight-Dependent Gates for Network Pruning
Li, Y., Liu, Z., Wu, W., Yao, H., Zhang, X., Zhang, C., & Yin, B. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3175762 · Cited by 18 · see citing works
A multi-granularity CNN pruning framework via deformable soft mask with joint training
Zhang, P., Tian, C., Zhao, L., & Duan, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127189 · Cited by 18 · see citing works
Differentiable Transportation Pruning
Li, Y., van Gemert, J. C., Hoefler, T., Moons, B., Eleftheriou, E. S., & Verhoef, B.-E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01555 · Cited by 18 · see citing works
SFP: Similarity-based filter pruning for deep neural networks
Li, G., Li, R., Li, T., Shen, C., Zou, X., Wang, J., Wang, C., & Li, N. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121418 · Cited by 18 · see citing works
SOSP: Efficiently Capturing Global Correlations by Second-Order Structured PruningPreprint
Nonnenmacher, M., Pfeil, T., Steinwart, I., & Reeb, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.11395 · Cited by 18 · see citing works
Dai, S., Luo, Z., Luo, W., Wang, S., Dai, C., Guo, B., & Zhou, X. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3482288 · Cited by 17 · see citing works
A Lightweight YOLO-Based Model in Small-Object Detection for AAV Optical Sensors
Sun, H., Shi, B., & Hu, Y.-L. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3553871 · Cited by 18 · see citing works
Multitargets Joint Training Lightweight Model for Object Detection of Substation
Yan, X., Jia, L., Cao, H., Yu, Y., Wang, T., Zhang, F., & Guan, Q. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190139 · Cited by 17 · see citing works
Effective Model Sparsification by Scheduled Grow-and-Prune MethodsPreprint
Ma, X., Qin, M., Sun, F., Hou, Z., Yuan, K., Xu, Y. T., Wang, Y., Chen, Y.-K., Jin, R., & Xie, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09857 · Cited by 17 · see citing works
Self-citationTowards Better Structured Pruning Saliency by Reorganizing Convolution
Sun, X., & Shi, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00220 · Cited by 15 · see citing works
AACP: Model Compression by Accurate and Automatic Channel Pruning
Lin, L., Chen, S., Yang, Y., & Guo, Z. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956562 · Cited by 15 · see citing works
Acceleration-Aware Fine-Grained Channel Pruning for Deep Neural Networks via Residual Gating
Huang, K., Chen, S., Li, B., Claesen, L., Yao, H., Chen, J., Jiang, X., Liu, Z., & Xiong, D. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3093835 · Cited by 14 · see citing works
Efficient Channel Pruning Based on Architecture Alignment and Probability Model Bypassing
Tao, L., & Gao, W. (2021) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc52423.2021.9659289 · Cited by 14 · see citing works
Zhang, R., Hou, J., Li, L., Zhang, K., Li, Z., & Gao, S. (2025) · Sensors · doi:10.3390/s25216573 · Cited by 13 · see citing works
Grow-push-prune: Aligning deep discriminants for effective structural network compression
Tian, Q., Arbel, T., & Clark, J. J. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103682 · Cited by 13 · see citing works
Single-Path Bit Sharing for Automatic Loss-Aware Model Compression
Liu, J., Zhuang, B., Chen, P., Shen, C., Cai, J., & Tan, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3275159 · Cited by 13 · see citing works
Towards efficient network compression via Few-Shot Slimming
He, J., Ding, Y., Zhang, M., & Li, D. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.12.011 · Cited by 13 · see citing works
Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient
Yu, S., Nguyễn, P., Anwar, A., & Jannesari, A. (2023) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid57682.2023.00038 · Cited by 13 · see citing works
Adaptive Dynamic Pruning for Non-IID Federated Learning.Preprint
Yu, S., Nguyen, P., Anwar, A., & Jannesari, A. (2021) · arXiv (Cornell University) · Cited by 13 · see citing works
Compressing Models with Few Samples: Mimicking then Replacing
Wang, H., Liu, J., Ma, X., Yong, Y., Chai, Z., & Wu, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00078 · Cited by 12 · see citing works
Yu, J., Chen, J., Wan, H., Zhou, Z., Cao, Y., Huang, Z., Li, Y., Wu, B., & Yao, B. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3350712 · Cited by 12 · see citing works
Zhang, Z., Lu, Y., Wang, T., Wei, X., & Wei, Z. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106164 · Cited by 12 · see citing works
Fault-Tolerant Deep Neural Networks for Processing-In-Memory based Autonomous Edge Systems
Wang, S., Yuan, G., Ma, X., Li, Y., Lin, X., & Kailkhura, B. (2022) · Design, Automation, and Test in Europe · doi:10.23919/date54114.2022.9774523 · Cited by 12 · see citing works
Joint Pruning & Quantization for Extremely Sparse Neural NetworksPreprint
Yu, P.-H., Wu, S.-S., Klopp, J. P., Chen, L., & Chien, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01892 · Cited by 12 · see citing works
Zhang, M., Feng, J., Yang, H., Guo, J., Li, Y., & Gao, X. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3594958 · Cited by 13 · see citing works
Semantic-Driven Automatic Filter Pruning for Neural Networks
Guo, Y., & Gao, W. (2022) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859932 · Cited by 11 · see citing works
Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks
Chin, T.-W., Morcos, A. S., & Marculescu, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86523-8_8 · Cited by 11 · see citing works
Hardware-friendly User-specific Machine Learning for Edge Devices
Goyal, V., Das, R., & Bertacco, V. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3524125 · Cited by 11 · see citing works
ABCP: Automatic Blockwise and Channelwise Network Pruning via Joint Search
Li, J., Li, H., Chen, Y., Ding, Z., Li, N., Ma, M., Duan, Z., & Zhao, D. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3230858 · Cited by 11 · see citing works
Prune Efficiently by Soft Pruning
Agarwal, P., Mathew, M., Patel, K. R., Tripathi, V., & Swami, P. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00226 · Cited by 10 · see citing works
ECBC: Efficient Convolution via Blocked Columnizing
Zhao, T., Hu, Q., He, X., Xu, W., Wang, J., Leng, C., & Cheng, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3095276 · Cited by 10 · see citing works
Searching for Network Width With Bilaterally Coupled Network
Su, X. Q., You, S., Xie, J., Wang, F., Qian, C., Zhang, C., & Xu, C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3226777 · Cited by 10 · see citing works
Ensemble Knowledge Guided Sub-network Search and Fine-Tuning for Filter Pruning
Lee, S., & Song, B. C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20083-0_34 · Cited by 10 · see citing works
More-Similar-Less-Important: Filter Pruning VIA Kmeans Clustering
Liu, Z., Wang, P., & Li, Z. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428286 · Cited by 10 · see citing works
Li, Q., Li, H., & Meng, L. (2024) · Journal of Real-Time Image Processing · doi:10.1007/s11554-024-01496-8 · Cited by 9 · see citing works
Self-citationLottery Jackpots Exist in Pre-Trained Models
Zhang, Y., Lin, M., Zhong, Y., Chao, F., & Ji, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3311783 · Cited by 12 · see citing works
Xu, Z., Yu, F., Liu, C., Wu, Z., Wang, H., & Chen, X. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00369 · Cited by 9 · see citing works
Efficient deep-narrow residual networks using dilated pooling for scene recognition
Qiao, Z., Yuan, X., Zhang, R., Chen, T., & Zhang, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121018 · Cited by 8 · see citing works
Hua, J., Wang, Z., Han, H., Gao, H., & Nie, L. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad5199 · Cited by 8 · see citing works
Markov-PQ: Joint Pruning-Quantization via Learnable Markov Chain
Li, Y., Zhang, X., Xie, W., Zhang, J., Fang, L., & Du, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3437182 · Cited by 8 · see citing works
SIECP: Neural Network Channel Pruning based on Sequential Interval Estimation
Chen, S.-B., Zheng, Y., Ding, C. H. Q., & Luo, B. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.053 · Cited by 8 · see citing works
Channel Pruning via Multi-Criteria based on Weight Dependency
Yan, Y., Guo, R., Li, C., Yang, K., & Xu, Y. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534068 · Cited by 8 · see citing works
Automatic channel pruning by neural network based on improved poplar optimisation algorithm
Hu, Y., Chen, D., Zou, F., & Liu, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113002 · Cited by 7 · see citing works
Deep Learning Assisted mmWave Beam Prediction With Flexible Network Architecture
Wang, P., Ma, K., Bai, Y., Sun, C., & Wang, Z. (2025) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2025.3573327 · Cited by 7 · see citing works
Ding, Q., Li, W., Xu, C., Zhang, M., Sheng, C., He, M., & Shan, N. (2024) · Sensors · doi:10.3390/s24175789 · Cited by 7 · see citing works
Global balanced iterative pruning for efficient convolutional neural networks
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07594-7 · Cited by 7 · see citing works
Consecutive layer collaborative filter similarity for differentiable neural network pruning
Zu, X., Li, Y., & Yin, B. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.02.063 · Cited by 7 · see citing works
- Authors
- Guo, S., Wang, Y., Li, Q., & Yan, J.
- Affiliations
- Sensetime (China) (CN)
- ORCID
- Wang, Yujie
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 1536-1544
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035377608
- Cited by
- 198
- References
- 23
- Citations by year
- 2026: 4 · 2025: 25 · 2024: 43 · 2023: 32 · 2022: 46 · 2021: 43 · 2020: 5
- FWCI
- 9.72
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- channel pruning, Markov processes, neural network compression, ResNet, MobileNetV2
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
