The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Learning Filter Pruning Criteria for Deep Convolutional Neural Networks Acceleration
Open accessAbstract
Filter pruning has been widely applied to neural network compression and acceleration. Existing methods usually utilize pre-defined pruning criteria, such as Lp-norm, to prune unimportant filters. There are two major limitations to these methods. First, existing methods fail to consider the variety of filter distribution across layers. To extract features of the coarse level to the fine level, the filters of different layers have various distributions. Therefore, it is not suitable to utilize the same pruning criteria to different functional layers. Second, prevailing layer-by-layer pruning methods process each layer independently and sequentially, failing to consider that all the layers in the network collaboratively make the final prediction. In this paper, we propose Learning Filter Pruning Criteria (LFPC) to solve the above problems. Specifically, we develop a differentiable pruning criteria sampler. This sampler is learnable and optimized by the validation loss of the pruned network obtained from the sampled criteria. In this way, we could adaptively select the appropriate pruning criteria for different functional layers. Besides, when evaluating the sampled criteria, LFPC comprehensively consider the contribution of all the layers at the same time. Experiments validate our approach on three image classification benchmarks. Notably, on ILSVRC-2012, our LFPC reduces more than 60% FLOPs on ResNet-50 with only 0.83% top-5 accuracy loss.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Pruning is the well-studied topic in model compression and many methods have been proposed to advance the network pruning [103].”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [103]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
(2017) · Cited by 11,625
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Research works printed but not linked: 2
- carreira-perpinán, 0, learning-compression” algorithms for neural net pruning, CVPR
- han, 0, Learning both weights and connections for efficient neural network, NeurIPS
Cited by
Sorted by citations
Unbiased Scene Graph Generation From Biased Training
Tang, K., Niu, Y., Huang, J., Shi, J., & Zhang, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00377 · Cited by 810
Self-citationStructured Pruning for Deep Convolutional Neural Networks: A Survey
He, Y., & Xiao, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3334614 · Cited by 468
Self-citationLightweight Deep Learning for Resource-Constrained Environments: A Survey
Liu, H.-I., Galindo, M., Xie, H., Wong, L.-K., Shuai, H.-H., Li, Y., & Cheng, W.-H. (2024) · ACM Computing Surveys · doi:10.1145/3657282 · Cited by 332
Quantization and Deployment of Deep Neural Networks on Microcontrollers
Novac, P.-E., Hacene, G. B., Pégatoquet, A., Miramond, B., & Gripon, V. (2021) · Sensors · doi:10.3390/s21092984 · Cited by 250
ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting
Ding, X., Hao, T., Tan, J., Liu, J., Han, J., Guo, Y., & Ding, G. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00447 · Cited by 203
GhostNets on Heterogeneous Devices via Cheap Operations
Han, K., Wang, Y., Xu, C., Guo, J., Xu, C., Wu, E., & Tian, Q. C. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01575-y · Cited by 201
Bringing ai to edge: from deep learning’s perspective
Liu, D., Kong, H., Luo, X., Liu, W., & Subramaniam, R. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.04.141 · Cited by 171
“Pruning methods Scope Process Year Li et al. [87] Inference-based Layer Rule-based 2016 Hu et al. [88] Inference-based Global Rule-based 2016 SSL [89] Training-based Layer Rule-based 2016 He et al. [90] Inference-based Layer Rule-based 2017 ThiNet [91] Inference-based Layer Rule-based 2017 DeepIoT [92] Training-based…”
BackgroundMethodInfluentialNetwork Pruning via Performance Maximization
Gao, S., Huang, F., Cai, W., & Huang, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00915 · Cited by 134
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks
Räuker, T., Ho, A., Casper, S., & Hadfield-Menell, D. (2023) · 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00039 · Cited by 122
Carrying Out CNN Channel Pruning in a White Box
Zhang, Y., Lin, M., Lin, C., Chen, J., Wu, Y., Tian, Y., & Ji, R. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3147269 · Cited by 92
Pruning Networks With Cross-Layer Ranking & k-Reciprocal Nearest Filters
Lin, M., Cao, L., Zhang, Y., Shao, L., Lin, C., & Ji, R. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3156047 · Cited by 92
CHEX: CHannel EXploration for CNN Model Compression
Hou, Z., Qin, M., Sun, F., Ma, X., Yuan, K., Xu, Y. T., Chen, Y.-K., Jin, R., Xie, Y., & Kung, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01197 · Cited by 93
CHIP: CHannel Independence-based Pruning for Compact Neural NetworksPreprint
Sui, Y., Yin, M., Xie, Y., Phan, H., Zonouz, S., & Yuan, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13981 · Cited by 92
Neural Pruning via Growing RegularizationPreprint
Wang, H., Qin, C., Zhang, Y., & Fu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09243 · Cited by 132
Automatic Sparse Connectivity Learning for Neural Networks
Tang, Z., Luo, L., Xie, B., Zhu, Y., Zhao, R., Bi, L., & Lü, C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3141665 · Cited by 80
OPQ: Compressing Deep Neural Networks with One-shot Pruning-Quantization
Hu, P., Peng, X., Zhu, H., Aly, M. M. S., & Lin, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16950 · Cited by 76
Learnable Companding Quantization for Accurate Low-bit Neural Networks
Yamamoto, K. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00499 · Cited by 75
Filter Pruning by Switching to Neighboring CNNs With Good Attributes
He, Y., Liu, P., Zhu, L., & Yang, Y. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3149332 · Cited by 74
Self-citationA survey of model compression strategies for object detection
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17192-x · Cited by 65
EACP: An effective automatic channel pruning for neural networks
Liu, Y., Wu, D., Zhou, W., Fan, K., & Zhou, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.014 · Cited by 61
When to Prune? A Policy towards Early Structural Pruning
Shen, M., Molchanov, P. A., Yin, H., & Álvarez, J. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01193 · Cited by 63
Kim, N. J., & Kim, H. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3189496 · Cited by 52
TRC‐YOLO: A real‐time detection method for lightweight targets based on mobile devices
Wang, G., Ding, H., Yang, Z., Li, B. H., Wang, Y., & Bao, L. (2021) · IET Computer Vision · doi:10.1049/cvi2.12072 · Cited by 51
Hessian-Aware Pruning and Optimal Neural Implant
Yu, S., Yao, Z., Gholami, A., Dong, Z., Kim, S., Mahoney, M. W., & Keutzer, K. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00372 · Cited by 60
Automatic channel pruning via clustering and swarm intelligence optimization for CNN
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03508-1 · Cited by 55
Pruning Deep Neural Networks for Green Energy-Efficient Models: A Survey
Tmamna, J., Ayed, E. B., Fourati, R., Gogate, M., Arslan, T., Hussain, A., & Ayed, M. B. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10313-0 · Cited by 59
Optimizing deep neural networks on intelligent edge accelerators via flexible-rate filter pruning
Li, G., Ma, X., Wang, X., Yue, H., Li, J., Liu, L., Feng, X., & Xue, J. (2022) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2022.102431 · Cited by 51
HRel: Filter pruning based on High Relevance between activation maps and class labels
Sarvani, C. H., Ghorai, M., Dubey, S. R., & Basha, S. H. S. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.12.017 · Cited by 48
Adaptive Filter Pruning via Sensitivity Feedback
Zhang, Y., & Freris, N. M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3246263 · Cited by 48
CATRO: Channel Pruning via Class-Aware Trace Ratio Optimization
Hu, W., Che, Z., Liu, N., Li, M., Tang, J., Zhang, C., & Wang, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3262952 · Cited by 46
DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Guan, Y., Liu, N., Zhao, P., Che, Z., Bian, K., Wang, Y., & Tang, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3161284 · Cited by 46
Soft Person Reidentification Network Pruning via Blockwise Adjacent Filter Decaying
Wang, X., Zheng, Z., He, Y., Yan, F., Zeng, Z., & Yang, Y. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3130047 · Cited by 44
Self-citationŻarski, M., Wójcik, B., Książek, K., & Miszczak, J. A. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12755 · Cited by 45
Training Compact CNNs for Image Classification Using Dynamic-Coded Filter Fusion
Lin, M., Chen, B., Chao, F., & Ji, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3259402 · Cited by 45
Iterative clustering pruning for convolutional neural networks
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110386 · Cited by 45
Neural Network Structure Optimization by Simulated Annealing
Kuo, C.-L., Kuruoğlu, E. E., & Chan, W. K. (2022) · Entropy · doi:10.3390/e24030348 · Cited by 40
Rethinking the Pruning Criteria for Convolutional Neural Network
Huang, Z., Wang, X., & Luo, P. (2021) · neural information processing systems · Cited by 38
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization
Guo, Y., Yuan, H., Tan, J., Wang, Z., Yang, S., & Liu, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00519 · Cited by 42
Prior Gradient Mask Guided Pruning-Aware Fine-Tuning
Cai, L., An, Z., Yang, C., Yan, Y., & Xu, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19888 · Cited by 40
DeepReDuce: ReLU Reduction for Fast Private InferencePreprint
Jha, N. K., Ghodsi, Z., Garg, S., & Reagen, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01396 · Cited by 43
Interpretable Task-inspired Adaptive Filter Pruning for Neural Networks Under Multiple Constraints
Guo, Y., Gao, W., & Li, G. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01972-x · Cited by 37
Jayasimhan, A., & Pabitha, P. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110671 · Cited by 38
Filter Pruning via Learned Representation Median in the Frequency Domain
Zhang, X., Xie, W., Li, Y., Lei, J., & Du, Q. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3124284 · Cited by 35
Zheng, Y., Sun, P., Ren, Q., Xu, W., & Zhu, D. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127124 · Cited by 33
Efficient Layer Compression Without Pruning
Wu, J., Zhu, D., Fang, L., Deng, Y. C., & Zhong, Z. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3302519 · Cited by 34
Linearly Replaceable Filters for Deep Network Channel Pruning
Joo, D., Yi, E., Baek, S., & Kim, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16978 · Cited by 32
Feng, K., Fei, X., Gong, M., Qin, A. K., Li, H., & Wu, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3156588 · Cited by 32
Multidimensional Pruning and Its Extension: A Unified Framework for Model Compression
Guo, J., Xu, D., & Ouyang, W. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3266435 · Cited by 30
Adaptive CNN filter pruning using global importance metric
Mondal, M., Das, B., Roy, S. D., Singh, P., Lall, B., & Joshi, S. D. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103511 · Cited by 29
Implementation of Pavement Defect Detection System on Edge Computing Platform
Lin, Y., Chen, W.-H., & Kuo, C.-H. (2021) · Applied Sciences · doi:10.3390/app11083725 · Cited by 28
Automatic filter pruning algorithm for image classification
Xue, Y., Yao, W., Peng, S., & Yao, S. (2023) · Applied Intelligence · doi:10.1007/s10489-023-05207-x · Cited by 27
Channel Pruning via Lookahead Search Guided Reinforcement Learning
Wang, Z., & Li, C. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00357 · Cited by 28
SOKS: Automatic Searching of the Optimal Kernel Shapes for Stripe-Wise Network Pruning
Liu, G., Zhang, K., & Lv, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3162067 · Cited by 30
Neural Network Pruning by Cooperative Coevolution
Shang, H., Wu, J., Hong, W., & Qian, C. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/667 · Cited by 26
Structural Alignment for Network Pruning through Partial Regularization
Gao, S., Zhang, Z., Zhang, Y., Huang, F., & Huang, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01596 · Cited by 27
Tmamna, J., Ayed, E. B., Fourati, R., Hussain, A., & Ayed, M. B. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111978 · Cited by 25
Exploration and Estimation for Model Compression
Zhang, Y., Gao, S., & Huang, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00054 · Cited by 26
Exploiting Channel Similarity for Network Pruning
Zhao, C., Zhang, Y., & Ni, B. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3248659 · Cited by 25
Kim, N. J., & Kim, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3338052 · Cited by 25
On the Channel Pruning using Graph Convolution Network for Convolutional Neural Network Acceleration
Jiang, D., Cao, Y., & Yang, Q. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/431 · Cited by 27
Filter Pruning via Feature Discrimination in Deep Neural Networks
He, Z., Qian, Y., Wang, Y., Wang, B., Guan, X., Gu, Z., Ling, X., Zeng, S., Wang, H., & Zhou, W. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19803-8_15 · Cited by 24
On the Effect of Pruning on Adversarial Robustness
Jordão, A., & Pedrini, H. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00007 · Cited by 22
Loss-aware automatic selection of structured pruning criteria for deep neural network acceleration
Ghimire, D., Lee, K., & Kim, S. (2023) · Image and Vision Computing · doi:10.1016/j.imavis.2023.104745 · Cited by 24
Zheng, Y., Chen, L., Bao, X., Zhao, F., Zhong, J., & Wang, C. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110562 · Cited by 22
AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression
Zhu, B., Hofstee, H. P., Peltenburg, J., Lee, J., & Al-Ars, Z. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/478 · Cited by 22
Li, C., Li, H., Gao, G., Liu, Z., & Liu, P. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110326 · Cited by 22
Self-citationHolistic Filter Pruning for Efficient Deep Neural Networks
Enderich, L., Timm, F., & Burgard, W. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00264 · Cited by 23
Filter pruning via separation of sparsity search and model training
Lian, Y., Peng, P., & Xu, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.083 · Cited by 21
Attentive Fine-Grained Structured Sparsity for Image Restoration
Oh, J., Kim, H., Nah, S., Hong, C., Choi, J., & Lee, K. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01715 · Cited by 21
WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural Networks
Chen, S., Sun, W., & Huang, L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094874 · Cited by 20
Soft Hybrid Knowledge Distillation against deep neural networks
Zhang, J., Tao, Z., Zhang, S., Qiao, Z., & Guo, K. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127142 · Cited by 21
Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment
Ganjdanesh, A., Gao, S., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01520 · Cited by 22
Auto- Train-Once: Controller Network Guided Automatic Network Pruning from Scratch
Wu, X., Gao, S., Zhang, Z., Li, Z., Bao, R., Zhang, Y., Wang, X., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01530 · Cited by 24
REAF: Remembering Enhancement and Entropy-Based Asymptotic Forgetting for Filter Pruning
Zhang, X., Xie, W., Li, Y., Jiang, K., & Fang, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3288986 · Cited by 20
Complex hybrid weighted pruning method for accelerating convolutional neural networks
Xu, G., Gao, J., Zhang, Y., & Xu, D. (2024) · Scientific Reports · doi:10.1038/s41598-024-55942-5 · Cited by 22
DMPP: Differentiable multi-pruner and predictor for neural network pruning
Li, J., Zhao, B., & Liu, D. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.12.020 · Cited by 19
Zhang, H., Liu, L., Zhou, H., Si, L., Sun, H., & Zheng, N. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3170620 · Cited by 19
Self-citationExploring Incompatible Knowledge Transfer in Few-shot Image Generation
Zhao, Y., Du, C., Abdollahzadeh, M., Pang, T., Lin, M., Yan, S., & Cheung, N. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00713 · Cited by 22
A multi-granularity CNN pruning framework via deformable soft mask with joint training
Zhang, P., Tian, C., Zhao, L., & Duan, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127189 · Cited by 19
Differentiable Transportation Pruning
Li, Y., van Gemert, J. C., Hoefler, T., Moons, B., Eleftheriou, E. S., & Verhoef, B.-E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01555 · Cited by 22
Kill Two Birds with One Stone: Domain Generalization for Semantic Segmentation via Network Pruning
Luo, Y., Liu, P., & Yang, Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02194-5 · Cited by 20
Self-citationProgressive kernel pruning with saliency mapping of input-output channels
Zhu, J., & Pei, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.10.009 · Cited by 18
DDEP: Evolutionary pruning using distilled dataset
Wang, X., Sun, Y., Chen, X., & Xu, H. (2024) · Information Sciences · doi:10.1016/j.ins.2023.120048 · Cited by 17
AutoReP: Automatic ReLU Replacement for Fast Private Network Inference
Peng, H., Huang, S., Zhou, T., Luo, Y., Wang, C., Wang, Z., Zhao, J., Xi, X., Li, A., Geng, T., et al. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00478 · Cited by 18
Pruning-aware Sparse Regularization for Network Pruning
Jiang, N.-F., Zhao, X. F., Zhao, C., An, Y.-Q., Tang, M., & Wang, J.-Q. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1353-0 · Cited by 16
Bit-Line Computing for CNN Accelerators Co-Design in Edge AI Inference
Rios, M. A., Ponzina, F., Levisse, A., Ansaloni, G., & Atienza, D. (2023) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2023.3237914 · Cited by 18
Model Lightweighting for Real-time Distraction Detection on Resource-Limited Devices
Wang, J., & Wu, Z. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/7360170 · Cited by 15
FSConv: Flexible and separable convolution for convolutional neural networks compression
Zhu, Y., Xie, L., Xie, Z., Yin, M., & Yin, G. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109589 · Cited by 16
Network pruning via probing the importance of filters
Kuang, J., Shao, M., Wang, R., Zuo, W., & Ding, W. (2022) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01530-w · Cited by 15
Acceleration-Aware Fine-Grained Channel Pruning for Deep Neural Networks via Residual Gating
Huang, K., Chen, S., Li, B., Claesen, L., Yao, H., Chen, J., Jiang, X., Liu, Z., & Xiong, D. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3093835 · Cited by 14
Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps
Ganjdanesh, A., Gao, S., & Huang, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19803-8_17 · Cited by 16
Multi-objective compression for CNNs via evolutionary algorithm
Lian, Y., Peng, P., Jiang, K., & Xu, W. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120155 · Cited by 14
Ghimire, D., & Kim, S. (2022) · Applied Sciences · doi:10.3390/app13010316 · Cited by 14
Grow-push-prune: Aligning deep discriminants for effective structural network compression
Tian, Q., Arbel, T., & Clark, J. J. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103682 · Cited by 17
Pruning for Power: Optimizing Energy Efficiency in IoT with Neural Network Pruning
Widmann, T., Merkle, F., Nocker, M., & Schöttle, P. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-34204-2_22 · Cited by 16
RASP: Regularization-based Amplitude Saliency Pruning
Zhen, C., Zhang, W., Mo, J., Ji, M., Zhou, H., & Zhu, J. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.09.002 · Cited by 13
Cross-layer importance evaluation for neural network pruning
Lian, Y., Peng, P., Jiang, K., & Xu, W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106496 · Cited by 13
Batch Normalization Tells You Which Filter is Important
Oh, J., Kim, H., Baik, S., Hong, C., & Lee, K. M. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00341 · Cited by 14
Image-Captioning Model Compression
Atliha, V., & Šešok, D. (2022) · Applied Sciences · doi:10.3390/app12031638 · Cited by 13
CorrNet: pearson correlation based pruning for efficient convolutional neural networks
Kumar, A., Yin, B., Shaikh, A. M., Ali, M., & Wei, W. (2022) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01624-5 · Cited by 13
Metadata
- Authors
- He, Y., Ding, Y., Liu, P., Zhu, L., Zhang, H., & Yang, Y.
- Affiliations
- University of Technology Sydney (AU)
- Baidu (China) (CN)
- Nanyang Technological University (SG)
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 2006-2015
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035467254
- Cited by
- 262
- References
- 64
- Citations by year
- 2026: 9 · 2025: 35 · 2024: 43 · 2023: 62 · 2022: 55 · 2021: 49 · 2020: 9
- FWCI
- 13.50
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- OPUS - Open Publications of UTS Scholars (University of Technology Sydney) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- filter pruning, neural network compression, deep convolutional neural networks, layer-wise pruning, model acceleration, FLOPs reduction, image classification, ResNet50
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
