Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
This paper proposed a Soft Filter Pruning (SFP) method to accelerate the inference procedure of deep Convolutional Neural Networks (CNNs). Specifically, the proposed SFP enables the pruned filters to be updated when training the model after pruning. SFP has two advantages over previous works: (1) Larger model capacity. Updating previously pruned filters provides our approach with larger optimization space than fixing the filters to zero. Therefore, the network trained by our method has a larger model capacity to learn from the training data. (2) Less dependence on the pretrained model. Large capacity enables SFP to train from scratch and prune the model simultaneously. In contrast, previous filter pruning methods should be conducted on the basis of the pre-trained model to guarantee their performance. Empirically, SFP from scratch outperforms the previous filter pruning methods. Moreover, our approach has been demonstrated effective for many advanced CNN architectures. Notably, on ILSCRC-2012, SFP reduces more than 42% FLOPs on ResNet-101 with even 0.2% top-5 accuracy improvement, which has advanced the state-of-the-art. Code is publicly available on GitHub: https://github.com/he-y/softfilter-pruning
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
(2017) · Cited by 11,625
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665 · cited 4×
“In the CIFAR-10 experiments, we use the default parameter setting as [He et al., 2016b] and follow the training schedule in [Zagoruyko and Komodakis, 2016].”
MethodInfluentialZagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Research works printed but not linked: 1
- Pavlo Molchanov, Stephen Tyree, Tero Karras, Timo Aila, and Jan Kautz. Pruning convolu- tional neural networks for resource efficient transfer learn- ing. In ICLR, 2017.
Cited by
Items 101–200 of 1,000
Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction
Elkerdawy, S., Elhoushi, M., Zhang, H., & Ray, N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01213 · Cited by 74
Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety
Houben, S., Abrecht, S., Akila, M., Bär, A., Brockherde, F., Feifel, P., Fingscheidt, T., Gannamaneni, S. S., Ghobadi, S. E., Hammam, A., et al. (2022) · Springer eBooks · doi:10.1007/978-3-031-01233-4_1 · Cited by 73
Liu, Y., Shu, Z., Li, Y., Lin, Z., Perazzi, F., & Kung, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01198 · Cited by 73
EDP: An Efficient Decomposition and Pruning Scheme for Convolutional Neural Network Compression
Ruan, X., Liu, Y., Yuan, C., Li, B., Hu, W., Li, Y., & Maybank, S. J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3018177 · Cited by 73
Dynamic Dual Gating Neural Networks
Li, F., Li, G., He, X., & Cheng, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00528 · Cited by 72
Where to Prune: Using LSTM to Guide Data-Dependent Soft Pruning
Ding, G., Zhang, S., Jia, Z., Zhong, J., & Han, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3035028 · Cited by 71
FedSCR: Structure-based Communication Reduction for Federated Learning
Wu, X., Yao, X., & Wang, C. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3046250 · Cited by 70
Channel pruning based on convolutional neural network sensitivity
Yang, C., & Liu, H. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.07.051 · Cited by 69
Play and Prune: Adaptive Filter Pruning for Deep Model Compression
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/480 · Cited by 68
Prune Your Model Before Distill It
Park, J., & No, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20083-0_8 · Cited by 66
A Deep Learning-Based Framework for Low Complexity Multiuser MIMO Precoding Design
Zhang, M., Gao, J., & Zhong, C. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3190435 · Cited by 66
A survey of model compression strategies for object detection
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17192-x · Cited by 65
CNNPruner: Pruning Convolutional Neural Networks with Visual Analytics
Guan, L., Wang, J., Shen, H., Chen, K., Shan, G., & Lu, Z. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030461 · Cited by 65
Auto Graph Encoder-Decoder for Neural Network Pruning
Yu, S., Mazaheri, A., & Jannesari, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00630 · Cited by 65
Isomorphic Pruning for Vision Models
Fang, G., Ma, X., Mi, M. B., & Wang, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73404-5_14 · Cited by 65
Learn-Prune-Share for Lifelong Learning
Wang, Z., Jian, T., Chowdhury, K. R., Wang, Y., Dy, J., & Ioannidis, S. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00073 · Cited by 64
Masking as an Efficient Alternative to Finetuning for Pretrained Language Models
Zhao, M., Lin, T., Mi, F., Jaggi, M., & Schütze, H. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.174 · Cited by 62
A Generalized and Robust Method Towards Practical Gaze Estimation on Smart Phone
Guo, T., Liu, Y., Zhang, H., Liu, X., Kwak, Y., Yoo, B. I., Han, J., & Choi, C. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00144 · Cited by 62
Compressing Neural Networks: Towards Determining the Optimal Layer-wise DecompositionPreprint
Liebenwein, L., Maalouf, A., Oren, G., Feldman, D., & Rus, D. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11442 · Cited by 63
RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition
Dong, P., Wang, S., Niu, W., Zhang, C., Lin, S., Li, Z., Gong, Y., Ren, B., Lin, X., & Tao, D. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218499 · Cited by 61
Automatic channel pruning via clustering and swarm intelligence optimization for CNN
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03508-1 · Cited by 61
Tensor Decomposition for Model Reduction in Neural Networks: A Review [Feature]
Liu, X., & Parhi, K. K. (2023) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2023.3267921 · Cited by 62
Evolutionary Shallowing Deep Neural Networks at Block Levels
Zhou, Y., Yen, G. G., & Zhang, Y. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3059529 · Cited by 59
Lin, H., Bai, H., Liu, Z., Hou, L., Sun, M., Song, L., Wei, Y., & Surr, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02584 · Cited by 59
EasiEdge: A Novel Global Deep Neural Networks Pruning Method for Efficient Edge Computing
Yu, F., Cui, L., Wang, P., Han, C., Huang, R., & Huang, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3034925 · Cited by 58
“Current practices [13]–[15], [17]–[19] perform filter prun-”
BackgroundMethodAdaptive Sparse ViT: Towards Learnable Adaptive Token Pruning by Fully Exploiting Self-Attention
Liu, X., Wu, T., & Guo, G. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/136 · Cited by 59
HRel: Filter pruning based on High Relevance between activation maps and class labels
Sarvani, C. H., Ghorai, M., Dubey, S. R., & Basha, S. H. S. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.12.017 · Cited by 58
ZeroFL: Efficient On-Device Training for Federated Learning with Local SparsityPreprint
Qiu, X., Fernández-Marqués, J., de Gusmão, P. P. B., Gao, Y., Parcollet, T., & Lane, N. D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.02507 · Cited by 58
Ruan, X., Liu, Y., Li, B., Yuan, C., & Hu, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16351 · Cited by 57
Data-Independent Structured Pruning of Neural Networks via Coresets
Mussay, B., Feldman, D., Zhou, S., Braverman, V., & Osadchy, M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3088587 · Cited by 59
Kim, N. J., & Kim, H. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3189496 · Cited by 57
Adaptive Filter Pruning via Sensitivity Feedback
Zhang, Y., & Freris, N. M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3246263 · Cited by 56
CAP: Context-Aware Pruning for Semantic Segmentation
He, W. P., Wu, M., Liang, M., & Lam, S.-K. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00100 · Cited by 55
Optimizing deep neural networks on intelligent edge accelerators via flexible-rate filter pruning
Li, G., Ma, X., Wang, X., Yue, H., Li, J., Liu, L., Feng, X., & Xue, J. (2022) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2022.102431 · Cited by 55
CATRO: Channel Pruning via Class-Aware Trace Ratio Optimization
Hu, W., Che, Z., Liu, N., Li, M., Tang, J., Zhang, C., & Wang, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3262952 · Cited by 55
A Generic Layer Pruning Method for Signal Modulation Recognition Deep Learning Models
Lu, Y., Zhu, Y., Li, Y., Xu, D., Lin, Y., Xuan, Q., & Yang, X. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3520958 · Cited by 55
Accelerate CNNs from Three Dimensions: A Comprehensive Pruning FrameworkPreprint
Wang, W., Chen, M., Zhao, S., Chen, L., Hu, J., Liu, H., Cai, D., He, X., & Liu, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04879 · Cited by 55
Exploring Token Pruning in Vision State Space Models
Zhan, Z., Kong, Z., Gong, Y., Wu, Y., Meng, Z., Zheng, H., Shen, X., Ioannidis, S., Niu, W., Zhao, P., et al. (2024) · neural information processing systems · doi:10.52202/079017-1613 · Cited by 59
ChipNet: Budget-Aware Pruning with Heaviside Continuous ApproximationsPreprint
Tiwari, R., Bamba, U., Chavan, A., & Gupta, D. K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07156 · Cited by 54
Auto- Train-Once: Controller Network Guided Automatic Network Pruning from Scratch
Wu, X., Gao, S., Zhang, Z., Li, Z., Bao, R., Zhang, Y., Wang, X., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01530 · Cited by 54
Performance-Aware Approximation of Global Channel Pruning for Multitask CNNs
Ye, H., Zhang, B., Chen, T., Fan, J., & Wang, B. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3260903 · Cited by 53
CCPrune: Collaborative channel pruning for learning compact convolutional networks
Chen, Y., Wen, X., Zhang, Y., & Shi, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.063 · Cited by 53
DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Guan, Y., Liu, N., Zhao, P., Che, Z., Bian, K., Wang, Y., & Tang, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3161284 · Cited by 53
Prior Gradient Mask Guided Pruning-Aware Fine-Tuning
Cai, L., An, Z., Yang, C., Yan, Y., & Xu, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19888 · Cited by 53
Li, Z., Yuan, G., Niu, W., Zhao, P., Li, Y., Cai, Y., Shen, X., Zhan, Z., Kong, Z., Jin, Q., et al. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01403 · Cited by 53
PCAS: Pruning Channels with Attention Statistics for Deep Network CompressionPreprint
Yamamoto, K., & Maeno, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05382 · Cited by 53
Masking as an Efficient Alternative to Finetuning for Pretrained Language ModelsPreprint
Zhao, M., Lin, T., Mi, F., Jaggi, M., & Schütze, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12406 · Cited by 52
A Gradient Flow Framework For Analyzing Network PruningPreprint
Lubana, E. S., & Dick, R. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.11839 · Cited by 52
Structured Pruning for Efficient Generative Pre-trained Language Models
Tao, C., Hou, L., Bai, H., Wei, J., Jiang, X., Liu, Q., Luo, P., & Wong, N. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.692 · Cited by 52
Dynamic Sparsity Neural Networks for Automatic Speech Recognition
Wu, Z., Zhao, D. X., Liang, Q., Yu, J., Gulati, A., & Pang, R. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414505 · Cited by 51
Jiang, P., Xue, Y., & Neri, F. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110229 · Cited by 51
Dynamic Network Pruning with Interpretable Layerwise Channel Selection
Wang, Y., Zhang, X., Hu, X., Zhang, B., & Su, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6098 · Cited by 51
Iterative clustering pruning for convolutional neural networks
Chang, J., Lu, Y., Xue, P., Xu, Y., & Wei, Z. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110386 · Cited by 51
Layer-compensated Pruning for Resource-constrained Convolutional Neural NetworksPreprint
Chin, T.-W., Zhang, C., & Marculescu, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00518 · Cited by 51
Efficient Neural Network Training via Forward and Backward Propagation SparsificationPreprint
Zhou, X., Zhang, W., Chen, Z., Diao, S., & Zhang, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05685 · Cited by 51
SCSP: Spectral Clustering Filter Pruning with Soft Self-adaption MannersPreprint
Zhuo, H., Qian, X., Fu, Y., Yang, H., & Xue, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05320 · Cited by 49
Self-citationTraining Compact CNNs for Image Classification Using Dynamic-Coded Filter Fusion
Lin, M., Chen, B., Chao, F., & Ji, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3259402 · Cited by 51
Literature Review of Deep Network Compression
Alqahtani, A., Xie, X., & Jones, M. W. (2021) · Informatics · doi:10.3390/informatics8040077 · Cited by 50
Neuron Merging: Compensating for Pruned NeuronsPreprint
Kim, W., Kim, S., Park, M.-C., & Jeon, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13160 · Cited by 50
EdgeKE: An On-Demand Deep Learning IoT System for Cognitive Big Data on Industrial Edge Devices
Fang, W. W., Feng, X., Ding, Y., Xiong, N. N., & Leung, V. C. M. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3044930 · Cited by 48
RGP: Neural Network Pruning Through Regular Graph With Edges Swapping
Chen, Z., Xiang, J., Lu, Y., Xuan, Q., Wang, Z., Chen, G., & Yang, X. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3280899 · Cited by 48
Soft Person Reidentification Network Pruning via Blockwise Adjacent Filter Decaying
Wang, X., Zheng, Z., He, Y., Yan, F., Zeng, Z., & Yang, Y. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3130047 · Cited by 47
Self-citationPruning CNN filters via quantifying the importance of deep visual representations
Alqahtani, A., Xie, X., Jones, M. W., & Essa, E. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103220 · Cited by 47
Dynamic Sparse Graph for Efficient Deep LearningPreprint
Liu, L., Deng, L., Hu, X., Zhu, M., Li, G., Ding, Y., & Xie, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00859 · Cited by 47
A Mixed-Pruning Based Framework for Embedded Convolutional Neural Network Acceleration
Chang, X., Pan, H., Lin, W., & Gao, H. (2021) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3048260 · Cited by 47
Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection
Ye, M., Gong, C., Nie, L., Zhou, D., Klivans, A. R., & Liu, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01794 · Cited by 46
CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters
Gavrikov, P., & Keuper, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01848 · Cited by 48
Filter Grafting for Deep Neural Networks
Meng, F., Cheng, H., Li, K., Xu, Z., Ji, R., Sun, X., & Lu, G. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00663 · Cited by 46
A comprehensive review of network pruning based on pruning granularity and pruning time perspectives
Zhu, K., Hu, F., Ding, Y., Zhou, W., & Wang, R. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129382 · Cited by 45
EmbeddedPigDet—Fast and Accurate Pig Detection for Embedded Board Implementations
Seo, J., Ahn, H., Kim, D., Lee, S.-J., Chung, Y., & Park, D. (2020) · Applied Sciences · doi:10.3390/app10082878 · Cited by 45
BCNet: Searching for Network Width with Bilaterally Coupled Network
Su, X. Q., You, S., Wang, F., Qian, C., Zhang, C., & Xu, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00221 · Cited by 44
Rethinking Weight Decay for Efficient Neural Network Pruning
Tessier, H., Gripon, V., Léonardon, M., Arzel, M., Hannagan, T., & Bertrand, D. (2022) · Journal of Imaging · doi:10.3390/jimaging8030064 · Cited by 44
LOss-Based SensiTivity rEgulaRization: Towards deep sparse neural networks
Tartaglione, E., Bragagnolo, A., Fiandrotti, A., & Grangetto, M. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.11.029 · Cited by 44
An Image Enhancing Pattern-Based Sparsity for Real-Time Inference on Mobile Devices
Ma, X., Niu, W., Zhang, T., Liu, S., Lin, S., Li, H., Wen, W., Chen, X., Tang, J., Ma, K., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58601-0_37 · Cited by 44
Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learning
Yu, S., Mazaheri, A., & Jannesari, A. (2021) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.2102.03214 · Cited by 44
Fusion-Catalyzed Pruning for Optimizing Deep Learning on Intelligent Edge Devices
Li, G., Ma, X., Wang, X., Liu, L., Xue, J., & Feng, X. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.3013050 · Cited by 43
Zhang, S., Wu, G., Gu, J., & Han, J. (2020) · Electronics · doi:10.3390/electronics9081209 · Cited by 43
Learning Efficient Binarized Object Detectors With Information Compression
Wang, Z., Lu, J., Wu, Z., & Zhou, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3050464 · Cited by 43
Sparse Weight Activation TrainingPreprint
Raihan, A., & Aamodt, T. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.01969 · Cited by 43
Locally Free Weight Sharing for Network Width SearchPreprint
Su, X. Q., You, S., Huang, T., Wang, F., Qian, C., Zhang, C., & Xu, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05258 · Cited by 43
Linearly Replaceable Filters for Deep Network Channel Pruning
Joo, D., Yi, E., Baek, S., & Kim, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16978 · Cited by 43
OTOV2: Automatic, Generic, User-FriendlyPreprint
Chen, T., Liang, L., Ding, T., Zhu, Z., & Zharkov, I. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.06862 · Cited by 50
Trainability Preserving Neural PruningPreprint
Wang, H., & Fu, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.12534 · Cited by 43
Self-citationSPATL: Salient Parameter Aggregation and Transfer Learning for Heterogeneous Federated Learning
Yu, S., Nguyen, P., Abebe, W. M., Qian, W., Anwar, A., & Jannesari, A. (2022) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41404.2022.00041 · Cited by 42
BilevelPruning: Unified Dynamic and Static Channel Pruning for Convolutional Neural Networks
Gao, S., Zhang, Y., Huang, F., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01523 · Cited by 42
A dynamic CNN pruning method based on matrix similarity
Shao, M., Dai, J., Kuang, J., & Meng, D. (2020) · Signal Image and Video Processing · doi:10.1007/s11760-020-01760-x · Cited by 42
Jayasimhan, A., & Pabitha, P. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110671 · Cited by 42
Chen, Y., Wen, X., Zhang, Y., & He, Q. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107876 · Cited by 42
Agricultural Image Processing: Challenges, Advances, and Future Trends
Song, X., Yan, L., Liu, S., Gao, T., Han, L., Jiang, X., Jin, H., & Zhu, Y. (2025) · Applied Sciences · doi:10.3390/app15169206 · Cited by 42
Efficient Neural Network Compression Inspired by Compressive Sensing
Gao, W., Guo, Y., Ma, S., Li, G., & Kwong, S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3186008 · Cited by 41
NAP: Neural architecture search with pruning
Ding, Y., Wu, Y., Huang, C., Tang, S., Wu, F. Q., Yang, Y., Zhu, W., & Zhuang, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.12.002 · Cited by 41
Self-citationGrowing Efficient Deep Networks by Structured Continuous SparsificationPreprint
Yuan, X., Savarese, P., & Maire, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15353 · Cited by 41
On the Channel Pruning using Graph Convolution Network for Convolutional Neural Network Acceleration
Jiang, D., Cao, Y., & Yang, Q. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/431 · Cited by 41
On the Opportunities of Green Computing: A SurveyPreprint
Zhou, Y., Lin, X., Zhang, X., Wang, M., Jiang, G., Lu, H., Wu, Y., Zhang, K., Yang, Z., Wang, K., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.00447 · Cited by 42
S-Rocket: Selective Random Convolution Kernels for Time Series ClassificationPreprint
Salehinejad, H., Wang, Y., Yu, Y., Tang, J., & Valaee, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.03445 · Cited by 41
Structural Alignment for Network Pruning through Partial Regularization
Gao, S., Zhang, Z., Zhang, Y., Huang, F., & Huang, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01596 · Cited by 40
Multidimensional Pruning and Its Extension: A Unified Framework for Model Compression
Guo, J., Xu, D., & Ouyang, W. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3266435 · Cited by 40
Compressing Deep Model With Pruning and Tucker Decomposition for Smart Embedded Systems
Dai, C., Liu, X., Cheng, H., Yang, L. T., & Deen, M. J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3116316 · Cited by 40
Pruning by Training: A Novel Deep Neural Network Compression Framework for Image Processing
Tian, G., Chen, J., Zeng, X., & Liu, Y. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3054315 · Cited by 39
Cascaded Projection: End-To-End Network Compression and Acceleration
Minnehan, B., & Savakis, A. E. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01097 · Cited by 39
Metadata
- Authors
- He, Y., Kang, G., Dong, X., Fu, Y., & Yang, Y.
- Venue
- Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
- Published
- 2018-07
- Pages
- 2234-2240
- OpenAlex
- W2808168148
- Cited by
- 1,020
- References
- 33
- FWCI
- 29.46
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.