Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
This paper proposed a Soft Filter Pruning (SFP) method to accelerate the inference procedure of deep Convolutional Neural Networks (CNNs). Specifically, the proposed SFP enables the pruned filters to be updated when training the model after pruning. SFP has two advantages over previous works: (1) Larger model capacity. Updating previously pruned filters provides our approach with larger optimization space than fixing the filters to zero. Therefore, the network trained by our method has a larger model capacity to learn from the training data. (2) Less dependence on the pretrained model. Large capacity enables SFP to train from scratch and prune the model simultaneously. In contrast, previous filter pruning methods should be conducted on the basis of the pre-trained model to guarantee their performance. Empirically, SFP from scratch outperforms the previous filter pruning methods. Moreover, our approach has been demonstrated effective for many advanced CNN architectures. Notably, on ILSCRC-2012, SFP reduces more than 42% FLOPs on ResNet-101 with even 0.2% top-5 accuracy improvement, which has advanced the state-of-the-art. Code is publicly available on GitHub: https://github.com/he-y/softfilter-pruning
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
(2017) · Cited by 11,625
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665 · cited 4×
“In the CIFAR-10 experiments, we use the default parameter setting as [He et al., 2016b] and follow the training schedule in [Zagoruyko and Komodakis, 2016].”
MethodInfluentialZagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Research works printed but not linked: 1
- Pavlo Molchanov, Stephen Tyree, Tero Karras, Timo Aila, and Jan Kautz. Pruning convolu- tional neural networks for resource efficient transfer learn- ing. In ICLR, 2017.
Cited by
Items 201–300 of 1,000
Channel Pruning Method for Signal Modulation Recognition Deep Learning Models
Chen, Z., Wang, Z., Gao, X., Zhou, J., Xu, D., Zheng, S., Xuan, Q., & Yang, X. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3329000 · Cited by 39
Neural Network Pruning by Cooperative Coevolution
Shang, H., Wu, J., Hong, W., & Qian, C. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/667 · Cited by 39
Knapsack Pruning with Inner DistillationPreprint
Aflalo, Y., Noy, A., Lin, M., Friedman, I., & Zelnik, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08258 · Cited by 39
Multi-way backpropagation for training compact deep neural networks
Guo, Y. F., Chen, J., Du, Q., van den Hengel, A., Shi, Q., & Tan, M. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.03.001 · Cited by 39
Survey of Deep Learning Accelerators for Edge and Emerging Computing
Alam, S., Yakopcic, C., Wu, Q., Barnell, M., Khan, S., & Taha, T. M. (2024) · Electronics · doi:10.3390/electronics13152988 · Cited by 38
Filter Pruning via Learned Representation Median in the Frequency Domain
Zhang, X., Xie, W., Li, Y., Lei, J., & Du, Q. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3124284 · Cited by 38
Channel Pruning via Lookahead Search Guided Reinforcement Learning
Wang, Z., & Li, C. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00357 · Cited by 38
Zheng, Y., Sun, P., Ren, Q., Xu, W., & Zhu, D. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127124 · Cited by 38
Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis
Zhuo, L., Wang, G., Li, S., Wu, W., & Liu, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19784-0_17 · Cited by 38
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging
Yvinec, E., Dapogny, A., Cord, M., & Bailly, K. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3179616 · Cited by 38
Efficient Layer Compression Without Pruning
Wu, J., Zhu, D., Fang, L., Deng, Y. C., & Zhong, Z. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3302519 · Cited by 37
A Hardware-Friendly High-Precision CNN Pruning Method and Its FPGA Implementation
Sui, X., Lv, Q., Zhi, L., Zhu, B., Yang, Y., Zhang, Y., & Tan, Z. (2023) · Sensors · doi:10.3390/s23020824 · Cited by 37
Self-citationFilter pruning by quantifying feature similarity and entropy of feature maps
Liu, Y., Fan, K., Wu, D., & Zhou, W. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126297 · Cited by 37
Aketi, S. A., Roy, S., Raghunathan, A., & Roy, K. (2020) · IEEE Access · doi:10.1109/access.2020.3024992 · Cited by 36
Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment
Ganjdanesh, A., Gao, S., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01520 · Cited by 36
Towards performance-maximizing neural network pruning via global channel attention
Wang, Y., Guo, S., Guo, J., Zhang, J., Zhang, W., Yan, C., & Zhang, Y. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.11.065 · Cited by 36
Cascading structured pruning: enabling high data reuse for sparse DNN accelerators
Hanson, E., Li, S., Li, H. H., & Chen, Y. (2022) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3470496.3527419 · Cited by 36
CUP: Cluster Pruning for Compressing Deep Neural Networks
Duggal, R., Xiao, C., Vuduc, R. W., Chau, D. H., & Sun, J. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671980 · Cited by 36
Differentiable Transportation Pruning
Li, Y., van Gemert, J. C., Hoefler, T., Moons, B., Eleftheriou, E. S., & Verhoef, B.-E. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01555 · Cited by 36
TinyADC: Peripheral Circuit-aware Weight Pruning Framework for Mixed-signal DNN Accelerators
Yuan, G., Behnam, P., Cai, Y., Shafiee, A. R., Fu, J., Liao, Z., Li, Z., Ma, X., Deng, J., Wang, J., et al. (2021) · Design, Automation, and Test in Europe · doi:10.23919/date51398.2021.9474235 · Cited by 36
Topological Insights into Sparse Neural Networks
Liu, S., van der Lee, T., Yaman, A., Atashgahi, Z., Ferraro, D., Sokar, G., Pechenizkiy, M., & Mocanu, D. C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67664-3_17 · Cited by 36
RED : Looking for Redundancies for Data-Free Structured Compression of Deep Neural NetworksPreprint
Yvinec, E., Dapogny, A., Cord, M., & Bailly, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14797 · Cited by 36
Edge Deployment of Deep Networks for Visual Detection: A Review
Zhai, H., Du, J., Ai, Y., & Hu, T. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3502539 · Cited by 35
Liang, J., Zhang, L., Bu, C., Cheng, D., Wu, H., & Song, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122180 · Cited by 35
FPWT: Filter pruning via wavelet transform for CNNs
Liu, Y., Fan, K., & Zhou, W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106577 · Cited by 36
Designing efficient convolutional neural network structure: A survey
Mi, J., Feng, J., & Huang, K.-Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.08.158 · Cited by 35
Model compression for real-time object detection using rigorous gradation pruning
Yang, D., Solihin, M. I., Zhao, Y., Cai, B., Chen, C., Wijaya, A. A., Ang, C. K., & Lim, W. H. (2024) · iScience · doi:10.1016/j.isci.2024.111618 · Cited by 35
Chen, Y., & Wang, Z. (2019) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2019.06.004 · Cited by 35
Adaptive CNN filter pruning using global importance metric
Mondal, M., Das, B., Roy, S. D., Singh, P., Lall, B., & Joshi, S. D. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103511 · Cited by 35
SOKS: Automatic Searching of the Optimal Kernel Shapes for Stripe-Wise Network Pruning
Liu, G., Zhang, K., & Lv, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3162067 · Cited by 35
Exploration and Estimation for Model Compression
Zhang, Y., Gao, S., & Huang, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00054 · Cited by 35
Adaptive Layer Sparsity for Large Language Models via Activation Correlation Assessment
Li, W., Li, L., Lee, M. G., & Sun, S. (2024) · neural information processing systems · doi:10.52202/079017-3471 · Cited by 35
Metaheuristics for pruning convolutional neural networks: A comparative study
Palakonda, V., Tursunboev, J., Kang, J., & Moon, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126326 · Cited by 34
Feng, K., Fei, X., Gong, M., Qin, A. K., Li, H., & Wu, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3156588 · Cited by 34
Layer-wise Searching for 1-bit Detectors
Xu, S. H., Zhao, J., Lü, J., Zhang, B., Han, S., & Doermann, D. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00563 · Cited by 37
Resilient Binary Neural Network
Xu, S. Y., Li, Y., Ma, T., Lin, M., Dong, H., Zhang, B., Gao, P., & Lü, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26261 · Cited by 35
Layer Pruning for Obtaining Shallower ResNets
Zhang, K., & Liu, G. (2022) · IEEE Signal Processing Letters · doi:10.1109/lsp.2022.3171128 · Cited by 34
Deep Model Compression based on the Training History
Basha, S. H. S., Farazuddin, M., Pulabaigari, V., Dubey, S. R., & Mukherjee, S. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127257 · Cited by 34
Luo, X., Liu, D., Kong, H., Huai, S., Chen, H., Xiong, G., & Liu, W. (2024) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3701728 · Cited by 33
Joint Multi-Dimension Pruning via Numerical Gradient Update
Liu, Z., Zhang, X., Shen, Z., Wei, Y., Cheng, K.-T. T., & Sun, J. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3112041 · Cited by 33
Efficient Deep Learning-Based Lossy Image Compression Via Asymmetric Autoencoder and Pruning
Kim, J., Choi, J. H., Chang, J., & Lee, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053102 · Cited by 33
Dynamic Structure Pruning for Compressing CNNs
Park, J.-H., Kim, Y., Kim, J., Choi, J., & Lee, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26127 · Cited by 33
Dynamic Slimmable Denoising Network
Jiang, Z., Li, C., Chang, X., Chen, L., Zhu, J., & Yang, Y. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3246792 · Cited by 33
Self-citationManzoor, H. U., Jafri, A. R., & Zoha, A. (2024) · Internet of Things · doi:10.1016/j.iot.2024.101376 · Cited by 32
SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels
Zhao, H., Wang, P., Zhao, Y., Luo, H., Wang, F., & Shou, M. Z. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01918-3 · Cited by 32
SASL: Saliency-Adaptive Sparsity Learning for Neural Network Acceleration
Shi, J., Xu, J., Tasaka, K., & Chen, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3013170 · Cited by 32
Learning to Explore Distillability and Sparsability: A Joint Framework for Model Compression
Liu, Y., Cao, J., Li, B., Hu, W., & Maybank, S. J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3185317 · Cited by 34
Dong, R., Li, C., Fu, H., Wang, J., Li, W., Yao, Y., Gan, L., Yu, L., & Gong, P. (2020) · Remote Sensing · doi:10.3390/rs12091418 · Cited by 32
ARPruning: An automatic channel pruning based on attention map ranking
Yuan, T., Li, Z., Liu, B., Tang, Y., & Liu, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106220 · Cited by 32
Efficient Image Super Resolution Via Channel Discriminative Deep Neural Network Pruning
Hou, Z., & Kung, S. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054019 · Cited by 32
Compressing convolutional neural networks with hierarchical Tucker-2 decomposition
Gabor, M., & Zdunek, R. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109856 · Cited by 31
Hybrid Pruning: Thinner Sparse Networks for Fast Inference on Edge DevicesPreprint
Xu, X., Park, M. S., & Brick, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00482 · Cited by 31
Towards Better Structured Pruning Saliency by Reorganizing Convolution
Sun, X., & Shi, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00220 · Cited by 31
Learning Low Resource Consumption CNN through Pruning and Quantization
Qi, Q., Lu, Y., Li, J., Wang, J., Sun, H., & Liao, J. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3050770 · Cited by 30
Spatially Adaptive Feature Refinement for Efficient Inference
Han, Y., Huang, G. M., Song, S., Yang, L., Zhang, Y., & Jiang, H. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3125263 · Cited by 30
HFPQ: deep neural network compression by hardware-friendly pruning-quantization
Fan, Y., Pang, W., & Lu, S. (2021) · Applied Intelligence · doi:10.1007/s10489-020-01968-x · Cited by 30
COP: customized correlation-based Filter level pruning method for deep CNN compression
Wang, W., Yu, Z., Fu, C., Cai, D., & He, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.098 · Cited by 30
Stability Based Filter Pruning for Accelerating Deep CNNs
Singh, P. P., Kadi, V. S. R., Verma, N., & Namboodiri, V. P. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00129 · Cited by 30
Exploring Structural Sparsity in CNN via Selective Penalty
Zhao, M., Peng, J., Yu, S., Liu, L., & Wu, N. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3071532 · Cited by 30
PENNI: Pruned Kernel Sharing for Efficient CNN InferencePreprint
Li, S., Hanson, E., Li, H., & Chen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07133 · Cited by 30
Zou, Y., & Liu, C. (2023) · Measurement · doi:10.1016/j.measurement.2023.113438 · Cited by 30
ELRT: Efficient Low-Rank Training for Compact Convolutional Neural NetworksPreprint
Sui, Y., Yin, M., Gong, Y., Xiao, J., Phan, H., & Yuan, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.10341 · Cited by 30
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training
Yuan, G., Li, Y., Li, S., Kong, Z., Tulyakov, S., Tang, X., Wang, Y., & Ren, J. (2022) · neural information processing systems · doi:10.52202/068431-1385 · Cited by 30
Holistic Filter Pruning for Efficient Deep Neural Networks
Enderich, L., Timm, F., & Burgard, W. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00264 · Cited by 29
Acceleration of Deep Convolutional Neural Networks Using Adaptive Filter Pruning
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2992390 · Cited by 29
AdaPrune: An Accelerator-Aware Pruning Technique for Sustainable CNN Accelerators
Li, J., & Louri, A. (2021) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2021.3060690 · Cited by 32
Single-shot pruning and quantization for hardware-friendly neural network acceleration
Jiang, B., Chen, J., & Liu, Y. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106816 · Cited by 29
Multistage Pruning of CNN Based ECG Classifiers for Edge Devices
Li, X., Panicker, R. C., Cardiff, B., & John, D. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630588 · Cited by 29
Network Pruning That Matters: A Case Study on Retraining Variants
Le, D. H., & Hua, B.-S. (2021) · arXiv · doi:10.48550/arxiv.2105.03193 · Cited by 28
Grad-CAM++ is Equivalent to Grad-CAM With Positive Gradients
Lerma, M., & Lucas, M. (2022) · International Machine Vision and Image Processing Conference (IMVIP) · doi:10.56541/awjv6348 · Cited by 28
SCWC: Structured channel weight sharing to compress convolutional neural networks
Li, G., Zhang, M., Wang, J., Weng, D., & Corporaal, H. (2021) · Information Sciences · doi:10.1016/j.ins.2021.12.020 · Cited by 28
Optimizing Convolutional Neural Network Architectures
Balderas, L., Lastra, M., & Benítez, J. M. (2024) · Mathematics · doi:10.3390/math12193032 · Cited by 28
WHC: Weighted Hybrid Criterion for Filter Pruning on Convolutional Neural Networks
Chen, S., Sun, W., & Huang, L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094874 · Cited by 28
Saliency and location aware pruning of deep visual detectors for autonomous driving
Choi, J. I., & Tian, Q. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128656 · Cited by 28
Eo, M., Kang, S., & Rhee, W. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.01.024 · Cited by 28
Pruning Neural Networks Via Coresets and Convex Geometry: Towards No Assumptions
Tukan, M., Mualem, L., & Maalouf, A. (2022) · neural information processing systems · doi:10.52202/068431-2754 · Cited by 28
Kim, N. J., & Kim, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3338052 · Cited by 29
Automatic filter pruning algorithm for image classification
Xue, Y., Yao, W., Peng, S., & Yao, S. (2023) · Applied Intelligence · doi:10.1007/s10489-023-05207-x · Cited by 27
Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN
Hao, T., Ding, X., Han, J., Guo, Y., & Ding, G. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3298263 · Cited by 27
HetConv: Beyond Homogeneous Convolution Kernels for Deep CNNs
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01264-3 · Cited by 27
Softer Pruning, Incremental Regularization
Cai, L., An, Z., Yang, C., & Xu, Y. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412993 · Cited by 27
Neural network relief: a pruning algorithm based on neural activity
Dekhovich, A., Tax, D. M. J., Sluiter, M. H. F., & Bessa, M. A. (2024) · Machine Learning · doi:10.1007/s10994-024-06516-z · Cited by 27
SFP: Similarity-based filter pruning for deep neural networks
Li, G., Li, R., Li, T., Shen, C., Zou, X., Wang, J., Wang, C., & Li, N. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121418 · Cited by 27
Complex hybrid weighted pruning method for accelerating convolutional neural networks
Xu, G., Gao, J., Zhang, Y., & Xu, D. (2024) · Scientific Reports · doi:10.1038/s41598-024-55942-5 · Cited by 26
Toward Compact Deep Neural Networks via Energy-Aware PruningPreprint
Yeom, S.-K., Shim, K.-H., & Hwang, J.-H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.10858 · Cited by 26
Pruning-aware Sparse Regularization for Network Pruning
Jiang, N.-F., Zhao, X. F., Zhao, C., An, Y.-Q., Tang, M., & Wang, J.-Q. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1353-0 · Cited by 26
Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps
Ganjdanesh, A., Gao, S., & Huang, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19803-8_17 · Cited by 26
A Unified Approach to Coreset Learning
Maalouf, A., Eini, G., Mussay, B., Feldman, D., & Osadchy, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3213169 · Cited by 26
Soft Masking for Cost-Constrained Channel Pruning
Humble, R., Shen, M., Latorre, J. A., Darve, E., & Álvarez, J. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20083-0_38 · Cited by 26
DPACS: Hardware Accelerated Dynamic Neural Network Pruning through Algorithm-Architecture Co-design
Gao, Y., Zhang, B., Qi, X., & So, H. K. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3575693.3575728 · Cited by 26
Sensitivity pruner: Filter-Level compression algorithm for deep neural networks
Guo, S., Lai, B., Yang, S., Zhao, J., & Shen, F. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109508 · Cited by 26
FPFS: Filter-level pruning via distance weight measuring filter similarity
Zhang, W., & Wang, Z. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.049 · Cited by 26
BinaryViT: Toward Efficient and Accurate Binary Vision Transformers
Xiao, J., Li, Z., Li, J., Yang, L., & Gu, Q. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3457610 · Cited by 26
Dynamic Token-Pass Transformers for Semantic Segmentation
Liu, Y., Zhou, Q., Wang, J., Wang, Z., Wang, F., Wang, J., & Zhang, W. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00184 · Cited by 25
Recurrent Bilinear Optimization for Binary Neural Networks
Xu, S. H., Li, Y., Wang, T., Ma, T., Zhang, B., Gao, P., Qiao, Y., Lü, J., & Guo, G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20053-3_2 · Cited by 25
Exploiting Channel Similarity for Network Pruning
Zhao, C., Zhang, Y., & Ni, B. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3248659 · Cited by 25
Efficient Visual Recognition: A Survey on Recent Advances and Brain-inspired Methodologies
Wu, Y., Wang, D., Lu, X., Yang, F., Yao, M., Dong, W., Shi, J., & Li, G. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1340-5 · Cited by 25
Multi-domain clustering pruning: Exploring space and frequency similarity based on GAN
Zhang, J., Feng, Y., Wang, C., Shao, M., Jiang, Y., & Wang, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126279 · Cited by 25
Zheng, Q., Tian, X., Yang, M., & Su, H. (2020) · Multidimensional Systems and Signal Processing · doi:10.1007/s11045-020-00736-x · Cited by 25
Filter pruning with uniqueness mechanism in the frequency domain for efficient neural networks
Zhang, S., Gao, M., Ni, Q., & Han, J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.02.004 · Cited by 25
Metadata
- Authors
- He, Y., Kang, G., Dong, X., Fu, Y., & Yang, Y.
- Venue
- Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
- Published
- 2018-07
- Pages
- 2234-2240
- OpenAlex
- W2808168148
- Cited by
- 1,020
- References
- 33
- FWCI
- 29.46
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.