Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
This paper proposed a Soft Filter Pruning (SFP) method to accelerate the inference procedure of deep Convolutional Neural Networks (CNNs). Specifically, the proposed SFP enables the pruned filters to be updated when training the model after pruning. SFP has two advantages over previous works: (1) Larger model capacity. Updating previously pruned filters provides our approach with larger optimization space than fixing the filters to zero. Therefore, the network trained by our method has a larger model capacity to learn from the training data. (2) Less dependence on the pretrained model. Large capacity enables SFP to train from scratch and prune the model simultaneously. In contrast, previous filter pruning methods should be conducted on the basis of the pre-trained model to guarantee their performance. Empirically, SFP from scratch outperforms the previous filter pruning methods. Moreover, our approach has been demonstrated effective for many advanced CNN architectures. Notably, on ILSCRC-2012, SFP reduces more than 42% FLOPs on ResNet-101 with even 0.2% top-5 accuracy improvement, which has advanced the state-of-the-art. Code is publicly available on GitHub: https://github.com/he-y/softfilter-pruning
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
(2017) · Cited by 11,625
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665 · cited 4×
“In the CIFAR-10 experiments, we use the default parameter setting as [He et al., 2016b] and follow the training schedule in [Zagoruyko and Komodakis, 2016].”
MethodInfluentialZagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Research works printed but not linked: 1
- Pavlo Molchanov, Stephen Tyree, Tero Karras, Timo Aila, and Jan Kautz. Pruning convolu- tional neural networks for resource efficient transfer learn- ing. In ICLR, 2017.
Cited by
Rethinking the Value of Network Pruning
Liu, Z., Sun, M., Zhou, T., Huang, G., & Darrell, T. (2018) · arXiv · doi:10.48550/arxiv.1810.05270 · Cited by 1,625
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration
He, Y., Liu, P., Wang, Z., Hu, Z., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00447 · Cited by 1,217
Self-citationModel Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
“Different from the hard pruning, the pruned filters can also be invoked during gradient descent, termed soft filter pruning [212].”
MethodPruning and quantization for deep neural network acceleration: A survey
Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 943
LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
Fan, Z., Wang, K., Wen, K., Zhu, Z., Xu, D., & Wang, Z. (2024) · neural information processing systems · doi:10.52202/079017-4447 · Cited by 769
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning
Liu, Z., Mu, H., Zhang, X., Guo, Z., Yang, X., Cheng, K.-T., & Sun, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00339 · Cited by 563
What is the State of Neural Network Pruning?
Blalock, D., Ortiz, J. J. G., Frankle, J., & Guttag, J. (2020) · arXiv · doi:10.48550/arxiv.2003.03033 · Cited by 560
“These values are sometimes wall time, sometimes original number of FLOPs divided by pruned number of FLOPs, sometimes a more complex formula relating these two quantities (Dong et al., 2017; He et al., 2018a), and some- times never made clear.”
BackgroundMethodDepGraph: Towards Any Structural Pruning
Fang, G., Ma, X., Song, M., Bi Mi, M., & Wang, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01544 · Cited by 501
A Survey on Deep Neural Network Pruning: Taxonomy, Comparison, Analysis, and Recommendations
Cheng, H., Zhang, M., & Shi, J. Q. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3447085 · Cited by 497
Structured Pruning for Deep Convolutional Neural Networks: A Survey
He, Y., & Xiao, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3334614 · Cited by 363
Self-citationCompact Language Models via Pruning and Knowledge Distillation
Muralidharan, S., Sreenivas, S. T., Joshi, R., Chochowski, M., Patwary, M. A., Shoeybi, M., Catanzaro, B., Kautz, J., & Molchanov, P. (2024) · neural information processing systems · doi:10.52202/079017-1299 · Cited by 333
Bai, X., Wang, X., Liu, X., Liu, Q., Song, J., Sebe, N., & Kim, B. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108102 · Cited by 313
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions
Wan, A., Dai, X., Zhang, P., He, Z., Tian, Y., Xie, S., Wu, B., Yu, M., Xu, T., Chen, K., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01298 · Cited by 305
Residual Local Feature Network for Efficient Super-Resolution
Kong, F., Li, M., Liu, S., Liu, D., He, J., Bai, Y., Chen, F., & Fu, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00092 · Cited by 285
Learning Filter Pruning Criteria for Deep Convolutional Neural Networks Acceleration
He, Y., Ding, Y., Liu, P., Zhu, L., Zhang, H., & Yang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00208 · Cited by 262
“, MIL [7], PFEC [27], CP [22], ThiNet [36], SFP [18], NISP [54], FPGM [20], LFC [44], ELR [49], GAL [30], IMP [38], DDS [24].”
BackgroundMethodResultInfluentialSelf-citationLightweight Deep Learning for Resource-Constrained Environments: A Survey
Liu, H.-I., Galindo, M., Xie, H., Wong, L.-K., Shuai, H.-H., Li, Y.-H., & Cheng, W.-H. (2024) · ACM Computing Surveys · doi:10.1145/3657282 · Cited by 259
Channel Pruning via Automatic Structure Search
Lin, M., Ji, R., Zhang, Y., Zhang, B., Wu, Y., & Tian, Y. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/94 · Cited by 256
Edge deep learning in computer vision and medical diagnostics: a comprehensive survey
Xu, Y., Khan, T. M., Song, Y., & Meijering, E. H. W. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11033-5 · Cited by 240
Zhang, M., Yang, H., Guo, J., Li, Y., Gao, X., & Zhang, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28551 · Cited by 236
Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners
Chen, Z., Shen, Y., Ding, M., Chen, Z., Zhao, H., Miller, E. G., & Gan, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01138 · Cited by 229
Methods for Pruning Deep Neural Networks
Vadera, S., & Ameen, S. (2022) · IEEE Access · doi:10.1109/access.2022.3182659 · Cited by 223
Liao, L., Li, H., Shang, W., & Ma, L. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3506695 · Cited by 222
Highly Efficient Salient Object Detection with 100K Parameters
Gao, S.-H., Tan, Y.-Q., Cheng, M.-M., Lu, C., Chen, Y., & Yan, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58539-6_42 · Cited by 220
Li, C., Wang, G., Wang, B., Liang, X., Li, Z., & Chang, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00850 · Cited by 215
Stable Low-Rank Tensor Decomposition for Compression of Convolutional Neural Network
Phan, A. H., Sobolev, K., Sozykin, K., Ermilov, D., Gusak, J., Tichavský, P., Glukhov, V., Oseledets, I. V., & Cichocki, A. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_31 · Cited by 212
Convolutional Neural Network Pruning with Structural Redundancy Reduction
Wang, Z., Li, C., & Wang, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01467 · Cited by 205
CHIP: CHannel Independence-based Pruning for Compact Neural NetworksPreprint
Sui, Y., Yin, M., Xie, Y., Phan, H., Zonouz, S., & Yuan, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.13981 · Cited by 199
A Survey on Efficient Convolutional Neural Networks and Hardware Acceleration
Ghimire, D., Kil, D., & Kim, S.-H. (2022) · Electronics · doi:10.3390/electronics11060945 · Cited by 198
Discrimination-aware Network Pruning for Deep Model Compression
Liu, J., Zhuang, B., Zhuang, Z., Guo, Y. F., Huang, J., Zhu, J., & Tan, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3066410 · Cited by 195
Q-ViT: Accurate and Fully Quantized Low-Bit Vision Transformer
Li, Y., Xu, S., Zhang, B., Cao, X., Gao, P., & Guo, G. (2022) · neural information processing systems · doi:10.52202/068431-2496 · Cited by 196
Dynamic Channel Pruning: Feature Boosting and Suppression
Gao, X., Zhao, Y., Dudziak, Ł., Mullins, R., & Xu, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05331 · Cited by 195
Centripetal SGD for Pruning Very Deep Convolutional Networks With Complicated Structure
Ding, X., Ding, G., Guo, Y., & Han, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00508 · Cited by 193
GhostNets on Heterogeneous Devices via Cheap Operations
Han, K., Wang, Y., Xu, C., Guo, J., Xu, C., Wu, E., & Tian, Q. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01575-y · Cited by 192
Asymptotic Soft Filter Pruning for Deep Convolutional Neural Networks
He, Y., Dong, X., Kang, G., Fu, Y., Yan, C., & Yang, Y. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2933477 · Cited by 191
Self-citationHetConv: Heterogeneous Kernel-Based Convolutions for Deep CNNs
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00497 · Cited by 185
Toward Compact ConvNets via Structure-Sparsity Regularized Filter Pruning
Lin, S., Ji, R., Li, Y., Deng, C., & Li, X. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2906563 · Cited by 180
ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting
Ding, X., Hao, T., Tan, J., Liu, J., Han, J., Guo, Y., & Ding, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00447 · Cited by 177
Neural Pruning via Growing RegularizationPreprint
Wang, H., Qin, C., Zhang, Y., & Fu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.09243 · Cited by 176
Self-citationBringing ai to edge: from deep learning’s perspective
Liu, D., Kong, H., Luo, X., Liu, W., & Subramaniam, R. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.04.141 · Cited by 171
“[93] Inference-based Layer Rule-based 2018 SFP [94] Training-based Layer Rule-based 2018 Huang et al.”
MethodInfluentialPruning filters with L1-norm and capped L1-norm for CNN compression
Kumar, A., Shaikh, A. M., Li, Y., Bilal, H., & Yin, B. (2021) · Applied Intelligence · doi:10.1007/s10489-020-01894-y · Cited by 170
Network Pruning via Performance Maximization
Gao, S., Huang, F., Cai, W., & Huang, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00915 · Cited by 169
de Venâncio, P. V. A. B., Lisboa, A. C., & Barbosa, A. V. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07467-z · Cited by 168
Revisiting Random Channel Pruning for Neural Network Compression
Li, Y., Adamczewski, K., Li, W., Gu, S., Timofte, R., & Gool, L. V. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00029 · Cited by 168
Towards Efficient Model Compression via Learned Global Ranking
Chin, T.-W., Ding, R., Zhang, C., & Marculescu, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00159 · Cited by 165
Operation-Aware Soft Channel Pruning using Differentiable MasksPreprint
Kang, M. S., & Han, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03938 · Cited by 167
Real-Time 3D Face Alignment Using an Encoder-Decoder Network With an Efficient Deconvolution Layer
Ning, X., Duan, P., Li, W., & Zhang, S. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3032277 · Cited by 164
EagleEye: Fast Sub-net Evaluation for Efficient Neural Network Pruning
Li, B., Wu, B., Su, J., & Wang, G. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_38 · Cited by 163
Deep Learning on Mobile and Embedded Devices: State-of-the-art, Challenges, and Future Directions
Chen, Y., Zheng, B., Zhang, Z., Wang, Q., Shen, C., & Zhang, Q. (2021) · ACM Computing Surveys · doi:10.1145/3398209 · Cited by 159
“Similar to dynamic network surgery [56], Soft Filter Pruning (SFP) [65] was proposed to solve the problem of model capacity reduction and irretrievable network damage.”
BackgroundProvable Filter Pruning for Efficient Neural NetworksPreprint
Liebenwein, L., Baykal, C., Lang, H., Feldman, D., & Rus, D. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07412 · Cited by 157
A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services
Katare, D., Perino, D., Nurmi, J., Warnier, M., Janssen, M., & Ding, A. Y. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3302474 · Cited by 158
Pruning Filter in FilterPreprint
Meng, F., Cheng, H., Li, K., Luo, H., Guo, X., Lu, G., & Sun, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.14410 · Cited by 155
Group Fisher Pruning for Practical Network CompressionPreprint
Liu, L., Zhang, S., Kuang, Z., Zhou, A., Xue, J., Wang, X., Chen, Y., Yang, W., Liao, Q., & Zhang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.00708 · Cited by 152
Only Train Once: A One-Shot Neural Network Training And Pruning FrameworkPreprint
Chen, T., Ji, B., Ding, T., Fang, B., Wang, G., Zhu, Z., Liang, L., Shi, Y., Yi, S., & Tu, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07467 · Cited by 143
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked LayersPreprint
Liu, J., Xu, Z., Shi, R., Cheung, R. C. C., & So, H. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.06870 · Cited by 140
DSA: More Efficient Budgeted Pruning via Differentiable Sparsity Allocation
Ning, X., Zhao, T., Li, W., Lei, P., Wang, Y., & Yang, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_35 · Cited by 133
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the EdgePreprint
Yuan, G., Ma, X., Niu, W., Li, Z., Kong, Z., Liu, N., Gong, Y., Zhan, Z., He, C., Jin, Q., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14032 · Cited by 132
Network Pruning via Transformable Architecture Search
Dong, X., & Yang, Y. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09717 · Cited by 132
Self-citationCHEX: CHannel EXploration for CNN Model Compression
Hou, Z., Qin, M., Sun, F., Ma, X., Yuan, K., Xu, Y. T., Chen, Y.-K., Jin, R., Xie, Y., & Kung, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01197 · Cited by 131
Compressing Convolutional Neural Networks via Factorized Convolutional Filters
Li, T., Wu, B., Yang, Y., Fan, Y., Zhang, Y., & Liu, W. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00410 · Cited by 130
Self-citationNTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results
Li, Y., Zhang, K., Timofte, R., Gool, L. V., Kong, F., Li, M., Liu, S., Du, Z., Liu, D., Zhou, C., et al. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00118 · Cited by 142
Drawing Early-Bird Tickets: Towards More Efficient Training of Deep NetworksPreprint
You, H., Li, C., Xu, P., Fu, Y., Wang, Y., Chen, X., Baraniuk, R. G., Wang, Z., & Lin, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11957 · Cited by 208
Self-citationDynamic Model Pruning with Feedback
Lin, T., Stich, S. U., Barba, L., Dmitriev, D., & Jaggi, M. (2020) · arXiv · doi:10.48550/arxiv.2006.07253 · Cited by 126
“Baselines Model Dense SFP (He et al., 2018) DPF Pruning ratio ResNet-20 92.”
BackgroundMethodInfluentialTowards Efficient Tensor Decomposition-Based DNN Model Compression with Optimization Framework
Yin, M., Sui, Y., Liao, S., & Yuan, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01053 · Cited by 127
Channel Gating Neural Networks
Hua, W., Zhou, Y. J., De, C., Zhang, Z., & Suh, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12549 · Cited by 124
Spatially Adaptive Inference with Stochastic Feature Sampling and Interpolation
Xie, Z., Zhang, Z., Zhu, X., Huang, G. M., & Lin, S. C.-F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58452-8_31 · Cited by 123
A Highly Efficient Model to Study the Semantics of Salient Object Detection
Cheng, M., Gao, S., Borji, A., Tan, Y., Zheng, L. L., & Wang, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3107956 · Cited by 122
Pay Attention to Features, Transfer Learn faster CNNs
Wang, K., Gao, X., Zhao, Y., Li, X., Dou, D., & Xu, C. (2020) · International Conference on Learning Representations · Cited by 118
Differentiable Joint Pruning and Quantization for Hardware Efficiency
Wang, Y., Lu, Y., & Blankevoort, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_16 · Cited by 115
Discrete Model Compression With Resource Constraint for Deep Neural Networks
Gao, S., Huang, F., Pei, J., & Huang, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00197 · Cited by 115
PAMS: Quantized Super-Resolution via Parameterized Max Scale
Li, H., Yan, C., Lin, S., Zheng, X., Zhang, B., Yang, F., & Ji, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58595-2_34 · Cited by 113
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test AccuracyPreprint
Liebenwein, L., Baykal, C., Carter, B., Gifford, D. K., & Rus, D. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03014 · Cited by 115
Carrying Out CNN Channel Pruning in a White Box
Zhang, Y., Lin, M., Lin, C., Chen, J., Wu, Y., Tian, Y., & Ji, R. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3147269 · Cited by 111
Transform Quantization for CNN Compression
Young, S. I., Wang, Z., Taubman, D., & Girod, B. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3084839 · Cited by 109
SparCL: Sparse Continual Learning on the Edge
Wang, Z., Zhan, Z., Gong, Y., Yuan, G., Niu, W., Jian, T., Ren, B., Ioannidis, S., Wang, Y., & Dy, J. (2022) · neural information processing systems · doi:10.52202/068431-1481 · Cited by 108
Manifold Regularized Dynamic Network Pruning
Tang, Y., Wang, Y., Xu, Y., Deng, Y., Xu, C., Tao, D., & Xu, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00498 · Cited by 104
Yang, H., Tang, M., Wen, W., Yan, F., Hu, D., Li, A., Li, H., & Chen, Y. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00347 · Cited by 105
Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks
You, Z., Yan, K., Ye, J., Ma, M., & Wang, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.08174 · Cited by 100
Leveraging Filter Correlations for Deep Model Compression
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093331 · Cited by 94
Drawing Early-Bird Tickets: Toward More Efficient Training of Deep NetworksPreprint
You, H., Li, C., Xu, P., Fu, Y., Wang, Y., Chen, X., Lin, Y., Wang, Z., & Baraniuk, R. G. (2020) · arXiv (Cornell University) · Cited by 94
Self-citationSCOP: Scientific Control for Reliable Neural Network Pruning
Tang, Y., Wang, Y., Xu, Y., Tao, D., Xu, C., Xu, C., & Xu, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10732 · Cited by 93
COP: Customized Deep Model Compression via Regularized Correlation-Based Filter-Level Pruning
Wang, W., Fu, C., Guo, J., Cai, D., & He, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/525 · Cited by 93
DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity MeasuresPreprint
Yang, H., Wen, W., & Li, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.09979 · Cited by 92
Automatic Sparse Connectivity Learning for Neural Networks
Tang, Z., Luo, L., Xie, B., Zhu, Y., Zhao, R., Bi, L., & Lü, C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3141665 · Cited by 87
Progressive Local Filter Pruning for Image Retrieval Acceleration
Wang, X., Zheng, Z., He, Y., Yan, F., Zeng, Z., & Yang, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3256092 · Cited by 87
Self-citationNetwork pruning using sparse learning and genetic algorithm
Wang, Z., Li, F., Shi, G., Xie, X., & Wang, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.082 · Cited by 85
Learning Best Combination for Efficient N:M Sparsity
Zhang, Y., Lin, M., Li, K., Luo, Y., Li, K., Chao, F., Wu, Y., & Ji, R. (2022) · neural information processing systems · doi:10.52202/068431-0069 · Cited by 85
Filter Pruning by Switching to Neighboring CNNs With Good Attributes
He, Y., Liu, P., Zhu, L., & Yang, Y. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3149332 · Cited by 90
Self-citationStructured Knowledge Distillation for Accurate and Efficient Object Detection
Zhang, L., & Ma, K. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3300470 · Cited by 82
TransTailor: Pruning the Pre-trained Model for Improved Transfer Learning
Liu, B., Cai, Y., Guo, Y., & Chen, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17046 · Cited by 82
DS-Net++: Dynamic Weight Slicing for Efficient Inference in CNNs and Vision Transformers
Li, C., Wang, G., Wang, B., Liang, X., Li, Z., & Chang, X. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3194044 · Cited by 81
1xN Pattern for Pruning Convolutional Neural Networks
Lin, M., Zhang, Y., Li, Y., Chen, B., Chao, F., Wang, M., Li, S., Tian, Y., & Ji, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195774 · Cited by 81
Model Compression Based on Differentiable Network Channel Pruning
Zheng, Y.-J., Chen, S.-B., Ding, C. H. Q., & Luo, B. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3165123 · Cited by 80
An improved lightweight small object detection framework applied to real-time autonomous driving
Mahaur, B., Mishra, K. K., & Kumar, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121036 · Cited by 80
Automated Multi-Stage Compression of Neural Networks
Gusak, J., Kholiavchenko, M., Ponomarev, E., Markeeva, L., Blagoveschensky, P., Cichocki, A. S., & Oseledets, I. V. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00306 · Cited by 80
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A SurveyPreprint
Liu, J., Tripathi, S., Kurup, U., & Shah, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.04275 · Cited by 80
OICSR: Out-In-Channel Sparsity Regularization for Compact Deep Neural Networks
Li, J., Qi, Q., Wang, J., Ge, C., Li, Y., Yue, Z., & Sun, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00721 · Cited by 76
Dynamic Group Convolution for Accelerating Convolutional Neural Networks
Su, Z., Fang, L., Kang, W., Hu, D., Pietikäinen, M., & Liu, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_9 · Cited by 75
Learnable Lookup Table for Neural Network Quantization
Wang, L., Dong, X., Wang, Y., Liu, L., An, W., & Guo, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01210 · Cited by 76
Self-citationConvolutional Neural Network Pruning: A Survey
Xu, S. H., Huang, A., Chen, L., & Zhang, B. (2020) · Chinese Control Conference (CCC) · doi:10.23919/ccc50068.2020.9189610 · Cited by 74
Pruning Deep Neural Networks for Green Energy-Efficient Models: A Survey
Tmamna, J., Ayed, E. B., Fourati, R., Gogate, M., Arslan, T., Hussain, A., & Ayed, M. B. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10313-0 · Cited by 75
Metadata
- Authors
- He, Y., Kang, G., Dong, X., Fu, Y., & Yang, Y.
- Venue
- Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
- Published
- 2018-07
- Pages
- 2234-2240
- OpenAlex
- W2808168148
- Cited by
- 1,020
- References
- 33
- FWCI
- 29.46
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.