The DOI matches its Crossref record; 57 of the 59 references it cites were found in a registry or an index.
Channel Pruning for Accelerating Very Deep Neural Networks
Open accessAbstract
In this paper, we introduce a new channel pruning method to accelerate very deep convolutional neural networks. Given a trained CNN model, we propose an iterative two-step algorithm to effectively prune each layer, by a LASSO regression based channel selection and least square reconstruction. We further generalize this algorithm to multi-layer and multi-branch cases. Our method reduces the accumulated error and enhance the compatibility with various architectures. Our pruned VGG-16 achieves the state-of-the-art results by 5× speed-up along with only 0.3% increase of error. More importantly, our method is able to accelerate modern networks like ResNet, Xception and suffers only 1.4%, 1.0% accuracy loss under 2× speedup respectively, which is significant.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Self-citationScikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Self-citationImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Flagged first, then by citations
2 of the 59 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- everingham, 0, The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results
- han, 2015, Deep compression Compressing deep neural network with pruning trained quantization and huffman coding, abs 1510 149
- han, 2015, Learning both weights and connections for efficient neural network, Advances in neural information processing systems, 1135
Cited by
Sorted by citations
Items 201–300 of 1,002
PPCL: Privacy-preserving collaborative learning for mitigating indirect information leakage
Yan, H., Hu, L. F., Xiang, X., Liu, Z., & Yuan, X. (2020) · Information Sciences · doi:10.1016/j.ins.2020.09.064 · Cited by 84
Towards Model Compression for Deep Learning Based Speech Enhancement
Tan, K., & Wang, D. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3082282 · Cited by 84
Rymarczyk, D., Struski, Ł., Tabor, J., & Zieliński, B. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467245 · Cited by 83
Towards Efficient Tensor Decomposition-Based DNN Model Compression with Optimization Framework
Yin, M., Sui, Y., Liao, S., & Yuan, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01053 · Cited by 87
Wang, B., Ma, F., Ge, L., Ma, H., Wang, H., & Mohamed, M. A. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3018831 · Cited by 83
Instance-Aware Distillation for Efficient Object Detection in Remote Sensing Images
Li, C., Cheng, G., Wang, G., Zhou, P., & Han, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3238801 · Cited by 80
Training Small Networks for Scene Classification of Remote Sensing Images via Knowledge Distillation
Chen, G., Zhang, X., Tan, X., Cheng, Y., Dai, F., Zhu, K., Gong, Y., & Wang, Q. (2018) · Remote Sensing · doi:10.3390/rs10050719 · Cited by 82
Self-citationA Two-Stage Operand Trimming Approximate Logarithmic Multiplier
Pilipović, R., Bulić, P., & Lotrič, U. (2021) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2021.3069168 · Cited by 79
Automatic Sparse Connectivity Learning for Neural Networks
Tang, Z., Luo, L., Xie, B., Zhu, Y., Zhao, R., Bi, L., & Lü, C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3141665 · Cited by 80
Transform Quantization for CNN Compression
Young, S. I., Wang, Z., Taubman, D., & Girod, B. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3084839 · Cited by 86
COP: Customized Deep Model Compression via Regularized Correlation-Based Filter-Level Pruning
Wang, W., Fu, C., Guo, J., Cai, D., & He, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/525 · Cited by 77
MoBiNet: A Mobile Binary Network for Image Classification
Phan, H., Huynh, D. N., He, Y., Savvides, M., & Shen, Z. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093444 · Cited by 79
Self-citationEfficient Crowd Counting via Structured Knowledge Transfer
Liu, L., Chen, J., Wu, H., Chen, T., Li, G., & Lin, L. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413938 · Cited by 81
Applications and Techniques for Fast Machine Learning in Science
Deiana, A. M., Tran, N. V., Agar, J., Blott, M., Guglielmo, G. D., Duarte, J. M., Harris, P. C., Hauck, S., Liu, M., Neubauer, M. S., et al. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.787421 · Cited by 104
Liu, S., Fan, H., Niu, X., Ng, H.-C., Chu, Y., & Luk, W. W. (2018) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3242900 · Cited by 76
FracBits: Mixed Precision Quantization via Fractional Bit-Widths
Yang, L., & Jin, Q. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17269 · Cited by 76
Xue, Y., Jia, F., Cai, X., Shadabfar, M., & Huang, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12731 · Cited by 76
Network Decoupling: From Regular to Depthwise Separable ConvolutionsPreprint
Guo, J., Li, Y., Lin, W., Chen, Y., & Li, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.05517 · Cited by 85
Bayesian Bits: Unifying Quantization and PruningPreprint
van Baalen, M., Louizos, C., Nagel, M., Amjad, R. A., Wang, Y., Blankevoort, T., & Welling, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07093 · Cited by 95
Lym, S., Choukse, E., Zangeneh, S., Wen, W., Sanghavi, S., & Erez, M. (2019) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3295500.3356156 · Cited by 86
SAR ATR of Ground Vehicles Based on ESENet
Wang, L., Bai, X., & Zhou, F. (2019) · Remote Sensing · doi:10.3390/rs11111316 · Cited by 76
Progressive Local Filter Pruning for Image Retrieval Acceleration
Wang, X., Zheng, Z., He, Y., Yan, F., Zeng, Z., & Yang, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3256092 · Cited by 81
Self-citationModel Compression Using Progressive Channel Pruning
Guo, J.-Y., Zhang, W.-C., Ouyang, W., & Xu, D. (2021) · IEEE transactions on circuits and systems for video technology (Print) · doi:10.1109/tcsvt.2020.2996231 · Cited by 79
BiDet: An Efficient Binarized Object Detector
Wang, Z., Wu, Z., Lu, J., & Zhou, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00212 · Cited by 77
FusionPlanner: A multi-task motion planner for mining trucks via multi-sensor fusion
Teng, S., Li, L., Li, Y., Hu, X., Li, L., Ai, Y., & Chen, L. F. (2024) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.111051 · Cited by 84
Network pruning using sparse learning and genetic algorithm
Wang, Z., Li, F., Shi, G., Xie, X., & Wang, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.082 · Cited by 74
Differentiable Joint Pruning and Quantization for Hardware Efficiency
Wang, Y., Lu, Y., & Blankevoort, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_16 · Cited by 76
Distilling a Powerful Student Model via Online Knowledge Distillation
Li, S., Lin, M., Wang, Y., Wu, Y., Tian, Y., Shao, L., & Ji, R. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3152732 · Cited by 76
Network Pruning Using Adaptive Exemplar Filters
Lin, M., Ji, R., Li, S., Wang, Y., Wu, Y., Huang, F., & Ye, Q. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084856 · Cited by 75
Comprehensive review of recent developments in visual object detection based on deep learning
Edozie, E., Shuaibu, A. N., John, U. K., & Sadiq, B. O. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11284-w · Cited by 100
Yang, H., Gui, S., Zhu, Y., & Liu, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00225 · Cited by 82
Provable Filter Pruning for Efficient Neural NetworksPreprint
Liebenwein, L., Baykal, C., Lang, H., Feldman, D., & Rus, D. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07412 · Cited by 99
Extreme Network Compression via Filter Group Approximation
Peng, B., Tan, W., Li, Z., Zhang, S., Xie, D., & Pu, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_19 · Cited by 68
GAN Slimming: All-in-One GAN Compression by a Unified Optimization Framework
Wang, H., Gui, S., Yang, H., Liu, J., & Wang, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_4 · Cited by 73
A Real-Time Object Detection Accelerator with Compressed SSDLite on FPGA
Fan, H., Liu, S., Ferianc, M., Ng, H.-C., Que, Z., Liu, С., Niu, X., & Luk, W. W. (2018) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/fpt.2018.00014 · Cited by 73
Coreset-Based Neural Network Compression
Dubey, A., Chatterjee, M., & Ahuja, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01234-2_28 · Cited by 72
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space
Chavan, A., Shen, Z., Liu, Z., Liu, Z., Cheng, K.-T., & Xing, E. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00488 · Cited by 72
A review of AI edge devices and lightweight CNN and LLM deployment
Sun, K., Wang, X., Miao, X., & Zhao, Q. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128791 · Cited by 87
A Survey on Deep Neural Network Compression: Challenges, Overview, and SolutionsPreprint
Mishra, R., Gupta, H. P., & Dutta, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03954 · Cited by 114
Kim, S., & Kim, H. (2021) · IEEE Access · doi:10.1109/access.2021.3054879 · Cited by 71
The Lottery Ticket Hypothesis at Scale
Frankle, J., Dziugaite, G. K., Roy, D. M., & Carbin, M. (2019) · Cited by 71
Real-Time Semantic Image Segmentation with Deep Learning for Autonomous Driving: A Survey
Papadeas, I., Tsochatzidis, L., Amanatiadis, A. A., & Pratikakis, I. (2021) · Applied Sciences · doi:10.3390/app11198802 · Cited by 81
TRP: Trained Rank Pruning for Efficient Deep Neural Networks
Xu, Y., Li, Y., Zhang, S., Wen, W., Wang, B., Qi, Y., Chen, Y., Lin, W., & Xiong, H. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/136 · Cited by 82
CondenseNet V2: Sparse Feature Reactivation for Deep Networks
Yang, L., Jiang, H., Cai, R., Wang, Y., Song, S., Huang, G., & Tian, Q. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00357 · Cited by 71
Recovering from Random Pruning: On the Plasticity of Deep Convolutional Neural Networks
Mittal, D., Bhardwaj, S., Khapra, M. M., & Ravindran, B. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00098 · Cited by 70
Pay Attention to Features, Transfer Learn faster CNNs
Wang, K., Gao, X., Zhao, Y., Li, X., Dou, D., & Xu, C. (2020) · International Conference on Learning Representations · Cited by 70
A novel channel pruning method for deep neural network compressionPreprint
Hu, Y., Sun, S., Li, J., Wang, X., & Gu, Q. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11394 · Cited by 70
SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Features Recombining
Qiu, J., Chen, C., Liu, S., Zhang, H.-Y., & Zeng, B. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3093795 · Cited by 68
Machine Learning for Cataract Classification/Grading on Ophthalmic Imaging Modalities: A Survey
Zhang, X.-Q., Hu, Y., Xiao, Z., Fang, J., Higashita, R., & Liu, J. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1329-0 · Cited by 89
Self-citationDS-Net++: Dynamic Weight Slicing for Efficient Inference in CNNs and Vision Transformers
Li, C., Wang, G., Wang, B., Liang, X., Li, Z., & Chang, X. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3194044 · Cited by 74
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer
Chen, X., Liu, Z., Tang, H., Yi, L., Zhao, H., & Han, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00205 · Cited by 86
Enabling Resource-Efficient AIoT System With Cross-Level Optimization: A Survey
Liu, S., Guo, B., Fang, C., Wang, Z., Luo, S., Zhou, Z., & Yu, Z. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3319952 · Cited by 74
Channel Selection Using Gumbel Softmax
Herrmann, C., Bowen, R. S., & Zabih, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_15 · Cited by 69
He, Z., & Fan, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01170 · Cited by 70
ECG signal classification with binarized convolutional neural network
Wu, Q., Sun, Y., Yan, H. M., & Wu, X. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103800 · Cited by 67
Lightspeech: Lightweight and Fast Text to Speech with Neural Architecture Search
Luo, R., Tan, X., Wang, R., Qin, T., Li, J., Zhao, S., Chen, E., & Liu, T.-Y. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414403 · Cited by 67
A Survey on the Optimization of Neural Network Accelerators for Micro-AI On-Device Inference
Mazumder, A. N., Meng, J., Rashid, H.-A., Kallakuri, U., Zhang, X., Seo, J.-S., & Mohsenin, T. (2021) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2021.3129415 · Cited by 70
Self-citationSofter-NMS: Rethinking Bounding Box Regression for Accurate Object Detection.Preprint
He, Y., Zhang, X., Savvides, M., & Kitani, K. (2018) · arXiv (Cornell University) · Cited by 67
Self-citationT-Net: Parametrizing Fully Convolutional Nets With a Single High-Order Tensor
Kossaifi, J., Bulat, A., Tzimiropoulos, G., & Pantić, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00801 · Cited by 64
Distributed Deep Convolutional Neural Networks for the Internet-of-Things
Disabato, S., Roveri, M., & Alippi, C. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3062227 · Cited by 67
Filter Pruning by Switching to Neighboring CNNs With Good Attributes
He, Y., Liu, P., Zhu, L., & Yang, Y. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3149332 · Cited by 74
Self-citationAccelerate CNN via Recursive Bayesian Pruning
Zhou, Y., Zhang, Y., Wang, Y., & Tian, Q. C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00340 · Cited by 63
Dynamic Spatial Sparsification for Efficient Vision Transformers and Convolutional Neural Networks
Rao, Y., Liu, Z., Zhao, W., Zhou, J., & Lu, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263826 · Cited by 75
A survey of model compression strategies for object detection
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17192-x · Cited by 65
OICSR: Out-In-Channel Sparsity Regularization for Compact Deep Neural Networks
Li, J., Qi, Q., Wang, J., Ge, C., Li, Y., Yue, Z., & Sun, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00721 · Cited by 66
RePr: Improved Training of Convolutional Filters
Prakash, A., Storer, J. A., Florencio, D. A. F., & Zhang, C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01092 · Cited by 64
Yue, K., Deng, J., & Zhou, F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_19 · Cited by 65
Model Compression Based on Differentiable Network Channel Pruning
Zheng, Y.-J., Chen, S.-B., Ding, C. H. Q., & Luo, B. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3165123 · Cited by 64
CNNPC: End-Edge-Cloud Collaborative CNN Inference With Joint Model Partition and Compression
Yang, S., Zhang, Z., Zhao, C., Song, X., Guo, S., & Li, H. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3177782 · Cited by 67
Where to Prune: Using LSTM to Guide Data-Dependent Soft Pruning
Ding, G., Zhang, S., Jia, Z., Zhong, J., & Han, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3035028 · Cited by 63
Accelerating large scale real-time GNN inference using channel pruning
Zhou, H., Srivastava, A., Zeng, H., Kannan, R., & Prasanna, V. K. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3461535.3461547 · Cited by 84
Good Subnetworks Provably Exist: Pruning via Greedy Forward SelectionPreprint
Ye, M., Gong, C., Nie, L., Zhou, D., Klivans, A. R., & Liu, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01794 · Cited by 67
Yang, Y., Guo, C., Liu, F., Sun, L., Liu, C., & Sun, Q. (2022) · IEEE Industrial Electronics Magazine · doi:10.1109/mie.2022.3174331 · Cited by 101
Big data and deep learning for RNA biology
Hwang, H., Jeon, H., Yeo, N., & Baek, D. (2024) · Experimental & Molecular Medicine · doi:10.1038/s12276-024-01243-w · Cited by 64
Building efficient CNN architecture for offline handwritten Chinese character recognition
Li, Z., Teng, N., Jin, M., & Lu, H. (2018) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-018-0311-4 · Cited by 62
Optical Flow Distillation: Towards Efficient and Stable Video Style Transfer
Chen, X., Zhang, Y., Wang, Y., Shu, H., Xu, C., & Xu, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_37 · Cited by 61
EDP: An Efficient Decomposition and Pruning Scheme for Convolutional Neural Network Compression
Ruan, X., Liu, Y., Yuan, C., Li, B., Hu, W., Li, Y., & Maybank, S. J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3018177 · Cited by 63
EACP: An effective automatic channel pruning for neural networks
Liu, Y., Wu, D., Zhou, W., Fan, K., & Zhou, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.014 · Cited by 61
SparseRT: Accelerating Unstructured Sparsity on GPUs for Deep Learning InferencePreprint
Wang, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.11849 · Cited by 61
Situ, Z., Teng, S., Liao, X., Chen, G., & Zhou, Q. (2023) · Journal of Civil Structural Health Monitoring · doi:10.1007/s13349-023-00681-w · Cited by 62
Structured Knowledge Distillation for Accurate and Efficient Object Detection
Zhang, L., & Ma, K. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3300470 · Cited by 66
Feature fusion strategy and improved GhostNet for accurate recognition of fish feeding behavior
Du, Z., Xu, X., Bai, Z., Liu, X., Hu, Y., Li, W., Wang, C., & Li, D. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108310 · Cited by 62
Improving Deep Neural Network Sparsity through Decorrelation Regularization
Zhu, X., Zhou, W., & Li, H. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/453 · Cited by 59
A Survey of Hierarchical Energy Optimization for Mobile Edge Computing
Cong, P., Zhou, J., Li, L., Cao, K., Wei, T., & Li, K. (2020) · ACM Computing Surveys · doi:10.1145/3378935 · Cited by 59
Pavlović, D., Davison, C., Hamilton, A. W., Marko, O., Atkinson, R. C., Michie, C., Crnojevic, V. S., Andonović, I., Bellekens, X., & Tachtatzis, C. (2021) · Sensors · doi:10.3390/s21124050 · Cited by 68
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search
Zhan, Z., Gong, Y., Zhao, P., Yuan, G., Niu, W., Wu, Y., Zhang, T., Jayaweera, M., Kaeli, D. R., Ren, B., et al. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00478 · Cited by 61
Nillmani, Jain, P. K., Sharma, N., Kalra, M. M., Višković, K., Saba, L., & Suri, J. S. (2022) · Diagnostics · doi:10.3390/diagnostics12030652 · Cited by 65
Lightweight Pixel Difference Networks for Efficient Visual Representation Learning
Su, Z., Zhang, J., Wang, L., Zhang, H., Liu, Z., Pietikäinen, M., & Liu, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3300513 · Cited by 69
Frequency Attention for Knowledge Distillation
Pham, C., Nguyen, V.-A., Le, T., Phung, D., Carneiro, G., & Do, T.-T. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00227 · Cited by 59
DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity MeasuresPreprint
Yang, H., Wen, W., & Li, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.09979 · Cited by 83
EasiEdge: A Novel Global Deep Neural Networks Pruning Method for Efficient Edge Computing
Yu, F., Cui, L., Wang, P., Han, C., Huang, R., & Huang, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3034925 · Cited by 58
Cluster Pruning: An Efficient Filter Pruning Method for Edge AI Vision Applications
Gamanayake, C., Jayasinghe, L., Ng, B. K. K., & Yuen, C. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2971418 · Cited by 62
Batch-Shaping for Learning Conditional Channel Gated NetworksPreprint
Bejnordi, B. E., Blankevoort, T., & Welling, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06627 · Cited by 58
Only Train Once: A One-Shot Neural Network Training And Pruning FrameworkPreprint
Chen, T., Ji, B., Ding, T., Fang, B., Wang, G., Zhu, Z., Liang, L., Shi, Y., Yi, S., & Tu, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07467 · Cited by 63
Knowledge Distillation for Fast and Accurate Monocular Depth Estimation on Mobile Devices
Wang, Y., Li, X., Shi, M., Xian, K., & Cao, Z. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00278 · Cited by 61
Atitallah, A. B., Said, Y., Atitallah, M. A. B., Albekairi, M., Kaâniche, K., & Boubaker, S. (2023) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2023.102387 · Cited by 69
A Survey on Green Deep LearningPreprint
Xu, J., Zhou, W., Fu, Z., Zhou, H., & Li, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05193 · Cited by 118
Resource-Constrained Neural Architecture Search on Edge Devices
Lyu, B., Yuan, H., Lu, L., & Zhang, Y. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3054583 · Cited by 55
Dynamic Dual Gating Neural Networks
Li, F., Li, G., He, X., & Cheng, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00528 · Cited by 57
A Profit-Maximizing Model Marketplace with Differentially Private Federated Learning
Sun, P., Chen, X., Liao, G., & Huang, J. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796833 · Cited by 59
Metadata
- Authors
- He, Y., Zhang, X., & Sun, J.
- Affiliations
- Xi'an Jiaotong University (CN)
- Megvii (China) (CN)
- Venue
- 2017 IEEE International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 1398-1406
- OpenAlex
- W2963363373
- Cited by
- 2,647
- References
- 59
- Citations by year
- 2026: 119 · 2025: 182 · 2024: 287 · 2023: 357 · 2022: 402 · 2021: 474 · 2020: 423 · 2019: 279 · 2018: 116 · 2017: 6
- FWCI
- 65.90
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- channel pruning, convolutional neural networks, model compression, LASSO, least-squares reconstruction, multi-branch network, VGG16, ResNet, Xception, inference acceleration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
