The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration
Open accessAbstract
Previous works utilized “smaller-norm-less-important” criterion to prune filters with smaller norm values in a convolutional neural network. In this paper, we analyze this norm-based criterion and point out that its effectiveness depends on two requirements that are not always met: (1) the norm deviation of the filters should be large; (2) the minimum norm of the filters should be small. To solve this problem, we propose a novel filter pruning method, namely Filter Pruning via Geometric Median (FPGM), to compress the model regardless of those two requirements. Unlike previous methods, FPGM compresses CNN models by pruning filters with redundancy, rather than those with“relatively less” importance. When applied to two image classification benchmarks, our method validates its usefulness and strengths. Notably, on CIFAR-10, FPGM reduces more than 52% FLOPs on ResNet-110 with even 2.69% relative accuracy improvement. Moreover, on ILSVRC-2012, FPGM reduces more than 42% FLOPs on ResNet-101 without top-5 accuracy drop, which has advanced the state-of-the-art. Code is publicly available on GitHub: https://github.com/he-y/filter-pruning-geometric-median
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2017) · Cited by 11,625
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
Learning Efficient Convolutional Networks through Network Slimming
Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., & Zhang, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.298 · Cited by 2,761
Channel Pruning for Accelerating Very Deep Neural Networks
He, Y., Zhang, X., & Sun, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.155 · Cited by 2,647 · cited 3×
“, MIL [5], PFEC [21], CP [16], ThiNet [25], SFP [15], NISP [39], Rethinking [38].”
BackgroundMethodSelf-citationThiNet: A Filter Level Pruning Method for Deep Neural Network Compression
Luo, J.-H., Wu, J., & Lin, W. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.541 · Cited by 1,832
Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks
He, Y., Kang, G., Dong, X., Fu, Y., & Yang, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/309 · Cited by 1,020
Self-citationZhu, C., Han, S., Mao, H., & Dally, W. J. (2016) · arXiv · doi:10.48550/arxiv.1612.01064 · Cited by 865
Accelerating Very Deep Convolutional Networks for Classification and Detection
Zhang, X., Zou, J., He, K., & Sun, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2502579 · Cited by 832
Luo, Y., Zheng, L., Guan, T., Yu, J., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00261 · Cited by 798
Self-citationNISP: Pruning Networks Using Neuron Importance Score Propagation
Yu, R., Li, A., Chen, C.-F., Lai, J.-H., Morariu, V. I., Han, X., Gao, M., Lin, C.-Y., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00958 · Cited by 794
Searching for a Robust Neural Architecture in Four GPU Hours
Dong, X., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00186 · Cited by 640
Self-citationTowards Optimal Structured CNN Pruning via Generative Adversarial Learning
Lin, S., Ji, R., Yan, C., Zhang, B., Cao, L., Ye, Q., Huang, F., & Doermann, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00290 · Cited by 555
Discrimination-aware Channel Pruning for Deep Neural NetworksPreprint
Zhuang, Z., Tan, M., Zhuang, B., Liu, J., Guo, Y. F., Wu, Q., Huang, J., & Zhu, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11809 · Cited by 543
A Systematic DNN Weight Pruning Framework Using Alternating Direction Method of Multipliers
Zhang, T., Ye, S., Zhang, K., Tang, J., Wen, W., Fardad, M., & Wang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_12 · Cited by 473
Convolutional neural networks with low-rank regularization
Tai, C., Xiao, T., Zhang, Y., Wang, X., & Weinan, E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06067 · Cited by 341
Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning.Preprint
Molchanov, P. A., Tyree, S., Karras, T., Aila, T., & Kautz, J. (2016) · arXiv (Cornell University) · Cited by 303
More is Less: A More Complicated Network with Less Inference Complexity
Dong, X., Huang, J., Yang, Y., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.205 · Cited by 291
Self-citationCLIP-Q: Deep Network Compression Learning by In-parallel Pruning-Quantization
Tung, F., & Mori, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00821 · Cited by 220
"Learning-Compression" Algorithms for Neural Net Pruning
Carreira-Perpinan, M. A., & Idelbayev, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00890 · Cited by 195
Learning to Prune Filters in Convolutional Neural Networks
Huang, Q., Zhou, K., You, S., & Neumann, U. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00083 · Cited by 170
Geometric median in nearly linear time
Cohen, M. B., Lee, Y. T., Miller, G. L., Pachocki, J., & Sidford, A. (2016) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/2897518.2897647 · Cited by 132
Frequency-Domain Dynamic Pruning for Convolutional Neural Networks
Liu, Z., Xu, J., Peng, X., & Xiong, R. (2018) · neural information processing systems · Cited by 118
Robust statistics on Riemannian manifolds via the geometric median
Fletcher, P. T., Venkatasubramanian, S., & Joshi, S. C. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587747 · Cited by 114
Clustering Convolutional Kernels to Compress Deep Neural Networks
Son, S., Nah, S., & Lee, K. M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_14 · Cited by 85
Coreset-Based Neural Network Compression
Dubey, A., Chatterjee, M., & Ahuja, N. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01234-2_28 · Cited by 72
ADC: Automated Deep Compression and Acceleration with Reinforcement Learning.Preprint
He, Y., & Han, S. (2018) · arXiv (Cornell University) · Cited by 50
Self-citationSCSP: Spectral Clustering Filter Pruning with Soft Self-adaption MannersPreprint
Zhuo, H., Qian, X., Fu, Y., Yang, H., & Xue, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05320 · Cited by 45
Runtime guarantees for regression problems
Chin, H. H., Mądry, A., Miller, G. L., & Peng, R. (2013) · Conference on Innovations in Theoretical Computer Science · doi:10.1145/2422436.2422469 · Cited by 42
Exploring Linear Relationship in Feature Map Subspace for ConvNets Compression
Wang, D., Zhou, L., Zhang, X., Bai, X., & Zhou, J. (2018) · arXiv · doi:10.48550/arxiv.1803.05729 · Cited by 42
Sim-Real Joint Reinforcement Transfer for 3D Indoor Navigation
Zhu, F., Zhu, L., & Yang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01165 · Cited by 28
Self-citationPrincipal Filter Analysis for Guided Network Compression.Preprint
Suau, X., Zappella, L., Palakkode, V., & Apostoloff, N. (2018) · arXiv (Cornell University) · Cited by 23
Research works printed but not linked: 7
- ye, 2018, Rethinking the smaller-norm-less-informative assumption in channel pruning of convolution layers, ICLRE
- han, 2015, Learning both weights and connections for efficient neural network, NIPS
- kim, 2018, Paraphrasing complex network: Network compression via factor transfer, NIPS
- dong, 2017, Learning to prune deep neural networks via layer-wise optimal brain surgeon, Advances in neural information processing systems, 4857
- guo, 2016, Dynamic network surgery for efficient DNNs, NIPS
- li, 2017, Pruning filters for efficient ConvNets, ICLRE
- zhou, 2017, Incremental network quantization: Towards lossless cnns with low- precision weights, ICLRE
Cited by
Pruning and quantization for deep neural network acceleration: A survey
Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 943
Data augmentation: A comprehensive survey of modern approaches
Mumuni, A., & Mumuni, F. (2022) · Array · doi:10.1016/j.array.2022.100258 · Cited by 891
HRank: Filter Pruning Using High-Rank Feature Map
Lin, M., Ji, R., Wang, Y., Zhang, Y., Zhang, B., Tian, Y., & Shao, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00160 · Cited by 866
Luo, Y., Zheng, L., Guan, T., Yu, J., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00261 · Cited by 798
Self-citationTowards Optimal Structured CNN Pruning via Generative Adversarial Learning
Lin, S., Ji, R., Yan, C., Zhang, B., Cao, L., Ye, Q., Huang, F., & Doermann, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00290 · Cited by 555
Metadata
- Authors
- He, Y., Liu, P., Wang, Z., Hu, Z., & Yang, Y.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 4335-4344
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2928560789
- Cited by
- 1,217
- References
- 41
- FWCI
- 53.81
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.