The DOI matches its Crossref record; 246 of the 246 references it cites were found in a registry or an index.
Pruning and quantization for deep neural network acceleration: A survey
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2014) · Cited by 33,419
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
International Conference on Learning Representations (ICLR 2013)
松尾, 豊. (2013) · 人工知能学会誌 = Journal of Japanese Society for Artificial Intelligence · Cited by 6,286
Learning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00907 · Cited by 6,249
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Self-citation2013 IEEE International Conference on Computer Vision
(2013) · doi:10.1109/iccv19984.2013 · Cited by 4,183
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., & Kalenichenko, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00286 · Cited by 4,114
Knowledge Distillation: A Survey
Gou, J., Yu, B., Maybank, S. J., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01453-z · Cited by 3,931
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Feature selection for classification
DASH, M., & LIU, H. (1997) · Intelligent Data Analysis · doi:10.1016/s1088-467x(97)00008-5 · Cited by 3,574
(1989) · Cited by 3,214
2017 IEEE International Conference on Computer Vision (ICCV)
(2017) · doi:10.1109/iccv37128.2017 · Cited by 3,056
Pruning Filters for Efficient ConvNets
Li, H., Kadav, A., Durdanovic, I., Samet, H., & Graf, H. P. (2016) · arXiv · doi:10.48550/arxiv.1608.08710 · Cited by 2,928
Learning Efficient Convolutional Networks through Network Slimming
Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., & Zhang, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.298 · Cited by 2,761
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Self-citationChannel Pruning for Accelerating Very Deep Neural Networks
He, Y., Zhang, X., & Sun, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.155 · Cited by 2,647
Self-citationAdvances in Neural Information Processing Systems 27 (NIPS 2014)
Zhong, M., Goddard, N., & Sutton, C. A. (2014) · Cited by 2,636
International Conference on Machine Learning (ICML)-2005
津田, 宏. (2006) · 人工知能学会誌 = Journal of Japanese Society for Artificial Intelligence · Cited by 2,558
(2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9 · Cited by 2,285
Convolutional Neural Networks for Speech Recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,262
Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1602.02830 · Cited by 2,106
Buciluǎ, C., Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150464 · Cited by 2,068
Tensor Completion for Estimating Missing Values in Visual Data
Liu, J., Musialski, P., Wonka, P., & Ye, J. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.39 · Cited by 2,063
ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression
Luo, J.-H., Wu, J., & Lin, W. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.541 · Cited by 1,832
A set of level 3 basic linear algebra subprograms
Dongarra, J. J., Du Croz, J., Hammarling, S., & Duff, I. S. (1990) · ACM Transactions on Mathematical Software · doi:10.1145/77626.79170 · Cited by 1,821
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
(2019) · doi:10.1109/cvpr41558.2019 · Cited by 1,775
Reed, R. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.248452 · Cited by 1,708
International Conference on Learning Representations (ICLR)
Abbas, M. Z. A., Kivinen, J., & Raiko, T. (2016) · Cited by 1,694
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
Zhou, S., Wu, Y., Ni, Z., Zhou, X., Wen, H., & Zou, Y. (2016) · arXiv · doi:10.48550/arxiv.1606.06160 · Cited by 1,690
Hubara, I., Soudry, D., & Yaniv, R. E. (2016) · arXiv · doi:10.48550/arxiv.1602.02505 · Cited by 1,667
Advances in Neural Information Processing Systems 19 (NIPS 2006)
Simonotto, E., Whalley, H. C., Lawrie, S. M., Murray, L. M., McGonigle, D. J., & Storkey, A. (2006) · Cited by 1,651
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2016) · doi:10.1109/cvpr33180.2016 · Cited by 1,534
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
Frankle, J., & Carbin, M. (2018) · arXiv · doi:10.48550/arxiv.1803.03635 · Cited by 1,529
Learning both Weights and Connections for Efficient Neural Networks
Han, S., Pool, J., Tran, J., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1506.02626 · Cited by 1,481
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · arXiv · doi:10.48550/arxiv.1502.02551 · Cited by 1,364
IEEE Standard for Floating-Point Arithmetic
(2008) · doi:10.1109/ieeestd.2008.4610935 · Cited by 1,328
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080246 · Cited by 1,240
Pruning Convolutional Neural Networks for Resource Efficient Inference
Molchanov, P. A., Tyree, S., Karras, T., Aila, T., & Kautz, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06440 · Cited by 1,239
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration
He, Y., Liu, P., Wang, Z., Hu, Z., & Yang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00447 · Cited by 1,217
Quantized Convolutional Neural Networks for Mobile Devices
Wu, J., Leng, C., Wang, Y., Hu, Q., & Cheng, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.521 · Cited by 1,212
FINN: A Framework for Fast, Scalable Binarized Neural Network Inference
Umuroglu, Y., Fraser, N. J., Gambardella, G., Blott, M., Leong, P., Jahre, M., & Vissers, K. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021744 · Cited by 1,189
Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., Venkatesh, G., et al. (2017) · arXiv · doi:10.48550/arxiv.1710.03740 · Cited by 1,179
TVM: an automated end-to-end optimizing compiler for deep learning
(2018) · arXiv (Cornell University) · doi:10.5555/3291168.3291211 · Cited by 1,170
2019 IEEE/CVF International Conference on Computer Vision (ICCV)
(2019) · doi:10.1109/iccv43118.2019 · Cited by 1,116
Neocognitron: A hierarchical neural network capable of visual pattern recognition
Fukushima, K. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90014-7 · Cited by 1,097
How Does Batch Normalization Help Optimization?
Santurkar, S., Tsipras, D., Ilyas, A., & Madry, A. (2018) · arXiv · doi:10.48550/arxiv.1805.11604 · Cited by 1,092
EIE: Efficient Inference Engine on Compressed Deep Neural Network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.30 · Cited by 1,077
Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks
He, Y., Kang, G., Dong, X., Fu, Y., & Yang, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/309 · Cited by 1,020
HAQ: Hardware-Aware Automated Quantization With Mixed Precision
Wang, K., Liu, Z., Lin, Y., Lin, J., & Han, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00881 · Cited by 978
Compressing Neural Networks with the Hashing Trick
Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv · doi:10.48550/arxiv.1504.04788 · Cited by 974
(2014) · arXiv (Cornell University) · Cited by 942
Dynamic Network Surgery for Efficient DNNsPreprint
Guo, Y., Yao, A., & Chen, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.04493 · Cited by 926
Compressing Deep Convolutional Networks using Vector Quantization
Gong, Y., Liu, L., Yang, M., & Bourdev, L. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6115 · Cited by 925
Fast Algorithms for Convolutional Neural Networks
Lavin, A., & Gray, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.435 · Cited by 915
Rethinking the Value of Network Pruning
Liu, Z., Sun, M., Zhou, T., Huang, G. M., & Darrell, T. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05270 · Cited by 872
Zhu, C., Han, S., Mao, H., & Dally, W. J. (2016) · arXiv · doi:10.48550/arxiv.1612.01064 · Cited by 865
A Survey of Model Compression and Acceleration for Deep Neural Networks
Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2017) · arXiv · doi:10.48550/arxiv.1710.09282 · Cited by 857
Once-for-All: Train One Network and Specialize it for Efficient Deployment
Cai, H., Gan, C., Wang, T., Zhang, Z., & Han, S. (2019) · arXiv · doi:10.48550/arxiv.1908.09791 · Cited by 845
Benchmark analysis of representative deep neural network architectures
Bianco, S., Cadene, R., Celona, L., & Napoletano, P. (2018) · IEEE Access · doi:10.1109/access.2018.2877890 · Cited by 838
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks.Preprint
Frankle, J., & Carbin, M. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 838
Elsken, T., Metzen, J. H., & Hutter, F. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_3 · Cited by 785
Convolutional networks for fast, energy-efficient neuromorphic computing
Esser, S. K., Merolla, P. A., Arthur, J. V., Cassidy, A. S., Appuswamy, R., Andreopoulos, A., Berg, D. J., McKinstry, J. L., Melano, T., Barch, D. R., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1604850113 · Cited by 781
Quantizing deep convolutional networks for efficient inference: A whitepaper
Krishnamoorthi, R. (2018) · arXiv · doi:10.48550/arxiv.1806.08342 · Cited by 753
Li, F., Liu, B., Wang, X., Zhang, B., & Yan, J. (2016) · arXiv · doi:10.48550/arxiv.1605.04711 · Cited by 732
PACT: Parameterized Clipping Activation for Quantized Neural Networks
Choi, J., Wang, Z., Venkataramani, S., Chuang, P. I.-J., Srinivasan, V., & Gopalakrishnan, K. (2018) · arXiv · doi:10.48550/arxiv.1805.06085 · Cited by 703
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks
Zhang, D., Yang, J., Ye, D., & Hua, G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_23 · Cited by 693
SNIP: Single-shot Network Pruning based on Connection Sensitivity
Lee, N., Ajanthan, T., & Torr, P. H. S. (2018) · arXiv · doi:10.48550/arxiv.1810.02340 · Cited by 685
Sparse Convolutional Neural Networks
Liu, B., Wang, M., Foroosh, H., Tappen, M., & Penksy, M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298681 · Cited by 680
Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures
Hu, H., Peng, R., Tai, Y., & Tang, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.03250 · Cited by 668
Optimal Brain Surgeon and general network pruning
Hassibi, B., Stork, D. G., & Wolff, G. J. (2002) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1993.298572 · Cited by 597
Lin, J., Rao, Y., Lu, J., & Zhou, J. (2017) · neural information processing systems · Cited by 597
LASSO: A feature selection technique in predictive modeling for machine learning
Muthukrishnan, R., & Rohini, R. (2016) · 2016 IEEE International Conference on Advances in Computer Applications (ICACA) · doi:10.1109/icaca.2016.7887916 · Cited by 586
The coincidence approach to stochastic point processes
Macchi, O. (1975) · Advances in Applied Probability · doi:10.1017/s0001867800040313 · Cited by 582
Liu, Z., Wu, B., Luo, W., Yang, X., Liu, W., & Cheng, K.-T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_44 · Cited by 565
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning
Liu, Z., Mu, H., Zhang, X., Guo, Z., Yang, X., Cheng, K.-T., & Sun, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00339 · Cited by 563
Self-citationAngel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGA
Guo, K., Sui, L., Qiu, J., Yu, J., Wang, J., Yao, S., Han, S., Wang, Y., & Yang, H. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2705069 · Cited by 562
What is the State of Neural Network Pruning?
Blalock, D., Ortiz, J. J. G., Frankle, J., & Guttag, J. (2020) · arXiv · doi:10.48550/arxiv.2003.03033 · Cited by 560
Data-Driven Sparse Structure Selection for Deep Neural Networks
Huang, Z., & Wang, N. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_19 · Cited by 549
Binary Neural Networks: A Survey
Qin, H., Gong, R., Liu, X., Bai, X., Song, J., & Sebe, N. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107281 · Cited by 546
A comprehensive survey on model compression and acceleration
Choudhary, T., Mishra, V., Goswami, A., & Sarangapani, J. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09816-7 · Cited by 513
Data-free Parameter Pruning for Deep Neural Networks
Srinivas, S., & Babu, R. V. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.31 · Cited by 505
Deep Learning with Low Precision by Half-Wave Gaussian Quantization
Cai, Z., He, X., Sun, J., & Vasconcelos, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.574 · Cited by 498
Comparing Biases for Minimal Network Construction with Back-Propagation
Hanson, S. J., & Pratt, L. (1988) · neural information processing systems · Cited by 480
Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks
Gong, R., Liu, X., Jiang, S., Li, T., Hu, P., Lin, J., Yu, F., & Yan, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00495 · Cited by 466
BlockDrop: Dynamic Inference Paths in Residual Networks
Wu, Z., Nagarajan, T., Kumar, A., Rennie, S., Davis, L. S., Grauman, K., & Feris, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00919 · Cited by 465
Towards Accurate Binary Convolutional Neural Network
Lin, X., Zhao, C., & Pan, W. (2017) · arXiv · doi:10.48550/arxiv.1711.11294 · Cited by 453
The State of Sparsity in Deep Neural Networks
Gale, T., Elsen, E., & Hooker, S. (2019) · arXiv · doi:10.48550/arxiv.1902.09574 · Cited by 440
Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights
Zhou, A., Yao, A., Guo, Y., Xu, L., & Chen, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03044 · Cited by 439
Recent advances in convolutional neural network acceleration
Zhang, Q., Zhang, M., Chen, T., Sun, Z., Ma, Y., & Yu, B. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.09.038 · Cited by 434
Accelerating Binarized Convolutional Neural Networks with Software-Programmable FPGAs
Zhao, R., Song, W., Zhang, W., Xing, T., Lin, J.-H., Srivastava, M., Gupta, R., & Zhang, Z. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021741 · Cited by 429
Training deep neural networks with low precision multiplications
Courbariaux, M., Bengio, Y., & David, J.-P. (2014) · arXiv · doi:10.48550/arxiv.1412.7024 · Cited by 407
Yang, J., Shen, X., Xing, J., Tian, X., Li, H., Deng, B., Huang, J., & Hua, X.-S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00748 · Cited by 387
Learning to Quantize Deep Networks by Optimizing Quantization Intervals With Task Loss
Jung, S., Son, C., Lee, S., Son, J., Han, J.-J., Kwak, Y., Hwang, S. J., & Choi, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00448 · Cited by 385
Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315128 · Cited by 374
Fast ConvNets Using Group-Wise Brain Damage
Lebedev, V., & Lempitsky, V. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.280 · Cited by 373
Conditional Computation in Neural Networks for faster modelsPreprint
Bengio, E., Bacon, P., Pineau, J., & Precup, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06297 · Cited by 355
MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks
Gordon, A., Eban, E., Nachum, O., Chen, B., Wu, H., Yang, T.-J., & Choi, E. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00171 · Cited by 341
MLIR: A Compiler Infrastructure for the End of Moore's LawPreprint
Lattner, C., Amini, M., Bondhugula, U. K. R., Cohen, A., Davis, A., Pienaar, J. A., Riddle, R., Shpeisman, T., Vasilache, N., & Zinenko, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11054 · Cited by 341
Forward and Backward Information Retention for Accurate Binary Neural Networks
Qin, H., Gong, R., Liu, X., Shen, M., Wei, Z., Yu, F., & Song, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00232 · Cited by 337
Adaptive Computation Time for Recurrent Neural Networks
Graves, A. (2016) · arXiv · doi:10.48550/arxiv.1603.08983 · Cited by 335
Convolutional Neural Networks using Logarithmic Data Representation
Miyashita, D., Lee, E. H., & Murmann, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01025 · Cited by 329
Spatially Adaptive Computation Time for Residual Networks
Figurnov, M., Collins, M. D., Zhu, Y., Zhang, L., Huang, J., Vetrov, D., & Salakhutdinov, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.194 · Cited by 329
Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers
Ye, J., Lu, X., Lin, Z., & Wang, J. Z. (2018) · arXiv · doi:10.48550/arxiv.1802.00124 · Cited by 328
Neural Networks for Machine Learning
(2017) · Human and Machine Hearing · doi:10.1017/9781139051699.031 · Cited by 325
Variational Dropout Sparsifies Deep Neural Networks
Molchanov, D., Ashukha, A., & Vetrov, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.05369 · Cited by 311
Training and Inference with Integers in Deep Neural Networks
Wu, S., Li, G., Chen, F., & Shi, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04680 · Cited by 306
Günther, J., Pilarski, P. M., Helfrich, G., Shen, H., & Diepold, K. (2014) · Procedia Technology · doi:10.1016/j.protcy.2014.09.007 · Cited by 303
More is Less: A More Complicated Network with Less Inference Complexity
Dong, X., Huang, J., Yang, Y., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.205 · Cited by 291
Less Is More: Towards Compact CNNs
Zhou, H., Alvarez, J. M., & Porikli, F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_40 · Cited by 279
Extremely Low Bit Neural Network: Squeeze the Last Bit Out With ADMM
Leng, C., Dou, Z., Li, H., Zhu, S., & Jin, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11713 · Cited by 275
Learning Pooling for Convolutional Neural Network
Sun, M., Song, Z., Jiang, X., Pan, J., & Pang, Y. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.10.049 · Cited by 274
Fast Training of Convolutional Networks through FFTs
Mathieu, M., Henaff, M., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.5851 · Cited by 273
Scalpel: Customizing DNN Pruning to the Underlying Hardware Parallelism
Yu, J., Lukefahr, A., Palframan, D., Dasika, G., Das, R., & Mahlke, S. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080215 · Cited by 272
Weighted-Entropy-Based Quantization for Deep Neural Networks
Park, E., Ahn, J., & Yoo, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.761 · Cited by 267
Gysel, P., Pimentel, J., Motamedi, M., & Ghiasi, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2808319 · Cited by 250
Post training 4-bit quantization of convolutional networks for rapid-deployment
Banner, R., Nahshan, Y., & Soudry, D. (2019) · neural information processing systems · Cited by 250
DSD: Dense-Sparse-Dense Training for Deep Neural NetworksPreprint
Han, S., Pool, J., Narang, S., Mao, H., Gong, E., Tang, S., Elsen, E., Vajda, P., Paluri, M., Tran, J. J., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.04381 · Cited by 248
Group sparse optimization by alternating direction method
Deng, W., Yin, W., & Zhang, Y. (2013) · SPIE Proceedings · doi:10.1117/12.2024410 · Cited by 247
AI Benchmark: All About Deep Learning on Smartphones in 2019
Ignatov, A., Timofte, R., Kulik, A., Yang, S., Wang, K., Baum, F., Wu, M., Xu, L., & Van Gool, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00447 · Cited by 247
Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation
Wu, H., Judd, P., Zhang, X., Isaev, M., & Micikevicius, P. (2020) · arXiv · doi:10.48550/arxiv.2004.09602 · Cited by 246
Self-citationFixed-point feedforward deep neural network design using weights +1, 0, and −1
Hwang, K., & Sung, W. (2014) · 2014 IEEE Workshop on Signal Processing Systems (SiPS) · doi:10.1109/sips.2014.6986082 · Cited by 244
Recent advances in efficient computation of deep convolutional neural networks
Cheng, J., Wang, P.-S., Li, G., Hu, Q.-H., & Lu, H.-Q. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700789 · Cited by 230
Ternary neural networks for resource-efficient AI applications
Alemdar, H., Leroy, V., Prost-Boucle, A., & Petrot, F. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966166 · Cited by 229
WRPN: Wide Reduced-Precision Networks
Mishra, A., Nurvitadhi, E., Cook, J. J., & Marr, D. (2017) · arXiv · doi:10.48550/arxiv.1709.01134 · Cited by 227
Highway and Residual Networks learn Unrolled Iterative EstimationPreprint
Greff, K., Srivastava, R. K., & Schmidhuber, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07771 · Cited by 222
AutoPruner: An end-to-end trainable filter pruning method for efficient deep model inference
Luo, J.-H., & Wu, J. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107461 · Cited by 221
A Review of Binarized Neural Networks
Simons, T., & Lee, D.-J. (2019) · Electronics · doi:10.3390/electronics8060661 · Cited by 219
Yu, J., Yang, L., Xu, N., Yang, J., & Huang, T. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.08928 · Cited by 216
Loss-aware Binarization of Deep NetworksPreprint
Hou, L., Yao, Q., & Kwok, J. T.-Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01600 · Cited by 209
Multi-Scale Dense Networks for Resource Efficient Image Classification
Huang, G. M., Chen, D., Li, T., Wu, F., van der Maaten, L., & Weinberger, K. Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09844 · Cited by 208
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression
Li, Y., Gu, S., Mayer, C., Van Gool, L., & Timofte, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00804 · Cited by 208
DianNao family: energy-efficient hardware accelerators for machine learning
Chen, Y., Chen, T., Xu, Z., Sun, N., & Temam, O. (2016) · Communications of the ACM · doi:10.1145/2996864 · Cited by 205
AdderNet: Do We Really Need Multiplications in Deep Learning?
Chen, H., Wang, Y., Xu, C., Shi, B., Xu, C., Tian, Q., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00154 · Cited by 199
A new pruning heuristic based on variance analysis of sensitivity information
Engelbrecht, A. P. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.963775 · Cited by 198
"Learning-Compression" Algorithms for Neural Net Pruning
Carreira-Perpinan, M. A., & Idelbayev, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00890 · Cited by 195
Dynamic Channel Pruning: Feature Boosting and Suppression
Gao, X., Zhao, Y., Dudziak, Ł., Mullins, R., & Xu, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05331 · Cited by 195
Scalable Methods for 8-bit Training of Neural Networks
Banner, R., Hubara, I., Hoffer, E., & Soudry, D. (2018) · arXiv · doi:10.48550/arxiv.1805.11046 · Cited by 193
Training Deep Neural Networks with 8-bit Floating Point Numbers
Wang, N., Choi, J., Brand, D., Chen, C., & Gopalakrishnan, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.08011 · Cited by 189
Toolflows for Mapping Convolutional Neural Networks on FPGAs: A Survey and Future Directions
Venieris, S. I., Kouris, A., & Bouganis, C.-S. (2019) · ACM Computing Surveys · doi:10.1145/3186332 · Cited by 189
A Survey on Methods and Theories of Quantized Neural Networks
Guo, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04752 · Cited by 188
Architectural Complexity Measures of Recurrent Neural NetworksPreprint
Zhang, S., Wu, Y., Che, T., Lin, Z., Memisevic, R., Salakhutdinov, R. R., & Bengio, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.08210 · Cited by 186
Recurrent Processing during Object Recognition
O’Reilly, R. C., Wyatte, D., Herd, S., Mingus, B., & Jilk, D. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00124 · Cited by 184
An Overview of Neural Network CompressionPreprint
O’Neill, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03669 · Cited by 179
Improved Techniques for Training Adaptive Deep Networks
Li, H., Zhang, H., Qi, X., Yang, R., & Huang, G. M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00198 · Cited by 177
Soudry, D., Hubara, I., & Meir, R. (2014) · Cited by 176
Glow: Graph Lowering Compiler Techniques for Neural Networks
Rotem, N., Fix, J., Abdulrasool, S., Catron, G., Deng, S., Dzhabarov, R., Gibson, N., Hegeman, J. W., Lele, M., Levenstein, R., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.00907 · Cited by 174
Channel-level acceleration of deep face representations
Polyak, A., & Wolf, L. (2015) · IEEE Access · doi:10.1109/access.2015.2494536 · Cited by 171
$L1$ -Norm Batch Normalization for Efficient Training of Deep Neural Networks
Wu, S., Li, G., Deng, L., Liu, L., Wu, D., Xie, Y., & Shi, L. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876179 · Cited by 166
8-Bit Approximations for Parallelism in Deep LearningPreprint
Dettmers, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.04561 · Cited by 165
Flexpoint: An Adaptive Numerical Format for Efficient Training of Deep Neural Networks
Köster, U., Webb, T. J., Wang, X., Nassar, M., Bansal, A. K., Constable, W., Elibol, O. H., Gray, S., Hall, S., Hornof, L., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02213 · Cited by 164
Scalable and modularized RTL compilation of Convolutional Neural Networks onto FPGA
Ma, Y., Suda, N., Cao, Y., Seo, J.-S., & Vrudhula, S. (2016) · 2016 26th International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2016.7577356 · Cited by 161
Towards Unified INT8 Training for Convolutional Neural Network
Zhu, F., Gong, R., Yu, F., Liu, X., Wang, Y., Li, Z., Yang, X., & Yan, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00204 · Cited by 160
Structured Binary Neural Networks for Accurate Image Classification and Semantic Segmentation
Zhuang, B., Shen, C., Tan, M., Liu, L., & Reid, I. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00050 · Cited by 158
A Quantization-Friendly Separable Convolution for MobileNets
Sheng, T., Feng, C., Zhuo, S., Zhang, X., Shen, L., & Aleksic, M. (2018) · Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2) · doi:10.1109/emc2.2018.00011 · Cited by 156
Self-citationScalpel: Customizing DNN Pruning to the Underlying Hardware Parallelism
Yu, J., Lukefahr, A., Palframan, D. J., Dasika, G. S., Das, R., & Mahlke, S. A. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3140659.3080215 · Cited by 152
A Survey of FPGA-Based Neural Network AcceleratorPreprint
Guo, K., Zeng, S., Yu, J., Wang, Y., & Yang, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.08934 · Cited by 147
Towards the Limit of Network Quantization
Choi, Y., El-Khamy, M., & Lee, J. (2016) · arXiv · doi:10.48550/arxiv.1612.01543 · Cited by 143
Two-Step Quantization for Low-bit Neural Networks
Wang, P., Hu, Q., Zhang, Y., Zhang, C., Liu, Y., & Cheng, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00460 · Cited by 136
Learning Channel-Wise Interactions for Binary Convolutional Neural Networks
Wang, Z., Lu, J., Tao, C., Zhou, J., & Tian, Q. C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00066 · Cited by 135
SYQ: Learning Symmetric Quantization for Efficient Deep Neural Networks
Faraone, J., Fraser, N., Blott, M., & Leong, P. H. W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00452 · Cited by 134
Xilinx Vitis Unified Software Platform
Kathail, V. (2020) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3373087.3375887 · Cited by 129
Estimating or Propagating Gradients Through Stochastic NeuronsPreprint
Bengio, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.2982 · Cited by 128
Training high-performance and large-scale deep neural networks with full 8-bit integers
Yang, Y., Deng, L., Wu, S., Yan, T., Xie, Y., & Li, G. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.12.027 · Cited by 125
Accelerating Deep Convolutional Networks using low-precision and sparsity
Venkatesh, G., Nurvitadhi, E., & Marr, D. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952679 · Cited by 123
Pruning algorithms of neural networks — a comparative study
Augasta, M. G., & Kathirvalavakumar, T. (2013) · Open Computer Science · doi:10.2478/s13537-013-0109-x · Cited by 119
DeepShift: Towards Multiplication-Less Neural Networks
Elhoushi, M., Chen, Z., Shafiq, F., Tian, Y. H., & Li, J. Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00268 · Cited by 117
Balanced Quantization: An Effective and Efficient Approach to Quantized Neural Networks
Zhou, S., Wang, Y., Wen, H., He, Q., & Zou, Y. (2017) · Journal of Computer Science and Technology · doi:10.1007/s11390-017-1750-y · Cited by 109
Accelerating CNN inference on FPGAs: A Survey
Abdelouahab, K., Pelcat, M., Serot, J., & Berry, F. (2018) · arXiv · doi:10.48550/arxiv.1806.01683 · Cited by 107
Quantization of Fully Convolutional Networks for Accurate Biomedical Image Segmentation
Xu, X., Lu, Q. H., Yang, L., Hu, X. S., Chen, D. Z., Hu, Y. H., & Shi, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00866 · Cited by 105
From Hashing to CNNs: Training Binary Weight Networks via Hashing
Hu, Q., Wang, P., & Cheng, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11660 · Cited by 101
Deep neural networks are robust to weight binarization and other non-linear distortionsPreprint
Merolla, P. A., Appuswamy, R., Arthur, J. V., Esser, S. K., & Modha, D. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01981 · Cited by 98
SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity Through Low-Bit Quantization
Cao, S., Ma, L., Xiao, W., Zhang, C., Liu, Y., Zhang, L., Nie, L., & Yang, Z. Q. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01147 · Cited by 93
Low-Rank Approximations for Conditional Feedforward Computation in Deep Neural NetworksPreprint
Davis, A., & Arel, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.4461 · Cited by 92
Weight discretization paradigm for optical neural networks
Fiesler, E., Choudry, A., & Caulfield, H. J. (1990) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.20700 · Cited by 91
Recent advances in efficient computation of deep convolutional neural networks
Jian, J. I. A. N., Cheng, C., Pei-song, et al. (2018) · Acta Scientiarum Naturalium Universitatis Sunyatseni · Cited by 90
Ternary Neural Networks with Fine-Grained QuantizationPreprint
Mellempudi, N., Kundu, A., Mudigere, D., Das, D., Kaul, B., & Dubey, P. K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.01462 · Cited by 89
Research works printed but not linked: 16
- Baskin, C., Schwartz, E., Zheltonozhskii, E., Liss, N., Giryes, R., Bronstein, A.M., Mendelson, A., 2018. UNIQ: Uniform Noise Injection for Non-Uniform Quantization of Neural Networks. arXiv preprint arXiv:1804.10969 http://arxiv.org/abs/1804.10969. · arXiv
- Chellapilla, K., Puri, S., Simard, P., 2006. High Performance Convolutional Neural Networks for Document Processing, in: Tenth International Workshop on Frontiers in Handwriting Recognition. https://hal.inria.fr/inria-00112631/, 10.1.1.137.482.
- Choi, 2008, Solving local minima problem with large number of hidden nodes on two-layered feed-forward artificial neural networks, Neurocomputing, 71, 3640, 10.1016/j.neucom.2008.04.004 · doi:10.1016/j.neucom.2008.04.004
- Cotofana, S., Vassiliadis, S., Logic, T., Addition, B., Addition, S., 1997. Low Weight and Fan-In Neural Networks for Basic Arithmetic Operations, in: 15th IMACS World Congress, pp. 227–232. 10.1.1.50.4450.
- Courbariaux, M., Bengio, Y., David, J.P., 2015. BinaryConnect: Training Deep Neural Networks with binary weights during propagations, in: Advances in Neural Information Processing Systems (NIPS), pp. 1–9. http://arxiv.org/abs/1511.00363, DOI: 10.5555/2969442.2969588. · arXiv · doi:10.5555/2969442.2969588
- Lei, J., Gao, X., Song, J., Wang, X.L., Song, M.L., 2018. Survey of Deep Neural Network Model Compression. Ruan Jian Xue Bao/Journal of Software 29, 251–266. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85049464636&doi=10.13328 10.13328/j.cnki.jos.005428. · doi:10.13328/j.cnki.jos.005428
- Li, M., Liu, Y.I., Liu, X., Sun, Q., You, X.I.N., Yang, H., Luan, Z., Gan, L., Yang, G., Qian, D., 2020a. The Deep Learning Compiler: A Comprehensive Survey. ArXiv preprint 1, 1–36. http://arxiv.org/abs/2002.03794. · arXiv
- Macchi, 1975, Coincidence Approach To Stochastic Point Process, Adv. Appl. Prob., 7, 83, 10.2307/1425855 · doi:10.2307/1425855
- Migacz, 2017, 8-bit inference with TensorRT, GPU Technology Conference, 2, 7
- Ouyang, J., Noh, M., Wang, Y., Qi, W., Ma, Y., Gu, C., Kim, S., Hong, K.i., Bae, W.K., Zhao, Z., Wang, J., Wu, P., Gong, X., Shi, J., Zhu, H., Du, X., 2020. Baidu Kunlun An AI processor for diversified workloads, in: 2020 IEEE Hot Chips 32 Symposium (HCS), IEEE. pp. 1–18. https://ieeexplore.ieee.org/document/9220641/, DOI: 10.1109/HCS49909.2020.9220641. · doi:10.1109/hcs49909.2020.9220641
- Rodriguez, 2018, Lower Numerical Precision Deep Learning Inference and Training, Intel White Paper, 1
- Ruffy, F., Chahal, K., 2019. The State of Knowledge Distillation for Classification. ArXiv preprint http://arxiv.org/abs/1912.10850. · arXiv
- Saad, 1990, Training Feed Forward Nets with Binary Weights Via a Modified CHIR Algorithm, Complex Systems, 4, 573
- Sabour, 2017, Dynamic routing between capsules, Advances in Neural Information Processing Systems (NIPS), 3857
- Singh, P., Kumar Verma, V., Rai, P., Namboodiri, V.P., 2019. Play and Prune: Adaptive Filter Pruning for Deep Model Compression, in: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, International Joint Conferences on Artificial Intelligence Organization, California. pp. 3460–3466. https://www.ijcai.org/proceedings/2019/480, 10.24963/ijcai.2019/480. · DOI
- Inc, 2018, Accelerating DNNs with Xilinx Alveo Accelerator Cards (WP504), White Paper, 504, 1
Cited by
A Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219
DepGraph: Towards Any Structural Pruning
Fang, G., Ma, X., Song, M., Bi Mi, M., & Wang, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01544 · Cited by 501
Structured Pruning for Deep Convolutional Neural Networks: A Survey
He, Y., & Xiao, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3334614 · Cited by 363
Multi-Modal 3D Object Detection in Autonomous Driving: A Survey and Taxonomy
Wang, L., Zhang, X., Song, Z., Bi, J., Zhang, G., Wei, H., Tang, L., Yang, L., Li, J., Jia, C., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3264658 · Cited by 269
Self-citationLightweight Deep Learning for Resource-Constrained Environments: A Survey
Liu, H.-I., Galindo, M., Xie, H., Wong, L.-K., Shuai, H.-H., Li, Y.-H., & Cheng, W.-H. (2024) · ACM Computing Surveys · doi:10.1145/3657282 · Cited by 259
Metadata
- Authors
- Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2021-10
- Volume
- 461
- Pages
- 370-403
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W3184606595
- Cited by
- 943
- References
- 246
- FWCI
- 49.47
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Natural Science Foundation of China
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.