The DOI matches its Crossref record; 246 of the 246 references it cites were found in a registry or an index.
Pruning and quantization for deep neural network acceleration: A survey
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–246 of 246
Diversity Networks: Neural Network Compression Using Determinantal Point ProcessesPreprint
Mariet, Z., & Sra, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05077 · Cited by 84
Dissecting the Graphcore IPU Architecture via Microbenchmarking
Jia, Z., Tillman, B., Maggioni, M., & Scarpazza, D. P. (2019) · arXiv · doi:10.48550/arxiv.1912.03413 · Cited by 83
Discriminative Transfer Learning Using Similarities and Dissimilarities
Lu, Y., Chen, L., Saidi, A. S., Dellandréa, E., & Wang, Y. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2705760 · Cited by 82
Scalable high-performance architecture for convolutional ternary neural networks on FPGA
Prost-Boucle, A., Bourge, A., Pétrot, F., Alemdar, H. O., Caldwell, N., & Leroy, V. (2017) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056850 · Cited by 79
High performance binary neural networks on the Xeon+FPGA™ platform
Moss, D. J. M., Nurvitadhi, E., Sim, J., Mishra, A., Marr, D., Subhaschandra, S., & Leong, P. H. W. (2017) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056823 · Cited by 76
Convolutional Neural Network Pruning: A Survey
Xu, S. H., Huang, A., Chen, L., & Zhang, B. (2020) · Chinese Control Conference (CCC) · doi:10.23919/ccc50068.2020.9189610 · Cited by 74
ShiftCNN: Generalized Low-Precision Architecture for Inference of Convolutional Neural NetworksPreprint
Gudovskiy, D., & Rigazio, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02393 · Cited by 73
MeliusNet: Can Binary Neural Networks Achieve MobileNet-level Accuracy?Preprint
Bethge, J., Bartz, C., Yang, H., Chen, Y., & Meinel, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.05936 · Cited by 69
Tracing biomass burning aerosol from South America to Troll Research Station, Antarctica
Fiebig, M., Lunder, C., & Stohl, A. (2009) · Geophysical Research Letters · doi:10.1029/2009gl038531 · Cited by 68
Blended coarse gradient descent for full quantization of deep neural networks
Yin, P., Zhang, S., Lyu, J., Osher, S., Qi, Y., & Xin, J. X. (2019) · Research in the Mathematical Sciences · doi:10.1007/s40687-018-0177-6 · Cited by 67
Searching for Accurate Binary Neural Architectures
Shen, M., Han, K., Xu, C., & Wang, Y. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00256 · Cited by 65
BinaryDenseNet: Developing an Architecture for Binary Neural Networks
Bethge, J., Yang, H., Bornstein, M., & Meinel, C. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00244 · Cited by 61
Rounding Methods for Neural Networks with Low Resolution Synaptic WeightsPreprint
Müller, L. K., & Indiveri, G. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.05767 · Cited by 59
The cascading neural network: building the Internet of Smart Things
Leroux, S., Bohez, S., De Coninck, E., Verbelen, T., Vankeirsbilck, B., Simoens, P., & Dhoedt, B. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1029-1 · Cited by 59
A survey of FPGA design for AI era
Li, Z., Zhang, Y., Wang, J., & Lai, J. (2020) · Journal of Semiconductors · doi:10.1088/1674-4926/41/2/021402 · Cited by 59
Automatic Recommendation Technology for Learning Resources with Convolutional Neural Network
Shen, X., Yi, B., Zhang, Z., Shu, J., & Liu, H. (2016) · International Symposium on Educational Technology · doi:10.1109/iset.2016.12 · Cited by 57
Cheng, Z., Soudry, D., Mao, Z., & Lan, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03562 · Cited by 54
Parsimonious network design and feature selection through node pruning
Mao, J., Mohiuddin, K., & Jain, A. K. (2002) · IAPR International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.1994.577060 · Cited by 53
Weight quantization in Boltzmann machines
Balzer, W., Takahashi, M., Ohta, J., & Kyuma, K. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90077-i · Cited by 51
Inference of quantized neural networks on heterogeneous all-programmable devices
Preuser, T. B., Gambardella, G., Fraser, N., & Blott, M. (2018) · Design, Automation, and Test in Europe · doi:10.23919/date.2018.8342121 · Cited by 51
Learning Low-precision Neural Networks without Straight-Through Estimator (STE)
Liu, Z.-G., & Mattina, M. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/425 · Cited by 49
Changing Model Behavior at Test-Time Using Reinforcement LearningPreprint
Odena, A., Lawson, D., & Olah, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07780 · Cited by 48
A survey of neural network accelerators
Li, Z., Wang, Y., Zhi, T., & Chen, T. (2017) · Frontiers of Computer Science · doi:10.1007/s11704-016-6159-1 · Cited by 46
Fixed-Point Factorized Networks
Wang, P., & Cheng, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.422 · Cited by 43
Speeding-up convolutional neural networks: A survey
Lebedev, V., & Lempitsky, V. (2018) · Bulletin of the Polish Academy of Sciences Technical Sciences · doi:10.24425/bpas.2018.125927 · Cited by 38
Categorizing Malware via A Word2Vec-based Temporal Convolutional Network Scheme
Sun, J., Luo, X., Gao, H., et al. (2020) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-020-00200-y · Cited by 35
Energy-Efficient Design of Processing Element for Convolutional Neural Network
Choi, Y., Bae, D., Sim, J., Choi, S., Kim, M., & Kim, L. (2017) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2017.2691771 · Cited by 32
A Deep Look into Logarithmic Quantization of Model Parameters in Neural Networks
Cai, J., Takemoto, M., & Nakajo, H. (2018) · Proceedings of the 10th International Conference on Advances in Information Technology · doi:10.1145/3291280.3291800 · Cited by 31
Cnvlutin2: Ineffectual-Activation-and-Weight-Free Deep Neural Network ComputingPreprint
Judd, P., Delmas, A., Sharify, S., & Moshovos, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.00125 · Cited by 29
Quantizing Convolutional Neural Networks for Low-Power High-Throughput Inference EnginesPreprint
Settle, S. O., Bollavaram, M., D’Alberto, P., Delaye, E., Fernandez, O., Fraser, N. J., Ng, A. N., Sirasao, A., & Wu, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07941 · Cited by 28
Compression of convolutional neural networks: A short survey
Pilipović, R., Bulić, P., & Risojević, V. (2018) · International Symposium INFOTEH-JAHORINA (INFOTEH) · doi:10.1109/infoteh.2018.8345545 · Cited by 27
Yuan, Z., Hu, J., Wu, D., & Ban, X. (2020) · Sensors · doi:10.3390/s20051260 · Cited by 23
Distributed Sequence Memory of Multidimensional Inputs in Recurrent NetworksPreprint
Charles, A. S., Yin, D., & Rozell, C. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08346 · Cited by 19
2019 IEEE Hot Chips 31 Symposium (HCS)
(2019) · doi:10.1109/hcs47070.2019 · Cited by 18
2019 IEEE High Performance Extreme Computing Conference (HPEC)
(2019) · doi:10.1109/hpec43673.2019 · Cited by 18
Roudaia, L., & Speck, N. A. (2008) · Cancer Cell · doi:10.1016/j.ccr.2008.06.009 · Cited by 15
Low-Precision Batch-Normalized ActivationsPreprint
Graham, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08231 · Cited by 11
A Low-Power Arithmetic Element for Multi-Base Logarithmic Computation on Deep Neural Networks
Xu, J., Huan, Y., Zheng, L., & Zou, Z. (2018) · IEEE International System-on-Chip Conference (SOCC) · doi:10.1109/socc.2018.8618560 · Cited by 11
Compressing Deep Convolutional Networks Using K-means Based on Weights Distribution
Lei, W., Chen, H., & Wu, Y. (2017) · doi:10.1145/3144789.3144803 · Cited by 10
Towards Lower Bit Multiplication for Convolutional Neural Network Training.Preprint
Zhong, K., Zhao, T., Ning, X., Zeng, S., Guo, K., Wang, Y., & Yang, H. (2020) · arXiv (Cornell University) · Cited by 6
Heterogeneous Edge CNN Hardware Accelerator
Moudgill, M., Glossner, J., Huang, W., Tian, C., Xu, C., Yang, N., Wang, L., Liang, T., Shi, S., Zhang, X., et al. (2020) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp49889.2020.9299736 · Cited by 6
Self-citationExploiting Channel Similarity for Accelerating Deep Convolutional Neural NetworksPreprint
Zhang, Y., Zhao, C., Ni, B., Zhang, J., & Deng, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.02620 · Cited by 4
(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations
Hubara, I., Courbariaux, M., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1609.07061
Research works printed but not linked: 16
- Baskin, C., Schwartz, E., Zheltonozhskii, E., Liss, N., Giryes, R., Bronstein, A.M., Mendelson, A., 2018. UNIQ: Uniform Noise Injection for Non-Uniform Quantization of Neural Networks. arXiv preprint arXiv:1804.10969 http://arxiv.org/abs/1804.10969. · arXiv
- Chellapilla, K., Puri, S., Simard, P., 2006. High Performance Convolutional Neural Networks for Document Processing, in: Tenth International Workshop on Frontiers in Handwriting Recognition. https://hal.inria.fr/inria-00112631/, 10.1.1.137.482.
- Choi, 2008, Solving local minima problem with large number of hidden nodes on two-layered feed-forward artificial neural networks, Neurocomputing, 71, 3640, 10.1016/j.neucom.2008.04.004 · doi:10.1016/j.neucom.2008.04.004
- Cotofana, S., Vassiliadis, S., Logic, T., Addition, B., Addition, S., 1997. Low Weight and Fan-In Neural Networks for Basic Arithmetic Operations, in: 15th IMACS World Congress, pp. 227–232. 10.1.1.50.4450.
- Courbariaux, M., Bengio, Y., David, J.P., 2015. BinaryConnect: Training Deep Neural Networks with binary weights during propagations, in: Advances in Neural Information Processing Systems (NIPS), pp. 1–9. http://arxiv.org/abs/1511.00363, DOI: 10.5555/2969442.2969588. · arXiv · doi:10.5555/2969442.2969588
- Lei, J., Gao, X., Song, J., Wang, X.L., Song, M.L., 2018. Survey of Deep Neural Network Model Compression. Ruan Jian Xue Bao/Journal of Software 29, 251–266. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85049464636&doi=10.13328 10.13328/j.cnki.jos.005428. · doi:10.13328/j.cnki.jos.005428
- Li, M., Liu, Y.I., Liu, X., Sun, Q., You, X.I.N., Yang, H., Luan, Z., Gan, L., Yang, G., Qian, D., 2020a. The Deep Learning Compiler: A Comprehensive Survey. ArXiv preprint 1, 1–36. http://arxiv.org/abs/2002.03794. · arXiv
- Macchi, 1975, Coincidence Approach To Stochastic Point Process, Adv. Appl. Prob., 7, 83, 10.2307/1425855 · doi:10.2307/1425855
- Migacz, 2017, 8-bit inference with TensorRT, GPU Technology Conference, 2, 7
- Ouyang, J., Noh, M., Wang, Y., Qi, W., Ma, Y., Gu, C., Kim, S., Hong, K.i., Bae, W.K., Zhao, Z., Wang, J., Wu, P., Gong, X., Shi, J., Zhu, H., Du, X., 2020. Baidu Kunlun An AI processor for diversified workloads, in: 2020 IEEE Hot Chips 32 Symposium (HCS), IEEE. pp. 1–18. https://ieeexplore.ieee.org/document/9220641/, DOI: 10.1109/HCS49909.2020.9220641. · doi:10.1109/hcs49909.2020.9220641
- Rodriguez, 2018, Lower Numerical Precision Deep Learning Inference and Training, Intel White Paper, 1
- Ruffy, F., Chahal, K., 2019. The State of Knowledge Distillation for Classification. ArXiv preprint http://arxiv.org/abs/1912.10850. · arXiv
- Saad, 1990, Training Feed Forward Nets with Binary Weights Via a Modified CHIR Algorithm, Complex Systems, 4, 573
- Sabour, 2017, Dynamic routing between capsules, Advances in Neural Information Processing Systems (NIPS), 3857
- Singh, P., Kumar Verma, V., Rai, P., Namboodiri, V.P., 2019. Play and Prune: Adaptive Filter Pruning for Deep Model Compression, in: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, International Joint Conferences on Artificial Intelligence Organization, California. pp. 3460–3466. https://www.ijcai.org/proceedings/2019/480, 10.24963/ijcai.2019/480. · DOI
- Inc, 2018, Accelerating DNNs with Xilinx Alveo Accelerator Cards (WP504), White Paper, 504, 1
Cited by
A Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219
DepGraph: Towards Any Structural Pruning
Fang, G., Ma, X., Song, M., Bi Mi, M., & Wang, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01544 · Cited by 501
Structured Pruning for Deep Convolutional Neural Networks: A Survey
He, Y., & Xiao, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3334614 · Cited by 363
Multi-Modal 3D Object Detection in Autonomous Driving: A Survey and Taxonomy
Wang, L., Zhang, X., Song, Z., Bi, J., Zhang, G., Wei, H., Tang, L., Yang, L., Li, J., Jia, C., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3264658 · Cited by 269
Self-citationLightweight Deep Learning for Resource-Constrained Environments: A Survey
Liu, H.-I., Galindo, M., Xie, H., Wong, L.-K., Shuai, H.-H., Li, Y.-H., & Cheng, W.-H. (2024) · ACM Computing Surveys · doi:10.1145/3657282 · Cited by 259
Metadata
- Authors
- Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2021-10
- Volume
- 461
- Pages
- 370-403
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W3184606595
- Cited by
- 943
- References
- 246
- FWCI
- 49.47
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Natural Science Foundation of China
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.