The DOI matches its DataCite record; 25 of the 26 references it cites were found in a registry or an index.
Fixed Point Quantization of Deep Convolutional Networks
Open accessAbstract
In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in computation and model storage resources. Fixed point implementation of DCNs has the potential to alleviate some of these complexities and facilitate potential deployment on embedded hardware. In this paper, we propose a quantizer design for fixed point implementation of DCNs. We formulate and solve an optimization problem to identify optimal fixed point bit-width allocation across DCN layers. Our experiments show that in comparison to equal bit-width settings, the fixed point DCNs with optimized bit width allocation offer >20% reduction in the model size without any loss in accuracy on CIFAR-10 benchmark. We also demonstrate that fine-tuning can further enhance the accuracy of fixed point DCNs beyond that of the original floating point model. In doing so, we report a new state-of-the-art fixed point performance of 6.78% error-rate on CIFAR-10 benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Lin et al. [26] use the signal-to-quantization-noise ratio (SQNR) to ensure that the error resulting from the xed-point quantization is minimized and mathematically assign the bits to each layer for the xed-point quantization. However, mathematically minimizing errors does not necessarily lead to an accuracy reduction.”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as Lin et al. [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Research works printed but not linked: 2
- Courbariaux, M., Bengio, Y., and David, J. Low precision arithmetic for deep learning. arXiv:1412.7024 , 2014. · arXiv
- Hinton, G., Vinyals, O., and Dean, J. Distilling knowledge in a neural network. In Proc. Deep Learning and Representation Learning NIPS Workshop , 2014.
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
“This topic has received a lot of attention in the broader ML community [194, 120, 436, 270, 312], but these methods either do not have a straightforward mapping to federated learning, or make the training process more complex which makes it difficult to adopt.”
BackgroundA Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219
“Specifically, the library leverages fixed-point quantization [112, 151, 259] with power-of-two scaling factors so that quantization and dequantization processes can be carried out efficiently with bit shifting operations.”
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks
Zhang, D., Yang, J., Ye, D., & Hua, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_23 · Cited by 714
A comprehensive survey on model compression and acceleration
Choudhary, T., Mishra, V. K., Goswami, A., & Jagannathan, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09816-7 · Cited by 555
Deep Learning with Low Precision by Half-Wave Gaussian Quantization
Cai, Z., He, X., Sun, J., & Vasconcelos, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.574 · Cited by 498
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
A High-Throughput and Power-Efficient FPGA Implementation of YOLO CNN for Object Detection
Nguyen, D. T., Nguyen, T. N., Kim, H., & Lee, H.-J. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2905242 · Cited by 435
Enabling Spike-Based Backpropagation for Training Deep Neural Network Architectures
Lee, C., Sarwar, S. S., Panda, P., Srinivasan, G., & Roy, K. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00119 · Cited by 449
Low-bit Quantization of Neural Networks for Efficient Inference
Choukroun, Y., Kravchik, E., Yang, F., & Kisilev, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00363 · Cited by 404
Bayesian Compression for Deep LearningPreprint
Louizos, C., Ullrich, K., & Welling, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08665 · Cited by 375
Point-Voxel CNN for Efficient 3D Deep LearningPreprint
Liu, Z., Tang, H., Lin, Y., & Han, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.03739 · Cited by 379
Triton: an intermediate language and compiler for tiled neural network computations
Tillet, P., Kung, H. T., & Cox, D. (2019) · Proceedings of the 3rd ACM SIGPLAN International Workshop on Machine Learning and Programming Languages · doi:10.1145/3315508.3329973 · Cited by 318
Aimar, A., Mostafa, H., Calabrese, E., Ríos-Navarro, A., Tapiador-Morales, R., Lungu, I.-A., Milde, M. B., Corradi, F., Linares-Barranco, A., Liu, S., et al. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2852335 · Cited by 289
Extremely Low Bit Neural Network: Squeeze the Last Bit Out With ADMM
Leng, C., Dou, Z., Li, H., Shenghuo Zhu, B., & Jin, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11713 · Cited by 275
Gondimalla, A., Chesnut, N., Thottethodi, M. S., & Vijaykumar, T. N. (2019) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3352460.3358291 · Cited by 289
Ding, C., Liao, S., Wang, Y., Li, Z., Liu, N., Zhuo, Y., Wang, C., Qian, X., Bai, Y., Yuan, G., et al. (2017) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3123939.3124552 · Cited by 259
Knowledge distillation: A good teacher is patient and consistent
Beyer, L., Zhai, X., Royer, A., Markeeva, L., Anil, R., & Kolesnikov, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01065 · Cited by 308
YodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Andri, R., Cavigelli, L., Rossi, D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2682138 · Cited by 247
Rouhani, B. D., Chen, H., & Koushanfar, F. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304051 · Cited by 261
Bulat, A., & Tzimiropoulos, G. (2017) · Nottingham ePrints (University of Nottingham) · Cited by 199
Design and Analysis of Uplink and Downlink Communications for Federated Learning
Zheng, S., Shen, C., & Chen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041388 · Cited by 191
Adaptive Quantization for Deep Neural Network
Zhou, Y., Moosavi-Dezfooli, S.-M., Cheung, N. M., & Frossard, P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11623 · Cited by 212
Efficient and Effective Sparse LSTM on FPGA with Bank-Balanced Sparsity
Cao, S., Zhang, C., Yao, Z., Xiao, W., Nie, L., Zhan, D., Liu, Y., Wu, M., & Zhang, L. (2019) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3289602.3293898 · Cited by 196
Making AI Forget You: Data Deletion in Machine Learning
Ginart, A., Guan, M. Y., Valiant, G., & Zou, J. (2019) · arXiv · doi:10.48550/arxiv.1907.05012 · Cited by 175
Deep Neural Network Approximation for Custom Hardware
Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W. W., Cheung, P. Y. K., & Constantinides, G. A. (2019) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 175
XNOR-Net++: Improved Binary Neural Networks
Bulat, A., & Tzimiropoulos, G. (2019) · arXiv · doi:10.48550/arxiv.1909.13863 · Cited by 165
Post-training Piecewise Linear Quantization for Deep Neural Networks
Fang, J., Shafiee, A. R., Abdel-Aziz, H. A., Thorsley, D., Georgiadis, G., & Hassoun, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_5 · Cited by 178
Regularizing Activation Distribution for Training Binarized Deep Networks
Ding, R., Chin, T.-W., Liu, Z., & Marculescu, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01167 · Cited by 157
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit?
Zhu, S., Dong, X., & Su, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00506 · Cited by 153
“Quantized and binary neural networks: People have found that there is no need to use full-precision parameters and activations and can still preserve the accuracy of a neural network using k-bit fixed point numbers, as stated by [19, 23, 61, 8, 40, 41, 48, 56, 49].”
BackgroundKraft, M., Piechocki, M., Ptak, B., & Walas, K. (2021) · Remote Sensing · doi:10.3390/rs13050965 · Cited by 163
Ren, A., Zhang, T., Ye, S., Li, J., Xu, W., Qian, X., Lin, X., & Wang, Y. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304076 · Cited by 158
Packing Sparse Convolutional Neural Networks for Efficient Systolic Array Implementations
Kung, H. T., McDanel, B., & Zhang, S. Q. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304028 · Cited by 147
Kim, B., Lee, M., Kim, J., Kim, J., & Lee, J. (2016) · Advanced science and technology letters · doi:10.14257/astl.2016.140.36 · Cited by 145
Efficient Hardware Architectures for Deep Convolutional Neural Network
Wang, J., Lin, J. T., & Wang, Z. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2017.2767204 · Cited by 148
Towards the Limit of Network Quantization
Choi, Y., El-Khamy, M., & Lee, J. (2016) · arXiv · doi:10.48550/arxiv.1612.01543 · Cited by 143
Kulkarni, U., Meena, S. M., Gurlahosur, S. V., & Bhogar, G. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.12.022 · Cited by 143
Effnet: An Efficient Structure for Convolutional Neural Networks
Freeman, I., Roese-Koerner, L., & Kummert, A. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451339 · Cited by 130
Chang, J.-W., Kang, K.-W., & Kang, S. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2888898 · Cited by 126
Rethinking Differentiable Search for Mixed-Precision Neural Networks
Cai, Z., & Vasconcelos, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00242 · Cited by 119
Characterizing the deployment of deep neural networks on commercial edge devices
Hadidi, R., Cao, J., Xie, Y., Asgari, B., Krishna, T., & Kim, H. (2019) · 2019 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc47752.2019.9041955 · Cited by 118
Non-Structured DNN Weight Pruning—Is It Beneficial in Any Platform?
Ma, X., Lin, S., Ye, S., He, Z., Zhang, L., Yuan, G., Tan, S. H., Li, Z., Fan, D., Qian, X., et al. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3063265 · Cited by 133
Ristretto: Hardware-Oriented Approximation of Convolutional Neural NetworksPreprint
Gysel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06402 · Cited by 132
A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing
Véstias, M. P. (2019) · Algorithms · doi:10.3390/a12080154 · Cited by 112
FracBNN: Accurate and FPGA-Efficient Binary Neural Networks with Fractional Activations
Zhang, Y., Pan, J., Liu, X., Chen, H., Chen, D., & Zhang, Z. (2021) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3431920.3439296 · Cited by 118
Dave, S., Baghdadi, R., Nowatzki, T., Avancha, S., Shrivastava, A., & Li, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3098483 · Cited by 120
Laconic deep learning inference acceleration
Sharify, S., Lascorz, A. D., Mahmoud, M., Nikolić, M., Siu, K., Stuart, D. M., Poulos, Z., & Moshovos, A. (2019) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3307650.3322255 · Cited by 116
Machine Learning in Resource-Scarce Embedded Systems, FPGAs, and End-Devices: A Survey
Branco, S., Ferreira, A. G., & Cabral, J. (2019) · Electronics · doi:10.3390/electronics8111289 · Cited by 110
Rethinking floating point for deep learningPreprint
Johnson, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01721 · Cited by 173
Ding, C., Wang, S., Liu, N., Xu, K., Wang, Y., & Liang, Y. E. (2019) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3289602.3293904 · Cited by 109
Computation and Communication Efficient Federated Learning With Adaptive Model Pruning
Jiang, Z., Xu, Y., Xu, H., Wang, Z., Liu, J., Qian, C., & Qiao, C. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3247798 · Cited by 117
TBN: Convolutional Neural Network with Ternary Inputs and Binary Weights
Wan, D., Shen, F., Liu, L., Zhu, F., Qin, J., Shao, L., & Shen, H. T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_20 · Cited by 105
Koppula, S., Orosa, L., Yağlıkçı, A. G., Azizi, R., Shahroodi, T., Kanellopoulos, K., & Mutlu, O. (2019) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3352460.3358280 · Cited by 110
Kim, Y., Choi, J.-S., & Kim, M. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2864321 · Cited by 100
PermDNN: Efficient Compressed DNN Architecture with Permuted Diagonal Matrices
Deng, C., Liao, S., Xie, Y., Parhi, K. K., Qian, X., & Yuan, B. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00024 · Cited by 102
Rotated Binary Neural NetworkPreprint
Lin, M., Ji, R., Xu, Z., Zhang, B., Wang, Y., Wu, Y., Huang, F., & Lin, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13055 · Cited by 112
Nguyen, D. T., Kim, H., & Lee, H. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3020569 · Cited by 98
BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression
Xin, J., Tang, R., Yu, Y., & Lin, J. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.8 · Cited by 112
Taurus: a data plane architecture for per-packet ML
Swamy, T., Rucker, A., Shahbaz, M., Gaur, I., & Olukotun, K. (2022) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3503222.3507726 · Cited by 117
From Hashing to CNNs: Training Binary Weight Networks via Hashing
Hu, Q., Wang, P., & Cheng, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11660 · Cited by 96
Universal Deep Neural Network Compression
Choi, Y., El‐Khamy, M., & Lee, J. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2975903 · Cited by 95
FedMP: Federated Learning through Adaptive Model Pruning in Heterogeneous Edge Computing
Jiang, Z., Xu, Y., Xu, H., Wang, Z., Qiao, C., & Zhao, Y. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00062 · Cited by 97
An Energy-Efficient Architecture for Binary Weight Convolutional Neural Networks
Wang, Y., Lin, J. T., & Wang, Z. (2017) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2017.2767624 · Cited by 88
A Survey and Taxonomy of FPGA-based Deep Learning Accelerators
Blaiech, A. G., Ben Khalifa, K., Valderrama, C., Fernandes, M. A. C., & Bedoui, M. H. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.01.007 · Cited by 88
Communication-Efficient Federated Learning via Optimal Client Sampling
Ribero, M., & Vikalo, H. (2020) · LatinX in AI at International Conference on Machine Learning (LXAI) · doi:10.52591/lxai2020071310 · Cited by 87
LookNN: Neural network with no multiplication
Samragh, M., Imani, M., Koushanfar, F., & Rosing, T. (2017) · Design, Automation, and Test in Europe · doi:10.23919/date.2017.7927280 · Cited by 88
Understanding and Overcoming the Challenges of Efficient Transformer Quantization
Bondarenko, Y., Nagel, M., & Blankevoort, T. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.627 · Cited by 172
Tiny Machine Learning for Resource-Constrained Microcontrollers
Immonen, R., & Hämäläinen, T. (2022) · Journal of Sensors · doi:10.1155/2022/7437023 · Cited by 85
Li, P., Han, L., Tao, X., Zhang, X., Grecos, C., Plaza, A., & Ren, P. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2981997 · Cited by 84
Network Sketching: Exploiting Binary Structure in Deep CNNs
Guo, Y., Yao, A., Zhao, H., & Chen, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.430 · Cited by 81
AtomLayer: A Universal ReRAM-Based CNN Accelerator with Atomic Layer Computation
Qiao, X., Cao, X., Yang, H., Song, L., & Li, H. H. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3195970.3195998 · Cited by 122
The Effects of Approximate Multiplication on Convolutional Neural Networks
Kim, M. S., Barrio, A. A. D., Kim, H., & Bagherzadeh, N. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3050989 · Cited by 91
Applications and Techniques for Fast Machine Learning in Science
Deiana, A. M., Tran, N. V., Agar, J., Blott, M., Guglielmo, G. D., Duarte, J. M., Harris, P. C., Hauck, S., Liu, M., Neubauer, M. S., et al. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.787421 · Cited by 104
Improving Post Training Neural Quantization: Layer-wise Calibration and Integer ProgrammingPreprint
Hubara, I., Nahshan, Y., Hanani, Y., Banner, R., & Soudry, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10518 · Cited by 166
Analytical guarantees on numerical precision of deep neural networks
Sakr, C., Kim, Y., & Shanbhag, N. R. (2017) · Open Access System for Information Sharing (Pohang University of Science and Technology) · Cited by 76
E-RNN: Design Optimization for Efficient Recurrent Neural Networks in FPGAs
Li, Z., Ding, C., Wang, S., Wen, W., Zhuo, Y., Liu, C., Qiu, Q., Xu, W., Lin, X., Qian, X., et al. (2019) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2019.00028 · Cited by 79
Moving Deep Learning to the Edge
Véstias, M. P., Duarte, R. P., de Sousa, J. T., & Neto, H. C. (2020) · Algorithms · doi:10.3390/a13050125 · Cited by 79
Compact and Computationally Efficient Representation of Deep Neural Networks
Wiedemann, S., Müller, K., & Samek, W. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2910073 · Cited by 79
Akilan, T., Wu, Q. M. J., & Zhang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2937076 · Cited by 70
ProFlip: Targeted Trojan Attack with Progressive Bit Flips
Chen, H., Fu, C., Zhao, J., & Koushanfar, F. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00762 · Cited by 76
Kim, S., & Kim, H. (2021) · IEEE Access · doi:10.1109/access.2021.3054879 · Cited by 71
“Compared with the proposed method and Lin et al. [26], both studies allocate the same number of bits to weight and activation parameters, and the accuracy of the proposed method is 0.27% higher than that of Lin et al. [26].”
BackgroundMethodInfluentialZhu, B., Shin, U., & Shoaran, M. (2021) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2021.3112756 · Cited by 67
AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers
Faraone, J., Kumm, M., Hardieck, M., Zipf, P., Liu, X., Boland, D., & Leong, P. H. W. (2020) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2939429 · Cited by 66
Tambe, T., Yang, E.-Y., Wan, Z., Deng, Y., Reddi, V. J., Rush, A. M., Brooks, D. M., & Wei, G.-Y. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218516 · Cited by 66
Efficient Video Compression via Content-Adaptive Super-Resolution
Khani, M., Sivaraman, V., & Alizadeh, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00448 · Cited by 64
Searching for Low-Bit Weights in Quantized Neural Networks
Yang, Z., Wang, Y., Han, K., Xu, C., Xu, C., Tao, D., & Xu, C. (2020) · arXiv · doi:10.48550/arxiv.2009.08695 · Cited by 64
Dynamic Precision Analog Computing for Neural Networks
Garg, S., Lou, J., Jain, A., Guo, Z., Shastri, B. J., & Nahmias, M. A. (2022) · IEEE Journal of Selected Topics in Quantum Electronics · doi:10.1109/jstqe.2022.3218019 · Cited by 71
Towards resource-frugal deep convolutional neural networks for hyperspectral image segmentation
Nalepa, J., Antoniak, M., Myller, M., Lorenzo, P. R., & Marcinkiewicz, M. (2020) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2020.102994 · Cited by 63
Rusci, M., Capotondi, A., & Benini, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13082 · Cited by 73
Cerutti, G., Prasad, R., Brutti, A., & Farella, E. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2969775 · Cited by 61
Accelerating Convolutional Neural Networks via Activation Map Compression
Georgiadis, G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00725 · Cited by 61
Adaptive approximate computing in edge AI and IoT applications: A review
Damsgaard, H. J., Grenier, A., Katare, D., Taufique, Z., Shakibhamedan, S., Troccoli, T., Chatzitsompanis, G., Kanduri, A., Ometov, A., Ding, A. Y., et al. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103114 · Cited by 61
From Research to Production and Back: Ludicrously Fast Neural Machine Translation
Kim, Y. J., Junczys-Dowmunt, M., Hassan, H., Aji, A. F., Heafield, K., Grundkiewicz, R., & Bogoychev, N. (2019) · Workshop on Neural Generation and Translation (WNGT) · doi:10.18653/v1/d19-5632 · Cited by 56
AutoQ: Automated Kernel-Wise Neural Network QuantizationPreprint
Lou, Q., Guo, F., Liu, L., Kim, M., & Jiang, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.05690 · Cited by 56
Adaptive Data-Free Quantization
Qian, B., Wang, Y., Hong, R., & Wang, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00769 · Cited by 59
Shafique, M., Hafiz, R., Javed, M. U., Abbas, S., Sekanina, L., Vašíček, Z., & Mrázek, V. (2017) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2017.124 · Cited by 55
Hanif, M. A., Hafiz, R., & Shafique, M. (2018) · Design, Automation, and Test in Europe · doi:10.23919/date.2018.8342139 · Cited by 55
Real-Time Video Inference on Edge Devices via Adaptive Model Streaming
Khani, M., Hamadanian, P., Nasr-Esfahany, A., & Alizadeh, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00453 · Cited by 59
Adaptive Loss-Aware Quantization for Multi-Bit Networks
Qu, Z., Zhou, Z., Cheng, Y., & Thiele, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00801 · Cited by 60
Hashemi, H., Wang, Y., & Annavaram, M. (2021) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3466752.3480112 · Cited by 57
A Reliability Study on CNNs for Critical Embedded Systems
Neggaz, M. A., Alouani, I., Lorenzo, P. R., & Niar, S. (2018) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd.2018.00077 · Cited by 56
Metadata
- Authors
- Lin, D. D., Talathi, S. S., & Annapureddy, V. S.
- Affiliations
- Qualcomm (United States) (US)
- ORCID
- Talathi, Sachin S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 2849-2858
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1511.06393
- OpenAlex
- W2286365479
- Cited by
- 684
- References
- 26
- Citations by year
- 2026: 1 · 2025: 21 · 2024: 36 · 2023: 48 · 2022: 71 · 2021: 109 · 2020: 141 · 2019: 130 · 2018: 86 · 2017: 31 · 2016: 10
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- fixed-point quantization, deep convolutional neural networks, bit-width allocation, quantizer design, model size reduction, fine-tuning, CIFAR-10, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
