Fixed Point Quantization of Deep Convolutional Networks

Lin, Darryl D.; Talathi, Sachin S.; Annapureddy, V. Sreekanth

doi:10.48550/arxiv.1511.06393

PreprintCited by 684Advanced Neural Network ApplicationsNumerical Methods and AlgorithmsDomain Adaptation and Few-Shot Learning

Fixed Point Quantization of Deep Convolutional Networks

Open access

Lin, Darryl D., Talathi, Sachin S., Annapureddy, V. Sreekanth·2015·arXiv

DOI 10.48550/arxiv.1511.06393arXiv 1511.06393

Open this paper in CoChat — free account Open PDF

Abstract

In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in computation and model storage resources. Fixed point implementation of DCNs has the potential to alleviate some of these complexities and facilitate potential deployment on embedded hardware. In this paper, we propose a quantizer design for fixed point implementation of DCNs. We formulate and solve an optimization problem to identify optimal fixed point bit-width allocation across DCN layers. Our experiments show that in comparison to equal bit-width settings, the fixed point DCNs with optimized bit width allocation offer >20% reduction in the model size without any loss in accuracy on CIFAR-10 benchmark. We also demonstrate that fine-tuning can further enhance the accuracy of fixed point DCNs beyond that of the original floating point model. In doing so, we report a new state-of-the-art fixed point performance of 6.78% error-rate on CIFAR-10 benchmark.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1511.06393

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Lin et al. use SQNR to minimize fixed-point quantization error and mathematically assign bits to each layer, but mathematically minimizing errors does not necessarily lead to an accuracy reduction.
“Lin et al. [26] use the signal-to-quantization-noise ratio (SQNR) to ensure that the error resulting from the xed-point quantization is minimized and mathematically assign the bits to each layer for the xed-point quantization. However, mathematically minimizing errors does not necessarily lead to an accuracy reduction.”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as Lin et al. [26]

ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Convex Optimization
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601 · see citing works
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273 · see citing works
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · see citing works
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196 · see citing works
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335 · see citing works
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034 · see citing works
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680 · see citing works
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461 · see citing works
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · arXiv · doi:10.48550/arxiv.1502.02551 · Cited by 1,364 · see citing works
New types of deep neural network learning for speech recognition and related applications: an overview
Deng, L., Hinton, G. E., & Kingsbury, B. E. D. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6639344 · Cited by 1,222 · see citing works
Compressing Deep Convolutional Networks using Vector QuantizationPreprint
Gong, Y., Liu, L., Yang, M., & Bourdev, L. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6115 · Cited by 1,047 · see citing works
Compressing Neural Networks with the Hashing Trick
Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv · doi:10.48550/arxiv.1504.04788 · Cited by 974 · see citing works
Improving the speed of neural networks on CPUs
Vanhoucke, V., Senior, A., & Mao, M. (2011) · Cited by 662 · see citing works
CNN Features off-the-shelf: an Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · arXiv · doi:10.48550/arxiv.1403.6382 · Cited by 607 · see citing works
Visualizing and Understanding Convolutional Neural NetworksPreprint
Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · Cited by 440 · see citing works
Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and Standards
Shi, Y. Q., & Sun, H. (1999) · Thammasat University Digital Collections · Cited by 272 · see citing works
Neural Networks with Few MultiplicationsPreprint
Lin, Z., Courbariaux, M., Memisevic, R., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.03009 · Cited by 266 · see citing works
Fixed-point feedforward deep neural network design using weights +1, 0, and −1
Hwang, K., & Sung, W. (2014) · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · doi:10.1109/sips.2014.6986082 · Cited by 258 · see citing works
Fixed point optimization of deep convolutional neural networks for object recognition
Anwar, S., Hwang, K., & Sung, W. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178146 · Cited by 246 · see citing works
Overcoming Challenges in Fixed Point Training of Deep Convolutional NetworksPreprint
Lin, D. D., & Talathi, S. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02241 · Cited by 36 · see citing works
Self-citation
A Deep Neural Network Compression Pipeline: Pruning, Quantization, Huffman EncodingPreprint
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv (Cornell University) · Cited by 33 · see citing works
Audio Coding: Theory and Applications
You, Y. (2010) · Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) · doi:10.1007/978-1-4419-1754-6 · Cited by 14 · see citing works

Flagged first, then by citations

1 of the 26 references couldn’t be matched to a known paper.

Sorted by citations

Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · see citing works
“This topic has received a lot of attention in the broader ML community [194, 120, 436, 270, 312], but these methods either do not have a straightforward mapping to federated learning, or make the training process more complex which makes it difficult to adopt.”
Background
A Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219 · see citing works
“Speciﬁcally, the library leverages ﬁxed-point quantization [112, 151, 259] with power-of-two scaling factors so that quantization and dequantization processes can be carried out efﬁciently with bit shifting operations.”
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks
Zhang, D., Yang, J., Ye, D., & Hua, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_23 · Cited by 714 · see citing works
A comprehensive survey on model compression and acceleration
Choudhary, T., Mishra, V. K., Goswami, A., & Jagannathan, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09816-7 · Cited by 519 · see citing works
Deep Learning with Low Precision by Half-Wave Gaussian Quantization
Cai, Z., He, X., Sun, J., & Vasconcelos, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.574 · Cited by 498 · see citing works
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436 · see citing works
A High-Throughput and Power-Efficient FPGA Implementation of YOLO CNN for Object Detection
Nguyen, D. T., Nguyen, T. N., Kim, H., & Lee, H.-J. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2905242 · Cited by 435 · see citing works
Enabling Spike-Based Backpropagation for Training Deep Neural Network Architectures
Lee, C., Sarwar, S. S., Panda, P., Srinivasan, G., & Roy, K. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00119 · Cited by 435 · see citing works
Low-bit Quantization of Neural Networks for Efficient Inference
Choukroun, Y., Kravchik, E., Yang, F., & Kisilev, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00363 · Cited by 404 · see citing works
Bayesian Compression for Deep LearningPreprint
Louizos, C., Ullrich, K., & Welling, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08665 · Cited by 363 · see citing works
Point-Voxel CNN for Efficient 3D Deep LearningPreprint
Liu, Z., Tang, H., Lin, Y., & Han, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.03739 · Cited by 379 · see citing works
Triton: an intermediate language and compiler for tiled neural network computations
Tillet, P., Kung, H. T., & Cox, D. (2019) · Proceedings of the 3rd ACM SIGPLAN International Workshop on Machine Learning and Programming Languages · doi:10.1145/3315508.3329973 · Cited by 318 · see citing works
NullHop: A Flexible Convolutional Neural Network Accelerator Based on Sparse Representations of Feature Maps
Aimar, A., Mostafa, H., Calabrese, E., Ríos-Navarro, A., Tapiador-Morales, R., Lungu, I.-A., Milde, M. B., Corradi, F., Linares-Barranco, A., Liu, S., et al. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2852335 · Cited by 284 · see citing works
Extremely Low Bit Neural Network: Squeeze the Last Bit Out With ADMM
Leng, C., Dou, Z., Li, H., Shenghuo Zhu, B., & Jin, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11713 · Cited by 275 · see citing works
SparTen
Gondimalla, A., Chesnut, N., Thottethodi, M. S., & Vijaykumar, T. N. (2019) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3352460.3358291 · Cited by 278 · see citing works
C ir CNN
Ding, C., Liao, S., Wang, Y., Li, Z., Liu, N., Zhuo, Y., Wang, C., Qian, X., Bai, Y., Yuan, G., et al. (2017) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3123939.3124552 · Cited by 260 · see citing works
Knowledge distillation: A good teacher is patient and consistent
Beyer, L., Zhai, X., Royer, A., Markeeva, L., Anil, R., & Kolesnikov, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01065 · Cited by 259 · see citing works
YodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Andri, R., Cavigelli, L., Rossi, D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2682138 · Cited by 247 · see citing works
DeepSigns
Rouhani, B. D., Chen, H., & Koushanfar, F. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304051 · Cited by 246 · see citing works
Binarized convolutional landmark localizers for human pose estimation and face alignment with limited resources
Bulat, A., & Tzimiropoulos, G. (2017) · Nottingham ePrints (University of Nottingham) · Cited by 199 · see citing works
Design and Analysis of Uplink and Downlink Communications for Federated Learning
Zheng, S., Shen, C., & Chen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041388 · Cited by 191 · see citing works
Adaptive Quantization for Deep Neural Network
Zhou, Y., Moosavi-Dezfooli, S.-M., Cheung, N. M., & Pascal Frossard, B. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11623 · Cited by 187 · see citing works
Efficient and Effective Sparse LSTM on FPGA with Bank-Balanced Sparsity
Cao, S., Zhang, C., Yao, Z., Xiao, W., Nie, L., Zhan, D., Liu, Y., Wu, M., & Zhang, L. (2019) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3289602.3293898 · Cited by 184 · see citing works
Making AI Forget You: Data Deletion in Machine Learning
Ginart, A., Guan, M. Y., Valiant, G., & Zou, J. (2019) · arXiv · doi:10.48550/arxiv.1907.05012 · Cited by 175 · see citing works
Deep Neural Network Approximation for Custom Hardware
Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W. W., Cheung, P. Y. K., & Constantinides, G. A. (2019) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 166 · see citing works
XNOR-Net++: Improved Binary Neural Networks
Bulat, A., & Tzimiropoulos, G. (2019) · arXiv · doi:10.48550/arxiv.1909.13863 · Cited by 165 · see citing works
Post-training Piecewise Linear Quantization for Deep Neural Networks
Fang, J., Shafiee, A. R., Abdel-Aziz, H. A., Thorsley, D., Georgiadis, G., & Hassoun, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_5 · Cited by 165 · see citing works
Regularizing Activation Distribution for Training Binarized Deep Networks
Ding, R., Chin, T.-W., Liu, Z., & Marculescu, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01167 · Cited by 157 · see citing works
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit?
Zhu, S., Dong, X., & Su, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00506 · Cited by 153 · see citing works
Autonomous, Onboard Vision-Based Trash and Litter Detection in Low Altitude Aerial Images Collected by an Unmanned Aerial Vehicle
Kraft, M., Piechocki, M., Ptak, B., & Walas, K. (2021) · Remote Sensing · doi:10.3390/rs13050965 · Cited by 163 · see citing works
ADMM-NN
Ren, A., Zhang, T., Ye, S., Li, J., Xu, W., Qian, X., Lin, X., & Wang, Y. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304076 · Cited by 150 · see citing works
Packing Sparse Convolutional Neural Networks for Efficient Systolic Array Implementations
Kung, H. T., McDanel, B., & Zhang, S. Q. (2019) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3297858.3304028 · Cited by 146 · see citing works
Hierarchical Compression of Deep Convolutional Neural Networks on Large Scale Visual Recognition for Mobile Applications
Kim, B., Lee, M., Kim, J., Kim, J., & Lee, J. (2016) · Advanced science and technology letters · doi:10.14257/astl.2016.140.36 · Cited by 145 · see citing works
Efficient Hardware Architectures for Deep Convolutional Neural Network
Wang, J., Lin, J. T., & Wang, Z. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2017.2767204 · Cited by 145 · see citing works
Towards the Limit of Network Quantization
Choi, Y., El-Khamy, M., & Lee, J. (2016) · arXiv · doi:10.48550/arxiv.1612.01543 · Cited by 143 · see citing works
Quantization Friendly MobileNet (QF-MobileNet) Architecture for Vision Based Applications on Embedded Platforms
Kulkarni, U., Meena, S. M., Gurlahosur, S. V., & Bhogar, G. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.12.022 · Cited by 130 · see citing works
Effnet: An Efficient Structure for Convolutional Neural Networks
Freeman, I., Roese-Koerner, L., & Kummert, A. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451339 · Cited by 128 · see citing works
An Energy-Efficient FPGA-Based Deconvolutional Neural Networks Accelerator for Single Image Super-Resolution
Chang, J.-W., Kang, K.-W., & Kang, S. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2888898 · Cited by 126 · see citing works
Rethinking Differentiable Search for Mixed-Precision Neural Networks
Cai, Z., & Vasconcelos, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00242 · Cited by 119 · see citing works
Characterizing the deployment of deep neural networks on commercial edge devices
Hadidi, R., Cao, J., Xie, Y., Asgari, B., Krishna, T., & Kim, H. (2019) · 2019 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc47752.2019.9041955 · Cited by 118 · see citing works
Non-Structured DNN Weight Pruning—Is It Beneficial in Any Platform?
Ma, X., Lin, S., Ye, S., He, Z., Zhang, L., Yuan, G., Tan, S. H., Li, Z., Fan, D., Qian, X., et al. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3063265 · Cited by 116 · see citing works
Ristretto: Hardware-Oriented Approximation of Convolutional Neural NetworksPreprint
Gysel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06402 · Cited by 114 · see citing works
A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing
Véstias, M. P. (2019) · Algorithms · doi:10.3390/a12080154 · Cited by 112 · see citing works
FracBNN: Accurate and FPGA-Efficient Binary Neural Networks with Fractional Activations
Zhang, Y., Pan, J., Liu, X., Chen, H., Chen, D., & Zhang, Z. (2021) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3431920.3439296 · Cited by 112 · see citing works
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights
Dave, S., Baghdadi, R., Nowatzki, T., Avancha, S., Shrivastava, A., & Li, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3098483 · Cited by 110 · see citing works
Laconic deep learning inference acceleration
Sharify, S., Lascorz, A. D., Mahmoud, M., Nikolić, M., Siu, K., Stuart, D. M., Poulos, Z., & Moshovos, A. (2019) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3307650.3322255 · Cited by 111 · see citing works
Machine Learning in Resource-Scarce Embedded Systems, FPGAs, and End-Devices: A Survey
Branco, S., Ferreira, A. G., & Cabral, J. (2019) · Electronics · doi:10.3390/electronics8111289 · Cited by 110 · see citing works
Rethinking floating point for deep learningPreprint
Johnson, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01721 · Cited by 109 · see citing works
REQ-YOLO
Ding, C., Wang, S., Liu, N., Xu, K., Wang, Y., & Liang, Y. E. (2019) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3289602.3293904 · Cited by 107 · see citing works
Computation and Communication Efficient Federated Learning With Adaptive Model Pruning
Jiang, Z., Xu, Y., Xu, H., Wang, Z., Liu, J., Qian, C., & Qiao, C. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3247798 · Cited by 105 · see citing works
TBN: Convolutional Neural Network with Ternary Inputs and Binary Weights
Wan, D., Shen, F., Liu, L., Zhu, F., Qin, J., Shao, L., & Shen, H. T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_20 · Cited by 104 · see citing works
EDEN
Koppula, S., Orosa, L., Yağlıkçı, A. G., Azizi, R., Shahroodi, T., Kanellopoulos, K., & Mutlu, O. (2019) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3352460.3358280 · Cited by 104 · see citing works
A Real-Time Convolutional Neural Network for Super-Resolution on FPGA With Applications to 4K UHD 60 fps Video Services
Kim, Y., Choi, J.-S., & Kim, M. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2864321 · Cited by 100 · see citing works
PermDNN: Efficient Compressed DNN Architecture with Permuted Diagonal Matrices
Deng, C., Liao, S., Xie, Y., Parhi, K. K., Qian, X., & Yuan, B. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00024 · Cited by 100 · see citing works
Rotated Binary Neural NetworkPreprint
Lin, M., Ji, R., Xu, Z., Zhang, B., Wang, Y., Wu, Y., Huang, F., & Lin, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13055 · Cited by 109 · see citing works
Layer-Specific Optimization for Mixed Data Flow With Mixed Precision in FPGA Design for CNN-Based Object Detectors
Nguyen, D. T., Kim, H., & Lee, H. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3020569 · Cited by 98 · see citing works
BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression
Xin, J., Tang, R., Yu, Y., & Lin, J. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.8 · Cited by 98 · see citing works
Taurus: a data plane architecture for per-packet ML
Swamy, T., Rucker, A., Shahbaz, M., Gaur, I., & Olukotun, K. (2022) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3503222.3507726 · Cited by 98 · see citing works
From Hashing to CNNs: Training Binary Weight Networks via Hashing
Hu, Q., Wang, P., & Cheng, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11660 · Cited by 96 · see citing works
Universal Deep Neural Network Compression
Choi, Y., El‐Khamy, M., & Lee, J. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2975903 · Cited by 91 · see citing works
FedMP: Federated Learning through Adaptive Model Pruning in Heterogeneous Edge Computing
Jiang, Z., Xu, Y., Xu, H., Wang, Z., Qiao, C., & Zhao, Y. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00062 · Cited by 92 · see citing works
An Energy-Efficient Architecture for Binary Weight Convolutional Neural Networks
Wang, Y., Lin, J. T., & Wang, Z. (2017) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2017.2767624 · Cited by 88 · see citing works
A Survey and Taxonomy of FPGA-based Deep Learning Accelerators
Blaiech, A. G., Ben Khalifa, K., Valderrama, C., Fernandes, M. A. C., & Bedoui, M. H. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.01.007 · Cited by 88 · see citing works
Communication-Efficient Federated Learning via Optimal Client Sampling
Ribero, M., & Vikalo, H. (2020) · LatinX in AI at International Conference on Machine Learning (LXAI) · doi:10.52591/lxai2020071310 · Cited by 87 · see citing works
LookNN: Neural network with no multiplication
Samragh, M., Imani, M., Koushanfar, F., & Rosing, T. (2017) · Design, Automation, and Test in Europe · doi:10.23919/date.2017.7927280 · Cited by 86 · see citing works
Understanding and Overcoming the Challenges of Efficient Transformer Quantization
Bondarenko, Y., Nagel, M., & Blankevoort, T. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.627 · Cited by 92 · see citing works
Tiny Machine Learning for Resource-Constrained Microcontrollers
Immonen, R., & Hämäläinen, T. (2022) · Journal of Sensors · doi:10.1155/2022/7437023 · Cited by 85 · see citing works
Hashing Nets for Hashing: A Quantized Deep Learning to Hash Framework for Remote Sensing Image Retrieval
Li, P., Han, L., Tao, X., Zhang, X., Grecos, C., Plaza, A., & Ren, P. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2981997 · Cited by 84 · see citing works
Network Sketching: Exploiting Binary Structure in Deep CNNs
Guo, Y., Yao, A., Zhao, H., & Chen, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.430 · Cited by 81 · see citing works
Atomlayer
Qiao, X., Cao, X., Yang, H., Song, L., & Li, H. H. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3195970.3195998 · Cited by 80 · see citing works
The Effects of Approximate Multiplication on Convolutional Neural Networks
Kim, M. S., Barrio, A. A. D., Kim, H., & Bagherzadeh, N. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3050989 · Cited by 80 · see citing works
Applications and Techniques for Fast Machine Learning in Science
Deiana, A. M., Tran, N. V., Agar, J., Blott, M., Guglielmo, G. D., Duarte, J. M., Harris, P. C., Hauck, S., Liu, M., Neubauer, M. S., et al. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.787421 · Cited by 81 · see citing works
Improving Post Training Neural Quantization: Layer-wise Calibration and Integer ProgrammingPreprint
Hubara, I., Nahshan, Y., Hanani, Y., Banner, R., & Soudry, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10518 · Cited by 77 · see citing works
Analytical guarantees on numerical precision of deep neural networks
Sakr, C., Kim, Y., & Shanbhag, N. R. (2017) · Open Access System for Information Sharing (Pohang University of Science and Technology) · Cited by 76 · see citing works
E-RNN: Design Optimization for Efficient Recurrent Neural Networks in FPGAs
Li, Z., Ding, C., Wang, S., Wen, W., Zhuo, Y., Liu, C., Qiu, Q., Xu, W., Lin, X., Qian, X., et al. (2019) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2019.00028 · Cited by 75 · see citing works
Moving Deep Learning to the Edge
Véstias, M. P., Duarte, R. P., de Sousa, J. T., & Neto, H. C. (2020) · Algorithms · doi:10.3390/a13050125 · Cited by 76 · see citing works
Compact and Computationally Efficient Representation of Deep Neural Networks
Wiedemann, S., Müller, K., & Samek, W. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2910073 · Cited by 75 · see citing works
Video Foreground Extraction Using Multi-View Receptive Field and Encoder–Decoder DCNN for Traffic and Surveillance Applications
Akilan, T., Wu, Q. M. J., & Zhang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2937076 · Cited by 70 · see citing works
ProFlip: Targeted Trojan Attack with Progressive Bit Flips
Chen, H., Fu, C., Zhao, J., & Koushanfar, F. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00762 · Cited by 70 · see citing works
Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors
Kim, S., & Kim, H. (2021) · IEEE Access · doi:10.1109/access.2021.3054879 · Cited by 69 · see citing works
“Compared with the proposed method and Lin et al. [26], both studies allocate the same number of bits to weight and activation parameters, and the accuracy of the proposed method is 0.27% higher than that of Lin et al. [26].”
BackgroundMethodInfluential
Closed-Loop Neural Prostheses With On-Chip Intelligence: A Review and a Low-Latency Machine Learning Model for Brain State Detection
Zhu, B., Shin, U., & Shoaran, M. (2021) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2021.3112756 · Cited by 67 · see citing works
AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers
Faraone, J., Kumm, M., Hardieck, M., Zipf, P., Liu, X., Boland, D., & Leong, P. H. W. (2020) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2939429 · Cited by 66 · see citing works
Algorithm-Hardware Co-Design of Adaptive Floating-Point Encodings for Resilient Deep Learning Inference
Tambe, T., Yang, E.-Y., Wan, Z., Deng, Y., Reddi, V. J., Rush, A. M., Brooks, D. M., & Wei, G.-Y. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218516 · Cited by 66 · see citing works
Efficient Video Compression via Content-Adaptive Super-Resolution
Khani, M., Sivaraman, V., & Alizadeh, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00448 · Cited by 64 · see citing works
Searching for Low-Bit Weights in Quantized Neural Networks
Yang, Z., Wang, Y., Han, K., Xu, C., Xu, C., Tao, D., & Xu, C. (2020) · arXiv · doi:10.48550/arxiv.2009.08695 · Cited by 64 · see citing works
Dynamic Precision Analog Computing for Neural Networks
Garg, S., Lou, J., Jain, A., Guo, Z., Shastri, B. J., & Nahmias, M. A. (2022) · IEEE Journal of Selected Topics in Quantum Electronics · doi:10.1109/jstqe.2022.3218019 · Cited by 65 · see citing works
Towards resource-frugal deep convolutional neural networks for hyperspectral image segmentation
Nalepa, J., Antoniak, M., Myller, M., Lorenzo, P. R., & Marcinkiewicz, M. (2020) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2020.102994 · Cited by 62 · see citing works
Memory-Driven Mixed Low Precision Quantization For Enabling Deep Network Inference On MicrocontrollersPreprint
Rusci, M., Capotondi, A., & Luca Benini, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13082 · Cited by 62 · see citing works
Compact Recurrent Neural Networks for Acoustic Event Detection on Low-Energy Low-Complexity Platforms
Cerutti, G., Prasad, R., Brutti, A., & Farella, E. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2969775 · Cited by 61 · see citing works
Accelerating Convolutional Neural Networks via Activation Map Compression
Georgiadis, G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00725 · Cited by 58 · see citing works
Adaptive approximate computing in edge AI and IoT applications: A review
Damsgaard, H. J., Grenier, A., Katare, D., Taufique, Z., Shakibhamedan, S., Troccoli, T., Chatzitsompanis, G., Kanduri, A., Ometov, A., Ding, A. Y., et al. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103114 · Cited by 61 · see citing works
From Research to Production and Back: Ludicrously Fast Neural Machine Translation
Kim, Y. J., Junczys-Dowmunt, M., Hassan, H., Aji, A. F., Heafield, K., Grundkiewicz, R., & Bogoychev, N. (2019) · Workshop on Neural Generation and Translation (WNGT) · doi:10.18653/v1/d19-5632 · Cited by 56 · see citing works
AutoQ: Automated Kernel-Wise Neural Network QuantizationPreprint
Lou, Q., Guo, F., Liu, L., Kim, M., & Jiang, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.05690 · Cited by 56 · see citing works
Adaptive Data-Free Quantization
Qian, B., Wang, Y., Hong, R., & Wang, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00769 · Cited by 55 · see citing works
Adaptive and Energy-Efficient Architectures for Machine Learning: Challenges, Opportunities, and Research Roadmap
Shafique, M., Hafiz, R., Javed, M. U., Abbas, S., Sekanina, L., Vašíček, Z., & Mrázek, V. (2017) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2017.124 · Cited by 55 · see citing works
Error resilience analysis for systematically employing approximate computing in convolutional neural networks
Hanif, M. A., Hafiz, R., & Shafique, M. (2018) · Design, Automation, and Test in Europe · doi:10.23919/date.2018.8342139 · Cited by 55 · see citing works
Real-Time Video Inference on Edge Devices via Adaptive Model Streaming
Khani, M., Hamadanian, P., Nasr-Esfahany, A., & Alizadeh, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00453 · Cited by 55 · see citing works
AtomLayer: A Universal ReRAM-Based CNN Accelerator with Atomic Layer Computation
Qiao, X., Cao, X., Yang, H., Song, L., & Li, H. H. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.2018.8465832 · Cited by 54 · see citing works
Adaptive Loss-Aware Quantization for Multi-Bit Networks
Qu, Z., Zhou, Z., Cheng, Y., & Thiele, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00801 · Cited by 54 · see citing works
DarKnight: An Accelerated Framework for Privacy and Integrity Preserving Deep Learning Using Trusted Hardware
Hashemi, H., Wang, Y., & Annavaram, M. (2021) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3466752.3480112 · Cited by 53 · see citing works

Fixed-Point Quantization of Deep Convolutional Networks using Low-Precision Arithmetic for Efficient Computation
Mythile, C., Jaisiva, S., Arunadevi, A., & Sudhapriya, K. (2025) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc65190.2025.11140619
Fixed point optimization of deep convolutional neural networks for object recognition
Anwar, S., Hwang, K., & Sung, W. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178146 · Cited by 246 · see citing works
Quantization of deep convolutional networks
Huang, Y., Slot, C. D., & Yu, C. W. (2019) · International Conference on Image, Video Processing and Artificial Intelligence (IVPAI) · doi:10.1117/12.2549445
Fixed-point Quantization of Convolutional Neural Networks for Quantized Inference on Embedded PlatformsPreprint
Goyal, R., Vanschoren, J., van Acht, V., & Nijssen, S. (2021) · TU/e Research Portal · doi:10.48550/arxiv.2102.02147 · Cited by 22 · see citing works
IFQ-Net: Integrated Fixed-Point Quantization Networks for Embedded Vision
Gao, H., Tao, W., Wen, D., Chen, T.-W., Osa, K., & Kato, M. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00103 · Cited by 13 · see citing works

Authors: Lin, D. D., Talathi, S. S., & Annapureddy, V. S.
Affiliations: Qualcomm (United States) (US)
ORCID: Talathi, Sachin S.
Venue: arXiv
Publisher: arXiv
Published: 2015
Pages: 2849-2858
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1511.06393
arXiv: 1511.06393
OpenAlex: W2286365479
Cited by: 684
References: 26
Citations by year: 2026: 1 · 2025: 21 · 2024: 36 · 2023: 48 · 2022: 71 · 2021: 109 · 2020: 141 · 2019: 130 · 2018: 86 · 2017: 31 · 2016: 10
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
International Conference on Machine Learning
Topics: Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords: fixed-point quantization, deep convolutional neural networks, bit-width allocation, quantizer design, model size reduction, fine-tuning, CIFAR-10, image classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Fixed Point Quantization of Deep Convolutional Networks

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks