The DOI matches its DataCite record; 25 of the 26 references it cites were found in a registry or an index.
Fixed Point Quantization of Deep Convolutional Networks
Open accessAbstract
In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in computation and model storage resources. Fixed point implementation of DCNs has the potential to alleviate some of these complexities and facilitate potential deployment on embedded hardware. In this paper, we propose a quantizer design for fixed point implementation of DCNs. We formulate and solve an optimization problem to identify optimal fixed point bit-width allocation across DCN layers. Our experiments show that in comparison to equal bit-width settings, the fixed point DCNs with optimized bit width allocation offer >20% reduction in the model size without any loss in accuracy on CIFAR-10 benchmark. We also demonstrate that fine-tuning can further enhance the accuracy of fixed point DCNs beyond that of the original floating point model. In doing so, we report a new state-of-the-art fixed point performance of 6.78% error-rate on CIFAR-10 benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Lin et al. [26] use the signal-to-quantization-noise ratio (SQNR) to ensure that the error resulting from the xed-point quantization is minimized and mathematically assign the bits to each layer for the xed-point quantization. However, mathematically minimizing errors does not necessarily lead to an accuracy reduction.”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as Lin et al. [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Research works printed but not linked: 2
- Courbariaux, M., Bengio, Y., and David, J. Low precision arithmetic for deep learning. arXiv:1412.7024 , 2014. · arXiv
- Hinton, G., Vinyals, O., and Dean, J. Distilling knowledge in a neural network. In Proc. Deep Learning and Representation Learning NIPS Workshop , 2014.
Cited by
Sorted by citations
Items 601–681 of 681
Efficient and Robust Machine Learning for Real-World SystemsPreprint
Pernkopf, F., Roth, W., Zoehrer, M., Pfeifenberger, L., Schindler, G., Froening, H., Tschiatschek, S., Peharz, R., Mattina, M., & Ghahramani, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02240 · Cited by 3
Learning In Practice: Reasoning About QuantizationPreprint
Cherkaev, A., Tai, W., Phillips, J. M., & Srikumar, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11478 · Cited by 1
Lee, K.-H., Jeong, J., & Bae, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06835 · Cited by 1
Irregularly Tabulated MLP for Fast Point Feature EmbeddingPreprint
Sekikawa, Y., & Suzuki, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09852 · Cited by 1
Reducing Inference Latency with Concurrent Architectures for Image RecognitionPreprint
Hadidi, R., Cao, J., Ryoo, M. S., & Kim, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07092 · Cited by 1
Robust error bounds for quantised and pruned neural networksPreprint
Li, J., Drummond, R., & Duncan, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.00138 · Cited by 1
DAQ: Distribution-Aware Quantization for Deep Image Super-Resolution NetworksPreprint
Hong, C., Kim, H., Oh, J., & Lee, K. M. (2020) · arXiv (Cornell University) · Cited by 1
Q-Rater: Non-Convex Optimization for Post-Training Uniform QuantizationPreprint
Kim, B., Lee, D., Ro, Y., Jeon, Y., Kwon, S. J., Park, B., & Oh, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.01868 · Cited by 1
KML: Using Machine Learning to Improve Storage SystemsPreprint
Akgun, I. U., Aydin, A. S., Burford, A., McNeill, M., Arkhangelskiy, M., Shaikh, A., Velikov, L., & Zadok, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.11554 · Cited by 1
Mobilenet model compression with ADMM training and mix-up
Li, Z. (2019) · doi:10.17760/d20317892 · Cited by 1
The Future of Brain-inspired Computing: A Survey on Large-scale Spiking Neural NetworksPreprint
Han, C., Zihan, R., & Xue, H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5166170 · Cited by 1
Randomization Boosts KV Caching, Learning Balances Query Load: A Joint Perspective
Wu, F., Silwal, S., Qiuyi, & Zhang (2026) · arXiv · doi:10.48550/arxiv.2601.18999
Dynamic and Adaptive Threshold for DNN Compression from Scratch
Jiang, C., Li, G., & Qian, C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68759-9_70
Storing and Compressing Video into Neural Networks by Overfitting
Egawa, H., & Shibata, Y. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-93659-8_56
ReRise: An Adversarial Example Restoration System for Neuromorphic Computing Security
Liu, C., Dong, Q., Yu, F., & Chen, X. (2018) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2018.00091
An Overview of Datatype Quantization Techniques for Convolutional Neural NetworksPreprint
Athar, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07530 · Cited by 3
Fundamentals and Literature Review
Huang, H., & Yu, H. (2018) · Computer architecture and design methodologies · doi:10.1007/978-981-13-3323-1_2
Multi-Precision Quantized Neural Networks via Encoding Decomposition of -1 and +1Preprint
Sun, Q., Shang, F., Yang, K., Li, X., Ren, Y., & Jiao, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13389
BitSplit-Net: Multi-bit Deep Neural Network with Bitwise Activation FunctionPreprint
Kim, H., Kim, Y., Ryu, S., & Kim, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09807 · Cited by 1
Progressive Stochastic Binarization of Deep Networks
Hartmann, D., & Wand, M. (2019) · Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2) · doi:10.1109/emc2-nips53020.2019.00015
Hryniowski, A., & Wong, A. K. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10901 · Cited by 1
Succinct Source Coding of Deep Neural Networks
Basu, S., & Varshney, L. R. (2018)
Compilers for Portable Programming of Heterogeneous Parallel & Approximate Computing Systems
Srivastava, P. (2019) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Low-Complexity LSTM Training and Inference with FloatSD8 Weight RepresentationPreprint
Liu, Y.-T., & Chiueh, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08450
EAGLE: Exploiting Essential Address in Both Weight and Activation to Accelerate CNN Computing
Liu, W., Wen, X., Lin, J. T., Wang, Z., & Du, L. (2019) · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · doi:10.1109/sips47522.2019.9020555
Efficient Implementations of Sparse and Quantized Deep Neural Networks Using Systolic Arrays
McDanel, B. (2019) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Joint Coreset Construction and Quantization for Distributed Machine LearningPreprint
Lu, H., Liu, C., Wang, S., He, T., Narayanan, V., Chan, K., & Pasteris, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.06652
Bio-inspired learning and hardware acceleration with emerging memories
Kulkarni, S. (2019)
High-performance and energy-efficient deep learning for resource-constrained devices
Ren, A. (2020) · Digital Repository Service (Northeastern University) · doi:10.17760/d20383685
Adaptive Structured Sparse Network for Efficient CNNs with Feature Regularization.Preprint
Tang, C., Sun, W., Yuan, Z., Wang, G., & Liu, Y. (2020) · arXiv (Cornell University)
Booster: An Accelerator for Gradient Boosting Decision TreesPreprint
He, M., Vijaykumar, T. N., & Thottethodi, M. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02022
When deep learning models on GPU can be accelerated by taking advantage of unstructured sparsityPreprint
Pietroń, M., & Żurek, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06295
Garofalo, A., Tagliavini, G., Conti, F., Luca Benini, C., & Rossi, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14325
Design and Analysis of Uplink and Downlink Communications for Federated LearningPreprint
Zheng, S., Shen, C., & Chen, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04057
Platform-specific model compression for deep neural networks with joint methods
Lin, S. (2020) · Digital Repository Service (Northeastern University) · doi:10.17760/d20398267
Kotsifakou, M. (2020) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Covolutional neural networks based on non-euclidean operators
Badawi, D. (2018) · Bilkent University Institutional Repository (Bilkent University)
Barrier-Free Large-Scale Sparse Tensor Accelerator (BARISTA) For Convolutional Neural NetworksPreprint
Gondimalla, A., Gundabolu, S. C., Vijaykumar, T. N., & Thottethodi, M. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08734 · Cited by 1
Recurrent Stacking of Layers in Neural Networks: An Application to Neural Machine TranslationPreprint
Dabre, R., & Fujita, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10002
Quantized Neural Networks via {-1, +1} Encoding Decomposition and AccelerationPreprint
Sun, Q., Li, X., Shang, F., Liu, H., Yang, K., Jiao, L., & Lin, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09886
Faster Math Functions, SoundlyPreprint
Briggs, I., & Panchekha, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05761
Smoothed Differential PrivacyPreprint
Liu, A., Wang, Y.-X., & Xia, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.01559
A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
Zheng, N., Lin, B., Zhang, Q., Ma, L., Yang, Y., Yang, F., Yang, M., & Zhou, L. (2021)
Niu, W., Li, Z., Ma, X., Dong, P., Zhou, G., Qian, X., Lin, X., Wang, Y., & Ren, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.11033
Optimizing Communication Data Streams in Edge Computing Systems Using Bayesian Algorithms
Larrakoetxea, N. G., Sanz, B., Pastor-López, I., García-Barruetabeña, J., & Bringas, P. G. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-87869-6_12
Cursor-based Adaptive Quantization for Deep Convolutional Neural Network
Li, B., Fan, Y., Pan, Z., Cheng, Z., & Zhang, G. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533578
Mixed-precision architecture for flexible neural network accelerators
Hafdi, D. (2019) · DSpace@MIT (Massachusetts Institute of Technology)
Krishnakumar, A., & Ogras, U. Y. (2021) · Embedded Software
Phantom: A High-Performance Computational Core for Sparse Convolutional Neural NetworksPreprint
Qureshi, M. A., & Munir, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.05002 · Cited by 1
Eo, M., Kang, S., & Rhee, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.15179
A Hierarchical and Reconfigurable Process Element Design for Quantized Neural Networks
Chen, Y., Hsu, C.-W., Chiang, H.-Y., Hsieh, T.-H., & Jou, J.-Y. (2021) · IEEE International System-on-Chip Conference (SOCC) · doi:10.1109/socc52499.2021.9739487
Dong, P. (2020) · doi:10.17760/d20382861
Neighborhood Graph Neural Networks under Random Perturbations and Quantization Errors
Saad, L. B., Nagendra, N. A., & Beferull‐Lozano, B. (2022) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc51304.2022.9834020
Fast convolutions leveraging pruning aware runtime code generation
Jayaweera, M. (2022) · doi:10.17760/d20449069
Bin-Specific Quantization in Spectral-Domain Convolutional Neural Network Accelerators
Park, J., Lee, J., Kim, G., & Bae, H. (2022) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas54282.2022.9869971
Convolutional Neural Network Accelerator for Compression Based on Simon k-means
Wei, M., Zhao, Y., Lu, J., Chen, X., Li, C., & Li, Z. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892097
Ma, X. (2022) · Digital Repository Service (Northeastern University) · doi:10.17760/d20467279
Operator Selection and Ordering in a Pipeline Approach to Efficiency Optimizations for Transformers
Xin, J., Tang, R., Jiang, Z., Yu, Y., & Lin, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.180
In-Cache Processing with Power-of-Two Quantization for Fast CNN Inference on CPUs
Woo, J., Lee, S., Kim, S., Byeon, G., & Hong, S. (2023) · International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC) · doi:10.1109/itc-cscc58803.2023.10212854
MobileFuse: Multimodal Image Fusion at the Edge
Perreault, H., Debaque, B., David, R., Drouin, M.-A., Duclos-Hindie, N., & Roy, S. (2023) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion52260.2023.10224104
Decoupling efficiency-performance optimization for modern neural networks
Jin, Q. (2023) · Digital Repository Service (Northeastern University) · doi:10.17760/d20592335
DiffQuant: Reducing Compression Difference for Neural Network Quantization
Zhang, M., Xu, J., Li, W., & Ning, X. (2023) · Electronics · doi:10.3390/electronics12244972
Chang, C.-Y., Huang, C.-T., Chuang, Y.-C., Chou, K.-C., & Wu, A.-Y. A. (2024) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac58780.2024.10473797
Towards resource-aware dialogue systems and sentiment analysis
Pandelea, V. (2024) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/173846
StyleWA: adaptive discriminator-based wavelet knowledge distillation
Li, R., & Bao, Y. (2024) · Journal of Electronic Imaging · doi:10.1117/1.jei.33.4.043019
Gupta, S., Ullah, S., & Kumar, A. (2024) · Euromicro Conference on Digital System Design (DSD) · doi:10.1109/dsd64264.2024.00072
Weight-Shifting Based Pruning for Convolutional Neural Networks
Threethanuchai, P., & Lursinsap, C. (2024) · International Computer Science and Engineering Conference · doi:10.1109/icsec62781.2024.10770739
SMCD: Privacy-preserving deep learning based malicious code detection
Mu, G., Zhang, H., Lin, J., & Kong, F. (2024) · Computers & Security · doi:10.1016/j.cose.2024.104226
Proposal and evaluation of recurrent neural network training by multi-phase quantization optimizer
Yamazaki, H., Akeno, I., Nobori, K., Asai, T., & Ando, K. (2024) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.16.30
Infrared domain adaptation with zero-shot quantization
sevsay, B., & Akagündüz, E. (2025) · International Conference on Machine Vision · doi:10.1117/12.3055067 · Cited by 1
Abdulghafoor, Y. S., Al-Neami, A. Q., & Hussein, A. F. (2025) · Al-Nahrain Journal for Engineering Sciences · doi:10.29194/njes.2801097
Stratified sampling: fast estimation of quantization effects on DNN
Quentin, M., Dardaillon, M., & Ménard, D. (2025) · IEEE International Symposium on Design and Diagnostics of Electronic Circuits & Systems (DDECS) · doi:10.1109/ddecs63720.2025.11006808
Energy-Efficient and Fault-Tolerant Spiking Neural NetworksPreprint
Li, J., Zhao, M., Gao, C., & Xue, H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5339085
Up or Down? Adaptive Rounding for Post-Training Quantization
Nagel, M., Amjad, R. A., van Baalen, M., Louizos, C., & Blankevoort, T. (2020) · arXiv · doi:10.48550/arxiv.2004.10568 · Cited by 252
Metadata
- Authors
- Lin, D. D., Talathi, S. S., & Annapureddy, V. S.
- Affiliations
- Qualcomm (United States) (US)
- ORCID
- Talathi, Sachin S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 2849-2858
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1511.06393
- OpenAlex
- W2286365479
- Cited by
- 684
- References
- 26
- Citations by year
- 2026: 1 · 2025: 21 · 2024: 36 · 2023: 48 · 2022: 71 · 2021: 109 · 2020: 141 · 2019: 130 · 2018: 86 · 2017: 31 · 2016: 10
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- fixed-point quantization, deep convolutional neural networks, bit-width allocation, quantizer design, model size reduction, fine-tuning, CIFAR-10, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
