The DOI matches its DataCite record; the references it cites are not checked yet.
Bit Efficient Quantization for Deep Neural Networks
Open accessAbstract
Quantization for deep neural networks have afforded models for edge devices that use less on-board memory and enable efficient low-power inference. In this paper, we present a comparison of model-parameter driven quantization approaches that can achieve as low as 3-bit precision without affecting accuracy. The post-training quantization approaches are data-free, and the resulting weight values are closely tied to the dataset distribution on which the model has converged to optimality. We show quantization results for a number of state-of-art deep neural networks (DNN) using large dataset like ImageNet. To better analyze quantization results, we describe the overall range and local sparsity of values afforded through various quantization schemes. We show the methods to lower bit-precision beyond quantization limits with object class clustering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Compared to YOLOv3-tiny [10], Gaussian YOLOv3-tiny [13], and Nayak et al. [41], the weight size of the proposed network is approximately one-third larger, but the mAP of the proposed network is much higher than that of YOLOv3-tiny [10], Gaussian YOLOv3-tiny [13], and Nayak et al. [41] by 21.42, 15.22, and 26.43, respectively.”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as [41]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
The citation lists haven’t been fetched yet
References 21 · Cited by 51
Research works printed but not linked: 19
- M.Wistuba, "A survey on neural architecture search", arXiv: 1905.01392, May 2019 · arXiv
- R. Krishnamoorthi, "Quantizing deep convolutional networks for efficient inference: A whitepaper," arXiv 1806:0842, June 2018
- S. Han, et al. "Learning both Weights and Connections for Efficient Neural Network." Advances in Neural Information Processing Systems. 2015.
- A. Graves, et. al., "Framewise phoneme classification with bidirectional LSTM and other neural network architectures," Neural Networks, 18(5):602-610, 2005.
- R. Collobert, et. al., "Natural language processing (almost) from scratch", JMLR, 12:2493-2537, 2011.
- Y. Guo, "A survey on methods and theories of quantized neural network", arXiv 1808.04752, Aug 2018 · arXiv
- M. Nagel, et. al., "Data-Free Quantization through Weight Equalization and Bias Correction", arXiv 1906.0472, June 2019
- A. Raghavan, et.al., "BitNet: Bit-Regularized Deep Neural Networks," arXiv 1708.04788, Aug 2017 · arXiv
- S. Parajuli, et.al., "Generalized Ternary Connect: End-to- End Learning and Compression of Multiplication-Free Deep Neural Networks," arXiv 1811.04985, Nov 2018 · arXiv
- S. Gupta, et.al., "Deep learning with limited numerical precision". In ICML 2015, pages 1737-1746, July 2015.
- B. Jacob, et. al., "Quantization and training of neural networks for efficient integer-arithmetic-only inference". CVPR 2018.
- A. Zhou, et.al., "Incremental network quantization: Towards lossless CNNs with low-precision weights". arXiv:1702.03044, 2017. · arXiv
- C. Louizos, et. al., "Relaxed quantization for discretized neural networks", ICLR 2019.
- T. Sheng, et. al. A quantization-friendly separable convolution for mobilenets. EMC2 workshop, 2018.
- S. Zhou, et. al., "Dorefa-net: Training low bitwidth convolutional neural networks with low bitwidth gradients." arXiv:1606.06160, 2016. · arXiv
- M. Courbariaux, et.al. "Binary Connect: Training deep neural networks with binary weights during propagations", NIPS'15, pp. 3123-3131, 2015.
- J. W. T. Peters and M. Welling, "Probabilistic binary neural networks", arXiv preprint arxiv:1809.03368, 2018. · arXiv
- M. Rastegari, et. al., "Xnor-net: Imagenet classification using binary convolutional neural networks", ECCV 2016.
- F. Li and B. Liu. "Ternary weight networks", arXiv: 1605.04711, 2016. · arXiv
Metadata
- Authors
- Nayak, P., Zhang, D., & Chai, S.
- Affiliations
- SRI International (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Pages
- 52-56
- arXiv
- 1910.04877
- OpenAlex
- W3176483701
- Cited by
- 51
- References
- 21
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 8 · 2023: 10 · 2022: 6 · 2021: 15 · 2020: 7
- FWCI
- 2.28
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- neural network quantization, low-bit precision, post-training quantization, data-free quantization, edge devices, low-power inference, weight sparsity, ImageNet, model compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bit Efficient Quantization for Deep Neural Networks. https://app.cochat.ai/papers/10.48550/arxiv.1910.04877
- The paper
- Nayak, P., Zhang, D., & Chai, S. (2019). Bit Efficient Quantization for Deep Neural Networks. arXiv. https://doi.org/10.48550/arxiv.1910.04877
