Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation
Open accessAbstract
Quantization techniques can reduce the size of Deep Neural Networks and improve inference latency and throughput by taking advantage of high throughput integer instructions. In this paper we review the mathematical aspects of quantization parameters and evaluate their choices on a wide range of neural network models for different application domains, including vision, speech, and language. We focus on quantization techniques that are amenable to acceleration by processors with high-throughput integer math pipelines. We also present a workflow for 8-bit quantization that is able to maintain accuracy within 1% of the floating-point baseline on all networks studied, including models that are more difficult to quantize, such as MobileNets and BERT-large.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Quantization reduces the computational and memory footprint of DNNs without significantly compromising model accuracy.
“This process enables efficient inference on resource-constrained hardware, such as edge devices and embedded systems, without significantly compromising model accuracy [36-38].”
From Fine-Grained Fault Sensitivity Analysis of Vision Transformers Under Soft Errors (2025) · cites this paper as [38]
The Introduction (p. 1) says lower-precision formats can increase computational throughput and reduce memory requirements, and the Conclusions (p. 13) report int8 accuracy within 1% of the floating-point baseline for all models studied. These passages support efficient inference with little accuracy loss, but they do not establish that the workflow was evaluated on edge devices or embedded systems. (LLM, conf=0.82)
Experimental — accuracy not yet measuredQAT provides better accuracy and more optimized networks in terms of bit-widths when training data are available.
“By leveraging the availability of training data, the QAT method provides better accuracy and more optimized networks in terms of bit-widths.”
From HADQ-Net: A Power-Efficient and Hardware-Adaptive Deep Convolutional Neural Network Translator Based on Quantization-Aware Training for Hardware Accelerators (2025) · cites this paper as [15]
Section 5.2 (p. 10) describes QAT as training or fine-tuning a network to adapt to quantization and reports improved accuracy over post-training quantization in most cases. The paper evaluates int8 quantization, but these passages do not show that QAT optimizes networks by selecting bit-widths; that part of the claim is unsupported. (LLM, conf=0.87)
Experimental — accuracy not yet measuredStarting from a pre-trained FP32 model is common and recommended practice in QAT, improving accuracy and reducing required iterations.
“It is common and recommended practice in the literature to start from a pre-trained FP32 model [12,15,17]. This approach not only improves accuracy but also reduces the number of required iterations.”
QAT generally yields higher accuracy than PTQ, particularly for lower bit-widths, when sufficient training data are available.
“While PTQ is simpler and more efficient, QAT generally yields higher accuracy, particularly for lower bit-widths, when sufficient training data are available [14,15].”
Percentile and KL divergence strategies are introduced to address the sensitivity of min/max clipping range to outliers.
“Percentile [36] and KL divergence [37] strategies are introduced to address this problem.”
From Model Quantization and Hardware Acceleration for Vision Transformers: A Comprehensive Survey (2024) · cites this paper as [37]
Clustering can help reduce information loss from quantization.
“In addition to rule-based and optimization-based nonuniform quantization, clustering can also be beneficial to alleviate the information loss due to quantization.”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [256]
Section 2 (p. 2) mentions nonuniform quantization and codebook lookup, but does not discuss clustering or say it reduces quantization-related information loss. Sections 5 and 5.1 (pp. 8–9) describe other ways to recover accuracy. Searches for clustering and cluster-based nonuniform quantization found no passage addressing the claim. (LLM, conf=0.72)
Experimental — accuracy not yet measuredProduct quantization divides the weight matrix into submatrices and applies vector quantization to each submatrix.
“Product quantization [74,227,256] is an extension of vector quantization, where the weight matrix is divided into submatrices and vector quantization is applied to each submatrix.”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [256]
Section 3.2 (pp. 4–5) discusses per-row, per-column, and per-tensor quantization, but does not describe product quantization or applying vector quantization to weight submatrices. Searches for product quantization, vector quantization, submatrices, and codebooks found no passage in our copy that addresses the claimed procedure. (LLM, conf=0.75)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Self-citationVaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473 · see citing works
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581 · see citing works
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755 · see citing works
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015 · see citing works
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072 · see citing works
TensorFlow: A system for large-scale machine learningPreprint
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.5555/3026877.3026899 · Cited by 16,369 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273 · see citing works
(2010) · International Conference on Machine Learning · Cited by 13,995 · see citing works
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465 · see citing works
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072 · see citing works
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319 · see citing works
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636 · see citing works
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · see citing works
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · see citing works
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00020 · Cited by 4,026 · see citing works
(1989) · neural information processing systems · Cited by 3,736 · see citing works
Gaussian Error Linear Units (GELUs)
Hendrycks, D., & Gimpel, K. (2016) · arXiv · doi:10.48550/arxiv.1606.08415 · Cited by 3,537 · see citing works
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335 · see citing works
Binarized Neural NetworksPreprint
Hubara, I., Soudry, D., & El-Yaniv, R. (2016) · arXiv.org · doi:10.48550/arxiv.1602.02505 · Cited by 2,241 · see citing works
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
Bengio, Y., Léonard, N., & Courville, A. (2013) · arXiv · doi:10.48550/arxiv.1308.3432 · Cited by 1,910 · see citing works
A set of level 3 basic linear algebra subprograms
Dongarra, J. J., Croz, J. D., Hammarling, S. J., & Duff, I. (1990) · ACM Transactions on Mathematical Software · doi:10.1145/77626.79170 · Cited by 1,822 · see citing works
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
Zhou, S., Wu, Y., Ni, Z., Zhou, X., Wen, H., & Zou, Y. (2016) · arXiv · doi:10.48550/arxiv.1606.06160 · Cited by 1,690 · see citing works
cuDNN: Efficient Primitives for Deep LearningPreprint
Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J. J., Catanzaro, B., & Shelhamer, E. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.0759 · Cited by 1,394 · see citing works
Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., Venkatesh, G., et al. (2017) · arXiv · doi:10.48550/arxiv.1710.03740 · Cited by 1,179 · see citing works
Self-citationZhu, C., Han, S., Mao, H., & Dally, W. J. (2016) · arXiv · doi:10.48550/arxiv.1612.01064 · Cited by 865 · see citing works
Bridging Nonlinearities and Stochastic Regularizers with Gaussian Error Linear UnitsPreprint
Hendrycks, D., & Gimpel, K. (2016) · arXiv (Cornell University) · Cited by 753 · see citing works
Quantizing deep convolutional networks for efficient inference: A whitepaper
Krishnamoorthi, R. (2018) · arXiv · doi:10.48550/arxiv.1806.08342 · Cited by 753 · see citing works
PACT: Parameterized Clipping Activation for Quantized Neural Networks
Choi, J., Wang, Z., Venkataramani, S., Chuang, P. I.-J., Srinivasan, V., & Gopalakrishnan, K. (2018) · arXiv · doi:10.48550/arxiv.1805.06085 · Cited by 703 · see citing works
Model compression via distillation and quantizationPreprint
Polino, A., Pascanu, R., & Alistarh, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05668 · Cited by 648 · see citing works
Three Factors Influencing Minima in SGDPreprint
Jastrzebski, S., Kenton, Z., Arpit, D., Ballas, N., Fischer, A., Bengio, Y., & Storkey, A. (2017) · arXiv.org · doi:10.48550/arxiv.1711.04623 · Cited by 560 · see citing works
Data-Free Quantization Through Weight Equalization and Bias Correction
Nagel, M., Baalen, M. V., Blankevoort, T., & Welling, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00141 · Cited by 500 · see citing works
Zafrir, O., Boudoukh, G., Izsak, P., & Wasserblat, M. (2019) · 2019 Fifth Workshop on Energy Efficient Machine Learning and Cognitive Computing - NeurIPS Edition (EMC2-NIPS) · doi:10.1109/emc2-nips53020.2019.00016 · Cited by 442 · see citing works
Training deep neural networks with low precision multiplications
Courbariaux, M., Bengio, Y., & David, J.-P. (2014) · arXiv · doi:10.48550/arxiv.1412.7024 · Cited by 407 · see citing works
Extremely Low Bit Neural Network: Squeeze the Last Bit Out With ADMM
Leng, C., Dou, Z., Li, H., Shenghuo Zhu, B., & Jin, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11713 · Cited by 275 · see citing works
Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy
Mishra, A., & Marr, D. (2017) · arXiv · doi:10.48550/arxiv.1711.05852 · Cited by 270 · see citing works
Baskin, C., Liss, N., Schwartz, E., Zheltonozhskii, E., Giryes, R., Bronstein, A. M., & Mendelson, A. (2019) · ACM Transactions on Computer Systems · doi:10.1145/3444943 · Cited by 140 · see citing works
Image Classification at Supercomputer ScalePreprint
Ying, C., Kumar, S., Chen, D., Wang, T., & Cheng, Y.-L. (2018) · arXiv.org · doi:10.48550/arxiv.1811.06992 · Cited by 133 · see citing works
Low precision storage for deep learningPreprint
Courbariaux, M., Bengio, Y., & David, J. (2014) · arXiv (Cornell University) · Cited by 120 · see citing works
Jain, S. R., Gural, A., Wu, M., & Dick, C. H. (2019) · arXiv · doi:10.48550/arxiv.1903.08066 · Cited by 115 · see citing works
Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation ModelPreprint
Bhandare, A., Sripathi, V., Karkada, D., Menon, V., Choi, S., Datta, K., & Saletore, V. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00532 · Cited by 106 · see citing works
SIMPLIFYING NEURAL NETS BY DISCOVERING FLAT MINIMA
Hochreiter, S., & Schmidhuber, J. (1994) · Cited by 92 · see citing works
Ternary Neural Networks with Fine-Grained QuantizationPreprint
Mellempudi, N., Kundu, A., Mudigere, D., Das, D., Kaul, B., & Dubey, P. K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.01462 · Cited by 89 · see citing works
Stochastic Gradient Methods with Layer-wise Adaptive Moments for Training of Deep NetworksPreprint
Ginsburg, B., Castonguay, P., Hrinchuk, O., Kuchaiev, O., Lavrukhin, V., Leary, R., Li, J., Nguyen, H., Zhang, Y., & Cohen, J. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11286 · Cited by 83 · see citing works
Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inference
McKinstry, J. L., Esser, S. K., Appuswamy, R., Bablani, D., Arthur, J. V., Yildiz, I. B., & Modha, D. S. (2018) · arXiv · doi:10.48550/arxiv.1809.04191 · Cited by 74 · see citing works
Rusci, M., Capotondi, A., & Luca Benini, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13082 · Cited by 62 · see citing works
Marian: Cost-effective High-Quality Neural Machine Translation in C++
Junczys-Dowmunt, M., Heafield, K., Hoang, H., Grundkiewicz, R., & Aue, A. (2018) · doi:10.18653/v1/w18-2716 · Cited by 52 · see citing works
Neural Network Distiller: A Python Package For DNN Compression Research
Zmora, N., Jacob, G., Zlotnik, L., Elharar, B., & Novik, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12232 · Cited by 51 · see citing works
Neural Network Compression Framework for Fast Model Inference
Kozlov, A., Lazarevich, I. A., Shamporov, V. A., Lyalyushkin, N., & Gorbachev, Y. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-80129-8_17 · Cited by 44 · see citing works
Retraining-Based Iterative Weight Quantization for Deep Neural NetworksPreprint
Lee, D., & Kim, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11233 · Cited by 11 · see citing works
(2011)
Flagged first, then by citations
2 of the 57 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- [2][2] Chaim Baskin, Eli Schwartz, Evgenii Zheltonozhskii, Natan Liss, Raja Giryes, Alex M Bronstein, and Avi Mendelson. Uniq: Uniform noise injection for non-uniform quantization of neural networks. arXiv preprint arXiv:1804.10969 , 2018. - · arXiv
- [8][8] Matthieu Courbariaux, Yoshua Bengio, and Jean-Pierre David. BinaryConnect: Training Deep Neural Networks with binary weights during propagations. NIPS , 28:3123-3131, 2015. -
- [13][13] Song Han, Huizi Mao, and William J Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 , 2015. - · arXiv
- [20][20] Benoit Jacob, Skirmantas Kligys, Bo Chen, Menglong Zhu, Matthew Tang, Andrew Howard, Hartwig Adam, and Dmitry Kalenichenko. Quantization and training of neural networks for efficient integer-arithmetic-only inference. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 2704-2713, 2018. -
- [27][27] Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems , pages 1097-1105, 2012. -
- [36][36] Szymon Migacz. Nvidia 8-bit inference width tensorrt. In GPU Technology Conference , 2017. -
Cited by
Sorted by citations
A Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219 · see citing works
“Symmetric quantization is widely adopted in practice for quantizing weights because zeroing out the zero point can lead to reduction in computational cost during inference [247], and also makes the implementation more straightforward.”
Pruning and quantization for deep neural network acceleration: A survey
Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 969 · see citing works
Self-citationKnowledge distillation: A good teacher is patient and consistent
Beyer, L., Zhai, X., Royer, A., Markeeva, L., Anil, R., & Kolesnikov, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01065 · Cited by 259 · see citing works
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240 · see citing works
Magalhães, S. A., de Castro, L. M. G., Moreira, G., dos Santos, F. N., Cunha, M., Dias, J. M. M., & Moreira, A. P. (2021) · Sensors · doi:10.3390/s21103569 · Cited by 193 · see citing works
Softermax: Hardware/Software Co-Design of an Efficient Softmax for Transformers
Stevens, J. R., Venkatesan, R., Dai, S., Khailany, B., & Raghunathan, A. (2021) · 2021 58th ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586134 · Cited by 148 · see citing works
I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference
Li, Z., & Gu, Q. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01565 · Cited by 141 · see citing works
“1(b), is highly desired in real-time applications [11, 23].”
BackgroundDegree-Quant: Quantization-Aware Training for Graph Neural NetworksPreprint
Tailor, S. A., Fernández-Marqués, J., & Lane, N. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05000 · Cited by 136 · see citing works
Deep learning in electron microscopy
Ede, J. M. (2020) · Machine Learning Science and Technology · doi:10.1088/2632-2153/abd614 · Cited by 105 · see citing works
Accelerating Sparse Deep Neural Networks
Mishra, A., Latorre, J. A., Pool, J., Stosic, D., Stosic, D., Venkatesh, G., Yu, C., & Micikevicius, P. (2021) · arXiv · doi:10.48550/arxiv.2104.08378 · Cited by 97 · see citing works
“After fine-tuning, the networks are quantized to INT8 using max calibration [41].”
MethodInfluentialSelf-citationAdvances in the Neural Network Quantization: A Comprehensive Review
Lu, W., Ma, Z., Yang, C., & Yao, Q. (2024) · Applied Sciences · doi:10.3390/app14177445 · Cited by 90 · see citing works
An Electro-Photonic System for Accelerating Deep Neural Networks
Demirkiran, C., Eris, F., Wang, G., Elmhurst, J., Moore, N., Harris, N. C., Basumallik, A., Reddi, V. J., Joshi, A., & Bunandar, D. (2023) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3606949 · Cited by 87 · see citing works
Wei, X., Zhang, Y., Li, Y., Zhang, X., Gong, R., Guo, J., & Liu, X. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.102 · Cited by 86 · see citing works
Self-citationBlockchain-Based Privacy Preservation Scheme for Misbehavior Detection in Lightweight IoMT Devices
Rahmadika, S., Astillo, P. V., Choudhary, G., Duguma, D. G., Sharma, V., & You, I. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3187037 · Cited by 80 · see citing works
FPGA-based Deep Learning Inference Accelerators: Where Are We Standing?
Nechi, A., Groth, L., Mulhem, S., Merchant, F., Buchty, R., & Bereković, M. (2023) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3613963 · Cited by 79 · see citing works
Differentiable Joint Pruning and Quantization for Hardware Efficiency
Wang, Y., Lu, Y., & Blankevoort, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_16 · Cited by 76 · see citing works
A Comprehensive Study on Quantization Techniques for Large Language Models
Lang, J., Guo, Z., & Huang, S. (2024) · International Conference on Artificial Intelligence, Robotics, and Communication (ICAIRC) · doi:10.1109/icairc64177.2024.10899941 · Cited by 66 · see citing works
Astillo, P. V., Duguma, D. G., Park, H., Kim, J., Kim, B., & You, I. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.10.023 · Cited by 63 · see citing works
A Survey of Domain-Specific Architectures for Reinforcement Learning
Rothmann, M., & Porrmann, M. (2022) · IEEE Access · doi:10.1109/access.2022.3146518 · Cited by 63 · see citing works
A 95.6-TOPS/W Deep Learning Inference Accelerator With Per-Vector Scaled 4-bit Quantization in 5 nm
Keller, B., Venkatesan, R., Dai, S. X., Tell, S. G., Zimmer, B., Sakr, C., Dally, W. J., Gray, C. T., & Khailany, B. (2023) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2023.3234893 · Cited by 61 · see citing works
Lee, J., Mukhanov, L., Molahosseini, A. S., Minhas, U. I., Yang, H., del Rincón, J. M., Dichev, K., Hong, C.-H., & Vandierendonck, H. (2023) · ACM Computing Surveys · doi:10.1145/3587095 · Cited by 55 · see citing works
Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety
Houben, S., Abrecht, S., Akila, M., Bär, A., Brockherde, F., Feifel, P., Fingscheidt, T., Gannamaneni, S. S., Ghobadi, S. E., Hammam, A., et al. (2022) · Springer eBooks · doi:10.1007/978-3-031-01233-4_1 · Cited by 52 · see citing works
SOLE: Hardware-Software Co-design of Softmax and LayerNorm for Efficient Transformer Inference
Wang, W., Zhou, S., Sun, W., Sun, P., & Liu, Y. (2023) · 2023 IEEE/ACM International Conference on Computer Aided Design (ICCAD) · doi:10.1109/iccad57390.2023.10323725 · Cited by 51 · see citing works
A survey of FPGA and ASIC designs for transformer inference acceleration and optimization
Kang, B. J., Lee, H. I., Yoon, S. K., Kim, Y. C., Jeong, S. B., Jeong, S. B., & Kim, H. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103247 · Cited by 51 · see citing works
Efficient Quantized Sparse Matrix Operations on Tensor Cores
Li, S., Osawa, K., & Hoefler, T. (2022) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41404.2022.00042 · Cited by 50 · see citing works
Andrulis, T., Emer, J., & Sze, V. (2023) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3579371.3589062 · Cited by 46 · see citing works
Coffee disease classification at the edge using deep learning
Yamashita, J. V. Y. B., & Leite, J. P. (2023) · Smart Agricultural Technology · doi:10.1016/j.atech.2023.100183 · Cited by 45 · see citing works
Jiang, G., & Chen, J. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106223 · Cited by 44 · see citing works
Towards smart pruning: ViNet, a deep-learning approach for grapevine structure estimation
Gentilhomme, T., Villamizar, M., Corre, J., & Odobez, J. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107736 · Cited by 42 · see citing works
Towards AI-Based Traffic Counting System with Edge Computing
Dinh, D.-L., Nguyen, H., Thai, H.-T., & Le, K.-H. (2021) · Journal of Advanced Transportation · doi:10.1155/2021/5551976 · Cited by 33 · see citing works
Ron, D. A., Freire, P. J., Prilepsky, J. E., Kamalian-Kopae, M., Napoli, A., & Turitsyn, S. K. (2022) · Scientific Reports · doi:10.1038/s41598-022-12563-0 · Cited by 39 · see citing works
VS-Quant: Per-vector Scaled Quantization for Accurate Low-Precision Neural Network InferencePreprint
Dai, S. X., Venkatesan, R., Ren, H. M., Zimmer, B., Dally, W. J., & Khailany, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04503 · Cited by 38 · see citing works
Dong, P., Zhuang, J., Yang, Z., Ji, S., Li, Y., Xu, D., Huang, H., Hu, J., Jones, A. K., Shi, Y., et al. (2024) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2024.3443692 · Cited by 35 · see citing works
“We can achieve a lower inference latency by quantization [32] and deploying the 8-bit integer (INT8) inference on U250 FPGA and A10G GPU.”
Safety assurance of Machine Learning for autonomous systems
Paterson, C., Hawkins, R., Picardi, C., Jia, Y., Călinescu, R., & Habli, I. (2025) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2025.111311 · Cited by 35 · see citing works
Reinforcement Learning for Datacenter Congestion Control
Tessler, C., Shpigelman, Y., Dalal, G., Mandelbaum, A., Kazakov, D. H., Fuhrer, B., Chechik, G., & Mannor, S. (2022) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/3512798.3512815 · Cited by 36 · see citing works
Prophet: Realizing a Predictable Real-time Perception Pipeline for Autonomous Vehicles
Liu, L., Dong, Z., Wang, Y., & Shi, W. (2022) · IEEE Real-Time Systems Symposium (RTSS) · doi:10.1109/rtss55097.2022.00034 · Cited by 34 · see citing works
Reggiani, E., Pappalardo, A., Doblas, M., Moretó, M., Olivieri, M., Ünsal, O., & Cristal, A. (2023) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca56546.2023.10071076 · Cited by 33 · see citing works
Boost Vision Transformer with GPU-Friendly Sparsity and Quantization
Yu, C., Chen, T., Gan, Z., & Fan, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02170 · Cited by 33 · see citing works
PTQ4SAM: Post-Training Quantization for Segment Anything
Lv, C., Chen, H., Guo, J., Guo, J., Guo, J., Ding, Y., Liu, X., Liu, X., & Liu, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01509 · Cited by 33 · see citing works
Hong, H., Choi, D., Kim, N. J., & Kim, H. (2024) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2024.3440884 · Cited by 32 · see citing works
Federated Learning for Human Activity Recognition: Overview, Advances, and Challenges
Aouedi, O., Sacco, A., Khan, L. U., Nguyen, D. C., & Guizani, M. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3484228 · Cited by 32 · see citing works
Improving the Efficiency of Transformers for Resource-Constrained Devices
Tabani, H., Balasubramaniam, A., Marzban, S., Arani, E., & Zonooz, B. (2021) · Euromicro Conference on Digital System Design (DSD) · doi:10.1109/dsd53832.2021.00074 · Cited by 32 · see citing works
Datta, G., Kundu, S., Jaiswal, A., & Beerel, P. A. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.815258 · Cited by 31 · see citing works
Deployment of Deep Neural Networks for Object Detection on Edge AI Devices with Runtime Optimization
Stacker, L., Fei, J., Heidenreich, P., Bonarens, F., Rambach, J., Stricker, D., & Stiller, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00118 · Cited by 29 · see citing works
Real-time face alignment: evaluation methods, training strategies and implementation optimization
Casado, C. Á., & López, M. B. (2021) · Journal of Real-Time Image Processing · doi:10.1007/s11554-021-01107-w · Cited by 28 · see citing works
Self-Attention-Assisted TinyML With Effective Representation for UWB NLOS Identification
Wu, Y., He, X., Mo, L., & Wang, Q. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3349462 · Cited by 26 · see citing works
Pareto-Optimal Quantized ResNet Is Mostly 4-bit
Abdolrashidi, A., Wang, L., Agrawal, S., Malmaud, J., Rybakov, O. J., Leichner, C., & Lew, Ł. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00345 · Cited by 26 · see citing works
LNS-Madam: Low-Precision Training in Logarithmic Number System Using Multiplicative Weight Update
Zhao, J., Dai, S. X., Venkatesan, R., Zimmer, B., Ali, M., Liu, M.-Y., Khailany, B., Dally, W. J., & Anandkumar, A. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3202747 · Cited by 25 · see citing works
Lee, J., Yu, M., Kwon, Y., & Kim, T. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.02.005 · Cited by 24 · see citing works
Edge Deployment of Deep Networks for Visual Detection: A Review
Zhai, H., Du, J., Ai, Y., & Hu, T. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3502539 · Cited by 23 · see citing works
Jeong, H., Han, S., Park, S., Kim, T. R., Bae, J., Jang, T., Cho, Y., Seo, S., Jeong, H.-J., Park, S., et al. (2025) · Nature Electronics · doi:10.1038/s41928-024-01318-6 · Cited by 23 · see citing works
Real-Time Compressed Sensing for Joint Hyperspectral Image Transmission and Restoration for CubeSat
Hsu, C., Jian, C.-Y., Tu, E.-S., Lee, C.-M., & Chen, G. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3378828 · Cited by 23 · see citing works
Gutiérrez‐Zaballa, J., Basterretxea, K., & Echanobe, J. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103242 · Cited by 23 · see citing works
Quantization via Distillation and Contrastive Learning
Pei, Z., Yao, X., Zhao, W., & Yu, B. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3300309 · Cited by 22 · see citing works
Bhalgaonkar, S., Munot, M. V., & Anuse, A. D. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109180 · Cited by 22 · see citing works
A Parametrizable High-Level Synthesis Library for Accelerating Neural Networks on FPGAs
Kalms, L., Rad, P. A., Ali, M. M., Iskander, A., & Göhringer, D. (2021) · Journal of Signal Processing Systems · doi:10.1007/s11265-021-01651-5 · Cited by 21 · see citing works
One-Shot Model for Mixed-Precision Quantization
Koryakovskiy, I., Yakovleva, A., Buchnev, V., Isaev, T., & ОДИНОКИХ, Г. А. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00767 · Cited by 21 · see citing works
A comprehensive review of lightweight deep learning models for edge computing with future directions
Lai, N., Dewi, D. A., Maidin, S. S., Xiao, W., Zhao, S., & Hu, Q. (2026) · Discover Computing · doi:10.1007/s10791-026-10021-3 · Cited by 20 · see citing works
TEA-S: A Tiny and Efficient Architecture for PLAC-Based Softmax in Transformers
Mei, Z., Dong, H., Wang, Y., & Pan, H. (2023) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2023.3265710 · Cited by 20 · see citing works
Developing a TinyML Image Classifier in an Hour
Berta, R., Dabbous, A., Lazzaroni, L., Pau, D. P., & Bellotti, F. (2024) · IEEE Open Journal of the Industrial Electronics Society · doi:10.1109/ojies.2024.3451959 · Cited by 20 · see citing works
4-Bit Quantization of LSTM-Based Speech Recognition Models
Fasoli, A., Chen, C., Serrano, M. J., Sun, X. N., Wang, N., Venkataramani, S., Saon, G., Cui, X., Kingsbury, B. E. D., Zhang, W., et al. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1962 · Cited by 20 · see citing works
Stateful Neural Networks for Intermittent Systems
Yen, C.-H., Mendis, H. R., Kuo, T., & Hsiu, P.-C. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3197513 · Cited by 19 · see citing works
Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production
Kim, Y. J., Henry, R., Fahim, R., & Hassan, H. (2022) · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · doi:10.18653/v1/2022.sustainlp-1.6 · Cited by 19 · see citing works
Accelerating Sparse DNNs Based on Tiled GEMM
Guo, C., Xue, F., Leng, J., Qiu, Y., Guan, Y., Cui, W., Chen, Q., & Guo, M. (2024) · IEEE Transactions on Computers · doi:10.1109/tc.2024.3365942 · Cited by 19 · see citing works
Kim, S., Hong, K., Kim, H., Kim, M., & Choi, W. Y. (2024) · Advanced Intelligent Systems · doi:10.1002/aisy.202300797 · Cited by 19 · see citing works
Musthafa, M. B., Huda, S., Nguyen, T. T., Kodera, Y., & Nogami, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3584373 · Cited by 18 · see citing works
Lee, J., Kwon, Y., Park, S., Yu, M., Park, J., & Song, H. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3403844 · Cited by 18 · see citing works
Real-Time Intrusion Detection and Prevention with Neural Network in Kernel Using eBPF
Zhang, J., Chen, P., He, Z., Chen, H., & Li, X. (2024) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn58291.2024.00048 · Cited by 18 · see citing works
Xiao, P., Zhang, C., Guo, Q. J., Xiao, X., & Wang, H. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3452321 · Cited by 18 · see citing works
Electronic Nose Pattern Recognition Engine: Design, Build, and Deployment
Sun, F., Wu, B., Jia, Y., Duan, S., & Hu, X. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3225535 · Cited by 17 · see citing works
Mirage: An RNS-Based Photonic Accelerator for DNN Training
Demirkiran, C., Yang, G., Bunandar, D., & Joshi, A. (2024) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca59077.2024.00016 · Cited by 17 · see citing works
Rehm, F., Vallecorsa, S., Saletore, V., Pabst, H., Chaibi, A., Codreanu, V., Borras, K., & Krücker, D. (2021) · International Conference on Pattern Recognition Applications and Methods · doi:10.5220/0010245002510258 · Cited by 17 · see citing works
QEST: Quantized and Efficient Scene Text Detector Using Deep Learning
Manjari, K., Verma, M., Singal, G., & Namasudra, S. (2022) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3526217 · Cited by 17 · see citing works
A survey of low-bit large language models: Basics, systems, and algorithms
Gong, R., Ding, Y., Wang, Z., Lv, C., Zheng, X., Du, J., Yong, Y., Gu, S., Qin, H., Guo, J., et al. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107856 · Cited by 16 · see citing works
Posit Process Element for Using in Energy-Efficient DNN Accelerators
Zolfagharinejad, M., Kamal, M., Afzali‐Kusha, A., & Pedram, M. (2022) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2022.3165510 · Cited by 16 · see citing works
Hara, T., & Sasabe, M. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110188 · Cited by 16 · see citing works
Adaptive Quantization Method for CNN with Computational-Complexity-Aware Regularization
Nakata, K., Miyashita, D., Deguchi, J., & Fujimoto, R. (2021) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas51556.2021.9401657 · Cited by 15 · see citing works
Alps: Adaptive Quantization of Deep Neural Networks with GeneraLized PositS
Langroudi, H. F., Karia, V., Carmichael, Z., Zyarah, A. M., Pandit, T., Gustafson, J. L., & Kudithipudi, D. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00346 · Cited by 15 · see citing works
Post-training quantization for re-parameterization via coarse & fine weight splitting
Yang, D., He, N., Hu, X., Yuan, Z., Yu, J., Xu, C., & Jiang, Z. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103065 · Cited by 14 · see citing works
Guella, F., Valpreda, E., Caon, M., Masera, G., & Martina, M. (2024) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2024.3365952 · Cited by 14 · see citing works
Quantizing YOLOv7: A Comprehensive Study
Baghbanbashi, M., Raji, M., & Ghavami, B. (2023) · International Computer Conference, Computer Society of Iran (CSICC) · doi:10.1109/csicc58665.2023.10105310 · Cited by 14 · see citing works
Intelligent Sensing Framework: Near-Sensor Machine Learning for Efficient Data Transmission
Huang, W. M., Rezvani, A., Chen, H., Ni, Y., Yun, S., Jeong, S., Zhang, G., & Imani, M. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3440988 · Cited by 14 · see citing works
Layer-Wise Data-Free CNN Compression
Horton, M., Jin, Y., Farhadi, A., & Rastegari, M. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956237 · Cited by 14 · see citing works
A High-Performance Accelerator for Super-Resolution Processing on Embedded GPU
Zhao, W., Bai, Y., Sun, Q. L., Li, W., Zheng, H., Jiang, N., Lu, J., Yu, B., & Wong, M. D. F. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3241110 · Cited by 13 · see citing works
Low-Precision Hardware Architectures Meet Recommendation Model Inference at Scale
Deng, Z., Park, J., Tang, P. T. P., Liu, H., Yang, J., Yuen, H., Huang, J., Khudia, D. S., Wei, X., Wen, E., et al. (2021) · IEEE Micro · doi:10.1109/mm.2021.3081981 · Cited by 12 · see citing works
Khurshid, S. S., Hussain, W., Zabit, U., & Bernal, O. D. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3251409 · Cited by 12 · see citing works
Efficient Transformer Inference with Statically Structured Sparse Attention
Dai, S. X., Genc, H., Venkatesan, R., & Khailany, B. (2023) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac56929.2023.10247993 · Cited by 12 · see citing works
FELARE: Fair Scheduling of Machine Learning Tasks on Heterogeneous Edge Systems
Mokhtari, A., Hossen, M. A., Jamshidi, P., & Salehi, M. A. (2022) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud55607.2022.00069 · Cited by 11 · see citing works
Answer Fast: Accelerating BERT on the Tensor Streaming Processor
Ahmed, I., Parmar, S., Boyd, M., Beidler, M., Kang, K., Liu, B., Roach, K., Kim, J., & Abts, D. (2022) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap54787.2022.00022 · Cited by 11 · see citing works
Shifting Capsule Networks from the Cloud to the Deep Edge
Costa, M., Costa, D. C., Gomes, T., & Pinto, S. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3544562 · Cited by 11 · see citing works
Wang, Z., Tian, S., Gao, H., & Guo, F. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3383488 · Cited by 10 · see citing works
Zhang, K., Wang, Y., Shi, S., Wang, Q., Wang, C., & Liu, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-74416-2 · Cited by 10 · see citing works
H2PIPE: High Throughput CNN Inference on FPGAs with High-Bandwidth Memory
Doumet, M., Stan, M., Hall, M., & Betz, V. (2024) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl64840.2024.00019 · Cited by 10 · see citing works
Almadan, A., & Rattani, A. (2023) · IEEE Access · doi:10.1109/access.2023.3265357 · Cited by 10 · see citing works
P4FL: An Architecture for Federating Learning With In-Network Processing
Sacco, A., Angi, A., Marchetto, G., & Esposito, F. (2023) · IEEE Access · doi:10.1109/access.2023.3318109 · Cited by 10 · see citing works
Park, J., Yoo, T., Lee, S., & Kim, T. (2023) · International Journal of Computers Communications & Control · doi:10.15837/ijccc.2023.5.5814 · Cited by 10 · see citing works
High-Level Design of Precision-Scalable DNN Accelerators Based on Sum-Together Multipliers
Urbinati, L., & Casu, M. R. (2024) · IEEE Access · doi:10.1109/access.2024.3380472 · Cited by 10 · see citing works
DoubleQExt: Hardware and Memory Efficient CNN Through Two Levels of Quantization
See, J., Ng, H., Tan, H., Chang, J.-J., Lee, W., & Hwang, S. O. (2021) · IEEE Access · doi:10.1109/access.2021.3138756 · Cited by 10 · see citing works
HPTQ: Hardware-Friendly Post Training QuantizationPreprint
Habi, H. V., Peretz, R., Cohen, E., Dikstein, L., Dror, O., Diamant, I., Jennings, R. H., & Netzer, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.09113 · Cited by 10 · see citing works
TensorRT Implementations of Model Quantization on Edge SoC
Zhou, Y., Guo, Z., Dong, Z., & Yang, K. (2023) · IEEE International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC) · doi:10.1109/mcsoc60832.2023.00078 · Cited by 9 · see citing works
- Authors
- Wu, H., Judd, P., Zhang, X., Isaev, M., & Micikevicius, P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2004.09602
- OpenAlex
- W3017746288
- Cited by
- 246
- References
- 57
- Citations by year
- 2026: 4 · 2025: 30 · 2024: 68 · 2023: 65 · 2022: 41 · 2021: 32 · 2020: 6
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- integer quantization, 8-bit quantization, deep neural network inference, quantization parameter, inference latency, model size reduction, MobileNet, BERT
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
