Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation

Cited by (329)

Items 201–300 of 329

1. VFT: A versatile fine-tuning scheme based on feature distribution-aware knowledge distillation for lightweight convolutional neural networks
   Hyeonseok Hong, Hyun Kim · 2025 · Engineering Applications of Artificial Intelligence
2. Optimal Quantization using Scaled Codebook
   Yerlan Idelbayev, Pavlo A. Molchanov, Maying Shen, Hongxu Yin, Miguel Á. Carreira-Perpiñán, José Manuel Álvarez · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
3. Optimization of Object Detection CNN With Weight Quantization and Scale Factor Consolidation
   Ali A. Al-Hamid, Taehyeon Kim, TaeMi Park, HyungWon Kim · 2021 · IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia)
4. Effect of Weight Quantization on Learning Models by Typical Case Analysis
   Shuhei Kashiwamura, Ayaka Sakata, Masaaki Imaizumi · 2024 · IEEE International Symposium on Information Theory (ISIT)
5. LightDepth: A resource efficient depth estimation approach for dealing with ground truth sparsity via curriculum learning
   F. Karimi, Amir Mehrpanah, Reza Rawassizadeh · 2024 · Robotics and Autonomous Systems
6. FDCA: Fine-grained Digital-CIM based CNN Accelerator with Hybrid Quantization and Weight-Stationary Dataflow
   Bo Liu, Qingwen Wei, Yang Zhang, Xingyu Xu, Zihan Zou, Xinxiang Huang, Xin Si, Hao Cai · 2024 · ACM/IEEE Design Automation Conference (DAC)
7. Thinking in Granularity: Dynamic Quantization for Image Super-Resolution by Intriguing Multi-Granularity Clues
   Mingshen Wang, Zhao Zhang, Feng Li, Ke Xu, Kang Miao, Meng Wang · 2025 · Proceedings of the AAAI Conference on Artificial Intelligence
8. Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition
   Yoonjun Cho, Suhwan Kim, Dongjae Jeon, Kyelim Lee, Beomsoo Lee, Albert No · 2025 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
9. Shared knowledge distillation for robust multi‐scale super‐resolution networks
   Youngju Na, Hee Hyeon Kim, Seok Bong Yoo · 2022 · Electronics Letters
10. Neural Network Model Compression Algorithms for Image Classification in Embedded Systems
    Heejung Shin, Hyondong Oh · 2022 · The Journal of Korea Robotics Society
11. Channel-wise quantization without accuracy degradation using Δloss analysis
    Kazuki Okado, Kengo Matsumoto, Atsuki Inoue, Hiroshi Kawaguchi, Yasufumi Sakai · 2022 · International Conference on Machine Learning Technologies (ICMLT)
12. Quantization and Pipelined Hardware Implementation of Deep Neural Network Models
    El Hadrami Cheikh Tourad, Mohsine Eleuldj · 2022 · Journal of Computer Science
13. Research on Neural Network Post-Quantization Method for Ship Detection in SAR Images
    Penghao Xiao, Xiaojing Lin, Haipeng Wang · 2022 · IEEE International Geoscience and Remote Sensing Symposium (IGARSS)
14. On the Convergence of Stochastic Gradient Descent in Low-Precision Number Formats
    Matteo Cacciola, Antonio Frangioni, Masoud Asgharian, Alireza Ghaffari, Vahid Partovi Nia · 2023 · International Conference on Pattern Recognition Applications and Methods
15. Neural Networks with Quantization Constraints
    Ignacio Hounie, Juan Elenter, Alejandro Ribeiro · 2023 · IEEE International Conference on Acoustics Speech and Signal Processing
16. REM-CiM: Attentional RGB-Event Fusion Multi-Modal Analog CiM for Area/Energy-Efficient Edge Object Detection during Both Day and Night
    Yuya ICHIKAWA, Ayumu Yamada, Naoko Misawa, Chihiro Matsui, Ken TAKEUCHI · 2024 · IEICE Transactions on Electronics
17. GPQ: Greedy Partial Quantization of Convolutional Neural Networks Inspired by Submodular Optimization
    Satoki Tsuji, Fuyuka Yamada, Hiroshi Kawaguchi, Atsuki Inoue, Yasufumi Sakai · 2020 · International Conference on Soft Computing & Machine Intelligence (ISCMI)
18. A Hybrid Asymmetric Integer-Only Quantization Method of Neural Networks for Efficient Inference
    Wei Dong Lu, Zhong Ma, Yang Chaojie · 2022 · International Conference on Pattern Recognition and Artificial Intelligence (PRAI)
19. Empirical Evaluation of Deep Learning Model Compression Techniques on the WaveNet Vocoder
    Sam Davis, Giuseppe Coccia, Sam Gooch, Julian Mack · 2020 · arXiv (Cornell University)
20. Proceedings of the Third Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
    2022
21. An Investigation of Latency-Accuracy Trade-off in Inter-frame Video Prediction using Quantized CNNs
    T. De Silva, Pradeepa Yahampath · 2023 · Conference proceedings - Canadian Conference on Electrical and Computer Engineering
22. Convolutional Neural Network Post-Compression Evaluation with Explainable AI
    Recep Erol, Mariofanna G. Milanova · 2023 · Congress in Computer Science, Computer Engineering, and Applied Computing (CSCE)
23. SLA-Driven Performance Prediction for Co-Hosted DNNs
    Sarah Shah, Yasaman Amannejad, Diwakar Krishnamurthy · 2025 · IEEE/IFIP Network Operations and Management Symposium (NOMS)
24. Endoscopy-based IBD identification by a quantized deep learning pipeline
    Massimiliano Datres, Elisa Paolazzi, Marco Chierici, M. Pozzi, Antonio Colangelo, Marcello Dorian Donzella, Giuseppe Jurman · 2023 · BioData Mining
25. A Novel Hyperparameter Optimized Quantized MobileNet Architecture for Improving Diagnostic Accuracy in the Medical Image Classification
    Rupa Patel, Anita Chaware · 2023 · Communications in computer and information science
26. Energy-Efficient Object Detection: Impact of Weight Clustering for Different Arithmetic Representations
    Martí Caro, Jaume Abella · 2024 · Journal of Signal Processing Systems
27. Infer-HiRes: Accelerating Inference for High-Resolution Images with Quantization and Distributed Deep Learning
    Radha Gulhane, Quentin G. Anthony, Aamir Shafi, Hari Subramoni, Dhabaleswar K. DK Panda · 2024 · Practice and Experience in Advanced Research Computing
28. Q-MiniSAM2: A Quantization-based Benchmark for Resource-Efficient Video Segmentation
    Xuanxuan Ren, Xiangyu Li, Kun Wei, Xu Yang, Yanhua Yang · 2025 · International Joint Conference on Artificial Intelligence
29. Search-optimized quantization in biomedical ontology alignment
    Oussama Bouaggad, Natalia Grabar · 2025 · Frontiers in Artificial Intelligence
30. RockNet : Distributed Learning on Ultra-Low-Power Devices
    Alexander Gräfe, Fabian Mager, Marco Zimmerling, Sebastian Trimpe · 2025 · ACM Transactions on Cyber-Physical Systems
31. Performance Evaluation of AI and Traditional Techniques for Crack Detection on Concrete Structures
    Omer Abdalla, Ángel Encalada-Dávila, Mitterand Ekole · 2025 · World Journal of Science Technology and Sustainable Development
32. Azure-Lily: An FPGA Architecture with Analog IMC Engines for Efficient AI
    Archit Gajjar, Ruthwik Reddy Sunketa, Lei Zhao, Omar Eldash, Aishwarya Natarajan, Giacomo Pedretti, Aman Arora, Paolo Faraboschi, Jim Ignowski, Luca Buonanno · 2026 · ACM Transactions on Architecture and Code Optimization
33. Privacy-Preserving and Secure AI-based Stress Monitoring Federated Learning on Wearable Edge Devices Using Homomorphic Encryption
    Abdullah Ghanim Jaber* · 2026 · International Journal of Research and Innovation in Applied Science
34. A Lightweight Deep Learning Framework for Real-Time Brinjal Detection Under Field Conditions
    Abhishek Pandey, Pramod Kumar Sahoo, Tapan Kumar Khura, Dilip Kumar Kushwaha, Roaf Ahmad Parray, Jeetendra Kumar Ranjan, Md. Ashraful Haque, Susheel Kumar Sarkar, Rohit Bhojyareddy Gaddamwar, Nrusingh Charan Pradhan · 2026 · Automation
35. A generalized, outage period-aware CNN-BiLSTM architecture for real-world INS/GPS deployment under extended GNSS denials
    Khalid M. Nasr, Sherif Mostafa, Ali Maher, Ahmed Mohsen Kamel · 2026 · GPS Solutions
36. Non-Zero Grid for Accurate 2-Bit Additive Power-of-Two CNN Quantization
    Young Min Kim, KyungHyun Han, Wai‐Kong Lee, Hyung Jin Chang, Seong Oun Hwang · 2023 · IEEE Access
37. Cassava Disease Classification with Knowledge Distillation for use in Constrained Devices
    Shivaditya Shivganesh, Aakash Ambalavanan, C. Adittya, B. Radhika Selvamani · 2023 · International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE)
38. Metaheuristic based framework for Deep Neural Networks compression via DeepCABAC Arithmetic Coding and Fractional Filter
    Fekhr Eddine Keddous, Amir Nakib · 2023 · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum
39. Adaptive Scheduling for Edge-Assisted DNN Serving
    Jian He, Chenxi Yang, Zhaoyuan He, Ghufran Baig, Lili Qiu · 2023 · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS)
40. Implementing Quantization to Indonesian BERT Language Model
    M Abdurrahman, Samuel Cahyawijaya, Genta Indra Winata, Ayu Purwarianti · 2023 · International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA)
41. Relationship Between Semantic Segmentation Model and Additional Features for 3D Point Clouds Obtained from on-Vehicle LIDAR
    Hisato Hashimoto, Shuichi Enokida · 2024 · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP)
42. Deep learning and quantization for accurate and efficient multi-target radar inference of moving targets
    Nyasha Ernest Mashanda, Neil Watson, Robert John Berndt, Mohammed Yunus Abdul Gaffar · 2024 · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering
43. Accelerating CNN Inference with an Adaptive Quantization Method Using Computational Complexity-Aware Regularization
    Kengo Nakata, Daisuke Miyashita, Jun Deguchi, Ryuichi FUJIMOTO · 2024 · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences
44. Design Space Exploration of Semantic Segmentation CNN SalsaNext for Constrained Architectures
    Oliver Renke, Christoph Riggers, Jens Karrenbauer, Holger Blume · 2024 · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP)
45. Scalable Low-Complexity Implementation of Constant Matrix Multiplication Circuits
    Aymen-Alaeddine Zeghaida, Dinesh Daultani, J. M. Pierre Langlois, Jean‐Pierre David · 2024 · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS)
46. Q_YOLOv5m: A Quantization-based Approach for Accelerating Object Detection on Embedded Platforms
    Nizal Alshammry, Taoufik S. Saidani, Nasser S. Albalawi, Sami Mohammed Alenezi, Fahd Alhamazani, Sami Aziz Alshammari, Mohammed Aleinzi, Abdulaziz Alanazi, Mahmoud Salaheldin Elsayed · 2025 · Engineering Technology & Applied Science Research
47. FlexInt: A New Number Format for Robust Sub-8-Bit Neural Network Inference
    Minuk Hong, Hyeonuk Sim, Sugil Lee, Jongeun Lee · 2024
48. Advanced Knowledge Transfer: Refined Feature Distillation for Zero-Shot Quantization in Edge Computing
    Inpyo Hong, Youngwan Jo, Hyojeong Lee, Sunghyun Ahn, Sanghyun Park · 2025 · ACM Symposium on Applied Computing
49. eFAirWrite: Bringing energy efficient text entry to next generation smart devices
    Muhammad Mohsin Ghaffar, Ahmad Abdullah, Junaid Younas, Vladimir Rybalkin, Jonas Ney, Paul Lukowicz, Norbert Wehn · 2025 · Expert Systems with Applications
50. Distributed Model Serving: Latency-Accuracy Tradeoffs in Multi-Tenant Inference Systems
    Anjan Kumar Dash · 2025 · European Journal of Computer Science and Information Technology
51. Incremental Learning of Image Classification Models Over Low Data-Rate Networks
    Rakhat Khamitov, Amin Kargar, Malika Azamat, Marko Ristin, Brendan O’Flynn, Dimitrios Zorbas · 2025 · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT)
52. Quantization: how far should we go?
    Floran A. M. de Putter, Henk Corporaal · 2022 · Euromicro Conference on Digital System Design (DSD)
53. Proceedings of the 9th ACM Cyber-Physical System Security Workshop
    2023
54. Randomization Boosts KV Caching, Learning Balances Query Load: A Joint Perspective
    Wu, Fangzhou, Silwal, Sandeep, Qiuyi, Zhang · 2026 · arXiv
55. 4-bit Quantization of LSTM-based Speech Recognition Models
    Andrea Fasoli, Chia‐Yu Chen, Mauricio J. Serrano, Xiao Ning Sun, Naigang Wang, Swagath Venkataramani, George Saon, Xiaodong Cui, Brian E. D. Kingsbury, Zhang, Wei et al. · 2021 · arXiv (Cornell University)
56. New Students on Sesame Street: What Order-Aware Matrix Embeddings Can Learn from BERT.
    Lukas Paul Achatius Galke, Isabelle Cuber, Christoph F. J. Meyer, Henrik Ferdinand Nölscher, Angelina Sonderecker, Ansgar Scherp · 2021 · arXiv (Cornell University)
57. Optimization of Convolutional Neural Networks for Constrained Devices through Binarization
    Kaveh Rouhandeh · 2022
58. Background in ML Models and Radiation Effects
    Geancarlo Abich, Luciano Copello Ost, Ricardo A. L. Reis · 2023 · Synthesis lectures on engineering, science, and technology
59. Deep learning acceleration: from quantization to in-memory computing
    Zhu, Shien · 2022
60. Representation Learning for Texts and Graphs
    Lukas Paul Achatius Galke · 2023
61. ERODE: Error Resilient Object DetEction by Recovering Bounding Box and Class Information
    Emanuele Valpreda, Giuseppe Palumbo, Michele Caon, Guido Masera, Maurizio Martina · 2023 · Conference on Ph.D. Research in Microelectronics and Electronics
62. Bitrate-Performance Optimized Model Training for the Neural Network Coding (NNC) Standard
    Paul Haase, Jonathan Pfaff, Heiko Schwarz, Detlev Marpe, Thomas Wiegand · 2023 · Proceedings - International Conference on Image Processing
63. MINA: Multi-Input Network Augmentation for Enhancing Tiny Deep Learning
    Seokhyeon Ha, Yeongmo Kim, Jungwoo Lee · 2023 · IEEE Access
64. Decoupling efficiency-performance optimization for modern neural networks
    Qing Jin · 2023
65. Optimizing MobileNet Algorithms for Real-time Vessel Detection on Smartphones
    Lars Gjesteby, Ellie Haber, Shoyo Hakozaki, Alec Xu, Nancy DeLosa, Benjamin W. Roop, Joshua S. Werblin, Brian A. Telfer, Laura J. Brattain · 2023 · Wearable and Implantable Body Sensor Networks
66. Photonic Accelerators for Image Segmentation in Autonomous Driving and Defect Detection
    Lakshmi Nair, David Peter Widemann, Brad Turcott, Nick Moore, Alexandra Wleklinski, Darius Bunandar, Ioannis Papavasileiou, Shihu Wang, Eric Logan · 2023 · IEEE High Performance Extreme Computing Conference
67. Implementation and Performance Analysis of Mixed Precision-based CNN Inference
    Jong-Eun Lee, Kyung-Bin Jang, Seung‐Ho Lim · 2023 · The Journal of Korean Institute of Information Technology
68. Development of Parameter Bit Operation Framework for Deep Neural Networks
    Dong‐In Lee, Jung-Heon Kim, Seung‐Ho Lim · 2024 · International Conference on Consumer Electronics
69. A Novel Throughput Enhancement Method for Deep Learning Applications on Mobile Devices With Heterogeneous Processors
    Choonghoon Park, Soonhoi Ha · 2024 · IEEE Access
70. Efficient hardware acceleration of deep neural networks via arithmetic complexity reduction
    Enrico Reggiani · 2023
71. A Fully Embedded AI System for the Detection of Soft Falls Using Accelerometer Data in Real Time
    Gamaliel Percino, Annie Bourgeais, Alexandre Fenneteau, Vincent Pitard · 2023 · International Conference on Computer Technology and Development
72. Low-Complexity Vision Transformer with Adaptive Channel Partitioning Method
    Seyoung Lee, Sang-Soo Oh, Sang-Hyun Han, Seunghwan Lim, Jongseok Lee, Donggyu Sim · 2024 · Journal of Broadcast Engineering
73. Post-training quantization of CNN accelerator with mixed precision floating-point arithmetic selection based on a genetic algorithm
    Muhammad Junaid, Shoaib Sajid, Hayotjon Aliev, HyungWon Kim · 2026 · Array
74. Ultra-Tiny Quantized Neural Networks for Piezo Pressure Sensors
    Danilo Pietro Pau, Welid Ben Yahmed, Stefano Bosco, Gian Domenico Licciardo, Santo Pennino, Paola Vitolo · 2024 · Smart Systems Integration Conference and Exhibition (SSI)
75. Designing Quantizers for Low-Precision Post-Training Quantization: A Standard Pipeline Approach for CNNs
    Yang Xiao, Fei Chao · 2024 · International Conference on Cyber Security and Information Engineering (ICCSIE)
76. ML MODELS AND OPTIMIZATION STRATEGIES FOR ENHANCING THE PERFORMANCE OF CLASSIFICATION ON MOBILE DEVICES
    V. Ya. Chornenkyi, Iryna Kazymyra · 2024 · Ukrainian Journal of Information Technology
77. Quantization Technology for Neural Network Models with Complex Branching Structures
    Yang Yu, Wei Lu, Zhong Ma, Chaojie Yang, Yuejiao Wang · 2024 · International Conference on Pattern Recognition and Artificial Intelligence (PRAI)
78. An End-to-End Flow to Deploy and Accelerate TinyML Mixed-Precision Models on RISC-V MCUs
    Edward Manca, Luca Urbinati, Mario R. Casu · 2025
79. Effective Method with Compression for Distributed and Federated Cocoercive Variational Inequalities
    Daniil Olegovich Medyakov, Gleb L'vovich Molodtsov, Aleksandr Nikolaevich Beznosikov · 2024 · Proceedings of the Institute for System Programming of RAS
80. Towards Efficient Capsule Networks Through Approximate Squash Function and Layer-Wise Quantization
    Mohsen Raji, Kimia Soroush, Amir Ghazizadeh · 2024 · International Conference on Computer and Knowledge Engineering
81. Improving INT Inference Resilience of CNNs by Vulnerability-Aware Mixed-Precision Quantization
    Xiaohui Wei, Peng Liu, Chenyang Wang, Zeyu Guan, Qi Wu, Hengshan Yue · 2024 · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA)
82. Compress YOLOv5 via Convolution Filters Reconstruction for the Application in Smart City Governance
    Shiyong Wang, Yang Wang, Weichao Lan, Yingjie Yang, Chao Xin, Yue Yu, Chengcheng Ma · 2025 · International Conference on Computer Research and Development
83. Quantized Neural Networks for Ball Detection on the NAO Robot: An Optimized Implementation
    Felix Thielke · 2025 · Lecture notes in computer science
84. Quantization of Tiny MLP-Mixer and Its Evaluation
    Ryo Kumagai, Shu Takemoto, Yusuke Nozaki, 雅弥 吉川 · 2025 · International Conference on Computer and Automation Engineering
85. Advancing multi-class object detection from LEO/VLEO: model evaluation and onboard deployment tailored for a 16U CubeSat
    Bharadwaj Chintalapati, Aras Jafari, René Laufer, Marcus Liwicki, Jens Eickhoff · 2026 · CEAS Space Journal
86. Hardware-Compatible U-Net for Low-Dose PET Reconstruction
    Eric-Khang Dao, Katherine Zukotynski, Sandra E. Black, Vincent Gaudet · 2025 · IEEE International Symposium on Multiple-Valued Logic (ISMVL)
87. An End-to-End Flow to Deploy and Accelerate TinyML Mixed-Precision Models on RISC-V MCUs
    Edward Manca, Luca Urbinati, Mario R. Casu · 2025
88. Single Spike Artificial Neural Networks
    Rhys Gretsch, Michael J. Beyeler, Jeremy Lau, Timothy Sherwood · 2025 · Proceedings - International Symposium on Computer Architecture/Proceedings
89. Accelerated CNN-based Scans for Traces of Positive Selection
    Sjoerd van den Belt, Nikolaos Alachiotis · 2025 · Platform for Advanced Scientific Computing Conference (PASC)
90. Distributed Acoustic Mixture-of-Experts for Spatial Sound Estimation
    Gioele Greco, Gioele Greco, Dongzhe Zhang, Mirco Pezzoli, Fabio Antonacci · 2026 · IEEE Open Journal of Signal Processing
91. Activation and Weight Distribution Balancing for Optimal Post-Training Quantization in Learned Image Compression
    Jie Yu, Songping Mai, Peng Zhang, Yucheng Jiang, Jian Jun Cheng · 2025 · ACM International Conference on Multimedia (ACM MM)
92. Driver Pattern Recognition Using ML Quantization and Tabular Cloning Approach
    Mohamed H. Al-Meer · 2025 · International Journal of Automotive Science And Technology
93. Avaliação da quantização de modelos visuais de linguagem para implantação em ambiente hospitalar
    Rafael Scalabrin Dosso, Diedre Santos do Carmo, Letícia Rittner · 2025 · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)
94. Choice of component bit width for nonlinear neuron implementation on FPGA
    Oleg G. Bondar, Брежнева Екатерина Олеговна, D. A. Golubev · 2026 · Proceedings of Southwest State University
95. Mixed-precision Interpolative Decomposition on GPUs
    Qianxiang Ma, Toshiyuki Imamura · 2026 · International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia)
96. Energy Consumption and Performance of AI Accelerators for Edge Devices
    Minseon Kang, Moonju Park · 2026 · Communications in computer and information science
97. Performance Analysis of Quantization in Federated Split Learning
    Claro Henrique Silva Sales, Francisco Heron de Carvalho, Allberson Bruno de Oliveira Dantas · 2026 · Lecture notes in computer science
98. Evaluation of Software Implemented Binarized MLP-Mixer
    Ryo Kumagai, Shu Takemoto, Yusuke Nozaki, 雅弥 吉川 · 2026 · IEEJ Transactions on Electronics Information and Systems
99. Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models
    Harshita Diddee, Sandipan Dandapat, Monojit Choudhury, Tanuja Ganu, Kalika Bali · 2022 · Conference on Machine Translation (WMT)
100. Real-time onboard vessel detection in WJ-1B satellite panchromatic imagery using deep learning
     Bingteng Ma, Dezhao Zhang, Guichun Mao, Lin Wang, Yuhui Li, Mingming Xie, Hongwei Li · 2026 · International Conference on Environmental Remote Sensing and Geographic Information Technology (ERSGIT)