A Survey of Quantization Methods for Efficient Neural Network Inference

Cited by (1,155)

Items 401–500 of 1,155

1. DECA: A Near-Core LLM Decompression Accelerator Grounded on a 3D Roofline Model
   Gerasimos Gerogiannis, Stijn Eyerman, Evangelos Georganas, Wim Heirman, Josep Torrellas · 2025 · IEEE/ACM International Symposium on Microarchitecture (MICRO)
2. A railway fastener inspection method based on lightweight network
   Yue Wang, Wang Ji, Shubin Zheng · 2024 · Engineering Research Express
3. Reliable edge machine learning hardware for scientific applications
   Tommaso Lisini Baldi, Javier Campos, Benjamin Hawks et al. · 2024 · Proceedings - IEEE VLSI Test Symposium/Proceedings of the ... IEEE VLSI Test Symposium
4. How Much Can We Gain From Tensor Kernel Fusion on GPUs?
   Wei Sun, Ang Li, Sander Stuijk, Henk Corporaal · 2024 · IEEE Access
5. Gesture Recognition of Filipino Sign Language Using Convolutional and Long Short-Term Memory Deep Neural Networks
   Karl Jensen F. Cayme, Vince Andrei B. Retutal, Miguel Edwin P. Salubre · 2024 · Knowledge
6. Content-Aware Radiance Fields: Aligning Model Complexity with Scene Intricacy Through Learned Bitwidth Quantization
   Weihang Liu, Xue Xian Zheng, Jingyi Yu A, Xin Lou · 2024 · Lecture notes in computer science
7. Convergence-aware operator-wise mixed-precision training
   Wenhao Dai, Ziyi Jia, Yuesi Bai · 2024 · CCF Transactions on High Performance Computing
8. Input-Dependent Power Usage in GPUs
   Theo Gregersen, Pratyush Patel, Esha Choukse · 2024
9. Iterative Algorithm for Parameterization of Two-Region Piecewise Uniform Quantizer for the Laplacian Source
   Jelena Nikolić, Danijela Aleksić, Zoran Perić, Milan R. Dincic · 2021 · Mathematics
10. AIQoSer: Building the efficient Inference-QoS for AI Services
    Jianxin Li, Tianchen Zhu, Haoyi Zhou, Qingyun Sun, Chunyang Jiang, Shuai Zhang, Chunming Hu · 2022 · International Workshop on Quality of Service
11. Elements of TinyML on Constrained Resource Hardware
    Vasileios Tsoukas, Anargyros Gkogkidis, Athanasios P. Kakarountas · 2022 · Communications in computer and information science
12. CNN quantization for anatomical landmarks classification from upper gastrointestinal endoscopic images on Edge Devices
    Minh Quan Le, Quang Tung Nguyen, Viet Hang Dao, Thanh-Hai Tran · 2022 · International Conference on Communications and Electronics (ICCE)
13. Towards Fast GPU-based Sparse DNN Inference: A Hybrid Compute Model
    Shaoxian Xu, Minkang Wu, Long Gen Zheng, Zhiyuan Shao, Xiangyu Ye, Xiaofei Liao, Hai Jin · 2022 · IEEE High Performance Extreme Computing Conference
14. Fast Computation of RFD-Like Descriptors in Four Orientations
    Anton V. Trusov, Elena E. Limonova, Vladimir V. Arlazarov · 2023 · IEEE Access
15. Evaluating Robustness to Noise and Compression of Deep Neural Networks for Keyword Spotting
    Pedro Henrique Castro Pereira, Wesley Beccaro, Miguel Arjona Ramírez · 2023 · IEEE Access
16. Real-Time Caries Detection of Bitewing Radiographs Using a Mobile Phone and an Artificial Neural Network: A Pilot Study
    Ming Hong Jim Pun · 2023 · Oral
17. Review on Application of Deep Neural Networks and Parallel Architectures for Rock Fragmentation Problems
    Mikhail Ronkin, Elena Nikolaevna Akimova, Vladimir Evgenevich Misilov, Kirill Reshetnikov · 2023 · Bulletin of the South Ural State University Series Computational Mathematics and Software Engineering
18. Machine Learning Across Network-Connected FPGAs
    Dana Diaconu, Yanyue Xie, Mehmet Gungor, Suranga Handagala, Xue Lin, Miriam E. Leeser · 2023 · IEEE High Performance Extreme Computing Conference
19. Factorized Dynamic Fully-Connected Layers for Neural Networks
    Francesca Babiloni, Thomas Tanay, Jiankang Deng, Matteo Maggioni, Stefanos P. Zafeiriou · 2023 · IEEE International Conference on Computer Vision Workshops
20. Overcoming Forgetting Catastrophe in Quantization-Aware Training
    Ting‐An Chen, De-Nian Yang, Ming-Syan Chen⋆ · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
21. ATLAS: An Approximate Time-Series LSTM Accelerator for Low-Power IoT Applications
    Fabian Kreß, Alexey Serdyuk, Micha Hiegle, Disnebio Waldmann, Tim Hotfilter, Julian Hoefer, Tim Hamann, Jens Barth, Peter Kämpf, Tanja Harbaum et al. · 2023 · Euromicro Conference on Digital System Design (DSD)
22. Quantized non-volatile nanomagnetic domain wall synapse based autoencoder for efficient unsupervised network anomaly detection
    M. S. Alam, Walid Al Misba, Jayasimha Atulasimha · 2024 · Neuromorphic Computing and Engineering
23. An All-Optical General-Purpose CPU and Optical Computer Architecture
    Michael Kissner, Leonardo Del Bino, Felix Päsler, Peter Caruana, George N. Ghalanos · 2024 · Journal of Lightwave Technology
24. ColFigPhotoAttnNet: Reliable Finger Photo Presentation Attack Detection Leveraging Window-Attention on Color Spaces
    Anudeep Vurity, Emanuela Marasco, Raghavendra Ramachandra, Jong-Woo Park · 2025 · IEEE Winter Conference on Applications of Computer Vision
25. Exploiting Wireless Technology for Energy-Efficient Accelerators With Multiple Dataflows and Precision
    Siqin Liu, Talha Furkan Canan, Harsha Chenji, Soumyasanta Laha, Savaş Kaya, Avinash Karanth · 2022 · IEEE Transactions on Circuits and Systems I Regular Papers
26. Lightweight Periocular Recognition through Low-bit Quantization
    Jan Niklas Kolf, Fadi Boutros, Florian Kirchbuchner · 2022 · IEEE International Joint Conference on Biometrics (IJCB)
27. Dilated Involutional Pyramid Network (DInPNet): A Novel Model for Printed Circuit Board (PCB) Components Classification
    Ananya Mantravadi, Dhruv Makwana, Sai Chandra Teja R · 2023 · International Symposium on Quality Electronic Design (ISQED)
28. PreQuant: A Task-agnostic Quantization Approach for Pre-trained Language Models
    Zhuocheng Gong, Jiahao Liu, Qifan Wang, Yang Yang, Jingang Wang, Wei Wu, Yunsen Xian, Dongyan Zhao, Rui Yan · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
29. A non-alternating graph hashing algorithm for large-scale image search
    Sobhan Hemati, Mohammad Hadi Mehdizavareh, Shojaeddin Chenouri, Hamid R. Tizhoosh · 2022 · Computer Vision and Image Understanding
30. HADQ-Net: A Power-Efficient and Hardware-Adaptive Deep Convolutional Neural Network Translator Based on Quantization-Aware Training for Hardware Accelerators
    Oflamaz, Can Uğur, Yalçın, Müştak Erhan · 2025 · Electronics
31. Towards Comprehensive Neural Materials: Dynamic Structure-Preserving Synthesis with Accurate Silhouette at Instant Inference Speed
    Zilin Xu, Xiang Chen, Chen Liu, Beibei Wang, Lu Wang, Zahra Montazeri, Ling‐Qi Yan · 2025 · ACM SIGGRAPH Conference (SIGGRAPH)
32. Ground-Assisted LEO Satellite Federated Learning: Dynamic, Efficient, Distributed Learning
    Fuyao Zhang, Dan Wang, Jiawen Kang, Dusit Tao Niyato · 2025 · IEEE Transactions on Mobile Computing
33. Benchmarking and Characterization of Large Language Model Inference on Apple Silicon
    Afsara Benazir, Felix Xiaozhu Lin · 2025 · Proceedings of the ACM on Measurement and Analysis of Computing Systems
34. RAMS: Runtime Adaptive Memory Scaling for Tiny Deep Learning on IoT Devices
    Haolin Chu, Haiteng Xin, Xiaolong Zheng, Liang Liu, Huadóng Ma · 2026 · IEEE Transactions on Mobile Computing
35. Deployment-Aware Compression of Large Language Models for Edge Intelligence: A System-Level Survey
    Elias Dritsas, Maria Trigka · 2026 · IEEE Transactions on Artificial Intelligence
36. Railway track geometry degradation: A review of prediction methods
    Alireza Safari Tarbozagh, Saeed Mohammadzadeh, Morteza Esmaeili · 2026 · Results in Engineering
37. Mix-GEMM: Extending RISC-V CPUs for Energy-Efficient Mixed-Precision DNN Inference Using Binary Segmentation
    Jordi Fornt, Enrico Reggiani, Pau Fontova-Musté · 2024 · IEEE Transactions on Computers
38. BioEdgeNet: A compact deep residual network for stress recognition on edge devices
    Stevica Cvetković, Sandra Stankovic, Saša V. Nikolić · 2024 · Biomedical Signal Processing and Control
39. Large-Scale Recurrent Neural Networks with Fully Homomorphic Encryption for Privacy-Enhanced Speaker Identification
    Vele Tosevski, P. Glenn Gulak · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
40. Mobile Device-Based Detection System of Diseases and Pests in Rose Plants Using Deep Convolutional Neural Networks and Quantization
    Burhan Duman · 2025 · Tarım Bilimleri Dergisi
41. Wireless Hearables With Programmable Speech AI Accelerators
    Malek Itani, Tuochao Chen, Arun M. Raghavan · 2025 · Proceedings of the 28th Annual International Conference on Mobile Computing And Networking
42. Post-Training Quantization for Longformer with Chunkwise Quantization Granularity and Optimized Percentile
    Qibin Chen, Yijin Teng, Hui Zhang, Kai Jiang, Qiang Duan, Xue Li, Xinxin Zhao, Rui Li · 2022 · International Conference on Computer and Communication Systems (ICCCS)
43. Implementation and Optimization of Neural Networks for Tiny Hardware Devices
    Hadi Al Zein, Mohamad Aoude, Youssef Harkouss · 2022 · International Conference on Smart Systems and Power Management (IC2SPM)
44. Simulated Annealing Based Integerization of Hidden Weights for Area-Efficient IoT Edge Intelligence
    Rajeev Joshi, Lakshmi Kavya Kalyanam, Srinivas Katkoori · 2022 · IEEE International Symposium on Smart Electronic Systems (iSES)
45. QFT: Post-training Quantization via Fast Joint Finetuning of All Degrees of Freedom
    Alex Finkelstein, Ella Fuchs, Idan Tal, Mark Grobman, Niv Vosco, Eldad Meller · 2023 · Lecture notes in computer science
46. Area Efficient VLSI ASIC Implementation of Multilayer Perceptrons
    Rajeev Joshi, Lakshmi Kavya Kalyanam, Srinivas Katkoori · 2023 · International VLSI Symposium on Technology, Systems and Applications (VLSI-TSA)
47. Convolutional neural network pruning based on misclassification cost
    Saeed Ahmadluei, Karim Faez A, Behrooz Masoumi · 2023 · The Journal of Supercomputing
48. DOSA: Organic Compilation for Neural Network Inference on Distributed FPGAs
    Burkhard Ringlein, François Abel, Dionysios Diamantopoulos · 2023 · IEEE International Conference on Edge Computing and Communications (EDGE)
49. Quantization for Bayesian Deep Learning: Low-Precision Characterization and Robustness
    Jun-Liang Lin, Ranganath Krishnan, Keyur Ruganathbhai Ranipa, Mahesh M. Subedar, Vrushabh Sanghavi, Meena Arunachalam, Omesh Tickoo, Ravishankar Iyer, Mahmut Kandemir · 2023 · IEEE International Symposium on Workload Characterization
50. Effective Multi-Stage Training Model for Edge Computing Devices in Intrusion Detection
    Trong Thua Huynh, Hoang Thanh Nguyen · 2024 · International journal of Computer Networks & Communications
51. CANET: Quantized Neural Network Inference With 8-bit Carry-Aware Accumulator
    Jingxuan Yang, Xiaoqin Wang, Yiying Jiang · 2024 · IEEE Access
52. Fuzzy Norm-Explicit Product Quantization for Recommender Systems
    Mohammadreza Jamalifard, Javier Andreu-Pérez, Hani Hagras, Luis M. Martínez · 2024 · IEEE Transactions on Fuzzy Systems
53. Characterizing Parameter Scaling with Quantization for Deployment of CNNs on Real-Time Systems
    Calvin B. Gealy, Alan D. George · 2024 · ACM Transactions on Embedded Computing Systems
54. FedCFC: On-Device Personalized Federated Learning with Closed-Form Continuous-Time Neural Networks
    Yimin Dai, Rui Tan · 2024 · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)
55. Enhanced Machine-Learning Flow for Microwave-Sensing Systems for Contaminant Detection in Food
    Bernardita Štitić, Luca Urbinati, Giuseppe Di Guglielmo · 2024 · IEEE Transactions on AgriFood Electronics
56. Difficulties and approaches in enabling learning-in-memory using crossbar arrays of memristors
    Wei Juan Wang, Yang Li, Ming Wang · 2024 · Neuromorphic Computing and Engineering
57. Edge AI on Constrained IoT Devices: Quantization Strategies for Model Optimization
    Muhammad Yasir Shabir, Gianluca Torta, Ferruccio Damiani · 2024 · Lecture notes in networks and systems
58. Neural Network-Based Control of Forced-Convection and Thermoelectric Coolers
    Mahsa Akhsham, Mohammad Javad Dousti, Saeed Safari · 2024 · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
59. ZeD: A Generalized Accelerator for Variably Sparse Matrix Computations in ML
    Pranav Dangi, Zhenyu Bai, Rohan Juneja · 2024 · International Conference on Parallel Architectures and Compilation Techniques
60. An energy-efficient dehazing neural network accelerator based on E$$^2$$AOD-Net
    Zhihao Zhang, Gaoming Du, Zhenmin Li, Qinran Kang, Wenyao Zhao, Xiaolei Wang · 2024 · Journal of Real-Time Image Processing
61. Quantized Prompt for Efficient Generalization of Vision-Language Models
    Tianxiang Hao, Xiaohan Ding, Juexiao Feng, Yuhong Yang, Hui Chen, Guiguang Ding · 2024 · Lecture notes in computer science
62. Quantization Aware Factorization for Deep Neural Network Compression
    Daria Cherniuk, Stanislav Abukhovich, Anh Huy Phan · 2024 · Journal of Artificial Intelligence Research
63. Power Consumption in HPC-AI Systems
    Roblex T. Nana, Claude Tadonki, Petr Dokládal, Youssef Mesri · 2024 · Lecture notes in networks and systems
64. Structured Model Pruning for Efficient Inference in Computational Pathology
    Mohammed Adnan, Qinle Ba, Nazim Shaikh, Shivam Kalra, Satarupa Mukherjee, Auranuch Lorsakul · 2025 · Lecture notes in computer science
65. Enabling Harmonious Human-Machine Interaction with Visual-Context Augmented Dialogue System: A Review
    Hao Wang, Bin Guo, Yating Zeng, Mengqi Chen, Yasan Ding, Ying Zhang, Lina Yao, Zhiwen Yu · 2025 · ACM Transactions on Information Systems
66. BDCKD: Unlocking the Power of Brownian Distance Covariance in Knowledge Distillation
    Guoming Lu, Heng Yin, Zhiyong Shu, Jielei Wang, Guangchun Luo · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
67. EPTQ: Enhanced Post-training Quantization via Hessian-Guided Network-Wise Optimization
    Ofir Gordon, Elad Cohen, Hai Victor Habi, Arnon Netzer · 2025 · Lecture notes in computer science
68. Safety and Trust in Artificial Intelligence with Abstract Interpretation
    Gagandeep Singh, Jacob Laurel, Saša Misailovíc, Debangshu Banerjee, Avaljot Singh, Changming Xu, Shubham Ugare, Huan Zhang · 2025 · Foundations and Trends® in Programming Languages
69. High-Throughput Energy-Efficient Accelerator With Collaborative-Trainable Sparse-Quantization Method for On-Board Remote Sensing Processing
    Tong Wang, He Chen, Ning Zhang · 2025 · IEEE Transactions on Geoscience and Remote Sensing
70. StreamSVD: Low-rank Approximation and Streaming Accelerator Co-design
    Zhewen Yu, Christos-Savvas Bouganis · 2021 · International Conference on Field-Programmable Technology (FPT)
71. Approximated Doubly Robust Search Relevance Estimation
    Lixin Zou, Changying Hao, Hengyi Cai, Shuaiqiang Wang, Suqi Cheng, Zhicong Cheng, Wenwen Ye, Simiu Gu, Dawei Yin · 2022 · ACM International Conference on Information and Knowledge Management (CIKM)
72. AlignQ: Alignment Quantization with ADMM-based Correlation Preservation
    Ting‐An Chen, De-Nian Yang, Ming-Syan Chen⋆ · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
73. Scaling by Learning: Accelerating Open vSwitch Data Path With Neural Networks
    Alon Rashelbach, Ori Rottenstreich, Mark Silberstein · 2022 · IEEE/ACM Transactions on Networking
74. A 4-bit Integer-Only Neural Network Quantization Method Based on Shift Batch Normalization
    Qingyu Guo, Xiaoxin Cui, Jian Zhang, Aifei Zhang, Xinjie Guo, Yuan Wang · 2022 · IEEE International Symposium on Circuits and Systems proceedings
75. On the Performance of Quantized Neural Networks based Digital Predistortion for PA linearization in OFDM systems
    Alexis Falempin, Johan Laurent, Jean‐Baptiste Doré · 2022 · IEEE Vehicular Technology Conference
76. Model Compression Techniques in Deep Neural Networks
    Mubarek Mohammed Yesuf, Beakal Gizachew Assefa · 2023 · Communications in computer and information science
77. Emergent Quantized Communication
    Boaz Carmeli, Ron Meir, Yonatan Belinkov · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
78. In-Memory Computing for AI Accelerators: Challenges and Solutions
    Gokul Krishnan V, Sumit K. Mandal, Chaitali Chakrabarti, Jae-sun Seo, Umit Yusuf Ogras, Yu Kevin Cao · 2023 · Springer eBooks
79. A Light-Weighted Machine Learning Approach to Channel Estimation for New-Radio Systems
    H. Lee, Sang Won Choi · 2023 · Electronics
80. Efficient Defense Against Model Stealing Attacks on Convolutional Neural Networks
    Kacem Khaled, Mouna Dhaouadi, Felipe Göhring de Magalhães · 2023 · International Conference on Machine Learning and Applications
81. Certified Quantization Strategy Synthesis for Neural Networks
    Yedi Zhang, Guangke Chen, Fu Song · 2024 · Lecture notes in computer science
82. Integrating physical units into high-performance AI-driven scientific computing
    Chaoming Wang, Sichao He, Shouwei Luo, Yuxiang Huan, Si Wu · 2025 · Nature Communications
83. Real-time Hyper-Dimensional Reconfiguration at the Edge using Hardware Accelerators
    Indhumathi Kandaswamy, Saurabh Farkya, Zachary Daniels, Gooitzen van der Wal, Aswin Raghavan, Yuzheng Zhang, Jun Hu, Michael Lomnitz, Michael A. Isnardi, David Zhang et al. · 2022 · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
84. Detection of atrial fibrillation with an optimized neural network on a RISC-V-based microcontroller for efficient integration into ECG patches
    Ingo Hoyer, Alexander Utz, André Lüdecke, Mike Richter, Felix Wichum, Pierre Gembaczka, Kerstin Köhler, Maurice Rohr, Christoph Hoog Antink, Karsten Seidl · 2022 · IEEE International Symposium on Medical Measurements and Applications (MeMeA)
85. IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization
    Yunshan Zhong, Mingbao Lin, Gongrui Nan, Jianzhuang Liu, Baochang Zhang, Yonghong Tian, Rongrong Ji · 2021 · arXiv (Cornell University)
86. Experimental Implementation of a Neural Network Optical Channel Equalizer in Restricted Hardware Using Pruning and Quantization
    Diego Argüello Ron, Pedro Jorge Freire De Carvalho Sourza, Jaroslaw E. Prilepsky · 2022 · Research Square
87. Model Quantization and Hardware Acceleration for Vision Transformers: A Comprehensive Survey
    Du, Dayou, Gong, Gu, Chu, Xiaowen · 2024 · arXiv
88. On the Robustness of Compressed Models with Class Imbalance
    Baraa Saeed Ali, Nabil J. Sarhan, Mohammed Alawad · 2024 · Computers
89. Accelerating Inference of Networks in the Frequency Domain
    Chenqiu Zhao, Guanfang Dong, Anup Basu · 2024 · ACM International Conference on Multimedia in Asia (MMAsia)
90. Training 4.6-Bit Convolutional Neural Networks with a HardTanh Activation Function
    A. V. Trusov · 2025 · Pattern Recognition and Image Analysis
91. LightML: A Photonic Accelerator for Efficient General Purpose Machine Learning
    Liang Liu, Sadra Rahimi Kari, Xin Xin, Nathan Youngblood, Youtao Zhang, Jun Yang · 2025 · Proceedings - International Symposium on Computer Architecture/Proceedings
92. Unsupervised Real-Time In-Kernel Intrusion Detection System Using Autoencoders and eBPF
    Hotaka Taguchi, Takanori Hara, Shoji Kasahara · 2025 · IEICE Transactions on Communications
93. ORQ-ViT: Outlier resilient Post Training Quantization for vision transformers via outlier decomposition
    Xinyu He, Lu Ye, Hang Liu, Cheng Gong, Wenxuan He · 2025 · Journal of Systems Architecture
94. Is Quantization a Deal-Breaker? Empirical Insights From Large Code Models
    Saima Afrin, Bowen Xu, Antonio Mastropaolo · 2025 · IEEE International Conference on Software Maintenance (ICSM)
95. Rapid wavefield forecasting for earthquake early warning via deep sequence to sequence learning
    Dongwei Lyu, Rie Nakata, Pu Ren · 2025 · Nature Communications
96. Real-Time Visual Perception and Explainable Fault Diagnosis for Railway Point Machines at the Edge
    Yu Feng Zhai, Lili Wei · 2026 · Electronics
97. KVC-Q: A high-fidelity and dynamic KV Cache quantization framework for long-context large language models
    Yusen Wu, Ruiqin Lin, Jiarong Que, Qixiang Zeng, Hongsen Zhang · 2026 · Journal of Systems Architecture
98. Real-time fruit quality assessment using optimized cnn models on low-power edge devices
    Manel Hentati, Raida Hentati, Olfa Gaddour · 2026 · Multimedia Tools and Applications
99. Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models
    Clara Na, Sanket Vaibhav Mehta, Emma Strubell · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
100. Cross-Layer Optimizations for Efficient Deep Learning Inference at the Edge
     Muhammad Abdullah Hanif, Muhammad Shafique · 2023 · Springer eBooks