CoChat

HADQ-Net: A Power-Efficient and Hardware-Adaptive Deep Convolutional Neural Network Translator Based on Quantization-Aware Training for Hardware Accelerators

Open access
Oflamaz, Can Uğur, Yalçın, Müştak Erhan · 2025 · Electronics

The DOI matches its Crossref record; 71 of the 72 references it cites were found in a registry or an index; 11 of the 19 sources its claims cite were checked for support.

Abstract

With the increasing demand for implementing deep-learning models on devices on resource-constrained devices, the development of power-efficient neural networks has become imperative. This paper introduces HADQ-Net, a novel framework for optimizing deep convolutional neural networks (CNNs) through Quantization-Aware Training (QAT). By compressing 32-bit floating-point (FP32) precision weights and activation values to lower bit-widths, HADQ-Net significantly reduces memory footprint and computational complexity while maintaining high accuracy. We propose adaptive quantization limits based on the statistical properties of each layer or channel, coupled with normalization techniques, to enhance quantization efficiency and accuracy. The framework includes algorithms for QAT, quantized convolution, and quantized inference, enabling efficient deployment of deep CNN models on edge devices. Extensive experiments across tasks such as super-resolution, classification, object detection, and semantic segmentation demonstrate the trade-offs between accuracy, model size, and computational efficiency under various quantization levels. Our results highlight the superiority of QAT over post-training quantization methods and underscore the impact of quantization types on model performance. HADQ-Net achieves significant reductions in memory footprint, computational complexity, and energy consumption, making it ideal for resource-constrained environments without sacrificing performance.

Overview

CoChat Summary

## TL;DR

HADQ-Net is a quantization-aware training framework for compressing deep CNNs to lower bit-widths while preserving accuracy and improving efficiency for hardware accelerators and edge devices. The paper reports that QAT outperforms PTQ across bit-widths, and that the method reduces parameter size from 41.94 MB at FP32 to 1.31 MB at 1-bit/1-bit.

## Key findings

  • On CIFAR-100 with a pre-trained ResNet18, the proposed method achieved accuracy of 0.633, 0.751, 0.797, 0.862, 0.901, 0.907, 0.908, 0.910 at 1/1 through 8/8 bit-widths, compared with 0.496, 0.549, 0.562, 0.679, 0.849, 0.862, 0.875, 0.875 for PTQ.
  • The paper states that QAT consistently outperforms PTQ across all bit-width configurations.
  • Parameter size decreases from 41.94 MB at FP32 to 1.31 MB at 1/1, with intermediate sizes of 2.62, 3.93, 5.24, 6.55, 7.86, 9.17, and 10.49 MB for 2/2 through 8/8.
  • In the fixed- vs mixed-precision comparison, mixed precision reduced weight size to 3.27 MB while achieving 0.823 accuracy, versus 3.93 MB and 0.797 accuracy for fixed precision.
  • For classification, the paper reports results such as ResNet18: 0.594 to 0.960 across 1/1 to 8/8, and DenseNet121: 0.588 to 0.941 across the same range.
  • For detection, faster_rcnn reached 0.868 to 0.972 mAP across low-to-full precision, and for segmentation AP@IoU 0.50:0.95 rose from 0.708 at 4/4 to 0.787 at FP32.

## Methods

  • The study proposes HADQ-Net, a quantization-aware training (QAT) framework using uniform quantization, with dynamic activation quantization during inference and experiments on layer-wise vs channel-wise and fixed vs mixed precision quantization.
  • The quantization algorithm uses adaptive clipping limits based on mean and standard deviation, followed by normalization and quantization; STE is used for backpropagation, and bias quantization is omitted.
  • Experiments were run in PyTorch on an NVIDIA GeForce RTX 3090 Ti (24 GB), with multiple retrainings; datasets named in the text include CIFAR-100, ImageNet Object Localization, Hymenoptera, Berkeley Segmentation, and coco-2017.

## Limitations

  • The paper states that QAT introduces significant training overhead, which remains a challenge for practical deployment.
  • The authors note that their current results focus on training outcomes, and that comprehensive inference performance metrics will require implementation on dedicated edge computing platforms.
  • The text indicates that some evaluations used a small subset of ImageNet, and the paper itself says this may not fully reflect real-world performance.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/electronics14183686

Cites

71 of 72 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

7 Valid · 1 Not valid · 3 Not checked · 79 Own results and interpretations

33 more claims

Create a free account to see all 90 claims and to verify the 2 references still open.

See all claims — free account
  • It may state two separate claims as one. 37
  • Probably not a substantial claim. 25
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Citations

Cites

Show all 72 references

Research works printed but not linked: 3

  1. Choi, J., Venkataramani, S., Srinivasan, V., Gopalakrishnan, K., Wang, Z., and Chuang, P. (April, January 31). Accurate and Efficient 2-bit Quantized Neural Networks. Proceedings of the 2nd SysML Conference, Palo Alto, CA, USA.
  2. Dong, Z., Yao, Z., Gholami, A., Mahoney, M.W., and Keutzer, K. (November, January 27). HAWQ: Hessian aware quantization of neural networks with mixed-precision. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
  3. Shen, X., Kong, Z., Yang, C., Han, Z., Lu, L., Dong, P., Lyu, C., Li, C., Guo, X., and Shu, Z. (2024). EdgeQAT: Entropy and distribution guided quantization-aware training for the acceleration of lightweight LLMs on the edge. arXiv.

Cited by

Metadata

Authors
Oflamaz, C. U., & Yalçın, M. E.
Affiliations
  • Istanbul Technical University (TR)
  • Department of Electronics and Communication Engineering, İstanbul Technical University, 34469 İstanbul, Türkiye
Corresponding author
Oflamaz, Can Uğur
Venue
Electronics
Publisher
MDPI AG
Published
2025-09-18
Volume
14
Issue
18
Pages
3686
ISSN
2079-9292 (ISSN-L)
OpenAlex
W4414334266
Cited by
4
References
47
Citations by year
2026: 3 · 2025: 1
FWCI
1.41
Type
journal article
Language
en
Open access
Locations
  • Electronics (publishedVersion, cc-by)
  • Istanbul Technical University Academic Open Archive (Istanbul Technical University) (submittedVersion)
Funders
Aselsan Inc.
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
quantization-aware training, convolutional neural networks, neural network compression, edge devices, power efficiency, hardware accelerators, memory footprint reduction, energy consumption

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.