CoChat
Sign Up
PreprintCited by 47Advanced Neural Network ApplicationsNumerical Methods and AlgorithmsLow-power high-performance VLSI design

EasyQuant: Post-training Quantization via Scale Optimization

Open access
Wu, Di, Tang, Qi, Zhao, Yongle, Zhang, Ming, Fu, Ying, Zhang, Debing·2020·arXiv
DOI 10.48550/arxiv.2006.16669arXiv 2006.16669
Open this paper in CoChat — free accountOpen PDF

Abstract

The 8 bits quantization has been widely applied to accelerate network inference in various deep learning applications. There are two kinds of quantization methods, training-based quantization and post-training quantization. Training-based approach suffers from a cumbersome training process, while post-training quantization may lead to unacceptable accuracy drop. In this paper, we present an efficient and simple post-training method via scale optimization, named EasyQuant (EQ),that could obtain comparable accuracy with the training-based method.Specifically, we first alternately optimize scales of weights and activations for all layers target at convolutional outputs to further obtain the high quantization precision. Then, we lower down bit width to INT7 both for weights and activations, and adopt INT16 intermediate storage and integer Winograd convolution implementation to accelerate inference.Experimental results on various computer vision tasks show that EQ outperforms the TensorRT method and can achieve near INT8 accuracy in 7 bits width post-training.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2006.16669

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • For DeiT-S on ImageNet, EasyQuant reduces the accuracy loss to 6.54% at 6-bit quantization.

    “EasyQuant [30] is a popular simple post-training quantization method which improves the performance loss to 6.54% and 3.21%, respectively.”

    From Post-Training Quantization for Vision Transformer (2021) · cites this paper as [30]

    Table 1 in §4.2 (p. 10) reports that EasyQuant improves ImageNet accuracy relative to TRT for several convolutional models at 7- and 8-bit quantization. Section 4.4 (p. 13) discusses 6-bit experiments but does not report a DeiT-S result or a 6.54% accuracy loss; it says ImageNet accuracy dropped sharply below 7 bits for the MobileNet V1 model tested. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • For DeiT-S on ImageNet, EasyQuant reduces the accuracy loss to 3.21% at 8-bit quantization.

    “EasyQuant [30] is a popular simple post-training quantization method which improves the performance loss to 6.54% and 3.21%, respectively.”

    From Post-Training Quantization for Vision Transformer (2021) · cites this paper as [30]

    Section 4.2 (p. 10, Table 1) reports EasyQuant’s 8-bit ImageNet2012 results, but only for SqueezeNetV1.1, MobileNetV1, VGG16, and ResNet50. It does not report a DeiT-S result or a 3.21% accuracy loss, so the model-specific figure is unsupported. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • Most existing post-training quantization methods are designed for convolutional neural networks or recurrent neural networks.

    “Most of the existing post-training quantization methods are designed for convolutional neural networks [3, 21, 30] or recurrent neural networks [35].”

    From Post-Training Quantization for Vision Transformer (2021) · cites this paper as [30]

  • For DETR on COCO2017, the proposed method outperforms EasyQuant by 1.1 mAP for 6-bit quantization.

    “As we can see, the proposed method outperforms percentile-based method, EasyQuant, BitSplit by 2.6, 1.1 and 1.2 mAP for 6-bit quantization, respectively.”

    From Post-Training Quantization for Vision Transformer (2021) · cites this paper as [30]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 31 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. [11]11. Han, S., Mao, H., Dally, W.J.: Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015) · arXiv
  2. [17]17. Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., Kalenichenko, D.: Quantization and training of neural networks for efficient integerarithmetic-only inference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2704-2713 (2018)
  3. [21]21. Migacz, S.: 8-bit inference with tensorrt. In: Proceedings of Conference on GPU Technology. p. 7 (2017)
  4. [35]35. Zheng, T., Deng, W., Hu, J.: Cross-age lfw: A database for studying cross-age face recognition in unconstrained environments. arXiv preprint arXiv:1708.08197 (2017) · arXiv

Cited by

Sorted by citations

Related

Authors
Wu, D., Tang, Q., Zhao, Y., Zhang, M., Fu, Y., & Zhang, D.
Affiliations
  • Deepglint (China) (CN)
  • Shanghai Artificial Intelligence Laboratory (CN)
  • Beijing Institute of Technology (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2006.16669
arXiv
2006.16669
OpenAlex
W3038470071
Cited by
44
References
31
Citations by year
2025: 9 · 2024: 15 · 2023: 12 · 2022: 2 · 2021: 6
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
Keywords
post-training quantization, 8-bit quantization, scale optimization, inference acceleration, computer vision models, accuracy-precision trade-off

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review