Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.

FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference

Open access
Ding, Ruizhou, Liu, Zeye, Chin, Ting-Wu, Marculescu, Diana, Blanton, R. D. (Shawn) · 2019 · Proceedings of the 56th Annual Design Automation Conference 2019

Abstract

To improve the throughput and energy efficiency of Deep Neural Networks (DNNs) on customized hardware, lightweight neural networks constrain the weights of DNNs to be a limited combination (denoted as k ϵ {1, 2}) of powers of 2. In such networks, the multiply-accumulate operation can be replaced with a single shift operation, or two shifts and an add operation. To provide even more design flexibility, the k for each convolutional filter can be optimally chosen instead of being fixed for every filter. In this paper, we formulate the selection of k to be differentiable, and describe model training for determining k-based weights on a per-filter basis. Over 46 FPGA-design experiments involving eight configurations and four data sets reveal that lightweight neural networks with a flexible k value (dubbed FLightNNs) fully utilize the hardware resources on Field Programmable Gate Arrays (FPGAs), our experimental results show that FLightNNs can achieve 2× speedup when compared to lightweight NNs with k = 2, with only 0.1% accuracy degradation. Compared to a 4-bit fixed-point quantization, FLightNNs achieve higher accuracy and up to 2× inference speedup, due to their lightweight shift operations. In addition, our experiments also demonstrate that FLightNNs can achieve higher computational energy efficiency for ASIC implementation.

Overview

Integrity signals

Registry

Crossref · 10.1145/3316781.3317828

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 27 references

Research works printed but not linked: 2

  1. S. Han , J. Pool , J. Tran , and W. Dally , " Learning both weights and connections for efficient neural network," in Advances in Neural Information Processing Systems , pp. 1135 -- 1143 , 2015 . S. Han, J. Pool, J. Tran, and W. Dally, "Learning both weights and connections for efficient neural network," in Advances in Neural Information Processing Systems, pp. 1135--1143, 2015.
  2. A. L. Maas , A. Y. Hannun , and A. Y. Ng , " Rectifier nonlinearities improve neural network acoustic models ," in Proc. ICML , vol. 30 , no. 1 , pp. 3 , 2013 . A. L. Maas, A. Y. Hannun, and A. Y. Ng, "Rectifier nonlinearities improve neural network acoustic models," in Proc. ICML, vol. 30, no. 1, pp. 3, 2013.

Cited by

See all 19

Metadata

Authors
Ding, R., Liu, Z., Chin, T.-W., Marculescu, D., & Blanton, R. D. (.
Affiliations
Carnegie Mellon University (US)
Venue
Proceedings of the 56th Annual Design Automation Conference 2019
Publisher
ACM
Published
2019-06-02
Pages
1-6
ISSN
0738-100X (ISSN-L)
OpenAlex
W2963398264
Cited by
19
References
27
Citations by year
2025: 2 · 2024: 2 · 2023: 1 · 2022: 2 · 2021: 5 · 2020: 5 · 2019: 2
FWCI
1.14
Type
conference paper
Language
en
Open access
Locations
ACM/IEEE Design Automation Conference (DAC) (publishedVersion)
Funders
National Science Foundation (1815899)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
Keywords
lightweight neural networks, FPGA implementation, shift operations, energy efficiency, inference acceleration, ASIC implementation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference. https://app.cochat.ai/papers/10.1145/3316781.3317828
The paper
Ding, R., Liu, Z., Chin, T.-W., Marculescu, D., & Blanton, R. D. (. (2019). FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference. Proceedings of the 56th Annual Design Automation Conference 2019. https://doi.org/10.1145/3316781.3317828

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.