The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference
Open accessAbstract
To improve the throughput and energy efficiency of Deep Neural Networks (DNNs) on customized hardware, lightweight neural networks constrain the weights of DNNs to be a limited combination (denoted as k ϵ {1, 2}) of powers of 2. In such networks, the multiply-accumulate operation can be replaced with a single shift operation, or two shifts and an add operation. To provide even more design flexibility, the k for each convolutional filter can be optimally chosen instead of being fixed for every filter. In this paper, we formulate the selection of k to be differentiable, and describe model training for determining k-based weights on a per-filter basis. Over 46 FPGA-design experiments involving eight configurations and four data sets reveal that lightweight neural networks with a flexible k value (dubbed FLightNNs) fully utilize the hardware resources on Field Programmable Gate Arrays (FPGAs), our experimental results show that FLightNNs can achieve 2× speedup when compared to lightweight NNs with k = 2, with only 0.1% accuracy degradation. Compared to a 4-bit fixed-point quantization, FLightNNs achieve higher accuracy and up to 2× inference speedup, due to their lightweight shift operations. In addition, our experiments also demonstrate that FLightNNs can achieve higher computational energy efficiency for ASIC implementation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“We use the Adam optimizer [22] to train the network.”
MethodMobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755 · cited 1×
“Some work proposes more lightweight DNN units for faster inference on general-purpose hardware [22], while others propose hardwarefriendly DNN computation units to enable energy-efficient implementation on customized hardware [25].”
BackgroundDARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
MobileNetV2: Inverted Residuals and Linear BottlenecksPreprint
Sandler, M., Howard, A., Zhu, M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04381 · Cited by 2,255 · cited 1×
“Some work proposes more lightweight DNN units for faster inference on general-purpose hardware [22], while others propose hardwarefriendly DNN computation units to enable energy-efficient implementation on customized hardware [25].”
BackgroundBinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180 · cited 2×
“propose BinaryConnect, which uses only 1 bit for the DNN parameters, turning multiplications into XNOR operations on customized hardware [6].”
MethodOptimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
Bengio, Y., Léonard, N., & Courville, A. (2013) · arXiv · doi:10.48550/arxiv.1308.3432 · Cited by 1,910
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
Zhou, S., Wu, Y., Ni, Z., Zhou, X., Wen, H., & Zou, Y. (2016) · arXiv · doi:10.48550/arxiv.1606.06160 · Cited by 1,690 · cited 1×
“Similar to prior work on DNN quantization [15, 16], we use the straight-through estimator (STE) [19] to compute ∂ L .”
MethodHubara, I., Soudry, D., & Yaniv, R. E. (2016) · arXiv · doi:10.48550/arxiv.1602.02505 · Cited by 1,667 · cited 1×
“2 RELATEDWORK Prior work has extensively explored approaches to reduce latency and energy consumption of DNNs on hardware, through both algorithmic [2, 6] and hardware [7, 8] efforts.”
Background
Research works printed but not linked: 2
- S. Han , J. Pool , J. Tran , and W. Dally , " Learning both weights and connections for efficient neural network," in Advances in Neural Information Processing Systems , pp. 1135 -- 1143 , 2015 . S. Han, J. Pool, J. Tran, and W. Dally, "Learning both weights and connections for efficient neural network," in Advances in Neural Information Processing Systems, pp. 1135--1143, 2015.
- A. L. Maas , A. Y. Hannun , and A. Y. Ng , " Rectifier nonlinearities improve neural network acoustic models ," in Proc. ICML , vol. 30 , no. 1 , pp. 3 , 2013 . A. L. Maas, A. Y. Hannun, and A. Y. Ng, "Rectifier nonlinearities improve neural network acoustic models," in Proc. ICML, vol. 30, no. 1, pp. 3, 2013.
Cited by
Single-Path NAS: Designing Hardware-Efficient ConvNets in Less Than 4 Hours
Stamoulis, D., Ding, R., Wang, D., Lymberopoulos, D., Priyantha, B., Liu, J., & Marculescu, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-46147-8_29 · Cited by 215
Self-citationA Survey of Methods for Low-Power Deep Learning and Computer Vision
Goel, A., Tung, C., Lu, Y.-H., & Thiruvathukal, G. K. (2020) · IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot48130.2020.9221198 · Cited by 146
“A constant bit-width for all layers can lead to poor performance [11].”
BackgroundMethodJoint architecture and knowledge distillation in CNN for Chinese text recognition
Wang, Z.-R., & Du, J. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107722 · Cited by 50
“Different from constraining the weights to +1 or − 1, Ding et al. [38,39] replaced the multiply-accumulate operation with one shift or a constrained number of shifts and adds, which can make trade-offs between accuracy and computational consumption.”
BackgroundSingle-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization
Stamoulis, D. S., Ding, R., Wang, D., Lymberopoulos, D., Priyantha, N. B., Liu, J., & Marculescu, D. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2971421 · Cited by 41
“We draw inspiration from weight-based conditions that have been successfully used for quantization-related decisions [36], [37] and we use the group Lasso term .”
MethodSelf-citationAutomated Log-Scale Quantization for Low-Cost Deep Neural Networks
Oh, S., Sim, H., Lee, S., & Lee, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00080 · Cited by 35
Metadata
- Authors
- Ding, R., Liu, Z., Chin, T.-W., Marculescu, D., & Blanton, R. D. (.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 56th Annual Design Automation Conference 2019
- Publisher
- ACM
- Published
- 2019-06-02
- Pages
- 1-6
- ISSN
- 0738-100X (ISSN-L)
- OpenAlex
- W2963398264
- Cited by
- 19
- References
- 27
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 1 · 2022: 2 · 2021: 5 · 2020: 5 · 2019: 2
- FWCI
- 1.14
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM/IEEE Design Automation Conference (DAC) (publishedVersion)
- Funders
- National Science Foundation (1815899)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- lightweight neural networks, FPGA implementation, shift operations, energy efficiency, inference acceleration, ASIC implementation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference. https://app.cochat.ai/papers/10.1145/3316781.3317828
- The paper
- Ding, R., Liu, Z., Chin, T.-W., Marculescu, D., & Blanton, R. D. (. (2019). FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference. Proceedings of the 56th Annual Design Automation Conference 2019. https://doi.org/10.1145/3316781.3317828
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.