Cited by 66Advanced Neural Network ApplicationsEmbedded Systems Design TechniquesNumerical Methods and Algorithms

AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers

Open access
Faraone, Julian, Kumm, Martin, Hardieck, Martin, Zipf, Peter, Liu, Xueyuan, Boland, David, Leong, Philip H. W.·2020·IEEE Transactions on Very Large Scale Integration (VLSI) Systems

Abstract

Low-precision arithmetic operations to accelerate deep-learning applications on field-programmable gate arrays (FPGAs) have been studied extensively, because they offer the potential to save silicon area or increase throughput. However, these benefits come at the cost of a decrease in accuracy. In this article, we demonstrate that reconfigurable constant coefficient multipliers (RCCMs) offer a better alternative for saving the silicon area than utilizing low-precision arithmetic. RCCMs multiply input values by a restricted choice of coefficients using only adders, subtractors, bit shifts, and multiplexers (MUXes), meaning that they can be heavily optimized for FPGAs. We propose a family of RCCMs tailored to FPGA logic elements to ensure their efficient utilization. To minimize information loss from quantization, we then develop novel training techniques that map the possible coefficient representations of the RCCMs to neural network weight parameter distributions. This enables the usage of the RCCMs in hardware, while maintaining high accuracy. We demonstrate the benefits of these techniques using AlexNet, ResNet-18, and ResNet-50 networks. The resulting implementations achieve up to 50% resource savings over traditional 8-bit quantized networks, translating to significant speedups and power savings. Our RCCM with the lowest resource requirements exceeds 6-bit fixed point accuracy, while all other implementations with RCCMs achieve at least similar accuracy to an 8-bit uniformly quantized design, while achieving significant resource savings.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tvlsi.2019.2939429

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The AddNet approach gives better accuracy than a network that constrains weight parameters to binary values.

    “This approach gives better accuracy than the network that constrain weight parameters to have binary value.”

    From Embedded Intelligence on FPGA: Survey, Applications and Challenges (2021) · cites this paper as [34]

    The Accuracy Versus Area section (p. 12) reports that AddNet improves accuracy over 4-bit and 6-bit fixed-point implementations. It does not report an accuracy comparison with a network whose weights are constrained to binary values, so the specific comparator in the claim is unsupported. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Implementing RCCM and AddNet saved resources by up to 50% more than a standard 8-bit quantized network with similar accuracy.

    “The result of implementing RCCM and AddNet was the ability to save resources by up to 50% more than a standard 8-bit quantized network with similar accuracy [34].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Part of this paper’s reference list could not be split into single entries.

Flagged first, then by citations

1 of the 42 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Faraone, J., Kumm, M., Hardieck, M., Zipf, P., Liu, X., Boland, D., & Leong, P. H. W.
Affiliations
  • The University of Sydney (AU)
  • Fulda University of Applied Sciences (DE)
  • University of Kassel (DE)
Venue
IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Published
2020-01
Volume
28
Issue
1
Pages
115-128
ISSN
  • 1063-8210 (ISSN-L)
  • 1557-9999
OpenAlex
W2976047473
Cited by
66
References
42
Citations by year
2026: 4 · 2025: 4 · 2024: 15 · 2023: 16 · 2022: 14 · 2021: 7 · 2020: 6
FWCI
3.02
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Very Large Scale Integration (VLSI) Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Australia–Germany Joint Research Co-operation Scheme
  • German Academic Exchange Service (57388068)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
Keywords
low-precision arithmetic, quantization, fixed-point arithmetic, FPGA resource utilization, AlexNet, ResNet-18, ResNet50, area and power efficiency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review