CoChat

[DL] A Survey of FPGA-based Neural Network Inference Accelerators

Guo, Kaiyuan, Zeng, Shulin, Yu, Jincheng, Wang, Yu, Yang, Huazhong · 2019 · ACM Transactions on Reconfigurable Technology and Systems

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.

Abstract

Recent research on neural networks has shown a significant advantage in machine learning over traditional algorithms based on handcrafted features and models. Neural networks are now widely adopted in regions like image, speech, and video recognition. But the high computation and storage complexity of neural network inference poses great difficulty on its application. It is difficult for CPU platforms to offer enough computation capacity. GPU platforms are the first choice for neural network processes because of its high computation capacity and easy-to-use development frameworks. However, FPGA-based neural network inference accelerator is becoming a research topic. With specifically designed hardware, FPGA is the next possible solution to surpass GPU in speed and energy efficiency. Various FPGA-based accelerator designs have been proposed with software and hardware optimization techniques to achieve high speed and energy efficiency. In this article, we give an overview of previous work on neural network inference accelerators based on FPGA and summarize the main techniques used. An investigation from software to hardware, from circuit level to system level is carried out to complete analysis of FPGA-based neural network inference accelerator design and serves as a guide to future work.

Overview

Integrity signals

Registry

Crossref · 10.1145/3289185

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 71 references

Research works printed but not linked: 14

  1. DeePhi Tech . 2017. DNNDK. Retrieved December 3, 2018 from http://www.deephi.com/technology/dnndk. DeePhi Tech. 2017. DNNDK. Retrieved December 3, 2018 from http://www.deephi.com/technology/dnndk.
  2. Martín Abadi , Ashish Agarwal , Paul Barham , Eugene Brevdo , Zhifeng Chen , Craig Citro , Greg S. Corrado , Andy Davis , Jeffrey Dean , Matthieu Devin , 2016 . Tensorflow: A system for large-scale machine learning . In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI’16) . 265--283. Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. 2016. Tensorflow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI’16). 265--283.
  3. 10.5555/3195638.3195664 · doi:10.5555/3195638.3195664
  4. Wenlin Chen , James Wilson , Stephen Tyree , Kilian Weinberger , and Yixin Chen . 2015 . Compressing neural networks with the hashing trick . In Proceedings of the International Conference on Machine Learning. 2285--2294 . Wenlin Chen, James Wilson, Stephen Tyree, Kilian Weinberger, and Yixin Chen. 2015. Compressing neural networks with the hashing trick. In Proceedings of the International Conference on Machine Learning. 2285--2294.
  5. P. K. Gupta . 2016 . Accelerating datacenter workloads . In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16) . P. K. Gupta. 2016. Accelerating datacenter workloads. In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16).
  6. Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates etal 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates et al. 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). · arXiv
  7. Fengfu Li , Bo Zhang , and Bin Liu . 2016. Ternary weight networks. arXiv preprint arXiv:1605.04711 ( 2016 ). Fengfu Li, Bo Zhang, and Bin Liu. 2016. Ternary weight networks. arXiv preprint arXiv:1605.04711 (2016). · arXiv
  8. Huimin Li , Xitian Fan , Li Jiao , Wei Cao , Xuegong Zhou , and Lingli Wang . 2016 . A high performance FPGA-based accelerator for large-scale convolutional neural networks . In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16) . IEEE, 1--9. Huimin Li, Xitian Fan, Li Jiao, Wei Cao, Xuegong Zhou, and Lingli Wang. 2016. A high performance FPGA-based accelerator for large-scale convolutional neural networks. In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16). IEEE, 1--9.
  9. Huizi Mao , Song Han , Jeff Pool , Wenshuo Li , Xingyu Liu , Yu Wang , and William J. Dally . 2017. Exploring the granularity of sparsity in convolutional neural networks . In Proceedings of the Computer Vision and Pattern Recognition Workshops. 1927--1934 . Huizi Mao, Song Han, Jeff Pool, Wenshuo Li, Xingyu Liu, Yu Wang, and William J. Dally. 2017. Exploring the granularity of sparsity in convolutional neural networks. In Proceedings of the Computer Vision and Pattern Recognition Workshops. 1927--1934.
  10. Duncan J. M. Moss , Eriko Nurvitadhi , Jaewoong Sim , Asit Mishra , Debbie Marr , Suchit Subhaschandra , and Philip H. W. Leong . 2017. High performance binary neural networks on the Xeon+FPGA™ platform . In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17) . IEEE, 1--4. Duncan J. M. Moss, Eriko Nurvitadhi, Jaewoong Sim, Asit Mishra, Debbie Marr, Suchit Subhaschandra, and Philip H. W. Leong. 2017. High performance binary neural networks on the Xeon+FPGA™ platform. In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17). IEEE, 1--4.
  11. 10.5555/3130379.3130591 · doi:10.5555/3130379.3130591
  12. 10.5555/3195638.3195659 · doi:10.5555/3195638.3195659
  13. Stylianos I. Venieris and Christos-Savvas Bouganis. 2017. Latency-driven design for FPGA-based convolutional neural networks . In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17) . IEEE, 1--8. Stylianos I. Venieris and Christos-Savvas Bouganis. 2017. Latency-driven design for FPGA-based convolutional neural networks. In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17). IEEE, 1--8.
  14. Xin Wang , Fisher Yu , Zi-Yi Dou , and Joseph E . Gonzalez . 2017 . Skipnet : Learning dynamic routing in convolutional networks. arXiv preprint arXiv:1711.09485 (2017). Xin Wang, Fisher Yu, Zi-Yi Dou, and Joseph E. Gonzalez. 2017. Skipnet: Learning dynamic routing in convolutional networks. arXiv preprint arXiv:1711.09485 (2017). · arXiv

Cited by

See all 575

Metadata

Authors
Guo, K., Zeng, S., Yu, J., Wang, Y., & Yang, H.
Affiliations
Tsinghua University (CN)
Venue
ACM Transactions on Reconfigurable Technology and Systems
Published
2019-03-28
Volume
12
Issue
1
Pages
1-26
ISSN
  • 1936-7406 (ISSN-L)
  • 1936-7414
OpenAlex
W2997106510
Cited by
292
References
65
Citations by year
2026: 43 · 2025: 37 · 2024: 29 · 2023: 44 · 2022: 42 · 2021: 54 · 2020: 34 · 2019: 9
FWCI
35.21
Type
journal article
Language
en
Open access
closed
Locations
ACM Transactions on Reconfigurable Technology and Systems (publishedVersion)
Funders
  • National Key R&D Program of China (2018YFB0105005, 2017YFA0207600)
  • National Natural Science Foundation of China (61622403, 61621091)
Topics
  • Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Electrical and Electronic Engineering › VLSI and FPGA Design Techniques
Keywords
FPGA, neural network inference, hardware acceleration, energy efficiency, program optimization, hardware optimization, GPU comparison, machine learning hardware

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: [DL] A Survey of FPGA-based Neural Network Inference Accelerators. https://app.cochat.ai/papers/10.1145/3289185
The paper
Guo, K., Zeng, S., Yu, J., Wang, Y., & Yang, H. (2019). [DL] A Survey of FPGA-based Neural Network Inference Accelerators. ACM Transactions on Reconfigurable Technology and Systems. https://doi.org/10.1145/3289185

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.