The DOI matches its Crossref record; 210 of the 210 references it cites were found in a registry or an index.
FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review
Open accessAbstract
Due to recent advances in digital technologies, and availability of credible data, an area of artificial intelligence, deep learning, has emerged and has demonstrated its ability and effectiveness in solving complex learning problems not possible before. In particular, convolutional neural networks (CNNs) have demonstrated their effectiveness in the image detection and recognition applications. However, they require intensive CPU operations and memory bandwidth that make general CPUs fail to achieve the desired performance levels. Consequently, hardware accelerators that use application-specific integrated circuits, field-programmable gate arrays (FPGAs), and graphic processing units have been employed to improve the throughput of CNNs. More precisely, FPGAs have been recently adopted for accelerating the implementation of deep learning networks due to their ability to maximize parallelism and their energy efficiency. In this paper, we review the recent existing techniques for accelerating deep learning networks on FPGAs. We highlight the key features employed by the various techniques for improving the acceleration performance. In addition, we provide recommendations for enhancing the utilization of FPGAs for CNNs acceleration. The techniques investigated in this paper represent the recent trends in the FPGA-based accelerators of deep learning networks. Thus, this paper is expected to direct the future advances on efficient hardware accelerators and to be useful for deep learning researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–210 of 210
Area-efficient 2-D shift-variant convolvers for FPGA-based digital image processing
Cardells-Tormo, F., Molinet, P., Sempere-Agullo, J., Baldez, L., & Bautista-Palacios, M. (2005) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2005.1515789 · Cited by 38
Computing Models for FPGA-Based Accelerators
Herbordt, M., Gu, Y., VanCourt, T., Model, J., Sukhwani, B., & Chiu, M. (2008) · Computing in Science & Engineering · doi:10.1109/mcse.2008.143 · Cited by 35
A multirange architecture for collision‐free off‐road robot navigation
Sermanet, P., Hadsell, R. T., Scoffier, M., Grimes, M. K., Ben, J., Erkan, A., Crudele, C., Miller, U., & LeCun, Y. (2008) · Journal of Field Robotics · doi:10.1002/rob.20270 · Cited by 35
Design and implementation of a 2D convolution core for video applications on FPGAs
Benkrid, K., & Belkacemi, S. (2004) · International Workshop on Digital and Computational Video (DCV) · doi:10.1109/dcv.2002.1218747 · Cited by 25
USING EMBEDDED PROCESSORS IN HARDWARE MODELS OF ARTIFICIAL NEURAL NETWORKS
Wolf, D. F., Romero, R. A. F., & Marques, E. (2001) · Cited by 21
Korekado, K., Morie, T., Nomura, O., Nakano, T., Matsugu, M., & Iwata, A. (2005) · Symposium on VLSI Circuits · doi:10.1109/vlsic.2005.1469371 · Cited by 19
Field Programmable Gate Arrays
Bailey, D. G. (2011) · doi:10.1002/9780470828519.ch2 · Cited by 18
DjiNN and Tonic: DNN as a service and its implications for future warehouse scale computers
Hauswald, J., Kang, Y., Laurenzano, M. A., Chen, Q., Li, C., Mudge, T., Dreslinski, R., Mars, J., & Tang, L. (2015) · ACM SIGARCH Computer Architecture News · doi:10.1145/2872887.2749472 · Cited by 18
A multi-range vision strategy for autonomous offroad navigation
Hadsell, R. T., Erkan, A. N., Sermanet, P., et al. (2007) · Robotics and Applications · Cited by 12
Projection-Field-Type VLSI Convolutional Neural Networks Using Merged/Mixed Analog-Digital Approach
Nomura, O., & Morie, T. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69158-7_111 · Cited by 9
Research works printed but not linked: 30
- lin, 2013, Network in Network
- 2018, Imagenet Large Scale Visual Recognition Challenge
- 2011, The OpenCL Specification Version 1 1
- 10.1109/TCSVT.2008.918775 · doi:10.1109/tcsvt.2008.918775
- 10.1145/2830772.2830810 · doi:10.1145/2830772.2830810
- 2018, DE5-Net FPGA Kit User Manual
- 2018, P395-D8 OpenCL FPGA Accelerator Cards
- 10.1145/2664666.2664670 · doi:10.1145/2664666.2664670
- 2018, What is Deep Learning?
- 2018, OpenCL Design Examples
- joshi, 2018, What is Local Response Normalization in Convolutional Neural Networks
- 10.1007/978-1-4614-1791-0 · doi:10.1007/978-1-4614-1791-0
- 2018, JTAG UART Core
- iandola, 2016, SqueezeNet AlexNet-level accuracy with 50 $\times$ fewer parameters and
- czajkowski, 2012, OpenCL for FPGAs: Prototyping a compiler, Proc Int Conf Eng Reconfigurable Syst Algorithms (ERSA), 1
- 10.1007/978-981-10-0591-6 · doi:10.1007/978-981-10-0591-6
- 10.1007/978-3-319-68161-0 · doi:10.1007/978-3-319-68161-0
- karpathy, 2018, Convolutional Neural Network for Visual Recognition
- van loan, 1996, Matrix Computations
- chung, 2017, Accelerating persistent neural networks at datacenter scale, Proc Hot Chips, 27
- 10.1109/FCCM.2015.15 · doi:10.1109/fccm.2015.15
- lecun, 2015, Lenet-5 convolutional neural networks
- graf, 2009, A massively parallel digital learning processor, Proc Adv Neural Inf Process Syst, 529
- collobert, 2008, Torch, Proc Workshop Mach Learn Open Source Softw (NIPS), 76, 113
- grangier, 2009, Deep convolutional networks for scene parsing, Proc ICML Deep Learn Workshop, 3, 109
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 1135
- guennebaud, 2015, Eigen V3
- lecun, 1998, The MNIST Database of Handwritten Digits
- deshpande, 2018, A Beginner's Guide To Understanding Convolutional Neural Networks
- nichols, 2002, Feasibility of floating-point arithmetic in FPGA based artificial neural networks, Proc CAINE, 8
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Valueva, M. V., Nagornov, N. N., Lyakhov, P. A., Valuev, G. V., & Chervyakov, N. I. (2020) · Mathematics and Computers in Simulation · doi:10.1016/j.matcom.2020.04.031 · Cited by 478
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“Due to the increased demand for EI, small and high-density FPGAs are now being considered [11], [315], [316], [317].”
BackgroundMethodThe promise of artificial intelligence and deep learning in PET and SPECT imaging
Arabi, H., AkhavanAllaf, A., Sanaat, A., Shiri, I., & Zaidi, H. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.03.008 · Cited by 268
Ahmad, S., Shakeel, I., Mehfuz, S., & Ahmad, J. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100568 · Cited by 197
Metadata
- Authors
- Shawahna, A., Sait, S. M., & El-Maleh, A.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 7823-7859
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2907463061
- Cited by
- 496
- References
- 210
- FWCI
- 20.81
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- King Fahd University of Petroleum and Minerals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.