The DOI matches its Crossref record; 210 of the 210 references it cites were found in a registry or an index.
FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review
Open accessAbstract
Due to recent advances in digital technologies, and availability of credible data, an area of artificial intelligence, deep learning, has emerged and has demonstrated its ability and effectiveness in solving complex learning problems not possible before. In particular, convolutional neural networks (CNNs) have demonstrated their effectiveness in the image detection and recognition applications. However, they require intensive CPU operations and memory bandwidth that make general CPUs fail to achieve the desired performance levels. Consequently, hardware accelerators that use application-specific integrated circuits, field-programmable gate arrays (FPGAs), and graphic processing units have been employed to improve the throughput of CNNs. More precisely, FPGAs have been recently adopted for accelerating the implementation of deep learning networks due to their ability to maximize parallelism and their energy efficiency. In this paper, we review the recent existing techniques for accelerating deep learning networks on FPGAs. We highlight the key features employed by the various techniques for improving the acceleration performance. In addition, we provide recommendations for enhancing the utilization of FPGAs for CNNs acceleration. The techniques investigated in this paper represent the recent trends in the FPGA-based accelerators of deep learning networks. Thus, this paper is expected to direct the future advances on efficient hardware accelerators and to be useful for deep learning researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Research works printed but not linked: 30
- lin, 2013, Network in Network
- 2018, Imagenet Large Scale Visual Recognition Challenge
- 2011, The OpenCL Specification Version 1 1
- 10.1109/TCSVT.2008.918775 · doi:10.1109/tcsvt.2008.918775
- 10.1145/2830772.2830810 · doi:10.1145/2830772.2830810
- 2018, DE5-Net FPGA Kit User Manual
- 2018, P395-D8 OpenCL FPGA Accelerator Cards
- 10.1145/2664666.2664670 · doi:10.1145/2664666.2664670
- 2018, What is Deep Learning?
- 2018, OpenCL Design Examples
- joshi, 2018, What is Local Response Normalization in Convolutional Neural Networks
- 10.1007/978-1-4614-1791-0 · doi:10.1007/978-1-4614-1791-0
- 2018, JTAG UART Core
- iandola, 2016, SqueezeNet AlexNet-level accuracy with 50 $\times$ fewer parameters and
- czajkowski, 2012, OpenCL for FPGAs: Prototyping a compiler, Proc Int Conf Eng Reconfigurable Syst Algorithms (ERSA), 1
- 10.1007/978-981-10-0591-6 · doi:10.1007/978-981-10-0591-6
- 10.1007/978-3-319-68161-0 · doi:10.1007/978-3-319-68161-0
- karpathy, 2018, Convolutional Neural Network for Visual Recognition
- van loan, 1996, Matrix Computations
- chung, 2017, Accelerating persistent neural networks at datacenter scale, Proc Hot Chips, 27
- 10.1109/FCCM.2015.15 · doi:10.1109/fccm.2015.15
- lecun, 2015, Lenet-5 convolutional neural networks
- graf, 2009, A massively parallel digital learning processor, Proc Adv Neural Inf Process Syst, 529
- collobert, 2008, Torch, Proc Workshop Mach Learn Open Source Softw (NIPS), 76, 113
- grangier, 2009, Deep convolutional networks for scene parsing, Proc ICML Deep Learn Workshop, 3, 109
- han, 2015, Learning both weights and connections for efficient neural network, Proc Adv Neural Inf Process Syst, 1135
- guennebaud, 2015, Eigen V3
- lecun, 1998, The MNIST Database of Handwritten Digits
- deshpande, 2018, A Beginner's Guide To Understanding Convolutional Neural Networks
- nichols, 2002, Feasibility of floating-point arithmetic in FPGA based artificial neural networks, Proc CAINE, 8
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Valueva, M. V., Nagornov, N. N., Lyakhov, P. A., Valuev, G. V., & Chervyakov, N. I. (2020) · Mathematics and Computers in Simulation · doi:10.1016/j.matcom.2020.04.031 · Cited by 478
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“Due to the increased demand for EI, small and high-density FPGAs are now being considered [11], [315], [316], [317].”
BackgroundMethodThe promise of artificial intelligence and deep learning in PET and SPECT imaging
Arabi, H., AkhavanAllaf, A., Sanaat, A., Shiri, I., & Zaidi, H. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.03.008 · Cited by 268
Ahmad, S., Shakeel, I., Mehfuz, S., & Ahmad, J. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100568 · Cited by 197
Soft Error Resilience of Deep Residual Networks for Object Recognition
Ibrahim, Y., Wang, H., Bai, M., Liu, Z., Wang, J., Yang, Z., & Chen, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2968129 · Cited by 72
Li, H.-C., Deng, Z.-Y., & Chiang, H.-H. (2020) · Sensors · doi:10.3390/s20216114 · Cited by 54
Autonomous marine robot based on AI recognition for permanent surveillance in marine protected areas
Molina-Molina, J. C., Salhaoui, M., Guerrero-González, A., & Arioua, M. (2021) · Sensors · doi:10.3390/s21082664 · Cited by 48
Edge ai: leveraging the full potential of deep learning
Shuvo, M. M. H. (2022) · Studies in Computational Intelligence · doi:10.1007/978-3-031-14748-7_2 · Cited by 18
Metadata
- Authors
- Shawahna, A., Sait, S. M., & El-Maleh, A.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 7823-7859
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2907463061
- Cited by
- 496
- References
- 210
- FWCI
- 20.81
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- King Fahd University of Petroleum and Minerals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.