[DL] A Survey of FPGA-based Neural Network Inference Accelerators
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Recent research on neural networks has shown a significant advantage in machine learning over traditional algorithms based on handcrafted features and models. Neural networks are now widely adopted in regions like image, speech, and video recognition. But the high computation and storage complexity of neural network inference poses great difficulty on its application. It is difficult for CPU platforms to offer enough computation capacity. GPU platforms are the first choice for neural network processes because of its high computation capacity and easy-to-use development frameworks. However, FPGA-based neural network inference accelerator is becoming a research topic. With specifically designed hardware, FPGA is the next possible solution to surpass GPU in speed and energy efficiency. Various FPGA-based accelerator designs have been proposed with software and hardware optimization techniques to achieve high speed and energy efficiency. In this article, we give an overview of previous work on neural network inference accelerators based on FPGA and summarize the main techniques used. An investigation from software to hardware, from circuit level to system level is carried out to complete analysis of FPGA-based neural network inference accelerator design and serves as a guide to future work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The research from Facebook shows the performance gain by porting DNN applications to specific hardware accelerators may not be able to compensate the significant engineering effort spent due to the poor ecosystems and program-ability [20].”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [20]
In the citing paper
“However, static DNN models are unable to achieve such guarantee under dynamic environment [20].”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [20]
In the citing paper
“Such variance may influence the quality of service (QoS) of applications without rigorously temporal requirement, like voice recognition, face recognition, machine translation, etc [20] and on the other hand may lead to catastrophic consequence for those with rigorously temporal requirement, (i.e., real-time requirement), like autonomous driving, UAV, etc.”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [20]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 5×
“Besides CONV and FC layers, NN layers also have pooling, ReLU [28], concat [58], elementwise [22], and other types of layers.”
BackgroundMethodInfluentialVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 6×
“For certain networks like VGG [56], only 3 × 3 convolution kernels are used.”
BackgroundMethodInfluentialImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 26×
“In Table 1, we list the number of operations, number of parameters (add or multiplication), and top-1 accuracy on the ImageNet dataset [50] of state-of-the-art CNN models.”
BackgroundMethodInfluentialGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 7×
“In Table 1, we list the number of operations, number of parameters (add or multiplication), and top-1 accuracy on the ImageNet dataset [50] of state-of-the-art CNN models.”
MethodInfluentialRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 1×
“New features like depthwise convolution [24] and the complex branch in SSD [34] may brings more design opportunities.”
BackgroundMobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015 · cited 4×
“AlexNet [28] VGG19 [56] ResNet152 [22] MobileNet [24] ShuffleNet [79] Year 2012 2014 2016 2017 2017 # Param 60M 144M 57M 4.”
BackgroundMethodInfluentialProceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · cited 3×
“Development frameworks like Caffe [26] and Tensorflow [4] also offer easy-to-use interfaces, which makes GPU the first choice of neural network acceleration.”
Method
Research works printed but not linked: 14
- DeePhi Tech . 2017. DNNDK. Retrieved December 3, 2018 from http://www.deephi.com/technology/dnndk. DeePhi Tech. 2017. DNNDK. Retrieved December 3, 2018 from http://www.deephi.com/technology/dnndk.
- Martín Abadi , Ashish Agarwal , Paul Barham , Eugene Brevdo , Zhifeng Chen , Craig Citro , Greg S. Corrado , Andy Davis , Jeffrey Dean , Matthieu Devin , 2016 . Tensorflow: A system for large-scale machine learning . In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI’16) . 265--283. Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. 2016. Tensorflow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI’16). 265--283.
- 10.5555/3195638.3195664 · doi:10.5555/3195638.3195664
- Wenlin Chen , James Wilson , Stephen Tyree , Kilian Weinberger , and Yixin Chen . 2015 . Compressing neural networks with the hashing trick . In Proceedings of the International Conference on Machine Learning. 2285--2294 . Wenlin Chen, James Wilson, Stephen Tyree, Kilian Weinberger, and Yixin Chen. 2015. Compressing neural networks with the hashing trick. In Proceedings of the International Conference on Machine Learning. 2285--2294.
- P. K. Gupta . 2016 . Accelerating datacenter workloads . In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16) . P. K. Gupta. 2016. Accelerating datacenter workloads. In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16).
- Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates etal 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates et al. 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). · arXiv
- Fengfu Li , Bo Zhang , and Bin Liu . 2016. Ternary weight networks. arXiv preprint arXiv:1605.04711 ( 2016 ). Fengfu Li, Bo Zhang, and Bin Liu. 2016. Ternary weight networks. arXiv preprint arXiv:1605.04711 (2016). · arXiv
- Huimin Li , Xitian Fan , Li Jiao , Wei Cao , Xuegong Zhou , and Lingli Wang . 2016 . A high performance FPGA-based accelerator for large-scale convolutional neural networks . In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16) . IEEE, 1--9. Huimin Li, Xitian Fan, Li Jiao, Wei Cao, Xuegong Zhou, and Lingli Wang. 2016. A high performance FPGA-based accelerator for large-scale convolutional neural networks. In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16). IEEE, 1--9.
- Huizi Mao , Song Han , Jeff Pool , Wenshuo Li , Xingyu Liu , Yu Wang , and William J. Dally . 2017. Exploring the granularity of sparsity in convolutional neural networks . In Proceedings of the Computer Vision and Pattern Recognition Workshops. 1927--1934 . Huizi Mao, Song Han, Jeff Pool, Wenshuo Li, Xingyu Liu, Yu Wang, and William J. Dally. 2017. Exploring the granularity of sparsity in convolutional neural networks. In Proceedings of the Computer Vision and Pattern Recognition Workshops. 1927--1934.
- Duncan J. M. Moss , Eriko Nurvitadhi , Jaewoong Sim , Asit Mishra , Debbie Marr , Suchit Subhaschandra , and Philip H. W. Leong . 2017. High performance binary neural networks on the Xeon+FPGA™ platform . In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17) . IEEE, 1--4. Duncan J. M. Moss, Eriko Nurvitadhi, Jaewoong Sim, Asit Mishra, Debbie Marr, Suchit Subhaschandra, and Philip H. W. Leong. 2017. High performance binary neural networks on the Xeon+FPGA™ platform. In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17). IEEE, 1--4.
- 10.5555/3130379.3130591 · doi:10.5555/3130379.3130591
- 10.5555/3195638.3195659 · doi:10.5555/3195638.3195659
- Stylianos I. Venieris and Christos-Savvas Bouganis. 2017. Latency-driven design for FPGA-based convolutional neural networks . In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17) . IEEE, 1--8. Stylianos I. Venieris and Christos-Savvas Bouganis. 2017. Latency-driven design for FPGA-based convolutional neural networks. In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17). IEEE, 1--8.
- Xin Wang , Fisher Yu , Zi-Yi Dou , and Joseph E . Gonzalez . 2017 . Skipnet : Learning dynamic routing in convolutional networks. arXiv preprint arXiv:1711.09485 (2017). Xin Wang, Fisher Yu, Zi-Yi Dou, and Joseph E. Gonzalez. 2017. Skipnet: Learning dynamic routing in convolutional networks. arXiv preprint arXiv:1711.09485 (2017). · arXiv
Cited by
Pruning and quantization for deep neural network acceleration: A survey
Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 943
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304049 · Cited by 424
A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms
Silvano, C., Ielmini, D., Ferrandi, F., Fiorin, L., Curzel, S., Benini, L., Conti, F., Garofalo, A., Zambelli, C., Calore, E., et al. (2025) · ACM Computing Surveys · doi:10.1145/3729215 · Cited by 262
Fast convolutional neural networks on FPGAs with hls4ml
Aarrestad, T. K., Lončar, V., Ghielmetti, N., Pierini, M., Summers, S., Ngadiuba, J., Petersson, C., Linander, H., Iiyama, Y., Guglielmo, G. D., et al. (2021) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ac0ea1 · Cited by 225
The Deep Learning Compiler: A Comprehensive Survey
Li, M., Liu, Y., Liu, X., Sun, Q., You, X., Yang, H., Luan, Z., Gan, L., Yang, G., & Qian, D. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3030548 · Cited by 215
Self-citationHardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
Azghadi, M. R., Lammie, C., Eshraghian, J. K., Payvand, M., Donati, E., Linares-Barranco, B., & Indiveri, G. (2020) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2020.3036081 · Cited by 212
Coelho, C. N., Kuusela, A., Li, S., Zhuang, H., Ngadiuba, J., Aarrestad, T. K., Loncar, V., Pierini, M., Pol, A. A., & Summers, S. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00356-5 · Cited by 197
A systematic literature review on hardware implementation of artificial intelligence algorithms
Talib, M. A., Majzoub, S., Nasir, Q., & Jamal, D. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-020-03325-8 · Cited by 188
Efficient Hardware Architectures for Accelerating Deep Neural Networks: Survey
Pudi, D., Boppu, S., Manikandan, M. S., & Cenkeramaddi, L. R. (2022) · IEEE Access · doi:10.1109/access.2022.3229767 · Cited by 180
Mixed Precision DNNs: All you need is a good parametrizationPreprint
Uhlich, S., Mauch, L., Cardinaux, F., Yoshiyama, K., García, J. A., Tiedemann, S., Kemp, T., & Nakamura, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11452 · Cited by 178
Survey and Benchmarking of Machine Learning Accelerators
Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J. (2019) · 2019 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec.2019.8916327 · Cited by 175
Bringing ai to edge: from deep learning’s perspective
Liu, D., Kong, H., Luo, X., Liu, W., & Subramaniam, R. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.04.141 · Cited by 171
“…accelerators are proposed and many companies are dedicated to develop specific hardware architectures to speed up the execution of DNN models, such as application-specific integrated circuits (ASICs) Tensor Processing Unit (TPU) [15] and DianNao family [16], and FPGA-based accelerators ESE [17] [18].”
BackgroundToward Intelligent Sensing: Intermediate Deep Feature Compression
Chen, Z., Fan, K., Wang, S., Duan, L., Lin, W., & Kot, A. C. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2941660 · Cited by 168
Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going
Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W., Cheung, P. Y. K., & Constantinides, G. A. (2020) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 166
Survey of Machine Learning Accelerators
Reuther, A., Michaleas, P., Jones, M., Gadepally, V., Samsi, S., & Kepner, J. (2020) · 2020 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec43674.2020.9286149 · Cited by 163
“not be included this year, namely most FPGA-based inference instances [7]–[10] and smartphone accelerators.”
BackgroundDeep Learning on Mobile and Embedded Devices: State-of-the-art, Challenges, and Future Directions
Chen, Y., Zheng, B., Zhang, Z., Wang, Q., Shen, C., & Zhang, Q. (2021) · ACM Computing Surveys · doi:10.1145/3398209 · Cited by 159
Hyperspectral image classification using CNN: Application to industrial food packaging
Medus, L. D., Saban, M., Francés-Víllora, J. V., Bataller-Mompeán, M., & Rosado-Muñoz, A. (2021) · Food Control · doi:10.1016/j.foodcont.2021.107962 · Cited by 159
A Survey of FPGA-Based Robotic Computing
Wan, Z., Bo, Y., Li, T. Y., Tang, J., Zhu, Y., Wang, Y., Raychowdhury, A., & Liu, S. (2021) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2021.3071609 · Cited by 151
“Many FPGA-based CNN accelerator implementations have been summarized in [15].”
BackgroundSelf-citationAn Efficient Hardware Accelerator for Structured Sparse Convolutional Neural Networks on FPGAs
Zhu, C., Huang, K., Yang, S., Zhu, Z., Zhang, H., & Shen, H. (2020) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2020.3002779 · Cited by 150
Deep learning in electron microscopy
Ede, J. M. (2021) · Machine Learning Science and Technology · doi:10.1088/2632-2153/abd614 · Cited by 143
A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing
Véstias, M. P. (2019) · Algorithms · doi:10.3390/a12080154 · Cited by 112
A Systematic Literature Review on Hardware Reliability Assessment Methods for Deep Neural Networks
Ahmadilivani, M. H., Taheri, M., Raik, J., Daneshtalab, M., & Jenihhin, M. (2024) · ACM Computing Surveys · doi:10.1145/3638242 · Cited by 132
“…accelerators’ ability to perform correctly in the presence of faults, which may occur during the deployment caused by physical effects either from the environment (e.g., soft errors, electromagnetic effects) or from within the device (e.g., manufacturing defects, aging effects, process variations).”
BackgroundInfluentialOn the Resilience of RTL NN Accelerators: Fault Characterization and Mitigation
Salami, B., Ünsal, O., & Kestelman, A. C. (2018) · International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) · doi:10.1109/cahpc.2018.8645906 · Cited by 114
FPGA-based Deep Learning Inference Accelerators: Where Are We Standing?
Nechi, A., Groth, L., Mulhem, S., Merchant, F., Buchty, R., & Bereković, M. (2023) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3613963 · Cited by 113
A pseudo-softmax function for hardware-based high speed image classification
Cardarilli, G. C., Di Nunzio, L., Fazzolari, R., Giardino, D., Nannarelli, A., Re, M., & Spanò, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-94691-7 · Cited by 83
Review of ASIC accelerators for deep neural network
Machupalli, R., Hossain, M., & Mandal, M. K. (2022) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2022.104441 · Cited by 108
Accelerating CNN Inference on ASICs: A Survey
Moolchandani, D., Kumar, A., & Sarangi, S. R. (2020) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2020.101887 · Cited by 108
Neural Architecture Search Survey: A Hardware Perspective
Chitty-Venkata, K. T., & Somani, A. K. (2023) · ACM Computing Surveys · doi:10.1145/3524500 · Cited by 106
Soft errors in DNN accelerators: A comprehensive review
Ibrahim, Y., Wang, H., Liu, J., Wei, J., Chen, L., Rech, P., Adam, K., & Guo, G. (2020) · Microelectronics Reliability · doi:10.1016/j.microrel.2020.113969 · Cited by 102
A Full Featured Configurable Accelerator for Object Detection With YOLO
Pestana, D. G., Miranda, P. R., Lopes, J. D., Duarte, R. P., Véstias, M. P., Neto, H. C., & de Sousa, J. T. (2021) · IEEE Access · doi:10.1109/access.2021.3081818 · Cited by 102
Custom Hardware Architectures for Deep Learning on Portable Devices: A Review
Zaman, K. S., Reaz, M. B. I., Ali, S. H. M., Bakar, A. A. A., & Chowdhury, M. E. H. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3082304 · Cited by 102
Moving Deep Learning to the Edge
Véstias, M. P., Duarte, R. P., de Sousa, J. T., & Neto, H. C. (2020) · Algorithms · doi:10.3390/a13050125 · Cited by 73
Molina, R., Gil-Costa, V., Crespo, M. L., & Ramponi, G. (2022) · IEEE Access · doi:10.1109/access.2022.3201107 · Cited by 84
“Technologies such as field programmable gate array (FPGA) and system on chip (SoC) based on FPGA (FPGA/SoC) [1], [2], [3], [4] have shown their ability to accelerate intensive computing applications while saving power consumption, owing to their capability of high parallelism and reconfiguration of the architecture.”
BackgroundXu, Z., Tang, B., Zhang, X., Leong, J. F., Pan, J., Hooda, S., Zamburg, E. G., & Thean, A. (2022) · Light Science & Applications · doi:10.1038/s41377-022-00976-5 · Cited by 81
Liu, X., Yang, J., Zou, C., Chen, Q., Yan, X., Chen, Y., & Cai, C. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2021.3059318 · Cited by 79
Resource Usage and Performance Trade-offs for Machine Learning Models in Smart Environments
Preuveneers, D., Tsingenopoulos, I., & Joosen, W. (2020) · Sensors · doi:10.3390/s20041176 · Cited by 58
“…hardware solutions—such as neuromorphic computing chips [51] that emulate the electrical behavior of neurons in the brain, or FPGA-based accelerators [52]—will enable the evaluation of neural networks at a very low energy cost and can turn into a tipping-point for deep learning at the edge.”
BackgroundLUTNet: Learning FPGA Configurations for Highly Efficient Neural Network Inference
Wang, E., Davis, J. J., Cheung, P. Y. K., & Constantinides, G. A. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2978817 · Cited by 75
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning InferencePreprint
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltín, M., Williams, R. S., Faraboschi, P., Hwu, W., Strachan, J. P., Roy, K., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10351 · Cited by 73
Soft Error Resilience of Deep Residual Networks for Object Recognition
Ibrahim, Y., Wang, H., Bai, M., Liu, Z., Wang, J., Yang, Z., & Chen, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2968129 · Cited by 72
“some level of neuron faults or noise (incomplete data) during computation [12], [13].”
BackgroundPrakash, S., Callahan, T., Bushagour, J., Banbury, C., Green, A. V., Warden, P., Ansell, T., & Reddi, V. J. (2023) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass57527.2023.00024 · Cited by 72
Kim, S., & Kim, H. (2021) · IEEE Access · doi:10.1109/access.2021.3054879 · Cited by 71
Real-time artificial intelligence for accelerator control: A study at the Fermilab Booster
John, J. M. S., Herwig, T. C., Kafkes, D., Mitrevski, J., Pellico, W. A., Perdue, G., Quintero-Parra, A., Schupbach, B., Seiya, K., Tran, N. V., et al. (2021) · Physical Review Accelerators and Beams · doi:10.1103/physrevaccelbeams.24.104601 · Cited by 71
A Survey of Domain-Specific Architectures for Reinforcement Learning
Rothmann, M., & Porrmann, M. (2022) · IEEE Access · doi:10.1109/access.2022.3146518 · Cited by 69
“In the domain of deep learning, FPGAs show promising results for the acceleration of neural network inference, as summarized in [26].”
MethodFPGA Implementation of Object Detection Accelerator Based on Vitis-AI
Wang, J., & Gu, S. (2021) · International Conference on Information Science and Technology · doi:10.1109/icist52614.2021.9440554 · Cited by 69
FPGA acceleration on a multi-layer perceptron neural network for digit recognition
Westby, I., Yang, X., Liu, T., & Xu, H. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-021-03849-7 · Cited by 67
An Experimental Study of Reduced-Voltage Operation in Modern FPGAs for Neural Network Acceleration
Salami, B., Onural, E. B., Yüksel, İ. E., Koç, F., Ergin, O., Kestelman, A. C., Ünsal, O., Sarbazi‐Azad, H., & Mutlu, O. (2020) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn48063.2020.00032 · Cited by 67
AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers
Faraone, J., Kumm, M., Hardieck, M., Zipf, P., Liu, X., Boland, D., & Leong, P. H. W. (2020) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2939429 · Cited by 66
Comprehensive Evaluation of Supply Voltage Underscaling in FPGA on-Chip Memories
Salami, B., Ünsal, O., & Kestelman, A. C. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00064 · Cited by 66
hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices
Fahim, F., Hawks, B., Herwig, C., Hirschauer, J., Jindariani, S., Tran, N., Carloni, L. P., Di Guglielmo, G., Harris, P., Krupa, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.05579 · Cited by 62
Rodríguez, I., Campos, C., & Fdez‐Riverola, F. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06830-w · Cited by 60
“…over the last 4 years (2017–2020) from different levels of abstraction, explore the use of machine learning techniques on terminal devices [32, 38, 56–58], and also publications explicitly circumscribed to the detection problem, that comprehensively review the most salient issues concerning…”
BackgroundPIR-DSP: An FPGA DSP Block Architecture for Multi-precision Deep Neural Networks
Rasoulinezhad, S., Zhou, H., Wang, L., & Leong, P. H. W. (2019) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2019.00015 · Cited by 60
Accelerating Attention Mechanism on FPGAs based on Efficient Reconfigurable Systolic Array
Ye, W., Zhou, X., Zhou, J. T., Chen, C., & Li, K. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3549937 · Cited by 58
“FPGA is widely used to accelerate deep learning algorithms for its high parallelism and low latency [8].”
MethodEfficient Error-Tolerant Quantized Neural Network Accelerators
Gambardella, G., Kappauf, J., Blott, M., Doehring, C., Kumm, M., Zipf, P., & Vissers, K. (2019) · Proceedings · doi:10.1109/dft.2019.8875314 · Cited by 57
Reliability Evaluation and Analysis of FPGA-Based Neural Network Acceleration System
Xu, D., Zhu, Z., Liu, C., Wang, Y., Zhao, S., Zhang, L., Liang, H., Li, H., & Cheng, K.-T. T. (2021) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2020.3046075 · Cited by 57
Self-citationMeetGo: A Trusted Execution Environment for Remote Applications on FPGA
Oh, H., Nam, K., Jeon, S., Cho, Y., & Paek, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3069223 · Cited by 56
A Depthwise Separable Convolution Architecture for CNN Accelerator
Srivastava, H. R., & Sarawadekar, K. P. (2020) · IEEE Applied Signal Processing Conference (ASPCON) · doi:10.1109/aspcon49795.2020.9276672 · Cited by 56
FPGA-based implementation of classification techniques: A survey
Saidi, A., Othman, S. B., Dhouibi, M., & Saoud, S. B. (2021) · Integration · doi:10.1016/j.vlsi.2021.08.004 · Cited by 55
Field-Programmable Gate Array Architecture for Deep Learning: Survey and Future Directions
Boutros, A., Arora, A., & Betz, V. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3623023 · Cited by 55
“…enhancements for DL. Interested readers can also find existing surveys of lower performance CNN and RNN accelerators on older FPGA architectures in [72] and [73], tool flows that facilitate their creation in [74], and optimization techniques to improve efficiency using DL model approximations such…”
Memory-Efficient Dataflow Inference for Deep CNNs on FPGA
Petrică, L., Alonso, T., Kroes, M., Fraser, N. J., Cotöfană, S., & Blott, M. (2020) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/icfpt51103.2020.00016 · Cited by 55
GenExp: Multi-objective pruning for deep neural network based on genetic algorithm
Xu, K., Zhang, D., An, J., Liu, L., Liu, L., & Wang, D. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.04.022 · Cited by 55
An Overview of FPGA Based Deep Learning Accelerators: Challenges and Opportunities
Wang, T., Wang, C., Zhou, X., & Chen, H. (2019) · 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc/smartcity/dss.2019.00229 · Cited by 53
Review of neural network model acceleration techniques based on FPGA platforms
Liu, F., Li, H., Hu, W., & He, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128511 · Cited by 54
Cosmas, K., & Kenichi, A. (2020) · Aerospace · doi:10.3390/aerospace7110159 · Cited by 51
“Guo et al., in [31], conducted a survey on FPGA-based NN inference accelerators.”
BackgroundSecurity of Cloud FPGAs: A SurveyPreprint
Jin, C., Gohil, V., Karri, R., & Rajendran, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.04867 · Cited by 51
Awano, H., & Hashimoto, M. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116302 · Cited by 50
High-Throughput Convolutional Neural Network on an FPGA by Customized JPEG Compression
Nakahara, H., Que, Z., & Luk, W. W. (2020) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm48280.2020.00010 · Cited by 49
Evaluating and analyzing the energy efficiency of CNN inference on high‐performance GPU
Yao, C., Liu, W., Tang, W., Guo, J., Hu, S., Lu, Y., & Jiang, W. (2020) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6064 · Cited by 49
Hardware-Software Co-Design for an Analog-Digital Accelerator for Machine Learning
Ambrosi, J., Ankit, A., Antunes, R., Chalamalasetti, S. R., Chatterjee, S., Hajj, I. E., Fachini, G. J. D. A., Faraboschi, P., Foltín, M., Huang, S., et al. (2018) · IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2018.8638612 · Cited by 47
Joint Task Offloading and Resource Allocation in Heterogeneous Edge Environments
Liu, Y., Mao, Y., Liu, Z., Ye, F., & Yang, Y. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3335198 · Cited by 46
Optimizing Temporal Convolutional Network Inference on FPGA-Based Accelerators
Carreras, M., Deriu, G., Raffo, L., Benini, L., & Meloni, P. (2020) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2020.3014503 · Cited by 46
“The landscape of FPGA-based accelerators for CNN is crowded and multifaceted [26].”
BackgroundA Binarized Neural Network Approach to Accelerate in-Vehicle Network Intrusion Detection
Zhang, L., Yan, X., & Ma, D. (2022) · IEEE Access · doi:10.1109/access.2022.3208091 · Cited by 44
Photonic-aware neural networks
Paolini, E., Marinis, L. D., Cococcioni, M., Valcarenghi, L., Maggiani, L., & Andriolli, N. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07243-z · Cited by 43
“The high degree of programmability and the advancements in terms of processing capabilities of digital electronic architectures of the last decades enabled the great achievements of DNNs [8].”
BackgroundCompiler Technologies in Deep Learning Co-Design: A Survey
Zhang, H., Xing, M., Wu, Y., & Zhao, C. (2023) · Intelligent Computing · doi:10.34133/icomputing.0040 · Cited by 41
FPGA-based low-batch training accelerator for modern CNNs featuring high bandwidth memory
Venkataramanaiah, S. K., Suh, H.-S., Yin, S., Nurvitadhi, E., Dasu, A. R., Cao, Y. K., & Seo, J.-S. (2020) · doi:10.1145/3400302.3415643 · Cited by 41
Onboard Powerline Perception System for UAVs Using mmWave Radar and FPGA-Accelerated Vision
Malle, N. H., Nyboe, F. F., & Ebeid, E. (2022) · IEEE Access · doi:10.1109/access.2022.3217537 · Cited by 40
“Central Processing Units (CPUs) and Graphics Processing Units (GPUs) are commonly used to run novel algorithms and handle a wide range of tasks [4].”
BackgroundEl-Maksoud, A. J. A., Ebbed, M. R., Khalil, A. H., & Mostafa, H. (2021) · IEEE Access · doi:10.1109/access.2021.3126838 · Cited by 39
FPGA/AI-Powered Architecture for Anomaly Network Intrusion Detection Systems
Pham‐Quoc, C., Bao, T. H. Q., & Thinh, T. N. (2023) · Electronics · doi:10.3390/electronics12030668 · Cited by 39
Increasing Flexibility of FPGA-based CNN Accelerators with Dynamic Partial Reconfiguration
Irmak, H., Ziener, D., & Alachiotis, N. (2021) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl53798.2021.00061 · Cited by 38
DeepAxe: A Framework for Exploration of Approximation and Reliability Trade-offs in DNN Accelerators
Taheri, M., Riazati, M., Ahmadilivani, M. H., Jenihhin, M., Daneshtalab, M., Raik, J., Sjödin, M., & Lisper, B. (2023) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed57927.2023.10129353 · Cited by 37
Challenges in Energy-Efficient Deep Neural Network Training with FPGA
Tao, Y., Ma, R., Shyu, M., & Chen, S. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00208 · Cited by 36
A Survey of FPGA-Based Vision Systems for Autonomous Cars
Castells‐Rufas, D., Ngo, V., Borrego-Carazo, J., Codina, M., Sanchez, C., Gil, D., & Carrabina, J. (2022) · IEEE Access · doi:10.1109/access.2022.3230282 · Cited by 36
A Hybrid GPU + FPGA System Design for Autonomous Driving Cars
Hao, C., Sarwari, A., Jin, Z., Abu-Haimed, H., Sew, D., Li, Y., Liu, X., Wu, B., Fu, D., Gu, J., et al. (2019) · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · doi:10.1109/sips47522.2019.9020540 · Cited by 35
FPG-AI: A Technology-Independent Framework for the Automation of CNN Deployment on FPGAs
Pacini, T., Rapuano, E., & Fanucci, L. (2023) · IEEE Access · doi:10.1109/access.2023.3263392 · Cited by 35
“architecture and the Single Processing Unit (SPU) architecture [38], [39].”
BackgroundMapping Neural Networks to FPGA-Based IoT Devices for Ultra-Low Latency Processing
Wielgosz, M., & Karwatowski, M. (2019) · Sensors · doi:10.3390/s19132981 · Cited by 35
A dedicated hardware accelerator for real-time acceleration of YOLOv2
Xu, K., Wang, X., Liu, X., Cao, C., Li, H., Peng, H., & Wang, D. (2020) · Journal of Real-Time Image Processing · doi:10.1007/s11554-020-00977-w · Cited by 35
Ultrafast jet classification at the HL-LHC
Odagiu, P., Que, Z., Duarte, J. M., Haller, J., Kasieczka, G., Lobanov, A., Lončar, V., Luk, W. W., Ngadiuba, J., Pierini, M., et al. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad5f10 · Cited by 34
“Previous efforts explore tools for translating neural network algorithms into FPGA firmware, as reviewed in references [27, 28].”
Multi-Tenant Cloud FPGA: A Survey on Security, Trust, and Privacy
Ahmed, M. K., Panoff, M., Mbongue, J. M., Saha, S. K., Tchinda, E. N., Mbua, P., & Bobda, C. (2025) · ACM Transactions on Reconfigurable Technology and Systems · doi:10.1145/3713078 · Cited by 34
Optofluidic imaging meets deep learning: from merging to emerging
Siu, D. M. D., Lee, K. C. M., Chung, B. M. F., Wong, J. S. J., Zheng, G., & Tsia, K. K. (2023) · Lab on a Chip · doi:10.1039/d2lc00813k · Cited by 34
Open-source FPGA-ML codesign for the MLPerf Tiny BenchmarkPreprint
Borras, H., Guglielmo, G. D., Duarte, J. M., Ghielmetti, N., Hawks, B., Hauck, S., Hsu, S.-C., Kastner, R., Liang, J., Meza, A., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.11791 · Cited by 34
Exploration of Activation Fault Reliability in Quantized Systolic Array-Based DNN Accelerators
Taheri, M., Cherezova, N., Ansari, M. S., Jenihhin, M., Mahani, A. K., Daneshtalab, M., & Raik, J. (2024) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed60706.2024.10528372 · Cited by 33
Network Intrusion Detection Using Neural Networks on FPGA SoCs
Ioannou, L., & Fahmy, S. A. (2019) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2019.00043 · Cited by 33
“Network pruning, data quantization, and reduced arithmetic precision can be exploited to trade off performance, power consumption, and detection accuracy [23, 24, 25].”
BackgroundA Winograd-Based CNN Accelerator with a Fine-Grained Regular Sparsity Pattern
Yang, T., Liao, Y., Shi, J., Liang, Y. E., Jing, N., & Jiang, L. (2020) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl50879.2020.00050 · Cited by 32
“FPGA has become a promising platform for accelerating CNN because of its high efficiency and high programmability [2].”
BackgroundInfluentialFast Algorithms for Quaternion-Valued Convolutional Neural Networks
Cariow, A., & Cariowa, G. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979682 · Cited by 30
Spatio-Temporal Optimization of Deep Neural Networks for Reconfigurable FPGA SoCs
Seyoum, B. B., Pagani, M., Biondi, A., Balleri, S., & Buttazzo, G. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.3033730 · Cited by 30
“Two major approaches have been proposed [9] to accelerate DNNs on FPGAs.”
BackgroundTAS: Ternarized Neural Architecture Search for Resource-Constrained Edge Devices
Loni, M., Mousavi, H., Riazati, M., Daneshtalab, M., & Sjödin, M. (2022) · Design, Automation, and Test in Europe · doi:10.23919/date54114.2022.9774615 · Cited by 29
MulNet: A Flexible CNN Processor With Higher Resource Utilization Efficiency for Constrained Devices
Hailesellasie, M., & Hasan, S. R. (2019) · IEEE Access · doi:10.1109/access.2019.2907865 · Cited by 29
Farsa, E. Z., Ahmadi, A., & Keszöcze, O. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3551934 · Cited by 28
“…digital implementations of AI algorithms and brain-inspired computing like neuromorphic systems and deep learning algorithms due to being flexible, reprogrammable, and reconfigurable, having short design and development times, and offering a short time to market [5], [6], [26], [27], [28], and [29].”
Tamm, J. A., Laanemets, E. K., & Siim, A. P. (2025) · SCCTS Transactions on Reconfigurable Computing · doi:10.31838/rcc/02.03.04 · Cited by 28
Zhang, X., Hao, C., Zhou, P., Jones, A. K., & Hu, J. (2022) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3489517.3530509 · Cited by 28
Horizontally Distributed Inference of Deep Neural Networks for AI-Enabled IoT
Rodríguez, I., Campos, C., & Fdez‐Riverola, F. (2023) · Sensors · doi:10.3390/s23041911 · Cited by 28
“…devices and accessories for accelerating ML tasks, such as application-specific integrated circuits (ASICs) [38,39], GPUs [40,41], and FPGAs [42,43]—have emerged as the infrastructure cornerstone of the recent AI trend known as on-device ML, underpinning an intense and still ongoing research…”
Metadata
- Authors
- Guo, K., Zeng, S., Yu, J., Wang, Y., & Yang, H.
- Affiliations
- Tsinghua University (CN)
- Venue
- ACM Transactions on Reconfigurable Technology and Systems
- Published
- 2019-03-28
- Volume
- 12
- Issue
- 1
- Pages
- 1-26
- ISSN
- 1936-7406 (ISSN-L)
- 1936-7414
- OpenAlex
- W2997106510
- Cited by
- 292
- References
- 65
- Citations by year
- 2026: 43 · 2025: 37 · 2024: 29 · 2023: 44 · 2022: 42 · 2021: 54 · 2020: 34 · 2019: 9
- FWCI
- 35.21
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Reconfigurable Technology and Systems (publishedVersion)
- Funders
- National Key R&D Program of China (2018YFB0105005, 2017YFA0207600)
- National Natural Science Foundation of China (61622403, 61621091)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › VLSI and FPGA Design Techniques
- Keywords
- FPGA, neural network inference, hardware acceleration, energy efficiency, program optimization, hardware optimization, GPU comparison, machine learning hardware
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.