[DL] A Survey of FPGA-based Neural Network Inference Accelerators
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Recent research on neural networks has shown a significant advantage in machine learning over traditional algorithms based on handcrafted features and models. Neural networks are now widely adopted in regions like image, speech, and video recognition. But the high computation and storage complexity of neural network inference poses great difficulty on its application. It is difficult for CPU platforms to offer enough computation capacity. GPU platforms are the first choice for neural network processes because of its high computation capacity and easy-to-use development frameworks. However, FPGA-based neural network inference accelerator is becoming a research topic. With specifically designed hardware, FPGA is the next possible solution to surpass GPU in speed and energy efficiency. Various FPGA-based accelerator designs have been proposed with software and hardware optimization techniques to achieve high speed and energy efficiency. In this article, we give an overview of previous work on neural network inference accelerators based on FPGA and summarize the main techniques used. An investigation from software to hardware, from circuit level to system level is carried out to complete analysis of FPGA-based neural network inference accelerator design and serves as a guide to future work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The research from Facebook shows the performance gain by porting DNN applications to specific hardware accelerators may not be able to compensate the significant engineering effort spent due to the poor ecosystems and program-ability [20].”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [20]
In the citing paper
“However, static DNN models are unable to achieve such guarantee under dynamic environment [20].”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [20]
In the citing paper
“Such variance may influence the quality of service (QoS) of applications without rigorously temporal requirement, like voice recognition, face recognition, machine translation, etc [20] and on the other hand may lead to catastrophic consequence for those with rigorously temporal requirement, (i.e., real-time requirement), like autonomous driving, UAV, etc.”
From Bringing ai to edge: from deep learning’s perspective (2022) · cites this paper as [20]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201 · cited 1×
“Neural network researchers are designing more efficient network models from AlexNet [28] to ResNet [22], SqueezeNet [25], and MobileNet [24].”
MethodHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416
Empirical Evaluation of Rectified Activations in Convolutional Network
Xu, B., Wang, N., Chen, T., & Li, M. (2015) · arXiv · doi:10.48550/arxiv.1505.00853 · Cited by 2,264
Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks
Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., & Cong, J. (2015) · Proceedings of the 2015 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2684746.2689060 · Cited by 2,158 · cited 4×
“[74] introduce the roofline model in their work to analyze whether a design is memory bounded or computation bounded.”
BackgroundMethodInfluentialDeep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
Self-citationDoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
Zhou, S., Wu, Y., Ni, Z., Zhou, X., Wen, H., & Zou, Y. (2016) · arXiv · doi:10.48550/arxiv.1606.06160 · Cited by 1,690
Going Deeper with Embedded FPGA Platform for Convolutional Neural Network
Qiu, J., Wang, J., Yao, S., Guo, K., Li, B., Zhou, E., Yu, J., Tang, T., Xu, N., Song, S., et al. (2016) · Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2847263.2847265 · Cited by 1,252
Self-citationFINN: A Framework for Fast, Scalable Binarized Neural Network Inference
Umuroglu, Y., Fraser, N. J., Gambardella, G., Blott, M., Leong, P., Jahre, M., & Vissers, K. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021744 · Cited by 1,189
TVM: an automated end-to-end optimizing compiler for deep learning
(2018) · arXiv (Cornell University) · doi:10.5555/3291168.3291211 · Cited by 1,170
Zhu, C., Han, S., Mao, H., & Dally, W. J. (2016) · arXiv · doi:10.48550/arxiv.1612.01064 · Cited by 865
Alwani, M., Chen, H., Ferdman, M., & Milder, P. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783725 · Cited by 662 · cited 1×
“[5] address the external memory access problem by fusing two neighboring layers together to avoid the intermediate result transfer between the two layers.”
BackgroundESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA
Han, S., Kang, J., Mao, H., Hu, Y., Li, X., Li, Y., Xie, D., Luo, H., Yao, S., Wang, Y., et al. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021745 · Cited by 591 · cited 9×
“ESE [19] adopts 12-bit fixed-point weight and 16-bit fixed-point neurons design.”
BackgroundMethodResultInfluentialSelf-citationAngel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGA
Guo, K., Sui, L., Qiu, J., Yu, J., Wang, J., Yao, S., Han, S., Wang, Y., & Yang, H. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2705069 · Cited by 562
Self-citationThroughput-Optimized OpenCL-based FPGA Accelerator for Large-Scale Convolutional Neural Networks
Suda, N., Chandra, V., Dasika, G., Mohanty, A., Ma, Y., Vrudhula, S., Seo, J.-S., & Cao, Y. (2016) · Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/2847263.2847276 · Cited by 553
Arithmetic Complexity of Computations
Winograd, S. (1980) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970364 · Cited by 535
Accelerating Binarized Convolutional Neural Networks with Software-Programmable FPGAs
Zhao, R., Song, W., Zhang, W., Xing, T., Lin, J.-H., Srivastava, M., Gupta, R., & Zhang, Z. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021741 · Cited by 429
Automated Systolic Array Architecture Synthesis for High Throughput CNN Inference on FPGAs
Wei, X., Yu, C. H., Zhang, P., Chen, Y., Wang, Y., Hu, H., Liang, Y., & Cong, J. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062207 · Cited by 426
Self-citationOptimizing Loop Operation and Dataflow in FPGA Acceleration of Deep Convolutional Neural Networks
Ma, Y., Cao, Y., Vrudhula, S., & Seo, J.-S. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021736 · Cited by 389
From high-level deep neural models to FPGAs
Sharma, H., Park, J., Mahajan, D., Amaro, E., Kim, J. K., Shao, C., Mishra, A., & Esmaeilzadeh, H. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783720 · Cited by 365
DNNBuilder: an automated tool for building high-performance DNN hardware accelerators for FPGAs
Zhang, X., Wang, J., Zhu, C., Lin, Y., Xiong, J., Hwu, W.-M., & Chen, D. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3240801 · Cited by 345
Accelerating Binarized Neural Networks: Comparison of FPGA, CPU, GPU, and ASIC
Nurvitadhi, E., Sheffield, D., Sim, J., Mishra, A., Venkatesh, G., & Marr, D. (2016) · 2016 International Conference on Field-Programmable Technology (FPT) · doi:10.1109/fpt.2016.7929192 · Cited by 342
Guan, Y., Liang, H., Xu, N., Wang, W., Shi, S., Chen, X., Sun, G., Zhang, W., & Cong, J. (2017) · 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.25 · Cited by 308
Caffeine: towards uniformed representation and acceleration for deep convolutional neural networks
Zhang, C., Fang, Z., Zhou, P., Pan, P., & Cong, J. (2016) · Proceedings of the 35th International Conference on Computer-Aided Design · doi:10.1145/2966986.2967011 · Cited by 299
Efficient and accurate approximations of nonlinear convolutional networks
Zhang, X., Zou, J., Ming, X., He, K., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298809 · Cited by 262
Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs
Lu, L., Liang, Y., Xiao, Q., & Yan, S. (2017) · 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.64 · Cited by 248
An OpenCL™ Deep Learning Accelerator on Arria 10
Aydonat, U., O'Connell, S., Capalija, D., Ling, A. C., & Chiu, G. R. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021738 · Cited by 229
Energy-Efficient CNN Implementation on a Deeply Pipelined FPGA Cluster
Zhang, C., Wu, D., Sun, J., Sun, G., Luo, G., & Cong, J. (2016) · Proceedings of the 2016 International Symposium on Low Power Electronics and Design · doi:10.1145/2934583.2934644 · Cited by 227
Improving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network
Zhang, J., & Li, J. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021698 · Cited by 208
Design space exploration of FPGA-based Deep Convolutional Neural Networks
Motamedi, M., Gysel, P., Akella, V., & Ghiasi, S. (2016) · 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2016.7428073 · Cited by 206
DeepBurning: automatic generation of FPGA-based learning accelerators for the neural network family
Wang, Y., Xu, J., Han, Y., Li, H., & Li, X. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898003 · Cited by 205
Self-citationExploring Heterogeneous Algorithms for Accelerating Deep Convolutional Neural Networks on FPGAs
Xiao, Q., Liang, Y., Lu, L., Yan, S., & Tai, Y.-W. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062244 · Cited by 202
Toolflows for Mapping Convolutional Neural Networks on FPGAs: A Survey and Future Directions
Venieris, S. I., Kouris, A., & Bouganis, C.-S. (2019) · ACM Computing Surveys · doi:10.1145/3186332 · Cited by 189
FPGA-based accelerator for long short-term memory recurrent neural networks
Guan, Y., Yuan, Z., Sun, G., & Cong, J. (2017) · 2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858394 · Cited by 180
C ir CNN: accelerating and compressing deep neural networks using block-circulant weight matrices
Ding, C., Liao, S., Wang, Y., Li, Z., Liu, N., Zhuo, Y., Wang, C., Qian, X., Bai, Y., Yuan, G., et al. (2017) · Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1145/3123939.3124552 · Cited by 176
Self-citationFrequency Domain Acceleration of Convolutional Neural Networks on CPU-FPGA Shared Memory System
Zhang, C., & Prasanna, V. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021727 · Cited by 158
Ma, Y., Cao, Y., Vrudhula, S., & Seo, J.-S. (2017) · 2017 27th International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056824 · Cited by 134
ReBNet: Residual Binarized Neural Network
Ghasemzadeh, M., Samragh, M., & Koushanfar, F. (2018) · 2018 IEEE 26th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2018.00018 · Cited by 132
Escher: A CNN Accelerator with Flexible Buffering to Minimize Off-Chip Transfer
Shen, Y., Ferdman, M., & Milder, P. (2017) · 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.47 · Cited by 106
Towards a Uniform Template-based Architecture for Accelerating 2D and 3D CNNs on FPGA
Shen, J., Huang, Y. R., Wang, Z., Qiao, Y., Wen, M., & Zhang, C. (2018) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3174243.3174257 · Cited by 106
Proceedings of the 2014 International Conference on Field-Programmable Technology, FPT 2014
Wu, Y., Nunez-Yanez, J. L., Woods, R., & Nikolopoulos, D. S. (2015) · Field-Programmable Technology · Cited by 104
Design Flow of Accelerating Hybrid Extremely Low Bit-Width Neural Network in Embedded FPGA
Wang, J., Lou, Q., Zhang, X., Zhu, C., Lin, Y., & Chen, D. (2018) · 2018 28th International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2018.00035 · Cited by 104
Caffeinated FPGAs: FPGA framework For Convolutional Neural Networks
DiCecco, R., Lacey, G., Vasiljevic, J., Chow, P., Taylor, G., & Areibi, S. (2016) · 2016 International Conference on Field-Programmable Technology (FPT) · doi:10.1109/fpt.2016.7929549 · Cited by 103
Fast and efficient implementation of Convolutional Neural Networks on FPGA
Podili, A., Zhang, C., & Prasanna, V. K. (2017) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap.2017.7995253 · Cited by 94
Accelerating low bit-width convolutional neural networks with embedded FPGA
Jiao, L., Luo, C., Cao, W., Zhou, X., & Wang, L. (2017) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056820 · Cited by 82
Scalable high-performance architecture for convolutional ternary neural networks on FPGA
Prost-Boucle, A., Bourge, A., Petrot, F., Alemdar, H., Caldwell, N., & Leroy, V. (2017) · 2017 27th International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056850 · Cited by 78
A fully connected layer elimination for a binarizec convolutional neural network on an FPGA
Nakahara, H., Fujii, T., & Sato, S. (2017) · 2017 27th International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056771 · Cited by 74
Customizing Neural Networks for Efficient FPGA Implementation
Samragh, M., Ghasemzadeh, M., & Koushanfar, F. (2017) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.43 · Cited by 54
Overcoming resource underutilization in spatial CNN accelerators
Shen, Y., Ferdman, M., & Milder, P. A. (2016) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2016.7577315 · Cited by 48
Face Recognition with Hybrid Efficient Convolution Algorithms on FPGAs
Zhuge, C., Liu, X., Zhang, X., Gummadi, S., Xiong, J., & Chen, D. (2018) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3194554.3194597 · Cited by 46
fpgaConvNet: Automated Mapping of Convolutional Neural Networks on FPGAs (Abstract Only)
Venieris, S. I., & Bouganis, C.-S. (2017) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3020078.3021791 · Cited by 45
A Fully Onchip Binarized Convolutional Neural Network FPGA Impelmentation with Accurate Inference
Li, Y., He, Z., & Fan, D. (2018) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/3218603.3218615 · Cited by 45
Li, Y., Liu, Z., Xu, K., Yu, H., & Ren, F. (2017) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3020078.3021786 · Cited by 42
Instruction driven cross-layer CNN accelerator with winograd transformation on FPGA
Yu, J., Hu, Y., Ning, X., Qiu, J., Guo, K., Wang, Y., & Yang, H. (2017) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/fpt.2017.8280147 · Cited by 42
Self-citationA high-throughput reconfigurable processing array for neural networks
Wu, E., Zhang, X., Berman, D., & Cho, I. (2017) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056794 · Cited by 37
Bit-Width Based Resource Partitioning for CNN Acceleration on FPGA
Guo, J., Yin, S., Ouyang, P., Liu, L., & Wei, S. (2017) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.13 · Cited by 21
Lin, X., Yin, S., Tu, F., Liu, L., Li, X., & Wei, S. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3195970.3196067 · Cited by 18
A Batch Normalization Free Binarized Convolutional Deep Neural Network on an FPGA (Abstract Only)
Nakahara, H., Yonekawa, H., Iwamoto, H., & Motomura, M. (2017) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3020078.3021782 · Cited by 13
Minimalist Design for Accelerating Convolutional Neural Networks for Low-End FPGA Platforms
Morcel, R., Akkary, H. H., Hajj, H. M., Saghir, M. A. R., Keshavamurthy, A. S., Khanna, R., & Artail, H. A. (2017) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.62 · Cited by 7
Research works printed but not linked: 14
- DeePhi Tech . 2017. DNNDK. Retrieved December 3, 2018 from http://www.deephi.com/technology/dnndk. DeePhi Tech. 2017. DNNDK. Retrieved December 3, 2018 from http://www.deephi.com/technology/dnndk.
- Martín Abadi , Ashish Agarwal , Paul Barham , Eugene Brevdo , Zhifeng Chen , Craig Citro , Greg S. Corrado , Andy Davis , Jeffrey Dean , Matthieu Devin , 2016 . Tensorflow: A system for large-scale machine learning . In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI’16) . 265--283. Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. 2016. Tensorflow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI’16). 265--283.
- 10.5555/3195638.3195664 · doi:10.5555/3195638.3195664
- Wenlin Chen , James Wilson , Stephen Tyree , Kilian Weinberger , and Yixin Chen . 2015 . Compressing neural networks with the hashing trick . In Proceedings of the International Conference on Machine Learning. 2285--2294 . Wenlin Chen, James Wilson, Stephen Tyree, Kilian Weinberger, and Yixin Chen. 2015. Compressing neural networks with the hashing trick. In Proceedings of the International Conference on Machine Learning. 2285--2294.
- P. K. Gupta . 2016 . Accelerating datacenter workloads . In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16) . P. K. Gupta. 2016. Accelerating datacenter workloads. In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16).
- Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates etal 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). Awni Hannun Carl Case Jared Casper Bryan Catanzaro Greg Diamos Erich Elsen Ryan Prenger Sanjeev Satheesh Shubho Sengupta Adam Coates et al. 2014. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567 (2014). · arXiv
- Fengfu Li , Bo Zhang , and Bin Liu . 2016. Ternary weight networks. arXiv preprint arXiv:1605.04711 ( 2016 ). Fengfu Li, Bo Zhang, and Bin Liu. 2016. Ternary weight networks. arXiv preprint arXiv:1605.04711 (2016). · arXiv
- Huimin Li , Xitian Fan , Li Jiao , Wei Cao , Xuegong Zhou , and Lingli Wang . 2016 . A high performance FPGA-based accelerator for large-scale convolutional neural networks . In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16) . IEEE, 1--9. Huimin Li, Xitian Fan, Li Jiao, Wei Cao, Xuegong Zhou, and Lingli Wang. 2016. A high performance FPGA-based accelerator for large-scale convolutional neural networks. In Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL’16). IEEE, 1--9.
- Huizi Mao , Song Han , Jeff Pool , Wenshuo Li , Xingyu Liu , Yu Wang , and William J. Dally . 2017. Exploring the granularity of sparsity in convolutional neural networks . In Proceedings of the Computer Vision and Pattern Recognition Workshops. 1927--1934 . Huizi Mao, Song Han, Jeff Pool, Wenshuo Li, Xingyu Liu, Yu Wang, and William J. Dally. 2017. Exploring the granularity of sparsity in convolutional neural networks. In Proceedings of the Computer Vision and Pattern Recognition Workshops. 1927--1934.
- Duncan J. M. Moss , Eriko Nurvitadhi , Jaewoong Sim , Asit Mishra , Debbie Marr , Suchit Subhaschandra , and Philip H. W. Leong . 2017. High performance binary neural networks on the Xeon+FPGA™ platform . In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17) . IEEE, 1--4. Duncan J. M. Moss, Eriko Nurvitadhi, Jaewoong Sim, Asit Mishra, Debbie Marr, Suchit Subhaschandra, and Philip H. W. Leong. 2017. High performance binary neural networks on the Xeon+FPGA™ platform. In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17). IEEE, 1--4.
- 10.5555/3130379.3130591 · doi:10.5555/3130379.3130591
- 10.5555/3195638.3195659 · doi:10.5555/3195638.3195659
- Stylianos I. Venieris and Christos-Savvas Bouganis. 2017. Latency-driven design for FPGA-based convolutional neural networks . In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17) . IEEE, 1--8. Stylianos I. Venieris and Christos-Savvas Bouganis. 2017. Latency-driven design for FPGA-based convolutional neural networks. In Proceedings of the 27th International Conference on Field Programmable Logic and Applications (FPL’17). IEEE, 1--8.
- Xin Wang , Fisher Yu , Zi-Yi Dou , and Joseph E . Gonzalez . 2017 . Skipnet : Learning dynamic routing in convolutional networks. arXiv preprint arXiv:1711.09485 (2017). Xin Wang, Fisher Yu, Zi-Yi Dou, and Joseph E. Gonzalez. 2017. Skipnet: Learning dynamic routing in convolutional networks. arXiv preprint arXiv:1711.09485 (2017). · arXiv
Cited by
Pruning and quantization for deep neural network acceleration: A survey
Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 943
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304049 · Cited by 424
A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms
Silvano, C., Ielmini, D., Ferrandi, F., Fiorin, L., Curzel, S., Benini, L., Conti, F., Garofalo, A., Zambelli, C., Calore, E., et al. (2025) · ACM Computing Surveys · doi:10.1145/3729215 · Cited by 262
Fast convolutional neural networks on FPGAs with hls4ml
Aarrestad, T. K., Lončar, V., Ghielmetti, N., Pierini, M., Summers, S., Ngadiuba, J., Petersson, C., Linander, H., Iiyama, Y., Guglielmo, G. D., et al. (2021) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ac0ea1 · Cited by 225
The Deep Learning Compiler: A Comprehensive Survey
Li, M., Liu, Y., Liu, X., Sun, Q., You, X., Yang, H., Luan, Z., Gan, L., Yang, G., & Qian, D. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3030548 · Cited by 215
Self-citation
Metadata
- Authors
- Guo, K., Zeng, S., Yu, J., Wang, Y., & Yang, H.
- Affiliations
- Tsinghua University (CN)
- Venue
- ACM Transactions on Reconfigurable Technology and Systems
- Published
- 2019-03-28
- Volume
- 12
- Issue
- 1
- Pages
- 1-26
- ISSN
- 1936-7406 (ISSN-L)
- 1936-7414
- OpenAlex
- W2997106510
- Cited by
- 292
- References
- 65
- Citations by year
- 2026: 43 · 2025: 37 · 2024: 29 · 2023: 44 · 2022: 42 · 2021: 54 · 2020: 34 · 2019: 9
- FWCI
- 35.21
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Reconfigurable Technology and Systems (publishedVersion)
- Funders
- National Key R&D Program of China (2018YFB0105005, 2017YFA0207600)
- National Natural Science Foundation of China (61622403, 61621091)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › VLSI and FPGA Design Techniques
- Keywords
- FPGA, neural network inference, hardware acceleration, energy efficiency, program optimization, hardware optimization, GPU comparison, machine learning hardware
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.