A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
The convolutional neural network (CNN) is one of the most used deep learning models for image detection and classification, due to its high accuracy when compared to other machine learning algorithms. CNNs achieve better results at the cost of higher computing and memory requirements. Inference of convolutional neural networks is therefore usually done in centralized high-performance platforms. However, many applications based on CNNs are migrating to edge devices near the source of data due to the unreliability of a transmission channel in exchanging data with a central server, the uncertainty about channel latency not tolerated by many applications, security and data privacy, etc. While advantageous, deep learning on edge is quite challenging because edge devices are usually limited in terms of performance, cost, and energy. Reconfigurable computing is being considered for inference on edge due to its high performance and energy efficiency while keeping a high hardware flexibility that allows for the easy adaption of the target computing platform to the CNN model. In this paper, we described the features of the most common CNNs, the capabilities of reconfigurable computing for running CNNs, the state-of-the-art of reconfigurable computing implementations proposed to run CNN models, as well as the trends and challenges for future edge reconfigurable platforms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247 · cited 1×
“Eyeriss [54] is a coarse-grain reconfigurable device that accelerates convolutional neural networks.”
BackgroundThe Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
Hochreiter, S. (1998) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488598000094 · Cited by 2,939
Hubara, I., Soudry, D., & Yaniv, R. E. (2016) · arXiv · doi:10.48550/arxiv.1602.02505 · Cited by 1,667
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · arXiv · doi:10.48550/arxiv.1502.02551 · Cited by 1,364 · cited 1×
“Several other works [29–31] have shown that the same inference accuracy can be achieved with reduced precision of weights and activations.”
BackgroundFINN: A Framework for Fast, Scalable Binarized Neural Network Inference
Umuroglu, Y., Fraser, N. J., Gambardella, G., Blott, M., Leong, P., Jahre, M., & Vissers, K. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021744 · Cited by 1,189
Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., Venkatesh, G., et al. (2017) · arXiv · doi:10.48550/arxiv.1710.03740 · Cited by 1,179 · cited 1×
“A total of 16-[26] and 8-bit [27] floating-point are commonly used representations.”
Method
Research works printed but not linked: 55
- Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
- Qiu, J., Wang, J., Yao, S., Guo, K., Li, B., Zhou, E., Yu, J., Tang, T., Xu, N., and Song, S. (2016, January 21–23). Going Deeper with Embedded FPGA Platform for Convolutional Neural Network. Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
- Zhang, 2019, Recent advances in convolutional neural network acceleration, Neurocomputing, 323, 37, 10.1016/j.neucom.2018.09.038 · DOI · Paper page
- Shawahna, 2019, FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review, IEEE Access, 7, 7823, 10.1109/ACCESS.2018.2890150 · DOI · Paper page
- Guan, Y., Liang, H., Xu, N., Wang, W., Shi, S., Chen, X., Sun, G., Zhang, W., and Cong, J. (May, January 30). FP-DNN: An Automated Framework for Mapping Deep Neural Networks onto FPGAs with RTL-HLS Hybrid Templates. Proceedings of the 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), Napa, CA, USA. · DOI · Paper page
- Diamantaras, K., Duch, W., and Iliadis, L.S. (2010). Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition. Artificial Neural Networks—ICANN 2010, Springer.
- Nwankpa, C., Ijomah, W., Gachagan, A., and Marshall, S. (2018). Activation Functions: Comparison of trends in Practice and Research for Deep Learning. arXiv.
- Motamedi, M., Gysel, P., Akella, V., and Ghiasi, S. (2016, January 25–28). Design space exploration of FPGA-based Deep Convolutional Neural Networks. Proceedings of the 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC), Macau, China. · DOI · Paper page
- Yang, J., and Yang, G. (2018). Modified Convolutional Neural Network Based on Dropout and the Stochastic Gradient Descent Optimizer. Algorithms, 11. · DOI
- Oh, J.H., Kwon, C., and Cho, S. (1995). Learning Algorithms For Classification: A Comparison On Handwritten Digit Recognition. Neural Networks: The Statistical Mechanics Perspective, World Scientific.
- Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. (2014). Visualizing and Understanding Convolutional Networks. Computer Vision—ECCV 2014, Springer International Publishing. · DOI · Paper page
- Simonyan, K., and Zisserman, A. (2015, January 7–9). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA.
- Szegedy, C., Wei, L., Yangqing, J., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA. · DOI · Paper page
- Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. · DOI · Paper page
- Huang, G., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA. · DOI · Paper page
- Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA. · DOI · Paper page
- Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18–22). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA. · DOI · Paper page
- Iandola, F.N., Moskewicz, M.W., Ashraf, K., Han, S., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1 MB model size. arXiv.
- Xie, S., Girshick, R.B., Dollár, P., Tu, Z., and He, K. (2017, January 21–26). Aggregated Residual Transformations for Deep Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA. · DOI · Paper page
- Wang, N., Choi, J., Brand, D., Chen, C., and Gopalakrishnan, K. (2018). Training Deep Neural Networks with 8-bit Floating Point Numbers. arXiv.
- Anwar, S., Hwang, K., and Sung, W. (2015, January 19–25). Fixed point optimization of deep convolutional neural networks for object recognition. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, Queensland, Australia. · DOI · Paper page
- Suda, N., Chandra, V., Dasika, G., Mohanty, A., Ma, Y., Vrudhula, S., Seo, J.S., and Cao, Y. (2016, January 21–23). Throughput-Optimized OpenCL-based FPGA Accelerator for Large-Scale Convolutional Neural Networks. Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
- Wang, J., Lou, Q., Zhang, X., Zhu, C., Lin, Y., and Chen, D. (2018, January 27–31). A Design Flow of Accelerating Hybrid Extremely Low Bit-width Neural Network in Embedded FPGA. Proceedings of the 28th International Conference on Field-Programmable Logic and Applications, Dublin, Ireland. · DOI · Paper page
- Véstias, M., Duarte, R.P., de Sousa, J.T., and Neto, H. (2017, January 4–6). Parallel dot-products for deep learning on FPGA. Proceedings of the 2017 27th International Conference on Field Programmable Logic and Applications (FPL), Gent, Belgium. · DOI
- Liang, 2018, FP-BNN: Binarized neural network on FPGA, Neurocomputing, 275, 1072, 10.1016/j.neucom.2017.09.046 · DOI · Paper page
- Courbariaux, M., and Bengio, Y. (2016). BinaryNet: Training Deep Neural Networks with Weights and Activations Constrained to +1 or −1. arXiv.
- Nakahara, H., Fujii, T., and Sato, S. (2017, January 4–6). A fully connected layer elimination for a binarizec convolutional neural network on an FPGA. Proceedings of the 2017 27th International Conference on Field Programmable Logic and Applications (FPL), Gent, Belgium. · DOI · Paper page
- Han, S., Mao, H., and Dally, W.J. (2015). Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding. arXiv.
- Yu, 2017, Scalpel: Customizing DNN Pruning to the Underlying Hardware Parallelism, SIGARCH Comput. Archit. News, 45, 548, 10.1145/3140659.3080215 · DOI · Paper page
- Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N.E., and Moshovos, A. (2016, January 18–22). Cnvlutin: Ineffectual-Neuron-Free Deep Neural Network Computing. Proceedings of the 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA), Seoul, Korea. · DOI · Paper page
- Zhang, C., Wu, D., Sun, J., Sun, G., Luo, G., and Cong, J. (2016, January 8–10). Energy-Efficient CNN Implementation on a Deeply Pipelined FPGA Cluster. Proceedings of the 2016 International Symposium on Low Power Electronics and Design, San Francisco Airport, CA, USA. · DOI · Paper page
- Aydonat, U., O’Connell, S., Capalija, D., Ling, A.C., and Chiu, G.R. (2017, January 22–24). An OpenCL™Deep Learning Accelerator on Arria 10. Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
- Shen, Y., Ferdman, M., and Milder, P. (May, January 30). Escher: A CNN Accelerator with Flexible Buffering to Minimize Off-Chip Transfer. Proceedings of the 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), Napa, CA, USA. · DOI · Paper page
- Winograd, S. (1980). Arithmetic Complexity of Computations, Society for Industrial and Applied Mathematics. · DOI · Paper page
- Lavin, A., and Gray, S. (2016, January 27–30). Fast Algorithms for Convolutional Neural Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. · DOI · Paper page
- Lu, L., Liang, Y., Xiao, Q., and Yan, S. (May, January 30). Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs. Proceedings of the 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), Napa, CA, USA. · DOI · Paper page
- Zhao, Y., Wang, D., and Wang, L. (2019). Convolution Accelerator Designs Using Fast Algorithms. Algorithms, 12. · DOI
- Zhao, Y., Wang, D., Wang, L., and Liu, P. (2018). A Faster Algorithm for Reducing the Computational Complexity of Convolutional Neural Networks. Algorithms, 11. · DOI
- Istrate, R., Malossi, A.C.I., Bekas, C., and Nikolopoulos, D.S. (2018). Incremental Training of Deep Convolutional Neural Networks. arXiv.
- Guo, S., Wang, L., Chen, B., Dou, Q., Tang, Y., and Li, Z. (2017, January 14–15). FixCaffe: Training CNN with Low Precision Arithmetic Operations by Fixed Point Caffe. Proceedings of the APPT 2017, Oslo, Norway. · DOI
- Shin, D., Lee, J., Lee, J., and Yoo, H. (2017, January 5–9). 14.2 DNPU: An 8.1TOPS/W reconfigurable CNN-RNN processor for general-purpose deep neural networks. Proceedings of the 2017 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, CA, USA. · DOI · Paper page
- Fujii, T., Toi, T., Tanaka, T., Togawa, K., Kitaoka, T., Nishino, K., Nakamura, N., Nakahara, H., and Motomura, M. (2018, January 18–22). New Generation Dynamically Reconfigurable Processor Technology for Accelerating Embedded AI Applications. Proceedings of the 2018 IEEE Symposium on VLSI Circuits, Honolulu, HI, USA. · DOI
- Guo, K., Zeng, S., Yu, J., Wang, Y., and Yang, H. (2017). A Survey of FPGA Based Neural Network Accelerator. arXiv.
- Abdelouahab, K., Pelcat, M., Sérot, J., and Berry, F. (2018). Accelerating CNN inference on FPGAs: A Survey. arXiv.
- Venieris, 2018, Toolflows for Mapping Convolutional Neural Networks on FPGAs: A Survey and Future Directions, ACM Comput. Surv., 51, 56:1
- Gokhale, V., Jin, J., Dundar, A., Martini, B., and Culurciello, E. (2014, January 23–28). A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA. · DOI · Paper page
- Wang, Y., Xu, J., Han, Y., Li, H., and Li, X. (2016, January 5–9). DeepBurning: Automatic generation of FPGA-based learning accelerators for the Neural Network family. Proceedings of the 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC), Austin, TX, USA. · DOI · Paper page
- Zhang, C., Sun, G., Fang, Z., Zhou, P., Pan, P., and Cong, J. (2015, January 2–6). Caffeine: Towards uniformed representation and acceleration for deep convolutional neural networks. Proceedings of the 2016 IEEE/ACM International Conference on Computer-Aided Design (ICCAD), Austin, TX, USA. · DOI · Paper page
- Ma, Y., Suda, N., Cao, Y., Seo, J.S., and Vrudhula, S. (September, January 29). Scalable and modularized RTL compilation of Convolutional Neural Networks onto FPGA. Proceedings of the 2016 26th International Conference on Field Programmable Logic and Applications (FPL), Lausanne, Switzerland.
- Liu, 2017, Throughput-Optimized FPGA Accelerator for Deep Convolutional Neural Networks, ACM Trans. Reconfigurab. Technol. Syst., 10, 17:1, 10.1145/3079758 · DOI · Paper page
- Zhang, J., and Li, J. (2017, January 22–24). Improving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network. Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
- Wang, 2017, DLAU: A Scalable Deep Learning Accelerator Unit on FPGA, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 36, 513
- Guo, 2018, Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGA, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 37, 35, 10.1109/TCAD.2017.2705069 · DOI · Paper page
- Véstias, M., Duarte, R.P., Sousa, J.T.D., and Neto, H. (2018, January 27–31). Lite-CNN: A High-Performance Architecture to Execute CNNs in Low Density FPGAs. Proceedings of the 28th International Conference on Field Programmable Logic and Applications, Dublin, Ireland. · DOI
- Yin, 2018, A High Energy Efficient Reconfigurable Hybrid Neural Network Processor for Deep Learning Applications, IEEE J. Solid-State Circuits, 53, 968, 10.1109/JSSC.2017.2778281 · DOI · Paper page
Cited by
YOLOv1 to v8: Unveiling Each Variant–A Comprehensive Review of YOLO
Hussain, M. (2024) · IEEE Access · doi:10.1109/access.2024.3378568 · Cited by 492
Deep Learning for Smart Healthcare—A Survey on Brain Tumor Detection from Medical Imaging
Arabahmadi, M., Farahbakhsh, R., & Rezazadeh, J. (2022) · Sensors · doi:10.3390/s22051960 · Cited by 253
Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification
AlBdairi, A. J. A., Xiao, Z., Alkhayyat, A., Humaidi, A. J., Fadhel, M. A., Taher, B. H., Alzubaidi, L., Santamaría, J., & Al-Shamma, O. (2022) · Applied Sciences · doi:10.3390/app12052605 · Cited by 54
Ghaffari, A., & Savaria, Y. (2020) · Electronics · doi:10.3390/electronics9122200 · Cited by 31
A Survey on the Integration and Optimization of Large Language Models in Edge Computing Environments
Bhardwaj, S., Singh, P., & Pandit, M. K. (2024) · 2024 16th International Conference on Computer and Automation Engineering (ICCAE) · doi:10.1109/iccae59995.2024.10569285 · Cited by 18
“, [2], [3], [4], [6], [7], [8], [21], [22], [27], [31], [32], [33], [34], [35], [36], [42] Q2 [3], [5], [6], [9], [14], [19], [24], [45] Q4 [3], [10], [11], [12], [25], [26], [31], [32], [33], [34], [36] Q5 [8], [9], [10], [12, ][13], [19], [35] Q6 [7], [8], [14], [19], [20], [35], [26] Q7 [4],…”
Metadata
- Authors
- Véstias, M. P.
- Venue
- Algorithms
- Publisher
- MDPI AG
- Published
- 2019-07-31
- Volume
- 12
- Issue
- 8
- Pages
- 154
- ISSN
- 1999-4893 (ISSN-L)
- OpenAlex
- W2966011162
- Cited by
- 112
- References
- 18
- FWCI
- 17.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing. https://app.cochat.ai/papers/10.3390/a12080154
- The paper
- Véstias, M. P. (2019). A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing. Algorithms. https://doi.org/10.3390/a12080154
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.