CoChat

A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing

Open access
Véstias, Mário P. · 2019 · Algorithms
Cited by 112

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

The convolutional neural network (CNN) is one of the most used deep learning models for image detection and classification, due to its high accuracy when compared to other machine learning algorithms. CNNs achieve better results at the cost of higher computing and memory requirements. Inference of convolutional neural networks is therefore usually done in centralized high-performance platforms. However, many applications based on CNNs are migrating to edge devices near the source of data due to the unreliability of a transmission channel in exchanging data with a central server, the uncertainty about channel latency not tolerated by many applications, security and data privacy, etc. While advantageous, deep learning on edge is quite challenging because edge devices are usually limited in terms of performance, cost, and energy. Reconfigurable computing is being considered for inference on edge due to its high performance and energy efficiency while keeping a high hardware flexibility that allows for the easy adaption of the target computing platform to the CNN model. In this paper, we described the features of the most common CNNs, the capabilities of reconfigurable computing for running CNNs, the state-of-the-art of reconfigurable computing implementations proposed to run CNN models, as well as the trends and challenges for future edge reconfigurable platforms.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/a12080154

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 55

  1. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
  2. Qiu, J., Wang, J., Yao, S., Guo, K., Li, B., Zhou, E., Yu, J., Tang, T., Xu, N., and Song, S. (2016, January 21–23). Going Deeper with Embedded FPGA Platform for Convolutional Neural Network. Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
  3. Zhang, 2019, Recent advances in convolutional neural network acceleration, Neurocomputing, 323, 37, 10.1016/j.neucom.2018.09.038 · DOI · Paper page
  4. Shawahna, 2019, FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review, IEEE Access, 7, 7823, 10.1109/ACCESS.2018.2890150 · DOI · Paper page
  5. Guan, Y., Liang, H., Xu, N., Wang, W., Shi, S., Chen, X., Sun, G., Zhang, W., and Cong, J. (May, January 30). FP-DNN: An Automated Framework for Mapping Deep Neural Networks onto FPGAs with RTL-HLS Hybrid Templates. Proceedings of the 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), Napa, CA, USA. · DOI · Paper page
  6. Diamantaras, K., Duch, W., and Iliadis, L.S. (2010). Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition. Artificial Neural Networks—ICANN 2010, Springer.
  7. Nwankpa, C., Ijomah, W., Gachagan, A., and Marshall, S. (2018). Activation Functions: Comparison of trends in Practice and Research for Deep Learning. arXiv.
  8. Motamedi, M., Gysel, P., Akella, V., and Ghiasi, S. (2016, January 25–28). Design space exploration of FPGA-based Deep Convolutional Neural Networks. Proceedings of the 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC), Macau, China. · DOI · Paper page
  9. Yang, J., and Yang, G. (2018). Modified Convolutional Neural Network Based on Dropout and the Stochastic Gradient Descent Optimizer. Algorithms, 11. · DOI
  10. Oh, J.H., Kwon, C., and Cho, S. (1995). Learning Algorithms For Classification: A Comparison On Handwritten Digit Recognition. Neural Networks: The Statistical Mechanics Perspective, World Scientific.
  11. Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. (2014). Visualizing and Understanding Convolutional Networks. Computer Vision—ECCV 2014, Springer International Publishing. · DOI · Paper page
  12. Simonyan, K., and Zisserman, A. (2015, January 7–9). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA.
  13. Szegedy, C., Wei, L., Yangqing, J., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA. · DOI · Paper page
  14. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. · DOI · Paper page
  15. Huang, G., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA. · DOI · Paper page
  16. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA. · DOI · Paper page
  17. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18–22). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA. · DOI · Paper page
  18. Iandola, F.N., Moskewicz, M.W., Ashraf, K., Han, S., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1 MB model size. arXiv.
  19. Xie, S., Girshick, R.B., Dollár, P., Tu, Z., and He, K. (2017, January 21–26). Aggregated Residual Transformations for Deep Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA. · DOI · Paper page
  20. Wang, N., Choi, J., Brand, D., Chen, C., and Gopalakrishnan, K. (2018). Training Deep Neural Networks with 8-bit Floating Point Numbers. arXiv.
  21. Anwar, S., Hwang, K., and Sung, W. (2015, January 19–25). Fixed point optimization of deep convolutional neural networks for object recognition. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), South Brisbane, Queensland, Australia. · DOI · Paper page
  22. Suda, N., Chandra, V., Dasika, G., Mohanty, A., Ma, Y., Vrudhula, S., Seo, J.S., and Cao, Y. (2016, January 21–23). Throughput-Optimized OpenCL-based FPGA Accelerator for Large-Scale Convolutional Neural Networks. Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
  23. Wang, J., Lou, Q., Zhang, X., Zhu, C., Lin, Y., and Chen, D. (2018, January 27–31). A Design Flow of Accelerating Hybrid Extremely Low Bit-width Neural Network in Embedded FPGA. Proceedings of the 28th International Conference on Field-Programmable Logic and Applications, Dublin, Ireland. · DOI · Paper page
  24. Véstias, M., Duarte, R.P., de Sousa, J.T., and Neto, H. (2017, January 4–6). Parallel dot-products for deep learning on FPGA. Proceedings of the 2017 27th International Conference on Field Programmable Logic and Applications (FPL), Gent, Belgium. · DOI
  25. Liang, 2018, FP-BNN: Binarized neural network on FPGA, Neurocomputing, 275, 1072, 10.1016/j.neucom.2017.09.046 · DOI · Paper page
  26. Courbariaux, M., and Bengio, Y. (2016). BinaryNet: Training Deep Neural Networks with Weights and Activations Constrained to +1 or −1. arXiv.
  27. Nakahara, H., Fujii, T., and Sato, S. (2017, January 4–6). A fully connected layer elimination for a binarizec convolutional neural network on an FPGA. Proceedings of the 2017 27th International Conference on Field Programmable Logic and Applications (FPL), Gent, Belgium. · DOI · Paper page
  28. Han, S., Mao, H., and Dally, W.J. (2015). Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding. arXiv.
  29. Yu, 2017, Scalpel: Customizing DNN Pruning to the Underlying Hardware Parallelism, SIGARCH Comput. Archit. News, 45, 548, 10.1145/3140659.3080215 · DOI · Paper page
  30. Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N.E., and Moshovos, A. (2016, January 18–22). Cnvlutin: Ineffectual-Neuron-Free Deep Neural Network Computing. Proceedings of the 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA), Seoul, Korea. · DOI · Paper page
  31. Zhang, C., Wu, D., Sun, J., Sun, G., Luo, G., and Cong, J. (2016, January 8–10). Energy-Efficient CNN Implementation on a Deeply Pipelined FPGA Cluster. Proceedings of the 2016 International Symposium on Low Power Electronics and Design, San Francisco Airport, CA, USA. · DOI · Paper page
  32. Aydonat, U., O’Connell, S., Capalija, D., Ling, A.C., and Chiu, G.R. (2017, January 22–24). An OpenCL™Deep Learning Accelerator on Arria 10. Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
  33. Shen, Y., Ferdman, M., and Milder, P. (May, January 30). Escher: A CNN Accelerator with Flexible Buffering to Minimize Off-Chip Transfer. Proceedings of the 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), Napa, CA, USA. · DOI · Paper page
  34. Winograd, S. (1980). Arithmetic Complexity of Computations, Society for Industrial and Applied Mathematics. · DOI · Paper page
  35. Lavin, A., and Gray, S. (2016, January 27–30). Fast Algorithms for Convolutional Neural Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. · DOI · Paper page
  36. Lu, L., Liang, Y., Xiao, Q., and Yan, S. (May, January 30). Evaluating Fast Algorithms for Convolutional Neural Networks on FPGAs. Proceedings of the 2017 IEEE 25th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), Napa, CA, USA. · DOI · Paper page
  37. Zhao, Y., Wang, D., and Wang, L. (2019). Convolution Accelerator Designs Using Fast Algorithms. Algorithms, 12. · DOI
  38. Zhao, Y., Wang, D., Wang, L., and Liu, P. (2018). A Faster Algorithm for Reducing the Computational Complexity of Convolutional Neural Networks. Algorithms, 11. · DOI
  39. Istrate, R., Malossi, A.C.I., Bekas, C., and Nikolopoulos, D.S. (2018). Incremental Training of Deep Convolutional Neural Networks. arXiv.
  40. Guo, S., Wang, L., Chen, B., Dou, Q., Tang, Y., and Li, Z. (2017, January 14–15). FixCaffe: Training CNN with Low Precision Arithmetic Operations by Fixed Point Caffe. Proceedings of the APPT 2017, Oslo, Norway. · DOI
  41. Shin, D., Lee, J., Lee, J., and Yoo, H. (2017, January 5–9). 14.2 DNPU: An 8.1TOPS/W reconfigurable CNN-RNN processor for general-purpose deep neural networks. Proceedings of the 2017 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, CA, USA. · DOI · Paper page
  42. Fujii, T., Toi, T., Tanaka, T., Togawa, K., Kitaoka, T., Nishino, K., Nakamura, N., Nakahara, H., and Motomura, M. (2018, January 18–22). New Generation Dynamically Reconfigurable Processor Technology for Accelerating Embedded AI Applications. Proceedings of the 2018 IEEE Symposium on VLSI Circuits, Honolulu, HI, USA. · DOI
  43. Guo, K., Zeng, S., Yu, J., Wang, Y., and Yang, H. (2017). A Survey of FPGA Based Neural Network Accelerator. arXiv.
  44. Abdelouahab, K., Pelcat, M., Sérot, J., and Berry, F. (2018). Accelerating CNN inference on FPGAs: A Survey. arXiv.
  45. Venieris, 2018, Toolflows for Mapping Convolutional Neural Networks on FPGAs: A Survey and Future Directions, ACM Comput. Surv., 51, 56:1
  46. Gokhale, V., Jin, J., Dundar, A., Martini, B., and Culurciello, E. (2014, January 23–28). A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA. · DOI · Paper page
  47. Wang, Y., Xu, J., Han, Y., Li, H., and Li, X. (2016, January 5–9). DeepBurning: Automatic generation of FPGA-based learning accelerators for the Neural Network family. Proceedings of the 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC), Austin, TX, USA. · DOI · Paper page
  48. Zhang, C., Sun, G., Fang, Z., Zhou, P., Pan, P., and Cong, J. (2015, January 2–6). Caffeine: Towards uniformed representation and acceleration for deep convolutional neural networks. Proceedings of the 2016 IEEE/ACM International Conference on Computer-Aided Design (ICCAD), Austin, TX, USA. · DOI · Paper page
  49. Ma, Y., Suda, N., Cao, Y., Seo, J.S., and Vrudhula, S. (September, January 29). Scalable and modularized RTL compilation of Convolutional Neural Networks onto FPGA. Proceedings of the 2016 26th International Conference on Field Programmable Logic and Applications (FPL), Lausanne, Switzerland.
  50. Liu, 2017, Throughput-Optimized FPGA Accelerator for Deep Convolutional Neural Networks, ACM Trans. Reconfigurab. Technol. Syst., 10, 17:1, 10.1145/3079758 · DOI · Paper page
  51. Zhang, J., and Li, J. (2017, January 22–24). Improving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network. Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA. · DOI · Paper page
  52. Wang, 2017, DLAU: A Scalable Deep Learning Accelerator Unit on FPGA, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 36, 513
  53. Guo, 2018, Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGA, IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst., 37, 35, 10.1109/TCAD.2017.2705069 · DOI · Paper page
  54. Véstias, M., Duarte, R.P., Sousa, J.T.D., and Neto, H. (2018, January 27–31). Lite-CNN: A High-Performance Architecture to Execute CNNs in Low Density FPGAs. Proceedings of the 28th International Conference on Field Programmable Logic and Applications, Dublin, Ireland. · DOI
  55. Yin, 2018, A High Energy Efficient Reconfigurable Hybrid Neural Network Processor for Deep Learning Applications, IEEE J. Solid-State Circuits, 53, 968, 10.1109/JSSC.2017.2778281 · DOI · Paper page

Cited by

See all 112

Metadata

Authors
Véstias, M. P.
Venue
Algorithms
Publisher
MDPI AG
Published
2019-07-31
Volume
12
Issue
8
Pages
154
ISSN
1999-4893 (ISSN-L)
OpenAlex
W2966011162
Cited by
112
References
18
FWCI
17.43
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.