The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Application of the residue number system to reduce hardware costs of the convolutional neural network implementation
Abstract
Abstract Convolutional neural networks are a promising tool for solving the problem of pattern recognition. Most well-known convolutional neural networks implementations require a significant amount of memory to store weights in the process of learning and working. We propose a convolutional neural network architecture in which the neural network is divided into hardware and software parts to increase performance and reduce the cost of implementation resources. We also propose to use the residue number system (RNS) in the hardware part to implement the convolutional layer of the neural network. Software simulations using Matlab 2018b showed that convolutional neural network with a minimum number of layers can be quickly and successfully trained. The hardware implementation of the convolution layer shows that the use of RNS allows to reduce the hardware costs on 7.86%–37.78% compared to the two’s complement implementation. The use of the proposed heterogeneous implementation reduces the average time of image recognition by 41.17%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
2019 IEEE International Symposium on Circuits and Systems (ISCAS)
(2019) · doi:10.1109/iscas43240.2019 · Cited by 497
FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review
Shawahna, A., Sait, S. M., & El-Maleh, A. (2019) · IEEE Access · doi:10.1109/access.2018.2890150 · Cited by 496
Medical image retrieval using deep convolutional neural network
Qayyum, A., Anwar, S. M., Awais, M., & Majid, M. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.05.025 · Cited by 433
2016 IEEE International Symposium on Circuits and Systems (ISCAS)
(2016) · doi:10.1109/iscas30516.2016 · Cited by 346
Motivation for and Evaluation of the First Tensor Processing Unit
Jouppi, N., Young, C., Patil, N., & Patterson, D. (2018) · IEEE Micro · doi:10.1109/mm.2018.032271057 · Cited by 239
Efficient Hardware Architectures for Deep Convolutional Neural Network
Wang, J., Lin, J. T., & Wang, Z. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2017.2767204 · Cited by 148
Scene recognition with objectness
Cheng, X., Lu, J., Feng, J., Yuan, B., & Zhou, J. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.025 · Cited by 139
Gong, L., Wang, C., Li, X., Chen, H., & Zhou, X. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857078 · Cited by 124
Efficient hardware architecture of softmax layer in deep neural network
Yuan, B. (2016) · IEEE International System-on-Chip Conference (SOCC) · doi:10.1109/socc.2016.7905501 · Cited by 109
A deep convolutional neural network based on nested residue number system
Nakahara, H., & Sasao, T. (2015) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2015.7293933 · Cited by 77
Small sample image recognition using improved Convolutional Neural Network
Zhang, J., Shao, K., & Luo, X. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.07.011 · Cited by 74
Data and Hardware Efficient Design for Convolutional Neural Network
Lin, Y.-J., & Chang, T. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2017.2759803 · Cited by 68
Nakahara, H., & Sasao, T. (2018) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2018.8351850 · Cited by 35
Increasing of convolutional neural network performance using residue number system
Chervyakov, N. I., Lyakhov, P. A., & Valueva, M. V. (2017) · International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON) · doi:10.1109/sibircon.2017.8109855 · Cited by 27
Self-citationEffect of RNS dynamic range on grayscale images filtering
Chervyakov, N. I., Lyakhov, P. A., Ивановна, К. Д., et al. (2016) · doi:10.1109/red.2016.7779323 · Cited by 7
Self-citationMehta, R., Huang, Y., Cheng, M., Bagga, S., Mathur, N., Li, J., Draper, J. T., & Nazarian, S. (2018) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2018.8357317 · Cited by 6
Cited by
Wang, J., Bretz, M., Dewan, M. A. A., & Delavar, M. A. (2022) · Science of The Total Environment · doi:10.1016/j.scitotenv.2022.153559 · Cited by 430
Wang, S.-H., Govindaraj, V. V., Górriz, J. M., Zhang, X., & Zhang, Y.-D. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.10.004 · Cited by 353
Recent Advances in Artificial Intelligence Sensors
Zhang, Z., Wang, L., & Lee, C. (2023) · Advanced Sensor Research · doi:10.1002/adsr.202200072 · Cited by 107
Automated pancreas segmentation and volumetry using deep neural network on computed tomography
Lim, S.-H., Kim, Y. J., Park, Y.-H., Kim, D., Kim, K. G., & Lee, D.-H. (2022) · Scientific Reports · doi:10.1038/s41598-022-07848-3 · Cited by 55
Detection of DDoS attacks in SDN-based VANET using optimized TabNet
Setitra, M. A., & Fan, M. (2024) · Computer Standards & Interfaces · doi:10.1016/j.csi.2024.103845 · Cited by 40
Metadata
- Authors
- Valueva, M. V., Nagornov, N. N., Lyakhov, P. A., Valuev, G. V., & Chervyakov, N. I.
- Venue
- Mathematics and Computers in Simulation
- Publisher
- Elsevier BV
- Published
- 2020-11
- Volume
- 177
- Pages
- 232-243
- ISSN
- 0378-4754 (ISSN-L)
- OpenAlex
- W3023192521
- Cited by
- 478
- References
- 24
- FWCI
- 34.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.