The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Fast, energy-efficient, robust, and reproducible mixed-signal neuromorphic classifier based on embedded NOR flash memory technology
Abstract
We have designed, fabricated, and tested a prototype mixed-signal, 28×28-binary-input, 10-ouput, 3-layer neuromorphic network based on embedded nonvolatile floating-gate cell arrays redesigned from a commercial 180-nm NOR flash memory. Each array performs a very fast and energy-efficient analog vector-by-matrix multiplication, which is the bottleneck for signal propagation in neuromorphic networks. All functional components of the prototype circuit, including 2 synaptic arrays with 101,780 floating-gate synaptic cells, 74 analog neurons, and the peripheral circuitry for weight adjustment and I/O operations, have a total area below 1 mm2. Its testing on the MNIST benchmark set has shown a classification fidelity of 94.65%, close to the 96.2% obtained in simulation. The classification of one pattern takes103× better than those of the 28-nm IBM TrueNorth digital chip for the same task at a similar fidelity. Estimates show that this performance may be further improved using a better neuron design and a more advanced memory technology, leading to a >102x advantage in speed and a >104x advantage in energy efficiency over the state-of-the-art purely digital circuits for classification of large, complex patterns. Experimental results for the chip-to-chip statistics, long-term drift, and temperature sensitivity show no evident showstoppers on the way toward practical deep neuromorphic networks with unprecedented performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
A single-transistor silicon synapse
Diorio, C., Hasler, P., Minch, A., & Mead, C. A. (1996) · IEEE Transactions on Electron Devices · doi:10.1109/16.543035 · Cited by 360 · cited 1×
“Up until recently, implementations of such circuits were based on “synaptic transistors” [2-4], which can be fabricated using the standard CMOS technology.”
Method
Cited by
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
“The estimates [108], based on the experimentally measured parameters of the memory cells, showed that the transfer to the 55 nm technology, with some improvements of auxiliary CMOS circuits, will allow the implementation of much larger networks with a similar performance lead over the most”
MethodModel Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
“[272] X.”
BackgroundNeuro-inspired computing chips
Zhang, W., Gao, B., Tang, J., Yao, P., Yu, S., Chang, M.-F., Yoo, H.-J., Qian, H., & Wu, H. (2020) · Nature Electronics · doi:10.1038/s41928-020-0435-7 · Cited by 892
In-Memory Computing: Advances and Prospects
Verma, N., Jia, H., Valavi, H., Tang, Y., Ozatay, M., Chen, L.-Y., Zhang, B., & Deaville, P. (2019) · IEEE Solid-State Circuits Magazine · doi:10.1109/mssc.2019.2922889 · Cited by 473
Scaling for edge inference of deep neural networks
Xu, X., Ding, Y., Hu, S. X., Niemier, M., Cong, J., Hu, Y., & Shi, Y. (2018) · Nature Electronics · doi:10.1038/s41928-018-0059-3 · Cited by 462
PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference
Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304049 · Cited by 424
Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“The traditional SRAM [338], DRAM [339], and Flash [340] memories also can be modified to realize the PIM implementation of DNN algorithms.”
MethodBreaking the von Neumann bottleneck: architecture-level processing-in-memory technology
Zou, X., Xu, S., Chen, X., Yan, L., & Han, Y. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3227-1 · Cited by 311
Three-Dimensional nand Flash for Vector–Matrix Multiplication
Wang, P., Xu, F., Wang, B., Gao, B., Wu, H., Qian, H., & Yu, S. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2882194 · Cited by 132
Compressed Sensing With Approximate Message Passing Using In-Memory Computing
Le Gallo, M., Sebastian, A., Cherubini, G., Giefers, H., & Eleftheriou, E. (2018) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2018.2865352 · Cited by 99
“Potential candidates include metal–oxide resistive random-access memory [3], NOR Flash [19], and static random-access memory [20].”
BackgroundOn the Accuracy of Analog Neural Network Inference Accelerators
Xiao, T. P., Feinberg, B., Bennett, C. H., Prabhakar, V., Saxena, P., Agrawal, V., Agarwal, S., & Marinella, M. J. (2022) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2022.3214409 · Cited by 76
Bavandpour, M., Sahay, S., Mahmoodi, M. R., & Strukov, D. B. (2021) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac0775 · Cited by 45
Self-citationMixed-Signal Neuromorphic Inference Accelerators: Recent Results and Future Prospects
Bavandpour, M., Mahmoodi, M. R., Nili, H., Bayat, F. M., Prezioso, M., Vincent, A., Strukov, D. B., & Likharev, K. K. (2018) · 2018 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2018.8614659 · Cited by 39
Self-citationComprehensive Compact Phenomenological Modeling of Integrated Metal-Oxide Memristors
Nili, H., Vincent, A. F., Prezesio, M., Mahmoodi, M. R., Kataeva, I., & Strukov, D. B. (2020) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2020.2982128 · Cited by 38
“Interestingly, the modelling results predicts rather negligible dependence of classifier performance on ambient temperature for MNIST datasets, which has been observed experimentally for mixed-signal implementations [18].”
ResultSelf-citation
Metadata
- Authors
- Guo, X., Bayat, F. M., Bavandpour, M., Klachko, M., Mahmoodi, M. R., Prezioso, M., Likharev, K. K., & Strukov, D. B.
- Venue
- 2017 IEEE International Electron Devices Meeting (IEDM)
- Publisher
- IEEE
- Published
- 2017-12
- Pages
- 6.5.1-6.5.4
- ISSN
- 0163-1918 (ISSN-L)
- OpenAlex
- W2785784536
- Cited by
- 192
- References
- 3
- FWCI
- 31.13
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.