Neuro-Inspired Computing With Emerging Nonvolatile Memorys
The DOI matches its Crossref record; 134 of the 141 references it cites were found in a registry or an index.
Abstract
This comprehensive review summarizes state of the art, challenges, and prospects of the neuro-inspired computing with emerging nonvolatile memory devices. First, we discuss the demand for developing neuro-inspired architecture beyond today's von-Neumann architecture. Second, we summarize the various approaches to designing the neuromorphic hardware (digital versus analog, spiking versus nonspiking, online training versus offline training) and discuss why emerging nonvolatile memory is attractive for implementing the synapses in the neural network. Then, we discuss the desired device characteristics of the synaptic devices (e.g., multilevel states, weight update nonlinearity/asymmetry, variation/noise), and survey a few representative material systems and device prototypes reported in the literature that show the analog conductance tuning. These candidates include phase change memory, resistive memory, ferroelectric memory, floating-gate transistors, etc. Next, we introduce the crossbar array architecture to accelerate the weighted sum and weight update operations that are commonly used in the neuro-inspired machine learning algorithms, and review the recent progresses of array-level experimental demonstrations for pattern recognition tasks. In addition, we discuss the peripheral neuron circuit design issues and present a device-circuit-algorithm codesign methodology to evaluate the impact of nonideal device effects on the system-level performance (e.g., learning accuracy). Finally, we give an outlook on the customization of the learning algorithms for efficient hardware implementation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To implement neural network computing hardware with a high learning accuracy, a low nonlinearity of synaptic weights with repetitive input pulses and a large on/off synapse conductance ratio are required 36 .”
From Enhanced analog synaptic behavior of SiNx/a-Si bilayer memristors through Ge implantation (2020) · cites this paper as [36]
In the citing paper
“The achieved learning accuracy is very comparable to the state-of-the-art results in the literature 36,46,49 .”
From Enhanced analog synaptic behavior of SiNx/a-Si bilayer memristors through Ge implantation (2020) · cites this paper as [36]
In the citing paper
“A promising solution to this problem is the use of memristor-based systems, which can drastically reduce the energy consumption of AI5,6, making it even conceivable to create self-powered edge AI systems that do not require batteries and can instead harvest energy from the environment.”
From Powering AI at the edge: A robust, memristor-based binarized neural network with near-memory computing and miniaturized solar cell (2024) · cites this paper as [5]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“For example, Microsoft’s Res-Net (which won the ImageNet 2015 image classification competition [5]) has more than 100 of layers [6].”
MethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 1×
“The adoption of low-precision weight is most suitable for the feedforward inference stage of the CNN models, including LeNet5 [127], AlexNet [3], and VGG [128] in an order of complexity.”
MethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 2×
“In particular, convolutional neural network (CNN) [3] and recurrent neural network (RNN) [4] algorithms and their variants have proved their efficacy in a wide range of image, video, speech, and biomedical applications.”
BackgroundMethodLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“The adoption of low-precision weight is most suitable for the feedforward inference stage of the CNN models, including LeNet5 [127], AlexNet [3], and VGG [128] in an order of complexity.”
MethodMastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 1×
“, Google’s AlphaGo [1]).”
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“In particular, convolutional neural network (CNN) [3] and recurrent neural network (RNN) [4] algorithms and their variants have proved their efficacy in a wide range of image, video, speech, and biomedical applications.”
BackgroundRedox‐Based Resistive Switching Memories – Nanoionic Mechanisms, Prospects, and Challenges
Waser, R., Dittmann, R., Staikov, G., & Szot, K. (2009) · Advanced Materials · doi:10.1002/adma.200900375 · Cited by 5,080 · cited 1×
“RRAM has two subcategories [44]: one is anion-based oxide random access memory (OxRAM) and the other one is cation-based conductive bridge random access memory (CBRAM) [45].”
BackgroundIn-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · cited 1×
“A similar work that constraints the weights and neurons to be (+1, −1), namely XNOR-Net [130], has been demonstrated for the classification of ImageNet data set with slight degradation of accuracy.”
Background
Research works printed but not linked: 9
- jouppi, 2016, Google Supercharges Machine Learning Tasks with TPU Custom Chip
- manan, 2012, CBRAM devices as binary synapses for low-power stochastic neuromorphic systems: Auditory (cochlea) and visual (retina) cognitive processing applications, IEDM Tech Dig
- 0, The MNIST dataset of handwritten digits
- 0, Image
- liu, 2013, A 130.7 mm $^{2}~2$ -layer 32 Gb ReRAM memory device in 24nm technology, IEEE Int Solid-State Circuits Conf (ISSCC) Dig Tech Papers, 31.6.1
- 0, Theano
- govoreanu, 2011, $10\times 10$ nm2 Hf/HfOx crossbar resistive RAM with excellent performance, reliability and low-energy operation, IEDM Tech Dig
- 0, Yale Face Database
- 0, NeuroSim
Cited by
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Physics for neuromorphic computing
Marković, D., Mizrahi, A., Querlioz, D., & Grollier, J. (2020) · Nature Reviews Physics · doi:10.1038/s42254-020-0208-2 · Cited by 1,176
Resistive switching materials for information processing
Wang, Z., Wu, H., Burr, G. W., Hwang, C. S., Wang, K. L., Xia, Q., & Yang, J. J. (2020) · Nature Reviews Materials · doi:10.1038/s41578-019-0159-3 · Cited by 1,214
Two-dimensional materials for next-generation computing technologies
Liu, C., Chen, H., Wang, S., Liu, Q., Jiang, Y.-G., Zhang, D. W., Liu, M., & Zhou, P. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0724-3 · Cited by 1,045
Metadata
- Authors
- Yu, S.
- Affiliations
- Arizona State University (US)
- Corresponding author
- Yu, Shimeng
- ORCID
- Yu, Shimeng
- Venue
- Proceedings of the IEEE
- Published
- 2018-02
- Volume
- 106
- Issue
- 2
- Pages
- 260-285
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2785141883
- Cited by
- 1,170
- References
- 141
- Citations by year
- 2026: 96 · 2025: 139 · 2024: 138 · 2023: 148 · 2022: 177 · 2021: 146 · 2020: 162 · 2019: 117 · 2018: 47
- FWCI
- 45.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Proceedings of the IEEE (publishedVersion)
- Funders
- NSF-CCF (NSF-CCF-1552687)
- NSFCCF (NSFCCF-1715443)
- NSF-ECCS (NSF-ECCS-1701565)
- HDTRA (HDTRA1-17-1-0038)
- NSF/SRC (NSF/SRC E2CDA)
- ASCENT (one of the six SRC/DARPA JUMP Centers)
- Qualcomm
- Samsung
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Keywords
- neuromorphic computing, neuromorphic hardware, non-volatile memory, artificial synapses, phase-change memory, resistive random access memory, ferroelectric memory, floating-gate transistors, pattern recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.