Neuro-Inspired Computing With Emerging Nonvolatile Memorys
The DOI matches its Crossref record; 134 of the 141 references it cites were found in a registry or an index.
Abstract
This comprehensive review summarizes state of the art, challenges, and prospects of the neuro-inspired computing with emerging nonvolatile memory devices. First, we discuss the demand for developing neuro-inspired architecture beyond today's von-Neumann architecture. Second, we summarize the various approaches to designing the neuromorphic hardware (digital versus analog, spiking versus nonspiking, online training versus offline training) and discuss why emerging nonvolatile memory is attractive for implementing the synapses in the neural network. Then, we discuss the desired device characteristics of the synaptic devices (e.g., multilevel states, weight update nonlinearity/asymmetry, variation/noise), and survey a few representative material systems and device prototypes reported in the literature that show the analog conductance tuning. These candidates include phase change memory, resistive memory, ferroelectric memory, floating-gate transistors, etc. Next, we introduce the crossbar array architecture to accelerate the weighted sum and weight update operations that are commonly used in the neuro-inspired machine learning algorithms, and review the recent progresses of array-level experimental demonstrations for pattern recognition tasks. In addition, we discuss the peripheral neuron circuit design issues and present a device-circuit-algorithm codesign methodology to evaluate the impact of nonideal device effects on the system-level performance (e.g., learning accuracy). Finally, we give an outlook on the customization of the learning algorithms for efficient hardware implementation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To implement neural network computing hardware with a high learning accuracy, a low nonlinearity of synaptic weights with repetitive input pulses and a large on/off synapse conductance ratio are required 36 .”
From Enhanced analog synaptic behavior of SiNx/a-Si bilayer memristors through Ge implantation (2020) · cites this paper as [36]
In the citing paper
“The achieved learning accuracy is very comparable to the state-of-the-art results in the literature 36,46,49 .”
From Enhanced analog synaptic behavior of SiNx/a-Si bilayer memristors through Ge implantation (2020) · cites this paper as [36]
In the citing paper
“A promising solution to this problem is the use of memristor-based systems, which can drastically reduce the energy consumption of AI5,6, making it even conceivable to create self-powered edge AI systems that do not require batteries and can instead harvest energy from the environment.”
From Powering AI at the edge: A robust, memristor-based binarized neural network with near-memory computing and miniaturized solar cell (2024) · cites this paper as [5]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“For example, Microsoft’s Res-Net (which won the ImageNet 2015 image classification competition [5]) has more than 100 of layers [6].”
MethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 1×
“The adoption of low-precision weight is most suitable for the feedforward inference stage of the CNN models, including LeNet5 [127], AlexNet [3], and VGG [128] in an order of complexity.”
MethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 2×
“In particular, convolutional neural network (CNN) [3] and recurrent neural network (RNN) [4] algorithms and their variants have proved their efficacy in a wide range of image, video, speech, and biomedical applications.”
BackgroundMethodLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“The adoption of low-precision weight is most suitable for the feedforward inference stage of the CNN models, including LeNet5 [127], AlexNet [3], and VGG [128] in an order of complexity.”
MethodMastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 1×
“, Google’s AlphaGo [1]).”
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“In particular, convolutional neural network (CNN) [3] and recurrent neural network (RNN) [4] algorithms and their variants have proved their efficacy in a wide range of image, video, speech, and biomedical applications.”
BackgroundRedox‐Based Resistive Switching Memories – Nanoionic Mechanisms, Prospects, and Challenges
Waser, R., Dittmann, R., Staikov, G., & Szot, K. (2009) · Advanced Materials · doi:10.1002/adma.200900375 · Cited by 5,080 · cited 1×
“RRAM has two subcategories [44]: one is anion-based oxide random access memory (OxRAM) and the other one is cation-based conductive bridge random access memory (CBRAM) [45].”
BackgroundIn-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · cited 1×
“A similar work that constraints the weights and neurons to be (+1, −1), namely XNOR-Net [130], has been demonstrated for the classification of ImageNet data set with slight degradation of accuracy.”
Background
Research works printed but not linked: 9
- jouppi, 2016, Google Supercharges Machine Learning Tasks with TPU Custom Chip
- manan, 2012, CBRAM devices as binary synapses for low-power stochastic neuromorphic systems: Auditory (cochlea) and visual (retina) cognitive processing applications, IEDM Tech Dig
- 0, The MNIST dataset of handwritten digits
- 0, Image
- liu, 2013, A 130.7 mm $^{2}~2$ -layer 32 Gb ReRAM memory device in 24nm technology, IEEE Int Solid-State Circuits Conf (ISSCC) Dig Tech Papers, 31.6.1
- 0, Theano
- govoreanu, 2011, $10\times 10$ nm2 Hf/HfOx crossbar resistive RAM with excellent performance, reliability and low-energy operation, IEDM Tech Dig
- 0, Yale Face Database
- 0, NeuroSim
Cited by
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Physics for neuromorphic computing
Marković, D., Mizrahi, A., Querlioz, D., & Grollier, J. (2020) · Nature Reviews Physics · doi:10.1038/s42254-020-0208-2 · Cited by 1,176
Resistive switching materials for information processing
Wang, Z., Wu, H., Burr, G. W., Hwang, C. S., Wang, K. L., Xia, Q., & Yang, J. J. (2020) · Nature Reviews Materials · doi:10.1038/s41578-019-0159-3 · Cited by 1,214
Two-dimensional materials for next-generation computing technologies
Liu, C., Chen, H., Wang, S., Liu, Q., Jiang, Y.-G., Zhang, D. W., Liu, M., & Zhou, P. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0724-3 · Cited by 1,045
Neuro-inspired computing chips
Zhang, W., Gao, B., Tang, J., Yao, P., Yu, S., Chang, M.-F., Yoo, H.-J., Qian, H., & Wu, H. (2020) · Nature Electronics · doi:10.1038/s41928-020-0435-7 · Cited by 892
Self-citationMemristive technologies for data storage, computation, encryption, and radio-frequency communication
Lanza, M., Sebastian, A., Lu, W. D., Le Gallo, M., Chang, M.-F., Akinwande, D., Puglisi, F. M., Alshareef, H. N., Liu, M., & Roldan, J. B. (2022) · Science · doi:10.1126/science.abj9979 · Cited by 708
“However, device-related challenges to performing precise weight updates need to be identified and overcome to obtain softwareequivalent training accuracy with this approach (62).”
BackgroundArtificial optic-neural synapse for colored and color-mixed pattern recognition
Seo, S., Jo, S.-H., Kim, S., Shim, J., Oh, S., Kim, J.-H., Heo, K., Choi, J.-W., Choi, C., Oh, S., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-07572-5 · Cited by 731
Recent Advances in Transistor‐Based Artificial Synapses
Dai, S., Zhao, Y., Wang, Y., Zhang, J., Fang, L., Jin, S., Shao, Y., & Huang, J. (2019) · Advanced Functional Materials · doi:10.1002/adfm.201903700 · Cited by 671
A crossbar array of magnetoresistive memory devices for in-memory computing
Jung, S., Lee, H., Myung, S., Kim, H., Yoon, S. K., Kwon, S.-W., Ju, Y., Kim, M., Yi, W., Han, S., et al. (2022) · Nature · doi:10.1038/s41586-021-04196-6 · Cited by 644
Ferroelectric Analog Synaptic Transistors
Kim, M.-K., & Lee, J.-S. (2019) · Nano Letters · doi:10.1021/acs.nanolett.9b00180 · Cited by 594
Review of memristor devices in neuromorphic computing: materials sciences and device challenges
Li, Y., Wang, Z., Midya, R., Xia, Q., & Yang, J. J. (2018) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aade3f · Cited by 569
Emerging Memory Devices for Neuromorphic Computing
Upadhyay, N. K., Jiang, H., Wang, Z., Asapu, S., Xia, Q., & Joshua Yang, J. (2019) · Advanced Materials Technologies · doi:10.1002/admt.201800589 · Cited by 540
Flexible Neuromorphic Electronics for Computing, Soft Robotics, and Neuroprosthetics
Park, H., Lee, Y., Kim, N., Seo, D., Go, G., & Lee, T. (2020) · Advanced Materials · doi:10.1002/adma.201903558 · Cited by 533
Thousands of conductance levels in memristors integrated on CMOS
(2023) · doi:10.1038/s41586-023-05759-5 · Cited by 503
“13, incomplete channels are consistently observed in a C-AFM scan whenever RTN is observed.”
BackgroundLogic-in-memory based on an atomically thin semiconductor
Migliato Marega, G., Zhao, Y., Avsar, A., Wang, Z., Tripathi, M., Radenovic, A., & Kis, A. (2020) · Nature · doi:10.1038/s41586-020-2861-0 · Cited by 447
“Therefore, in the search of the most efficient solution, next-generation architectures have been an important subject of research 16–19 .”
Compute-in-Memory Chips for Deep Learning: Recent Trends and Prospects
Yu, S., Jiang, H., Huang, S., Peng, X., & Lu, A. (2021) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2021.3092533 · Cited by 391
Self-citation2D Material Based Synaptic Devices for Neuromorphic Computing
Cao, G., Meng, P., Chen, J., Liu, H., Bian, R., Zhu, C., Liu, F., & Liu, Z. (2021) · Advanced Functional Materials · doi:10.1002/adfm.202005443 · Cited by 382
Brain-inspired computing with memristors: Challenges in devices, circuits, and systems
Zhang, Y., Wang, Z., Zhu, J., Yang, Y., Rao, M., Song, W., Zhuo, Y., Zhang, X., Cui, M., Shen, L., et al. (2020) · Applied Physics Reviews · doi:10.1063/1.5124027 · Cited by 384
Reliability of analog resistive switching memory for neuromorphic computing
Zhao, M., Gao, B., Tang, J., Qian, H., & Wu, H. (2020) · Applied Physics Reviews · doi:10.1063/1.5124915 · Cited by 349
Mehonic, A., Sebastian, A., Rajendran, B., Simeone, O., Vasilaki, E., & Kenyon, A. J. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000085 · Cited by 331
Peng, X., Huang, S., Jiang, H., Lu, A., & Yu, S. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.3043731 · Cited by 317
Self-citationNeuro-inspired electronic skin for robots
Liu, F., Deswal, S., Christou, A., Sandamirskaya, Y., Kaboli, M., & Dahiya, R. (2022) · Science Robotics · doi:10.1126/scirobotics.abl7344 · Cited by 300
“These issues negatively affect the learning and classification accuracy of neuromorphic computing ( 124 ).”
BackgroundIn situ training of feed-forward and recurrent convolutional memristor networks
Wang, Z., Li, C., Lin, P., Rao, M., Nie, Y., Song, W., Qiu, Q., Li, Y., Yan, P., Strachan, J. P., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0089-1 · Cited by 307
Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware
Rathi, N., Chakraborty, I., Kosta, A., Sengupta, A., Ankit, A., Panda, P., & Roy, K. (2023) · ACM Computing Surveys · doi:10.1145/3571155 · Cited by 267
“Considering the limitations of hardware systems designed to accelerate machine learning workloads, researchers have explored several avenues [6, 11, 21, 31, 46, 89, 208, 231, 262] across the design stack from devices and circuits to architectural solutions to address the unique challenges presented by neuromorphic com…”
BackgroundThe Roadmap of 2D Materials and Devices Toward Chips
Liu, A., Zhang, X., Liu, Z., Li, Y., Peng, X., Li, X., Qin, Y., Hu, C., Qiu, Y., Jiang, H., et al. (2024) · Nano-Micro Letters · doi:10.1007/s40820-023-01273-5 · Cited by 255
Artificial Synapses Based on Multiterminal Memtransistors for Neuromorphic Application
Wang, L., Liao, W., Wong, S. L., Yu, Z. G., Li, S., Lim, Y., Feng, X., Tan, W. C., Huang, X., Chen, L., et al. (2019) · Advanced Functional Materials · doi:10.1002/adfm.201901106 · Cited by 278
Memristive Synapses and Neurons for Bioinspired Computing
Yang, R., Huang, H., & Guo, X. (2019) · Advanced Electronic Materials · doi:10.1002/aelm.201900287 · Cited by 263
4K-memristor analog-grade passive crossbar circuit
Kim, H., Mahmoodi, M. R., Nili, H., & Strukov, D. B. (2021) · Nature Communications · doi:10.1038/s41467-021-25455-0 · Cited by 265
Artificial van der Waals hybrid synapse and its application to acoustic pattern recognition
Seo, S., Kang, B.-S., Lee, J.-J., Ryu, H.-J., Kim, S., Kim, H., Oh, S., Shim, J., Heo, K., Oh, S., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-17849-3 · Cited by 238
Exploring Ferroelectric Switching in α‐In2Se3 for Neuromorphic Computing
Wang, L., Wang, X., Zhang, Y., Li, R., Ma, T., Leng, K., Chen, Z., Abdelwahab, I., & Loh, K. P. (2020) · Advanced Functional Materials · doi:10.1002/adfm.202004609 · Cited by 250
The Next Generation of Deep Learning Hardware: Analog Computing
Haensch, W., Gokmen, T., & Puri, R. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2871057 · Cited by 235
“With renewed interest in deep learning, it gained attention again as a possible solution to accelerate the required computations [26]–[28].”
BackgroundElectric-double-layer transistors for synaptic devices and neuromorphic systems
He, Y., Yang, Y., Nie, S., Liu, R., & Wan, Q. (2018) · Journal of Materials Chemistry C · doi:10.1039/c8tc00530c · Cited by 240
Low-power linear computation using nonlinear ferroelectric tunnel junction memristors
Berdan, R., Marukame, T., Ota, K., Yamaguchi, M., Saitoh, M., Fujii, S., Deguchi, J., & Nishi, Y. (2020) · Nature Electronics · doi:10.1038/s41928-020-0405-0 · Cited by 238
Luo, Z., Wang, Z., Guan, Z., Ma, C., Zhao, L., Liu, C., Sun, H., Wang, H., Lin, Y., Jin, X., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28303-x · Cited by 225
“Therefore, arti fi cial synapses meeting the desired speci fi cations (summarized in Supplementary S1) 14 – 16 are still scarce, which limits the performance of corresponding neuro-inspired neural network computing systems.”
BackgroundMethodInfluentialKim, M., & Lee, J. (2020) · Advanced Materials · doi:10.1002/adma.201907826 · Cited by 223
From Ferroelectric Material Optimization to Neuromorphic Devices
Mikolajick, T., Park, M. H., Begon‐Lours, L., & Slesazeck, S. (2023) · Advanced Materials · doi:10.1002/adma.202206042 · Cited by 215
Nanoscale resistive switching memory devices: a review
Slesazeck, S., & Mikolajick, T. (2019) · Nanotechnology · doi:10.1088/1361-6528/ab2084 · Cited by 217
“resistive switching characteristics of real devices, that was recently discussed in [175].”
BackgroundSpatiotemporal Information Processing Emulated by Multiterminal Neuro‐Transistor Networks
He, Y., Nie, S., Liu, R., Jiang, S., Shi, Y., & Wan, Q. (2019) · Advanced Materials · doi:10.1002/adma.201900903 · Cited by 222
Perspective: A review on memristive hardware for neuromorphic computation
Sung, C., Hwang, H., & Yoo, I. K. (2018) · Journal of Applied Physics · doi:10.1063/1.5037835 · Cited by 217
Ryu, H., Wu, H., Rao, F., & Zhu, W. (2019) · Scientific Reports · doi:10.1038/s41598-019-56816-x · Cited by 205
Analog architectures for neural network acceleration based on non-volatile memory
Xiao, T. P., Bennett, C. H., Feinberg, B., Agarwal, S., & Marinella, M. J. (2020) · Applied Physics Reviews · doi:10.1063/1.5143815 · Cited by 193
Multilevel HfO2-based RRAM devices for low-power neuromorphic networks
Milo, V., Zambelli, C., Olivo, P., Pérez, E., K. Mahadevaiah, M., G. Ossorio, O., Wenger, C., & Ielmini, D. (2019) · APL Materials · doi:10.1063/1.5108650 · Cited by 200
Memristive Crossbar Arrays for Storage and Computing Applications
Li, H., Wang, S., Zhang, X., Wang, W., Yang, R., Sun, Z., Feng, W., Lin, P., Wang, Z., Sun, L., et al. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202100017 · Cited by 205
In-memory Learning with Analog Resistive Switching Memory: A Review and Perspective
Xi, Y., Gao, B., Tang, J., Chen, A., Chang, M.-F., Hu, X. S., Spiegel, J. V. D., Qian, H., & Wu, H. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3004543 · Cited by 196
“Recent work has led to some generally accepted conclusions about the key device characteristics, for example, linearity, symmetry, and level numbers as well as variation and fluctuation [67], [88], [91], [104].”
BackgroundMethodInfluentialRoadmap on emerging hardware and technology for machine learning
Berggren, K., Xia, Q., Likharev, K. K., Strukov, D. B., Jiang, H., Mikolajick, T., Querlioz, D., Salinga, M., Erickson, J. R., Pi, S., et al. (2021) · Nanotechnology · doi:10.1088/1361-6528/aba70f · Cited by 190
Revival of Ferroelectric Memories Based on Emerging Fluorite‐Structured Ferroelectrics
Park, J. Y., Choe, D., Lee, D. H., Yu, G. T., Yang, K., Kim, S. H., Park, G. H., Nam, S., Lee, H. J., Jo, S., et al. (2023) · Advanced Materials · doi:10.1002/adma.202204904 · Cited by 181
Ning, H., Yu, Z., Zhang, Q., Wen, H., Gao, B., Mao, Y., Li, Y., Zhou, Y., Zhou, Y., Chen, J., et al. (2023) · Nature Nanotechnology · doi:10.1038/s41565-023-01343-0 · Cited by 198
In-Plane Ferroelectric Tin Monosulfide and Its Application in a Ferroelectric Analog Synaptic Device
Kwon, K. C., Zhang, Y., Wang, L., Yu, W., Wang, X., Park, I.-H., Choi, H. S., Ma, T., Zhu, Z., Tian, B., et al. (2020) · ACS Nano · doi:10.1021/acsnano.0c03869 · Cited by 194
Li, S., Pam, M., Li, Y., Chen, L., Chien, Y., Fong, X., Chi, D., & Ang, K. (2022) · Advanced Materials · doi:10.1002/adma.202103376 · Cited by 190
Stimuli‐Responsive Memristive Materials for Artificial Synapses and Neuromorphic Computing
Bian, H., Goh, Y. Y., Liu, Y., Ling, H., Xie, L., & Liu, X. (2021) · Advanced Materials · doi:10.1002/adma.202006469 · Cited by 182
Yang, F.-S., Li, M., Lee, M.-P., Ho, I.-Y., Chen, J.-Y., Ling, H., Li, Y., Chang, J.-K., Yang, S.-H., Chang, Y.-M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-16766-9 · Cited by 169
Zhou, H., Li, S., Ang, K., & Zhang, Y. (2024) · Nano-Micro Letters · doi:10.1007/s40820-024-01335-2 · Cited by 208
Zhang, P., Xia, M., Zhuge, F., Zhou, Y., Wang, Z., Dong, B., Fu, Y., Yang, K., Li, Y., He, Y., et al. (2019) · Nano Letters · doi:10.1021/acs.nanolett.9b00525 · Cited by 179
Tsai, M., Huang, C.-T., Lin, C., Lee, M., Yang, F., Li, M., Chang, Y.-M., Watanabe, K., Taniguchi, T., Ho, C., et al. (2023) · Nature Electronics · doi:10.1038/s41928-023-01034-7 · Cited by 183
Device and Circuit Architectures for In‐Memory Computing
Ielmini, D., & Pedretti, G. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000040 · Cited by 170
Bioinspired interactive neuromorphic devices
Yu, J., Wang, Y., Qin, S., Gao, G., Xu, C., Lin Wang, Z., & Sun, Q. (2022) · Materials Today · doi:10.1016/j.mattod.2022.09.012 · Cited by 176
Room-temperature logic-in-memory operations in single-metallofullerene devices
Li, J., Hou, S., Yao, Y.-R., Zhang, C., Wu, Q., Wang, H.-C., Zhang, H., Liu, X., Tang, C., Wei, M., et al. (2022) · Nature Materials · doi:10.1038/s41563-022-01309-y · Cited by 165
Raeis‐Hosseini, N., Park, Y., & Lee, J. (2018) · Advanced Functional Materials · doi:10.1002/adfm.201800553 · Cited by 172
Yin, S., Sun, X., Yu, S., & Seo, J.-S. (2020) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2020.3015178 · Cited by 171
“As an alternative hardware platform, emerging resistive devices have been proposed for dense weight storage and parallel neural computing for matrix–vector multiplications [14]–[20].”
MethodSelf-citationSun, X., & Yu, S. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2933148 · Cited by 170
“In recent years, emerging non-volatile memory (eNVM) based resistive synaptic devices [5], such as phase change memory (PCM) [6], [7], resistive random access memory (RRAM) [8]–[11], and ferroelectric field effect transistor (FeFET) [12], [13] are considered as promising candidates to replace SRAM cells due to the sma…”
BackgroundSelf-citationDevice and materials requirements for neuromorphic computing
Islam, R., Li, H., Chen, P.-Y., Wan, W., Chen, H.-Y., Gao, B., Wu, H., Yu, S., Saraswat, K., & Philip Wong, H.-S. (2019) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aaf784 · Cited by 158
“Two similar yet broad reviews on the relevant topic were done by Burr et al [20] and Yu et al [21].”
BackgroundSelf-citationNanostructured perovskites for nonvolatile memory devices
Liu, Q., Gao, S., Xu, L., Yue, W., Zhang, C., Kan, H., Li, Y., & Shen, G. (2022) · Chemical Society Reviews · doi:10.1039/d1cs00886b · Cited by 163
Seo, S., Lee, J.-J., Lee, H.-J., Lee, H. W., Oh, S., Lee, J. J., Heo, K., & Park, J.-H. (2020) · ACS Applied Electronic Materials · doi:10.1021/acsaelm.9b00694 · Cited by 161
Multiwavelength Optoelectronic Synapse with 2D Materials for Mixed-Color Pattern Recognition
Islam, M. M., Krishnaprasad, A., Dev, D., Martinez-Martinez, R., Okonkwo, V., Wu, B., Han, S. S., Bae, T.-S., Chung, H., Touma, J. E., et al. (2022) · ACS Nano · doi:10.1021/acsnano.2c01035 · Cited by 158
Electrolyte‐Gated Synaptic Transistor with Oxygen Ions
Huang, H., Ge, C., Zhang, Q., Liu, C., Du, J., Li, J., Wang, C., Gu, L., Yang, G., & Jin, K. (2019) · Advanced Functional Materials · doi:10.1002/adfm.201902702 · Cited by 152
Memristor devices for neural networks
Jeong, H., & Shi, L. (2018) · Journal of Physics D Applied Physics · doi:10.1088/1361-6463/aae223 · Cited by 164
Stochastic Memory Devices for Security and Computing
Carboni, R., & Ielmini, D. (2019) · Advanced Electronic Materials · doi:10.1002/aelm.201900198 · Cited by 161
“This is stimulating an intense industrial research and development towards embedded and standalone RRAM, with several memory prototypes reported at 2x nm technology [76], [77], [78], and also embedded in microcontrollers [79].”
MethodEmerging Materials for Neuromorphic Devices and Systems
Kim, M., Park, Y., Kim, I., & Lee, J. (2020) · iScience · doi:10.1016/j.isci.2020.101846 · Cited by 157
“To let the synaptic weights approach the desired values as nearly as possible, artificial synapses need to have a gradual and linear synaptic weight update characteristic; linear conductance change with >100 states is required (Yu, 2018).”
BackgroundInfluentialRRAM for Compute-in-Memory: From Inference to Training
Yu, S., Shim, W., Peng, X., & Luo, Y. (2021) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2021.3072200 · Cited by 170
“On the other hand, it is more efficient to embed the MAC computation into the memory array itself, namely compute-in-memory (CIM) [3], to minimize the data transfer on-chip.”
BackgroundSelf-citationHänsch, W., Raghunathan, A., Roy, K., Chakrabarti, B., Phatak, C., Wang, C., & Guha, S. (2022) · Advanced Materials · doi:10.1002/adma.202204944 · Cited by 167
Phase change thin films for non-volatile memory applications
Lotnyk, A., Behrens, M., & Rauschenbach, B. (2019) · Nanoscale Advances · doi:10.1039/c9na00366e · Cited by 149
Memristive and CMOS Devices for Neuromorphic Computing
Milo, V., Malavena, G., Compagnoni, C. M., & Ielmini, D. (2020) · Materials · doi:10.3390/ma13010166 · Cited by 158
Magnetic skyrmions for unconventional computing
Li, S., Kang, W., Zhang, X., Nie, T., Zhou, Y., Wang, K. L., & Zhao, W. S. (2020) · Materials Horizons · doi:10.1039/d0mh01603a · Cited by 145
Advancements in 2D layered material memristors: unleashing their potential beyond memory
Nirmal, K. A., Kumbhar, D. D., Kesavan, A. V., Dongale, T. D., & Kim, T. G. (2024) · npj 2D Materials and Applications · doi:10.1038/s41699-024-00522-4 · Cited by 147
Stochastic resonance in a metal-oxide memristive device
Mikhaylov, A. N., Guseinov, D. V., Belov, A. I., Korolev, D. S., Shishmakova, V. A., Koryazhkina, M. N., Filatov, D. O., Gorshkov, O. N., Maldonado, D., Alonso, F., et al. (2021) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2021.110723 · Cited by 144
Chakraborty, I., Ali, M., Ankit, A., Jain, S., Roy, S., Sridharan, S., Agrawal, A., Raghunathan, A., & Roy, K. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3003007 · Cited by 140
“This led to a growing interest in exploring NVM technology as the substrate for the next generation of ML hardware [19], [25], [26].”
BackgroundResistive Memory-Based Analog Synapse: The Pursuit for Linear and Symmetric Weight Update
Woo, J., & Yu, S. (2018) · IEEE Nanotechnology Magazine · doi:10.1109/mnano.2018.2844902 · Cited by 139
“in addition, the cross-point rraM array, where word and bit lines are perpendicular to each other, is beneficial for in-memory computation that accelerates the vector-matrix multiplications in a massively parallel fashion [7].”
BackgroundSelf-citationMemristor-based neural networks: a bridge from device to artificial intelligence
Cao, Z., Sun, B. T., Zhou, G., Mao, S., Zhu, S., Zhang, J., Ke, C., Zhao, Y. X., & Shao, J. (2023) · Nanoscale Horizons · doi:10.1039/d2nh00536k · Cited by 141
Weilenmann, C., Ziogas, A. N., Zellweger, T., Portner, K., Mladenović, M., Kaniselvan, M., Moraitis, T., Luisier, M., & Emboras, A. (2024) · Nature Communications · doi:10.1038/s41467-024-51093-3 · Cited by 136
“Several promising neuromorphic architectures use memristors as hardware synapses because of their ability to collocate memory and computation in a single device, which circumvents the von Neumann bottleneck 23 .”
Ismail, M., Chand, U., Mahata, C., Nebhen, J., & Kim, S. (2021) · Journal of Material Science and Technology · doi:10.1016/j.jmst.2021.04.025 · Cited by 134
Three-Dimensional nand Flash for Vector–Matrix Multiplication
Wang, P., Xu, F., Wang, B., Gao, B., Wu, H., Qian, H., & Yu, S. (2019) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2882194 · Cited by 132
“To this end, emerging nonvolatile memory (eNVM)-based crossbar array architecture has been proposed to implement the vector–matrix multiplication (VMM) [2], one of the most computation-intensive operations in DNNs.”
BackgroundSelf-citationLi, S., Li, B., Feng, X., Chen, L., Li, Y., Huang, L., Fong, X., & Ang, K. (2021) · npj 2D Materials and Applications · doi:10.1038/s41699-020-00190-0 · Cited by 133
Improving linearity by introducing Al in HfO 2 as a memristor synapse device
Chandrasekaran, S., Simanjuntak, F. M., Saminathan, R., Panda, D., & Tseng, T.-Y. (2019) · Nanotechnology · doi:10.1088/1361-6528/ab3480 · Cited by 131
“Gradual current changes (analog switching) instead of an abrupt current change (digital switching) is essential to achieve synaptic behavior [15, 16].”
BackgroundAnalog‐Type Resistive Switching Devices for Neuromorphic Computing
Zhang, W., Gao, B., Tang, J., Li, X., Wu, W., Qian, H., & Wu, H. (2019) · physica status solidi (RRL) - Rapid Research Letters · doi:10.1002/pssr.201900204 · Cited by 132
CMOS-compatible electrochemical synaptic transistor arrays for deep learning accelerators
Cui, J., An, F., Qian, J., Wu, Y., Sloan, L. L., Pidaparthy, S., Zuo, J., & Cao, Q. (2023) · Nature Electronics · doi:10.1038/s41928-023-00939-7 · Cited by 136
“If not, the training accuracy will be dramatically affected 4–6 .”
BackgroundEfficient Processing of Deep Neural Networks
Sze, V., Chen, Y., Yang, T.-J., & Emer, J. (2020) · Synthesis lectures on computer architecture · doi:10.2200/s01004ed1v01y202004cac050 · Cited by 183
“Second, the NVM devices can also suffer from device-to-device and cycle-to-cycle variations with nonlinear conductance across the conductance range [322, 323, 324].”
BackgroundMethodInfluentialMou, X., Tang, J., Lyu, Y., Zhang, Q., Yang, S., Xu, F., Liu, W., Xu, M., Zhou, Y. M., Sun, W. B., et al. (2021) · Science Advances · doi:10.1126/sciadv.abh0648 · Cited by 130
“Different from digital memory applications, here, reproducible analog switching characteristics (e.g., multilevel conductance states, weight update linearity and symmetry, and low variability) are desired to meet the requirement of high computing accuracy and energy efficiency ( 9 , 10 ).”
BackgroundGo, G.-T., Lee, Y., Seo, D.-G., Pei, M., Lee, W., Yang, H., & Lee, T.-W. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000012 · Cited by 125
Ferroelectric field effect transistors for electronics and optoelectronics
Jiao, H., Wang, X., Wu, S., Chen, Y., Chu, J., & Wang, J. (2023) · Applied Physics Reviews · doi:10.1063/5.0090120 · Cited by 123
Mixed-Precision Deep Learning Based on Computational Memory
Nandakumar, S. R., Le Gallo, M., Piveteau, C., Joshi, V., Mariani, G., Boybat, I., Karunaratne, G., Khaddam-Aljameh, R., Egger, U., Petropoulos, A., et al. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00406 · Cited by 120
“However, realizing accurate and gradual modulations of the conductance of the memristive devices for the weight update stage has posed a major challenge in utilizing computational memory to achieve accurate DNN training (Yu, 2018).”
BackgroundAnalog Synaptic Transistor with Al-Doped HfO2 Ferroelectric Thin Film
Kim, D., Jeon, Y., Ku, B., Chung, C., Kim, T. H., Yang, S., Won, U., Jeong, T.-H., & Choi, C. (2021) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.1c12735 · Cited by 119
Brain-Inspired Computing: A Systematic Survey and Future Trends
Li, G., Deng, L., Tang, H., Pan, G., Tian, Y., Roy, K., & Maass, W. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3429360 · Cited by 154
“Emerging memories here mainly refer to memristor-based memory devices [323], [324], [325].”
Brain-inspired computing via memory device physics
Ielmini, D., Wang, Z., & Liu, Y. (2021) · APL Materials · doi:10.1063/5.0047641 · Cited by 123
Milo, V., Glukhov, A., Pérez, E., Zambelli, C., Lepri, N., Mahadevaiah, M. K., Quesada, E. P.-B., Olivo, P., Wenger, C., & Ielmini, D. (2021) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2021.3089995 · Cited by 115
Emerging synaptic devices: from two-terminal memristors to multiterminal neuromorphic transistors
Jiang, S., Nie, S., He, Y., Liu, R., Chen, C., & Wan, Q. (2019) · Materials Today Nano · doi:10.1016/j.mtnano.2019.100059 · Cited by 129
Probabilistic Neural Computing with Stochastic Devices
Misra, S., Bland, L. C., Cardwell, S., Incorvia, J. A. C., James, C. D., Kent, A. D., Schuman, C. D., Smith, J. D., & Aimone, J. B. (2022) · Advanced Materials · doi:10.1002/adma.202204569 · Cited by 114
Peng, X., Liu, R., & Yu, S. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702715 · Cited by 113
“As the two-terminal selector technology is premature, one-transistor-one-resistor (1T1R) based pseudocrossbar is practical for large-scale integration [3].”
BackgroundMethodSelf-citationKim, M., Kim, I., & Lee, J. (2022) · Science Advances · doi:10.1126/sciadv.abm8537 · Cited by 123
“Although there are some issues associated with an incremental pulse scheme, the use of this scheme can produce highly linear weight update characteristics, which are essential requirements for CIM hardware with a high recognition accuracy because the weights of the synaptic devices should be precisely adjusted to the…”
BackgroundMethodInfluentialKim, I., Kim, M., & Lee, J. (2023) · Nature Communications · doi:10.1038/s41467-023-36270-0 · Cited by 112
Metadata
- Authors
- Yu, S.
- Affiliations
- Arizona State University (US)
- Corresponding author
- Yu, Shimeng
- ORCID
- Yu, Shimeng
- Venue
- Proceedings of the IEEE
- Published
- 2018-02
- Volume
- 106
- Issue
- 2
- Pages
- 260-285
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2785141883
- Cited by
- 1,170
- References
- 141
- Citations by year
- 2026: 96 · 2025: 139 · 2024: 138 · 2023: 148 · 2022: 177 · 2021: 146 · 2020: 162 · 2019: 117 · 2018: 47
- FWCI
- 45.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Proceedings of the IEEE (publishedVersion)
- Funders
- NSF-CCF (NSF-CCF-1552687)
- NSFCCF (NSFCCF-1715443)
- NSF-ECCS (NSF-ECCS-1701565)
- HDTRA (HDTRA1-17-1-0038)
- NSF/SRC (NSF/SRC E2CDA)
- ASCENT (one of the six SRC/DARPA JUMP Centers)
- Qualcomm
- Samsung
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Keywords
- neuromorphic computing, neuromorphic hardware, non-volatile memory, artificial synapses, phase-change memory, resistive random access memory, ferroelectric memory, floating-gate transistors, pattern recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.