The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
In-memory Learning with Analog Resistive Switching Memory: A Review and Perspective
Abstract
In this article, we review the existing analog resistive switching memory (RSM) devices and their hardware technologies for in-memory learning, as well as their challenges and prospects. Since the characteristics of the devices are different for in-memory learning and digital memory applications, it is important to have an in-depth understanding across different layers from devices and circuits to architectures and algorithms. First, based on a top-down view from architecture to devices for analog computing, we define the main figures of merit (FoMs) and perform a comprehensive analysis of analog RSM hardware including the basic device characteristics, hardware algorithms, and the corresponding mapping methods for device arrays, as well as the architecture and circuit design considerations for neural networks. Second, we classify the FoMs of analog RSM devices into two levels. Level 1 FoMs are essential for achieving the functionality of a system (e.g., linearity, symmetry, dynamic range, level numbers, fluctuation, variability, and yield). Level 2 FoMs are those that make a functional system more efficient and reliable (e.g., area, operational voltage, energy consumption, speed, endurance, retention, and compatibility with back-end-of-line processing). By constructing a device-to-application simulation framework, we perform an in-depth analysis of how these FoMs influence in-memory learning and give a target list of the device requirements. Lastly, we evaluate the main FoMs of most existing devices with analog characteristics and review optimization methods from programming schemes to materials and device structures. The key challenges and prospects from the device to system level for analog RSM devices are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Strukov, D. B., Snider, G. S., Stewart, D. R., & Williams, R. S. (2008) · Nature · doi:10.1038/nature06932 · Cited by 11,828
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174 · cited 2×
“These include the use of set-only two-RRAM per cell, reset-only two-RRAM per cell [51]–[53], multiple-weak-filament RRAM [54], [55], and interfacial switching RRAM [23], [56]–[59].”
MethodEyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
Chen, Y.-H., Krishna, T., Emer, J. S., & Sze, V. (2017) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2016.2616357 · Cited by 3,247
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing
Wang, Z., Joshi, S., Savel’ev, S. E., Jiang, H., Midya, R., Lin, P., Hu, M., Ge, N., Strachan, J. P., Li, Z., et al. (2017) · Nature Materials · doi:10.1038/nmat4756 · Cited by 2,358
In-memory computing with resistive switching devices
Ielmini, D., & Wong, H.-S. P. (2018) · Nature Electronics · doi:10.1038/s41928-018-0092-2 · Cited by 2,298 · cited 1×
“…articles that discussed the computation-in-memory from different perspectives, including device model and characterizations [31], resistive switching materials and mechanisms [62], computing schemes [63], reliability [64], bio-inspired characteristics [65], and hardware implementations [66], [67].”
BackgroundFully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179 · cited 2×
“Yao et al. [75] developed a hybrid training method that combined on-chip and off-chip learning to accommodate device imperfections and improve the overall system performance.”
BackgroundMethodSelf-citationMemristive crossbar arrays for brain-inspired computing
Xia, Q., & Yang, J. J. (2019) · Nature Materials · doi:10.1038/s41563-019-0291-x · Cited by 1,800
Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing
Kuzum, D., Jeyasingh, R. G. D., Lee, B., & Wong, H.-S. P. (2012) · Nano Letters · doi:10.1021/nl201040y · Cited by 1,267 · cited 1×
“…limitations, emerging nonvolatile memory (NVM) devices, such as resistive random access memory (RRAM) [19], phase change memory (PCM) [20], and ferroelectric devices (e.g., ferroelectric field effect transistor—FeFET [21] and ferroelectric tunneling junction—FTJ [22]) have gained…”
BackgroundResistive switching materials for information processing
Wang, Z., Wu, H., Burr, G. W., Hwang, C. S., Wang, K. L., Xia, Q., & Yang, J. J. (2020) · Nature Reviews Materials · doi:10.1038/s41578-019-0159-3 · Cited by 1,214 · cited 1×
“…articles that discussed the computation-in-memory from different perspectives, including device model and characterizations [31], resistive switching materials and mechanisms [62], computing schemes [63], reliability [64], bio-inspired characteristics [65], and hardware implementations [66], [67].”
BackgroundSelf-citationNeuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170 · cited 5×
“Recent work has led to some generally accepted conclusions about the key device characteristics, for example, linearity, symmetry, and level numbers as well as variation and fluctuation [67], [88], [91], [104].”
BackgroundMethodInfluentialEquivalent-accuracy accelerated neural-network training using analogue memory
Ambrogio, S., Narayanan, P., Tsai, H., Shelby, R. M., Boybat, I., di Nolfo, C., Sidler, S., Giordano, M., Bodini, M., Farinha, N. C. P., et al. (2018) · Nature · doi:10.1038/s41586-018-0180-5 · Cited by 1,151
Towards artificial general intelligence with hybrid Tianjic chip architecture
Pei, J., Deng, L., Song, S., Zhao, M., Zhang, Y., Wu, S., Wang, G., Zou, Z., Wu, Z., He, W., et al. (2019) · Nature · doi:10.1038/s41586-019-1424-8 · Cited by 1,082
Self-citationBurr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936 · cited 4×
“The amplitude-dependent analog inputs [81]–[87] and timedependent digital inputs [70], [85] are the two most common choices.”
BackgroundMethodInfluentialEfficient and self-adaptive in-situ learning in multilayer memristor neural networks
Li, C., Belkin, D., Li, Y., Yan, P., Hu, M., Ge, N., Jiang, H., Montgomery, E., Lin, P., Wang, Z., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04484-2 · Cited by 931
Face classification using electronic synapses
Yao, P., Wu, H., Gao, B., Eryilmaz, S. B., Huang, X., Zhang, W., Zhang, Q., Deng, N., Shi, L., Wong, H.-S. P., et al. (2017) · Nature Communications · doi:10.1038/ncomms15199 · Cited by 909
Self-citationNeuromorphic computing with multi-memristive synapses
Boybat, I., Le Gallo, M., Nandakumar, S. R., Moraitis, T., Parnell, T., Tuma, T., Rajendran, B., Leblebici, Y., Sebastian, A., & Eleftheriou, E. (2018) · Nature Communications · doi:10.1038/s41467-018-04933-y · Cited by 899 · cited 3×
“A succinct definition as well as the relationships between some device characteristics and synaptic weights of the neural network are summarized in Table 3 [78], [88], [90].”
BackgroundMethodYu, S., Wu, Y., Jeyasingh, R., Kuzum, D., & Wong, H.-S. P. (2011) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2011.2147791 · Cited by 805
Woo, J., Moon, K., Song, J., Lee, S., Kwak, M., Park, J., & Hwang, H. (2016) · IEEE Electron Device Letters · doi:10.1109/led.2016.2582859 · Cited by 512 · cited 2×
“These include the use of set-only two-RRAM per cell, reset-only two-RRAM per cell [51]–[53], multipleweak-filament RRAM [54], [55], and interfacial switching RRAM [23], [56]–[59].”
BackgroundMethodGuan, X., Yu, S., & Wong, H.-S. P. (2012) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2012.2184545 · Cited by 355 · cited 1×
“Agarwal et al. [119] focused on the impact of read noise and write noise on neural network learning, which is very common in weight updates [130], [131].”
BackgroundReliability of analog resistive switching memory for neuromorphic computing
Zhao, M., Gao, B., Tang, J., Qian, H., & Wu, H. (2020) · Applied Physics Reviews · doi:10.1063/1.5124915 · Cited by 349
Self-citationSuri, M., Bichler, O., Querlioz, D., Cueto, O., Perniola, L., Sousa, V., Vuillaume, D., Gamrat, C., & DeSalvo, B. (2011) · 2011 International Electron Devices Meeting · doi:10.1109/iedm.2011.6131488 · Cited by 314
Khwa, W.-S., Chen, J.-J., Li, J.-F., Si, X., Yang, E.-Y., Sun, X., Liu, R., Chen, P.-Y., Li, Q., Yu, S., et al. (2018) · 2018 IEEE International Solid - State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2018.8310401 · Cited by 260
Self-citation3-D Memristor Crossbars for Analog and Neuromorphic Computing Applications
Adam, G. C., Hoskins, B. D., Prezioso, M., Merrikh-Bayat, F., Chakrabarti, B., & Strukov, D. B. (2017) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2016.2630925 · Cited by 234
Microscopic Modeling of HfOx RRAM Operations: From Forming to Switching
Padovani, A., Larcher, L., Pirrotta, O., Vandelli, L., & Bersuker, G. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2418114 · Cited by 219
Binary neural network with 16 Mb RRAM macro chip for classification and online training
Yu, S., Li, Z., Chen, P.-Y., Wu, H., Gao, B., Wang, D., Wu, W., & Qian, H. (2016) · 2016 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2016.7838429 · Cited by 219
Self-citationA Methodology to Improve Linearity of Analog RRAM for Neuromorphic Computing
Wu, W., Wu, H., Gao, B., Yao, P., Zhang, X., Peng, X., Yu, S., & Qian, H. (2018) · 2018 IEEE Symposium on VLSI Technology · doi:10.1109/vlsit.2018.8510690 · Cited by 197
Self-citationRRAM-based synapse for neuromorphic system with pattern recognition function
Park, S., Kim, H., Choo, M., Noh, J., Sheri, A., Jung, S., Seo, K., Park, J., Kim, S., Lee, W., et al. (2012) · 2012 International Electron Devices Meeting · doi:10.1109/iedm.2012.6479016 · Cited by 191 · cited 1×
“These include the use of set-only two-RRAM per cell, reset-only two-RRAM per cell [51]–[53], multiple-weak-filament RRAM [54], [55], and interfacial switching RRAM [23], [56]–[59].”
MethodData Clustering using Memristor Networks
Choi, S., Sheridan, P., & Lu, W. D. (2015) · Scientific Reports · doi:10.1038/srep10492 · Cited by 132
Diffusion of oxygen in amorphous Al2O3, Ta2O5, and Nb2O5
Nakamura, R., Toda, T., Tsukui, S., Tane, M., Ishimaru, M., Suzuki, T., & Nakajima, H. (2014) · Journal of Applied Physics · doi:10.1063/1.4889800 · Cited by 132
Tuning Resistive Switching Characteristics of Tantalum Oxide Memristors through Si Doping
Kim, S., Choi, S., Lee, J., & Lu, W. D. (2014) · ACS Nano · doi:10.1021/nn503464q · Cited by 129
Woo, J., Padovani, A., Moon, K., Kwak, M., Larcher, L., & Hwang, H. (2017) · IEEE Electron Device Letters · doi:10.1109/led.2017.2731859 · Cited by 103 · cited 4×
“In this section, some device optimizations and their underlying mechanisms are discussed, including electrothermal modulation [54], [141], [145], preferable locations of conductive filaments [147], interface barrier modulation [148], and optimization of cell structure [143].”
BackgroundMethodInfluentialIn-Memory and Error-Immune Differential RRAM Implementation of Binarized Deep Neural Networks
Bocquet, M., Hirztlin, T., Klein, J.-O., Nowak, E., Vianello, E., Portal, J.-M., & Querlioz, D. (2018) · 2018 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2018.8614639 · Cited by 99
Lee, H. D., Kim, S. G., Cho, K., Hwang, H., Choi, H., Lee, J., Lee, S. H., Lee, H. J., Suh, J., Chung, S.-O., et al. (2012) · 2012 Symposium on VLSI Technology (VLSIT) · doi:10.1109/vlsit.2012.6242506 · Cited by 68
Ni, L., Wang, Y., Yu, H., Yang, W., Weng, C., & Zhao, J. (2016) · 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2016.7428024 · Cited by 52
Negrov, D., Karandashev, I., Shakirov, V., Matveyev, Y., Dunin-Barkowski, W., & Zenkevich, A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.10.061 · Cited by 49
Sidler, S., Boybat, I., Shelby, R. M., Narayanan, P., Jang, J., Fumarola, A., Moon, K., Leblebici, Y., Hwang, H., & Burr, G. W. (2016) · 2016 46th European Solid-State Device Research Conference (ESSDERC) · doi:10.1109/essderc.2016.7599680 · Cited by 47
Accelerating machine learning with Non-Volatile Memory: Exploring device and circuit tradeoffs
Fumarola, A., Narayanan, P., Sanches, L. L., Sidler, S., Jang, J., Moon, K., Shelby, R. M., Hwang, H., & Burr, G. W. (2016) · 2016 IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2016.7738684 · Cited by 37
Kim, B., Kim, W., Kim, H., Jung, K., Park, W., Seo, B., Joo, M., Lee, K., Hong, K., & Park, S. (2013) · Japanese Journal of Applied Physics · doi:10.7567/jjap.52.04cd05 · Cited by 7
Cited by
Edge learning using a fully integrated neuro-inspired memristor chip
Zhang, W., Yao, P., Gao, B., Liu, Q., Wu, D., Zhang, Q., Li, Y., Qin, Q., Li, J., Zhu, Z., et al. (2023) · Science · doi:10.1126/science.ade3483 · Cited by 437
Self-citationMemristive Crossbar Arrays for Storage and Computing Applications
Li, H., Wang, S., Zhang, X., Wang, W., Yang, R., Sun, Z., Feng, W., Lin, P., Wang, Z., Sun, L., et al. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202100017 · Cited by 205
Linearly programmable two-dimensional halide perovskite memristor arrays for neuromorphic computing
Kim, S. J., Im, I. H., Baek, J. H., Choi, S., Park, S. H., Lee, D. E., Kim, J. Y., Kim, S. Y., Park, N.-G., Lee, D., et al. (2025) · Nature Nanotechnology · doi:10.1038/s41565-024-01790-3 · Cited by 157
Echo state graph neural networks with analogue random resistive memory arrays
Wang, S., Li, Y., Wang, D., Zhang, W., Chen, X., Dong, D., Wang, S., Zhang, X., Lin, P., Gallicchio, C., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00609-5 · Cited by 84
Activity-difference training of deep neural networks using memristor crossbars
Yi, S.-I., Kendall, J. D., Williams, R. S., & Kumar, S. (2022) · Nature Electronics · doi:10.1038/s41928-022-00869-w · Cited by 75
Metadata
- Authors
- Xi, Y., Gao, B., Tang, J., Chen, A., Chang, M.-F., Hu, X. S., Spiegel, J. V. D., Qian, H., & Wu, H.
- Venue
- Proceedings of the IEEE
- Published
- 2021-01
- Volume
- 109
- Issue
- 1
- Pages
- 14-42
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W3042167479
- Cited by
- 196
- References
- 43
- FWCI
- 9.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.