Memristor devices for neural networks
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Abstract Neural network technologies have taken center stage owing to their powerful computing capability for supporting deep learning in artificial intelligence. However, conventional synaptic devices such as SRAM and DRAM are not satisfactory solutions for neural networks. Recently, several types of memristor devices have become popular alternatives because of their outstanding characteristics such as scalability, high performance, and non-volatility. To understand the characteristics of memristors, a comparison among memristors has been made, considering both maturity and performance. Magneto-resistance random access memory, phase-change random access memory, and resistive random access memory among the proposed memristors are good candidates as synaptic devices for weight storage and matrix-vector multiplication required in artificial neural networks (ANNs). Moreover, these devices play key roles as synaptic devices in research for bio-plausible spiking neural networks (SNNs) because their distinctive switching properties are well matched for emulating synaptic and neuron functions of biological neural networks. In this paper we review motivation, advantage, technology, and applications of memristor devices for neural networks from practical approaches of ANNs to futuristic research of SNNs, considering the current status of memristor technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Strukov, D. B., Snider, G. S., Stewart, D. R., & Williams, R. S. (2008) · Nature · doi:10.1038/nature06932 · Cited by 11,828
Memristor—The Missing Circuit Element
Chua, L. (1971) · IEEE Transactions on Circuit Theory · doi:10.1109/tct.1971.1083337 · Cited by 10,268 · cited 2×
“The memristor was originally defined as a component that connected charge and magnetic flux [1, 2], and had a pinched-hysteresis loop I–V relationship whose size was frequency dependent [3].”
BackgroundHinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084 · cited 1×
“It is known that the efficiency of the human brain is essentially 500 000 times better than that of a conventional computer [119].”
Background3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Bi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174
Memristive devices for computing
Yang, J. J., Strukov, D. B., & Stewart, D. R. (2013) · Nature Nanotechnology · doi:10.1038/nnano.2012.240 · Cited by 3,885 · cited 1×
“[108], better reliability (endurance >1012, retention >10 years at 150 °C) [106, 107], and higher density (32 Gb) using”
BackgroundTraining and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001 · cited 1×
“Artificial neural networks (ANNs) having computational units that apply an activation function with a continuous set of possible output values to a weighted sum of inputs, are regarded as second generation neural network models [33, 34].”
BackgroundReservoir computing approaches to recurrent neural network training
Lukoševičius, M., & Jaeger, H. (2009) · Computer Science Review · doi:10.1016/j.cosrev.2009.03.005 · Cited by 2,956
Memristive devices and systems
Chua, L. O., & Kang, S. M. (1976) · Proceedings of the IEEE · doi:10.1109/proc.1976.10092 · Cited by 2,604 · cited 1×
“The memristor was originally defined as a component that connected charge and magnetic flux [1, 2], and had a pinched-hysteresis loop I–V relationship whose size was frequency dependent [3].”
BackgroundMemristors with diffusive dynamics as synaptic emulators for neuromorphic computing
Wang, Z., Joshi, S., Savel’ev, S. E., Jiang, H., Midya, R., Lin, P., Hu, M., Ge, N., Strachan, J. P., Li, Z., et al. (2017) · Nature Materials · doi:10.1038/nmat4756 · Cited by 2,358 · cited 3×
“Among emerging non-volatile memory devices, some devices such as MRAM, PRAM, RRAM, and FeRAM emerged as memristor devices later [15, 54 – 59].”
BackgroundMethodBinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1602.02830 · Cited by 2,106
Short-term plasticity and long-term potentiation mimicked in single inorganic synapses
Ohno, T., Hasegawa, T., Tsuruoka, T., Terabe, K., Gimzewski, J. K., & Aono, M. (2011) · Nature Materials · doi:10.1038/nmat3054 · Cited by 1,793 · cited 2×
“This phenomenon can appear in many types of conductive bridge devices, such as the Ag/Ag 2 S/nanogap/Pt [258], Cu/Cu 2 S/ nanogap/Pt [259], and Ag/GeS 2 /W synaptic devices [260].”
BackgroundMethodResistance switching memories are memristors
Chua, L. (2011) · Applied Physics A · doi:10.1007/s00339-011-6264-9 · Cited by 1,434
Sparse coding of sensory inputs
Olshausen, B. A., & Field, D. J. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.07.007 · Cited by 1,404
Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing
Kuzum, D., Jeyasingh, R. G. D., Lee, B., & Wong, H.-S. P. (2012) · Nano Letters · doi:10.1021/nl201040y · Cited by 1,267 · cited 1×
“A commonly used SNN learning algorithm is STDP [58, 239 – 240].”
MethodAmdahl's Law in the Multicore Era
Hill, M. D., & Marty, M. R. (2008) · Computer · doi:10.1109/mc.2008.209 · Cited by 1,262
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
Ultrasound image segmentation: a survey
Noble, J. A., & Boukerroui, D. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.877092 · Cited by 1,157
Approximation of dynamical systems by continuous time recurrent neural networks
Funahashi, K.-I., & Nakamura, Y. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80125-x · Cited by 980
Burr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936
Electrochemical metallization memories—fundamentals, applications, prospects
Valov, I., Waser, R., Jameson, J. R., & Kozicki, M. N. (2011) · Nanotechnology · doi:10.1088/0957-4484/22/25/254003 · Cited by 921 · cited 2×
“[241, 253] and (b), respectively [58, 193, 254], which require the characteristics of analog memristor devices.”
BackgroundYu, S., Wu, Y., Jeyasingh, R., Kuzum, D., & Wong, H.-S. P. (2011) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2011.2147791 · Cited by 805 · cited 1×
“Until now, many types of synaptic devices based on RRAM such as GdO x /Cu:MoO x [246], TiO x [232], WO x [247], FeO x /SiO x [248], HfO x [249], AlO x [250], TiO x /HfO x multilayers [251], and PCMO [252] have been reported.”
BackgroundMemristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine
Hu, M., Graves, C. E., Li, C., Li, Y., Ge, N., Montgomery, E., Davila, N., Jiang, H., Williams, R. S., Yang, J. J., et al. (2018) · Advanced Materials · doi:10.1002/adma.201705914 · Cited by 751 · cited 1×
“Already the possibility of many mem-ristor devices as neural devices has been proven by estimating their key characteristics at the research level, which will be discussed later in detail [47 – 51].”
BackgroundSparse coding with memristor networks
Sheridan, P. M., Cai, F., Du, C., Ma, W., Zhang, Z., & Lu, W. D. (2017) · Nature Nanotechnology · doi:10.1038/nnano.2017.83 · Cited by 619
NeuFlow: A runtime reconfigurable dataflow processor for vision
Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., & LeCun, Y. (2011) · CVPR 2011 WORKSHOPS · doi:10.1109/cvprw.2011.5981829 · Cited by 369
Spin-Transfer Torque Magnetic Memory as a Stochastic Memristive Synapse for Neuromorphic Systems
Vincent, A. F., Larroque, J., Locatelli, N., Ben Romdhane, N., Bichler, O., Gamrat, C., Zhao, W. S., Klein, J.-O., Galdin-Retailleau, S., & Querlioz, D. (2015) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2015.2414423 · Cited by 360
Study of Multilevel Programming in Programmable Metallization Cell (PMC) Memory
Russo, U., Kamalanathan, D., Ielmini, D., Lacaita, A. L., & Kozicki, M. N. (2009) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2009.2016019 · Cited by 319
Local Binary Convolutional Neural Networks
Juefei-Xu, F., Boddeti, V. N., & Savvides, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.456 · Cited by 297 · cited 1×
“Some researchers are trying to generalize this concept to quantized neural networks (QNNs) having low precision weights and activations such as binary, ternary, and slightly higher [213].”
BackgroundAmbrogio, S., Balatti, S., Milo, V., Carboni, R., Wang, Z.-Q., Calderoni, A., Ramaswamy, N., & Ielmini, D. (2016) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2016.2526647 · Cited by 256
YodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Andri, R., Cavigelli, L., Rossi, D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2682138 · Cited by 247
Binary neural network with 16 Mb RRAM macro chip for classification and online training
Yu, S., Li, Z., Chen, P.-Y., Wu, H., Gao, B., Wang, D., Wu, W., & Qian, H. (2016) · 2016 IEEE International Electron Devices Meeting (IEDM) · doi:10.1109/iedm.2016.7838429 · Cited by 219
Yu, S., Gao, B., Fang, Z., Yu, H., Kang, J., & Wong, H.-S. P. (2012) · 2012 International Electron Devices Meeting · doi:10.1109/iedm.2012.6479018 · Cited by 213
RRAM-based synapse for neuromorphic system with pattern recognition function
Park, S., Kim, H., Choo, M., Noh, J., Sheri, A., Jung, S., Seo, K., Park, J., Kim, S., Lee, W., et al. (2012) · 2012 International Electron Devices Meeting · doi:10.1109/iedm.2012.6479016 · Cited by 191 · cited 1×
“Until now, many types of synaptic devices based on RRAM such as GdOx/Cu:MoOx [246], TiOx [232], WOx [247], FeOx/SiOx [248], HfOx [249], AlOx [250], TiOx/HfOx multilayers [251], and PCMO [252] have been reported.”
BackgroundNanoscale resistive memory with intrinsic diode characteristics and long endurance
Kim, K.-H., Hyun Jo, S., Gaba, S., & Lu, W. (2010) · Applied Physics Letters · doi:10.1063/1.3294625 · Cited by 187
Ando, K., Ueyoshi, K., Orimo, K., Yonekawa, H., Sato, S., Nakahara, H., Takamaeda-Yamazaki, S., Ikebe, M., Asai, T., Kuroda, T., et al. (2018) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2017.2778702 · Cited by 160
The Missing Memristor has Not been Found
Vongehr, S., & Meng, X. (2015) · Scientific Reports · doi:10.1038/srep11657 · Cited by 131
Governing Big Data: Principles and practices
Malik, P. (2013) · IBM Journal of Research and Development · doi:10.1147/jrd.2013.2241359 · Cited by 109
An Energy-Efficient Digital ReRAM-Crossbar-Based CNN With Bitwise Parallelism
Ni, L., Liu, Z., Yu, H., & Joshi, R. V. (2017) · IEEE Journal on Exploratory Solid-State Computational Devices and Circuits · doi:10.1109/jxcdc.2017.2697910 · Cited by 74
Experimental demonstration of array-level learning with phase change synaptic devices
Eryilmaz, S. B., Kuzum, D., Jeyasingh, R. G. D., Kim, S., BrightSky, M., Lam, C., & Wong, H.-S. P. (2013) · 2013 IEEE International Electron Devices Meeting · doi:10.1109/iedm.2013.6724691 · Cited by 51
Memristor-based perceptron classifier: Increasing complexity and coping with imperfect hardware
Bayat, F. M., Prezioso, M., Chakrabarti, B., Kataeva, I., & Strukov, D. (2017) · 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2017.8203825 · Cited by 29
Fischetti, M. (2011) · Scientific American · doi:10.1038/scientificamerican1111-104 · Cited by 20
Cited by
Artificial Intelligence in Healthcare: Review and Prediction Case Studies
Rong, G., Mendez, A., Bou Assi, E., Zhao, B., & Sawan, M. (2020) · Engineering · doi:10.1016/j.eng.2019.08.015 · Cited by 552
Imambi, S., Prakash, K. B., & Kanagachidambaresan, G. R. (2021) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-57077-4_10 · Cited by 489
Neuro-inspired electronic skin for robots
Liu, F., Deswal, S., Christou, A., Sandamirskaya, Y., Kaboli, M., & Dahiya, R. (2022) · Science Robotics · doi:10.1126/scirobotics.abl7344 · Cited by 300
Sun, J., Li, C., Wang, Z., & Wang, Y. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3312405 · Cited by 172
Toward Reliable Compact Modeling of Multilevel 1T-1R RRAM Devices for Neuromorphic Systems
Pérez-Bosch Quesada, E., Romero-Zaliz, R., Pérez, E., Kalishettyhalli Mahadevaiah, M., Reuben, J., Schubert, M. A., Jiménez-Molinos, F., Roldán, J. B., & Wenger, C. (2021) · Electronics · doi:10.3390/electronics10060645 · Cited by 54
“Finally, variability do not prevent the technology from being used in a multilevel scheme in different Artificial Intelligence hardware accelerators since some prototypes have been fabricated based on these type of devices [45,46].”
Method
Metadata
- Authors
- Jeong, H., & Shi, L.
- Venue
- Journal of Physics D: Applied Physics
- Publisher
- IOP Publishing
- Published
- 2018-10-30
- Volume
- 52
- Issue
- 2
- Pages
- 023003
- ISSN
- 0022-3727 (ISSN-L)
- 1361-6463
- OpenAlex
- W2890653437
- Cited by
- 147
- References
- 47
- FWCI
- 4.52
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.