Brain-inspired computing via memory device physics
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
In our brain, information is exchanged among neurons in the form of spikes where both the space (which neuron fires) and time (when the neuron fires) contain relevant information. Every neuron is connected to other neurons by synapses, which are continuously created, updated, and stimulated to enable information processing and learning. Realizing the brain-like neuron/synapse network in silicon would enable artificial autonomous agents capable of learning, adaptation, and interaction with the environment. Toward this aim, the conventional microelectronic technology, which is based on complementary metal–oxide–semiconductor transistors and the von Neumann computing architecture, does not provide the desired energy efficiency and scaling potential. A generation of emerging memory devices, including resistive switching random access memory (RRAM) also known as the memristor, can offer a wealth of physics-enabled processing capabilities, including multiplication, integration, potentiation, depression, and time-decaying stimulation, which are suitable to recreate some of the fundamental phenomena of the human brain in silico. This work provides an overview about the status and the most recent updates on brain-inspired neuromorphic computing devices. After introducing the RRAM device technologies, we discuss the main computing functionalities of the human brain, including neuron integration and fire, dendritic filtering, and short- and long-term synaptic plasticity. For each of these processing functions, we discuss their proposed implementation in terms of materials, device structure, and brain-like characteristics. The rich device physics, the nano-scale integration, the tolerance to stochastic variations, and the ability to process information in situ make the emerging memory devices a promising technology for future brain-like hardware intelligence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Nanoionics-based resistive switching memories
Waser, R., & Aono, M. (2007) · Nature Materials · doi:10.1038/nmat2023 · Cited by 4,923
Simple model of spiking neurons
Izhikevich, E. M. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820440 · Cited by 4,828
Bi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing
Wang, Z., Joshi, S., Savel’ev, S. E., Jiang, H., Midya, R., Lin, P., Hu, M., Ge, N., Strachan, J. P., Li, Z., et al. (2017) · Nature Materials · doi:10.1038/nmat4756 · Cited by 2,358
Self-citationIn-memory computing with resistive switching devices
Ielmini, D., & Wong, H.-S. P. (2018) · Nature Electronics · doi:10.1038/s41928-018-0092-2 · Cited by 2,298
Self-citationSynaptic plasticity: taming the beast
Abbott, L. F., & Nelson, S. B. (2000) · Nature Neuroscience · doi:10.1038/81453 · Cited by 2,263
Short-term plasticity and long-term potentiation mimicked in single inorganic synapses
Ohno, T., Hasegawa, T., Tsuruoka, T., Terabe, K., Gimzewski, J. K., & Aono, M. (2011) · Nature Materials · doi:10.1038/nmat3054 · Cited by 1,793
Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing
Kuzum, D., Jeyasingh, R. G. D., Lee, B., & Wong, H.-S. P. (2012) · Nano Letters · doi:10.1021/nl201040y · Cited by 1,267
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
Fully memristive neural networks for pattern classification with unsupervised learning
Wang, Z., Joshi, S., Savel’ev, S., Song, W., Midya, R., Li, Y., Rao, M., Yan, P., Asapu, S., Zhuo, Y., et al. (2018) · Nature Electronics · doi:10.1038/s41928-018-0023-2 · Cited by 1,106
Self-citationShort-Term Memory to Long-Term Memory Transition in a Nanoscale Memristor
Chang, T., Jo, S.-H., & Lu, W. (2011) · ACS Nano · doi:10.1021/nn202983n · Cited by 1,058
Burr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936
Neuromorphic computing with multi-memristive synapses
Boybat, I., Le Gallo, M., Nandakumar, S. R., Moraitis, T., Parnell, T., Tuma, T., Rajendran, B., Leblebici, Y., Sebastian, A., & Eleftheriou, E. (2018) · Nature Communications · doi:10.1038/s41467-018-04933-y · Cited by 899
Yu, S., Wu, Y., Jeyasingh, R., Kuzum, D., & Wong, H.-S. P. (2011) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2011.2147791 · Cited by 805
Parallel programming of an ionic floating-gate memory array for scalable neuromorphic computing
Fuller, E. J., Keene, S. T., Melianas, A., Wang, Z., Agarwal, S., Li, Y., Tuchman, Y., James, C. D., Marinella, M. J., Yang, J. J., et al. (2019) · Science · doi:10.1126/science.aaw5581 · Cited by 756
Self-citationMemristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine
Hu, M., Graves, C. E., Li, C., Li, Y., Ge, N., Montgomery, E., Davila, N., Jiang, H., Williams, R. S., Yang, J. J., et al. (2018) · Advanced Materials · doi:10.1002/adma.201705914 · Cited by 751
Choi, S., Tan, S. H., Li, Z., Kim, Y., Choi, C., Chen, P.-Y., Yeon, H., Yu, S., & Kim, J. (2018) · Nature Materials · doi:10.1038/s41563-017-0001-5 · Cited by 690
Temporal data classification and forecasting using a memristor-based reservoir computing system
Moon, J., Ma, W., Shin, J. H., Cai, F., Du, C., Lee, S. H., & Lu, W. D. (2019) · Nature Electronics · doi:10.1038/s41928-019-0313-3 · Cited by 645
Correlation between neural spike trains increases with firing rate
de la Rocha, J., Doiron, B., Shea-Brown, E., Josić, K., & Reyes, A. (2007) · Nature · doi:10.1038/nature06028 · Cited by 644
Sparse coding with memristor networks
Sheridan, P. M., Cai, F., Du, C., Ma, W., Zhang, Z., & Lu, W. D. (2017) · Nature Nanotechnology · doi:10.1038/nnano.2017.83 · Cited by 619
Kim, S., Du, C., Sheridan, P., Ma, W., Choi, S., & Lu, W. D. (2015) · Nano Letters · doi:10.1021/acs.nanolett.5b00697 · Cited by 603
Compartmentalized dendritic plasticity and input feature storage in neurons
Losonczy, A., Makara, J. K., & Magee, J. C. (2008) · Nature · doi:10.1038/nature06725 · Cited by 598
Gokmen, T., & Vlasov, Y. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00333 · Cited by 491
Mixed-precision in-memory computing
Le Gallo, M., Sebastian, A., Mathis, R., Manica, M., Giefers, H., Tuma, T., Bekas, C., Curioni, A., & Eleftheriou, E. (2018) · Nature Electronics · doi:10.1038/s41928-018-0054-8 · Cited by 485
Du, C., Ma, W., Chang, T., Sheridan, P., & Lu, W. D. (2015) · Advanced Functional Materials · doi:10.1002/adfm.201501427 · Cited by 444
The BCM theory of synapse modification at 30: interaction of theory with experiment
Cooper, L. N., & Bear, M. F. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3353 · Cited by 395
Three-dimensional memristor circuits as complex neural networks
Lin, P., Li, C., Wang, Z., Li, Y., Jiang, H., Song, W., Rao, M., Zhuo, Y., Upadhyay, N. K., Barnell, M., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0397-9 · Cited by 375
Self-citationThe single dendritic branch as a fundamental functional unit in the nervous system
Branco, T., & Häusser, M. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.07.009 · Cited by 355
Surface diffusion-limited lifetime of silver and copper nanofilaments in resistive switching devices
Wang, W., Wang, M., Ambrosi, E., Bricalli, A., Laudato, M., Sun, Z., Chen, X., & Ielmini, D. (2019) · Nature Communications · doi:10.1038/s41467-018-07979-0 · Cited by 328
Self-citationReservoir Computing Using Diffusive Memristors
Midya, R., Wang, Z., Asapu, S., Zhang, X., Rao, M., Song, W., Zhuo, Y., Upadhyay, N., Xia, Q., & Yang, J. J. (2019) · Advanced Intelligent Systems · doi:10.1002/aisy.201900084 · Cited by 279
Self-citationAmbrogio, S., Balatti, S., Milo, V., Carboni, R., Wang, Z.-Q., Calderoni, A., Ramaswamy, N., & Ielmini, D. (2016) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2016.2526647 · Cited by 256
Self-citationThe decade of the dendritic nmda spike
Antic, S. D., Zhou, W., Moore, A. R., Short, S. M., & Ikonomu, K. D. (2010) · Journal of Neuroscience Research · doi:10.1002/jnr.22444 · Cited by 222
Electronic system with memristive synapses for pattern recognition
Park, S., Chu, M., Kim, J., Noh, J., Jeon, M., Hun Lee, B., Hwang, H., Lee, B., & Lee, B.-G. (2015) · Scientific Reports · doi:10.1038/srep10123 · Cited by 181
Threshold Selector With High Selectivity and Steep Slope for Cross-Point Memory Array
Song, J., Woo, J., Prakash, A., Lee, D., & Hwang, H. (2015) · IEEE Electron Device Letters · doi:10.1109/led.2015.2430332 · Cited by 169
Dynamics of cortical dendritic membrane potential and spikes in freely behaving rats.
Moore, J. J., Ravassard, P. M., Ho, D., Acharya, L., Kees, A. L., Vuong, C., & Mehta, M. R. (2017) · Science · doi:10.1126/science.aaj1497 · Cited by 110
Compressed Sensing With Approximate Message Passing Using In-Memory Computing
Le Gallo, M., Sebastian, A., Cherubini, G., Giefers, H., & Eleftheriou, E. (2018) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2018.2865352 · Cited by 99
Cited by
Embedded Devices for Neuromorphic Time-Series Assessment
Mazumder, A. N., Hosseini, M., & Mohsenin, T. (2022) · Research Explorer (The University of Manchester) · doi:10.13016/m2ksy0-wxr3 · Cited by 652
Nonideality‐Aware Training for Accurate and Robust Low‐Power Memristive Neural Networks
Joksas, D., Wang, E., Barmpatsalos, N., Ng, W. H., Kenyon, A. J., Constantinides, G. A., & Mehonic, A. (2022) · Advanced Science · doi:10.1002/advs.202105784 · Cited by 39
“[2] However, rapidly increasing number of parameters in modern ANNs is making them time- and power-consuming during both training[3] and inference[4] stages.”
MethodInfluentialBrain-inspired computing systems: a systematic literature review
Zolfagharinejad, M., Alegre-Ibarra, U., Chen, T., Kinge, S., & van der Wiel, W. G. (2024) · The European Physical Journal B · doi:10.1140/epjb/s10051-024-00703-6 · Cited by 39
2022 roadmap on neuromorphic computing and engineering
Christensen, D. V., Dittmann, R., Linares-Barranco, B., Sebastian, A., Le Gallo, M., Redaelli, A., Slesazeck, S., Mikolajick, T., Spiga, S., Menzel, S., et al. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac4a83
Self-citation
Metadata
- Authors
- Ielmini, D., Wang, Z., & Liu, Y.
- Venue
- APL Materials
- Publisher
- AIP Publishing
- Published
- 2021-05-01
- Volume
- 9
- Issue
- 5
- ISSN
- 2166-532X (ISSN-L)
- OpenAlex
- W3160759934
- Cited by
- 110
- References
- 40
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.