The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses
Open accessAbstract
In an increasingly data-rich world the need for developing computing systems that cannot only process, but ideally also interpret big data is becoming continuously more pressing. Brain-inspired concepts have shown great promise towards addressing this need. Here we demonstrate unsupervised learning in a probabilistic neural network that utilizes metal-oxide memristive devices as multi-state synapses. Our approach can be exploited for processing unlabelled data and can adapt to time-varying clusters that underlie incoming data by supporting the capability of reversible unsupervised learning. The potential of this work is showcased through the demonstration of successful learning in the presence of corrupted input data and probabilistic neurons, thus paving the way towards robust big-data processors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Strukov, D. B., Snider, G. S., Stewart, D. R., & Williams, R. S. (2008) · Nature · doi:10.1038/nature06932 · Cited by 11,828
Memristor—The Missing Circuit Element
Chua, L. (1971) · IEEE Transactions on Circuit Theory · doi:10.1109/tct.1971.1083337 · Cited by 10,268 · cited 2×
“3 shows the fraction on the right-hand side of equation (8) based on the fitted functions fLTP(g) and fLTD(g) from Fig.”
Redox‐Based Resistive Switching Memories – Nanoionic Mechanisms, Prospects, and Challenges
Waser, R., Dittmann, R., Staikov, G., & Szot, K. (2009) · Advanced Materials · doi:10.1002/adma.200900375 · Cited by 5,080
Nanoionics-based resistive switching memories
Waser, R., & Aono, M. (2007) · Nature Materials · doi:10.1038/nmat2023 · Cited by 4,923
Bi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744
Nanoscale Memristor Device as Synapse in Neuromorphic Systems
Jo, S. H., Chang, T., Ebong, I., Bhadviya, B. B., Mazumder, P., & Lu, W. (2010) · Nano Letters · doi:10.1021/nl904092h · Cited by 4,174 · cited 1×
“Such dependence of conductance changes on the actual memristive state has commonly been observed in memristors, including both metal-oxide 25 and phase-change 36 implementations.”
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Memristive devices and systems
Chua, L. O., & Kang, S. M. (1976) · Proceedings of the IEEE · doi:10.1109/proc.1976.10092 · Cited by 2,604 · cited 1×
“On the basis of the comparison of equations (6) and equation (9), we map memristor conductances g to abstract weights w via a linear function”
Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex
Trachtenberg, J. T., Chen, B. E., Knott, G. W., Feng, G., Sanes, J. R., Welker, E., & Svoboda, K. (2002) · Nature · doi:10.1038/nature01273 · Cited by 1,927
NEURONAL CIRCUITS OF THE NEOCORTEX
Douglas, R. J., & Martin, K. A. C. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144152 · Cited by 1,886
Neuromorphic Silicon Neuron Circuits
Indiveri, G., Linares-Barranco, B., Hamilton, T. J., Schaik, A. V., Etienne-Cummings, R., Delbruck, T., Liu, S.-C., Dudek, P., Häfliger, P., Renaud, S., et al. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00073 · Cited by 1,821
Complementary resistive switches for passive nanocrossbar memories
Linn, E., Rosezin, R., Kügeler, C., & Waser, R. (2010) · Nature Materials · doi:10.1038/nmat2748 · Cited by 1,274
Transient and persistent dendritic spines in the neocortex in vivo
Holtmaat, A. J. G. D., Trachtenberg, J. T., Wilbrecht, L., Shepherd, G. M., Zhang, X., Knott, G. W., & Svoboda, K. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.003 · Cited by 1,131
Feature Discovery by Competitive Learning*
Rumelhart, D. E., & Zipser, D. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_5 · Cited by 1,057
Indiveri, G., Chicca, E., & Douglas, R. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.860850 · Cited by 1,009
Burr, G. W., Shelby, R. M., Sidler, S., di Nolfo, C., Jang, J., Boybat, I., Shenoy, R. S., Narayanan, P., Virwani, K., Giacometti, E. U., et al. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2439635 · Cited by 936 · cited 1×
“Finally, the first large-scale neural network using PCM technology was demonstrated by IBM 34 , where a modified back-propagation rule was used in a three-layer ANN.”
Feature discovery by competitive learning
RUMELHART, D., & ZIPSER, D. (1985) · Cognitive Science · doi:10.1016/s0364-0213(85)80010-0 · Cited by 882
Development of long-term dendritic spine stability in diverse regions of cerebral cortex
Zuo, Y., Lin, A., Chang, P., & Gan, W.-B. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.001 · Cited by 684
Integration of nanoscale memristor synapses in neuromorphic computing architectures
Indiveri, G., Linares-Barranco, B., Legenstein, R., Deligeorgis, G., & Prodromakis, T. (2013) · Nanotechnology · doi:10.1088/0957-4484/24/38/384010 · Cited by 613
Self-citationSTDP and STDP variations with memristors for spiking neuromorphic learning systems
Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., Indiveri, G., & Linares-Barranco, B. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00002 · Cited by 533
Self-citationDu, C., Ma, W., Chang, T., Sheridan, P., & Lu, W. D. (2015) · Advanced Functional Materials · doi:10.1002/adfm.201501427 · Cited by 444
Drachman, D. A. (2005) · Neurology · doi:10.1212/01.wnl.0000166914.38327.bb · Cited by 366
Spike-timing-dependent learning in memristive nanodevices
Snider, G. S. (2008) · 2008 IEEE International Symposium on Nanoscale Architectures · doi:10.1109/nanoarch.2008.4585796 · Cited by 341
Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains
Masquelier, T., Guyonneau, R., & Thorpe, S. J. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001377 · Cited by 312
Self-organized computation with unreliable, memristive nanodevices
Snider, G. S. (2007) · Nanotechnology · doi:10.1088/0957-4484/18/36/365202 · Cited by 262
Brain-like associative learning using a nanoscale non-volatile phase change synaptic device array
Eryilmaz, S. B., Kuzum, D., Jeyasingh, R., Kim, S., BrightSky, M., Lam, C., & Wong, H.-S. P. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00205 · Cited by 205
Simulation of a memristor-based spiking neural network immune to device variations
Querlioz, D., Bichler, O., & Gamrat, C. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033439 · Cited by 198
Memristive Physically Evolving Networks Enabling the Emulation of Heterosynaptic Plasticity
Yang, Y., Chen, B., & Lu, W. D. (2015) · Advanced Materials · doi:10.1002/adma.201503202 · Cited by 158
Stochastic learning in oxide binary synaptic device for neuromorphic computing
Yu, S., Gao, B., Fang, Z., Yu, H. Y., Kang, J., & Wong, H. ‐. P. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00186 · Cited by 158
High density 3D memory architecture based on the resistive switching effect
Kügeler, C., Meier, M., Rosezin, R., Gilles, S., & Waser, R. (2009) · Solid-State Electronics · doi:10.1016/j.sse.2009.09.034 · Cited by 158
Physical aspects of low power synapses based on phase change memory devices
Suri, M., Bichler, O., Querlioz, D., Traoré, B., Cueto, O., Perniola, L., Sousa, V., Vuillaume, D., Gamrat, C., & de Salvo, B. (2012) · Journal of Applied Physics · doi:10.1063/1.4749411 · Cited by 149
Emulating short-term synaptic dynamics with memristive devices
Berdan, R., Vasilaki, E., Khiat, A., Indiveri, G., Serb, A., & Prodromakis, T. (2016) · Scientific Reports · doi:10.1038/srep18639 · Cited by 148
Self-citationBioinspired Programming of Memory Devices for Implementing an Inference Engine
Querlioz, D., Bichler, O., Vincent, A. F., & Gamrat, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2437616 · Cited by 142
A high-precision VLSI winner-take-all circuit for self-organizing neural networks
Choi, J. O., & Sheu, B. J. (1993) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.229397 · Cited by 135
Implementing Synaptic Plasticity in a VLSI Spiking Neural Network Model
Schemmel, J., Grübl, A., Meier, K., & Muller, E. B. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.246651 · Cited by 131
Network Plasticity as Bayesian Inference
Kappel, D., Habenschuss, S., Legenstein, R. A., & Maass, W. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004485 · Cited by 127
Self-citationSTDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning
Kappel, D., Nessler, B., & Maass, W. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003511 · Cited by 120
Voltage-time dilemma of pure electronic mechanisms in resistive switching memory cells
Schroeder, H., Zhirnov, V. V., Cavin, R. K., & Waser, R. (2010) · Journal of Applied Physics · doi:10.1063/1.3319591 · Cited by 108
A compound memristive synapse model for statistical learning through STDP in spiking neural networks
Bill, J., & Legenstein, R. A. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00412 · Cited by 108
Self-citationA $\mu $ -Controller-Based System for Interfacing Selectorless RRAM Crossbar Arrays
Berdan, R., Serb, A., Khiat, A., Regoutz, A., Papavassiliou, C., & Prodromakis, T. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2433676 · Cited by 92
Self-citationK-winners-take-all circuit with O(N) complexity
Urahama, K., & Nagao, T. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.377986 · Cited by 83
Enabling an Integrated Rate-temporal Learning Scheme on Memristor
He, W., Huang, K., Ning, N., Ramanathan, K., Li, G., Jiang, Y., Sze, J. Y., Shi, L., Zhao, R. J., & Pei, J. (2014) · Scientific Reports · doi:10.1038/srep04755 · Cited by 79
Neuromorphic Character Recognition System With Two PCMO Memristors as a Synapse
Sheri, A. M., Hwang, H., Jeon, M., & Lee, B. (2013) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2275966 · Cited by 77
A Current-Mode Hysteretic Winner-take-all Network, with Excitatory and Inhibitory Coupling
Indiveri, G. (2001) · Analog Integrated Circuits and Signal Processing · doi:10.1023/a:1011208127849 · Cited by 75
CMOS current mode winner-take-all circuit with both excitatory and inhibitory feedback
Starzyk, J. A., & Fang, X. (1993) · Electronics Letters · doi:10.1049/el:19930606 · Cited by 75
Single transistor learning synapse with long term storage
Hasler, P. E., Diorio, C., Minch, B. A., & Mead, C. (2002) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.1995.523729 · Cited by 59
Du, N., Kiani, M., Mayr, C., You, T., Bürger, D., Skorupa, I., Schmidt, O. G., & Schmidt, H. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00227 · Cited by 58
High precision analogue memristor state tuning
Berdan, R., Prodromakis, T., & Toumazou, C. (2012) · Electronics Letters · doi:10.1049/el.2012.2295 · Cited by 54
Self-citationImplementation of a spike-based perceptron learning rule using TiO2−x memristors
Mostafa, H., Khiat, A., Serb, A., Mayr, C., Indiveri, G., & Prodromakis, T. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00357 · Cited by 42
Self-citationA Memristor SPICE Model Accounting for Synaptic Activity Dependence
Li, Q., Serb, A., Prodromakis, T., & Xu, H. F. (2015) · PLoS ONE · doi:10.1371/journal.pone.0120506 · Cited by 42
Self-citationAn RRAM Biasing Parameter Optimizer
Serb, A., Khiat, A., & Prodromakis, T. (2015) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2015.2478491 · Cited by 34
Self-citationEmergence of Optimal Decoding of Population Codes Through STDP
Habenschuss, S., Puhr, H., & Maass, W. (2013) · Neural Computation · doi:10.1162/neco_a_00446 · Cited by 32
Bill, J., Buesing, L., Habenschuss, S., Nessler, B., Maass, W., & Legenstein, R. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0134356 · Cited by 22
Self-citationMemristive integrative sensors for neuronal activityPreprint
Gupta, I., Serb, A., Khiat, A., Zeitler, R., Vassanelli, S., & Prodromakis, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06832 · Cited by 14
Self-citationLegenstein, R. A., Chase, S. M., Schwartz, A. B., & Maass, W. (2009) · PubMed · Cited by 12
Self-citationEmulating long-term synaptic dynamics with memristive devicesPreprint
Wei, S. L., Vasilaki, E., Khiat, A., Salaoru, I., Berdan, R., & Prodromakis, T. (2015) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.1509.01998 · Cited by 12
Self-citation
Research works printed but not linked: 9
- Govoreanu, B. et al. in Proc. 2011 IEEE International Electron Devices Meeting (ed. Mahoney, P. W.) 31.6 (IEEE, (2011).
- Ma, X., Strukov, D. B., Lee, J. H. & Likharev, K. K. in Proc. 5th IEEE Conference on Nanotechnology (ed. Arai, F.) 175–178 (IEEE, (2005).
- Mayr, C. et al. in Proc. NIPS 2012 - Advances in Neural Information Processing Systems 25 (ed. Pereira, F. et al.) 1700–1708 (Neural Information Processing Systems Foundation, Inc., 2012).
- Habenschuss, S., Bill, J. & Nessler, B. in Proc. NIPS 2012 - Advances in Neural Information Processing Systems 25 (eds Pereira, F. et al.) 773–781 (Neural Information Processing Systems Foundation, Inc., (2012).
- Nessler, B., Pfeiffer, M. & Maass, W. in Advances in Neural Information Processing Systems, 1357–1365 (2009).
- Makosiej, A., Thomas, O., Amara, A. & Vladimirescu, A. in Proc. ISCAS 2013 - IEEE International Symposium on Circuits and Systems (eds Chen, C. W. et al.) 1460–1463 (IEEE, (2013). · doi:10.1109/iscas.2013.6572132
- Leung, W., Hsu, F.-C. & Jones, M.-E. in Proc. IEEE International ASIC/SOC Conference (eds Buchner, T. et al.) 32–36 (IEEE, (2000).
- Burr, G. W. et al. in Proc. VLSIT 2013 - Symposium on VLSI Technology (ed. Jammy, R.) T66–T67 (IEEE, (2013).
- Kappel, D., Habenschuss, S., Legenstein, R. & Maass, W. in Advances in Neural Information Processing Systems, 370–378 (2015).
Cited by
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Fully hardware-implemented memristor convolutional neural network
Yao, P., Wu, H., Gao, B., Tang, J., Zhang, Q., Zhang, W., Yang, J. J., & Qian, H. (2020) · Nature · doi:10.1038/s41586-020-1942-4 · Cited by 2,179
Memristive crossbar arrays for brain-inspired computing
Xia, Q., & Yang, J. J. (2019) · Nature Materials · doi:10.1038/s41563-019-0291-x · Cited by 1,800
Resistive switching materials for information processing
Wang, Z., Wu, H., Burr, G. W., Hwang, C. S., Wang, K. L., Xia, Q., & Yang, J. J. (2020) · Nature Reviews Materials · doi:10.1038/s41578-019-0159-3 · Cited by 1,214
Fully memristive neural networks for pattern classification with unsupervised learning
Wang, Z., Joshi, S., Savel’ev, S., Song, W., Midya, R., Li, Y., Rao, M., Yan, P., Asapu, S., Zhuo, Y., et al. (2018) · Nature Electronics · doi:10.1038/s41928-018-0023-2 · Cited by 1,106
Metadata
- Authors
- Serb, A., Bill, J., Khiat, A., Berdan, R., Legenstein, R., & Prodromakis, T.
- Venue
- Nature Communications
- Published
- 2016-09-29
- Volume
- 7
- Issue
- 1
- Pages
- 12611-12611
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W2525649597
- Cited by
- 339
- References
- 56
- FWCI
- 19.21
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.