Training a Probabilistic Graphical Model With Resistive Switching Electronic Synapses
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Current large-scale implementations of deep learning and data mining require thousands of processors, massive amounts of off-chip memory, and consume gigajoules of energy. New memory technologies, such as nanoscale two-terminal resistive switching memory devices, offer a compact, scalable, and low-power alternative that permits on-chip colocated processing and memory in fine-grain distributed parallel architecture. Here, we report the first use of resistive memory devices for implementing and training a restricted Boltzmann machine (RBM), a generative probabilistic graphical model as a key component for unsupervised learning in deep networks. We experimentally demonstrate a 45-synapse RBM realized with 90 resistive phase change memory (PCM) elements trained with a bioinspired variant of the contrastive divergence algorithm, implementing Hebbian and anti-Hebbian weight updates. The resistive PCM devices show a twofold to tenfold reduction in error rate in a missing pixel pattern completion task trained over 30 epochs, compared with untrained case. Measured programming energy consumption is 6.1 nJ per epoch with the PCM devices, a factor of ~ 150 times lower than the conventional processor-memory systems. We analyze and discuss the dependence of learning performance on cycle-to-cycle variations and number of gradual levels in the PCM analog memory devices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“the NeuRRAM chip achieves 1.6-times to 2.3-times lower EDP and 7-times to 13-times higher computational density (measured by throughput per million of RRAMs) at various MVM input and output bit-precisions than previous state-of-the-art RRAM-based CIM chips, despite being fabricated at an older technology node17–27,36.”
From A compute-in-memory chip based on resistive random-access memory (2022) · cites this paper as [25]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
The Internet of Things: A survey
Atzori, L., Iera, A., & Morabito, G. (2010) · Computer Networks · doi:10.1016/j.comnet.2010.05.010 · Cited by 15,613
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879
A million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
Prezioso, M., Merrikh-Bayat, F., Hoskins, B. D., Adam, G. C., Likharev, K. K., & Strukov, D. B. (2015) · Nature · doi:10.1038/nature14441 · Cited by 3,001
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
EIE: efficient inference engine on compressed deep neural network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001163 · Cited by 1,937
Short-term plasticity and long-term potentiation mimicked in single inorganic synapses
Ohno, T., Hasegawa, T., Tsuruoka, T., Terabe, K., Gimzewski, J. K., & Aono, M. (2011) · Nature Materials · doi:10.1038/nmat3054 · Cited by 1,793
Research works printed but not linked: 9
- burr, 2014, Experimental demonstration and tolerancing of a large scale neural network, Proc IEEE IEDM, 29.5.1
- erhan, 2010, Why does unsupervised pre-training help deep learning?, J Mach Learn Res, 11, 625
- wong, 2016, Stanford Memory Trends
- shao, 2013, Energy characterization and instruction-level energy model of Intel’s Xeon Phi processor, Proc ISLPED, 389
- yu, 2012, 65k-neuron integrate and fire array transceiver with address-event reconfigurable synaptic routing, Proc IEEE Biomed Circuits Syst Conf (BioCAS), 21
- natarajan, 2014, A 14nm logic technology featuring 2nd-generation FinFET, air-gapped interconnects, self-aligned double patterning and a 0.0588 $\mu $ m2 SRAM cell size, Proc IEEE Int Electron Devices Meeting, 3.7.1
- 2016, 16-Channel Current-Input Analog-to-Digital Converter
- 2016, Dual current input 20-bit analog-to-digital converter
- mackay, 2003, Information Theory Inference and Learning Algorithms
Cited by
Neuro-Inspired Computing With Emerging Nonvolatile Memorys
Yu, S. (2018) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2790840 · Cited by 1,170
A compute-in-memory chip based on resistive random-access memory
Wan, W., Kubendran, R., Schaefer, C., Eryilmaz, S. B., Zhang, W., Wu, D., Deiss, S., Raina, P., Qian, H., Gao, B., et al. (2022) · Nature · doi:10.1038/s41586-022-04992-8 · Cited by 943
Self-citationThe Future of Memristors: Materials Engineering and Neural Networks
Sun, K., Chen, J., & Yan, X. (2021) · Advanced Functional Materials · doi:10.1002/adfm.202006773 · Cited by 482
Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain
Thakur, C. S., Molin, J. L., Cauwenberghs, G., Indiveri, G., Kumar, K., Qiao, N., Schemmel, J., Wang, R., Chicca, E., Olson Hasler, J., et al. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00891 · Cited by 288
Self-citationFrom biomaterial-based data storage to bio-inspired artificial synapse
Lv, Z., Zhou, Y., Han, S.-T., & Roy, V. A. L. (2018) · Materials Today · doi:10.1016/j.mattod.2017.12.001 · Cited by 261
Metadata
- Authors
- Eryilmaz, S. B., Neftci, E., Joshi, S., Kim, S., BrightSky, M., Lung, H.-L., Lam, C., Cauwenberghs, G., & Wong, H.-S. P.
- Affiliations
- Stanford University (US)
- University of California, Irvine (US)
- University of California San Diego (US)
- IBM (United States) (US)
- Macronix International (Taiwan) (TW)
- Venue
- IEEE Transactions on Electron Devices
- Published
- 2016-12
- Volume
- 63
- Issue
- 12
- Pages
- 5004-5011
- ISSN
- 0018-9383 (ISSN-L)
- 1557-9646
- OpenAlex
- W2526812109
- Cited by
- 34
- References
- 44
- Citations by year
- 2025: 1 · 2022: 5 · 2021: 3 · 2020: 6 · 2019: 8 · 2018: 8 · 2017: 3
- FWCI
- 2.92
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Electron Devices (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- arXiv (Cornell University)
- Funders
- SONIC, one of six centers of STARnet, a Semiconductor Research Corporation Program sponsored by MARCO and DARPA
- NSF Expedition on Computing under Visual Cortex on Silicon (1317470)
- Member Companies of the Stanford Non-Volatile Memory Technology Research Initiative and the Stanford SystemX Alliance
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Ferroelectric and Negative Capacitance Devices
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Keywords
- resistive random access memory, phase-change memory, restricted Boltzmann machine, probabilistic graphical models, neuromorphic computing, contrastive divergence, Hebbian learning, unsupervised learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Training a Probabilistic Graphical Model With Resistive Switching Electronic Synapses. https://app.cochat.ai/papers/10.1109/ted.2016.2616483
- The paper
- Eryilmaz, S. B., Neftci, E., Joshi, S., Kim, S., BrightSky, M., Lung, H.-L., Lam, C., Cauwenberghs, G., & Wong, H.-S. P. (2016). Training a Probabilistic Graphical Model With Resistive Switching Electronic Synapses. IEEE Transactions on Electron Devices. https://doi.org/10.1109/ted.2016.2616483
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.