Supervised learning in spiking neural networks with MLC PCM synapses
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
We demonstrate for the first time, the feasibility of supervised learning in third generation Spiking Neural Networks (SNNs) using multi-level cell (MLC) phase change memory (PCM) synapses [1]. We highlight two key novel contributions: (i) As opposed to second generation neural networks that are used in machine learning algorithms [2], or spike timing dependent plasticity based unsupervised learning in SNNs [3], we use a spike-triggered supervised learning algorithm (NormAD [4]) for the weight updates. (ii) SNN learning capability is demonstrated using a comprehensive phenomenological model of MLC PCM that accurately captures the statistics of programming inter-cell and intra-cell variability. This work is a harbinger to efficient supervised SNN learning systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We capture this behavior in a PCM conductance response model that relies on piece-wise linear approximations to the functions that link the mean and variance of the conductance change to the mean conductance value45. As shown in Fig. 2(d), this model approximates the experimental behavior fairly well.”
From Neuromorphic computing with multi-memristive synapses (2018) · cites this paper as [45]
Citations
Cites
Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics
Brader, J. M., Senn, W., & Fusi, S. (2007) · Neural Computation · doi:10.1162/neco.2007.19.11.2881 · Cited by 371
Research works printed but not linked: 5
- anwani, 0, IJCNN $\mu_ \Delta G $ 2015
- suri, 0, IEDM 2011
- tuma, 0, Nature Nano 11 2016
- rumelhart, 1986, Nature 323 533536
- close, 0, IEDM 2010
Cited by
Neuromorphic computing with multi-memristive synapses
Boybat, I., Le Gallo, M., Nandakumar, S. R., Moraitis, T., Parnell, T., Tuma, T., Rajendran, B., Leblebici, Y., Sebastian, A., & Eleftheriou, E. (2018) · Nature Communications · doi:10.1038/s41467-018-04933-y · Cited by 899
Self-citationMixed-precision architecture based on computational memory for training deep neural networks
Nandakumar, S. R., Le Gallo, M., Boybat, I., Rajendran, B., Sebastian, A., & Eleftheriou, E. (2018) · 2018 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2018.8351656 · Cited by 67
“The model is created based on characterization data from approximately 10,000 devices integrated in 90nm CMOS technology [26].”
MethodSelf-citationLee, J.-H., Lim, D., Jeong, H., Ma, H., & Shi, L. (2019) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2019.2906249 · Cited by 58
“In [13] and [20], the conductance distribution after the nth pulse has been modeled as the accumulation of the previous conductance changes.”
BackgroundBuilding Brain-Inspired Computing Systems: Examining the Role of Nanoscale Devices
Nandakumar, S. R., Kulkarni, S., Babu, A. V., & Rajendran, B. (2018) · IEEE Nanotechnology Magazine · doi:10.1109/mnano.2018.2845078 · Cited by 52
“there are many studies showing gradual conductance evolution and stdp behavior in pcm devices [72] [73] and using them for supervised and unsupervised training of anns [74] and snns [75].”
BackgroundSelf-citationKim, H., Bae, J., Lim, S., Lee, S., Seo, Y.-T., Kwon, D., Park, B., & Lee, J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.09.099 · Cited by 26
A SPICE Model of Phase Change Memory for Neuromorphic Circuits
Chen, X., Hu, H., Huang, X., Cai, W., Liu, M., Lam, C. H., Lin, X., Zhang, L., & Chan, M. (2020) · IEEE Access · doi:10.1109/access.2020.2995907 · Cited by 13
“Considering its advantages, SNN is considered as the next generation neural network [10], [11].”
BackgroundMulti-ReRAM Synapses for Artificial Neural Network Training
Boybat, I., Giovinazzo, C., Shahrabi, E., Krawczuk, I., Giannopoulos, I., Piveteau, C., Gallo, M. L., Ricciardi, C., Sebastian, A., Eleftheriou, E. S., et al. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702714 · Cited by 12
“A statistical device model was developed to capture these experimental measurements based on the approach employed in [21] (Fig.”
MethodSelf-citationRobust Processing-In-Memory Neural Networks via Noise-Aware NormalizationPreprint
Tsai, L.-H., Chang, S.-C., Chen, Y., Pan, J.-Y., Wei, W., & Juan, D.-C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03230 · Cited by 12
Mixed-precision training of deep neural networks using computational memoryPreprint
Nandakumar, S. R., Gallo, M. L., Boybat, I., Rajendran, B., Sebastian, A., & Eleftheriou, E. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.01192 · Cited by 20
Self-citationMajumdar, S. (2024) · Frontiers in Nanotechnology · doi:10.3389/fnano.2024.1371386 · Cited by 12
Xie, C., Li, X., Chen, H., Li, Y., Liu, Y.-G., Wang, Q., Ren, K., & Song, Z. (2019) · Micromachines · doi:10.3390/mi10070461 · Cited by 10
“The MLC PCM can also be used in artificial neural networks as synapses, which provides a promising solution for energy-efficient artificial neural networks (ANNs) [3,4].”
BackgroundWell-Posed Verilog-A Compact Model for Phase Change Memory
Kulkarni, S., Kadetotad, D. V., Seo, J.-S., & Rajendran, B. (2018) · International Conference on Simulation of Semiconductor Processes and Devices · doi:10.1109/sispad.2018.8551667 · Cited by 2
Self-citationAccelerating Deep Neural Networks with Phase-Change Memory Devices
Spoon, K., Ambrogio, S., Narayanan, P., Tsai, H.-Y. S., Mackin, C., Chen, A., Fasoli, A., Friz, A. M., & Burr, G. W. (2022) · Springer eBooks · doi:10.1007/978-3-031-03841-9_3
Metadata
- Authors
- Nandakumar, S. R., Boybat, I., Le Gallo, M., Sebastian, A., Rajendran, B., & Eleftheriou, E.
- Affiliations
- New Jersey Institute of Technology (US)
- IBM Research - Zurich (CH)
- Venue
- 2017 75th Annual Device Research Conference (DRC)
- Publisher
- IEEE
- Published
- 2017-06
- Pages
- 1-2
- ISSN
- 1548-3770 (ISSN-L)
- OpenAlex
- W2744715919
- Cited by
- 13
- References
- 1
- Citations by year
- 2024: 1 · 2022: 1 · 2020: 2 · 2019: 4 · 2018: 4 · 2017: 1
- FWCI
- 4.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Conference digest (publishedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Keywords
- spiking neural networks, supervised learning, weight updating
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.