The DOI matches its Crossref record; 223 of the 223 references it cites were found in a registry or an index.
Training Spiking Neural Networks Using Lessons From Deep Learning
Open accessAbstract
The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This article serves as a tutorial and perspective showing how to apply the lessons learned from several decades of research in deep learning, gradient descent, backpropagation, and neuroscience to biologically plausible spiking neural networks (SNNs). We also explore the delicate interplay between encoding data as spikes and the learning process; the challenges and solutions of applying gradient-based learning to SNNs; the subtle link between temporal backpropagation and spike timing-dependent plasticity; and how deep learning might move toward biologically plausible online learning. Some ideas are well accepted and commonly used among the neuromorphic engineering community, while others are presented or justified for the first time here. A series of companion interactive tutorials complementary to this article using our Python package,snnTorch, are also made available: https://snntorch.readthedocs.io/en/latest/tutorials/index.html.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–223 of 223
The Intel neuromorphic DNS challenge
Timcheck, J., Shrestha, S. B., Rubin, D. B. D., Kupryjanow, A., Orchard, G., Pindor, L., Shea, T. M., & Davies, M. (2023) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ace737 · Cited by 42
Parallel Training of Deep Networks with Local UpdatesPreprint
Laskin, M., Metz, L., Nabarro, S., Saroufim, M., Noune, B., Luschi, C., Sohl‐Dickstein, J., & Abbeel, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03837 · Cited by 41
Memristive Stochastic Computing for Deep Learning Parameter Optimization
Lammie, C., Eshraghian, J. K., Lu, W. D., & Azghadi, M. R. (2021) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2021.3065932 · Cited by 41
Self-citationOn-Chip Error-Triggered Learning of Multi-Layer Memristive Spiking Neural Networks
Payvand, M., Fouda, M. E., Kurdahi, F. J., Eltawil, A. M., & Neftci, E. (2020) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2020.3040248 · Cited by 32
Self-citationUnbiased Online Recurrent OptimizationPreprint
Ollivier, Y., & Tallec, C. (2017) · HAL · Cited by 31
Recent Progress in Real‐Time Adaptable Digital Neuromorphic Hardware
Kornijčuk, V., & Jeong, D. S. (2019) · Advanced Intelligent Systems · doi:10.1002/aisy.201900030 · Cited by 31
Self-citationSpiking Neural Networks for Visual Place Recognition Via Weighted Neuronal Assignments
Hussaini, S., Milford, M. J., & Fischer, T. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3149030 · Cited by 28
ETLP: event-based three-factor local plasticity for online learning with neuromorphic hardware
Quintana, F. M., Perez‐Peña, F., Galindo, P. L., Neftci, E., Chicca, E., & Khacef, L. (2024) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ad6733 · Cited by 27
Self-citationWeak self-supervised learning for seizure forecasting: a feasibility study
Yang, Y., Truong, N. D., Eshraghian, J. K., Nikpour, A., & Kavehei, O. (2022) · Royal Society Open Science · doi:10.1098/rsos.220374 · Cited by 26
Self-citationEshraghian, J. K., Baek, S., Kim, J., Iannella, N. L., Cho, K.-R., Goo, Y. S., Iu, H. H., Kang, S., & Eshraghian, K. (2018) · International Journal of Neural Systems · doi:10.1142/s0129065718500041 · Cited by 22
Self-citationNonlinear retinal response modeling for future neuromorphic instrumentation
Eshraghian, J. K., Baek, S., Levi, T., Kohno, T., Al-Sarawi, S. F., Leong, P. H. W., Cho, K.-R., Abbott, D., & Kavehei, O. (2020) · IEEE Instrumentation & Measurement Magazine · doi:10.1109/mim.2020.8979519 · Cited by 22
Self-citationError-driven Input Modulation: Solving the Credit Assignment Problem without a Backward PassPreprint
Dellaferrera, G., & Kreiman, G. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.11665 · Cited by 21
Stochastic Properties of Coincidence-Detector Neural Cells
Krips, R., & Furst, M. (2009) · Neural Computation · doi:10.1162/neco.2009.07-07-563 · Cited by 17
A Real-Time Retinomorphic Simulator Using a Conductance-Based Discrete Neuronal Network
Baek, S., Eshraghian, J. K., Thio, W. J.-C., Sandamirskaya, Y., Iu, H. H., & Lu, W. D. (2020) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas48895.2020.9073963 · Cited by 15
Self-citationNeuroBench: A Framework for Benchmarking Neuromorphic Computing Algorithms and SystemsPreprint
Yik, J., Berghe, K. V. D., den Blanken, D., Bouhadjar, Y., Fabre, M., Hueber, P., Ke, W., Khoei, M. A., Kleyko, D. V., Pacik-Nelson, N., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.04640 · Cited by 13
Self-citationClockless continuous-time neural spike sorting: Method, implementation and evaluation
Liu, Y., Pereira, J. L., & Constandinou, T. G. (2016) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2016.7527296 · Cited by 10
Online Spatio-Temporal Learning with Target Projection
Ortner, T., Pes, L., Gentinetta, J., Frenkel, C., & Pantazi, A. (2023) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas57966.2023.10168623 · Cited by 10
A solution to the controversy between rate and temporal coding
Shinomoto, S., & Koyama, S. (2007) · Statistics in Medicine · doi:10.1002/sim.2932 · Cited by 9
Roth, C. G., Kanitscheider, I., & Fiete, I. (2018) · International Conference on Learning Representations · Cited by 9
A multimodal AI system for out-of-distribution generalization of seizure detectionPreprint
Yang, Y., Truong, N. D., Eshraghian, J. K., Maher, C., Nikpour, A., & Kavehei, O. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.02.450974 · Cited by 9
Self-citationA Mixed-Signal Spatio-Temporal Signal Classifier for On-Sensor Spike Sorting
Haessig, G., García-Lesta, D., Lenz, G., Benosman, R. B., & Dudek, P. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9180442 · Cited by 7
Self-citationLevy, W. B., & Calvert, V. G. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.04.23.057927 · Cited by 6
Learning temporal structure of the input with a network of integrate-and-fire neuronsPreprint
Kushnir, L., & Denève, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10262 · Cited by 1
Cited by
Neuromorphic computing at scale
Kudithipudi, D., Schuman, C., Vineyard, C. M., Pandit, T., Merkel, C., Kubendran, R., Aimone, J. B., Orchard, G., Mayr, C., Benosman, R., et al. (2025) · Nature · doi:10.1038/s41586-024-08253-8 · Cited by 357
Toward an AI Era: Advances in Electronic Skins
Fu, X., Cheng, W., Wan, G., Yang, Z., & Tee, B. C. K. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00049 · Cited by 172
Metadata
- Authors
- Eshraghian, J. K., Ward, M., Neftci, E. O., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D. S., & Lu, W. D.
- Venue
- Proceedings of the IEEE
- Published
- 2023-09
- Volume
- 111
- Issue
- 9
- Pages
- 1016-1054
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W3201870057
- Cited by
- 782
- References
- 223
- FWCI
- 55.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.