The DOI matches its Crossref record; 223 of the 223 references it cites were found in a registry or an index.
Training Spiking Neural Networks Using Lessons From Deep Learning
Open accessAbstract
The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This article serves as a tutorial and perspective showing how to apply the lessons learned from several decades of research in deep learning, gradient descent, backpropagation, and neuroscience to biologically plausible spiking neural networks (SNNs). We also explore the delicate interplay between encoding data as spikes and the learning process; the challenges and solutions of applying gradient-based learning to SNNs; the subtle link between temporal backpropagation and spike timing-dependent plasticity; and how deep learning might move toward biologically plausible online learning. Some ideas are well accepted and commonly used among the neuromorphic engineering community, while others are presented or justified for the first time here. A series of companion interactive tutorials complementary to this article using our Python package,snnTorch, are also made available: https://snntorch.readthedocs.io/en/latest/tutorials/index.html.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 1×
“LSTMs [181] and, later, GRUs [182] introduced slow dynamics designed to overcome memory and vanishing gradient problems in RNNs.”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Hodgkin, A. L., & Huxley, A. F. (1952) · The Journal of Physiology · doi:10.1113/jphysiol.1952.sp004764 · Cited by 23,191
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
(2010) · Cited by 14,134
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
(2017) · Cited by 11,625
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382 · cited 1×
“I N T R O D U C T I O N Deep learning has solved numerous problems in computer vision [1], [2], [3], [4], [5], [6], speech recognition [7], [8], [9], and natural language processing [10], [11], [12], [13], [14].”
BackgroundOvercoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“I N T R O D U C T I O N Deep learning has solved numerous problems in computer vision [1], [2], [3], [4], [5], [6], speech recognition [7], [8], [9], and natural language processing [10], [11], [12], [13], [14].”
BackgroundThe Organization of Behavior; A Neuropsychological Theory.
Attneave, F., B., M., & Hebb, D. O. (1950) · The American Journal of Psychology · doi:10.2307/1418888 · Cited by 5,146
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Simple model of spiking neurons
Izhikevich, E. M. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820440 · Cited by 4,828
Bi, G.-Q., & Poo, M.-M. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-24-10464.1998 · Cited by 4,744
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369
The Organization of Behavior: A Neuropsychological Theory
(1950) · Journal of the American Medical Association · doi:10.1001/jama.1950.02910470083028 · Cited by 4,195
A million spiking-neuron integrated circuit with a scalable communication network and interface
Merolla, P. A., Arthur, J. V., Alvarez-Icaza, R., Cassidy, A. S., Sawada, J., Akopyan, F., Jackson, B. L., Imam, N., Guo, C., Nakamura, Y., et al. (2014) · Science · doi:10.1126/science.1254642 · Cited by 4,147
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems
Dayan, P., & Abbott, L. F. (2001) · Cited by 4,099
Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
Davies, M., Srinivasa, N., Lin, T.-H., Chinya, G., Cao, Y., Choday, S. H., Dimou, G., Joshi, P., Imam, N., Jain, S., et al. (2018) · IEEE Micro · doi:10.1109/mm.2018.112130359 · Cited by 3,897
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Modeling Brain Function: The World of Attractor Neural Networks
Amit, D. J. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511623257 · Cited by 2,227
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
Fully integrated silicon probes for high-density recording of neural activity
Jun, J. J., Steinmetz, N. A., Siegle, J. H., Denman, D. J., Bauza, M., Barbarits, B., Lee, A. K., Anastassiou, C. A., Andrei, A., Aydın, Ç., et al. (2017) · Nature · doi:10.1038/nature24636 · Cited by 2,190
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
Towards End-To-End Speech Recognition with Recurrent Neural Networks
Graves, A., & Jaitly, N. (2014) · Cited by 1,861
Continual Learning Through Synaptic Intelligence
Zenke, F., Poole, B., & Ganguli, S. (2017) · arXiv · doi:10.48550/arxiv.1703.04200 · Cited by 1,784
Bag of Tricks for Image Classification with Convolutional Neural Networks
He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., & Li, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00065 · Cited by 1,680 · cited 1×
“’s [173] work in “Bag of tricks for image classification with convolutional neural networks” not only captures the honest state of deep learning in the title alone but also performs an ablation study of “hacks” that can be combined to improve optimization during training.”
BackgroundNeftci, E. O., Mostafa, H., & Zenke, F. (2019) · IEEE Signal Processing Magazine · doi:10.1109/msp.2019.2931595 · Cited by 1,538
Self-citationNeuronal Dynamics: From Single Neurons to Networks and Models of Cognition
Gerstner, W., Kistler, W. M., Naud, R., & Paninski, L. (2014) · doi:10.1017/cbo9781107447615 · Cited by 1,515
Unsupervised learning of digit recognition using spike-timing-dependent plasticity
Diehl, P. U., & Cook, M. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00099 · Cited by 1,452
Continual Learning with Deep Generative Replay
Shin, H., Lee, J. K., Kim, J., & Kim, J. (2017) · arXiv · doi:10.48550/arxiv.1705.08690 · Cited by 1,385
Furber, S. B., Galluppi, F., Temple, S., & Plana, L. A. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2304638 · Cited by 1,350
Deb, K., & Deb, K. (2014) · Search Methodologies · doi:10.1007/978-1-4614-6940-7_15 · Cited by 1,248
Chi, P., Li, S., Xu, C., Zhang, T., Zhao, J., Liu, Y., Wang, Y., & Xie, Y. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001140 · Cited by 1,231
A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input
Burkitt, A. N. (2006) · Biological Cybernetics · doi:10.1007/s00422-006-0068-6 · Cited by 1,208
Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks
Wu, Y., Deng, L., Li, G., Zhu, J., & Shi, L. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00331 · Cited by 1,196
Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., Venkatesh, G., et al. (2017) · arXiv · doi:10.48550/arxiv.1710.03740 · Cited by 1,179
Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity
Sjöström, P. J., Turrigiano, G. G., & Nelson, S. B. (2001) · Neuron · doi:10.1016/s0896-6273(01)00542-6 · Cited by 1,174
Neuropixels 2.0: A miniaturized high-density probe for stable, long-term brain recordings.
Steinmetz, N. A., Aydin, C., Lebedeva, A., Okun, M., Pachitariu, M., Bauza, M., Beau, M., Bhagat, J., Böhm, C., Broux, M., et al. (2021) · Science · doi:10.1126/science.abf4588 · Cited by 1,173 · cited 1×
“Ongoing advances in procuring largescale electrophysiological recordings at the neuron level can give us a window into observing how populations of spikes are orchestrated to handle credit assignment so efficiently and, at the very least, give us a more refined toolkit to developing theories that may advance deep lear…”
BackgroundA 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor
Brandli, C., Berner, R., Yang, M., Liu, S.-C., & Delbruck, T. (2014) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2014.2342715 · Cited by 1,144
Hecht, S., Shlaer, S., & Pirenne, M. H. (1942) · Journal of General Physiology · doi:10.1085/jgp.25.6.819 · Cited by 1,122
Towards artificial general intelligence with hybrid Tianjic chip architecture
Pei, J., Deng, L., Song, S., Zhao, M., Zhang, Y., Wu, S., Wang, G., Zou, Z., Wu, Z., He, W., et al. (2019) · Nature · doi:10.1038/s41586-019-1424-8 · Cited by 1,082
Rueckauer, B., Lungu, I.-A., Hu, Y., Pfeiffer, M., & Liu, S.-C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00682 · Cited by 1,072
Neural network computation with DNA strand displacement cascades
Qian, L., Winfree, E., & Bruck, J. (2011) · Nature · doi:10.1038/nature10262 · Cited by 1,071
A deep learning framework for neuroscience
Richards, B. A., Lillicrap, T. P., Beaudoin, P., Bengio, Y., Bogacz, R., Christensen, A., Clopath, C., Costa, R. P., de Berker, A., Ganguli, S., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0520-2 · Cited by 1,027
Error-backpropagation in temporally encoded networks of spiking neurons
Bohte, S. M., Kok, J. N., & La Poutré, H. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00658-0 · Cited by 1,021
A Low Power, Fully Event-Based Gesture Recognition System
Amir, A., Taba, B., Berg, D., Melano, T., McKinstry, J., Di Nolfo, C., Nayak, T., Andreopoulos, A., Garreau, G., Mendoza, M., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.781 · Cited by 1,017
Lillicrap, T. P., Santoro, A., Marris, L., Akerman, C. J., & Hinton, G. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0277-3 · Cited by 908
The neural basis of the Weber–Fechner law: a logarithmic mental number line
Dehaene, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00055-x · Cited by 907
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades
Orchard, G., Jayawant, A., Cohen, G. K., & Thakor, N. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00437 · Cited by 882
The tempotron: a neuron that learns spike timing–based decisions
Gütig, R., & Sompolinsky, H. (2006) · Nature Neuroscience · doi:10.1038/nn1643 · Cited by 815
Convolutional networks for fast, energy-efficient neuromorphic computing
Esser, S. K., Merolla, P. A., Arthur, J. V., Cassidy, A. S., Appuswamy, R., Andreopoulos, A., Berg, D. J., McKinstry, J. L., Melano, T., Barch, D. R., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1604850113 · Cited by 781
Deep Learning With Spiking Neurons: Opportunities and Challenges
Pfeiffer, M., & Pfeil, T. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00774 · Cited by 766
Cichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A. (2016) · Scientific Reports · doi:10.1038/srep27755 · Cited by 716
The recent excitement about neural networks
Crick, F. (1989) · Nature · doi:10.1038/337129a0 · Cited by 714
Advancing Neuromorphic Computing With Loihi: A Survey of Results and Outlook
Davies, M., Wild, A., Orchard, G., Sandamirskaya, Y., Guerra, G. A. F., Joshi, P., Plank, P., & Risbud, S. R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3067593 · Cited by 688
Role of experience and oscillations in transforming a rate code into a temporal code
Mehta, M. R., Lee, A. K., & Wilson, M. A. (2002) · Nature · doi:10.1038/nature00807 · Cited by 629
Mueggler, E., Rebecq, H., Gallego, G., Delbruck, T., & Scaramuzza, D. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917691115 · Cited by 606
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
DNA Computing: New Computing Paradigms
Pǎun, G., Rozenberg, G., & Salomaa, A. K. (1998) · Cited by 586
The Multivehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception
Zhu, A. Z., Thakur, D., Ozaslan, T., Pfrommer, B., Kumar, V., & Daniilidis, K. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800793 · Cited by 567
Recherches quantitatives sur l' excitation electrique des nerfs traitee comme une polarization.
Lapique, L. (1907) · Medical Entomology and Zoology · Cited by 562
Kell, A. J. E., Yamins, D. L. K., Shook, E. N., Norman-Haignere, S. V., & McDermott, J. H. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.044 · Cited by 544
The Computational Limits of Deep Learning
Thompson, N. C., Greenewald, K., Lee, K., & Manso, G. F. (2020) · arXiv · doi:10.48550/arxiv.2007.05558 · Cited by 538
The carbon impact of artificial intelligence
Dhar, P. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0219-9 · Cited by 509
A solution to the learning dilemma for recurrent networks of spiking neurons
Bellec, G., Scherr, F., Subramoney, A., Hajek, E., Salaj, D., Legenstein, R., & Maass, W. (2020) · Nature Communications · doi:10.1038/s41467-020-17236-y · Cited by 506
The Forward-Forward Algorithm: Some Preliminary InvestigationsPreprint
Hinton, G. E. (2022) · arXiv.org · doi:10.48550/arxiv.2212.13345 · Cited by 504
The Computational Limits of Deep Learning
Thompson, N., Greenewald, K., Lee, K., & Manso, G. F. (2023) · Ninth Computing within Limits 2023 · doi:10.21428/bf6fb269.1f033948 · Cited by 495
Wark, B., Lundstrom, B. N., & Fairhall, A. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.07.001 · Cited by 475
Huang, Y., & Rao, R. P. N. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.142 · Cited by 470
Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons
Vogels, T. P., & Abbott, L. F. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3508-05.2005 · Cited by 465
Brain-Score: Which Artificial Neural Network for Object Recognition is most Brain-Like?
Schrimpf, M., Kubilius, J., Hong, H., Majaj, N. J., Rajalingham, R., Issa, E. B., Kar, K., Bashivan, P., Prescott-Roy, J., Geiger, F., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/407007 · Cited by 458
SLAYER: Spike Layer Error Reassignment in Time
Shrestha, S. B., & Orchard, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08646 · Cited by 444
A Guide to Convolutional Neural Networks for Computer Vision
Khan, S. H., Rahmani, H., Shah, S. A. A., & Bennamoun, M. (2018) · Synthesis lectures on computer vision · doi:10.2200/s00822ed1v01y201712cov015 · Cited by 443
Self-citationElias, P. (1955) · IEEE Transactions on Information Theory · doi:10.1109/tit.1955.1055126 · Cited by 428
DSEC: A Stereo Event Camera Dataset for Driving Scenarios
Gehrig, M., Aarents, W., Gehrig, D., & Scaramuzza, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068942 · Cited by 428
Rathi, N., Srinivasan, G., Panda, P., & Roy, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.01807 · Cited by 423
Immunity to Device Variations in a Spiking Neural Network With Memristive Nanodevices
Querlioz, D., Bichler, O., Dollfus, P., & Gamrat, C. (2013) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2013.2250995 · Cited by 420
Very deep convolutional networks for end-to-end speech recognition
Zhang, Y., Chan, W., & Jaitly, N. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953077 · Cited by 407
Cai, F., Kumar, S., Van Vaerenbergh, T., Sheng, X., Liu, R., Li, C., Liu, Z., Foltin, M., Yu, S., Xia, Q., et al. (2020) · Nature Electronics · doi:10.1038/s41928-020-0436-6 · Cited by 393
Self-citationA Scalable Population Code for Time in the Striatum
Mello, G. B. M., Soares, S., & Paton, J. J. (2015) · Current Biology · doi:10.1016/j.cub.2015.02.036 · Cited by 392
Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics
Brader, J. M., Senn, W., & Fusi, S. (2007) · Neural Computation · doi:10.1162/neco.2007.19.11.2881 · Cited by 371
Towards deep learning with segregated dendrites
Guerguiev, J., Lillicrap, T. P., & Richards, B. A. (2017) · eLife · doi:10.7554/elife.22901 · Cited by 371
Modeling Brain Function: The World of Attractor Neural Networks
de Callataÿ, A. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90155-4 · Cited by 359
Rajalingham, R., Issa, E. B., Bashivan, P., Kar, K., Schmidt, K., & DiCarlo, J. J. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0388-18.2018 · Cited by 358
Learning in spiking neural networks by reinforcement of stochastic synaptic transmission
Seung, H. S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00761-x · Cited by 340 · cited 2×
“Beyond neuromorphic applications, SNNs are also used to test theories about how natural intelligence may arise, from the higher level learning rules of the brain [55] and how memories are formed [56] down to the lower level dynamics at the neuronal and synaptic layers [57].”
BackgroundPerez-Carrasco, J. A., Zhao, B., Serrano, C., Acha, B., Serrano-Gotarredona, T., Chen, S., & Linares-Barranco, B. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.71 · Cited by 324
A 128 X 128 120db 30mw asynchronous vision sensor that responds to relative intensity change
Lichtsteiner, P., Posch, C., & Delbruck, T. (2006) · 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers · doi:10.1109/isscc.2006.1696265 · Cited by 311
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and ArchitecturesPreprint
Bartunov, S., Santoro, A., Richards, B. A., Marris, L., Hinton, G. E., & Lillicrap, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.04587 · Cited by 310
The Heidelberg Spiking Data Sets for the Systematic Evaluation of Spiking Neural Networks
Cramer, B., Stradmann, Y., Schemmel, J., & Zenke, F. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3044364 · Cited by 288
Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)
Kaiser, J., Mostafa, H., & Neftci, E. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00424 · Cited by 288
Self-citationTowards Biologically Plausible Deep Learning
Bengio, Y., Lee, D.-H., Bornschein, J., Mesnard, T., & Lin, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.04156 · Cited by 276
Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain
Brette, R. (2015) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00151 · Cited by 270
Neural heterogeneity promotes robust learning
Perez-Nieves, N., Leung, V. C. H., Dragotti, P. L., & Goodman, D. F. M. (2021) · Nature Communications · doi:10.1038/s41467-021-26022-3 · Cited by 267
Single-photon detection by rod cells of the retina
Rieke, F., & Baylor, D. A. (1998) · Reviews of Modern Physics · doi:10.1103/revmodphys.70.1027 · Cited by 263
Zenke, F., & Vogels, T. P. (2021) · Neural Computation · doi:10.1162/neco_a_01367 · Cited by 261
Applications of advances in nonlinear sensitivity analysis
Werbos, P. J. (2005) · Lecture Notes in Control and Information Sciences · doi:10.1007/bfb0006203 · Cited by 259
Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models
Anthony, L. F. W., Kanding, B., & Selvan, R. (2020) · arXiv · doi:10.48550/arxiv.2007.03051 · Cited by 255 · cited 1×
“OpenAI’s language model, GPT-3, contains 175 billion learnable parameters, estimated to consume roughly 190 000 kWh to train [25], [26], [27].”
BackgroundThorpe, S., & Gautrais, J. (1998) · Computational Neuroscience · doi:10.1007/978-1-4615-4831-7_19 · Cited by 251
Renart, A., Song, P., & Wang, X.-J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00255-1 · Cited by 246
Self-citationEvent-Driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines
Neftci, E. O., Augustine, C., Paul, S., & Detorakis, G. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00324 · Cited by 237
Self-citationSpikeGPT: Generative Pre-trained Language Model with Spiking Neural NetworksPreprint
Zhu, R.-J., Zhao, Q., Li, G., & Eshraghian, J. K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.13939 · Cited by 232
Self-citationThe Spectro-Temporal Receptive Field: A functional characteristic of auditory neurons
Aertsen, A. M. H. J., & Johannesma, P. I. M. (1981) · Biological Cybernetics · doi:10.1007/bf00336731 · Cited by 231
Braindrop: A Mixed-Signal Neuromorphic Architecture With a Dynamical Systems-Based Programming Model
Neckar, A., Fok, S., Benjamin, B. V., Stewart, T. C., Oza, N. N., Voelker, A. R., Eliasmith, C., Manohar, R., & Boahen, K. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2881432 · Cited by 229
How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target PropagationPreprint
Bengio, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.7906 · Cited by 223
Embodied neuromorphic intelligence
Bartolozzi, C., Indiveri, G., & Donati, E. (2022) · Nature Communications · doi:10.1038/s41467-022-28487-2 · Cited by 218
Zhao, B., Ding, R., Chen, S., Linares-Barranco, B., & Tang, H. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2362542 · Cited by 216
Brain-inspired learning in artificial neural networks: A review
Schmidgall, S., Ziaei, R., Achterberg, J., Kirsch, L., Hajiseyedrazi, S. P., & Eshraghian, J. K. (2024) · APL Machine Learning · doi:10.1063/5.0186054 · Cited by 215
Self-citationGradient Descent for Spiking Neural NetworksPreprint
Huh, D., & B, T. J. S. A. (2017) · arXiv (Cornell University) · doi:10.12751/nncn.bc2017.0088 · Cited by 212
Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
Azghadi, M. R., Lammie, C., Eshraghian, J. K., Payvand, M., Donati, E., Linares-Barranco, B., & Indiveri, G. (2020) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2020.3036081 · Cited by 212
Self-citationDeep Residual Learning in Spiking Neural Networks
Fang, W., Yu, Z., Chen, Y., Huang, T., Masquelier, T., & Tian, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04159 · Cited by 209
Spiking Deep Networks with LIF Neurons
Hunsberger, E., & Eliasmith, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.08829 · Cited by 203
Temporal Backpropagation for Spiking Neural Networks with One Spike per Neuron
Kheradpisheh, S. R., & Masquelier, T. (2020) · International Journal of Neural Systems · doi:10.1142/s0129065720500276 · Cited by 203
Diehl, P. U., Zarrella, G., Cassidy, A., Pedroni, B. U., & Neftci, E. (2016) · 2016 IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2016.7738691 · Cited by 202
Self-citationFrenkel, C., Bol, D., & Indiveri, G. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3273520 · Cited by 190
Homeostatic plasticity and STDP: keeping a neuron's cool in a fluctuating world
Watt, A. J. (2010) · Frontiers in Synaptic Neuroscience · doi:10.3389/fnsyn.2010.00005 · Cited by 186
Rigotti, M. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00024 · Cited by 184
Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications
Azghadi, M. R., Lammie, C., Eshraghian, J. K., Payvand, M., Donati, E., Linares-Barranco, B., & Indiveri, G. (2020) · ResearchOnline - JCU (James Cook University) · doi:10.3929/ethz-b-000465927 · Cited by 176
Self-citationStöckl, C., & Maass, W. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00311-4 · Cited by 176
Ceolini, E., Frenkel, C., Shrestha, S. B., Taverni, G., Khacef, L., Payvand, M., & Donati, E. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00637 · Cited by 172
Revisiting Batch Normalization for Training Low-Latency Deep Spiking Neural Networks From Scratch
Kim, Y., & Panda, P. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.773954 · Cited by 172
Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function
Comsa, I. M., Potempa, K., Versari, L., Fischbacher, T., Gesmundo, A., & Alakuijala, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053856 · Cited by 170
Sharifshazileh, M., Burelo, K., Sarnthein, J., & Indiveri, G. (2021) · Nature Communications · doi:10.1038/s41467-021-23342-2 · Cited by 170
Adaptation maintains population homeostasis in primary visual cortex
Benucci, A., Saleem, A. B., & Carandini, M. (2013) · Nature Neuroscience · doi:10.1038/nn.3382 · Cited by 167
Graph-Based Object Classification for Neuromorphic Vision Sensing
Bi, Y., Chadha, A., Abbas, A., Bourtsoulatze, E., & Andreopoulos, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00058 · Cited by 167
The CaMKII/NMDAR complex as a molecular memory
Sanhueza, M., & Lisman, J. (2013) · Molecular Brain · doi:10.1186/1756-6606-6-10 · Cited by 166 · cited 1×
“Equation (12) describes how to propagate gradient-related terms forward in time to implement online learning, where such terms could be approximated by eligibility traces that keep track of presynaptic neuron activity in the form of calcium ions and fades over time [109], [234].”
BackgroundFeedforward, feedback and inhibitory connections in primate visual cortex
Callaway, E. M. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.04.004 · Cited by 165
The Brain as an Efficient and Robust Adaptive Learner
Denève, S., Alemi, A., & Bourdoukan, R. (2017) · Neuron · doi:10.1016/j.neuron.2017.05.016 · Cited by 162
Poker-DVS and MNIST-DVS. Their History, How They Were Made, and Other Details
Serrano-Gotarredona, T., & Linares-Barranco, B. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00481 · Cited by 161
A Neuromorphic Event-Based Neural Recording System for Smart Brain-Machine-Interfaces
Corradi, F., & Indiveri, G. (2015) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2015.2479256 · Cited by 157
A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks
Xu, Y., Zeng, X., Han, L., & Yang, J. (2013) · Neural Networks · doi:10.1016/j.neunet.2013.02.003 · Cited by 155
Event-based backpropagation can compute exact gradients for spiking neural networks
Wunderlich, T. C., & Pehle, C. (2021) · Scientific Reports · doi:10.1038/s41598-021-91786-z · Cited by 155
Neuromorphic computing hardware and neural architectures for robotics
Sandamirskaya, Y., Kaboli, M., Conradt, J., & Celikel, T. (2022) · Science Robotics · doi:10.1126/scirobotics.abl8419 · Cited by 153
Energy efficient ECG classification with spiking neural network
Yan, Z., Zhou, J. R., & Wong, W. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102170 · Cited by 152
Deep Supervised Learning Using Local Errors
Mostafa, H., Ramesh, V., & Cauwenberghs, G. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00608 · Cited by 147
Stable Recurrent ModelsPreprint
Miller, J. J., & Hardt, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10369 · Cited by 142
Complementary Metal‐Oxide Semiconductor and Memristive Hardware for Neuromorphic Computing
Azghadi, M. R., Chen, Y., Eshraghian, J. K., Chen, J., Lin, C.-Y., Amirsoleimani, A., Mehonić, A., Kenyon, A. J., Fowler, B. W., Lee, J. C., et al. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.201900189 · Cited by 142
Self-citationComputing with Neural Synchrony
Brette, R. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002561 · Cited by 141
Beyeler, M., Dutt, N. D., & Krichmar, J. L. (2013) · Neural Networks · doi:10.1016/j.neunet.2013.07.012 · Cited by 139
Real-Time Ultra-Low Power ECG Anomaly Detection Using an Event-Driven Neuromorphic Processor
Bauer, F. C., Muir, D. R., & Indiveri, G. (2019) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2019.2953001 · Cited by 138
Brain-Inspired Learning on Neuromorphic Substrates
Zenke, F., & Neftci, E. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3045625 · Cited by 135
Self-citationRuëdi, P.-F., Heim, P., Kaess, F., Grenet, E., Heitger, F., Burgi, P., Gyger, S., & Nussbaum, P. (2003) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2003.819169 · Cited by 134
DVS Benchmark Datasets for Object Tracking, Action Recognition, and Object Recognition
Hu, Y., Liu, H., Pfeiffer, M., & Delbrück, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00405 · Cited by 133
Feature Representations for Neuromorphic Audio Spike Streams
Anumula, J., Neil, D., Delbrück, T., & Liu, S. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00023 · Cited by 131
Local online learning in recurrent networks with random feedback
Murray, J. M. (2019) · eLife · doi:10.7554/elife.43299 · Cited by 126
Frenkel, C., Lefebvre, M., & Bol, D. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.629892 · Cited by 120
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119
Event-driven random backpropagation: Enabling neuromorphic deep learning machines
Neftci, E. O., Augustine, C., Paul, S., & Detorakis, G. (2017) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2017.8050529 · Cited by 118
Self-citationYin, B., Corradi, F., & Bohté, S. M. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00650-4 · Cited by 117
Learning Curves for Stochastic Gradient Descent in Linear Feedforward Networks
Werfel, J., Xie, X. S., & Seung, H. S. (2005) · Neural Computation · doi:10.1162/089976605774320539 · Cited by 112
Legendre Memory Units: Continuous-Time Representation in Recurrent Neural Networks
Voelker, A. R., Kajić, I., & Eliasmith, C. (2019) · neural information processing systems · Cited by 108
Sharifshazileh, M., Burelo, K., Sarnthein, J., & Indiveri, G. (2021) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000488458 · Cited by 104
A Bidirectional Brain-Machine Interface Featuring a Neuromorphic Hardware Decoder
Boi, F., Moraitis, T., Feo, V. D., Diotalevi, F., Bartolozzi, C., Indiveri, G., & Vato, A. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00563 · Cited by 101
Loss-aware Weight Quantization of Deep Networks
Hou, L., & Kwok, J. T. (2018) · arXiv · doi:10.48550/arxiv.1802.08635 · Cited by 99
Online Spatio-Temporal Learning in Deep Neural Networks
Bohnstingl, T., Woźniak, S., Pantazi, A., & Eleftheriou, E. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3153985 · Cited by 98
Human ownership of artificial creativity
Eshraghian, J. K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0161-x · Cited by 95
Self-citationWei, D., Wang, J., Niu, X., & Li, Z. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116842 · Cited by 93
Event-based Sensing for Space Situational Awareness
Cohen, G., Afshar, S., Morreale, B., Bessell, T., Wabnitz, A., Rutten, M. G., & André, V. S. (2019) · The Journal of the Astronautical Sciences · doi:10.1007/s40295-018-00140-5 · Cited by 92
Event-Based Object Detection and Tracking for Space Situational Awareness
Afshar, S., Nicholson, A. P., André, V. S., & Cohen, G. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3009687 · Cited by 90
Random feedback weights support learning in deep neural networksPreprint
Lillicrap, T., Cownden, D., Tweed, D., & Akerman, C. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.0247 · Cited by 89
What Is the Other 85 Percent of V1 Doing?
Olshausen, B. A., & Field, D. J. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195148220.003.0010 · Cited by 85
He, Y., Corradi, F., Shi, C., van der Ven, S., Timmermans, M., Stuijt, J., Detterer, P., Harpe, P. J. A., Lindeboom, L., Hermeling, E., et al. (2022) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2022.3193846 · Cited by 79
Renart, A., Brunel, N., & Wang, X. (2003) · Chapman & Hall/CRC mathematical and computational biology series · doi:10.1201/9780203494462.ch15 · Cited by 78
Self-citationFeedback alignment in deep convolutional networksPreprint
Moskovitz, T., Litwin-Kumar, A., & Abbott, L. F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06488 · Cited by 76
Spiking Deep Residual NetworkPreprint
Hu, Y., Tang, H., & Pan, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.01352 · Cited by 70
Memristive devices for stochastic computing
Gaba, S., Knag, P. C., Zhang, Z., & Lu, W. D. (2014) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2014.6865703 · Cited by 66
Self-citationNeuromorphic control for optic-flow-based landing of MAVs using the Loihi processor
Dupeyroux, J., Hagenaars, J. J., Paredes-Vallés, F., & de Croon, G. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560937 · Cited by 64
Biologically-plausible learning algorithms can scale to large datasetsPreprint
Xiao, W., Chen, H., Liao, Q., & Poggio, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.03567 · Cited by 62
Neuromorphic Vision Hybrid RRAM-CMOS Architecture
Eshraghian, J. K., Cho, K.-R., Zheng, C., Nam, M., Iu, H. H., Lei, W., & Eshraghian, K. (2018) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2829918 · Cited by 61
Self-citationTraining Recurrent Neural Networks via Forward Propagation Through Time
Kag, A., & Saligrama, V. (2021) · Cited by 59
To Spike or Not to Spike: A Digital Hardware Perspective on Deep Learning Acceleration
Ottati, F., Gao, C., Chen, Q., Brignone, G., Casu, M. R., Eshraghian, J. K., & Lavagno, L. (2023) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2023.3330432 · Cited by 56
Self-citationSparse distributed memory using N-of-M codes
Furber, S. B., Bainbridge, W. J., Cumpstey, J. M., & Temple, S. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.07.003 · Cited by 51
Sparse Spiking Gradient DescentPreprint
Perez-Nieves, N., & Goodman, D. F. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08810 · Cited by 50
Neuromorphic deep spiking neural networks for seizure detection
Yang, Y., Eshraghian, J. K., Truong, N. D., Nikpour, A., & Kavehei, O. (2023) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/acbab8 · Cited by 47
Self-citationMemory consolidation and improvement by synaptic tagging and capture in recurrent neural networks
Luboeinski, J., & Tetzlaff, C. (2021) · Communications Biology · doi:10.1038/s42003-021-01778-y · Cited by 43
A Multimodal AI System for Out-of-Distribution Generalization of Seizure Identification
Yang, Y., Truong, N. D., Eshraghian, J. K., Maher, C., Nikpour, A., & Kavehei, O. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3157877 · Cited by 42
Self-citation
Cited by
Neuromorphic computing at scale
Kudithipudi, D., Schuman, C., Vineyard, C. M., Pandit, T., Merkel, C., Kubendran, R., Aimone, J. B., Orchard, G., Mayr, C., Benosman, R., et al. (2025) · Nature · doi:10.1038/s41586-024-08253-8 · Cited by 357
Toward an AI Era: Advances in Electronic Skins
Fu, X., Cheng, W., Wan, G., Yang, Z., & Tee, B. C. K. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00049 · Cited by 172
Metadata
- Authors
- Eshraghian, J. K., Ward, M., Neftci, E. O., Wang, X., Lenz, G., Dwivedi, G., Bennamoun, M., Jeong, D. S., & Lu, W. D.
- Venue
- Proceedings of the IEEE
- Published
- 2023-09
- Volume
- 111
- Issue
- 9
- Pages
- 1016-1054
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W3201870057
- Cited by
- 782
- References
- 223
- FWCI
- 55.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.