The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
STDP-based spiking deep convolutional neural networks for object recognition
Open accessAbstract
Previous studies have shown that spike-timing-dependent plasticity (STDP) can be used in spiking neural networks (SNN) to extract visual features of low or intermediate complexity in an unsupervised manner. These studies, however, used relatively shallow architectures, and only one layer was trainable. Another line of research has demonstrated - using rate-based neural networks trained with back-propagation - that having many layers increases the recognition robustness, an approach known as deep learning. We thus designed a deep SNN, comprising several convolutional (trainable with STDP) and pooling layers. We used a temporal coding scheme where the most strongly activated neurons fire first, and less activated neurons fire later or not at all. The network was exposed to natural images. Thanks to STDP, neurons progressively learned features corresponding to prototypical patterns that were both salient and frequent. Only a few tens of examples per category were required and no label was needed. After learning, the complexity of the extracted features increased along the hierarchy, from edge detectors in the first layer to object prototypes in the last layer. Coding was very sparse, with only a few thousands spikes per image, and in some cases the object category could be reasonably well inferred from the activity of a single higher-order neuron. More generally, the activity of a few hundreds of such neurons contained robust category information, as demonstrated using a classifier on Caltech 101, ETH-80, and MNIST databases. We also demonstrate the superiority of STDP over other unsupervised techniques such as random crops (HMAX) or auto-encoders. Taken together, our results suggest that the combination of STDP with latency coding may be a key to understanding the way that the primate visual system learns, its remarkable processing speed and its low energy consumption. These mechanisms are also interesting for artificial vision systems, particularly for hardware solutions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Self-citationA 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
Robust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667
Unsupervised learning of digit recognition using spike-timing-dependent plasticity
Diehl, P. U., & Cook, M. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00099 · Cited by 1,452
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing
Diehl, P. U., Neil, D., Binas, J., Cook, M., Liu, S.-C., & Pfeiffer, M. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280696 · Cited by 991
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964 · cited 2×
“s implemented in biological neural networks, it seems that for some tasks (e.g., motor control and sensory inputs prediction) the brain must constantly learn temporal dynamics based on error feedback [59]. Employing such reinforcement and supervised learning strategies could improve the proposed SDNN in dierent aspect…”
Untangling invariant object recognition
DiCarlo, J. J., & Cox, D. D. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.06.010 · Cited by 959
A feedforward architecture accounts for rapid categorization
Serre, T., Oliva, A., & Poggio, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700622104 · Cited by 918
Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition
Cao, Y., Chen, Y., & Khosla, D. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0788-3 · Cited by 917
Fast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
Cadieu, C. F., Hong, H., Yamins, D. L. K., Pinto, N., Ardila, D., Solomon, E. A., Majaj, N. J., & DiCarlo, J. J. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003963 · Cited by 824
Spike-based strategies for rapid processing
Thorpe, S., Delorme, A., & Van Rullen, R. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00083-1 · Cited by 731
Self-citationCichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A. (2016) · Scientific Reports · doi:10.1038/srep27755 · Cited by 716
Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited
Kirchner, H., & Thorpe, S. J. (2006) · Vision Research · doi:10.1016/j.visres.2005.10.002 · Cited by 628
Self-citationComputational Neuroscience of Vision
Rolls, E., & Deco, G. (2001) · doi:10.1093/acprof:oso/9780198524885.001.0001 · Cited by 553
Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity
Masquelier, T., & Thorpe, S. J. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030031 · Cited by 548
Self-citationSTDP and STDP variations with memristors for spiking neuromorphic learning systems
Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., Indiveri, G., & Linares-Barranco, B. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00002 · Cited by 533
Self-citationRate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex
Rullen, R. V., & Thorpe, S. J. (2001) · Neural Computation · doi:10.1162/08997660152002852 · Cited by 487
Self-citationImmunity to Device Variations in a Spiking Neural Network With Memristive Nanodevices
Querlioz, D., Bichler, O., Dollfus, P., & Gamrat, C. (2013) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2013.2250995 · Cited by 420
Real-time classification and sensor fusion with a spiking deep belief network
O'Connor, P., Neil, D., Liu, S.-C., Delbruck, T., & Pfeiffer, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00178 · Cited by 408
Liu, H., Agam, Y., Madsen, J. R., & Kreiman, G. (2009) · Neuron · doi:10.1016/j.neuron.2009.02.025 · Cited by 385
Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics
Brader, J. M., Senn, W., & Fusi, S. (2007) · Neural Computation · doi:10.1162/neco.2007.19.11.2881 · Cited by 371
Towards Biologically Plausible Deep Learning
Bengio, Y., Lee, D.-H., Bornschein, J., Mesnard, T., & Lin, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.04156 · Cited by 276
Wiring considerations in analog VLSI systems, with application to field-programmable networks
Sivilotti, M. A. (2007) · CaltechTHESIS (California Institute of Technology) · doi:10.7907/stj4-kh72 · Cited by 273
Role of Dopamine Neurons in Reward and Aversion: A Synaptic Plasticity Perspective
Pignatelli, M., & Bonci, A. (2015) · Neuron · doi:10.1016/j.neuron.2015.04.015 · Cited by 245
How silent is the brain: is there a “dark matter” problem in neuroscience?
Shoham, S., O’Connor, D. H., & Segev, R. (2006) · Journal of Comparative Physiology A · doi:10.1007/s00359-006-0117-6 · Cited by 244
Zhao, B., Ding, R., Chen, S., Linares-Barranco, B., & Tang, H. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2362542 · Cited by 216
Spiking Deep Networks with LIF Neurons
Hunsberger, E., & Eliasmith, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.08829 · Cited by 203
Diehl, P. U., Zarrella, G., Cassidy, A., Pedroni, B. U., & Neftci, E. (2016) · 2016 IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2016.7738691 · Cited by 202
Deep Networks Can Resemble Human Feed-forward Vision in Invariant Object Recognition
Kheradpisheh, S. R., Ghodrati, M., Ganjtabesh, M., & Masquelier, T. (2016) · Scientific Reports · doi:10.1038/srep32672 · Cited by 197
Self-citationMeliza, C. D., & Dan, Y. (2006) · Neuron · doi:10.1016/j.neuron.2005.12.009 · Cited by 181
The Handbook of Brain Theory and Neural Networks
(1999) · Kybernetes · doi:10.1108/k.1999.28.9.1084.1 · Cited by 168
Virtual Retina: A biological retina model and simulator, with contrast gain control
Wohrer, A., & Kornprobst, P. (2008) · Journal of Computational Neuroscience · doi:10.1007/s10827-008-0108-4 · Cited by 158
Bio-inspired unsupervised learning of visual features leads to robust invariant object recognition
Kheradpisheh, S. R., Ganjtabesh, M., & Masquelier, T. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.04.029 · Cited by 141
Self-citationBeyeler, M., Dutt, N. D., & Krichmar, J. L. (2013) · Neural Networks · doi:10.1016/j.neunet.2013.07.012 · Cited by 139
Panda, P., & Roy, K. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727212 · Cited by 129
Arnaud Delorme, A., Perrinet, L., & Thorpe, S. J. (2001) · Neurocomputing · doi:10.1016/s0925-2312(01)00403-9 · Cited by 117
Self-citationPortelli, G., Barrett, J. M., Hilgen, G., Masquelier, T., Maccione, A., Marco, S. D., Berdondini, L., Kornprobst, P., & Sernagor, E. (2016) · eNeuro · doi:10.1523/eneuro.0134-15.2016 · Cited by 97
Self-citationComparing state-of-the-art visual features on invariant object recognition tasks
Pinto, N., Barhomi, Y., Cox, D., & DiCarlo, J. J. (2011) · Proceedings · doi:10.1109/wacv.2011.5711540 · Cited by 85
Mirrored STDP Implements Autoencoder Learning in a Network of Spiking Neurons
Burbank, K. S. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004566 · Cited by 81
Associative Hebbian Synaptic Plasticity in Primate Visual Cortex
Huang, S., Rozas, C., Treviño, M., Contreras, J. A., Yang, S., Song, L., Yoshioka, T., Lee, H., & Kirkwood, A. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0983-14.2014 · Cited by 68
Feedforward object-vision models only tolerate small image variations compared to human
Ghodrati, M., Farzmahdi, A., Rajaei, K., Ebrahimpour, R., & Khaligh‐Razavi, S. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00074 · Cited by 57
Stimulus Timing-Dependent Plasticity in High-Level Vision
McMahon, D. B. T., & Leopold, D. A. (2012) · Current Biology · doi:10.1016/j.cub.2012.01.003 · Cited by 50
Improved margin multi-class classification using dendritic neurons with morphological learning
Hussain, S., Liu, S., & Basu, A. (2014) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2014.6865715 · Cited by 44
Habenschuss, S., Bill, J., & Nessler, B. (2012) · neural information processing systems · Cited by 39
A Computational Framework for Realistic Retina Modeling
Martínez‐Cañada, P., Morillas, C. A., del Pino, B., Ros, E., & Pelayo, F. J. (2016) · International Journal of Neural Systems · doi:10.1142/s0129065716500301 · Cited by 36
Humans and Deep Networks Largely Agree on Which Kinds of Variation Make Object Recognition Harder
Kheradpisheh, S. R., Ghodrati, M., Ganjtabesh, M., & Masquelier, T. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00092 · Cited by 35
Self-citationTaking the MAX from neuronal responses
Rousselet, G. A., Thorpe, S. J., & Fabre‐Thorpe, M. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00023-8 · Cited by 29
Self-citationFast Pipeline 128×128 pixel spiking convolution core for event-driven vision processing in FPGAs
Yousefzadeh, A., Serrano‐Gotarredona, T., & Linares-Barranco, B. (2015) · International Conference on Event-based Control, Communication, and Signal Processing · doi:10.1109/ebccsp.2015.7300698 · Cited by 15
Supervised feature learning via l2-norm regularized logistic regression for 3D object recognition
Zou, F., Wang, Y., Yang, Y., Zhou, K., Chen, Y., & Song, J. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.06.089 · Cited by 13
Research works printed but not linked: 1
- Maass, 2002, Computing with spikes, Special Issue on Foundations of Information Processing of TELEMATIK, 8, 32
Cited by
Memory devices and applications for in-memory computing
Sebastian, A., Le Gallo, M., Khaddam-Aljameh, R., & Eleftheriou, E. (2020) · Nature Nanotechnology · doi:10.1038/s41565-020-0655-z · Cited by 2,289
Towards spike-based machine intelligence with neuromorphic computing
Roy, K., Jaiswal, A., & Panda, P. (2019) · Nature · doi:10.1038/s41586-019-1677-2 · Cited by 2,190
Deep learning in spiking neural networks
Tavanaei, A., Ghodrati, M., Kheradpisheh, S. R., Masquelier, T., & Maida, A. (2019) · Neural Networks · doi:10.1016/j.neunet.2018.12.002 · Cited by 1,386
Self-citationDeep Learning With Spiking Neurons: Opportunities and Challenges
Pfeiffer, M., & Pfeil, T. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00774 · Cited by 766
Spiking Neural Networks and Their Applications: A Review
Yamazaki, K., Vo-Ho, V.-K., Bulsara, D., & Le, N. (2022) · Brain Sciences · doi:10.3390/brainsci12070863 · Cited by 626
Metadata
- Authors
- Kheradpisheh, S. R., Ganjtabesh, M., Thorpe, S. J., & Masquelier, T.
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2018-03
- Volume
- 99
- Pages
- 56-67
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W2779025322
- Cited by
- 768
- References
- 60
- FWCI
- 24.50
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Funders
- European Research Council
- ERC (323711)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.