Efficient visual object representation using a biologically plausible spike-latency code and winner-take-all inhibition
Open accessAbstract
Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli from the Fashion MNIST dataset. Stimuli were preprocessed with center-surround receptive fields and then fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity (STDP). We investigate how the quality of the represented objects changes under different WTA-I schemes and demonstrate that a network of 150 spiking neurons can efficiently represent objects with as little as 40 spikes. Studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
New computer vision algorithms are needed to process the unconventional output of neuromorphic sensors to unlock their potential.
“new computer vision algorithms are needed to process the unconventional output of neuromorphic sensors to unlock their potential (Gallego et al., 2022; Sanchez-Garcia et al., 2022).”
From Towards a <i>Smart Bionic Eye</i> : AI-powered artificial vision for the treatment of incurable blindness (2022) · cites this paper as Sanchez-Garcia et al., 2022
The Introduction (p. 1) discusses spiking neural networks as a route to efficient artificial vision, and the Abstract (p. 1) describes a model tested on Fashion MNIST stimuli. Searches for neuromorphic sensors, their unconventional output, and algorithms needed to process it found no passage addressing that claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 10
- [1][1] MBeyeler, EL Rounds, KD Carlson, N Dutt, and JL Krichmar. Neural correlates of sparse coding and dimensionality reduction. PLoS Computational Biology , 15(6), 2019. 1, 4 -
- [2][2] T Chauhan, T Masquelier, A Montlibert, and BR Cottereau. Emergence of binocular disparity selectivity through Hebbian learning. Journal of Neuroscience , 38(44):9563-9578, 2018. 1, 2 -
- [3][3] RMCichy, D Pantazis, and A Oliva. Similarity-Based Fusion of MEG and fMRI Reveals Spatio-Temporal Dynamics in Human Cortex During Visual Object Recognition. Cerebral Cortex , 26(8):3563-3579, 07 2016. 1 -
- [4][4] JJ DiCarlo, D Zoccolan, and NC Rust. How does the brain solve visual object recognition? Neuron , 73(3):415-434, 2012. 1 -
- [5][5] AGoel, C Tung, Y-H Lu, and GK Thiruvathukal. A survey of methods for low-power deep learning and computer vision. In 2020 IEEE 6th World Forum on Internet of Things (WFIoT) , pages 1-6. IEEE, 2020. 1 -
- [6][6] R G¨ utig, R Aharonov, S Rotter, and H Sompolinsky. Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity. Journal of Neuroscience , 23(9):3697-3714, May 2003. Publisher: Society for Neuroscience Section: ARTICLE. 1, 2 -
- [7][7] K He, X Zhang, S Ren, and J Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In 2015 IEEE International Conference on Computer Vision (ICCV) , pages 1026-1034, 2015. 1 -
- [8][8] W Maass. On the computational power of winner-take-all. Neural Computation , 12(11):2519-2535, 2000. 1, 2, 3 -
- [9][9] T Masquelier and SJ Thorpe. Unsupervised learning of visual features through spike timing dependent plasticity. PLoS Computational Biology , 3(2):e31, 2007. 2 -
- [10][10] H Xiao, K Rasul, and R Vollgraf. Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747 , 2017. 1, 3 Figure 5. Reconstruction error in the test phase as a function of the number of spikes included in the STDP algorithm (WTA-I) for 150 V1 neurons. Number of spikes needed to optimally represent an object during the test phase is given in red. <!-- image --> Figure 6. Representation of a shoe using different WTA-I schemes, where between 1 (WTA-I 1) and 150 (WTA-I 150) neurons were active for each training sample. The number below each image indicates the reconstruction error for that particular image. <!-- image --> · arXiv
Cited by
Sorted by citations
Beyeler, M., & Sanchez-Garcia, M. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/aca69d · Cited by 34 · see citing works
Self-citation
- Authors
- Sanchez-Garcia, M., Chauhan, T., Cottereau, B. R., & Beyeler, M.
- Affiliations
- University of California, Santa Barbara (US)
- Centre National de la Recherche Scientifique (FR)
- Corresponding author
- Sanchez-Garcia, Melani
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- Volume
- 117
- Issue
- 1-2
- Pages
- 95-111
- ISSN
- 0340-1200 (ISSN-L)
- arXiv
- 2205.10338
- OpenAlex
- W4362506468
- Cited by
- 3
- References
- 0
- Citations by year
- 2024: 1 · 2023: 1 · 2022: 1
- FWCI
- 0.14
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Biological Cybernetics (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- HAL (submittedVersion)
- arXiv (Cornell University)
- arXiv (Cornell University) (cc-by)
- Funders
- U.S. Department of Energy (DESC0022997)
- Agence Nationale de la Recherche (ANR-19-HBPR-0007)
- Fondation pour la Recherche Médicale (FRM: SPF20170938752, SPF20170938752)
- University of California, Santa Barbara
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- spiking neural networks, object recognition, multi-scale representation, spatial frequency channels, spike-timing-dependent plasticity, energy-efficient neural networks, early visual cortex, biologically plausible learning rules, artificial vision
- MeSH terms
- Humans, Learning, Models, Neurological, Neuronal Plasticity, Visual Perception, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
