The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Characterizing the sparseness of neural codes
Abstract
It is often suggested that efficient neural codes for natural visual information should be `sparse'. However, the term `sparse' has been used in two different ways - firstly to describe codes in which few neurons are active at any time (`population sparseness'), and secondly to describe codes in which each neuron's lifetime response distribution has high kurtosis (`lifetime sparseness'). Although these ideas are related, they are not identical, and the most common measure of lifetime sparseness - the kurtosis of the lifetime response distributions of the neurons - provides no information about population sparseness. We have measured the population sparseness and lifetime kurtosis of several biologically inspired coding schemes. We used three measures of population sparseness (population kurtosis, Treves-Rolls sparseness and `activity sparseness'), and found them to be in close agreement with one another. However, we also measured the lifetime kurtosis of the cells in each code. We found that lifetime kurtosis is uncorrelated with population sparseness for the codes we used. Lifetime kurtosis is not, therefore, a useful measure of the population sparseness of a code. Moreover, the Gabor-like codes, which are often assumed to have high population sparseness (since they have high lifetime kurtosis), actually turned out to have rather low population sparseness. Surprisingly, principal components filters produced the codes with the highest population sparseness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 2×
“Three are possible models of simple cell receptive fields: Gabor filters (Daugman 1980, Marcelja 1980, Field and Tolhurst 1986, Jones and Palmer 1987), independent component filters (Bell and Sejnowski 1997) and Olshausen–Field bases (Olshausen and Field 1996, 1997).”
MethodSparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
McClelland, J. L., Rumelhart, D. E., & AU (1987) · doi:10.7551/mitpress/5237.001.0001 · Cited by 3,315
Normalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835 · cited 2×
“Secondly, a standardization of this sort may be related to the energy normalization believed to occur in primary visual cortex ( Heeger 1992 ).”
BackgroundSpatial summation in the receptive fields of simple cells in the cat's striate cortex.
Movshon, J. A., Thompson, I. D., & Tolhurst, D. J. (1978) · The Journal of Physiology · doi:10.1113/jphysiol.1978.sp012488 · Cited by 890
Self-citation
Cited by
Sparse coding of sensory inputs
Olshausen, B. A., & Field, D. J. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.07.007 · Cited by 1,404
Lei, Y., Jia, F., Lin, J., Xing, S., & Ding, S. X. (2016) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2519325 · Cited by 1,191
Energy limitation as a selective pressure on the evolution of sensory systems
Niven, J. E., & Laughlin, S. B. (2008) · Journal of Experimental Biology · doi:10.1242/jeb.017574 · Cited by 1,056
Oscillations and Sparsening of Odor Representations in the Mushroom Body
Perez-Orive, J., Mazor, O., Turner, G. C., Cassenaer, S., Wilson, R. I., & Laurent, G. (2002) · Science · doi:10.1126/science.1070502 · Cited by 806
Unsupervised Deep Feature Extraction for Remote Sensing Image Classification
Romero, A., Gatta, C., & Camps-Valls, G. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2478379 · Cited by 729
Cortical connectivity and sensory coding
Harris, K. D., & Mrsic-Flogel, T. D. (2013) · Nature · doi:10.1038/nature12654 · Cited by 651
Laminar Structure of Spontaneous and Sensory-Evoked Population Activity in Auditory Cortex
Sakata, S., & Harris, K. D. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.020 · Cited by 594
Transformation of Olfactory Representations in the Drosophila Antennal Lobe
Wilson, R. I., Turner, G. C., & Laurent, G. (2004) · Science · doi:10.1126/science.1090782 · Cited by 554
Odor Representations in Olfactory Cortex: “Sparse” Coding, Global Inhibition, and Oscillations
Poo, C., & Isaacson, J. S. (2009) · Neuron · doi:10.1016/j.neuron.2009.05.022 · Cited by 464
Population imaging of ongoing neuronal activity in the visual cortex of awake rats
Greenberg, D. S., Houweling, A. R., & Kerr, J. N. D. (2008) · Nature Neuroscience · doi:10.1038/nn.2140 · Cited by 404
Vehicle Type Classification Using a Semisupervised Convolutional Neural Network
Dong, Z., Wu, Y., Pei, M., & Jia, Y. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2402438 · Cited by 387
Oxytocin enhances social recognition by modulating cortical control of early olfactory processing
Oettl, L.-L., Ravi, N., Schneider, M., Scheller, M. F., Schneider, P., Mitre, M., da Silva Gouveia, M., Froemke, R. C., Chao, M. V., Young, W. S., et al. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.033 · Cited by 359
Sparse, decorrelated odor coding in the mushroom body enhances learned odor discrimination
Lin, A. C., Bygrave, A. M., de Calignon, A., Lee, T., & Miesenböck, G. (2014) · Nature Neuroscience · doi:10.1038/nn.3660 · Cited by 321
Auto-Encoders in Deep Learning—A Review with New Perspectives
Chen, S., & Guo, W. (2023) · Mathematics · doi:10.3390/math11081777 · Cited by 318
Representational drift in primary olfactory cortex
Schoonover, C. E., Ohashi, S. N., Axel, R., & Fink, A. J. P. (2021) · Nature · doi:10.1038/s41586-021-03628-7 · Cited by 313
A natural approach to studying vision
Felsen, G., & Dan, Y. (2005) · Nature Neuroscience · doi:10.1038/nn1608 · Cited by 285
Haider, B., Krause, M. R., Duque, A., Yu, Y., Touryan, J., Mazer, J. A., & McCormick, D. A. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.005 · Cited by 263
A bidirectional circuit switch reroutes pheromone signals in male and female brains
Kohl, J., Ostrovsky, A. D., Frechter, S., & Jefferis, G. S. X. E. (2013) · Cell · doi:10.1016/j.cell.2013.11.025 · Cited by 188
Functional Maps of Mechanosensory Features in the Drosophila Brain
Patella, P., & Wilson, R. I. (2018) · Current Biology · doi:10.1016/j.cub.2018.02.074 · Cited by 92
Representation and transformation of sensory information in the mouse accessory olfactory system
Meeks, J. P., Arnson, H. A., & Holy, T. E. (2010) · Nature Neuroscience · doi:10.1038/nn.2546 · Cited by 85
Coding of the contrasts in natural images by populations of neurons in primary visual cortex (V1)
Clatworthy, P. L., Chirimuuta, M., Lauritzen, J. S., & Tolhurst, D. J. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00277-3 · Cited by 54
Self-citationArousal regulates frequency tuning in primary auditory cortex
Lin, P.-A., Asinof, S. K., Edwards, N. J., & Isaacson, J. S. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911383116 · Cited by 51
“Similar results were obtained using lifetime sparseness (18) (Friedman’s ANOVA, P < 0.”
ResultRosales Jubal, E., Schwalm, M., dos Santos Guilherme, M., Schuck, F., Reinhardt, S., Tose, A., Barger, Z., Roesler, M. K., Ruffini, N., Wierczeiko, A., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-85912-0 · Cited by 30
Dora, S., Bohte, S. M., & Pennartz, C. M. A. (2021) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2021.666131 · Cited by 24
Willmore, B. D. B., Bulstrode, H., & Tolhurst, D. J. (2012) · Vision Research · doi:10.1016/j.visres.2011.12.008 · Cited by 10
Self-citation
Metadata
- Authors
- Willmore, B., & Tolhurst, D. J.
- Venue
- Network: Computation in Neural Systems
- Publisher
- Informa UK Limited
- Published
- 2001-01
- Volume
- 12
- Issue
- 3
- Pages
- 255-270
- ISSN
- 0954-898X (ISSN-L)
- 1361-6536
- OpenAlex
- W4240046814
- Cited by
- 229
- References
- 5
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.