Measuring sparseness in the brain: Comment on Bowers (2009).
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Bowers challenged the common view in favor of distributed representations in psychological modeling and the main arguments given against localist and grandmother cell coding schemes. He revisited the results of several single-cell studies, arguing that they do not support distributed representations. We praise the contribution of Bowers (2009) for joining evidence from psychological modeling and neurophysiological recordings, but we disagree with several of his claims. In this comment, we argue that distinctions between distributed, localist, and grandmother cell coding can be troublesome with real data. Moreover, these distinctions seem to be lying within the same continuum, and we argue that it may be sensible to characterize coding schemes with a sparseness measure. We further argue that there may not be a unique coding scheme implemented in all brain areas and for all possible functions. In particular, current evidence suggests that the brain may use distributed codes in primary sensory areas and sparser and invariant representations in higher areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“…modeling (McClelland, Rumelhart, & Group, 1986; Rumelhart, McClelland, & Group, 1986)—for related ideas in theoretical neuroscience, see Hopfield (1982, 2007)—and coarse coding schemes, that is, distributed codes in which single neurons have broad tuning curves, such that a single…”
BackgroundRecognition-by-components: A theory of human image understanding.
Biederman, I. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.115 · Cited by 5,621 · cited 2×
“Furthermore, assuming that a typical person can recognize between 10,000 and 30,000 objects (Biederman, 1987), we estimated that each neuron fires in response to 50–150 different objects (Waydo et al.”
Unsupervised spike detection and sorting with wavelets and superparamagnetic clustering
Quiroga, R. Q., Nadasdy, Z., & Ben-Shaul, Y. (2004) · Neural Computation · doi:10.1162/089976604774201631 · Cited by 2,119
Self-citationInvariant visual representation by single neurons in the human brain
Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C., & Fried, I. (2005) · Nature · doi:10.1038/nature03687 · Cited by 1,988 · cited 4×
“It is indeed not uncommon to find very selective MTL neurons firing to more than one person or object, as shown in Figure 1 (for more examples see Quian Quiroga et al., 2005).”
InfluentialSelf-citationSparse coding of sensory inputs
Olshausen, B. A., & Field, D. J. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.07.007 · Cited by 1,404 · cited 2×
“…sparseness refers to the fraction of neurons of a population that respond in a given time window and (b) lifetime sparseness refers to the relative number of stimuli to which a neuron responds to (Olshausen & Field, 2004; Quian Quiroga, Reddy, Koch, & Fried, 2007; Willmore & Tolhurst, 2001).”
Inferotemporal cortex and object vision
Tanaka, K. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.000545 · Cited by 1,402
Norman, K. A., & O'Reilly, R. C. (2003) · Psychological Review · doi:10.1037/0033-295x.110.4.611 · Cited by 1,312
Fast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
Self-citation
Cited by
Concept cells: the building blocks of declarative memory functions
Quiroga, R. Q. (2012) · Nature reviews. Neuroscience · doi:10.1038/nrn3251 · Cited by 472
Self-citationAre there any ‘object detectors’ in the hidden layers of CNNs trained to identify objects or scenes?
Gale, E. M., Martin, N., Blything, R., Nguyen, A., & Bowers, J. S. (2020) · Vision Research · doi:10.1016/j.visres.2020.06.007 · Cited by 16
Transient localist representations in critical branching networks
Rodny, J. J., Shea, T. M., & Kello, C. T. (2017) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2016.1242760 · Cited by 4
“They interpreted their results as indicative of a sparse code (Quiroga, Kreiman, Koch, & Fried, 2008), which is a coding scheme relatively similar to localist representation with respect to the distributed-localist debate (Quiroga & Kreiman, 2010).”
Background
Metadata
- Authors
- Quian Quiroga, R., & Kreiman, G.
- Venue
- Psychological Review
- Published
- 2010
- Volume
- 117
- Issue
- 1
- Pages
- 291-297
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2125138707
- Cited by
- 67
- References
- 8
- FWCI
- 2.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.