Unsupervised Natural Visual Experience Rapidly Reshapes Size-Invariant Object Representation in Inferior Temporal Cortex
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Summary We easily recognize objects and faces across a myriad of retinal images produced by each object. One hypothesis is that this tolerance (a.k.a. “invariance”) is learned by relying on the fact that object identities are temporally stable. While we previously found neuronal evidence supporting this idea at the top of the non-human primate ventral visual stream (inferior temporal cortex, IT), we here test if this is a general tolerance learning mechanism. First, we found that the same type of unsupervised experience that reshaped IT position tolerance also predictably reshaped IT size tolerance, and the magnitude of reshaping was quantitatively similar. Second, this tolerance reshaping can be induced under naturally occurring dynamic visual experience, even without eye movements. Third, unsupervised temporal contiguous experience can build new neuronal tolerance. These results suggest that the ventral visual stream uses a general unsupervised tolerance learning (UTL) algorithm to build its invariant object representation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
Self-citationNeural organization for the long-term memory of paired associates
Sakai, K., & Miyashita, Y. (1991) · Nature · doi:10.1038/354152a0 · Cited by 743 · cited 3×
“Previous neurophysiological investigations in the monkey ventral visual stream showed that IT and perirhinal neurons could learn to give similar responses to temporally nearby stimuli when instructed by reward (i.e., so-called ‘‘paired associate’’ learning; Messinger et al., 2001; Miyashita, 1988; Sakai and Miyashita,…”
Learning invariance from transformation sequences
Földiák, P. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.194 · Cited by 661 · cited 5×
“…contiguity of object features during natural visual experience can instruct the learning of tolerance, potentially in an unsupervised manner (Foldiak, 1991; Masquelier et al., 2007; Masquelier and Thorpe, 2007; Sprekeler et al., 2007; Stryker, 1991; Wiskott and Sejnowski, 2002; Wyss et al.,…”
InfluentialA synaptic memory trace for cortical receptive field plasticity
Froemke, R. C., Merzenich, M. M., & Schreiner, C. E. (2007) · Nature · doi:10.1038/nature06289 · Cited by 600 · cited 2×
“, 2009) and physiological evidence (Baker et al., 2002; Freedman and Assad, 2006; Froemke et al., 2007; Goard and Dan, 2009; Law and Gold, 2008) both suggest that reward is an important factor that can modulate or gate learning.”
Phenomenological models of synaptic plasticity based on spike timing
Morrison, A., Diesmann, M., & Gerstner, W. (2008) · Biological Cybernetics · doi:10.1007/s00422-008-0233-1 · Cited by 593
Experience-dependent representation of visual categories in parietal cortex
Freedman, D. J., & Assad, J. A. (2006) · Nature · doi:10.1038/nature05078 · Cited by 542 · cited 2×
“, 2009) and physiological evidence (Baker et al., 2002; Freedman and Assad, 2006; Froemke et al., 2007; Goard and Dan, 2009; Law and Gold, 2008) both suggest that reward is an important factor that can modulate or gate learning.”
Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area
Law, C.-T., & Gold, J. I. (2008) · Nature Neuroscience · doi:10.1038/nn2070 · Cited by 516
Microstimulation of inferotemporal cortex influences face categorization
Afraz, S.-R., Kiani, R., & Esteky, H. (2006) · Nature · doi:10.1038/nature04982 · Cited by 363 · cited 3×
“1062 Neuron 67, 1062–1075, September 23, 2010 a2010 Elsevier Inc and Orban, 1996), reasonably sized populations of these socalled ‘‘tolerant’’ neurons can support object recognition tasks (Afraz et al., 2006; Hung et al., 2005; Li et al., 2009).”
Rewards evoke learning of unconsciously processed visual stimuli in adult humans
Seitz, A. R., Kim, D., & Watanabe, T. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.016 · Cited by 337
Impact of learning on representation of parts and wholes in monkey inferotemporal cortex
Baker, C. I., Behrmann, M., & Olson, C. R. (2002) · Nature Neuroscience · doi:10.1038/nn960 · Cited by 293 · cited 3×
“, 2009) and physiological evidence (Baker et al., 2002; Freedman and Assad, 2006; Froemke et al., 2007; Goard and Dan, 2009; Law and Gold, 2008) both suggest that reward is an important factor that can modulate or gate learning.”
A model of the ventral visual system based on temporal stability and local memory
Wyss, R., König, P., & Verschure, P. F. M. J. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040120 · Cited by 145
Cited by
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
“…and sizes can rapidly and strongly reshape the position and size tolerance of IT neurons—destroying existing tolerance and building new tolerance, depending on the provided visual experience statistics (Li and DiCarlo, 2008, 2010), and predictably modifying object perception (Cox et al., 2005).”
Self-citationDeep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Characterizing the dynamics of mental representations: the temporal generalization method
King, J.-R., & Dehaene, S. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.002 · Cited by 919
Cadieu, C. F., Hong, H., Yamins, D. L. K., Pinto, N., Ardila, D., Solomon, E. A., Majaj, N. J., & DiCarlo, J. J. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003963 · Cited by 824
“IT cortex have been observed [52–54], even during passive viewing [55].”
BackgroundSelf-citationGrossberg, S. (2013) · Neural Networks · doi:10.1016/j.neunet.2012.09.017 · Cited by 410
Metadata
- Authors
- Li, N., & DiCarlo, J. J.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2010-09
- Volume
- 67
- Issue
- 6
- Pages
- 1062-1075
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W1973836515
- Cited by
- 130
- References
- 11
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.