The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Selectivity and Tolerance (“Invariance”) Both Increase as Visual Information Propagates from Cortical Area V4 to IT
Open accessAbstract
Our ability to recognize objects despite large changes in position, size, and context is achieved through computations that are thought to increase both the shape selectivity and the tolerance (“invariance”) of the visual representation at successive stages of the ventral pathway [visual cortical areas V1, V2, and V4 and inferior temporal cortex (IT)]. However, these ideas have proven difficult to test. Here, we consider how well population activity patterns at two stages of the ventral stream (V4 and IT) discriminate between, and generalize across, different images. We found that both V4 and IT encode natural images with similar fidelity, whereas the IT population is much more sensitive to controlled, statistical scrambling of those images. Scrambling sensitivity was proportional to receptive field (RF) size in both V4 and IT, suggesting that, on average, the number of visual feature conjunctions implemented by a V4 or IT neuron is directly related to its RF size. We also found that the IT population could better discriminate between objects across changes in position, scale, and context, thus directly demonstrating a V4-to-IT gain in tolerance. This tolerance gain could be accounted for by both a decrease in single-unit sensitivity to identity-preserving transformations (e.g., an increase in RF size) and an increase in the maintenance of rank-order object selectivity within the RF. These results demonstrate that, as visual information travels from V4 to IT, the population representation is reformatted to become more selective for feature conjunctions and more tolerant to identity preserving transformations, and they reveal the single-unit response properties that underlie that reformatting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1966) · Medical Entomology and Zoology · Cited by 10,293
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 1×
“…magnetic resonance imaging (fMRI) results in monkey extrastriate visual cortex (Denys et al., 2004) and are likely analogous to findings that regions of human high-level visual cortex produce more robust fMRI signals to intact objects compared with scrambled images (Kanwisher et al., 1996, 1997).”
ResultFukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759 · cited 1×
“…but instead that increasing RF phenomenology is likely a reflection of more sophisticated computations designed for the discrimination of objects invariant of identity-preserving image transformations (Fukushima, 1980; Riesenhuber and Poggio, 1999; DiCarlo and Cox, 2007; Serre et al., 2007).”
BackgroundHierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · cited 2×
“The crux of the object recognition problem lies in the ability to produce a representation that can selectively identify individual objects in a manner that is essentially tolerant (“invariant”) to changes in position, size, and context (Riesenhuber and Poggio, 1999; DiCarlo and Cox, 2007).”
BackgroundRECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT
Hubel, D. H., & Wiesel, T. N. (1965) · Journal of Neurophysiology · doi:10.1152/jn.1965.28.2.229 · Cited by 2,603
The analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958
A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients
Portilla, J., & Simoncelli, E. P. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026553619983 · Cited by 1,806 · cited 3×
“This confirms that the algorithm successfully converged for the images we included in this study and that the scrambled version of each image is much closer to its natural counterpart than to all other images in the set [when measured in a Portilla and Simoncelli (2000) image basis].”
MethodInfluentialRobust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667
Stimulus-selective properties of inferior temporal neurons in the macaque
Desimone, R., Albright, T., Gross, C., & Bruce, C. (1984) · The Journal of Neuroscience · doi:10.1523/jneurosci.04-08-02051.1984 · Cited by 1,423
Inferotemporal cortex and object vision
Tanaka, K. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.000545 · Cited by 1,402
Logothetis, N. K., & Sheinberg, D. L. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.003045 · Cited by 1,351
Untangling invariant object recognition
DiCarlo, J. J., & Cox, D. D. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.06.010 · Cited by 959
Self-citationFast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
Self-citationKobatake, E., & Tanaka, K. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.71.3.856 · Cited by 807
Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form
Desimone, R., & Schein, S. J. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.3.835 · Cited by 680
Visuotopic organization and extent of V3 and V4 of the macaque
Gattass, R., Sousa, A., & Gross, C. (1988) · The Journal of Neuroscience · doi:10.1523/jneurosci.08-06-01831.1988 · Cited by 676
Visual categorization shapes feature selectivity in the primate temporal cortex
Sigala, N., & Logothetis, N. K. (2002) · Nature · doi:10.1038/415318a · Cited by 559
Responses to Contour Features in Macaque Area V4
Pasupathy, A., & Connor, C. E. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.82.5.2490 · Cited by 547
Selectivity for Polar, Hyperbolic, and Cartesian Gratings in Macaque Visual Cortex
Gallant, J. L., Braun, J., & Van Essen, D. C. (1993) · Science · doi:10.1126/science.8418487 · Cited by 525
Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex
Rolls, E. T., & Tovee, M. J. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.2.713 · Cited by 500
Size and position invariance of neuronal responses in monkey inferotemporal cortex
Ito, M., Tamura, H., Fujita, I., & Tanaka, K. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.1.218 · Cited by 430
Dynamic Population Coding of Category Information in Inferior Temporal and Prefrontal Cortex
Meyers, E. M., Freedman, D. J., Kreiman, G., Miller, E. K., & Poggio, T. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90248.2008 · Cited by 419
Spatial Structure and Symmetry of Simple-Cell Receptive Fields in Macaque Primary Visual Cortex
Ringach, D. L. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.1.455 · Cited by 403
Underlying principles of visual shape selectivity in posterior inferotemporal cortex
Brincat, S. L., & Connor, C. E. (2004) · Nature Neuroscience · doi:10.1038/nn1278 · Cited by 385
Shape recognition and inferior temporal neurons.
Schwartz, E. L., Desimone, R., Albright, T. D., & Gross, C. G. (1983) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.80.18.5776 · Cited by 327
Object Selectivity of Local Field Potentials and Spikes in the Macaque Inferior Temporal Cortex
Kreiman, G., Hung, C. P., Kraskov, A., Quiroga, R. Q., Poggio, T., & DiCarlo, J. J. (2006) · Neuron · doi:10.1016/j.neuron.2005.12.019 · Cited by 310
Self-citationImpact of learning on representation of parts and wholes in monkey inferotemporal cortex
Baker, C. I., Behrmann, M., & Olson, C. R. (2002) · Nature Neuroscience · doi:10.1038/nn960 · Cited by 293 · cited 2×
“…were not asked to discriminate between different scrambled images; given the plasticity known to exist at higher stages of visual processing (Baker et al., 2002; Sigala and Logothetis, 2002; Kourtzi and DiCarlo, 2006; Li and DiCarlo, 2008), it remains an open question as to how well IT…”
BackgroundA neural code for three-dimensional object shape in macaque inferotemporal cortex
Yamane, Y., Carlson, E. T., Bowman, K. C., Wang, Z., & Connor, C. E. (2008) · Nature Neuroscience · doi:10.1038/nn.2202 · Cited by 292
Spatial sensitivity of macaque inferior temporal neurons
Op De Beeck, H., & Vogels, R. (2000) · The Journal of Comparative Neurology · doi:10.1002/1096-9861(20001030)426:4<505::aid-cne1>3.0.co;2-m · Cited by 278
Spatial frequency and orientation tuning dynamics in area V1
Mazer, J. A., Vinje, W. E., McDermott, J., Schiller, P. H., & Gallant, J. L. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.022638499 · Cited by 276
Denys, K., Vanduffel, W., Fize, D., Nelissen, K., Peuskens, H., Van Essen, D., & Orban, G. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3569-03.2004 · Cited by 268
Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex
Li, N., & DiCarlo, J. J. (2008) · Science · doi:10.1126/science.1160028 · Cited by 263
Self-citationPsychophysical and Physiological Evidence for Viewer-centered Object Representations in the Primate
Logothetis, N. K., & Pauls, J. (1995) · Cerebral Cortex · doi:10.1093/cercor/5.3.270 · Cited by 261
Functional imaging of human visual recognition
Kanwisher, N., Chun, M. M., McDermott, J., & Ledden, P. J. (1996) · Cognitive Brain Research · doi:10.1016/s0926-6410(96)00041-9 · Cited by 250
Neurons in monkey visual area V2 encode combinations of orientations
Anzai, A., Peng, X., & Van Essen, D. C. (2007) · Nature Neuroscience · doi:10.1038/nn1975 · Cited by 244 · cited 4×
“…of evidence have already suggested that conjunction sensitivity increases across the ventral visual stream (Desimone et al., 1984; Gallant et al., 1993; Kobatake and Tanaka, 1994; Pasupathy and Connor, 1999; Vogels, 1999; Brincat and Connor, 2004; Anzai et al., 2007; Hegdé and Van Essen, 2007).”
BackgroundInfluentialMultiple Object Response Normalization in Monkey Inferotemporal Cortex
Zoccolan, D., Cox, D. D., & DiCarlo, J. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-05.2005 · Cited by 218
Self-citationTovee, M. J., Rolls, E. T., & Azzopardi, P. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.3.1049 · Cited by 184
A Comparative Study of Shape Representation in Macaque Visual Areas V2 and V4
Hegdé, J., & Van Essen, D. C. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl020 · Cited by 172
Coding of color and form in the geniculostriate visual pathway (invited review)
Lennie, P., & Movshon, J. A. (2005) · Journal of the Optical Society of America A · doi:10.1364/josaa.22.002013 · Cited by 170
Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex
Zoccolan, D., Kouh, M., Poggio, T., & DiCarlo, J. J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1897-07.2007 · Cited by 169
Self-citationSawamura, H., Georgieva, S., Vogels, R., Vanduffel, W., & Orban, G. A. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0377-05.2005 · Cited by 158
Coding of Shape and Position in Macaque Lateral Intraparietal Area
Janssen, P., Srivastava, S., Ombelet, S., & Orban, G. A. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.0499-08.2008 · Cited by 114
Learning and neural plasticity in visual object recognition
Kourtzi, Z., & DiCarlo, J. J. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.012 · Cited by 108
Self-citationForm representation in monkey inferotemporal cortex is virtually unaltered by free viewing
DiCarlo, J. J., & Maunsell, J. H. R. (2000) · Nature Neuroscience · doi:10.1038/77722 · Cited by 105
Self-citationLi, N., Cox, D., Zoccolan, D., & DiCarlo, J. J. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90745.2008 · Cited by 105
Self-citationResponses of monkey inferior temporal neurons to luminance-, motion-, and texture-defined gratings
Sáry, G., Vogels, R., Kovacs, G., et al. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.4.1341 · Cited by 91
Processing of Kinetic Boundaries in Macaque V4
Mysore, S. G., Vogels, R., Raiguel, S. E., & Orban, G. A. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00627.2005 · Cited by 63
Effect of image scrambling on inferior temporal cortical responses
Vogels, R. (1999) · Neuroreport · doi:10.1097/00001756-199906230-00002 · Cited by 50
Cited by
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Self-citationHow does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
Self-citationUsing goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Self-citationWagemans, J., Elder, J. H., Kubovy, M., Palmer, S. E., Peterson, M. A., Singh, M., & von der Heydt, R. (2012) · Psychological Bulletin · doi:10.1037/a0029333 · Cited by 1,539
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Metadata
- Authors
- Rust, N. C., & DiCarlo, J. J.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2010-09-29
- Volume
- 30
- Issue
- 39
- Pages
- 12978-12995
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1990037101
- Cited by
- 387
- References
- 49
- FWCI
- 8.51
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.