Shape representation in the inferior temporal cortex of monkeys
Open accessAbstract
Background The inferior temporal cortex (IT) of the monkey has long been known to play an essential role in visual object recognition. Damage to this area results in severe deficits in perceptual learning and object recognition, without significantly affecting basic visual capacities. Consistent with these ablation studies is the discovery of IT neurons that respond to complex two-dimensional visual patterns, or objects such as faces or body parts. What is the role of these neurons in object recognition? Is such a complex configurational selectivity specific to biologically meaningful objects, or does it develop as a result of extensive exposure to any objects whose identification relies on subtle shape differences? If so, would IT neurons respond selectively to recently learned views of features of novel objects? The present study addresses this question by using combined psychophysical and electrophysiological experiments, in which monkeys learned to classify and recognize computer-generated three-dimensional objects.Results A population of IT neurons was found that responded selectively to views of previously unfamiliar objects. The cells discharged maximally to one view of an object, and their response declined gradually as the object was rotated away from this preferred view. No selective responses were ever encountered for views that the animal systematically failed to recognize. Most neurons also exhibited orientation-dependent responses during view-plane rotations. Some neurons were found to be tuned around two views of the same object, and a very small number of cells responded in a view-invariant manner. For the five different objects that were used extensively during the training of the animals, and for which behavioral performance became view-independent, multiple cells were found that were tuned around different views of the same object. A number of view-selective units showed response invariance for changes in the size of the object or the position of its image within the parafovea.Conclusion Our results suggest that IT neurons can develop a complex receptive field organization as a consequence of extensive training in the discrimination and recognition of objects. None of these objects had any prior meaning for the animal, nor did they resemble anything familiar in the monkey's environment. Simple geometric features did not appear to account for the neurons' selective responses. These findings support the idea that a population of neurons--each tuned to a different object aspect, and each showing a certain degree of invariance to image transformations--may, as an ensemble, encode at least some types of complex three-dimensional objects. In such a system, several neurons may be active for any given vantage point, with a single unit acting like a blurred template for a limited neighborhood of a single view.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
IT neurons are able to learn new arbitrary shapes and arbitrary pairings of stimuli.
“IT neurons are able to learn new arbitrary shapes (Logothetis et al., 1995), and arbitrary pairings of stimuli (Sakai and Miyashita, 1991), which might be an analogue of learning letters and of linking arbitrarily related upper- and lowercase letters.”
From Specialization within the ventral stream: the case for the visual word form area (2004) · cites this paper as Logothetis et al., 1995
From V1 to IT, there is an increase in invariance to position and scale and, in parallel, an increase in the size of the receptive fields and in the complexity of the optimal stimuli for the neurons.
“From V1 to IT, there is an increase in invariance to position and scale (1, 2, 4-6) and in parallel, an increase in the size of the receptive fields (2, 4) as well as in the complexity of the optimal stimuli for the neurons (2, 3, 7).”
From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [6]
Plasticity and learning are probably present at all stages and certainly at the level of IT and PFC.
“Finally, plasticity and learning are probably present at all stages and certainly at the level of IT (6) and PFC.”
From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [6]
Cites
Recognition-by-components: A theory of human image understanding.
Biederman, I. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.115 · Cited by 5,621 · see citing works
Face recognition: features versus templates
Brunelli, R., & Poggio, T. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.254061 · Cited by 2,452 · see citing works
Self-citationVisual properties of neurons in inferotemporal cortex of the Macaque.
Gross, C. G., Rocha‐Miranda, C. E., & Bender, D. B. (1972) · Journal of Neurophysiology · doi:10.1152/jn.1972.35.1.96 · Cited by 1,488 · see citing works
Stimulus-selective properties of inferior temporal neurons in the macaque
Desimone, R., Albright, T. D., Gross, C. G., & Bruce, C. J. (1984) · Journal of Neuroscience · doi:10.1523/jneurosci.04-08-02051.1984 · Cited by 1,424 · see citing works
Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque.
Bruce, C. J., Desimone, R., & Gross, C. G. (1981) · Journal of Neurophysiology · doi:10.1152/jn.1981.46.2.369 · Cited by 1,230 · see citing works
Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks
Poggio, T., & Girosi, F. (1990) · Science · doi:10.1126/science.247.4945.978 · Cited by 1,024 · see citing works
Self-citationVisual cells in the temporal cortex sensitive to face view and gaze direction
Perrett, D. I., Smith, P., Potter, D. D., Mistlin, A. J., Head, A., Milner, A. D., & Jeeves, M. A. (1985) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1985.0003 · Cited by 932 · see citing works
A network that learns to recognize three-dimensional objects
Poggio, T., & Edelman, S. (1990) · Nature · doi:10.1038/343263a0 · Cited by 930 · see citing works
Self-citationMental rotation and orientation-dependence in shape recognition
Tarr, M. J., & Pinker, S. A. (1989) · Cognitive Psychology · doi:10.1016/0010-0285(89)90009-1 · Cited by 798 · see citing works
Coding visual images of objects in the inferotemporal cortex of the macaque monkey
Tanaka, K., Saito, H., Fukada, Y., & Moriya, M. (1991) · Journal of Neurophysiology · doi:10.1152/jn.1991.66.1.170 · Cited by 773 · see citing works
Neuronal correlate of visual associative long-term memory in the primate temporal cortex
Miyashita, Y. (1988) · Nature · doi:10.1038/335817a0 · Cited by 741 · see citing works
Psychophysical support for a two-dimensional view interpolation theory of object recognition.
Bülthoff, H., & Edelman, S. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.1.60 · Cited by 685 · see citing works
Columns for visual features of objects in monkey inferotemporal cortex
Fujita, I., Tanaka, K., Ito, M., & Cheng, K. (1992) · Nature · doi:10.1038/360343a0 · Cited by 623 · see citing works
Frameworks of analysis for the neural representation of animate objects and actions
Perrett, D. I., Harries, M. H., Bevan, R., Thomas, S. M., Benson, P. J., Mistlin, A. J., Chitty, A. J., Hietanen, J. K., & Ortega, J. E. (1989) · Journal of Experimental Biology · doi:10.1242/jeb.146.1.87 · Cited by 609 · see citing works
Aligning pictorial descriptions: An approach to object recognition
Ullman, S. (1989) · Cognition · doi:10.1016/0010-0277(89)90036-x · Cited by 562 · see citing works
Richmond, B. J., Optican, L. M., Podell, M., & Spitzer, H. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.132 · Cited by 428 · see citing works
Orientation dependence in the recognition of familiar and novel views of three-dimensional objects
Edelman, S., & Bülthoff, H. (1992) · Vision Research · doi:10.1016/0042-6989(92)90102-o · Cited by 424 · see citing works
View-dependent object recognition by monkeys
Logothetis, N. K., Pauls, J., Bülthoff, H., & Poggio, T. (1994) · Current Biology · doi:10.1016/s0960-9822(00)00089-0 · Cited by 344 · see citing works
Self-citationRolls, E. T. (1984) · PubMed · Cited by 334 · see citing works
Shape recognition and inferior temporal neurons.
Schwartz, E., Desimone, R., Albright, T. D., & Gross, C. G. (1983) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.80.18.5776 · Cited by 328 · see citing works
Rolls, E. T., & Baylis, G. C. (1986) · Experimental Brain Research · doi:10.1007/bf00243828 · Cited by 311 · see citing works
Wachsmuth, E., Oram, M. W., & Perrett, D. I. (1994) · Cerebral Cortex · doi:10.1093/cercor/4.5.509 · Cited by 278 · see citing works
SPECIFIC READING DISABILITY— STREPHOSYMBOLIA
Orton, S. T. (1928) · JAMA · doi:10.1001/jama.1928.02690410007003 · Cited by 262 · see citing works
When does Human Object Recognition use a Viewer-Centered Reference Frame?
Tarr, M. J., & Pinker, S. A. (1990) · Psychological Science · doi:10.1111/j.1467-9280.1990.tb00209.x · Cited by 206 · see citing works
What facial features activate face neurons in the inferotemporal cortex of the monkey?
Yamane, S., Kaji, S., & Kawano, K. (1988) · Experimental Brain Research · doi:10.1007/bf00279674 · Cited by 202 · see citing works
A case of viewer-centered object perception
Rock, I., & DiVita, J. C. (1987) · Cognitive Psychology · doi:10.1016/0010-0285(87)90013-2 · Cited by 200 · see citing works
Can recognotion of living things be selectively impaired?
Farah, M. J., McMullen, P. A., & Meyer, M. M. (1991) · Neuropsychologia · doi:10.1016/0028-3932(91)90020-9 · Cited by 187 · see citing works
Tovée, M. J., Rolls, E. T., & Azzopardi, P. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.3.1049 · Cited by 185 · see citing works
The importance of symmetry and virtual views in three-dimensional object recognition
Vetter, T., Poggio, T., & Bülthoff, H. (1994) · Current Biology · doi:10.1016/s0960-9822(00)00004-x · Cited by 136 · see citing works
Self-citationPerceptual similarity of mirror images in infancy
Bornstein, M. H., Gross, C. G., & Wolf, J. Z. (1978) · Cognition · doi:10.1016/0010-0277(78)90017-3 · Cited by 113 · see citing works
Response properties of neurons in temporal cortical visual areas of infant monkeys
Rodman, H. R., Scalaidhe, S. P., & Gross, C. G. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.3.1115 · Cited by 93 · see citing works
A stereotaxic brain atlas for Macaca nemestrina
Winters, W. D., Kado, R. T., & ADEY, W. R. (1969) · University of California Press eBooks · Cited by 82 · see citing works
Winding one's Ps and Qs: Mental rotation and mirror-image discrimination.
Corballis, M. C., & McLaren, R. (1984) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.10.2.318 · Cited by 71 · see citing works
Some Significance Tests for the Median which are Valid Under Very General Conditions
Walsh, J. E. (1949) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730091 · Cited by 64 · see citing works
Left and Right in Science and Art
Gross, C. G., & Bornstein, M. H. (1978) · Leonardo · doi:10.2307/1573500 · Cited by 60 · see citing works
The effect on form perception of change of orientation in the third dimension.
Rock, I., di Vita, J., & Barbeito, R. (1981) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.7.4.719 · Cited by 52 · see citing works
The effect on form perception of change of orientation in the third dimension.
Rock, I., di Vita, J., & Barbeito, R. (1981) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.7.4.719 · Cited by 50 · see citing works
Winding one's Ps and Qs: Mental rotation and mirror-image discrimination.
Corballis, M. C., & McLaren, R. (1984) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.10.2.318 · Cited by 48 · see citing works
Article Commentary: Orientation-Dependent Mechanisms in Shape Recognition: Further Issues
Tarr, M. J., & Pinker, S. A. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00135.x · Cited by 43 · see citing works
Applications of Some Significance Tests for the Median Which are Valid Under Very General Conditions
Walsh, J. E. (1949) · Journal of the American Statistical Association · doi:10.1080/01621459.1949.10483311 · Cited by 31 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · see citing works
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · see citing works
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733 · see citing works
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · see citing works
Self-citationNeuronal Synchrony: A Versatile Code for the Definition of Relations?
Singer, W. (1999) · Neuron · doi:10.1016/s0896-6273(00)80821-1 · Cited by 2,581 · see citing works
Invariant visual representation by single neurons in the human brain
Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C., & Fried, I. (2005) · Nature · doi:10.1038/nature03687 · Cited by 1,988 · see citing works
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · see citing works
Robust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667 · see citing works
Self-citationUsing goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621 · see citing works
Visual long-term memory has a massive storage capacity for object details
Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803390105 · Cited by 1,106 · see citing works
Categorical Representation of Visual Stimuli in the Primate Prefrontal Cortex
Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2001) · Science · doi:10.1126/science.291.5502.312 · Cited by 1,123 · see citing works
Self-citationDomain specificity in face perception
Kanwisher, N. (2000) · Nature Neuroscience · doi:10.1038/77664 · Cited by 968 · see citing works
Neural mechanisms for the recognition of biological movements
Giese, M. A., & Poggio, T. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1057 · Cited by 955 · see citing works
Self-citationA feedforward architecture accounts for rapid categorization
Serre, T., Oliva, A., & Poggio, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700622104 · Cited by 918 · see citing works
Self-citationFast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854 · see citing works
Self-citationSpecialization within the ventral stream: the case for the visual word form area
Cohen, L., & Dehaene, S. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.049 · Cited by 776 · see citing works
Freiwald, W. A., & Tsao, D. Y. (2010) · Science · doi:10.1126/science.1194908 · Cited by 678 · see citing works
Visuo-haptic object-related activation in the ventral visual pathway
Amedi, A., Malach, R., Hendler, T., Peled, S., & Zohary, E. (2001) · Nature Neuroscience · doi:10.1038/85201 · Cited by 630 · see citing works
Eccentricity bias as an organizing principle for human high-order object areas
Hasson, U., Levy, I., Behrmann, M., Hendler, T., & Malach, R. (2002) · Neuron · doi:10.1016/s0896-6273(02)00662-1 · Cited by 578 · see citing works
Visual features of intermediate complexity and their use in classification
Ullman, S., Vidal-Naquet, M., & Sali, E. (2002) · Nature Neuroscience · doi:10.1038/nn870 · Cited by 600 · see citing works
von der Malsburg, C. (1999) · Neuron · doi:10.1016/s0896-6273(00)80825-9 · Cited by 501 · see citing works
The Effect of Perceptual Learning on Neuronal Responses in Monkey Visual Area V4
Yang, T., & Maunsell, J. H. R. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.4442-03.2004 · Cited by 427 · see citing works
Salinas, E., & Thier, P. (2000) · Neuron · doi:10.1016/s0896-6273(00)00004-0 · Cited by 400 · see citing works
Single units and conscious vision
The American Association for Research into Nervous and Mental Diseases, & Logothetis, N. K. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0333 · Cited by 375 · see citing works
Self-citationTowards a unifying neural theory of social cognition
Keysers, C., & Gazzola, V. (2006) · Progress in Brain Research · doi:10.1016/s0079-6123(06)56021-2 · Cited by 367 · see citing works
Effects of early and late nocturnal sleep on priming and spatial memory
Plihal, W., & Born, J. (1999) · Psychophysiology · doi:10.1111/1469-8986.3650571 · Cited by 364 · see citing works
Tanaka, K. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.1.90 · Cited by 329 · see citing works
Seeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338 · see citing works
Global Workspace Dynamics: Cortical “Binding and Propagation” Enables Conscious Contents
Baars, B. J., Franklin, S., & Ramsoy, T. Z. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00200 · Cited by 294 · see citing works
Impact of learning on representation of parts and wholes in monkey inferotemporal cortex
Baker, C. I., Behrmann, M., & Olson, C. R. (2002) · Nature Neuroscience · doi:10.1038/nn960 · Cited by 293 · see citing works
Effects of Visual Experience on the Representation of Objects in the Prefrontal Cortex
Rainer, G., & Miller, E. K. (2000) · Neuron · doi:10.1016/s0896-6273(00)00019-2 · Cited by 285 · see citing works
Learning optimized features for hierarchical models of invariant object recognition.
Wersing, H., & Körner, E. (2003) · Neural Computation · doi:10.1162/089976603321891800 · Cited by 169 · see citing works
Rates and rhythms: a synergistic view of frequency and temporal coding in neuronal networks
Ainsworth, M., Lee, S., Cunningham, M. O., Traub, R. D., Kopell, N. J., & Whittington, M. A. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.004 · Cited by 149 · see citing works
Developmental neuroimaging of the human ventral visual cortex
Grill-Spector, K., Golarai, G., & Gabrieli, J. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.01.009 · Cited by 147 · see citing works
Predicting the visual world: silence is golden
Koch, C., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/4511 · Cited by 141 · see citing works
Self-citationGomez, J., Barnett, M., & Grill-Spector, K. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0592-8 · Cited by 81 · see citing works
Effects of temporal context and temporal expectancy on neural activity in inferior temporal cortex
Anderson, B., & Sheinberg, D. L. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.11.025 · Cited by 65 · see citing works
“What” and “Where” in Word Reading: Ventral Coding of Written Words Revealed by Parietal Atrophy
Vinckier, F., Naccache, L., Papeix, C., Forget, J., Hahn-Barma, V., Dehaene, S., & Cohen, L. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.12.1998 · Cited by 69 · see citing works
Montijn, J. S., Goltstein, P. M., & Pennartz, C. M. (2015) · eLife · doi:10.7554/elife.10163 · Cited by 46 · see citing works
Brucklacher, M., Bohté, S. M., Mejias, J. F., & Pennartz, C. M. A. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1207361 · Cited by 15 · see citing works
“, 2005), inferotemporal cortex of rhesus (Desimone et al., 1984; Logothetis et al., 1995) and macaque monkeys (Freiwald and Tsao, 2010) as well as rats’ laterolateral extrastriate area (LL) (Tafazoli et al.”
Background
- Authors
- Logothetis, N. K., Pauls, J., & Poggio, T.
- Affiliations
- Baylor College of Medicine (US)
- Massachusetts Institute of Technology (US)
- Corresponding author
- Poggio, Tomaso
- Venue
- Current Biology
- Publisher
- Elsevier BV
- Published
- 1995-05
- Volume
- 5
- Issue
- 5
- Pages
- 552-563
- ISSN
- 0960-9822 (ISSN-L)
- OpenAlex
- W2142756981
- Cited by
- 963
- References
- 40
- Citations by year
- 2026: 7 · 2025: 17 · 2024: 15 · 2023: 11 · 2022: 11 · 2021: 24 · 2020: 18 · 2019: 33 · 2018: 20 · 2017: 19 · 2016: 36 · 2015: 24 · 2014: 48 · 2013: 35 · 2012: 39
- FWCI
- 12.54
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Current Biology (publishedVersion)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National Institutes of Health (5r01ey010089-03)
- National Eye Institute (1R01EY10089-01)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- inferior temporal cortex, object recognition, shape representation, perceptual learning, orientation selectivity, viewpoint invariance, receptive field organization, visual object classification
- MeSH terms
- Animals, Form Perception, Image Processing, Computer-Assisted, Macaca mulatta, Neurons, Temporal Lobe
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review