Hierarchical models of object recognition in cortex
Abstract
Visual processing in cortex is classically modeled as a hierarchy of increasingly sophisticated representations, naturally extending the model of simple to complex cells of Hubel and Wiesel. Surprisingly, little quantitative modeling has been done to explore the biological feasibility of this class of models to explain aspects of higher-level visual processing such as object recognition. We describe a new hierarchical model consistent with physiological data from inferotemporal cortex that accounts for this complex visual task and makes testable predictions. The model is based on a MAX-like operation applied to inputs to certain cortical neurons that may have a general role in cortical function.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Visual systems have a convolutional nature (the same computations are applied to each pixel of the visual input).
“One hallmark of visual systems that has been widely exploited in such tasks is their convolutional nature66–69 (that is, the fact that the same computations are applied to each pixel of the visual input).”
From Connectome-constrained networks predict neural activity across the fly visual system (2024) · cites this paper as [68]
The computational requirements for invariant recognition are largely common to the recognition of any type of visual objects.
“Those computational requirements are largely common to the recognition of any type of visual objects: Tools, buildings, or faces can all appear with huge variations in their appearance, including size, location, orientation, and so on.”
From Specialization within the ventral stream: the case for the visual word form area (2004) · cites this paper as Riesenhuber and Poggio, 1999
From V1 to IT, there is an increase in invariance to position and scale and, in parallel, an increase in the size of the receptive fields and in the complexity of the optimal stimuli for the neurons.
“From V1 to IT, there is an increase in invariance to position and scale (1, 2, 4-6) and in parallel, an increase in the size of the receptive fields (2, 4) as well as in the complexity of the optimal stimuli for the neurons (2, 3, 7).”
From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [5]
Plausible biophysical circuits may implement the two key operations assumed by the theory within the time constraints of the experimental data.
“In addition, plausible biophysical circuits may implement the two key operations (5) assumed by the theory within the time constraints of the experimental data (8).”
From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [5]
The model accounts for the bypass routes from V2 to the posterior inferotemporal cortex and from V4 to the anterior inferotemporal cortex, unlike the original model.
“In addition to the main routes through the V4 to the IT cortex (4), the model also accounts for the bypass routes (38) from V2 to the posterior inferotemporal cortex and from V4 to the anterior inferotemporal cortex (Fig. 1) [unlike the original model (5)].”
From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [5]
The new model implementation used in this study improves the original model in two significant ways.
“The new model implementation used in this study improves the original model (5) in two significant ways.”
From A feedforward architecture accounts for rapid categorization (2007) · cites this paper as [5]
Cites
Advances in neural information processing systems 7
Cios, K. J., & Shields, M. E. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,089 · see citing works
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,759 · see citing works
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680 · see citing works
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759 · see citing works
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · see citing works
Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Christof Koch, A., & Ullman, S. (1987) · Springer eBooks · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,739 · see citing works
Neural network-based face detection
Rowley, H. A., Baluja, S., & Kanade, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655647 · Cited by 3,554 · see citing works
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538 · see citing works
RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT
Hubel, D. H., & Wiesel, T. N. (1965) · Journal of Neurophysiology · doi:10.1152/jn.1965.28.2.229 · Cited by 2,615 · see citing works
Selective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (1985) · Science · doi:10.1126/science.4023713 · Cited by 2,433 · see citing works
Selective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (2003) · The MIT Press eBooks · doi:10.7551/mitpress/2834.003.0024 · Cited by 2,164 · see citing works
‘What’ and ‘where’ in the human brain
Ungerleider, L. G., & Haxby, J. V. (1994) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(94)90066-3 · Cited by 1,913 · cited 1× · see citing works
“, the highest purely visual area in the ventral visual stream thought to have a key role in object recognitio”
BackgroundNormalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835 · see citing works
Example-based learning for view-based human face detection
Sung, K. K., & Poggio, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655648 · Cited by 1,779 · see citing works
Self-citationSynaptic depression and cortical gain control
Abbott, L. F., Varela, J. A., Sen, K., & Nelson, S. B. (1997) · Science · doi:10.1126/science.275.5297.221 · Cited by 1,690 · see citing works
Nonlinear neural networks: Principles, mechanisms, and architectures
Grossberg, S. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90021-4 · Cited by 1,623 · see citing works
Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4
Reynolds, J. H., Chelazzi, L., & Desimone, R. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01736.1999 · Cited by 1,236 · see citing works
Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque.
Bruce, C. J., Desimone, R., & Gross, C. G. (1981) · Journal of Neurophysiology · doi:10.1152/jn.1981.46.2.369 · Cited by 1,230 · see citing works
On the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074 · see citing works
Recurrent Excitation in Neocortical Circuits
Douglas, R. J., Christof Koch, A., Mahowald, M. A., Martin, K. A. C., & Suarez, H. H. (1995) · Science · doi:10.1126/science.7638624 · Cited by 985 · see citing works
Shape representation in the inferior temporal cortex of monkeys
Logothetis, N. K., Pauls, J., & Poggio, T. (1995) · Current Biology · doi:10.1016/s0960-9822(95)00108-4 · Cited by 963 · see citing works
Self-citationA network that learns to recognize three-dimensional objects
Poggio, T., & Edelman, S. (1990) · Nature · doi:10.1038/343263a0 · Cited by 930 · see citing works
Self-citationOn the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929 · see citing works
Olshausen, B., Anderson, C., & Van Essen, D. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-11-04700.1993 · Cited by 908 · see citing works
Kobatake, E., & Tanaka, K. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.71.3.856 · Cited by 807 · see citing works
Psychophysical support for a two-dimensional view interpolation theory of object recognition.
Bülthoff, H., & Edelman, S. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.1.60 · Cited by 685 · see citing works
Learning invariance from transformation sequences
Földiák, P. (1991) · Neural Computation · doi:10.1162/neco.1991.3.2.194 · Cited by 661 · see citing works
INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM
Wallis, G. M., & Rolls, E. T. (1997) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00054-8 · Cited by 539 · see citing works
Tarr, M. J. (1995) · Psychonomic Bulletin & Review · doi:10.3758/bf03214412 · Cited by 470 · see citing works
View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex
Booth, M. J. (1998) · Cerebral Cortex · doi:10.1093/cercor/8.6.510 · Cited by 464 · see citing works
Attention activates winner-take-all competition among visual filters
Lee, D. K., Itti, L., Christof Koch, A., & Braun, J. (1999) · Nature Neuroscience · doi:10.1038/7286 · Cited by 458 · see citing works
Spatial Attention Effects in Macaque Area V4
Connor, C. E., Preddie, D. C., Gallant, J. L., & Van Essen, D. C. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-09-03201.1997 · Cited by 448 · see citing works
View-dependent object recognition by monkeys
Logothetis, N. K., Pauls, J., Bülthoff, H., & Poggio, T. (1994) · Current Biology · doi:10.1016/s0960-9822(00)00089-0 · Cited by 344 · see citing works
Self-citationMel, B. W. (1997) · Neural Computation · doi:10.1162/neco.1997.9.4.777 · Cited by 341 · see citing works
Effects of Shape-Discrimination Training on the Selectivity of Inferotemporal Cells in Adult Monkeys
Kobatake, E., Wang, G., & Tanaka, K. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.324 · Cited by 329 · see citing works
Viewer-centred and object-centred coding of heads in the macaque temporal cortex
Perrett, D. I., Oram, M. W., Harries, M. H., Bevan, R., Hietanen, J. K., Benson, P. J., & Thomas, S. M. (1991) · Experimental Brain Research · doi:10.1007/bf00231050 · Cited by 291 · see citing works
Shifter circuits: a computational strategy for dynamic aspects of visual processing.
Anderson, C. H., & Essen, D. C. V. (1987) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.84.17.6297 · Cited by 278 · see citing works
Neurophysiology of shape processing
Perrett, D. I., & Oram, M. W. (1993) · Image and Vision Computing · doi:10.1016/0262-8856(93)90011-5 · Cited by 213 · see citing works
Figure-ground discrimination by relative movement in the visual system of the fly
Reichardt, W., Poggio, T., & Hausen, K. (1983) · Biological Cybernetics · doi:10.1007/bf00595226 · Cited by 213 · see citing works
Self-citationA selection model for motion processing in area MT of primates
Nowlan, S., & Sejnowski, T. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-02-01195.1995 · Cited by 206 · see citing works
Complex cells as cortically amplified simple cells
Chance, F. S., Nelson, S. B., & Abbott, L. F. (1999) · Nature Neuroscience · doi:10.1038/6381 · Cited by 196 · see citing works
Are Cortical Models Really Bound by the “Binding Problem”?
Riesenhuber, M., & Poggio, T. (1999) · Neuron · doi:10.1016/s0896-6273(00)80824-7 · Cited by 192 · see citing works
Self-citationCategorization of complex visual images by rhesus monkeys. Part 2: single‐cell study
Vogels, R. (1999) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.1999.00531.x · Cited by 173 · see citing works
Rolls, E. T., & Tovée, M. J. (1995) · Experimental Brain Research · doi:10.1007/bf00241500 · Cited by 153 · see citing works
Functional architecture in monkey inferotemporal cortex revealed by in vivo optical imaging
Wang, G., Tanifuji, M., & Tanaka, K. (1998) · Neuroscience Research · doi:10.1016/s0168-0102(98)00062-5 · Cited by 141 · see citing works
Invariant Visual Responses From Attentional Gain Fields
Salinas, E., & Abbott, L. F. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.6.3267 · Cited by 129 · see citing works
Sato, T. (1989) · Experimental Brain Research · doi:10.1007/bf00250563 · Cited by 125 · see citing works
Object vision and visual awareness
Logethetis, N. (1998) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(98)80043-3 · Cited by 82 · see citing works
Responses of macaque inferior temporal neurons to overlapping shapes
Missal, M. (1997) · Cerebral Cortex · doi:10.1093/cercor/7.8.758 · Cited by 50 · see citing works
Learning Invariance from Transformation Sequences
Földiák, P. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/7011.003.0006 · Cited by 43 · see citing works
RECEPTIVE FIELDS, BINOCULAR AND FUNCTIONAL ARCHITECTURE IN THE CAT’S VISUAL CORTEX
Hubel, D. H., & Wiesel, T. N. (1962) · Cited by 30 · see citing works
Just One View: Invariances in Inferotemporal Cell Tuning
Riesenhuber, M., & Poggio, T. (1997) · Cited by 25 · see citing works
Self-citationNeural Models for Part-Whole Hierarchies
Riesenhuber, M., & Dayan, P. (1996) · MPG.PuRe (Max Planck Society) · Cited by 14 · see citing works
Self-citationModeling Invariances in Inferotemporal Cell Tuning
Riesenhuber, M., & Poggio, T. (1998) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 7 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570 · see citing works
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733 · see citing works
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120 · see citing works
Neuronal Synchrony: A Versatile Code for the Definition of Relations?
Singer, W. (1999) · Neuron · doi:10.1016/s0896-6273(00)80821-1 · Cited by 2,581 · see citing works
Gallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566 · see citing works
NEURONAL CIRCUITS OF THE NEOCORTEX
Douglas, R. J., & Martin, K. A. C. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144152 · Cited by 1,886 · see citing works
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · see citing works
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906 · see citing works
Integrated information theory: from consciousness to its physical substrate
Tononi, G., Boly, M., Massimini, M., & Koch, C. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.44 · Cited by 1,727 · see citing works
Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks
Katz, G., Barrett, C., Dill, D. L., Julian, K., & Kochenderfer, M. J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-63387-9_5 · Cited by 1,706 · see citing works
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695 · see citing works
Robust Object Recognition with Cortex-Like Mechanisms
Serre, T., Wolf, L., Bileschi, S., Riesenhuber, M., & Poggio, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.56 · Cited by 1,667 · see citing works
Self-citationUsing goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621 · see citing works
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557 · see citing works
Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536 · see citing works
The Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457 · see citing works
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204 · see citing works
Hinton, G. E., Krizhevsky, A., & Wang, S. D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_6 · Cited by 1,360 · see citing works
Top-down influences on visual processing
Gilbert, C. D., & Li, W. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3476 · Cited by 1,224 · see citing works
Language‐specific tuning of visual cortex? Functional properties of the Visual Word Form Area
Cohen, L., Lehéricy, S., Chochon, F., Lemer, C., Rivaud, S., & Dehaene, S. (2002) · Brain · doi:10.1093/brain/awf094 · Cited by 1,254 · see citing works
Kriegeskorte, N. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035447 · Cited by 1,093 · see citing works
Visual long-term memory has a massive storage capacity for object details
Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803390105 · Cited by 1,106 · see citing works
Multi-column deep neural network for traffic sign classification
Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.023 · Cited by 1,057 · see citing works
The Distributed Nature of Working Memory
Christophel, T. B., Klink, P. C., Spitzer, B., Roelfsema, P. R., & Haynes, J.-D. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.12.007 · Cited by 882 · see citing works
Neural mechanisms for the recognition of biological movements
Giese, M. A., & Poggio, T. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1057 · Cited by 955 · see citing works
Self-citationA feedforward architecture accounts for rapid categorization
Serre, T., Oliva, A., & Poggio, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700622104 · Cited by 918 · see citing works
Self-citationHierarchical organization of cortical and thalamic connectivity
Harris, J. A., Mihalas, S., Hirokawa, K. E., Whitesell, J. D., Choi, H., Bernard, A., Bohn, P., Caldejon, S., Casal, L., Cho, A., et al. (2019) · Nature · doi:10.1038/s41586-019-1716-z · Cited by 785 · see citing works
Fast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854 · see citing works
Self-citationCichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A. (2016) · Scientific Reports · doi:10.1038/srep27755 · Cited by 716 · see citing works
Fadlullah, Z. M., Tang, F., Mao, B., Kato, N., Akashi, O., Inoue, T., & Mizutani, K. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2707140 · Cited by 810 · see citing works
Specialization within the ventral stream: the case for the visual word form area
Cohen, L., & Dehaene, S. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.049 · Cited by 776 · see citing works
Freiwald, W. A., & Tsao, D. Y. (2010) · Science · doi:10.1126/science.1194908 · Cited by 678 · see citing works
Metamers of the ventral stream
Freeman, J., & Simoncelli, E. P. (2011) · Nature Neuroscience · doi:10.1038/nn.2889 · Cited by 667 · see citing works
Electronic skins and machine learning for intelligent soft robots
Shih, B., Shah, D., Li, J., Thuruthel, T. G., Park, Y.-L., Iida, F., Bao, Z., Kramer-Bottiglio, R., & Tolley, M. T. (2020) · Science Robotics · doi:10.1126/scirobotics.aaz9239 · Cited by 715 · see citing works
Statistical learning of new visual feature combinations by infants
Fiser, J., & Aslin, R. N. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.232472899 · Cited by 637 · see citing works
The Code for Facial Identity in the Primate Brain
Chang, L., & Tsao, D. Y. (2017) · Cell · doi:10.1016/j.cell.2017.05.011 · Cited by 644 · see citing works
Visual features of intermediate complexity and their use in classification
Ullman, S., Vidal-Naquet, M., & Sali, E. (2002) · Nature Neuroscience · doi:10.1038/nn870 · Cited by 600 · see citing works
Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review
Poggio, T., Mhaskar, H., Rosasco, L., Miranda, B., & Liao, Q. (2017) · International Journal of Automation and Computing · doi:10.1007/s11633-017-1054-2 · Cited by 559 · see citing works
Self-citationA review of visual memory capacity: Beyond individual items and toward structured representations
Brady, T. F., Konkle, T., & Alvarez, G. A. (2011) · Journal of Vision · doi:10.1167/11.5.4 · Cited by 556 · see citing works
Population coding of shape in area V4
Pasupathy, A., & Connor, C. E. (2002) · Nature Neuroscience · doi:10.1038/972 · Cited by 552 · see citing works
Face Recognition Performance: Role of Demographic Information
Klare, B. F., Burge, M. J., Klontz, J. C., Vorder Bruegge, R. W., & Jain, A. K. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2214212 · Cited by 516 · see citing works
“One reason Gabor features are popular for representing both facial and natural images is their similarity with human neurological receptor fields [30], [31].”
The Marabou Framework for Verification and Analysis of Deep Neural Networks
Katz, G., Huang, D. A., Ibeling, D., Julian, K., Lazarus, C., Lim, R., Shah, P., Thakoor, S., Wu, H., Zeljić, A., et al. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-25540-4_26 · Cited by 517 · see citing works
von der Malsburg, C. (1999) · Neuron · doi:10.1016/s0896-6273(00)80825-9 · Cited by 501 · see citing works
GREENE, M., & OLIVA, A. (2009) · Cognitive Psychology · doi:10.1016/j.cogpsych.2008.06.001 · Cited by 467 · see citing works
Shape Representation in Area V4: Position-Specific Tuning for Boundary Conformation
Pasupathy, A., & Connor, C. E. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.5.2505 · Cited by 483 · see citing works
The connectome of an insect brain
Winding, M., Pedigo, B. D., Barnes, C. L., Patsolic, H. G., Park, Y., Kazimiers, T., Fushiki, A., Andrade, I. V., Khandelwal, A., Valdes-Aleman, J., et al. (2023) · Science · doi:10.1126/science.add9330 · Cited by 435 · see citing works
Yovel, G., & Kanwisher, N. (2004) · Neuron · doi:10.1016/j.neuron.2004.11.018 · Cited by 450 · see citing works
A Sensorimotor Circuit in Mouse Cortex for Visual Flow Predictions
Leinweber, M., Ward, D. R., Sobczak, J. M., Attinger, A., & Keller, G. B. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.036 · Cited by 375 · see citing works
A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives
Haynes, J.-D. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.025 · Cited by 402 · see citing works
Towards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404 · see citing works
Evaluating the neurophysiological evidence for predictive processing as a model of perception
Walsh, K. S., McGovern, D. P., Clark, A., & O'Connell, R. G. (2020) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14321 · Cited by 333 · see citing works
Seeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338 · see citing works
Reading normal and degraded words: Contribution of the dorsal and ventral visual pathways.
Cohen, L., Dehaene, S., Vinckier, F., Jobert, A., & Montavont, A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.036 · Cited by 303 · see citing works
Sparse coding based visual tracking: Review and experimental comparison
Zhang, S., Yao, H., Sun, X., & Lu, X. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.10.006 · Cited by 284 · see citing works
A neurobiological theory of automaticity in perceptual categorization
Ashby, F. G., Ennis, J. M., & Spiering, B. J. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.632 · Cited by 286 · see citing works
Ponce, C. R., Xiao, W., Schade, P. F., Hartmann, T. S., Kreiman, G., & Livingstone, M. S. (2019) · Cell · doi:10.1016/j.cell.2019.04.005 · Cited by 245 · see citing works
Integrative benchmarking to advance neurally mechanistic models of human intelligence
Schrimpf, M., Kubilius, J., Lee, M. J., Ratan Murty, N. A., Ajemian, R., & DiCarlo, J. J. (2020) · Neuron · doi:10.1016/j.neuron.2020.07.040 · Cited by 233 · see citing works
The neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233 · see citing works
Heeger, D. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1619788114 · Cited by 220 · see citing works
Neurons in monkey visual area V2 encode combinations of orientations
Anzai, A., Peng, X., & Van Essen, D. C. (2007) · Nature Neuroscience · doi:10.1038/nn1975 · Cited by 244 · see citing works
Active inference on discrete state-spaces: A synthesis
Da Costa, L., Parr, T., Sajid, N., Veselic, S., Neacsu, V., & Friston, K. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102447 · Cited by 226 · see citing works
“Winner take-all architectures of decision-making are already commonplace in computational neuroscience (e.g., models of selective attention and recognition [133, 134], hierarchical models of vision [135]).”
BackgroundSwietojanski, P., & Renals, S. (2014) · 2014 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078569 · Cited by 218 · see citing works
Hamker, F. H. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh146 · Cited by 217 · see citing works
The neural bases of spatial frequency processing during scene perception
Kauffmann, L., Ramanoël, S., & Peyrin, C. (2014) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2014.00037 · Cited by 210 · see citing works
Mismatch Receptive Fields in Mouse Visual Cortex
Zmarz, P., & Keller, G. B. (2016) · Neuron · doi:10.1016/j.neuron.2016.09.057 · Cited by 178 · see citing works
Carneiro, G., Georgescu, B., Good, S., & Comaniciu, D. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2008.928917 · Cited by 205 · see citing works
Deep neural networks in computational neuroscience
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2019) · Oxford Research Encyclopedia of Neuroscience · doi:10.1093/acrefore/9780190264086.013.46 · Cited by 186 · see citing works
Learning Race from Face: A Survey
Fu, S., He, H., & Hou, Z.-G. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2321570 · Cited by 178 · see citing works
Rapid protein stability prediction using deep learning representations
Blaabjerg, L. M., Kassem, M. M., Good, L. L., Jonsson, N., Cagiada, M., Johansson, K. E., Boomsma, W., Stein, A., & Lindorff-Larsen, K. (2023) · eLife · doi:10.7554/elife.82593 · Cited by 177 · see citing works
Learning optimized features for hierarchical models of invariant object recognition.
Wersing, H., & Körner, E. (2003) · Neural Computation · doi:10.1162/089976603321891800 · Cited by 169 · see citing works
Higgins, I., Chang, L., Langston, V., Hassabis, D., Summerfield, C., Tsao, D., & Botvinick, M. (2021) · Nature Communications · doi:10.1038/s41467-021-26751-5 · Cited by 162 · see citing works
A model of the ventral visual system based on temporal stability and local memory
Wyss, R., König, P., & Verschure, P. F. M. J. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040120 · Cited by 145 · see citing works
Visual Selective Behavior Can Be Triggered by a Feed-Forward Process
VanRullen, R., & Koch, C. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321208141 · Cited by 140 · see citing works
Lampl, I., Ferster, D., Poggio, T., & Riesenhuber, M. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00060.2004 · Cited by 139 · see citing works
Self-citationEncoding of Stimulus Probability in Macaque Inferior Temporal Cortex
Bell, A. H., Summerfield, C., Morin, E. L., Malecek, N. J., & Ungerleider, L. G. (2016) · Current Biology · doi:10.1016/j.cub.2016.07.007 · Cited by 118 · see citing works
A social Bayesian brain: how social knowledge can shape visual perception
Otten, M., Seth, A. K., & Pinto, Y. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2016.05.002 · Cited by 124 · see citing works
Responses of Primate Visual Cortical V4 Neurons to Simultaneously Presented Stimuli
Gawne, T. J., & Martin, J. M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.3.1128 · Cited by 134 · see citing works
Connectome-constrained networks predict neural activity across the fly visual system
Lappalainen, J. K., Tschopp, F. D., Prakhya, S., McGill, M., Nern, A., Shinomiya, K., Takemura, S.-Y., Gruntman, E., Macke, J. H., & Turaga, S. C. (2024) · Nature · doi:10.1038/s41586-024-07939-3 · Cited by 128 · see citing works
Incremental grouping of image elements in vision
Roelfsema, P. R., & Houtkamp, R. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-011-0200-0 · Cited by 112 · see citing works
Learning the invariance properties of complex cells from their responses to natural stimuli
Einhäuser, W., Kayser, C., König, P., & Körding, K. P. (2002) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01885.x · Cited by 91 · see citing works
Computational mechanisms underlying cortical responses to the affordance properties of visual scenes
Bonner, M. F., & Epstein, R. A. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006111 · Cited by 94 · see citing works
Segregation of feedforward and feedback projections in mouse visual cortex
Berezovskii, V. K., Nassi, J. J., & Born, R. T. (2011) · Journal of Comparative Neurology · doi:10.1002/cne.22675 · Cited by 84 · see citing works
Samaha, J., Boutonnet, B., Postle, B. R., & Lupyan, G. (2018) · Scientific Reports · doi:10.1038/s41598-018-25093-5 · Cited by 80 · see citing works
Neural representational geometry underlies few-shot concept learning
Sorscher, B., Ganguli, S., & Sompolinsky, H. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2200800119 · Cited by 78 · see citing works
The empirical status of predictive coding and active inference
Hodson, R., Mehta, M., & Smith, R. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105473 · Cited by 69 · see citing works
“What” and “Where” in Word Reading: Ventral Coding of Written Words Revealed by Parietal Atrophy
Vinckier, F., Naccache, L., Papeix, C., Forget, J., Hahn-Barma, V., Dehaene, S., & Cohen, L. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.12.1998 · Cited by 69 · see citing works
Higher performers upregulate brain signal variability in response to more feature-rich visual input
Garrett, D. D., Epp, S. M., Kleemeyer, M., Lindenberger, U., & Polk, T. A. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116836 · Cited by 48 · see citing works
Model metamers reveal divergent invariances between biological and artificial neural networks
Feather, J., Leclerc, G., Mądry, A., & McDermott, J. H. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01442-0 · Cited by 59 · see citing works
Generative models for active vision
Parr, T., Sajid, N., Da Costa, L., Mirza, M. B., & Friston, K. J. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2021.651432 · Cited by 46 · see citing works
Learning and disrupting invariance in visual recognition with a temporal association rule
Isik, L., Leibo, J. Z., & Poggio, T. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00037 · Cited by 38 · see citing works
Self-citationLappalainen, J. K., Tschopp, F. D., Prakhya, S., McGill, M., Nern, A., Shinomiya, K., Takemura, S.-Y., Gruntman, E., Macke, J. H., & Turaga, S. C. (2023) · doi:10.1101/2023.03.11.532232 · Cited by 31 · see citing works
Investigations of face expertise in the social developmental disorders
Barton, J. J. S., Hefter, R. L., Cherkasova, M. V., & Manoach, D. S. (2007) · Neurology · doi:10.1212/01.wnl.0000267842.85646.f2 · Cited by 29 · see citing works
The brain of the beholder: honouring individual representational idiosyncrasies
Charest, I., & Kriegeskorte, N. (2015) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2014.1002505 · Cited by 27 · see citing works
Dora, S., Bohte, S. M., & Pennartz, C. M. A. (2021) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2021.666131 · Cited by 24 · see citing works
Attentional Recruitment of Inter-Areal Recurrent Networks for Selective Gain Control
Hahnloser, R. H. R., Douglas, R. J., & Hepp, K. (2002) · Neural Computation · doi:10.1162/08997660260028665 · Cited by 18 · see citing works
Brucklacher, M., Bohté, S. M., Mejias, J. F., & Pennartz, C. M. A. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1207361 · Cited by 15 · see citing works
“Here, combination of receptive field-like local filters with a pooling mechanism (Riesenhuber and Poggio, 1999) may be helpful to become tolerant to the varying configurations of individual features comprising the objects from the same class.”
Background
- Authors
- Riesenhuber, M., & Poggio, T.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Poggio, Tomaso
- Venue
- Nature Neuroscience
- Published
- 1999-11-01
- Volume
- 2
- Issue
- 11
- Pages
- 1019-1025
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2149194912
- Cited by
- 3,309
- References
- 54
- Citations by year
- 2026: 68 · 2025: 86 · 2024: 91 · 2023: 100 · 2022: 117 · 2021: 167 · 2020: 152 · 2019: 159 · 2018: 136 · 2017: 156 · 2016: 195 · 2015: 193 · 2014: 233 · 2013: 200 · 2012: 217
- FWCI
- 24.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- object recognition, hierarchical models, inferotemporal cortex, cortical neurons, biological plausibility, visual cortex
- MeSH terms
- Animals, Computer Simulation, Form Perception, Macaca, Models, Neurological, Neurons, Mental Recall, Visual Cortex, Visual Fields
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review