The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Open accessAbstract
Significance: Humans and monkeys easily recognize objects in scenes. This ability is known to be supported by a network of hierarchically interconnected brain areas. However, understanding neurons in higher levels of this hierarchy has long remained a major challenge in visual systems neuroscience. We use computational techniques to identify a neural network model that matches human performance on challenging object categorization tasks. Although not explicitly constrained to match neural data, this model turns out to be highly predictive of neural responses in both the V4 and inferior temporal cortex, the top two layers of the ventral visual hierarchy. In addition to yielding greatly improved models of visual cortex, these results suggest that a process of biological performance optimization directly shaped neural mechanisms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is problematic, since CNNs are being used as computational models for human object recognition (e.g. Cadieu et al., 2014; Yamins et al., 2014).”
From ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness (2018) · cites this paper as Yamins et al., 2014
In the citing paper
“Analogous approaches have proven successful in relating the structure of neural activity to computational functions in other domains, including vision 17–19, audition 20, olfaction 21,22, thermosensation 23, perceptual discrimination 24, facial perception 25, and navigation 26,27.”
From A virtual rodent predicts the structure of neural activity across behaviours (2024) · cites this paper as [17]
In the citing paper
“This suggests that more performant models exhibit representations more similar to those of both DLS and MC, consistent with previous reports comparing neural activity with task-optimized neural networks 17,20.”
From A virtual rodent predicts the structure of neural activity across behaviours (2024) · cites this paper as [17]
In the citing paper
“Neural networks also show substantial alignment with biological representations in the brain (Yamins et al., 2014).”
From The Platonic Representation Hypothesis (2024) · cites this paper as Yamins et al., 2014
In the citing paper
“Task-optimized artificial neural network models, for instance of mammalian visual pathways22, have previously demonstrated only a coarse correspondence of the population neural activity between model layers and brain regions.”
From Connectome-constrained networks predict neural activity across the fly visual system (2024) · cites this paper as [22]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Marr, D. (1982) · Cumulative Index of Computer Aided Architectural Design · Cited by 5,733
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Preface: Cerebral Cortex Has Come of Age
Goldman-Rakic, P. S., & Rakic, P. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1-a · Cited by 3,393
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
Self-citationThe lateral occipital complex and its role in object recognition
Grill-Spector, K., Kourtzi, Z., & Kanwisher, N. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00073-6 · Cited by 1,406
Inferotemporal cortex and object vision
Tanaka, K. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.000545 · Cited by 1,402
Cited by
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
A Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Self-citationDeep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Metadata
- Authors
- Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J.
- Affiliations
- McGovern Institute for Brain Research (US)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2014-05-08
- Volume
- 111
- Issue
- 23
- Pages
- 8619-8624
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC4060707
- OpenAlex
- W2058616551
- Cited by
- 1,924
- References
- 39
- Citations by year
- 2026: 157 · 2025: 215 · 2024: 206 · 2023: 196 · 2022: 199 · 2021: 209 · 2020: 180 · 2019: 174 · 2018: 127 · 2017: 111 · 2016: 92 · 2015: 41 · 2014: 17
- FWCI
- 48.54
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- Funders
- National Science Foundation (0964269)
- National Eye Institute (F32EY022845, R01EY014970)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Keywords
- inferior temporal cortex, ventral stream, object recognition, neural response prediction, performance optimization, biologically plausible models, naturalistic images
- MeSH terms
- Algorithms, Animals, Humans, Macaca mulatta, Models, Neurological, Nerve Net, Photic Stimulation, Psychomotor Performance, Visual Cortex, Visual Pathways, Visual Perception, Neural Networks, Computer, Recognition, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance-optimized hierarchical models predict neural responses in higher visual cortex. https://app.cochat.ai/papers/10.1073/pnas.1403112111
- The paper
- Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014). Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1403112111
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.