Object representations in the human brain reflect the co-occurrence statistics of vision and language
Open accessPublished version of a preprint
The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Abstract
A central regularity of visual perception is the co-occurrence of objects in the natural environment. Here we use machine learning and fMRI to test the hypothesis that object co-occurrence statistics are encoded in the human visual system and elicited by the perception of individual objects. We identified low-dimensional representations that capture the latent statistical structure of object co-occurrence in real-world scenes, and we mapped these statistical representations onto voxel-wise fMRI responses during object viewing. We found that cortical responses to single objects were predicted by the statistical ensembles in which they typically occur, and that this link between objects and their visual contexts was made most strongly in parahippocampal cortex, overlapping with the anterior portion of scene-selective parahippocampal place area. In contrast, a language-based statistical model of the co-occurrence of object names in written text predicted responses in neighboring regions of object-selective visual cortex. Together, these findings show that the sensory coding of objects in the human brain reflects the latent statistics of object context in visual and linguistic experience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, recent studies have found a striking representational alignment between a wide variety of ANNs and the human brain, despite their having different architectures, network initializations, learning objectives, and even different modalities such as language and vision [12,15–22]”
From The Umwelt Representation Hypothesis: rethinking Universality (2026) · cites this paper as [15]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
A cortical representation of the local visual environment
Epstein, R., & Kanwisher, N. (1998) · Nature · doi:10.1038/33402 · Cited by 2,984
Self-citationNatural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
Cited by
Hafri, A., & Firestone, C. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.01.006 · Cited by 124
High-level visual representations in the human brain are aligned with large language models
Doerig, A., Kietzmann, T. C., Allen, E., Wu, Y., Naselaris, T., Kay, K., & Charest, I. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01072-0 · Cited by 173
“Studies of the neural basis of object context and relations have provided insight into the role of object co-occurrence statistics 16,17 , spatial and semantic interrelations among objects 18–21 , the context in which objects appear 22 and their typical locations in scenes 23–26 .”
Predictive processing of scenes and objects
Peelen, M. V., Berlot, E., & de Lange, F. P. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00254-0 · Cited by 101
“Moreover, voxelwise parahippocampal place area responses are more similar for isolated objects that are typically found in the same scene context than for objects that are found in different scene contexts 66 .”
How Does the “Default Mode” Network Contribute to Semantic Cognition?
Fernandino, L., & Binder, J. R. (2024) · Brain and Language · doi:10.1016/j.bandl.2024.105405 · Cited by 73
Three cortical scene systems and their development
Dilks, D. D., Kamps, F. S., & Persichetti, A. S. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.11.002 · Cited by 72
“, with stronger responses or information processing in the anterior portion than the posterior one) [56,68,69].”
Background
Metadata
- Authors
- Bonner, M. F., & Epstein, R. A.
- Affiliations
- Johns Hopkins University (US)
- University of Pennsylvania (US)
- Corresponding author
- Bonner, Michael F.
- Venue
- Nature Communications
- Published
- 2021-07-02
- Volume
- 12
- Issue
- 1
- Pages
- 4081-4081
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC8253839
- OpenAlex
- W3174137462
- Cited by
- 96
- References
- 76
- Citations by year
- 2026: 15 · 2025: 17 · 2024: 18 · 2023: 25 · 2022: 14 · 2021: 7
- FWCI
- 8.41
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Communications (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- National Institutes of Health (EY022350)
- National Eye Institute (R01EY022350, P30EY001583)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- statistical learning, object representation, parahippocampal place area, scene-selective cortex, visual context, language statistics, natural scene statistics, object perception
- MeSH terms
- Adult, Brain, Brain Mapping, Female, Humans, Language, Magnetic Resonance Imaging, Pattern Recognition, Visual, Perception, Visual Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Object representations in the human brain reflect the co-occurrence statistics of vision and language. https://app.cochat.ai/papers/10.1038/s41467-021-24368-2
- The paper
- Bonner, M. F., & Epstein, R. A. (2021). Object representations in the human brain reflect the co-occurrence statistics of vision and language. Nature Communications. https://doi.org/10.1038/s41467-021-24368-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.