Contributions of low- and high-level properties to neural processing of visual scenes in the human brain
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Visual scene analysis in humans has been characterized by the presence of regions in extrastriate cortex that are selectively responsive to scenes compared with objects or faces. While these regions have often been interpreted as representing high-level properties of scenes (e.g. category), they also exhibit substantial sensitivity to low-level (e.g. spatial frequency) and mid-level (e.g. spatial layout) properties, and it is unclear how these disparate findings can be united in a single framework. In this opinion piece, we suggest that this problem can be resolved by questioning the utility of the classical low- to high-level framework of visual perception for scene processing, and discuss why low- and mid-level properties may be particularly diagnostic for the behavioural goals specific to scene perception as compared to object recognition. In particular, we highlight the contributions of low-level vision to scene representation by reviewing (i) retinotopic biases and receptive field properties of scene-selective regions and (ii) the temporal dynamics of scene perception that demonstrate overlap of low- and mid-level feature representations with those of scene category. We discuss the relevance of these findings for scene perception and suggest a more expansive framework for visual scene analysis. This article is part of the themed issue ‘Auditory and visual scene analysis’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Using goal-driven deep learning models to understand sensory cortex
Yamins, D. L. K., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4244 · Cited by 1,621
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
The role of context in object recognition
Oliva, A., & Torralba, A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.009 · Cited by 1,063
Guclu, U., & van Gerven, M. A. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5023-14.2015 · Cited by 961
How does nature program neuron types?
Borst, A. (2008) · Frontiers in Neuroscience · doi:10.3389/neuro.01.016.2008 · Cited by 705
Where am I now? Distinct roles for parahippocampal and retrosplenial cortices in place recognition
Epstein, R. A., Parker, W. E., & Feiler, A. M. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0799-07.2007 · Cited by 331
Anchoring the neural compass: coding of local spatial reference frames in human medial parietal lobe
Marchette, S. A., Vass, L. K., Ryan, J., & Epstein, R. A. (2014) · Nature Neuroscience · doi:10.1038/nn.3834 · Cited by 287
Retrosplenial cortex codes for permanent landmarks
Auger, S. D., Mullally, S. L., & Maguire, E. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0043620 · Cited by 205
3D shape perception from combined depth cues in human visual cortex
Welchman, A. E., Deubelius, A., Conrad, V., Bülthoff, H. H., & Kourtzi, Z. (2005) · Nature Neuroscience · doi:10.1038/nn1461 · Cited by 183
Two distinct scene processing networks connecting vision and memory
Baldassano, C., Esteva, A., Fei-Fei, L., & Beck, D. M. (2016) · eneuro · doi:10.1523/eneuro.0178-16.2016 · Cited by 144
Cited by
Scene Perception in the Human Brain
Epstein, R. A., & Baker, C. I. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014809 · Cited by 347
Self-citationThe Organization and Operation of Inferior Temporal Cortex
Conway, B. R. (2018) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091517-034202 · Cited by 255
Computational mechanisms underlying cortical responses to the affordance properties of visual scenes
Bonner, M. F., & Epstein, R. A. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006111 · Cited by 94
“However, the analyses presented here suggest an alternative interpretation, namely that scene-selective visual regions encode complex features that convey information about high-level scene properties, such as navigational layout, but that the computations that give rise to these features rely heavily on specific sets…”
BackgroundThe Diversity of Eyes and Vision
Nilsson, D.-E. (2021) · Annual Review of Vision Science · doi:10.1146/annurev-vision-121820-074736 · Cited by 71
Linking cortical circuit models to human cognition with laminar fMRI
Yang, J., Huber, L., Yu, Y., & Bandettini, P. A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.07.005 · Cited by 52
Metadata
- Authors
- Groen, I. I. A., Silson, E. H., & Baker, C. I.
- Venue
- Philosophical Transactions of the Royal Society B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2017-02-19
- Volume
- 372
- Issue
- 1714
- Pages
- 20160102
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2564487272
- Cited by
- 220
- References
- 12
- FWCI
- 8.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.