Human Scene-Selective Areas Represent 3D Configurations of Surfaces
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
It has been argued that scene-selective areas in the human brain represent both the 3D structure of the local visual environment and low-level 2D features (such as spatial frequency) that provide cues for 3D structure. To evaluate the degree to which each of these hypotheses explains variance in scene-selective areas, we develop an encoding model of 3D scene structure and test it against a model of low-level 2D features. We fit the models to fMRI data recorded while subjects viewed visual scenes. The fit models reveal that scene-selective areas represent the distance to and orientation of large surfaces, at least partly independent of low-level features. Principal component analysis of the model weights reveals that the most important dimensions of 3D structure are distance and openness. Finally, reconstructions of the stimuli based on the model weights demonstrate that our model captures unprecedented detail about the local visual environment from scene-selective areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
College Admissions and the Stability of Marriage
Gale, D., & Shapley, L. S. (1962) · The American Mathematical Monthly · doi:10.1080/00029890.1962.11989827 · Cited by 5,985
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033
Natural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504 · cited 3×
“This analysis used voxels from multiple subjects pooled together (as in Huth et al., 2012, 2016).”
MethodSelf-citationReconstructing Visual Experiences from Brain Activity Evoked by Natural Movies
Nishimoto, S., Vu, A. T., Naselaris, T., Benjamini, Y., Yu, B., & Gallant, J. L. (2011) · Current Biology · doi:10.1016/j.cub.2011.08.031 · Cited by 933
Self-citationThe human inferior parietal cortex: Cytoarchitectonic parcellation and interindividual variability
Caspers, S., Geyer, S., Schleicher, A., Mohlberg, H., Amunts, K., & Zilles, K. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.06.054 · Cited by 634
The human inferior parietal lobule in stereotaxic space
Caspers, S., Eickhoff, S. B., Geyer, S., Scheperjans, F., Mohlberg, H., Zilles, K., & Amunts, K. (2008) · Brain Structure and Function · doi:10.1007/s00429-008-0195-z · Cited by 395
Attention during natural vision warps semantic representation across the human brain
Çukur, T., Nishimoto, S., Huth, A. G., & Gallant, J. L. (2013) · Nature Neuroscience · doi:10.1038/nn.3381 · Cited by 351
Self-citationWhere am I now? Distinct roles for parahippocampal and retrosplenial cortices in place recognition
Epstein, R. A., Parker, W. E., & Feiler, A. M. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0799-07.2007 · Cited by 331
Retrosplenial cortex codes for permanent landmarks
Auger, S. D., Mullally, S. L., & Maguire, E. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0043620 · Cited by 205 · cited 1×
“For example, some studies have suggested that properties of individual objects are represented in scene-selective areas, including the relevance of objects for navigation (Auger et al., 2012; Epstein, 2008; Janzen and van Turennout, 2004; Maguire, 2001), the size of objects or the degree to which objects define the sp…”
Two distinct scene processing networks connecting vision and memory
Baldassano, C., Esteva, A., Fei-Fei, L., & Beck, D. M. (2016) · eneuro · doi:10.1523/eneuro.0178-16.2016 · Cited by 144 · cited 18×
“However, such correlations between 2D and 3D features are not sufficient to explain the entire performance of the model; the 3D structural model also predicts significant unique variance in all three scene-selective areas (mean ± SD in the PPA, RSC, and OPA, respectively: 54% ± 8.7%, 45% ± 20%, and 52% ± 14% of the to…”
InfluentialCorrespondences between retinotopic areas and myelin maps in human visual cortex
Abdollahi, R. O., Kolster, H., Glasser, M. F., Robinson, E. C., Coalson, T. S., Dierker, D., Jenkinson, M., Van Essen, D. C., & Orban, G. A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.06.042 · Cited by 126
Computational mechanisms underlying cortical responses to the affordance properties of visual scenes
Bonner, M. F., & Epstein, R. A. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006111 · Cited by 94 · cited 1×
“One potential solution to this problem would be to use modern deep-learning algorithms that compute many different types of features directly from pixel data (Bonner and Epstein, 2018; Groen et al., 2018).”
Cited by
Scene Perception in the Human Brain
Epstein, R. A., & Baker, C. I. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014809 · Cited by 347
Horikawa, T., Cowen, A. S., Keltner, D., & Kamitani, Y. (2020) · iScience · doi:10.1016/j.isci.2020.101060 · Cited by 101
Wehbe, L., Blank, I. A., Shain, C., Futrell, R., Levy, R., von der Malsburg, T., Smith, N., Gibson, E., & Fedorenko, E. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab065 · Cited by 72
Unveiling functions of the visual cortex using task-specific deep neural networks
Dwivedi, K., Bonner, M. F., Cichy, R. M., & Roig, G. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009267 · Cited by 52
Khosla, M., & Wehbe, L. (2022) · doi:10.1101/2022.03.16.484578 · Cited by 11
Metadata
- Authors
- Lescroart, M. D., & Gallant, J. L.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 101
- Issue
- 1
- Pages
- 178-192.e7
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2902108885
- Cited by
- 116
- References
- 13
- FWCI
- 5.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.