Coding of navigational affordances in the human visual system
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Significance: As we move about the world, we use vision to determine where we can go in our local environment and where our path is blocked. Despite the ubiquity of this problem, little is known about how it is solved by the brain. Here we show that a specific region in the human visual system, known as the occipital place area, automatically encodes the structure of navigable space in visual scenes, thus providing evidence for a bottom-up visual mechanism for perceiving potential paths for movement in one’s immediate surroundings. These findings are consistent with classic theoretical work predicting that sensory systems are optimized for processing environmental features that afford ecologically relevant behaviors, including the fundamental behavior of navigation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Separate visual pathways for perception and action
Goodale, M. A., & Milner, A. D. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90344-8 · Cited by 6,519 · cited 1×
“The OPA is located in the dorsal visual stream, a cluster of processing pathways that has been broadly associated with visuospatial perception and visuomotor processing (23, 24).”
BackgroundModeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319 · cited 1×
“We next performed a follow-up analysis to compare the coding of navigational affordances with representations from the Gist computer-vision model (20).”
MethodNonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
A cortical representation of the local visual environment
Epstein, R., & Kanwisher, N. (1998) · Nature · doi:10.1038/33402 · Cited by 2,984 · cited 1×
“The absence of robust affordance coding in the PPA, on the other hand, is at first glance surprising, as it has long been hypothesized that the PPA encodes the geometric layout of scenes (8, 35), possibly in the service of guiding navigation in local space (8, 12, 13, 36).”
BackgroundSelf-citationInformation-based functional brain mapping
Kriegeskorte, N., Goebel, R., & Bandettini, P. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0600244103 · Cited by 2,113 · cited 12×
“This finding suggests that by using the multivoxel activation patterns of scene-selective ROIs, we should be able to reconstruct the navigational affordances of novel scenes regardless of their semantic content and other navigationally irrelevant visual properties.”
MethodInfluentialPerceiving, Acting and Knowing: Toward an Ecological Psychology
(2017) · Routledge eBooks · doi:10.4324/9781315467931 · Cited by 2,065
Neural Mechanisms for Interacting with a World Full of Action Choices
Cisek, P., & Kalaska, J. F. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135409 · Cited by 1,543 · cited 2×
“This proposed mechanism also aligns well with a recent theory of actionplanning known as the affordance-competition framework, which suggests that observers routinely encode multiple, parallel plans of the relevant actions afforded by their environment and then rapidly select among these when implementing a behavior (…”
BackgroundA new neural framework for visuospatial processing
Kravitz, D. J., Saleem, K. S., Baker, C. I., & Mishkin, M. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3008 · Cited by 1,325 · cited 2×
“This finding suggests that the OPA is situated near the highest stage of the occipito-parietal circuit before it diverges into multiple, parallel pathways in the parietal lobe (23).”
BackgroundIntentional Maps in Posterior Parietal Cortex
Andersen, R. A., & Buneo, C. A. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142922 · Cited by 1,294 · cited 2×
“Many studies have examined the contribution of the dorsal stream to visually guided actions of the eyes, hands, and arms (25), but little is known about its possible role in extracting visuospatial parameters useful for navigation.”
BackgroundRepresentation of Manipulable Man-Made Objects in the Dorsal Stream
Chao, L. L., & Martin, A. (2000) · NeuroImage · doi:10.1006/nimg.2000.0635 · Cited by 1,250 · cited 1×
“Behavioral studies have shown that visual objects prime grasp-related information that reflects their orientation and function (21), and neural evidence suggests that objects automatically activate the visuospatial and motor regions that mediate their commonly associated actions (22).”
BackgroundOn the relations between seen objects and components of potential actions.
Tucker, M., & Ellis, R. (1998) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.24.3.830 · Cited by 1,145
Parahippocampal and retrosplenial contributions to human spatial navigation
Epstein, R. A. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.07.004 · Cited by 928
Self-citationVISUALLY CONTROLLED LOCOMOTION AND VISUAL ORIENTATION IN ANIMALS*
GIBSON, J. J. (1958) · British Journal of Psychology · doi:10.1111/j.2044-8295.1958.tb00656.x · Cited by 809
The retrosplenial contribution to human navigation: a review of lesion and neuroimaging findings
Maguire, E. (2001) · Scandinavian Journal of Psychology · doi:10.1111/1467-9450.00233 · Cited by 584
Decoding and Reconstructing Color from Responses in Human Visual Cortex
Brouwer, G. J., & Heeger, D. J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3577-09.2009 · Cited by 577 · cited 1×
“To do this, we applied an approach that has previously been used to characterize the neural coding of color and orientation (18, 19).”
MethodThe neural basis of object perception
Grill-Spector, K. (2003) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(03)00040-0 · Cited by 557
GREENE, M., & OLIVA, A. (2009) · Cognitive Psychology · doi:10.1016/j.cogpsych.2008.06.001 · Cited by 467 · cited 2×
“Like objects, spatial scenes also afford a set of potential actions, and one of the most fundamental of these is navigation (5).”
BackgroundSelective neural representation of objects relevant for navigation
Janzen, G., & van Turennout, M. (2004) · Nature Neuroscience · doi:10.1038/nn1257 · Cited by 382 · cited 1×
“Indeed, recent work shows that the PPA contains representations of landmark identity, which may reflect knowledge of the many visual features that are associated with a familiar place (16, 17, 37, 38).”
BackgroundViewpoint-Specific Scene Representations in Human Parahippocampal Cortex
Epstein, R., Graham, K. S., & Downing, P. E. (2003) · Neuron · doi:10.1016/s0896-6273(03)00117-x · Cited by 360
Self-citationAn algorithmic method for functionally defining regions of interest in the ventral visual pathway
Julian, J. B., Fedorenko, E., Webster, J., & Kanwisher, N. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.055 · Cited by 334 · cited 1×
“We identified the three scene-selectiveROIs: the PPA,OPA, andRSC in each subject using a contrast of scenes > objects implemented in a general linear model and a group-based anatomical constraint of scene-selective activation derived from a large number (n = 42) of localizer subjects in our laboratory (17, 43).”
MethodThe Occipital Place Area Is Causally and Selectively Involved in Scene Perception
Dilks, D. D., Julian, J. B., Paunov, A. M., & Kanwisher, N. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4081-12.2013 · Cited by 330 · cited 1×
“It has recently been proposed that, within the scene-selective network, the OPA is particularly well suited for guiding navigation in local space (26), although there is also evidence that it plays a role in scene categorization (27, 28).”
BackgroundAnchoring the neural compass: coding of local spatial reference frames in human medial parietal lobe
Marchette, S. A., Vass, L. K., Ryan, J., & Epstein, R. A. (2014) · Nature Neuroscience · doi:10.1038/nn.3834 · Cited by 287
Self-citationReal-World Scene Representations in High-Level Visual Cortex: It's the Spaces More Than the Places
Kravitz, D. J., Peng, C. S., & Baker, C. I. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4588-10.2011 · Cited by 282 · cited 2×
“The absence of robust affordance coding in the PPA, on the other hand, is at first glance surprising, as it has long been hypothesized that the PPA encodes the geometric layout of scenes (8, 35), possibly in the service of guiding navigation in local space (8, 12, 13, 36).”
BackgroundPark, S., Brady, T. F., Greene, M. R., & Oliva, A. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3885-10.2011 · Cited by 254 · cited 2×
“The absence of robust affordance coding in the PPA, on the other hand, is at first glance surprising, as it has long been hypothesized that the PPA encodes the geometric layout of scenes (8, 35), possibly in the service of guiding navigation in local space (8, 12, 13, 36).”
BackgroundSimple line drawings suffice for functional MRI decoding of natural scene categories
Walther, D. B., Chai, B., Caddigan, E., Beck, D. M., & Fei-Fei, L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1015666108 · Cited by 233
Cross-orientation suppression in human visual cortex
Brouwer, G. J., & Heeger, D. J. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00540.2011 · Cited by 217 · cited 1×
“To do this, we applied an approach that has previously been used to characterize the neural coding of color and orientation (18, 19).”
MethodRetrosplenial cortex codes for permanent landmarks
Auger, S. D., Mullally, S. L., & Maguire, E. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0043620 · Cited by 205
Continuous carry-over designs for fMRI
Aguirre, G. K. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.02.005 · Cited by 178 · cited 1×
“Stimuli within each scan run were presented in a type 1 index 1 continuous-carryover sequence so that each condition preceded and followed every other condition (including the null condition) an equal number of times (42).”
MethodNeural systems for landmark-based wayfinding in humans
Epstein, R. A., & Vass, L. K. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0533 · Cited by 171 · cited 1×
“Indeed, recent work shows that the PPA contains representations of landmark identity, which may reflect knowledge of the many visual features that are associated with a familiar place (16, 17, 37, 38).”
BackgroundSelf-citationMirror-Image Sensitivity and Invariance in Object and Scene Processing Pathways
Dilks, D. D., Julian, J. B., Kubilius, J., Spelke, E. S., & Kanwisher, N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1935-11.2011 · Cited by 159 · cited 2×
“It has recently been proposed that, within the scene-selective network, the OPA is particularly well suited for guiding navigation in local space (26), although there is also evidence that it plays a role in scene categorization (27, 28).”
BackgroundSilson, E. H., Chan, A. W.-Y., Reynolds, R. C., Kravitz, D. J., & Baker, C. I. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0137-15.2015 · Cited by 154 · cited 1×
“Furthermore, the OPA is known to show a retinotopic bias for information in the periphery, which could facilitate the perception of extended spatial structures, and also a bias for the lower visual field, where paths tend to be (31).”
BackgroundVisual Scene Processing in Familiar and Unfamiliar Environments
Epstein, R. A., Higgins, J. S., Jablonski, K., & Feiler, A. M. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00003.2007 · Cited by 153 · cited 1×
“The OPA, along with the PPA and RSC, constitute a network of brain regions that show a strong response to visual scenes (7, 11) [note that in the literature, the OPA has also been referred to as the transverse occipital sulcus (10)].”
BackgroundSelf-citationJulian, J. B., Ryan, J., Hamilton, R. H., & Epstein, R. A. (2016) · Current Biology · doi:10.1016/j.cub.2016.02.066 · Cited by 152 · cited 1×
“A recent study using transcranial magnetic stimulation showed that the OPA has a causal role in perceiving spatial relationships between objects and environmental boundaries, but not between objects and other objects (30).”
BackgroundSelf-citationDeconstructing Visual Scenes in Cortex: Gradients of Object and Spatial Layout Information
Harel, A., Kravitz, D. J., & Baker, C. I. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs091 · Cited by 152 · cited 2×
“Indeed, recent work shows that the PPA contains representations of landmark identity, which may reflect knowledge of the many visual features that are associated with a familiar place (16, 17, 37, 38).”
BackgroundAnterior hippocampus and goal-directed spatial decision making
Viard, A., Doeller, C. F., Hartley, T., Bird, C. M., & Burgess, N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4640-10.2011 · Cited by 144 · cited 1×
“Memory systems might also be crucial for using affordance information to actively plan paths through the local environment to reach specific goals (39).”
BackgroundThe cortical basis of visual scene processing
Epstein, R. (2005) · Visual Cognition · doi:10.1080/13506280444000607 · Cited by 137 · cited 1×
“The absence of robust affordance coding in the PPA, on the other hand, is at first glance surprising, as it has long been hypothesized that the PPA encodes the geometric layout of scenes (8, 35), possibly in the service of guiding navigation in local space (8, 12, 13, 36).”
BackgroundSelf-citationObject Ensemble Processing in Human Anterior-Medial Ventral Visual Cortex
Cant, J. S., & Xu, Y. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3325-11.2012 · Cited by 132 · cited 5×
“00000071] and significant effects in the OPA [t(15) = 3.”
BackgroundMethodInfluentialParallel specification of competing sensorimotor control policies for alternative action options
Gallivan, J. P., Logan, L., Wolpert, D. M., & Flanagan, J. R. (2016) · Nature Neuroscience · doi:10.1038/nn.4214 · Cited by 124 · cited 1×
“This perspective has gained renewed support from recent work on action planning, which suggests that the action system continually prepares multiple, parallel plans that are appropriate for the environment (3, 4).”
BackgroundOutside Looking In: Landmark Generalization in the Human Navigational System
Marchette, S. A., Vass, L. K., Ryan, J., & Epstein, R. A. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2270-15.2015 · Cited by 123 · cited 2×
“Indeed, recent work shows that the PPA contains representations of landmark identity, which may reflect knowledge of the many visual features that are associated with a familiar place (16, 17, 37, 38).”
BackgroundSelf-citationVisual scenes are categorized by function.
Greene, M. R., Baldassano, C. A., Esteva, A., Beck, D. M., & Fei-Fei, L. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000129 · Cited by 122 · cited 1×
“Furthermore, only recently have investigators begun to characterize the affordance properties of scenes, and this work has focused not on navigational affordances but on more abstract behavioral events that can be used to define scene categories, such as cooking and sleeping (6).”
BackgroundPerceived egocentric distance sensitivity and invariance across scene-selective cortex
Persichetti, A. S., & Dilks, D. D. (2016) · Cortex · doi:10.1016/j.cortex.2016.02.006 · Cited by 70
Silson, E. H., Groen, I. I. A., Kravitz, D. J., & Baker, C. I. (2016) · Journal of Vision · doi:10.1167/16.6.14 · Cited by 67 · cited 1×
“Fifth, what higher-level systems do these OPA representations feed into and how are these representations used? Within the dorsal stream, the OPA straddles several retinotopically defined regions, including V3A, V3B, LO1, LO2, and V7, and may also extend into more anterior motionsensitive regions (40).”
BackgroundGanaden, R. E., Mullin, C. R., & Steeves, J. K. E. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00372 · Cited by 62
Neural Systems for Visual Scene Recognition
Epstein, R. A. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262027854.003.0006 · Cited by 47 · cited 1×
“The OPA, along with the PPA and RSC, constitute a network of brain regions that show a strong response to visual scenes (7, 11) [note that in the literature, the OPA has also been referred to as the transverse occipital sulcus (10)].”
BackgroundSelf-citation(1977) · doi:10.4324/9781315740218-18
Cited by
The cognitive map in humans: spatial navigation and beyond
Epstein, R. A., Patai, E. Z., Julian, J. B., & Spiers, H. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4656 · Cited by 921
Self-citationScene Perception in the Human Brain
Epstein, R. A., & Baker, C. I. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014809 · Cited by 347
Self-citationStructuring knowledge with cognitive maps and cognitive graphs
Peer, M., Brunec, I. K., Newcombe, N. S., & Epstein, R. A. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.10.004 · Cited by 283
Self-citationComputational mechanisms underlying cortical responses to the affordance properties of visual scenes
Bonner, M. F., & Epstein, R. A. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006111 · Cited by 94
“1B) [19].”
BackgroundMethodResultInfluentialSelf-citationA common neural substrate for processing scenes and egomotion-compatible visual motion
Sulpizio, V., Galati, G., Fattori, P., Galletti, C., & Pitzalis, S. (2020) · Brain Structure and Function · doi:10.1007/s00429-020-02112-8 · Cited by 59
Metadata
- Authors
- Bonner, M. F., & Epstein, R. A.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2017-04-17
- Volume
- 114
- Issue
- 18
- Pages
- 4793-4798
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2607416176
- Cited by
- 204
- References
- 47
- FWCI
- 8.88
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.