Visual and vestibular cue integration for heading perception in extrastriate visual cortex
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Natural behaviours, and hence neuronal populations, often combine multiple sensory cues to improve stimulus detectability or discriminability as we explore the environment. Here we review one such example of multisensory cue integration in the dorsal medial superior temporal area (MSTd) of the macaque visual cortex. Visual and vestibular cues about the direction of self‐motion in the world (heading) are encoded by single multisensory neurons in MSTd. Most neurons tend to prefer lateral stimulus directions and, as they are broadly tuned, are most sensitive in discriminating heading directions around straight forward. Decoding of MSTd population activity shows that these neuronal properties can account for the fact that heading perception in humans and macaques is most precise for directions around straight forward, whereas heading sensitivity declines with increasing eccentricity of the reference direction. Remarkably, when heading is specified by both cues simultaneously, behavioural precision is improved in a manner that is predicted by statistically optimal (Bayesian) cue integration models. A subpopulation of multisensory MSTd cells with congruent visual and vestibular heading preferences also combines the cues near‐optimally, establishing a potential neural substrate for behavioral cue integration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 2×
“If the monkey combined the two cues optimally, as predicted by Bayesian cue integration principles (Ernst & Banks, 2002; Knill & Pouget, 2004), thresholds should be reduced by ∼30% under cue combination (Fig.”
BackgroundResultThe analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 2×
“Thus, visual/vestibular heading perception follows the principles of statistically optimal cue integration, as shown previously for other types of sensory interactions (van Beers et al. 1999; Ernst & Banks, 2002; Knill & Saunders, 2003; Alais & Burr, 2004; Hillis et al. 2004; Fetsch et al. 2009).”
BackgroundResultSENSE AND THE SINGLE NEURON: Probing the Physiology of Perception
Parker, A. J., & Newsome, W. T. (1998) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.21.1.227 · Cited by 801
Brandt, T., Dichgans, J., & Koenig, E. (1973) · Experimental Brain Research · doi:10.1007/bf00234474 · Cited by 794 · cited 1×
“Patterns of image motion across the retina (‘optic flow’) can be strong cues to self-motion, as evidenced by the fact that optic flow alone can elicit the illusion of self-motion (Brandt et al. 1973; Berthoz et al. 1975; Dichgans & Brandt, 1978).”
BackgroundIntegration of Proprioceptive and Visual Position-Information: An Experimentally Supported Model
van Beers, R. J., Sittig, A. C., & Gon, J. J. D. V. D. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.3.1355 · Cited by 742 · cited 1×
“Thus, visual/vestibular heading perception follows the principles of statistically optimal cue integration, as shown previously for other types of sensory interactions (van Beers et al. 1999; Ernst & Banks, 2002; Knill & Saunders, 2003; Alais & Burr, 2004; Hillis et al. 2004; Fetsch et al. 2009).”
BackgroundNeural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554 · cited 13×
“In particular, we summarize (1) how population activity in MSTd predicts heading discrimination behaviour (Gu et al. 2010) and (2) how neuronal sensitivity changes when both visual and vestibular heading cues are presented simultaneously (Gu et al. 2008; Morgan et al. 2008).”
BackgroundMethodInfluentialSelf-citationBerthoz, A., Pavard, B., & Young, L. R. (1975) · Experimental Brain Research · doi:10.1007/bf00234916 · Cited by 456 · cited 1×
“Patterns of image motion across the retina (‘optic flow’) can be strong cues to self-motion, as evidenced by the fact that optic flow alone can elicit the illusion of self-motion (Brandt et al. 1973; Berthoz et al. 1975; Dichgans & Brandt, 1978).”
BackgroundSlant from texture and disparity cues: Optimal cue combination
Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004) · Journal of Vision · doi:10.1167/4.12.1 · Cited by 421 · cited 1×
“Thus, visual/vestibular heading perception follows the principles of statistically optimal cue integration, as shown previously for other types of sensory interactions (van Beers et al. 1999; Ernst & Banks, 2002; Knill & Saunders, 2003; Alais & Burr, 2004; Hillis et al. 2004; Fetsch et al. 2009).”
Background
Cited by
The vestibular system: multimodal integration and encoding of self-motion for motor control
Cullen, K. E. (2012) · Trends in Neurosciences · doi:10.1016/j.tins.2011.12.001 · Cited by 630
Integration of visual motion and locomotion in mouse visual cortex
Saleem, A. B., Ayaz, A., Jeffery, K. J., Harris, K. D., & Carandini, M. (2013) · Nature Neuroscience · doi:10.1038/nn.3567 · Cited by 418
Vestibular processing during natural self-motion: implications for perception and action
Cullen, K. E. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0153-1 · Cited by 322
Carriot, J., Brooks, J. X., & Cullen, K. E. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3051-13.2013 · Cited by 86
“…by other cortical areas, which likely contribute to the perception of self-motion (e.g., parieto-insular vestibular cortex, MSTd, areas 2v and 3a; Grüsser et al., 1990a,b; Fasold et al., 2008; for review, see Angelaki et al., 2011; Lopez and Blanke, 2011), have considered only passive stimuli.”
BackgroundThe neural encoding of self-motion
Cullen, K. E. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.05.022 · Cited by 80
“Indeed neurons in areas MSTd/VIP that respond to optic flow stimuli also show tuning to translational motion in darkness [see [24] for review].”
BackgroundVestibular animal models: contributions to understanding physiology and disease
Straka, H., Zwergal, A., & Cullen, K. E. (2016) · Journal of Neurology · doi:10.1007/s00415-015-7909-y · Cited by 80
How multisensory neurons solve causal inference.
Rideaux, R., Storrs, K. R., Maiello, G., & Welchman, A. E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2106235118 · Cited by 65
“14 for a review.”
Metadata
- Authors
- Angelaki, D. E., Gu, Y., & DeAngelis, G. C.
- Venue
- The Journal of Physiology
- Publisher
- Wiley
- Published
- 2011-02-15
- Volume
- 589
- Issue
- 4
- Pages
- 825-833
- ISSN
- 0022-3751 (ISSN-L)
- 1469-7793
- OpenAlex
- W1548678907
- Cited by
- 101
- References
- 20
- FWCI
- 7.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.