Self-motion leads to mandatory cue fusion across sensory modalities
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
When perceiving properties of the world, we effortlessly combine multiple sensory cues into optimal estimates. Estimates derived from the individual cues are generally retained once the multisensory estimate is produced and discarded only if the cues stem from the same sensory modality (i.e., mandatory fusion). Does multisensory integration differ in that respect when the object of perception is one's own body, rather than an external variable? We quantified how humans combine visual and vestibular information for perceiving own-body rotations and specifically tested whether such idiothetic cues are subjected to mandatory fusion. Participants made extensive size comparisons between successive whole body rotations using only visual, only vestibular, and both senses together. Probabilistic descriptions of the subjects' perceptual estimates were compared with a Bayes-optimal integration model. Similarity between model predictions and experimental data echoed a statistically optimal mechanism of multisensory integration. Most importantly, size discrimination data for rotations composed of both stimuli was best accounted for by a model in which only the bimodal estimator is accessible for perceptual judgments as opposed to an independent or additive use of all three estimators (visual, vestibular, and bimodal). Indeed, subjects' thresholds for detecting two multisensory rotations as different from one another were, in pertinent cases, larger than those measured using either single-cue estimate alone. Rotations different in terms of the individual visual and vestibular inputs but quasi-identical in terms of the integrated bimodal estimate became perceptual metamers. This reveals an exceptional case of mandatory fusion of cues stemming from two different sensory modalities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 1×
“The neural mechanism underlying multisensory integration is therefore likely to be a process of probabilistic inference seeking to reduce perceptual uncertainty (Knill and Pouget 2004).”
BackgroundThe Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 4×
“2009) but not in other instances where optimal cross-modal cue integration has been previously demonstrated (Alais and Burr 2004; Ernst and Banks 2002; Mendonca et al. 2011).”
BackgroundInfluentialCausal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069 · cited 1×
“The reasons might instead be rooted in the causal inference process (Koerding et al. 2007; Parise et al. 2012; Shams and Beierholm 2010) since observers often effortlessly attribute separate causes to simultaneously received cross-modal cues.”
BackgroundMetamers of the ventral stream
Freeman, J., & Simoncelli, E. P. (2011) · Nature Neuroscience · doi:10.1038/nn.2889 · Cited by 667 · cited 2×
“…might guide future electrophysiology and modeling approaches to elucidate where and how visuovestibular metamers are formed, similar to recent attempts at explaining visual metamerism (Freeman and Simoncelli 2011) and at examining the dynamics of the fusion process (Scharnowski et al. 2009).”
BackgroundMethodNeural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554 · cited 5×
“Extending recent work in heading perception involving linear translation stimuli (Butler et al. 2010; Fetsch et al. 2009; Gu et al. 2008) as well as theoretical models of the optimal use of vestibular signals in general (Laurens and Droulez 2007; MacNeilage et al. 2007; Zupan et al. 2002), we first…”
BackgroundInfluentialGuldin, W. O., & Grüsser, O.-J. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(97)01211-3 · Cited by 504
Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses
Hillis, J. M., Ernst, M. O., Banks, M. S., & Landy, M. S. (2002) · Science · doi:10.1126/science.1075396 · Cited by 486 · cited 4×
“We next addressed the issue of mandatory cue fusion by adopting a paradigm (Hillis et al. 2002) measuring an observer’s ability to perceive two rotations as different.”
BackgroundInfluentialIonta, S., Heydrich, L., Lenggenhager, B., Mouthon, M., Fornari, E., Chapuis, D., Gassert, R., & Blanke, O. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.009 · Cited by 473 · cited 1×
“However, the observer’s body is also a multisensory object subjected to perceptual processes (Ionta et al. 2011).”
BackgroundSelf-citationSlant from texture and disparity cues: Optimal cue combination
Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004) · Journal of Vision · doi:10.1167/4.12.1 · Cited by 421 · cited 2×
“…from two different sensory modalities. mandatory fusion; metamers; multisensory integration; self-motion; vestibular SENSORY CUES either within (Hillis et al. 2004; Knill and Saunder 2003) or across senses (Alais and Burr 2004; Butler et al. 2010; Ernst and Banks 2002; Fetsch et al. 2009; Gu…”
Background
Cited by
Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness
Blanke, O., Slater, M., & Serino, A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.029 · Cited by 698
Self-citationSuboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342
The vestibular system: a spatial reference for bodily self-consciousness.
Pfeiffer, C., Serino, A., & Blanke, O. (2014) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2014.00031 · Cited by 165
“system encodes the position and movement of the head in threedimensional space, and because in the central nervous system vestibular signals are strongly integrated with motor, visual, somatosensory and proprioceptive signals (Grüsser et al., 1990a,b; Gu et al., 2007; Prsa et al., 2012), central vestibular processing…”
Self-citationAcerbi, L., Dokka, K., Angelaki, D. E., & Ma, W. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006110 · Cited by 111
“Our finding is in agreement with previous studies which demonstrated an increased tendency to combine discrepant visual and vestibular cues (Butler et al., 2010; Campos, Siegle, Mohler, Bülthoff, & Loomis, 2009; de Winkel et al., 2015; Kaliuzhna, Prsa, Gale, Lee, & Blanke, 2015; Prsa et al., 2012) 525 and also a large…”
Result
Metadata
- Authors
- Prsa, M., Gale, S., & Blanke, O.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 2012-10-15
- Volume
- 108
- Issue
- 8
- Pages
- 2282-2291
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W1987569607
- Cited by
- 93
- References
- 18
- FWCI
- 8.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.