The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Bayesian integration of visual and auditory signals for spatial localization
Abstract
Human observers localize events in the world by using sensory signals from multiple modalities. We evaluated two theories of spatial localization that predict how visual and auditory information are weighted when these signals specify different locations in space. According to one theory (visual capture), the signal that is typically most reliable dominates in a winner-take-all competition, whereas the other theory (maximum-likelihood estimation) proposes that perceptual judgments are based on a weighted average of the sensory signals in proportion to each signal's relative reliability. Our results indicate that both theories are partially correct, in that relative signal reliability significantly altered judgments of spatial location, but these judgments were also characterized by an overall bias to rely on visual over auditory information. These results have important implications for the development of cue integration and for neural plasticity in the adult brain that enables humans to optimally integrate multimodal information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
New Results in Linear Filtering and Prediction Theory
Kalman, R. E., & Bucy, R. S. (1961) · Journal of Basic Engineering · doi:10.1115/1.3658902 · Cited by 6,387
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Adaptive filtering prediction and control
Goodwin, G. C., & Sin, K. S. (1984) · Cited by 3,400
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,882
Shams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
Information processing with population codes
Pouget, A., Dayan, P., & Zemel, R. (2000) · Nature Reviews Neuroscience · doi:10.1038/35039062 · Cited by 752
Sensory modalities are not separate modalities: plasticity and interactions
Shimojo, S. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00241-5 · Cited by 598
Data Fusion for Sensory Information Processing Systems
Clark, J. J., & Yuille, A. L. (1990) · Springer eBooks · doi:10.1007/978-1-4757-2076-1 · Cited by 525
Cited by
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774
Decision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580
Neural correlates of reliability-based cue weighting during multisensory integration
Fetsch, C. R., Pouget, A., DeAngelis, G. C., & Angelaki, D. E. (2012) · Nature Neuroscience · doi:10.1038/nn.2983 · Cited by 459
“These types of deviations from optimality, apparent over- or under-weighting of a particular sensory cue, are not unprecedented in the human psychophysics literatur”
BackgroundSlant from texture and disparity cues: Optimal cue combination
Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004) · Journal of Vision · doi:10.1167/4.12.1 · Cited by 421
Dynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception
Fetsch, C. R., Turner, A. H., DeAngelis, G. C., & Angelaki, D. E. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2574-09.2009 · Cited by 412
Multisensory integration: psychophysics, neurophysiology, and computation
Angelaki, D. E., Gu, Y., & DeAngelis, G. C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.06.008 · Cited by 383
Knowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339
Suboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342
Cue weighting in auditory categorization: Implications for first and second language acquisition
Holt, L. L., & Lotto, A. J. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2188377 · Cited by 335
Multisensory Processing in Review: from Physiology to Behaviour
Alais, D., Newell, F., & Mamassian, P. (2010) · Seeing and Perceiving · doi:10.1163/187847510x488603 · Cited by 324
Fetsch, C. R., DeAngelis, G. C., & Angelaki, D. E. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3503 · Cited by 302
Emotion and decision-making: affect-driven belief systems in anxiety and depression
Paulus, M. P., & Yu, A. J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.009 · Cited by 287
Crossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli
Vatakis, A., & Spence, C. (2007) · Perception & Psychophysics · doi:10.3758/bf03193776 · Cited by 298
Feldman, N. H., Griffiths, T. L., & Morgan, J. L. (2009) · Psychological Review · doi:10.1037/a0017196 · Cited by 268
Sound-induced flash illusion as an optimal percept
Shams, L., Ma, W. J., & Beierholm, U. (2005) · NeuroReport · doi:10.1097/01.wnr.0000187634.68504.bb · Cited by 267
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195387247.001.0001 · Cited by 252
Bayesian integration of visual and vestibular signals for heading
Butler, J. S., Smith, S. T., Campos, J. L., & Bulthoff, H. H. (2010) · Journal of Vision · doi:10.1167/10.11.23 · Cited by 250
Multisensory Integration in Macaque Visual Cortex Depends on Cue Reliability
Morgan, M. L., DeAngelis, G. C., & Angelaki, D. E. (2008) · Neuron · doi:10.1016/j.neuron.2008.06.024 · Cited by 208
Perspectives on sensory processing disorder: a call for translational research
Miller, L. (2009) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.022.2009 · Cited by 183
Bayesian Prediction and Evaluation in the Anterior Cingulate Cortex
Ide, J. S., Shenoy, P., Yu, A. J., & Li, C.-S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2201-12.2013 · Cited by 185
“…probabilistic prediction and evaluation Bayesian probabilistic models have been successfully applied to explain perception (Ernst and Banks, 2002; Battaglia et al., 2003), attention (Dayan et al., 2000; Yu and Dayan, 2002), sensorimotor learning (Körding and Wolpert, 2004), decision making, and…”
BackgroundMethodRelation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72
Efficient probabilistic inference in generic neural networks trained with non-probabilistic feedback
Orhan, A. E., & Ma, W. J. (2017) · Nature Communications · doi:10.1038/s41467-017-00181-8 · Cited by 77
Signal detection theory, uncertainty, and Poisson-like population codes
Ma, W. J. (2010) · Vision Research · doi:10.1016/j.visres.2010.08.035 · Cited by 60
Suboptimal human multisensory cue combination
Arnold, D. H., Petrie, K., Murray, C., & Johnston, A. (2019) · Scientific Reports · doi:10.1038/s41598-018-37888-7 · Cited by 23
Human inference in changing environments with temporal structure.
Prat-Carrabin, A., Wilson, R. C., Cohen, J. D., & Azeredo da Silveira, R. (2021) · Psychological Review · doi:10.1037/rev0000276 · Cited by 16
“In cognitive science, it has successfully accounted for a wide range of observations, including cue combination in humans [5, 4, 1, 61, 3, 6, 7, 2], sensorimotor control [8, 9, 62], integration of temporal statistics [37, 36, 10, 11, 38], perceptual multistability [63, 41, 42], and various aspects of cognition [64, 65…”
Background
Metadata
- Authors
- Battaglia, P. W., Jacobs, R. A., & Aslin, R. N.
- Venue
- Journal of the Optical Society of America A
- Publisher
- Optica Publishing Group
- Published
- 2003-07-01
- Volume
- 20
- Issue
- 7
- Pages
- 1391
- ISSN
- 1084-7529 (ISSN-L)
- 1520-8532
- OpenAlex
- W2037554451
- Cited by
- 425
- References
- 21
- FWCI
- 13.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.