Models and processes of multisensory cue combination
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Fundamental to our perception of a unified and stable environment is the capacity to combine information across the senses. Although this process appears seamless as an adult, the brain’s ability to successfully perform multisensory cue combination takes years to develop and relies on a number of complex processes including cue integration, cue calibration, causal inference, and reference frame transformations. Further complexities exist because multisensory cue combination is implemented by populations of noisy neurons. In this review, we discuss recent behavioral studies exploring how the brain combines information from different sensory systems, neurophysiological studies relating behavior to neuronal activity, and a theory of neural sensory encoding that can account for many of these experimental findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 1×
“Previous work using this paradigm showed that observers make trade-offs between speed and accuracy [38] and that more reliable evidence leads to faster decisions [39], suggesting that perceptual evidence is accumulated over time until a decision boundary is reached.”
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · cited 2×
“This led to the investigation of how the brain can simultaneously represent multiple pieces of sensory information along with their reliabilities, and combine them optimally to implement Bayesian cue integration [14].”
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Correlated neuronal discharge rate and its implications for psychophysical performance
Zohary, E., Shadlen, M. N., & Newsome, W. T. (1994) · Nature · doi:10.1038/370140a0 · Cited by 1,237 · cited 1×
“This generalizes a widely used model which assumes that neurons’ firing rates are independent and governed by Poisson statistics to allow for, among other things, correlated neural variability [16, 17] and different mean–variance relationships in firing rates [18].”
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069 · cited 1×
“To examine how this inference is performed, one study presented human subjects with synchronized visual flashes and auditory clicks that originated from either the same or different locations, and asked them to indicate both the locations of the stimuli and whether they had one or two causes [12].”
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027
A common reference frame for movement plans in the posterior parietal cortex
Cohen, Y. E., & Andersen, R. A. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn873 · Cited by 695
Cited by
The connectome of an insect brain
Winding, M., Pedigo, B. D., Barnes, C. L., Patsolic, H. G., Park, Y., Kazimiers, T., Fushiki, A., Andrade, I. V., Khandelwal, A., Valdes-Aleman, J., et al. (2023) · Science · doi:10.1126/science.add9330 · Cited by 435
Baum, S. H., Stevenson, R. A., & Wallace, M. T. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.007 · Cited by 370
A computational perspective on autism
Rosenberg, A., Patterson, J. S., & Angelaki, D. E. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510583112 · Cited by 156
“One possibility is that population activity is decoded to determine the most probable stimulus, and the appropriate behavioral response is then selected accordingly (17, 38, 42).”
BackgroundSelf-citationCharacterizing the roles of alpha and theta oscillations in multisensory attention
Keller, A. S., Payne, L., & Sekuler, R. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.02.021 · Cited by 106
“Given that numerous behavioral studies using concurrent auditory and visual stimuli have demonstrated audio-visual integration (Seilheimer et al., 2014; Driver and Noesselt, 2008; Senkowski et al., 2008; Stein et al., 2014), it is unsurprising that an electroencephalographic correlate of auditory processing would be e…”
Khalvati, K., Kiani, R., & Rao, R. P. N. (2021) · Nature Communications · doi:10.1038/s41467-021-25419-4 · Cited by 64
Fitting predictive coding to the neurophysiological data
Spratling, M. W. (2019) · Brain Research · doi:10.1016/j.brainres.2019.146313 · Cited by 23
Metadata
- Authors
- Seilheimer, R. L., Rosenberg, A., & Angelaki, D. E.
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2014-04
- Volume
- 25
- Pages
- 38-46
- ISSN
- 0959-4388 (ISSN-L)
- OpenAlex
- W2036189952
- Cited by
- 107
- References
- 25
- FWCI
- 1.77
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.