Formal models and quantitative measures of multisensory integration: a selective overview
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Multisensory integration (MI) is defined as the neural process by which unisensory signals are combined to form a new product that is significantly different from the responses evoked by the modality‐specific component stimuli. In recent years, MI research has seen exponential growth in the number of empirical and theoretical studies. This study presents a selective overview of formal modeling approaches to MI. Emphasis is on models and measures for behavioral paradigms, such as localization, judgment of temporal order or simultaneity, and reaction times, but some concepts for the modeling of single‐cell spike rates are treated as well. We identify a number of essential concepts underlying most model classes, such as Bayesian causal inference, probability summation, coactivation, and time window of integration. Quantitative indexes for measuring and comparing the strength of MI across different paradigms are also discussed. Whereas progress over the last years is remarkable, we point out some strengths and weaknesses of the modeling approaches and discuss some obstacles toward a unified theory of MI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 1×
“For stimuli presented at different levels of spatial discrepancy (in particular, ventriloquism), modeling relies once again on Bayesian inference and optimal cue combination (Alais & Burr, 2004; K € ording et al. , 2007; Shams & Beierholm, 2010).”
MethodNormalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906 · cited 1×
“Divisive normalization is often seen as a near-universal feature of neural computation across many brain areas involving vision, audition, olfaction, spatial attention, and higher cognitive processes (for a recent review, see, Carandini & Heeger, 2012).”
BackgroundBayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069 · cited 5×
“If the objective is to minimize mean squared error of the spatial estimates, then the optimal estimates are obtained by a model averaging strategy (K € ording et al. , 2007): Note that these overall estimates are no longer linear combinations of x V and x A as the posterior probabilities for…”
BackgroundMethodInfluentialThe Handbook of Multisensory Processes
(2004) · doi:10.7551/mitpress/3422.001.0001 · Cited by 948
DIVISION OF PSYCHOLOGY : STATISTICAL FACILITATION OF SIMPLE REACTION TIMES*
Raab, D. H. (1962) · Transactions of the New York Academy of Sciences · doi:10.1111/j.2164-0947.1962.tb01433.x · Cited by 668
Neural correlates of reliability-based cue weighting during multisensory integration
Fetsch, C. R., Pouget, A., DeAngelis, G. C., & Angelaki, D. E. (2012) · Nature Neuroscience · doi:10.1038/nn.2983 · Cited by 459
A computational perspective on the neural basis of multisensory spatial representations
Pouget, A., Deneve, S., & Duhamel, J.-R. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn914 · Cited by 413 · cited 1×
“This additive version has raised some controversy because, under some modeling assumptions, an additive combination of crossmodal inputs yields a prediction of optimal multisensory integration (Pouget et al. , 2002).”
Background
Cited by
Acerbi, L., Dokka, K., Angelaki, D. E., & Ma, W. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006110 · Cited by 111
Which hand is mine? Discriminating body ownership perception in a two-alternative forced-choice task
Chancel, M., & Ehrsson, H. H. (2020) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-020-02107-x · Cited by 73
Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
Franzen, L., Delis, I., De Sousa, G., Kayser, C., & Philiastides, M. G. (2020) · Nature Communications · doi:10.1038/s41467-020-19306-7 · Cited by 57
Metadata
- Authors
- Colonius, H., & Diederich, A.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2018-01-23
- Volume
- 51
- Issue
- 5
- Pages
- 1161-1178
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2778339765
- Cited by
- 63
- References
- 15
- FWCI
- 6.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Formal models and quantitative measures of multisensory integration: a selective overview. https://app.cochat.ai/papers/10.1111/ejn.13813
- The paper
- Colonius, H., & Diederich, A. (2020). Formal models and quantitative measures of multisensory integration: a selective overview. European Journal of Neuroscience. https://doi.org/10.1111/ejn.13813
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.