Auditory–Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Current models of brain organization include multisensory interactions at early processing stages and within low-level, including primary, cortices. Embracing this model with regard to auditory–visual (AV) interactions in humans remains problematic. Controversy surrounds the application of an additive model to the analysis of event-related potentials (ERPs), and conventional ERP analysis methods have yielded discordant latencies of effects and permitted limited neurophysiologic interpretability. While hemodynamic imaging and transcranial magnetic stimulation studies provide general support for the above model, the precise timing, superadditive/subadditive directionality, topographic stability, and sources remain unresolved. We recorded ERPs in humans to attended, but task-irrelevant stimuli that did not require an overt motor response, thereby circumventing paradigmatic caveats. We applied novel ERP signal analysis methods to provide details concerning the likely bases of AV interactions. First, nonlinear interactions occur at 60–95 ms after stimulus and are the consequence of topographic, rather than pure strength, modulations in the ERP. AV stimuli engage distinct configurations of intracranial generators, rather than simply modulating the amplitude of unisensory responses. Second, source estimations (and statistical analyses thereof) identified primary visual, primary auditory, and posterior superior temporal regions as mediating these effects. Finally, scalar values of current densities in all of these regions exhibited functionally coupled, subadditive nonlinear effects, a pattern increasingly consistent with the mounting evidence in nonhuman primates. In these ways, we demonstrate how neurophysiologic bases of multisensory interactions can be noninvasively identified in humans, allowing for a synthesis across imaging methods on the one hand and species on the other.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection
Lakatos, P., Karmos, G., Mehta, A. D., Ulbert, I., & Schroeder, C. E. (2008) · Science · doi:10.1126/science.1154735 · Cited by 1,719 · cited 1×
“In monkeys, oscillations in primary cortices have been examined vis-à-vis the ability of nonpreferred sensory inputs to modulate the phase of ongoing activity and/or facilitate evoked neuronal responses to the preferred sensory modality (Lakatos et al., 2007, 2008, 2009).”
BackgroundIs neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 3×
“The requisite anatomy for such interactions has been well documented (Falchier et al., 2002, 2010; Rockland and Ojima, 2003; Cappe and Barone, 2005) and may even include a corticothalamocortical loop (Cappe et al., 2007a, 2009c; Hackett et al., 2007).”
BackgroundMultisensory convergence in calcarine visual areas in macaque monkey
Rockland, K. S., & Ojima, H. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00121-1 · Cited by 564
Unraveling multisensory integration: patchy organization within human STS multisensory cortex
Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004) · Nature Neuroscience · doi:10.1038/nn1333 · Cited by 513 · cited 4×
“organization (at least in auditory association cortices) of neurons responsive to unisensory versus multisensory stimulation (Beauchamp et al., 2004; Dahl et al., 2009).”
BackgroundInfluentialMultisensory integration: psychophysics, neurophysiology, and computation
Angelaki, D. E., Gu, Y., & DeAngelis, G. C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.06.008 · Cited by 383 · cited 3×
“In animal models, there is an increasing recognition of the preponderance of subadditive effects (Laurienti et al., 2005; Kayser et al., 2008; Angelaki et al., 2009).”
BackgroundEvaluating the Operations Underlying Multisensory Integration in the Cat Superior Colliculus
Stanford, T. R., Quessy, S., & Stein, B. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.5095-04.2005 · Cited by 314
Wang, Y., Celebrini, S., Trotter, Y., & Barone, P. (2008) · BMC Neuroscience · doi:10.1186/1471-2202-9-79 · Cited by 144
Cited by
Individual Differences in Alpha Frequency Drive Crossmodal Illusory Perception
Cecere, R., Rees, G., & Romei, V. (2015) · Current Biology · doi:10.1016/j.cub.2014.11.034 · Cited by 413
Self-citationWallace, M. T., & Stevenson, R. A. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.08.005 · Cited by 315
Multisensory Integration: Flexible Use of General Operations
van Atteveldt, N., Murray, M. M., Thut, G., & Schroeder, C. E. (2014) · Neuron · doi:10.1016/j.neuron.2014.02.044 · Cited by 272
Self-citationThe multisensory function of the human primary visual cortex
Murray, M. M., Thelen, A., Thut, G., Romei, V., Martuzzi, R., & Matusz, P. J. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.08.011 · Cited by 219
“To understand better the dynamics of multisensory processes gauged in perceptual tasks, we applied these analytical methods to ERPs in response to task-irrelevant AV stimuli that required topdown attention but no motor responses (Cappe et al., 2010; Fig.”
BackgroundMethodResultInfluentialSelf-citationLooming Signals Reveal Synergistic Principles of Multisensory Integration
Cappe, C., Thelen, A., Romei, V., Thut, G., & Murray, M. M. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5517-11.2012 · Cited by 107
“This main effect was the consequence of subadditive interactions, consistent with prior EEG and fMRI findings (Bizley et al., 2007; Martuzzi et al., 2007; Besle et al., 2008; Kayser et al., 2009; Cappe et al., 2010; Raij et al., 2010).”
BackgroundMethodResultInfluentialSelf-citation
Metadata
- Authors
- Cappe, C., Thut, G., Romei, V., & Murray, M. M.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2010-09-22
- Volume
- 30
- Issue
- 38
- Pages
- 12572-12580
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2043342325
- Cited by
- 143
- References
- 11
- FWCI
- 17.58
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Auditory–Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources. https://app.cochat.ai/papers/10.1523/jneurosci.1099-10.2010
- The paper
- Cappe, C., Thut, G., Romei, V., & Murray, M. M. (2010). Auditory–Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.1099-10.2010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.