Multisensory integration: methodological approaches and emerging principles in the human brain.
Abstract
Understanding the conditions under which the brain integrates the different sensory streams and the mechanisms supporting this phenomenon is now a question at the forefront of neuroscience. In this paper, we discuss the opportunities for investigating these multisensory processes using modern imaging techniques, the nature of the information obtainable from each method and their benefits and limitations. Despite considerable variability in terms of paradigm design and analysis, some consistent findings are beginning to emerge. The detection of brain activity in human neuroimaging studies that resembles multisensory integration responses at the cellular level in other species, suggests similar crossmodal binding mechanisms may be operational in the human brain. These mechanisms appear to be distributed across distinct neuronal networks that vary depending on the nature of the shared information between different sensory cues. For example, differing extents of correspondence in time, space or content seem to reliably bias the involvement of different integrative networks which code for these cues. A combination of data obtained from haemodynamic and electromagnetic methods, which offer high spatial or temporal resolution respectively, are providing converging evidence of multisensory interactions at both "early" and "late" stages of processing--suggesting a cascade of synergistic processes operating in parallel at different levels of the cortex.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
REM-locked multisensory recruitment may reflect top-down priming of sensory cortex.
“Instead, REM-locked multisensory recruitment may reflect top-down priming of sensory cortex (Tallon-Baudry and Bertrand, 1999; Calvert and Thesen, 2004; Hong et al., 2009).”
From Virtual reality and consciousness inference in dreaming (2014) · cites this paper as Calvert and Thesen, 2004
Psycho-physiological measurements have been used to assess mental effort, to measure user experiences in entertainment technologies, and in human-robot interaction.
“This method has been used to assess mental effort [26-29], to measure user experiences in entertainment technologies [30], and in human robot interaction [31,32].”
From Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study (2012) · cites this paper as [31]
REM-locked activation is found in multisensory cortical areas identified in waking studies, including superior temporal gyrus and right retrosplenial cortex.
“REM-locked activation was also found in multisensory cortical areas indentified in waking studies (Calvert and Thesen, 2004). These include superior temporal gyrus – a key region for audiovisual integration (Hein and Knight, 2008) – and the right retrosplenial cortex.”
From Virtual reality and consciousness inference in dreaming (2014) · cites this paper as Calvert and Thesen, 2004
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,542 · see citing works
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072 · see citing works
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 1× · see citing works
“[26] identified projections from core and parabelt auditory cortex into parts of V1 corresponding to the representation of the peripheral visual field.”
BackgroundA Comparison of Visual and Auditory Motion Processing in Human Cerebral Cortex
Lewis, J. W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.9.873 · Cited by 381 · see citing works
Neural Correlates of Auditory–Visual Stimulus Onset Asynchrony Detection
Bushara, K. O., Grafman, J., & Hallett, M. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-01-00300.2001 · Cited by 361 · see citing works
Spatial maps for the control of movement.
Graziano, M. S., & Gross, C. G. (1998) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(98)80140-2 · Cited by 323 · see citing works
Duhamel, J.-R. É., Colby, C., & Goldberg, M. E. (1991) · Brain And Space · doi:10.1093/oso/9780198542841.003.0012 · Cited by 99 · see citing works
Doyle, M. C., & Snowden, R. J. (2001) · Perception · doi:10.1068/p3126 · Cited by 66 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Neural reorganization following sensory loss: the opportunity of change
Merabet, L. B., & Pascual-Leone, A. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2758 · Cited by 751 · see citing works
A ventral visual stream reading center independent of visual experience
Reich, L., Szwed, M., Cohen, L., & Amedi, A. (2011) · Current Biology · doi:10.1016/j.cub.2011.01.040 · Cited by 295 · see citing works
Virtual reality and consciousness inference in dreaming
Hobson, J. A., Hong, C. C.-H., & Friston, K. J. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01133 · Cited by 197 · see citing works
“Instead, REMlocked multisensory recruitment may reflect top-down priming of sensory cortex (Tallon-Baudry and Bertrand, 1999; Calvert and Thesen, 2004; Hong et al., 2009).”
BackgroundMultisensory speech perception in children with autism spectrum disorders
Woynaroski, T. G., Kwakye, L. D., Foss-Feig, J. H., Stevenson, R. A., Stone, W. L., & Wallace, M. T. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1836-5 · Cited by 148 · see citing works
fMRI evidence for multisensory recruitment associated with rapid eye movements during sleep.
Hong, C. C., Harris, J. C., Pearlson, G. D., Kim, J., Calhoun, V. D., Fallon, J. H., Golay, X., Gillen, J. S., Simmonds, D. J., van Zijl, P. C. M., et al. (2009) · Human Brain Mapping · doi:10.1002/hbm.20635 · Cited by 124 · see citing works
Weiler, J. A., Suchan, B., & Daum, I. (2010) · Hippocampus · doi:10.1002/hipo.20695 · Cited by 93 · see citing works
Gonzalez, J., Soma, H., Sekine, M., & Yu, W. (2012) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-9-33 · Cited by 87 · see citing works
Hertz, U., & Amedi, A. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.04.186 · Cited by 43 · see citing works
Proulx, M. J., Gwinnutt, J., Dell’Erba, S., Levy-Tzedek, S., de Sousa, A. A., & Brown, D. J. (2015) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-150541 · Cited by 36 · see citing works
Spatiotemporal integration of looming visual and tactile stimuli near the face
Huang, R., Chen, C., & Sereno, M. I. (2018) · Human Brain Mapping · doi:10.1002/hbm.23995 · Cited by 17 · see citing works
- Authors
- Calvert, G. A., & Thesen, T.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Calvert, Gemma A.
- Venue
- Journal of Physiology-Paris
- Publisher
- Elsevier BV
- Published
- 2004-01
- Volume
- 98
- Issue
- 1-3
- Pages
- 191-205
- ISSN
- 0928-4257 (ISSN-L)
- OpenAlex
- W2043969427
- Cited by
- 425
- References
- 8
- Citations by year
- 2026: 15 · 2025: 18 · 2024: 21 · 2023: 20 · 2022: 23 · 2021: 22 · 2020: 21 · 2019: 24 · 2018: 14 · 2017: 18 · 2016: 24 · 2015: 24 · 2014: 19 · 2013: 25 · 2012: 18
- FWCI
- 2.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Physiology-Paris (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- multisensory integration, neuronal networks, electromagnetic imaging, human neuroimaging
- MeSH terms
- Animals, Brain, Brain Mapping, Humans, Touch, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
