Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Abstract
Modern brain imaging techniques have now made it possible to study the neural sites and mechanisms underlying crossmodal processing in the human brain. This paper reviews positron emission tomography, functional magnetic resonance imaging (fMRI), event-related potential and magnetoencephalographic studies of crossmodal matching, the crossmodal integration of content and spatial information, and crossmodal learning. These investigations are beginning to produce some consistent findings regarding the neuronal networks involved in these distinct crossmodal operations. Increasingly, specific roles are being defined for the superior temporal sulcus, the inferior parietal sulcus, regions of frontal cortex, the insula cortex and claustrum. The precise network of brain areas implicated in any one study, however, seems to be heavily dependent on the experimental paradigms used, the nature of the information being combined and the particular combination of modalities under investigation. The different analytic strategies adopted by different groups may also be a significant factor contributing to the variability in findings. In this paper, we demonstrate the impact of computing intersections, conjunctions and interaction effects on the identification of audiovisual integration sites using existing fMRI data from our own laboratory. This exercise highlights the potential value of using statistical interaction effects to model electrophysiological responses to crossmodal stimuli in order to identify possible sites of multisensory integration in the human brain.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In humans, temporal cortex, in particular the posterior aspect of superior temporal sulcus, superior temporal gyrus, and middle temporal gyrus, is thought to be a heteromodal association site and is involved with integration of memory, audiovisual association, and object-recognition functions.
“In humans, temporal cortex, in particular the posterior aspect of superior temporal sulcus, superior temporal gyrus, and middle temporal gyrus, is thought to be a heteromodal association site (along with prefrontal and inferior parietal cortices) and is involved with integration of memory, audiovisual association, and object-recognition functions (31–34).”
From Dynamic mapping of human cortical development during childhood through early adulthood (2004) · cites this paper as [32]
Cites
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798 · see citing works
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · see citing works
Visual Feature Integration and the Temporal Correlation Hypothesis
Singer, W., & Gray, C. M. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.003011 · Cited by 3,157 · see citing works
Psychophysiological and Modulatory Interactions in Neuroimaging
Friston, K. J., Buechel, C., Fink, G. R., Morris, J., Rolls, E., & Dolan, R. J. (1997) · NeuroImage · doi:10.1006/nimg.1997.0291 · Cited by 3,097 · see citing works
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · see citing works
Social perception from visual cues: Role of the STS region
Allison, T., Puce, A., & McCarthy, G. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01501-1 · Cited by 2,461 · see citing works
AN ANATOMICAL STUDY OF CONVERGING SENSORY PATHWAYS WITHIN THE CEREBRAL CORTEX OF THE MONKEY
Jones, E. G., & Powell, T. P. S. (1970) · Brain · doi:10.1093/brain/93.4.793 · Cited by 1,717 · see citing works
Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque.
Bruce, C. J., Desimone, R., & Gross, C. G. (1981) · Journal of Neurophysiology · doi:10.1152/jn.1981.46.2.369 · Cited by 1,230 · see citing works
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072 · see citing works
Haxby, J., Horwitz, B., Ungerleider, L. G., Maisog, J. M., Pietrini, P., & Grady, C. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-11-06336.1994 · Cited by 1,065 · see citing works
Activation of Auditory Cortex During Silent Lipreading
Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997) · Science · doi:10.1126/science.276.5312.593 · Cited by 1,025 · see citing works
Self-citationInsula of the old world monkey. III: Efferent cortical output and comments on function
Mesulam, M. ‐., & Mufson, E. J. (1982) · Journal of Comparative Neurology · doi:10.1002/cne.902120104 · Cited by 1,013 · see citing works
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954 · see citing works
Self-citationInteractions Among Converging Sensory Inputs in the Superior Colliculus
Meredith, M. A., & Stein, B. E. (1983) · Science · doi:10.1126/science.6867718 · Cited by 850 · see citing works
Seltzer, B., & Pandya, D. Ν. (1978) · Brain Research · doi:10.1016/0006-8993(78)90584-x · Cited by 781 · see citing works
Modulation of Human Visual Cortex by Crossmodal Spatial Attention
Macaluso, E., Frith, C., & Driver, J. (2000) · Science · doi:10.1126/science.289.5482.1206 · Cited by 603 · see citing works
Visual areas in the temporal cortex of the macaque
Desimone, R., & Gross, C. G. (1979) · Brain Research · doi:10.1016/0006-8993(79)90699-1 · Cited by 552 · see citing works
Turner, B. H., Mishkin, M., & Knapp, M. E. (1980) · The Journal of Comparative Neurology · doi:10.1002/cne.901910402 · Cited by 534 · see citing works
The Trouble with Cognitive Subtraction
Friston, K. J., Price, C. J., Fletcher, P. C., Moore, C. J., Frackowiak, R. S. J., & Dolan, R. J. (1996) · NeuroImage · doi:10.1006/nimg.1996.0033 · Cited by 531 · see citing works
Fries, W. (1984) · The Journal of Comparative Neurology · doi:10.1002/cne.902300106 · Cited by 475 · see citing works
Involuntary orienting to sound improves visual perception
McDonald, J. J., Teder-Sälejärvi, W. A., & Hillyard, S. A. (2000) · Nature · doi:10.1038/35038085 · Cited by 464 · see citing works
Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0812 · Cited by 464 · see citing works
Self-citationFunctional subdivisions of the temporal lobe neocortex
Baylis, G. C., Rolls, E. T., & Leonard, C. M. (1987) · Journal of Neuroscience · doi:10.1523/jneurosci.07-02-00330.1987 · Cited by 453 · see citing works
Receptive fields in deep layers of cat superior colliculus.
Gordon, B. (1973) · Journal of Neurophysiology · doi:10.1152/jn.1973.36.2.157 · Cited by 449 · see citing works
Further observations on corticofrontal connections in the rhesus monkey
Chavis, D. A., & Pandya, D. Ν. (1976) · Brain Research · doi:10.1016/0006-8993(76)90089-5 · Cited by 432 · see citing works
Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans
Bushara, K. O., Weeks, R. A., Ishii, K., Catalan, M.-J., Tian, B., Rauschecker, J. P., & Hallett, M. (1999) · Nature Neuroscience · doi:10.1038/11239 · Cited by 420 · see citing works
Representation and integration of multiple sensory inputs in primate superior colliculus
Wallace, M. T., Wilkinson, L. K., & Stein, B. E. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.2.1246 · Cited by 415 · see citing works
The development of intersensory temporal perception: an epigenetic systems/limitations view
Lewkowicz, D. J. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.2.281 · Cited by 403 · see citing works
Stein, B. E., Meredith, M. A., Huneycutt, W. S., & McDade, L. (1989) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1989.1.1.12 · Cited by 394 · see citing works
Foxe, J. J., Mórocz, I. Á., Murray, M. M., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00024-0 · Cited by 391 · see citing works
A Comparison of Visual and Auditory Motion Processing in Human Cerebral Cortex
Lewis, J. W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.9.873 · Cited by 381 · see citing works
Seeing speech: visual information from lip movements modifies activity in the human auditory cortex
Sams, M. E., Aulanko, R., Hämäläinen, M., Hari, R., Lounasmaa, O. V., Lu, S.-T., & Simola, J. (1991) · Neuroscience Letters · doi:10.1016/0304-3940(91)90914-f · Cited by 367 · see citing works
Neural Correlates of Auditory–Visual Stimulus Onset Asynchrony Detection
Bushara, K. O., Grafman, J., & Hallett, M. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-01-00300.2001 · Cited by 361 · see citing works
King, A. J., & Palmer, A. R. (1985) · Experimental Brain Research · doi:10.1007/bf00236934 · Cited by 355 · see citing works
Auditory receptive fields in primate superior colliculus shift with changes in eye position
Jay, M. F., & Sparks, D. L. (1984) · Nature · doi:10.1038/309345a0 · Cited by 341 · see citing works
Response amplification in sensory-specific cortices during crossmodal binding
Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D., & David, A. S. (1999) · Neuroreport · doi:10.1097/00001756-199908200-00033 · Cited by 330 · see citing works
Self-citationSpatial and temporal factors determine auditory-visual interactions in human saccadic eye movements
Frens, M. A., Opstal, A. J. V., & van der Willigen, R. F. (1995) · Perception & Psychophysics · doi:10.3758/bf03206796 · Cited by 328 · see citing works
Spatial determinants of multisensory integration in cat superior colliculus neurons
Meredith, M. A., & Stein, B. E. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1843 · Cited by 327 · see citing works
Spatial maps for the control of movement.
Graziano, M. S., & Gross, C. G. (1998) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(98)80140-2 · Cited by 323 · see citing works
Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading
Driver, J. (1996) · Nature · doi:10.1038/381066a0 · Cited by 315 · see citing works
Hikosaka, K., Iwai, E., Saito, H., & Tanaka, K. (1988) · Journal of Neurophysiology · doi:10.1152/jn.1988.60.5.1615 · Cited by 297 · see citing works
Benevento, L. A., Fallon, J., Davis, B. J., & Rezak, M. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90112-1 · Cited by 288 · see citing works
Audiovisual Integration of Letters in the Human Brain
Raij, T., Uutela, K., & Hari, R. (2000) · Neuron · doi:10.1016/s0896-6273(00)00138-0 · Cited by 282 · see citing works
The superior colliculus and movements of the head and eyes in cats
Harris, L. R. (1980) · The Journal of Physiology · doi:10.1113/jphysiol.1980.sp013167 · Cited by 273 · see citing works
Seltzer, B., & Pandya, D. Ν. (1980) · Brain Research · doi:10.1016/0006-8993(80)90888-4 · Cited by 271 · see citing works
Amygdalectomy impairs crossmodal association in monkeys.
Murray, E. A., & Mishkin, M. (1985) · Science · doi:10.1126/science.3983648 · Cited by 270 · see citing works
Mufson, E. J., & Mesulam, M. M. (1984) · The Journal of Comparative Neurology · doi:10.1002/cne.902270112 · Cited by 267 · see citing works
Effects of eye position on saccades evoked electrically from superior colliculus of alert cats
McIlwain, J. T. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.55.1.97 · Cited by 264 · see citing works
Wallace, M. T., Meredith, M. A., & Stein, B. E. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.69.6.1797 · Cited by 261 · see citing works
Visual-auditory interactions in sensorimotor processing: Saccades versus manual responses.
Hughes, H. C., Reuter‐Lorenz, P. A., Nozawa, G., & Fendrich, R. (1994) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.20.1.131 · Cited by 251 · see citing works
Neurons and behavior: the same rules of multisensory integration apply
Stein, B. E., Huneycutt, W. S., & Meredith, M. A. (1988) · Brain Research · doi:10.1016/0006-8993(88)91276-0 · Cited by 251 · see citing works
How Good Is Good Enough in Path Analysis of fMRI Data?
Bullmore, E. T., Horwitz, B., Honey, G. D., Brammer, M. J., Williams, S., & Sharma, T. (2000) · NeuroImage · doi:10.1006/nimg.2000.0544 · Cited by 241 · see citing works
Integration of multiple sensory modalities in cat cortex
Wallace, M. T., Meredith, M. A., & Stein, B. E. (1992) · Experimental Brain Research · doi:10.1007/bf00227844 · Cited by 239 · see citing works
Audio-ocular response characteristics.
Zahn, J. R., Abel, L. A., & Lf, D. (1978) · PubMed · Cited by 234 · see citing works
Hadjikhani, N. K., & Roland, P. E. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-03-01072.1998 · Cited by 224 · see citing works
Kawashima, R., O’Sullivan, B., & Roland, P. E. (1995) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.92.13.5969 · Cited by 214 · see citing works
Unit study of monkey frontal cortex: active localization of auditory and of visual stimuli
Vaadia, E., Benson, D. A., Hienz, R. D., & Goldstein, M. H. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.56.4.934 · Cited by 209 · see citing works
The Development of Intersensory Perception
Lewkowicz, D. J. (2013) · Psychology Press eBooks · doi:10.4324/9780203773079 · Cited by 202 · see citing works
Spatial attention and crossmodal interactions between vision and touch
Macaluso, E., & Driver, J. (2001) · Neuropsychologia · doi:10.1016/s0028-3932(01)00119-1 · Cited by 198 · see citing works
The time-course of intermodal binding between seeing and hearing affective information
Pourtois, G., de Gelder, B., Vroomen, J., Rossion, B., & Crommelinck, M. (2000) · Neuroreport · doi:10.1097/00001756-200004270-00036 · Cited by 196 · see citing works
The organization of the connections between the cortex and the claustrum in the monkey
Pearson, R. C. A., Brodal, P., Gatter, K. C., & Powell, T. P. S. (1982) · Brain Research · doi:10.1016/0006-8993(82)90883-6 · Cited by 184 · see citing works
Cross-modal performance: behavioural processes, phylogenetic considerations and neural mechanisms
Ettlinger, G., & Wilson, W. A. (1990) · Behavioural Brain Research · doi:10.1016/0166-4328(90)90075-p · Cited by 179 · see citing works
Auditory psychomotor coordination and visual search performance
Perrott, D. R., Saberi, K., Brown, K. M., & Strybel, T. Z. (1990) · Perception & Psychophysics · doi:10.3758/bf03211521 · Cited by 178 · see citing works
The role of anterior ectosylvian cortex in cross-modality orientation and approach behavior
Wilkinson, L. K., Meredith, M. A., & Stein, B. E. (1996) · Experimental Brain Research · doi:10.1007/bf00227172 · Cited by 163 · see citing works
The Role of Vision in the Perception of Speech
Dodd, B. J. (1977) · Perception · doi:10.1068/p060031 · Cited by 154 · see citing works
Selective Spatial Attention in Vision and Touch: Unimodal and Multimodal Mechanisms Revealed by PET
Macaluso, E., Frith, C., & Driver, J. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.5.3062 · Cited by 149 · see citing works
Mechanisms of Within- and Cross-Modality Suppression in the Superior Colliculus
Kadunce, D. C., Vaughan, J. W., Wallace, M. T., Benedek, G., & Stein, B. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.6.2834 · Cited by 149 · see citing works
Banati, R. B. (2000) · Neuropsychologia · doi:10.1016/s0028-3932(99)00074-3 · Cited by 148 · see citing works
Barth, D. S., Goldberg, N., Brett, B. A., & Di, S. (1995) · Brain Research · doi:10.1016/0006-8993(95)00182-p · Cited by 138 · see citing works
A secular decline in the strength of Spearman’s g in Japan
Lynn, R., & Cooper, C. (1994) · Current Psychology · doi:10.1007/bf02686854 · Cited by 127 · see citing works
Multisensory Integration and Crossmodal Attention Effects in the Human Brain
McDonald, J. J., Teder-Sälejärvi, W. A., & Ward, L. M. (2001) · Science · doi:10.1126/science.292.5523.1791a · Cited by 115 · see citing works
Superior Colliculus: Visuotopic-Somatotopic Overlap
Stein, B. E., Magalhães-Castro, B., & Kruger, L. (1975) · Science · doi:10.1126/science.1094540 · Cited by 110 · see citing works
Analysis of Neural Interactions Explains the Activation of Occipital Cortex by an Auditory Stimulus
McIntosh, A. R., Cabeza, R. E. L., & Lobaugh, N. J. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.5.2790 · Cited by 105 · see citing works
Callan, D. E., Callan, A. M., Kroos, C. H., & Vatikiotis‐Bateson, E. (2001) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00054-9 · Cited by 105 · see citing works
Gaffan, D., & HARRISON, S. (1991) · Brain · doi:10.1093/brain/114.5.2133 · Cited by 103 · see citing works
Audio–visual speech perception in schizophrenia: an fMRI study
Surguladze, S. A., Calvert, G. A., Brammer, M. J., Campbell, R., Bullmore, E. T., Giampietro, V., & David, A. S. (2001) · Psychiatry Research Neuroimaging · doi:10.1016/s0925-4927(00)00081-0 · Cited by 86 · see citing works
Self-citationVisual and somatosensory processing in the macaque temporal cortex: the role of ?expectation?
Mistlin, A. J., & Perrett, D. I. (1990) · Experimental Brain Research · doi:10.1007/bf00231263 · Cited by 80 · see citing works
The experimental development of color-tone synesthesia.
Howells, T. H. (1944) · Journal of Experimental Psychology · doi:10.1037/h0054424 · Cited by 75 · see citing works
Prefrontal unit activity of macaque monkeys during auditory and visual reaction time tasks
Ito, S.-I. (1982) · Brain Research · doi:10.1016/0006-8993(82)91025-3 · Cited by 68 · see citing works
Can attention be directed to opposite locations in different modalities? An ERP study
Eimer, M. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00052-8 · Cited by 62 · see citing works
Visual-auditory interactions in cat superior colliculus: their role in the control of gaze
Peck, C. K. (1987) · Brain Research · doi:10.1016/0006-8993(87)90253-8 · Cited by 57 · see citing works
Time-Dependent Changes in Learning Audiovisual Associations: A Single-Trial fMRI Study
Gonzalo, D., Shallice, T., & Dolan, R. J. (2000) · NeuroImage · doi:10.1006/nimg.2000.0540 · Cited by 54 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Dynamic mapping of human cortical development during childhood through early adulthood
Gogtay, N., Giedd, J. N., Lusk, L., Hayashi, K. M., Greenstein, D., Vaituzis, A. C., Nugent, T. F., Herman, D. H., Clasen, L. S., Toga, A. W., et al. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0402680101 · Cited by 5,604 · see citing works
Brain development in children and adolescents: Insights from anatomical magnetic resonance imaging
Lenroot, R. K., & Giedd, J. N. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.06.001 · Cited by 1,863 · see citing works
Structural magnetic resonance imaging of the adolescent brain
GIEDD, J. N. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1308.009 · Cited by 1,610 · see citing works
The emulation theory of representation: Motor control, imagery, and perception
Grush, R. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000093 · Cited by 1,387 · see citing works
Cross-modal plasticity: where and how?
Bavelier, D., & Neville, H. J. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn848 · Cited by 1,040 · see citing works
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828 · see citing works
Anterior insular cortex and emotional awareness
Gu, X., Hof, P. R., Friston, K. J., & Fan, J. (2013) · Journal of Comparative Neurology · doi:10.1002/cne.23368 · Cited by 712 · see citing works
Odor/taste integration and the perception of flavor
Small, D. M., & Prescott, J. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2376-9 · Cited by 712 · see citing works
Development of neural mechanisms for reading.
Turkeltaub, P. E., Gareau, L., Flowers, D. L., Zeffiro, T. A., & Eden, G. F. (2003) · Nature Neuroscience · doi:10.1038/nn1065 · Cited by 707 · see citing works
Ptak, R. (2012) · The Neuroscientist · doi:10.1177/1073858411409051 · Cited by 597 · see citing works
Unraveling multisensory integration: patchy organization within human STS multisensory cortex
Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004) · Nature Neuroscience · doi:10.1038/nn1333 · Cited by 513 · see citing works
Experience-dependent neural integration of taste and smell in the human brain
Small, D. M., Voss, J., Mak, Y. E., Simmons, K. B., Parrish, T., & Gitelman, D. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00050.2004 · Cited by 398 · see citing works
Stepwise Connectivity of the Modal Cortex Reveals the Multimodal Organization of the Human Brain
Sepulcre, J., Sabuncu, M. R., Yeo, T. B., Liu, H., & Johnson, K. A. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0759-12.2012 · Cited by 323 · see citing works
The contribution of the insula to motor aspects of speech production: A review and a hypothesis
Ackermann, H., & Riecker, A. (2004) · Brain and Language · doi:10.1016/s0093-934x(03)00347-x · Cited by 343 · see citing works
Derrfuss, J., Brass, M., & Yves von Cramon, D. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.06.007 · Cited by 312 · see citing works
Integration of Visual and Tactile Signals From the Hand in the Human Brain: An fMRI Study
Gentile, G., Petkova, V. I., & Ehrsson, H. H. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00840.2010 · Cited by 274 · see citing works
Selective and invariant neural responses to spoken and written narratives
Regev, M., Honey, C. J., Simony, E., & Hasson, U. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1580-13.2013 · Cited by 215 · see citing works
Clinical effects of insular damage in humans
Ibañez, A., Gleichgerrcht, E., & Manes, F. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0256-y · Cited by 217 · see citing works
The multisensory function of the human primary visual cortex
Murray, M. M., Thelen, A., Thut, G., Romei, V., Martuzzi, R., & Matusz, P. J. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.08.011 · Cited by 219 · see citing works
Touch, sound and vision in human superior temporal sulcus
Beauchamp, M. S., Yasar, N. E., Frye, R. E., & Ro, T. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.015 · Cited by 208 · see citing works
Color of Scents: Chromatic Stimuli Modulate Odor Responses in the Human Brain
Österbauer, R. A., Matthews, P. M., Jenkinson, M., Beckmann, C. F., Hansen, P. C., & Calvert, G. A. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00555.2004 · Cited by 193 · see citing works
Self-citationBebko, J. M., Weiss, J. A., Demark, J. L., & Gomez, P. (2006) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2005.01443.x · Cited by 189 · see citing works
Multisensory integration mechanisms during aging
Freiherr, J., Lundström, J. N., Habel, U., & Reetz, K. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00863 · Cited by 173 · see citing works
Assessing infants' cortical response to speech using near-infrared spectroscopy
Bortfeld, H., Wruck, E., & Boas, D. A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.010 · Cited by 169 · see citing works
Perceiving the World Through Group-Colored Glasses: A Perceptual Model of Intergroup Relations
Xiao, Y. J., Coppin, G., & Van Bavel, J. J. (2016) · Psychological Inquiry · doi:10.1080/1047840x.2016.1199221 · Cited by 121 · see citing works
Integration of Bimodal Looming Signals through Neuronal Coherence in the Temporal Lobe
Maier, J. X., Chandrasekaran, C., & Ghazanfar, A. A. (2008) · Current Biology · doi:10.1016/j.cub.2008.05.043 · Cited by 117 · see citing works
Shao, Y., Wang, L., Ye, E., Jin, X., Ni, W., Yang, Y., Wen, B., Hu, D., & Yang, Z. (2013) · PLoS ONE · doi:10.1371/journal.pone.0078830 · Cited by 110 · see citing works
Tanaka, C., Matsui, M., Uematsu, A., Noguchi, K., & Miyawaki, T. (2012) · Developmental Neuroscience · doi:10.1159/000345152 · Cited by 101 · see citing works
Temporal synchrony and integration of sub-threshold taste and smell signals
Pfeiffer, J. C., Hollowood, T. A., Hort, J., & Taylor, A. J. (2005) · Chemical Senses · doi:10.1093/chemse/bji047 · Cited by 94 · see citing works
Stanney, K., Samman, S., Reeves, L., Hale, K., Buff, W., Bowers, C., Goldiez, B., Nicholson, D., & Lackey, S. (2004) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1702_7 · Cited by 65 · see citing works
The role of the human anterior insular cortex in time processing
Kosillo, P., & Smith, A. T. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0267-8 · Cited by 59 · see citing works
Wible, C. G. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00180 · Cited by 56 · see citing works
McNorgan, C., Randazzo-Wagner, M., & Booth, J. R. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00388 · Cited by 46 · see citing works
Identification and integration of sensory modalities: Neural basis and relation to consciousness
Pennartz, C. M. A. (2009) · Consciousness and Cognition · doi:10.1016/j.concog.2009.03.003 · Cited by 40 · see citing works
Hertz, U., & Amedi, A. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.04.186 · Cited by 43 · see citing works
Pennartz, C. M. A. (2022) · Behavioural Brain Research · doi:10.1016/j.bbr.2022.113969 · Cited by 40 · see citing works
Russo, N., Mottron, L., Burack, J. A., & Jemel, B. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.05.003 · Cited by 35 · see citing works
Jao Keehn, R. J., Pueschel, E. B., Gao, Y., Jahedi, A., Alemu, K., Carper, R., Fishman, I., & Müller, R.-A. (2021) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2020.02.007 · Cited by 34 · see citing works
Salience network activity in perceptual decisions
Lamichhane, B., Adhikari, B. M., & Dhamala, M. (2016) · Brain Connectivity · doi:10.1089/brain.2015.0392 · Cited by 33 · see citing works
Neural dynamics of learning sound-action associations
McNamara, A., Buccino, G., Menz, M. M., Gläscher, J., Wolbers, T., Baumgärtner, A., & Binkofski, F. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003845 · Cited by 25 · see citing works
“This, as well as the lack of activation in the multi-sensory regions of the superior temporal sulcus sensitive to human movement [54–56] might be due to the stimuli not having common features across modalities [57].”
BackgroundSpatiotemporal integration of looming visual and tactile stimuli near the face
Huang, R., Chen, C., & Sereno, M. I. (2018) · Human Brain Mapping · doi:10.1002/hbm.23995 · Cited by 17 · see citing works
Naumer, M. J., van den Bosch, J. J. F., Wibral, M., Kohler, A., Singer, W., Kaiser, J., van de Ven, V., & Muckli, L. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2669-0 · Cited by 11 · see citing works
- Authors
- Calvert, G. A.
- Affiliations
- John Radcliffe Hospital (GB)
- Corresponding author
- Calvert, G. A.
- ORCID
- Calvert, G. A.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2001-12-01
- Volume
- 11
- Issue
- 12
- Pages
- 1110-1123
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2007428019
- Cited by
- 1,012
- References
- 83
- Citations by year
- 2026: 13 · 2025: 45 · 2024: 23 · 2023: 26 · 2022: 32 · 2021: 37 · 2020: 34 · 2019: 37 · 2018: 34 · 2017: 31 · 2016: 41 · 2015: 48 · 2014: 36 · 2013: 57 · 2012: 52
- FWCI
- 33.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- multisensory integration, audiovisual integration, superior temporal sulcus, insula, claustrum, frontal cortex, conjunction analysis, event-related potentials, magnetoencephalography, positron emission tomography, functional MRI
- MeSH terms
- Brain, Humans, Magnetic Resonance Imaging, Mental Processes, Perception, Tomography, Emission-Computed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review