Neural correlates of cross-modal binding
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Little is known about how the brain binds together signals from multiple sensory modalities to produce unified percepts of objects and events in the external world. Using event-related functional magnetic resonance imaging (fMRI) in humans, we measured transient brain responses to auditory/visual binding, as evidenced by a sound-induced change in visual motion perception. Identical auditory and visual stimuli were presented in all trials, but in some trials they were perceived to be bound together and in others they were perceived as unbound unimodal events. Cross-modal binding was associated with higher activity in multimodal areas, but lower activity in predominantly unimodal areas. This activation pattern suggests that a reciprocal and 'competitive' interaction between multimodal and unimodal areas underlies the perceptual interpretation of simultaneous signals from multiple sensory modalities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“Studies of perceptual illusions such as the ventriloquist and McGurk effects (in which conflicting multisensory information is erroneously perceived to be bound together) suggest that cross-modal binding is a fast, pre-attentive process that occurs without the subject's awarenes”
BackgroundEvent-Related fMRI: Characterizing Differential Responses
Friston, K. J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M. D., & Turner, R. (1998) · NeuroImage · doi:10.1006/nimg.1997.0306 · Cited by 2,029 · cited 1×
“Data were analyzed using the general linear model (as implemented in SPM99) with a multiple regression design matrix including separate hemodynamic response functions and their temporal derivatives for each event (collide trials, pass trials and motor responses”
MethodWatson, J. D. G., Myers, R., Frackowiak, R. S. J., Hajnal, J. V., Woods, R. P., Mazziotta, J. C., Shipp, S., & Zeki, S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.2.79 · Cited by 1,234 · cited 1×
“As expected, we found significant activations in multimodal brain areas as well as auditory and visual areas, including a region in the occipitotemporal region previously identified as the 'human visual motion area”
BackgroundSound alters visual motion perception
Sekuler, R., Sekuler, A. B., & Lau, R. (1997) · Nature · doi:10.1038/385308a0 · Cited by 685
The mind's eye – precuneus activation in memory-related imagery
Fletcher, P. C., Frith, C. D., Baker, S. C., Shallice, T., Frackowiak, R. S. J., & Dolan, R. J. (1995) · NeuroImage · doi:10.1006/nimg.1995.1025 · Cited by 680 · cited 1×
“These were all in occipital and temporal areas, except for the precuneus—an area known to be active during visual imager”
BackgroundModulation of Human Visual Cortex by Crossmodal Spatial Attention
Macaluso, E., Frith, C. D., & Driver, J. (2000) · Science · doi:10.1126/science.289.5482.1206 · Cited by 613
Cross-modal and cross-temporal association in neurons of frontal cortex
Fuster, J. M., Bodner, M., & Kroger, J. K. (2000) · Nature · doi:10.1038/35012613 · Cited by 528
The cost of expecting events in the wrong sensory modality
Spence, C., Nicholls, M. E. R., & Driver, J. (2001) · Perception & Psychophysics · doi:10.3758/bf03194473 · Cited by 467 · cited 1×
“Therefore, if the sound-induced change in visual perception shown in the current study was due to trial-to-trial attentional shifts to either modalit”
BackgroundCalvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0812 · Cited by 464
Event-related functional magnetic resonance imaging: modelling, inference and optimization
Josephs, O., & Henson, R. N. A. (1999) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1999.0475 · Cited by 425 · cited 1×
“Data were analyzed using the general linear model (as implemented in SPM99) with a multiple regression design matrix including separate hemodynamic response functions and their temporal derivatives for each event (collide trials, pass trials and motor responses”
Method
Cited by
Visual speech speeds up the neural processing of auditory speech
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408949102 · Cited by 854
Ehrsson, H. H., Holmes, N. P., & Passingham, R. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0800-05.2005 · Cited by 784
Odor/taste integration and the perception of flavor
Small, D. M., & Prescott, J. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2376-9 · Cited by 712
“…PO Box 6811, Cairns, QLD, 4870, Australia E-mail: John.Prescott@jcu.edu.au 1997, 1999, 2000, 2001; Lewis et al. 2000; Macaluso et al. 2000; Bushara et al. 2001; Calvert 2001; Laurienti et al. 2002; Bushara et al. 2003; Calvert and Campbell 2003; Lewald and Guski 2003; McDonald et al. 2003).”
BackgroundMenon, V. (2015) · Brain Mapping · doi:10.1016/b978-0-12-397025-1.00052-x · Cited by 625
Oscillatory synchronization in large-scale cortical networks predicts perception
Hipp, J. F., Engel, A. K., & Siegel, M. (2011) · Neuron · doi:10.1016/j.neuron.2010.12.027 · Cited by 599
“…(Fogassi et al., 1996; Graziano et al., 1994, 1999; Lemus et al., 2009), and temporal regions are involved in the cross-modal integration of audiovisual stimuli (Barraclough et al., 2005; Bushara et al., 2003; Dahl et al., 2009; Maier et al., 2008; Noesselt et al., 2007; Schneider et al., 2008).”
Correlates of alpha rhythm in functional magnetic resonance imaging and near infrared spectroscopy
Moosmann, M., Ritter, P., Krastel, I., Brink, A., Thees, S., Blankenburg, F., Taskin, B., Obrig, H., & Villringer, A. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00344-6 · Cited by 594
Recalibration of audiovisual simultaneity
Fujisaki, W., Shimojo, S., Kashino, M., & Nishida, S. (2004) · Nature Neuroscience · doi:10.1038/nn1268 · Cited by 591
Hanakawa, T., Dimyan, M. A., & Hallett, M. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn036 · Cited by 563
Self-citationIntegration of Letters and Speech Sounds in the Human Brain
van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.025 · Cited by 544
Integrating face and voice in person perception
Campanella, S., & Belin, P. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.10.001 · Cited by 527
“These two mechanisms could be engaged in a reciprocal, complementary interaction involving multimodal and unimodal areas, depending on the exact nature of the task and stimuli, that could underlie the perceptual interpretation of simultaneous signals from multiple sensory modalities in general [ 69 ].”
Experience-dependent neural integration of taste and smell in the human brain
Small, D. M., Voss, J., Mak, Y. E., Simmons, K. B., Parrish, T., & Gitelman, D. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00050.2004 · Cited by 398
“…between sensory-specific cortex and heteromodal neocortex (Calvert 2001) with increases in heteromodal regions either being associated with increases (Calvert et al. 1999; Macaluso et al. 2000) or decreases (Bushara et al. 2003; Laurienti et al. 2002) in unimodal sensory-specific cortex.”
BackgroundInfluentialPerceptual Training Narrows the Temporal Window of Multisensory Binding
Powers, A. R., Hillock, A. R., & Wallace, M. T. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-09.2009 · Cited by 333
“…of recent studies point to the presence of a large, dynamic network of areas that includes the insula, posterior parietal, and superior temporal cortices as being critical in the perception of audiovisual simultaneity (Bushara et al., 2001, 2003; Calvert et al., 2001; Noesselt et al., 2007, 2008).”
BackgroundBarraclough*, N. E., Xiao*, D., Baker, C. I., Oram, M. W., & Perrett, D. I. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053279586 · Cited by 332
“Clinical testing for audiovisual interactions was performed in 20 auditory responsive cells.”
BackgroundMethodInfluentialInteractions between auditory and dorsal premotor cortex during synchronization to musical rhythms
Chen, J. L., Zatorre, R. J., & Penhune, V. B. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.04.207 · Cited by 329
“The polymodal vPMC has been shown to respond to auditory stimuli (Bremmer et al., 2001; Graziano and Gandhi, 2000; Graziano et al., 1999; Schubotz et al., 2003) while the multimodal insula, known to be involved in the temporal integration of sensory stimuli ( Bushara et al., 2001, 2003; Calvert, 2001) and the detectio…”
BackgroundPerceptual Fusion and Stimulus Coincidence in the Cross-Modal Integration of Speech
Miller, L. M., & D'Esposito, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0896-05.2005 · Cited by 322
Semantic congruence is a critical factor in multisensory behavioral performance
Laurienti, P., Kraft, R., Maldjian, J., Burdette, J., & Wallace, M. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-1913-2 · Cited by 303
“Several previous studies have established the utility of this stimulus configuration by demonstrated multisensory enhancement with the use of headphones (Calvert et al. 2000, 2001; Bushara et al. 2003).”
BackgroundVandewalle, G., Gais, S., Schabus, M., Balteau, E., Carrier, J., Darsaud, A., Sterpenich, V., Albouy, G., Dijk, D. J., & Maquet, P. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm007 · Cited by 277
Integration of Visual and Tactile Signals From the Hand in the Human Brain: An fMRI Study
Gentile, G., Petkova, V. I., & Ehrsson, H. H. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00840.2010 · Cited by 274
“This is consistent with the literature on audiovisual perceptual binding in humans, that has shown the importance of interconnected brain regions for the fusion of auditory and visual cues (Bushara et al. 2003).”
ResultAudiovisual multisensory integration
Spence, C. (2007) · Acoustical Science and Technology · doi:10.1250/ast.28.61 · Cited by 251
Spatial and temporal factors during processing of audiovisual speech: a PET study
Macaluso, E., George, N., Dolan, R., Spence, C., & Driver, J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.049 · Cited by 237
Mashiko, T., Otani, K., Kawano, R., Konno, T., Kaneko, N., Ito, Y., & Watanabe, E. (2015) · World Neurosurgery · doi:10.1016/j.wneu.2013.10.032 · Cited by 228
Mullette-Gillman, O. A., Cohen, Y. E., & Groh, J. M. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00021.2005 · Cited by 216
“Multimodal activation has also been found in the human parietal cortex (Bremmer et al. 2001; Bushara et al. 2003; Bushara et al. 1999; Cusack et al. 2000; Deouell et al. 2000; Deouell and Soroker 2000; Griffiths et al. 1998; Warren et al. 2002).”
BackgroundLong-term music training tunes how the brain temporally binds signals from multiple senses
Lee, H., & Noppeney, U. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1115267108 · Cited by 188
Anterior insula activations in perceptual paradigms: often observed but barely understood
Sterzer, P., & Kleinschmidt, A. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0252-2 · Cited by 183
“Finally, AIC activations are also observed in association with one of two possible percepts in situations of perceptual ambiguity, where the salience of one over the other percept is not immediately obvious (Bushara et al. 2003; Carmel et al. 2006).”
BackgroundMethodThe representation of space near the body through touch and vision
Macaluso, E., & Maravita, A. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.10.010 · Cited by 181
The Neural Mechanisms for Minimizing Cross-Modal Distraction
Weissman, D. H., Warner, L. M., & Woldorff, M. G. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3669-04.2004 · Cited by 171
“Because stimuli presented in different sensory modalities are processed in distinct brain regions (Bushara et al., 2003), the present study provided a particularly clear test of this hypothesis.”
BackgroundMultisensory Processing in Sensory-Specific Cortical Areas
Macaluso, E. (2006) · The Neuroscientist · doi:10.1177/1073858406287908 · Cited by 166
Electrophysiological correlates of the BOLD signal for EEG-informed fMRI
Murta, T., Leite, M., Carmichael, D. W., Figueiredo, P., & Lemieux, L. (2015) · Human Brain Mapping · doi:10.1002/hbm.22623 · Cited by 165
“The synchronisation of neuronal networks seems to enable the brain to functionally integrate computations on multiple spatial and temporal scales [Bushara et al., 2003; Buzsaki et al., 2003].”
Cross-modal integration in a dart-poison frog
Narins, P. M., Grabul, D. S., Soma, K. K., Gaucher, P., & Hödl, W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0406407102 · Cited by 161
Superior temporal activation in response to dynamic audio-visual emotional cues
Robins, D. L., Hunyadi, E., & Schultz, R. T. (2009) · Brain and Cognition · doi:10.1016/j.bandc.2008.08.007 · Cited by 149
“These findings are consistent with results from the more extensive literature examining the neural mechanisms of sensory integration, which utilizes paradigms such as the McGurk effect (McGurk & MacDonald, 1976), in which the mouth forms one phoneme which blends with an auditory percept of another phoneme, perception…”
BackgroundResultInfluentialMental Imagery Changes Multisensory Perception
Berger, C. C., & Ehrsson, H. H. (2013) · Current Biology · doi:10.1016/j.cub.2013.06.012 · Cited by 147
Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites
Fairhall, S. L., & Macaluso, E. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06688.x · Cited by 137
“unfused multisensory percepts have failed to observe any activation in this posterior region of the STS (Olson et al., 2002; Bushara et al., 2003; Jones & Callan, 2003; Macaluso et al., 2004; Miller & D’Esposito, 2005; Ojanen et al., 2005 see also Hein & Knight, 2008).”
BackgroundResultInfluentialFeeling the Real World: Limbic Response to Music Depends on Related Content
Eldar, E., Ganor, O., Admon, R., Bleich, A., & Hendler, T. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm011 · Cited by 135
“This is in line with the findings of Bushara et al. (2002) which showed that cross-modal binding of sound and sight involves decreased activation of unimodal auditory and visual areas coupled with increased activation of multimodal areas.”
ResultTemporal frequency characteristics of synchrony–asynchrony discrimination of audio-visual signals
Fujisaki, W., & Nishida, S. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2385-8 · Cited by 152
“Finally, the present findings may contribute to diagnosis in electrophysiology and brain imaging to find neural correlates of perceptual synchrony among many multisensory areas responding to audio-visual signals (Meredith et al. 1987; Bushara et al. 2003).”
BackgroundIntegration of cross-modal emotional information in the human brain: An fMRI study
Park, J., Gu, B.-M., Kang, D., Shin, Y., Choi, C., Lee, J., & Kwon, J. S. (2008) · Cortex · doi:10.1016/j.cortex.2008.06.008 · Cited by 140
Wang, H., He, W., Wu, J., Zhang, J., Jin, Z., & Li, L. (2019) · Brain and Cognition · doi:10.1016/j.bandc.2019.01.002 · Cited by 137
Auditory thalamus integrates visual inputs into behavioral gains
Komura, Y., Tamura, R., Uwano, T., Nishijo, H., & Ono, T. (2005) · Nature Neuroscience · doi:10.1038/nn1528 · Cited by 123
Cue Integration: A Common Framework for Social Cognition and Physical Perception
Zaki, J. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613475454 · Cited by 118
“Neurally, these effects are supported by feedback loops that alter processing in low-level sensory cortex based on a perceiver’s expectations (Beauchamp, Nath, & Pasalar, 2010; Bushara et al., 2003; Driver & Spence, 2000; Skipper, van Wassenhove, Nusbaum, & Small, 2007), and they likely drive the top-down influences o…”
BackgroundChanging pitch induced visual motion illusion
Maeda, F., Kanai, R., & Shimojo, S. (2004) · Current Biology · doi:10.1016/j.cub.2004.11.018 · Cited by 135
Bengtsson, S. L., Ehrsson, H. H., Forssberg, H., & Ullén, F. (2004) · European Journal of Neuroscience · doi:10.1111/j.0953-816x.2004.03269.x · Cited by 116
Supramodal Representation of Emotions
Klasen, M., Kenworthy, C. A., Mathiak, K. A., Kircher, T. T. J., & Mathiak, K. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2833-11.2011 · Cited by 128
“The same applies to the thalamus, which integrates audiovisual stimuli without emotional content (Bushara et al., 2003).”
BackgroundCross-modal interactions between human faces and voices involved in person recognition
Joassin, F., Pesenti, M., Maurage, P., Verreckt, E., Bruyer, R., & Campanella, S. (2010) · Cortex · doi:10.1016/j.cortex.2010.03.003 · Cited by 119
Seeing speech affects acoustic information processing in the human brainstem
Musacchia, G., Sams, M. E., Nicol, T. G., & Kraus, N. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0071-5 · Cited by 117
“Sensory-specific cortices, on the other hand, demonstrate response decrements due to AV interaction ( Bushara et al. 2003; Klucharev and Sams 2004; Saito et al. 2005).”
BackgroundBrighter noise: Sensory enhancement of perceived loudness by concurrent visual stimulation
Odgaard, E. C., Arieh, Y., & Marks, L. E. (2004) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.4.2.127 · Cited by 104
“interactions (e.g. Bushara et al., 2003; Driver, 1996).”
BackgroundDiscrete neural substrates underlie complementary audiovisual speech integration processes
Stevenson, R. A., VanDerKlok, R. M., Pisoni, D. B., & James, T. W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.12.063 · Cited by 95
“Furthermore, perceptual fusion has been shown to modulate multisensory brain activation when manipulated in isolation from synchrony (Bushara et al., 2003).”
The Biological Basis of Audition
Recanzone, G. H., & Sutter, M. L. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093544 · Cited by 95
Impaired timing of audiovisual events in the elderly
Bedard, G., & Barnett‐Cowan, M. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4466-7 · Cited by 112
Functional topography of working memory for face or voice identity
Rämä, P., & Courtney, S. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.08.024 · Cited by 96
“On the other hand, it has been shown that cross-modal binding of auditory and visual information is associated with greater activity in the multimodal areas, such as insula/frontal operculum, dorsolateral frontal, posterior parietal, and superior temporal gyri, but lower activity in the unimodal areas (Bushara et al.,…”
BackgroundRecalibration of the Multisensory Temporal Window of Integration Results from Changing Task Demands
Mégevand, P., Molholm, S., Nayak, A., & Foxe, J. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071608 · Cited by 85
“In humans, the detection of audiovisual synchrony activates a large-scale network including the posterior parietal, superior temporal, prefrontal and insular cortices in addition to early visual and auditory areas and the posterior thalamus and superior colliculus [65–72].”
BackgroundBinder, M. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2015.05.011 · Cited by 98
Panagiotidi, M., Overton, P. G., & Stafford, T. (2017) · Acta Psychologica · doi:10.1016/j.actpsy.2017.10.001 · Cited by 82
Chen, H., Wang, J., Uddin, L. Q., Wang, X., Guo, X., Lu, F., Duan, X., Wu, L., & Chen, H. (2018) · Autism Research · doi:10.1002/aur.2029 · Cited by 89
“multimodal sensory processing (Bushara, Grafman, & Hallett, 2001), sensory binding (Bushara et al., 2003), and motor controlling (Anderson et al.”
BackgroundRegional brain signal variability: a novel indicator of pain sensitivity and coping
Rogachov, A., Cheng, J. C., Erpelding, N., Hemington, K. S., Crawley, A. P., & Davis, K. D. (2016) · Pain · doi:10.1097/j.pain.0000000000000665 · Cited by 92
“Moreover, the SN receives input from different sensory modalities,(7,11) and it involvedmultimodal attention.(10,20) Our finding that regional signal variability within the SN is linked to pain sensitivity hints at the salience of greater flexibility within the salience/ventral attention network,(40) possibly allowing…”
BackgroundSaito, D. N., Yoshimura, K., Kochiyama, T., Okada, T., Honda, M., & Sadato, N. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi052 · Cited by 81
“Bushara et al. (2003) measured transient brain responses to audio-visual binding, seen during a sound-induced change in visual motion percep- tion.”
BackgroundResultThe Fusion of Mental Imagery and Sensation in the Temporal Association Cortex
Berger, C. C., & Ehrsson, H. H. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0943-14.2014 · Cited by 79
“, 2004a, 2004b) and in studies on the perceptual effects of audiovisual integration (Bushara et al., 2003; Bischoff et al., 2007; Stevenson and James, 2009; Werner and Noppeney, 2010b; Marchant et al., 2012).”
BackgroundInfluentialChen, T., Michels, L., Supekar, K., Kochalka, J., Ryali, S., & Menon, V. (2015) · European Journal of Neuroscience · doi:10.1111/ejn.12764 · Cited by 76
“…that the rAI plays a causal role in attention to salient unisensory stimuli (Sridharan et al., 2008), and on converging evidence for its involvement in multisensory attention (Bushara et al., 2001, 2003), we hypothesised that this region integrates control signals during multisensory attention.”
Episodic Memory formation: A review of complex Hippocampus input pathways
Danieli, K., Guyon, A., & Bethus, I. (2023) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2023.110757 · Cited by 100
Binding of movement, sound and touch: multimodal coordination dynamics
Lagarde, J., & Kelso, J. A. S. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0410-1 · Cited by 89
“In recent years, however, multisensory integration or multimodal binding, has become a prominent focus of studies of perception (Bushara et al. 2003; Calvert 2001; Calvert et al. 2004; Driver and Spence 2000; Meredith 2002; Meredith and Stein 1983; Stein 1998).”
BackgroundFatigue in multiple sclerosis is associated with multimodal interoceptive abnormalities
Gonzalez Campo, C., Salamone, P. C., Rodríguez-Arriagada, N., Richter, F., Herrera, E., Bruno, D., Pagani Cassara, F., Sinay, V., García, A. M., Ibáñez, A., et al. (2020) · Multiple Sclerosis Journal · doi:10.1177/1352458519888881 · Cited by 70
Audio‐visual speech perception: a developmental ERP investigation
Knowland, V. C. P., Mercure, E., Karmiloff‐Smith, A., Dick, F., & Thomas, M. S. C. (2013) · Developmental Science · doi:10.1111/desc.12098 · Cited by 79
“Experimental evidence from fMRI studies supports the theoretical notion of competition between unisensory and multisensory areas (Bushara et al., 2003).”
Yiannakas, A., & Rosenblum, K. (2017) · Frontiers in Molecular Neuroscience · doi:10.3389/fnmol.2017.00335 · Cited by 79
“…a hub of integration of information regarding sensory perception, hedonic and novelty aspects of experiences, with bodily information to facilitate decisionmaking and abstract though (Pritchard et al., 1999; Craig et al., 2000; Bushara et al., 2001, 2003; Baliki et al., 2009; Ibanez et al., 2010).”
BackgroundNeural and behavioral correlates of auditory categorization
Russ, B. E., Lee, Y. S., & Cohen, Y. E. (2007) · Hearing Research · doi:10.1016/j.heares.2006.10.010 · Cited by 72
“…1997; Tardif and Clarke, 2001), neurophysiological (Alain et al., 2001; Anourova et al., 2001; Baumgart et al., 1999; Bremmer et al., 2001a,b; Bushara et al., 2003, 1999; Cusack et al., 2000; Deouell and Soroker, 2000a; Deouell et al., 2000b; Griffiths et al., 1998; Hart et al., 2004; Maeder…”
BackgroundNeural responses elicited to face motion and vocalization pairings
Puce, A., Epling, J. A., Thompson, J. C., & Carrick, O. K. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.04.017 · Cited by 70
“However, it is possible that these regions might also play a role in the binding of audio-visual non-speech stimuli (Bushara et al., 2003), in a study where a high-level motion stimulus was presented.”
BackgroundAuditory and multisensory aspects of visuospatial neglect
Pavani, F., Làdavas, E., & Driver, J. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00189-x · Cited by 67
Blau, V. C., van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06350.x · Cited by 72
“Modulation of FG by congruency has been previously reported in studies using audiovisual speech (Calvert et al., 2000; Bushara et al., 2003; Macaluso et al., 2004).”
BackgroundResultJoassin, F., Maurage, P., & Campanella, S. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.08.073 · Cited by 66
“On the other hand, the alternative hypothesis proposes that the crossmodal integration of faces and voices relies on the activation of a neural network including supramodal convergence regions (Driver and Spence, 2000; Bushara et al., 2003).”
Vidal, J., Giard, M., Roux, S., Barthélémy, C., & Bruneau, N. (2008) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.11.178 · Cited by 70
“This interpretation is in agreement with functional MRI findings showing that when attention is directed at one modality, the brain responses to bimodal events decrease in the sensory cortex of the unattended modality (Bushara et al., 2003; Johnson and Zatorre, 2005; Laurienti et al., 2002; Wright et al., 2003).”
ResultThe effects of attention on the temporal integration of multisensory stimuli
Donohue, S. E., Green, J. J., & Woldorff, M. G. (2015) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2015.00032 · Cited by 67
“…the enhanced perception of bouncing in the bounce/stream task by demonstrating the involvement of multisensory regions in the ‘‘bounce’’ percept (Bushara et al., 2003; Maniglia et al., 2012) and the role that the attributes of the sound stimuli play in these judgments (Grassi and Casco,…”
BackgroundInfluentialCerebro-cerebellar Interactions Underlying Temporal Information Processing
Aso, K., Hanakawa, T., Aso, T., & Fukuyama, H. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21429 · Cited by 62
“The insula is associated with various sensorimotor functions, including auditory/phonological information processing (Bamiou, Musiek, & Luxon, 2003) and visual–auditory interactions (Bushara et al., 2003).”
BackgroundSelf-citationSenkowski, D., Gomez‐Ramirez, M., Lakatos, P., Wylie, G. R., Molholm, S., Schroeder, C. E., & Foxe, J. J. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0664-7 · Cited by 61
Vleet, T. V., & Robertson, L. C. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.8.1368 · Cited by 60
“Cross-modal modulations of primary sensory and extrastriate areas in the intact brain likely represent reentrant feedback from higher intermodal areas such as the superior temporal gyrus, intraparietal sulcus, and inferior frontal lobe ( Bushara et al., 2003; Saito, Okada, Morita, Yonekura, & Sadato, 2003; Macaluso et…”
BackgroundCrossmodal integration – insights from the chemical senses
Small, D. M. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.002 · Cited by 56
Leo, F., Bertini, C., di Pellegrino, G., & Làdavas, E. (2007) · Experimental Brain Research · doi:10.1007/s00221-007-1204-9 · Cited by 67
“In recent years, neuroimaging studies in humans have identified several cortical sites [among others, the insula, the superior temporal sulcus, the intraparietal sulcus, and several frontal regions (Calvert 2001; Bushara et al. 2003; Calvert and Thesen 2004; Macaluso and Driver 2005)] associated with multisensory spat…”
BackgroundAuditory Processing in the Posterior Parietal Cortex
Cohen, Y. E., Russ, B. E., & Gifford, G. W. (2005) · Behavioral and Cognitive Neuroscience Reviews · doi:10.1177/1534582305285861 · Cited by 52
“, 1996) and human (Bremmer, Schlack, Duhamel, Graf, & Fink, 2001; Bremmer, Schlack, Jon Shah, et al., 2001; Bushara et al., 2003; Bushara et al., 1999; Cusack, Carlyon, & Robertson, 2000; Deouell, Hamalainen, & Bentin, 2000; Deouell & Soroker, 2000; Griffiths, Rees, et al., 1998; Warren, Zielinski, Green, Rauschecker,…”
EEG Alpha and Gamma Modulators Mediate Motion Sickness-Related Spectral Responses
Chuang, S.-W., Chuang, C., Yu, Y.-H., King, J., & Lin, C. (2016) · International Journal of Neural Systems · doi:10.1142/s0129065716500076 · Cited by 58
Idiomatic expressions evoke stronger emotional responses in the brain than literal sentences
CITRON, F. M. M., Cacciari, C., Funcke, J., Hsu, C., & Jacobs, A. M. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.05.020 · Cited by 66
An acquired deficit of audiovisual speech processing
Hamilton, R. H., Shenton, J. T., & Coslett, H. B. (2006) · Brain and Language · doi:10.1016/j.bandl.2006.02.001 · Cited by 47
Multimodal activity in the parietal cortex
Cohen, Y. E. (2009) · Hearing Research · doi:10.1016/j.heares.2009.01.011 · Cited by 47
“Moreover, and key for this review, both nonhuman and human studies have demonstrated that the parietal cortex is activated during tasks that use auditory or visual stimuli (Ahveninen et al., 2006; Bremmer et al., 2001a; Bremmer et al., 2001b; Bushara et al., 2003; Bushara et al., 1999; Butters et al., 1970; Cohen et a…”
BackgroundValenza, N., Murray, M. M., Ptak, R., & Vuilleumier, P. O. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.05.001 · Cited by 50
“, touch and vision (Grefkes, Weiss, Zilles, & Fink, 2002 ), or audition and vision (Bushara et al., 2003 ; Dolan, Morris, & de Gelder, 2001)—based on some common map of locations.”
BackgroundThe activity in the anterior insulae is modulated by perceptual decision-making difficulty
Lamichhane, B., Adhikari, B. M., & Dhamala, M. (2016) · Neuroscience · doi:10.1016/j.neuroscience.2016.04.016 · Cited by 50
“These regions showed greater responses during asynchronous stimulus presentation as in the study by Bushara and colleagues (Bushara et al., 2003).”
Functional neural anatomy of talent
Kalbfleisch, M. L. (2004) · The Anatomical Record Part B: The New Anatomist · doi:10.1002/ar.b.20010 · Cited by 45
“Principles of cognitive binding and cross-modal interactive processing in the brain may eventually lead us to a greater understanding of individual differences in the fluency and speed of cognitive performance in areas of general or specific talent (Treisman, 1996; Fuster et al., 2000; Bushara et al., 2003; Laurienti…”
BackgroundJaffe‐Dax, S., Kimel, E., & Ahissar, M. (2018) · eLife · doi:10.7554/elife.30018 · Cited by 40
“The right insular cortex is multi-modal (Bushara et al., 2003), and is also involved in introspection (Craig et al., 2000).”
BackgroundA Hypothesis about the Biological Basis of Expert Intuition
Chassy, P., & Gobet, F. R. (2011) · Review of General Psychology · doi:10.1037/a0023958 · Cited by 55
“Finally, as noted above, the characteristic of high distributivity is important; a cell assembly can activate neurons distributed in different brain areas (Bushara et al., 2003).”
BackgroundMultisensory integration in the mammalian brain: diversity and flexibility in health and disease
Choi, I., Demir, I., Oh, S., & Lee, S. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2022.0338 · Cited by 42
“In an fMRI study on human subjects judging whether two bars passed or collided with each other, a collision sound presented together with visual stimuli in some trials evoked more activity in the posterior thalamus when subjects perceived collision in audiovisual trials [36].”
BackgroundMeyerhoff, H. S., & Huff, M. (2015) · Memory & Cognition · doi:10.3758/s13421-015-0575-6 · Cited by 50
“Tübingen, Germany the brain but less in the corresponding unimodal areas (Bushara et al., 2003).”
BackgroundCross‐modal temporal order memory for auditory digits and visual locations: An fMRI study
Zhang, D., Zhang, X., Sun, X., Li, Z., Wang, Z., He, S., & Hu, X. (2004) · Human Brain Mapping · doi:10.1002/hbm.20036 · Cited by 40
“…cortical areas, mainly the prefrontal cortex (PFC) and the intraparietal lobule are involved in cross-modal integration [Badgaiyan et al., 2001; Bushara et al., 2003; Calvert et al., 2000; Downar et al., 2000; Klingberg and Roland, 1998; Laurienti et al., 2003], and the PFC and premotor cortex…”
BackgroundDark brain energy: Toward an integrative model of spontaneous slow oscillations
Gong, Z.-Q., & Zuo, X. (2025) · Physics of Life Reviews · doi:10.1016/j.plrev.2025.02.001 · Cited by 50
Effects of the orientation of moving objects on the perception of streaming/bouncing motion displays
Kawabe, T., & Miura, K. (2006) · Perception & Psychophysics · doi:10.3758/bf03193698 · Cited by 43
“…auditory signals at coincidence might be utilized to interpret an ambiguous streaming/bouncing display when combined with a visual signal; their results have been replicated and supported in later studies (Bushara et al., 2003; Scheier, Lewkowics, & Shimojo, 2003; Watanabe & Shimojo, 2001a, 2001b).”
MethodResultYeo, S. S., Kwon, J. W., & Park, G. Y. (2022) · Scientific Reports · doi:10.1038/s41598-022-21307-z · Cited by 48
van Gelderen, P., Duyn, J. H., Ramsey, N. F., Liu, G., & MOONEN, C. T. W. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.017 · Cited by 44
Li, Y., Wang, F., Chen, Y., Cichocki, A. S., & B, T. J. S. A. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx235 · Cited by 43
“been identified to be associated with audiovisual integration (Calvert et al. 2000; Frassinetti et al. 2002; Bushara et al. 2003).”
BackgroundEye closure enhances dark night perceptions
Brodoehl, S., Klingner, C. M., & Witte, O. W. (2015) · Scientific Reports · doi:10.1038/srep10515 · Cited by 43
Multisensory perception as an associative learning process
Connolly, K. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01095 · Cited by 36
“…multimodal perception results from an associative learning process, on the other hand, is consistent with several 1O’Callaghan adds to this list: Bushara et al. (2003), Bertelson and de Gelder (2004), Spence and Driver (2004), Spence (2007), and Stein (2012). other theories in the…”
ResultO’Callaghan, C. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9780262027786.003.0004 · Cited by 52
“See also, for example, Bushara et al. (2003); Bertelson and de Gelder (2004); Spence and Driver (2004); Spence (2007); Stein (2012).”
BackgroundEffects of sentence context and expectation on the McGurk illusion
Windmann, S. (2003) · Journal of Memory and Language · doi:10.1016/j.jml.2003.10.001 · Cited by 46
A shared neural network for simple reaction time
Kansaku, K., Hanakawa, T., Wu, T., & Hallett, M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.02.006 · Cited by 42
Self-citationSalami, A., Andreu-Pérez, J., & Gillmeister, H. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.08.011 · Cited by 57
Brain structures activated by overt and covert emotional visual stimuli
Sabatini, E., Penna, S. D., Franciotti, R., Ferretti, A., Zoccolotti, P., Rossini, P. M., Romani, G. L., & Gainotti, G. (2009) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2009.03.001 · Cited by 38
Ivanoff, J., Branning, P., & Marois, R. (2009) · Human Brain Mapping · doi:10.1002/hbm.20837 · Cited by 34
“This is consistent with the proposed role of the insula in crossmodal processing [e.g., Bushara et al., 2003; Calvert, 2001] and general task-set implementation [Dosenbach et al., 2007].”
ResultAttention periodically samples competing stimuli during binocular rivalry
Davidson, M., Alais, D., Tsuchiya, N., & van Boxtel, J. J. A. (2018) · eLife · doi:10.7554/elife.40868 · Cited by 36
Metadata
- Authors
- Bushara, K. O., Hanakawa, T., Immisch, I., Toma, K., Kansaku, K., & Hallett, M.
- Affiliations
- Minneapolis VA Health Care System (US)
- National Institutes of Health (US)
- Corresponding author
- Bushara, Khalafalla O.
- Venue
- Nature Neuroscience
- Published
- 2002-12-23
- Volume
- 6
- Issue
- 2
- Pages
- 190-195
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2089488430
- Cited by
- 226
- References
- 16
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 4 · 2023: 6 · 2022: 10 · 2021: 4 · 2020: 11 · 2019: 12 · 2018: 10 · 2017: 12 · 2016: 10 · 2015: 7 · 2014: 6 · 2013: 12 · 2012: 11
- FWCI
- 18.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- cross-modal binding, multisensory integration, neural correlates, perceptual binding, event-related fMRI
- MeSH terms
- Acoustic Stimulation, Auditory Perception, Brain, Brain Mapping, Female, Humans, Functional Laterality, Magnetic Resonance Imaging, Male, Motion Perception, Nerve Net, Neural Pathways, Neurons, Neuropsychological Tests, Photic Stimulation, Psychomotor Performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.