Neural correlates of cross-modal binding
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Little is known about how the brain binds together signals from multiple sensory modalities to produce unified percepts of objects and events in the external world. Using event-related functional magnetic resonance imaging (fMRI) in humans, we measured transient brain responses to auditory/visual binding, as evidenced by a sound-induced change in visual motion perception. Identical auditory and visual stimuli were presented in all trials, but in some trials they were perceived to be bound together and in others they were perceived as unbound unimodal events. Cross-modal binding was associated with higher activity in multimodal areas, but lower activity in predominantly unimodal areas. This activation pattern suggests that a reciprocal and 'competitive' interaction between multimodal and unimodal areas underlies the perceptual interpretation of simultaneous signals from multiple sensory modalities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · cited 1×
“Studies of perceptual illusions such as the ventriloquist and McGurk effects (in which conflicting multisensory information is erroneously perceived to be bound together) suggest that cross-modal binding is a fast, pre-attentive process that occurs without the subject's awarenes”
BackgroundEvent-Related fMRI: Characterizing Differential Responses
Friston, K. J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M. D., & Turner, R. (1998) · NeuroImage · doi:10.1006/nimg.1997.0306 · Cited by 2,029 · cited 1×
“Data were analyzed using the general linear model (as implemented in SPM99) with a multiple regression design matrix including separate hemodynamic response functions and their temporal derivatives for each event (collide trials, pass trials and motor responses”
MethodWatson, J. D. G., Myers, R., Frackowiak, R. S. J., Hajnal, J. V., Woods, R. P., Mazziotta, J. C., Shipp, S., & Zeki, S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.2.79 · Cited by 1,234 · cited 1×
“As expected, we found significant activations in multimodal brain areas as well as auditory and visual areas, including a region in the occipitotemporal region previously identified as the 'human visual motion area”
BackgroundSound alters visual motion perception
Sekuler, R., Sekuler, A. B., & Lau, R. (1997) · Nature · doi:10.1038/385308a0 · Cited by 685
The mind's eye – precuneus activation in memory-related imagery
Fletcher, P. C., Frith, C. D., Baker, S. C., Shallice, T., Frackowiak, R. S. J., & Dolan, R. J. (1995) · NeuroImage · doi:10.1006/nimg.1995.1025 · Cited by 680 · cited 1×
“These were all in occipital and temporal areas, except for the precuneus—an area known to be active during visual imager”
BackgroundModulation of Human Visual Cortex by Crossmodal Spatial Attention
Macaluso, E., Frith, C. D., & Driver, J. (2000) · Science · doi:10.1126/science.289.5482.1206 · Cited by 613
Cross-modal and cross-temporal association in neurons of frontal cortex
Fuster, J. M., Bodner, M., & Kroger, J. K. (2000) · Nature · doi:10.1038/35012613 · Cited by 528
The cost of expecting events in the wrong sensory modality
Spence, C., Nicholls, M. E. R., & Driver, J. (2001) · Perception & Psychophysics · doi:10.3758/bf03194473 · Cited by 467 · cited 1×
“Therefore, if the sound-induced change in visual perception shown in the current study was due to trial-to-trial attentional shifts to either modalit”
BackgroundCalvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0812 · Cited by 464
Event-related functional magnetic resonance imaging: modelling, inference and optimization
Josephs, O., & Henson, R. N. A. (1999) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1999.0475 · Cited by 425 · cited 1×
“Data were analyzed using the general linear model (as implemented in SPM99) with a multiple regression design matrix including separate hemodynamic response functions and their temporal derivatives for each event (collide trials, pass trials and motor responses”
Method
Cited by
Items 101–200 of 224
Age-Related Changes to Multisensory Integration and Audiovisual Speech Perception
Pepper, J. L., & Nuttall, H. E. (2023) · Brain Sciences · doi:10.3390/brainsci13081126 · Cited by 34
“Importantly, brain regions believed to be involved in multisensory integration, such as the superior colliculus and the posterior parietal cortex, display increased activation when the circles are perceived to bounce compared to when they are perceived to stream [55], as well as transcranial magnetic stimulation (TMS)…”
BackgroundLi, Y., Long, J., Huang, B., Yu, T., Wu, W., Liu, Y., Liang, C., & Sun, P. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht228 · Cited by 34
“As shown by human neuroimaging studies, enhanced brain activities are observed in posterior superior temporal sulcus (STS)/middle temporal gyrus (pSTS/MTG), a heteromodal area, in the congruent audiovisual stimulus conditions (e.g., Calvert et al. 2000; Bushara et al. 2003; Beauchamp, Argall, et al. 2004; Kreifelts et…”
BackgroundTemporal processing deficit leads to impaired multisensory binding in schizophrenia
Zvyagintsev, M., Parisi, C., & Mathiak, K. (2017) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2017.1331160 · Cited by 37
“Since the “bouncing” perception in the synchronous sound condition reflects the involvement of multisensory mechanisms (Bushara et al., 2003), this finding corroborates previous research suggesting that multisensory integration in schizophrenia is intact under certain conditions (cf.”
BackgroundResultInfluentialSpatio-Temporal Updating in the Left Posterior Parietal Cortex
Wada, M., Takano, K., Ikegami, S., Ora, H., Spence, C. J., & Kansaku, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039800 · Cited by 35
“Indeed, multisensory areas, including the left posterior parietal cortex, are involved in the crossmodal binding of visual and auditory stimuli [29].”
BackgroundSelf-citationLu, Y., Paraskevopoulos, E., Herholz, S. C., Kuchenbuch, A., & Pantev, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090686 · Cited by 37
“Multiple studies investigating the neural basis of multisensory temporal processing identified a coherent network of areas that include the insula, the posterior parietal, and superior temporal cortices as being involved in the perception of audiovisual synchronicity [5,24,25,43,46,47].”
BackgroundZhou, F., Wong, V. S. S., & Sekuler, R. (2007) · Experimental Brain Research · doi:10.1007/s00221-007-0897-0 · Cited by 35
“Moreover, in a study combining psychophysics and functional neuroimaging, Bushara et al. (2003) found significant differences in the patterns of brain activation associated with the two perceptual responses.”
BackgroundAging and Audio-Visual and Multi-Cue Integration in Motion
Roudaia, E., Sekuler, A. B., Bennett, P., & Sekuler, R. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00267 · Cited by 37
“It is noteworthy that these same regions have been shown to be involved in the bouncing percept (Bushara et al., 2003; Zvyagintsev et al., 2011; Maniglia et al., 2012).”
BackgroundHanakawa, T., Honda, M., Zito, G., Dimyan, M. A., & Hallett, M. (2006) · Experimental Brain Research · doi:10.1007/s00221-005-0336-z · Cited by 30
“This imaging sequence was chosen due to its fine temporal resolution and relative insensitivity to inflow effects (van Gelderen et al. 1995; Bushara et al. 2003), despite relatively poor in-plane resolution.”
BackgroundSelf-citationVisual motion disambiguation by a subliminal sound
Dufour, A., Touzalin-Chretien, P., Moessinger, M., Brochard, R., & Després, O. (2008) · Consciousness and Cognition · doi:10.1016/j.concog.2007.09.001 · Cited by 35
“The effect of the subliminal auditorystimulus on the bouncing–streaming illusion perception observed in this study was comparable to thatdescribed in previous studies using supraliminal sounds (Bushara et al., 2003; Sanabria et al., 2004; Sekuleret al., 1997).”
MethodResultLucia, M. J., Sanz, P. R., Garcia-Lopez, A., Ruíz‐Mezcua, B., Vergaz, R., Martínez, V. M. C., & Ortiz, T. (2020) · IEEE Access · doi:10.1109/access.2020.3032229 · Cited by 33
“In Condition 2 (hearing-impaired participants, muted videos), the activation was located mainly in the frontal lobe, associated with higher voluntary attentional resources and emotional and cognitive integration [53], [54].”
BackgroundA role for the anterior insular cortex in the global neuronal workspace model of consciousness
Michel, M. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.02.004 · Cited by 35
“Consistently with the hypothesis according to which the role of the aI is to implement a cross-modal priority map, the aI is also involved in the modulation of attention to multisensory stimuli (Bushara, Grafman, & Hallett, 2001; Bushara et al., 2003; Sterzer & Kleinschmidt, 2010). A recent study by Chen et al. (2015)…”
BackgroundSanabria, D., Correa, Á., Lupiáñez, J., & Spence, C. J. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-1993-z · Cited by 30
“Bushara et al. (2002) recently published a neuroimaging study of the crossmodal modulation of visual perception using a variant of this ambiguous two-dimensional motion display, using event-related functional magnetic resonance imaging.”
BackgroundMethodResultInfluentialDrijvers, L., van der Plas, M., Özyürek, A., & Jensen, O. B. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.03.032 · Cited by 31
The neural basis of complex audiovisual objects maintenances in working memory
Xie, Y., Li, Y. Y., Xie, B., Xu, Y., & Li, P. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107189 · Cited by 31
Leroy, A., Véry, E., Birmes, P. J., Yger, P., Szaffarczyk, S., Lopes, R., Outteryck, O., Faure, C., Duhem, S., Grandgenèvre, P., et al. (2022) · NeuroImage Clinical · doi:10.1016/j.nicl.2022.102964 · Cited by 40
“It receives convergent inputs from multiple sensory modalities, including the auditory and visual systems (Augustine, 1996; Bamiou et al., 2003; Butti and Hof, 2010; Mesulam and Mufson, 1982; Nieuwenhuys, 2012), while converging evidence supports AI’s involvement in simultaneous attention to…”
BackgroundThe origin of the audiovisual bounce inducing effect: A TMS study
Maniglia, M., Grassi, M., Casco, C., & Campana, G. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.02.033 · Cited by 30
“In addition, the role of the left PPC was also investigated, due to its activation in both the ABE (Bushara et al., 2003) and other tasks involving visual–auditory integration (Joassin et al., 2011).”
BackgroundMethodResultInfluentialAuditory Induced Bounce Perception Persists as the Probability of a Motion Reversal is Reduced
Grove, P. M., & Sakurai, K. (2009) · Perception · doi:10.1068/p5860 · Cited by 26
“Furthermore, increased activity in multimodal brain areas accompanied by suppression of activity in unimodal brain areas have been linked to auditory induced bounces (Bushara et al 2003).”
BackgroundNix, J., & Hohmann, V. (2007) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2006.889788 · Cited by 32
“[61] performed fMRI experiments on neural binding between hearing and vision.”
BackgroundNoise, multisensory integration, and previous response in perceptual disambiguation
Parise, C., & Ernst, M. O. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005546 · Cited by 27
Basile, G. A., Tatti, E., Bertino, S., Milardi, D., Genovese, G., Bruno, A., Muscatello, M. R. A., Ciurleo, R., Cerasa, A., Quartarone, A., et al. (2024) · Brain Structure and Function · doi:10.1007/s00429-024-02781-9 · Cited by 24
Schultze-Kraft, M., Becker, R., Breakspear, M. J., & Ritter, P. (2010) · Progress in Biophysics and Molecular Biology · doi:10.1016/j.pbiomolbio.2010.11.003 · Cited by 27
Moon, S.-Y., Kim, M., Lho, S. K., Oh, S., Kim, S. H., & Kwon, J. S. (2021) · Psychiatry Investigation · doi:10.30773/pi.2020.0438 · Cited by 28
Good, T. J., Villafuerte, J. W., Ryan, J. D., Grady, C. L., & Barense, M. D. (2020) · eNeuro · doi:10.1523/eneuro.0290-19.2020 · Cited by 24
“Last, the insular cortex has multiple functions including multimodal sensory processing and binding (Bushara et al., 2003) and a role in emotion (Phan et al., 2002).”
BackgroundExploring the role of visual perceptual grouping on the audiovisual integration of motion.
Sanabria, D., Soto‐Faraco, S., & Spence, C. J. (2004) · PubMed · Cited by 21
Early cross-modal interactions underlie the audiovisual bounce-inducing effect
Zhao, S., Wang, Y., Xu, H., Feng, C., & Feng, W. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.036 · Cited by 24
Okigawa, S., Yamaguchi, M., Ito, K. N., Takeuchi, R. F., Morimoto, N., & Osakada, F. (2020) · The Journal of Comparative Neurology · doi:10.1002/cne.25075 · Cited by 43
“Multisensory signals from separate modalityspecific pathways have been reported to be integrated in the cortex to perceive and respond to surroundings (Barth et al., 1995; Bushara et al., 2003; Calvert, 1997; Wallace et al., 2004).”
BackgroundHamilton, R. H., Wiener, M., Drebing, D. E., & Coslett, H. B. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00571 · Cited by 24
“Functional imaging studies in humans have implicated similar brain regions in multimodal integration (e.g., Calvert, 2001), and have demonstrated that some audiovisual illusions specifically engage these regions (Bushara et al., 2003).”
BackgroundWinkler, I., Horváth, J., Weisz, J., & Trejo, L. J. (2009) · Biological Psychology · doi:10.1016/j.biopsycho.2009.08.011 · Cited by 23
“The effect of visual speech on sound processing is often of suppressing nature, an observation compatible with the results of some cross-modal neuroimaging studies (Bushara et al., 2003; Kang et al., 2006; Laurienti et al., 2002).”
Zelic, G., Mottet, D., & Lagarde, J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032308 · Cited by 22
“In everyday natural situations the combination or integration of multiple senses is essential for an adapted goal directed behavior [1–8].”
BackgroundAssessing the effect of visual and tactile distractors on the perception of auditory apparent motion
Sanabria, D., Soto‐Faraco, S., & Spence, C. J. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2395-6 · Cited by 23
“Temporal synchrony of the auditory and visual signals was found to enhance activity in, among other brain areas, the superior temporal sulcus, a region known to be involved in multisensory convergence (Bushara et al. 2003; Calvert et al. 2000).”
BackgroundJiao, X., & Wang, R. (2006) · Applied Physics Letters · doi:10.1063/1.2204575 · Cited by 20
Banerjee, A., Tognoli, E., Assisi, C. G., Kelso, J. A. S., & Jirsa, V. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.04.260 · Cited by 26
“Recent literature such as Bressler and Kelso (2001), Bushara et al. (2003), Jirsa and Kelso (2004), Kelso and Engstrom (2006) emphasizes the existence of spatiotemporal (re)organization processes in the context of integration and segregation of perceptual and motor behavior.”
BackgroundAudio–visual interactions for motion perception in depth modulate activity in visual area V3A
Ogawa, A., & Macaluso, E. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.01.012 · Cited by 18
“This would be consistent with a set of serial processes where, first, auditory cues are combined in sensory-specific areas and, then, projections to associative regions enable combining information from the two modalities (Bremmer et al., 2001; Bushara et al., 2003).”
Fear processing is differentially affected by lateralized stimulation of carotid baroreceptors
Makovac, E., Garfinkel, S. N., Bassi, A., Basile, B., Macaluso, E., Cercignani, M., Calcagnini, G., Mattei, E., Mancini, M., Agalliu, D., et al. (2017) · Cortex · doi:10.1016/j.cortex.2017.07.002 · Cited by 20
“, 2004), multimodal sensory processing (Bushara et al., 2003) or body self-consciousness (Tsakiris et al.”
Spatiotemporal integration of looming visual and tactile stimuli near the face
Huang, R., Chen, C., & Sereno, M. I. (2018) · Human Brain Mapping · doi:10.1002/hbm.23995 · Cited by 17
“The optimal binding of cross-modal signals may take place at anytime during a dynamic event, not just its onset (Bushara et al., 2003).”
BackgroundInfluentialThe rubber hand illusion induced by visual-thermal stimulation
Trojan, J., Fuchs, X., Speth, S.-L., & Diers, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-29860-2 · Cited by 20
Audio-Visual Perception of Everyday Natural Objects – Hemodynamic Studies in Humans
Lewis, J. W. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5615-6_10 · Cited by 19
Orliac, F., Delamillieure, P., Delcroix, N., Naveau, M., Brazo, P., Razafimandimby, A., Dollfus, S., & Joliot, M. (2017) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2017.04.003 · Cited by 19
Perception of causality and synchrony dissociate in the audiovisual bounce-inducing effect (ABE)
Vroomen, J., & Keetels, M. (2020) · Cognition · doi:10.1016/j.cognition.2020.104340 · Cited by 16
“, the prefrontal and posterior parietal cortex) and subcortical areas (thalamus) when participants had a bouncing rather than streaming percept (Bushara et al., 2003).”
Multisensory Integration in Short-term Memory: Musicians do Rock
Aizenman, A., Gold, J. M., & Sekuler, R. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2017.04.031 · Cited by 19
Multiple phases of cross-sensory interactions associated with the audiovisual bounce-inducing effect
Zhao, S., Wang, Y., Feng, C., & Feng, W. (2019) · Biological Psychology · doi:10.1016/j.biopsycho.2019.107805 · Cited by 15
Perception of auditory signals
Recanzone, G. H. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2010.05920.x · Cited by 17
Kambeitz‐Ilankovic, L., Hennig‐Fast, K., Benetti, S., Kambeitz, J. P., Pettersson‐Yeo, W., O’Daly, O., McGuire, P. K., & Allen, P. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs101 · Cited by 15
Li, Y., Wang, G., Long, J., Yu, Z., Huang, B., Li, X., Yu, T., Liang, C., Li, Z., & Sun, P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020801 · Cited by 16
“Human functional imaging studies have associated the posterior superior temporal sulcus and the middle temporal gyrus (pSTS/MTG) with the crossmodal integration of audio and visual features of objects”
BackgroundIntegration and Segregation of Perceptual and Motor Behavior
Jirsa, V., & Kelso, J. A. S. (2004) · Understanding complex systems · doi:10.1007/978-3-540-39676-5_13 · Cited by 12
Multisensory binding: is the contribution of synchrony and semantic congruency obligatory?
Tsilionis, E., & Vatakis, A. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.01.002 · Cited by 18
Beep, be-, or –ep: The impact of auditory transients on perceived bouncing/streaming.
Meyerhoff, H. S., & Suzuki, S. (2018) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000585 · Cited by 13
“Auditory-induced bouncing is a robust effect that has been replicated multiple times (e.g., Bushara et al., 2003; Fujisaki, Shimojo, Kashino, & Nishida, 2004; Grassi & Casco, 2009; Grove, Kawachi, & Sakurai, 2012); however, its origin is still debated.”
Pei, C., Qiu, Y., Li, F., Huang, X., Si, Y., Li, Y., Zhang, X., Chen, C., Liu, Q., Cao, Z., et al. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac376 · Cited by 14
Spatially congruent visual motion modulates activity of the primary auditory cortex
Zvyagintsev, M., Nikolaev, A. R., Thönneßen, H., Sachs, O., Dammers, J., & Mathiak, K. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1830-5 · Cited by 10
“In contrast, the incongruent motion may be considered as the condition without crossmodal binding and consistently with reciprocal relationships (Bushara et al. 2002) it had no eVect on the activity of the unimodal auditory cortex.”
BackgroundInfluentialSomatosensory contribution to audio-visual speech processing
Ito, T., Ohashi, H., & Gracco, V. L. (2021) · Cortex · doi:10.1016/j.cortex.2021.07.013 · Cited by 10
“The superior temporal cortex contains a multisensory region that is modulated by temporal asynchrony in audiovisual processing (Macaluso et al., 2004; Miller & D’Esposito, 2005; Stevenson et al., 2010; Wright et al., 2003) and is engaged by perceptual fusion (Bushara et al., 2003).”
BackgroundSelective Audiovisual Semantic Integration Enabled by Feature-Selective Attention
Li, Y., Long, J., Huang, B., Yu, T., Wu, W., Li, P., Fang, F., & Sun, P. (2016) · Scientific Reports · doi:10.1038/srep18914 · Cited by 12
“The following statistical criterion was used to determine brain areas for audiovisual sensory integration: 4,6,24–27 , where ∩ denotes the intersection of two sets.”
BackgroundMethodKim, J., Bülthoff, I., Kim, S.-P., & Bülthoff, H. (2019) · Scientific Reports · doi:10.1038/s41598-018-37378-w · Cited by 11
van de Ven, V. G., Kleuters, G., & Stuiver, J. (2022) · Psychological Research · doi:10.1007/s00426-022-01682-y · Cited by 11
“, visual) information is presented synchronously rather than asynchronously with the other modality (Bushara et al., 2003; Miller & D’Esposito, 2005; Van Atteveldt et al., 2007; Chen & Spence, 2010; ten Oever et al., 2013).”
BackgroundEarly attention modulates perceptual interpretation of multisensory stimuli
Zvyagintsev, M., Nikolaev, A. R., Sachs, O., & Mathiak, K. (2011) · Neuroreport · doi:10.1097/wnr.0b013e32834901f3 · Cited by 13
Schwarz, C., Horowski, A., Möck, M., & Thier, P. (2005) · The Journal of Comparative Neurology · doi:10.1002/cne.20461 · Cited by 11
“…be part of a distributed network that deals with binding of multisensory information depending on temporal aspects like synchronous presentation (Bushara et al., 2001, 2003; Calvert et al., 2001) or if they relate to temporal aspects of movements like sequencing of motor events (Bengtsson et…”
BackgroundThe modulatory effect of semantic familiarity on the audiovisual integration of face‐name pairs
Li, Y., Wang, F., Huang, B., Yang, W., Yu, T., & Talsma, D. (2016) · Human Brain Mapping · doi:10.1002/hbm.23312 · Cited by 11
“The neural mechanisms of audiovisual integration have previously been investigated using neuroimaging techniques, and several brain regions including the pSTS/MTG have been identified as heteromodal areas [Bushara et al., 2003; Calvert et al., 2000; Frassinetti et al., 2002].”
MethodPerceptual complexity of faces and voices modulates cross-modal behavioral facilitation effects
Joassin, F., Maurage, P., & Campanella, S. (2008) · Neuropsychological Trends · doi:10.7358/neur-2008-003-joas · Cited by 10
Wang, L., Li, C., Han, Z., Wu, Q., Sun, L., Zhang, X., Go, R., Wu, J., & Yan, T. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac029 · Cited by 9
Gao, D., Liang, X., Qi, T., Nichols, E. S., Bai, Z., Xu, C., Cai, M., & Liu, L. (2024) · Human Brain Mapping · doi:10.1002/hbm.26713 · Cited by 7
Temporal variability of brain networks predicts individual differences in bistable perception
Mao, Y., Kanai, R., Ding, C., Bi, T., & Qiu, J. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107426 · Cited by 9
Segregated audio–tactile events destabilize the bimanual coordination of distinct rhythms
Lagarde, J., Zelic, G., & Mottet, D. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3103-y · Cited by 11
Pre-coincidence brain activity predicts the perceptual outcome of streaming/bouncing motion display
Zhao, S., Wang, Y., Jia, L., Feng, C., Liao, Y., & Feng, W. (2017) · Scientific Reports · doi:10.1038/s41598-017-08801-5 · Cited by 13
Interview with Michael Gazzaniga
(2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.05998.x · Cited by 192
The Neural Basis of Salt Perception: A Focus on Potassium Chloride as a Sodium Alternative
Iannilli, E., Fürer, R., Welge–Lüssen, A., & Hummel, T. R. (2025) · Life · doi:10.3390/life15020207 · Cited by 7
“Reduced consumption of NaCl, commonly referred to as table salt, has been associated with reduced blood pressure [3–5] and the subsequent lower risk of cardiovascular events [6], stroke [7,8], and left ventricular hypertrophy [9,10].”
Brain-inspired bodily self-perception model for robot rubber hand illusion
Zhao, Y., Lu, E., & Zeng, Y. (2023) · Patterns · doi:10.1016/j.patter.2023.100888 · Cited by 10
Binaural Scene Analysis with Multidimensional Statistical Filters
Spille, C., Meyer, B. T., Dietz, M., & Hohmann, V. (2013) · Springer eBooks · doi:10.1007/978-3-642-37762-4_6 · Cited by 8
“[7] examined the neural binding between hearing and vision.”
BackgroundTowards Decoding of Depersonalisation Disorder Using EEG: A Time Series Analysis Using CDTW
Salami, A., Andreu-Pérez, J., & Gillmeister, H. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308273 · Cited by 6
“The insular cortex is a region located deep in the cerebral cortex [17], which is believed to be responsible for the integration and the processing of visceral signals [18] as well as the signals from our environment [19, 20].”
BackgroundSkouras, S., Kleinert, M.-L., Lee, E. H. M., Hui, C. L. M., Suen, Y. N., Camchong, J., Chong, C. S. Y., Chang, W. C., Chan, S. K. W., Lo, W. T.-L., et al. (2024) · Brain Communications · doi:10.1093/braincomms/fcae094 · Cited by 7
Mate, K. (2022) · McGill Journal of Medicine · doi:10.26443/mjm.v20i2.928 · Cited by 6
“(91) The super-additive effect is also seen for social context and complex visual and auditory signals.(92) This may indicate its role in”
BackgroundIllusory Reversal of Causality between Touch and Vision has No Effect on Prism Adaptation Rate
Tanaka, H., Homma, K., & Imamizu, H. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00545 · Cited by 7
“Neural correlates of synchronous detection and temporal binding among cross-modal sensory stimulus onsets have been well investigated especially for audiovisual stimulus pairs (Bushara et al., 2001, 2003; Dhamala et al., 2007; Noesselt et al., 2007; Powers III et al., 2012).”
BackgroundResponse: Sound analysis in auditory cortex – from temporal decomposition to perception
Seifritz, E., Esposito, F., Neuhoff, J. G., & Salle, F. D. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00075-4 · Cited by 7
Multi-modal attention and event binding in humanoid robot using a sensory ego-sphere
Hambuchen, K., & Peters, R. A. (2004) · Cited by 6
Role of the Insula in Visual and Auditory Perception
Protas, M. (2018) · Springer eBooks · doi:10.1007/978-3-319-75468-0_16 · Cited by 5
Increases in regional brain volume across two native South American male populations
Chaudhari, N. N., Imms, P. E., Chowdhury, N. F., Gatz, M., Trumble, B. C., Mack, W. J., Law, E. M., Sutherland, M. L., Sutherland, J. D., Rowan, C. J., et al. (2024) · GeroScience · doi:10.1007/s11357-024-01168-2 · Cited by 5
“The insulae are linked to audio-visual integration tasks [91, 92], consciousness, emotion regulation [93], and homeostasis [94].”
BackgroundArousing emoticons edit stream/bounce perception of objects moving past each other
Gobara, A., Yoshimura, N., & Yamada, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-23973-4 · Cited by 5
Cross Media Analysis and Retrieval on the Web: Theory and Algorithm
Wu, F., & Zhuang, Y. (2010) · Journal of Computer-Aided Design & Computer Graphics · doi:10.3724/sp.j.1089.2010.10439 · Cited by 7
Ran, M., Zhang, H., Jin, M., Tao, Y., Xu, H., Zou, S., Wang, Z., Deng, F., Huang, L., Zhang, H., et al. (2025) · Frontiers in Neuroscience · doi:10.3389/fnins.2025.1487754 · Cited by 5
Multi-sensory integration using sparse spatio-temporal encoding
Rao, A. R., & Cecchi, G. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706792 · Cited by 5
“There is increasing interest in investigating the neural correlates of multi-sensory perception using techniques such as event-related potentials [15] and fMRI [16].”
MethodWhether attentional loads influence audiovisual integration depends on semantic associations
Li, Q., Yu, Y., Liu, Y., Xu, Z., Lü, F., Takahashi, S., Yang, J., Ejima, Y., Wu, Q., & Wu, J. (2022) · Attention Perception & Psychophysics · doi:10.3758/s13414-022-02461-y · Cited by 7
Marmoset Brain ISH Data Revealed Molecular Difference Between Cortical Folding Patterns
Li, X., Liu, T., Li, Y., Li, Q., Wang, X., Hu, X., Guo, L., Zhang, T., & Liu, T. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa317 · Cited by 6
Csonka, M., Mardmomen, N., Webster, P. J., Brefczynski‐Lewis, J. A., Frum, C., & Lewis, J. W. (2021) · Cerebral Cortex Communications · doi:10.1093/texcom/tgab002 · Cited by 6
“Bushara KO, Hanakawa T, Immisch I, Toma K, Kansaku K, Hallett M. 2003.”
BackgroundNEURAL INTEGRATION OF MULTIMODAL EVENTS
Vettel, J. M. (2009) · ProQuest Demo Repository · doi:10.7301/z0vq30zr · Cited by 9
Supramodal and cross-modal representations of working memory in higher-order cortex
Park, D., Hwang, S.-H., Lee, K., Ryoo, Y., Kim, H. F., & Lee, S. (2025) · Nature Communications · doi:10.1038/s41467-025-59825-9 · Cited by 8
“Lesion studies have shown that damage to the parietal cortex impairs visual-tactile integration 44,46 , while neuroimaging and electro-physiological studies have demonstrated increased neural activation in this region during multisensory integration 42,43,47,48 .”
Dynamic Neural Deactivation Bridges Direct and Competitive Inhibition Processes
He, Z., Du, Y., Fu, Z., Zheng, Y., Muhlert, N., Sahakian, B. J., & Elliott, R. (2025) · Advanced Science · doi:10.1002/advs.202506833 · Cited by 5
The Relationship Between Illusory Crescents and the Stream/Bounce Effect
A-Izzeddin, E. J., & Grove, P. M. (2020) · Multisensory Research · doi:10.1163/22134808-bja10040 · Cited by 3
The influence of tDCS on perceived bouncing/streaming
Friehs, M. A., Stegemann, M. J., Merz, S., Geissler, C. F., Meyerhoff, H. S., & Frings, C. (2022) · Experimental Brain Research · doi:10.1007/s00221-022-06505-5 · Cited by 3
“Previous studies showed an involvement of multimodal brain areas in the bouncing-streaming illusion (Ashbridge 1997; Bushara et al. 2003; Heinen et al. 2011; Sereno and Huang 2014).”
BackgroundFrontal cortex organization supporting audiovisual processing during naturalistic viewing
Zhou, F., Khalilian-Gourtani, A., Dugan, P. C., Michalak, A. J., Devinsky, O., Rozman, P. A., Doyle, W., Friedman, D., & Flinker, A. (2026) · Nature Communications · doi:10.1038/s41467-026-73947-8 · Cited by 2
“Increased activation in the frontal regions occurs when congruent multisensory information is presented 6 – 8 and when sensory inputs are successfully integrated 9 .”
Spatial Constraints in Multisensory Attention
Macaluso, E. (2011) · Frontiers in neuroscience · doi:10.1201/9781439812174-32 · Cited by 4
Ferrier, L. P., Streff, A., Martin, S., Brouillet, D., Barkat-Defradas, M., & Jimenez, M. (2009) · L’Année psychologique · doi:10.4074/s0003503309003017 · Cited by 9
Plasticity During Short-Term Visual Deprivation
Brodoehl, S., Klingner, C. M., Schaller, D., & Witte, O. W. (2016) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000246 · Cited by 3
Wang, L., Lin, L., & Ren, J. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad388 · Cited by 3
Leroy, A., Véry, E., Birmes, P. J., Szaffarczyk, S., Lopes, R., Outteryck, O., Faure, C., Duhem, S., Grandgenèvre, P., Warembourg, F., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.10.01.319269 · Cited by 3
“simultaneous attention to multisensory events (15,16).”
Semantic-based audiovisual integration enhances active storage in visual working memory
Zhao, S., Hui, S., Chen, M., Feng, C., Zhai, M., & Feng, W. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121577 · Cited by 3
Temporal dynamics of the flash‐induced bouncing effect
Zhong, H., Zhao, S., Chen, T., Wanlu, Y., Huang, X., & Feng, W. (2020) · Human Brain Mapping · doi:10.1002/hbm.24993 · Cited by 2
“For instance, a functional magnetic resonance imaging study (Bushara et al., 2003) found that the coincident sound elicited higher activation in a series of multisensory brain areas (e.”
BackgroundSound-modulations of visual motion perception implicate the cortico-vestibular brain
Chang, D. H. F., Thinnes, D., Au, P. Y., Maziero, D., Stenger, V. A., Sinnett, S., & Vibell, J. F. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119285 · Cited by 3
An MEG study on stream/bounce illusion
Kobayashi, A., Amano, K., & Takeda, T. (2007) · International Congress Series · doi:10.1016/j.ics.2006.12.083 · Cited by 2
Perceptual Gain and Perceptual Loss: Distinct Neural Mechanisms of Audiovisual Interactions*
Jiang, Y., & Han, S. (2007) · Cited by 2
The influence of auditory stimulation on binocular rivalry
Borojevic, N. (2012) · Cited by 1
Physiological Determinants of Consciousness
Steriade, M. (2007) · Humana Press eBooks · doi:10.1385/1-59259-925-7:129 · Cited by 1
Schmetz, A., Ackermann, T., Fitzner, A., Steinhoff, V., & Kampker, A. (2023) · Procedia CIRP · doi:10.1016/j.procir.2023.09.054 · Cited by 1
Metadata
- Authors
- Bushara, K. O., Hanakawa, T., Immisch, I., Toma, K., Kansaku, K., & Hallett, M.
- Affiliations
- Minneapolis VA Health Care System (US)
- National Institutes of Health (US)
- Corresponding author
- Bushara, Khalafalla O.
- Venue
- Nature Neuroscience
- Published
- 2002-12-23
- Volume
- 6
- Issue
- 2
- Pages
- 190-195
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2089488430
- Cited by
- 226
- References
- 16
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 4 · 2023: 6 · 2022: 10 · 2021: 4 · 2020: 11 · 2019: 12 · 2018: 10 · 2017: 12 · 2016: 10 · 2015: 7 · 2014: 6 · 2013: 12 · 2012: 11
- FWCI
- 18.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- cross-modal binding, multisensory integration, neural correlates, perceptual binding, event-related fMRI
- MeSH terms
- Acoustic Stimulation, Auditory Perception, Brain, Brain Mapping, Female, Humans, Functional Laterality, Magnetic Resonance Imaging, Male, Motion Perception, Nerve Net, Neural Pathways, Neurons, Neuropsychological Tests, Photic Stimulation, Psychomotor Performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.