Unraveling multisensory integration: patchy organization within human STS multisensory cortex
The DOI matches its Crossref record; 15 of the 16 references it cites were found in a registry or an index.
Abstract
Although early sensory cortex is organized along dimensions encoded by receptor organs, little is known about the organization of higher areas in which different modalities are integrated. We investigated multisensory integration in human superior temporal sulcus using recent advances in parallel imaging to perform functional magnetic resonance imaging (fMRI) at very high resolution. These studies suggest a functional architecture in which information from different modalities is brought into close proximity via a patchy distribution of inputs, followed by integration in the intervening cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Self-citationIntegration of Letters and Speech Sounds in the Human Brain
van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.025 · Cited by 544
Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements
Beauchamp, M. S., Lee, K. E., Haxby, J. V., & Martin, A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00642-6 · Cited by 528
Self-citationHuman Ocular Dominance Columns as Revealed by High-Field Functional Magnetic Resonance Imaging
Cheng, K., Waggoner, R. A., & Tanaka, K. (2001) · Neuron · doi:10.1016/s0896-6273(01)00477-9 · Cited by 383
A revised view of sensory cortical parcellation
Wallace, M. T., Ramachandran, R., & Stein, B. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0305697101 · Cited by 343
Seltzer, B., & Pandya, D. N. (1994) · Journal of Comparative Neurology · doi:10.1002/cne.903430308 · Cited by 327
Hikosaka, K., Iwai, E., Saito, H., & Tanaka, K. (1988) · Journal of Neurophysiology · doi:10.1152/jn.1988.60.5.1615 · Cited by 296
Benevento, L. A., Fallon, J., Davis, B. J., & Rezak, M. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90112-1 · Cited by 288
Cited by
Items 201–300 of 532
Multimodal integration of spontaneously produced representational co-speech gestures: an fMRI study
Weisberg, J., Hubbard, A. L., & Emmorey, K. D. (2016) · Language Cognition and Neuroscience · doi:10.1080/23273798.2016.1245426 · Cited by 54
“…plays a key role in sensory integration across diverse stimuli and tasks (e.g. multisensory object recognition, audiovisual speech comprehension; Beauchamp et al., 2004b; Calvert et al., 2000, 2001; Szycik, Stadler, Tempelmann, & Münte, 2012; van Atteveldt, Formisano, Goebel, & Blomert, 2004).”
BackgroundStraube, B., Green, A., Saß, K., Kirner-Veselinovic, A., & Kircher, T. T. J. (2012) · Human Brain Mapping · doi:10.1002/hbm.22015 · Cited by 56
“…lobe appears to rely more on perceptual matching processes, such as those that are engaged in the identification of tool sounds [Amedi et al., 2005; Beauchamp et al., 2004, 2008; Lewis, 2005, 2006], action words [e.g., Kable and Chatterjee, 2006; Kable et al., 2005] or high familiar and…”
BackgroundNeufeld, J., Sinke, C., Zedler, M., Dillo, W., Emrich, H. M., Bleich, S., & Szycik, G. R. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.02.032 · Cited by 54
Multisensory integration affects ERP components elicited by exogenous cues
Santangelo, V., Lubbe, R. H. J. V. D., Belardinelli, M. O., & Postma, A. (2007) · Experimental Brain Research · doi:10.1007/s00221-007-1151-5 · Cited by 55
“In humans, enhancement of neural activity in case of multimodal stimulation has been demonstrated using event-related brain potentials (Giard and Peronnet 1999; Talsma and WoldorV 2005; Teder-Salejarvi et al. 2002; see also Fort et al. 2002), gamma band responses (Senkowski et al. 2005), and other neuroimaging measure…”
Beer, A. L., Plank, T., Meyer, G., & Greenlee, M. W. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2013.00005 · Cited by 53
Schuwerk, T., Döhnel, K., Sodian, B., Keck, I. R., Rupprecht, R., & Sommer, M. (2014) · Human Brain Mapping · doi:10.1002/hbm.22377 · Cited by 49
“Human as well as primate studies suggest that middle temporal gyrus and posterior temporal regions integrate information from multisensory input [Beauchamp et al., 2004; Barnes and Pandya, 1992] and play a role in semantic processing of this information [Visser et al., 2012] or action observation…”
BackgroundMultisensory functional magnetic resonance imaging: a future perspective
Goebel, R., & van Atteveldt, N. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1881-7 · Cited by 59
Multimodal representations of person identity individuated with fMRI
Anzellotti, S., & Caramazza, A. (2017) · Cortex · doi:10.1016/j.cortex.2017.01.013 · Cited by 54
Tsantani, M., Kriegeskorte, N., McGettigan, C., & Garrido, L. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.07.017 · Cited by 60
Neural correlates of multisensory integration in the human brain: an ALE meta-analysis
Scheliga, S., Kellermann, T., Lampert, A., Rolke, R., Spehr, M., & Habel, U. (2022) · Reviews in the Neurosciences · doi:10.1515/revneuro-2022-0065 · Cited by 56
Integrating audiovisual information for the control of overt attention
Onat, S., Libertus, K., & König, P. (2007) · Journal of Vision · doi:10.1167/7.10.11 · Cited by 58
Song, J., Lee, H., Kang, H., Lee, D. S., Chang, S. O., & Oh, S. H. (2014) · Brain Structure and Function · doi:10.1007/s00429-013-0704-6 · Cited by 57
“Regions such as the IFG (Hein et al. 2007), PMC (Skipper et al. 2007), posterior parietal cortex (Noppeney et al. 2008), ventral occipito-temporal cortex (Beauchamp et al. 2004b), as well Fig.”
BackgroundSchizophrenia as a Disorder of Social Communication
Wible, C. G. (2012) · Schizophrenia Research and Treatment · doi:10.1155/2012/920485 · Cited by 54
Matchin, W., Groulx, K., & Hickok, G. S. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00515 · Cited by 54
Processing of Egomotion-Consistent Optic Flow in the Rhesus Macaque Cortex
Cottereau, B. R., Smith, A. T., Rima, S., Fize, D., Héjja‐Brichard, Y., Renaud, L., Lejards, C., Vayssière, N., Trotter, Y., & Durand, J. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhw412 · Cited by 55
“This region was named STSms (STS multi-sensory) because of its multi-sensory responses (Beauchamp et al. 2004a, 2004b, 2008).”
BackgroundInfluentialPark, H., & Kayser, C. (2019) · eLife · doi:10.7554/elife.47001 · Cited by 50
Lewis, J. W., Talkington, W. J., Puce, A., Engel, L. R., & Frum, C. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21570 · Cited by 54
Cross-Modal Interaction Between Auditory and Visual Input Impacts Memory Retrieval
Marian, V., Hayakawa, S. L., & Schroeder, S. R. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.661477 · Cited by 53
Synaesthesia or Vivid Imagery? A Single Case fMRI Study of Visually Induced Olfactory Perception
Chan, J., van den Bosch, J. J. F., Theves, S., Hardt, S., Pflanz, C. P., Lötsch, J., Kaiser, J., & Naumer, M. J. (2014) · Multisensory Research · doi:10.1163/22134808-00002451 · Cited by 48
Kast, M., Bezzola, L., Jäncke, L., & Meyer, M. E. (2011) · Brain and Language · doi:10.1016/j.bandl.2011.04.002 · Cited by 48
He, Y., Gebhardt, H., Steines, M., Sammer, G., Kircher, T. T. J., Nagels, A., & Straube, B. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.04.018 · Cited by 51
“The pSTS/MTG is a crucial area for multimodal integration and is considered as the brain region within which common object representations are formulated from two input modalities (Amedi et al., 2005; Beauchamp et al., 2004; Calvert et al., 2000; Calvert & Thesen, 2004).”
BackgroundAudiovisual integration in macaque face patch neurons
Khandhadia, A. P., Murphy, A. P., Romanski, L. M., Bizley, J. K., & Leopold, D. A. (2021) · Current Biology · doi:10.1016/j.cub.2021.01.102 · Cited by 51
“Previous explorations of the STS organization in monkeys and humans have indicated a patchy spatial organization across primate species, with unisensory regions for each modality and audiovisual regions clustering together.(4,37) In this context, the AF face patch might have been a good candidate for a visual-only reg…”
BackgroundSzycik, G. R., Jansma, H., & Münte, T. F. (2009) · Human Brain Mapping · doi:10.1002/hbm.20640 · Cited by 44
“The caudal part of STS has been identified as a multisensory integrative site involved in processing auditory as well as visual stimuli [Beauchamp et al., 2004a,b; Callan et al., 2003; Wright et al., 2003].”
BackgroundOlfactory-visual integration facilitates perception of subthreshold negative emotion
Novak, L. R., Gitelman, D. R., Schuyler, B. S., & Li, W. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.09.005 · Cited by 46
“…by the physical areas, via reciprocal fiber tracts and multisensory transition zones, enabling integration across these senses (e.g. pSTS and superior colliculus; Beauchamp et al., 2004; Kaas et al., 2004; Wallace et al., 2004; Driver and Noesselt, 2008; based on human and nonhuman primate data).”
Lippert, M., Takagaki, K., Kayser, C., & Ohl, F. W. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063631 · Cited by 49
“brain [16–18], and microelectrode recordings have elucidated”
Venezia, J. H., Fillmore, P., Matchin, W., Isenberg, A. L., Hickok, G. S., & Fridriksson, J. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.11.038 · Cited by 49
“…speech is that visual speech is first combined with auditory speech via multisensory integration (e.g., in the posterior superior temporal lobe; Beauchamp et al., 2004, 2010; Bernstein and Liebenthal, 2014; Calvert et al., 2000), and the resulting integrated speech representation is then fed…”
BackgroundAuditory object perception: A neurobiological model and prospective review
Brefczynski‐Lewis, J. A., & Lewis, J. W. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.04.034 · Cited by 49
“…yellow region) shows interaction or integration effects when corresponding sounds are also present (Calvert et al., 2000; Beauchamp et al., 2004b; Beauchamp et al., 2004a; Taylor et al., 2006; Campanella and Belin, 2007; Campbell, 2008; Taylor et al., 2009), and are generally activated by human…”
BackgroundLinguistic Aspects of Primary Progressive Aphasia
Grossman, M. (2018) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011516-034253 · Cited by 45
“…the heteromodal model, feature representations in multiple sensory and motor reservoirs of knowledge together contribute to typical, multimodal concepts, which are represented in semantic networks that include a heteromodal integrative component (Beauchamp et al. 2004a,b; Price et al. 2015, 2016).”
BackgroundSzycik, G. R., Tausche, P., & Münte, T. F. (2007) · Brain Research · doi:10.1016/j.brainres.2007.08.027 · Cited by 52
Multisensory Interactions between Auditory and Haptic Object Recognition
Kassuba, T., Menz, M. M., Röder, B., & Siebner, H. R. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs076 · Cited by 47
WSPM: Wavelet-based statistical parametric mapping
Van De Ville, D., Seghier, M. L., Lazeyras, F., Blu, T., & Unser, M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.011 · Cited by 46
An ALE meta‐analysis on the audiovisual integration of speech signals
Erickson, L. C., Heeg, E., Rauschecker, J. P., & Turkeltaub, P. E. (2014) · Human Brain Mapping · doi:10.1002/hbm.22572 · Cited by 48
Sight and Sound Converge to Form Modality-Invariant Representations in Temporoparietal Cortex
Man, K., Kaplan, J., Damásio, A. R., & Meyer, K. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.2342-12.2012 · Cited by 45
“Superior temporal cortex has been found to contain intermixed millimeter-scale patches that respond preferentially to auditory (A), visual (V), or audiovisual stimuli (AV) (Beauchamp et al., 2004; Dahl et al., 2009).”
BackgroundKaras, P. J., Magnotti, J. F., Metzger, B. A., Zhu, L. L., Smith, K. B., Yoshor, D., & Beauchamp, M. S. (2019) · eLife · doi:10.7554/elife.48116 · Cited by 50
Self-citationIordanescu, L., Grabowecky, M., & Suzuki, S. (2010) · Acta Psychologica · doi:10.1016/j.actpsy.2010.07.017 · Cited by 50
Neural networks supporting audiovisual integration for speech: A large-scale lesion study
Hickok, G. S., Rogalsky, C., Matchin, W., Basilakos, A., Cai, J., Pillay, S. B., Ferrill, M., Mickelsen, S., Anderson, S. W., Love, T. E., et al. (2018) · Cortex · doi:10.1016/j.cortex.2018.03.030 · Cited by 51
Agustus, J. L., Ruff, C. C., & Driver, J. (2011) · Human Brain Mapping · doi:10.1002/hbm.21278 · Cited by 48
“…are related, such as their relative spatial [e.g., Macaluso et al., 2000, 2004; Stein and Meredith, 1993; Wallace et al., 1996], semantic [e.g., Beauchamp et al., 2004a,b; Ghazanfar et al., 2005; Hein et al., 2007; Noppeney et al., 2008], or temporal properties [e.g., Bischoff et al., 2007;…”
BackgroundMethodInfluentialAltered Intra- and Inter-Regional Synchronization of Superior Temporal Cortex in Deaf People
Li, Y., Booth, J. R., Peng, D., Zang, Y., Li, J., Yan, C., & Ding, G. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs185 · Cited by 48
“Previous studies in HC have shown enhanced activity for multimodal stimuli compared with unimodal ones in pSTS (Calvert et al. 2000; Beauchamp et al. 2004; van Atteveldt et al. 2004; Noesselt et al. 2007; Beauchamp et al. 2008).”
Hertz, U., & Amedi, A. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.04.186 · Cited by 43
“…PT along the temporal lobe, has also been described by others using other types of much higher level stimuli such as objects and letters/phonemes (Beauchamp et al., 2004a; Stevenson and James, 2009; van Atteveldt et al., 2004), but also by low level, static, and non-ecological stimuli such as…”
InfluentialZhu, L. L., & Beauchamp, M. S. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.2914-16.2017 · Cited by 47
“…of speech perception, the pSTS itself is also multisensory, showing an enhanced response to multisensory audiovisual stimuli (Wright et al., 2003; Beauchamp et al., 2004a; van Atteveldt et al., 2004; Kreifelts et al., 2007; Stevenson et al., 2007) that is subject to cross-modal adaptation…”
BackgroundResultSelf-citationChen, Y., Lewis, T. L., Shore, D. I., & Maurer, D. M. (2017) · Current Biology · doi:10.1016/j.cub.2017.01.009 · Cited by 42
Explaining How Brain Stimulation Can Evoke Memories
Jacobs, J., Lega, B. C., & Anderson, C. T. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00170 · Cited by 48
“In this way, our findings extend recent studies identifying distinct category-specific cortical regions, such as those responding to faces, places, animals, or tools (Dahl, Logothetis, & Kayser, 2009; Mitchell et al., 2008; Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004; Martin & Chao, 2001; Epstein & Kanwisher, 199…”
ResultMeyer, M. E., Baumann, S., Marchina, S., & Jäncke, L. (2007) · BMC Neuroscience · doi:10.1186/1471-2202-8-14 · Cited by 50
“According to a recent fMRI study the STS should be considered a region where auditory and visual information about objects is integrated [44]; it has also been noted to play a cardinal role in audiovisual speech perception [30,45,46].”
Mental arithmetic in the bilingual brain: Language matters
Rinsveld, A. M. V., Dricot, L., Guillaumé, M., Rossion, B., & Schiltz, C. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.05.009 · Cited by 41
“Anterior and posterior transverse temporal gyri are parts of the auditory cortex and the superior temporal gyrus corresponds to Wernicke's area associated with semantic processing of language (Beauchamp et al., 2004; Vandenberghe et al., 1996).”
BackgroundThe Use of fMRI to Assess Multisensory Integration
James, T. W., & Stevenson, R. A. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-11 · Cited by 46
Mechanisms of enhancing visual–speech recognition by prior auditory information
Blank, H., & von Kriegstein, K. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.047 · Cited by 42
“Results from single-unit recording and fMRI suggest that the posterior STS consists of a patchy structure of neuronal populations that respond to auditory, visual, or multi-sensory auditory–visual stimuli (Beauchamp et al., 2004a; Dahl et al., 2009).”
BackgroundInfluentialEvidence for a basic level in a taxonomy of everyday action sounds
Lemaître, G., & Heller, L. M. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3430-7 · Cited by 47
“1997; Warren and Verbrugge 1984) and through neuroimaging research (Aglioti and Pazzaglia 2010; Alaerts et al. 2009; Aziz-Zadeh et al. 2004; Beauchamp et al. 2004; Bidet-Caulet et al. 2005; Chen et al. 2008; De Lucia et al. 2009; Gazzola et al. 2006; James et al. 2011; Kaplan and Iacobani 2007; Lewis et al. 2004, 2005…”
BackgroundLeitão, J., Thielscher, A., Werner, S., Pohmann, R., & Noppeney, U. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs078 · Cited by 45
“…direct connectivity between sensory areas, and feedback from higher order association areas such as the intraparietal sulcus (IPS) or the superior temporal sulcus (Calvert 2001; Schroeder et al. 2003; Beauchamp et al. 2004; Hackett et al. 2007; Driver and Noesselt 2008; Sadaghiani et al. 2009).”
BackgroundSpatial–temporal dynamics of gesture–speech integration: a simultaneous EEG-fMRI study
He, Y., Steines, M., Sommer, J. B., Gebhardt, H., Nagels, A., Sammer, G., Kircher, T. T. J., & Straube, B. (2018) · Brain Structure and Function · doi:10.1007/s00429-018-1674-5 · Cited by 44
Multisensory Interactions in the Real World
Soto‐Faraco, S., Kvasova, D., Biau, E., Ikumi, N., Ruzzoli, M., Fernández, L. M., & Cuello, M. T. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108578738 · Cited by 49
Cross-modal effects of value on perceptual acuity and stimulus encoding
Pooresmaeili, A., FitzGerald, T. H. B., Bach, D. R., Toelch, U., Ostendorf, F., & Dolan, R. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1408873111 · Cited by 40
The Effects of Stimulus Modality and Frequency of Stimulus Presentation on Cross-modal Distraction
Mayer, A. R., Franco, A. R., Cañive, J. M., & Harrington, D. L. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn148 · Cited by 41
“temporal sulcus sensory integration region that has previously been identified in other studies (Calvert et al. 2001; Beauchamp et al. 2004a; Calvert and Thesen 2004; Macaluso andDriver 2005)”
BackgroundResultWatanabe, H., Homae, F., Nakano, T., Tsuzuki, D., Enkhtur, L., Nemoto, K., Dan, I., & Taga, G. (2011) · Human Brain Mapping · doi:10.1002/hbm.21453 · Cited by 42
“Previous neuroimaging studies in human adults have also demonstrated that the stimulation of one sensory modality can produce deactivation responses in different sensory-specific regions [Beauchamp et al., 2004b; Laurienti et al., 2002].”
BackgroundInfluentialChange-driven cortical activation in multisensory environments: An MEG study
Tanaka, E., Kida, T., Inui, K., & Kakigi, R. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.037 · Cited by 39
Preference for Audiovisual Speech Congruency in Superior Temporal Cortex
Lüttke, C. S., Ekman, M., van Gerven, M. A. J., & de Lange, F. P. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00874 · Cited by 38
Meta-analytic connectivity modeling of the human superior temporal sulcus
Erickson, L. C., Rauschecker, J. P., & Turkeltaub, P. E. (2016) · Brain Structure and Function · doi:10.1007/s00429-016-1215-z · Cited by 43
Pa, J., Wilson, S. M., Pickell, H., Bellugi, U., & Hickok, G. S. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20154 · Cited by 38
“Using more typical, lower-resolution imaging such as that employed in the present study, this region of the STS appears uniformly multisensory (Beauchamp et al., 2004), consistent with our findings for joint speech/sign activation.”
BackgroundResultInfluentialMayer, A. R., Harrington, D. L., Stephen, J. M., Adair, J. C., & Lee, R. R. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.3.455 · Cited by 38
“Future studies directly comparing auditory and visual orienting are needed to determine if the parietal lobes maintain a supramodal representation of extrapersonal space or can be segregated into modality-specific spatial representations, as has been shown for the temporal lobes ( Beauchamp, Argall, Bodurka, Duyn, & M…”
Sounds exaggerate visual shape
Sweeny, T. D., Guzman-Martinez, E., Ortega, L., Grabowecky, M., & Suzuki, S. (2012) · Cognition · doi:10.1016/j.cognition.2012.04.009 · Cited by 42
Category Training Induces Cross-modal Object Representations in the Adult Human Brain
van der Linden, M., van Turennout, M., & Fernández, G. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21522 · Cited by 42
“Interestingly, the incongruent items also showed an effect of morph level in these areas.”
Föcker, J., Hölig, C., Best, A., & Röder, B. (2011) · Brain Research · doi:10.1016/j.brainres.2011.02.021 · Cited by 37
“…gyrus (MTG), perirhinal cortex, intraparietal sulcus, posterior cingulated cortex) which are known to receive input from sensoryspecific processing streams (Beauchamp et al., 2004; Benevento et al., 1977; Calvert et al., 2001; Shah et al., 2001; see Kayser and Logothetis, 2007 for a review).”
Li, Y., Long, J., Huang, B., Yu, T., Wu, W., Liu, Y., Liang, C., & Sun, P. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht228 · Cited by 34
Crottaz‐Herbette, S., Fornari, E., Notter, M., Bindschaedler, C., Manzoni, L., & Clarke, S. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.08.005 · Cited by 36
Sensory Deprivation and Brain Plasticity
Ptito, M., Kupers, R. C., Lomber, S. G., & Pietrini, P. (2012) · Neural Plasticity · doi:10.1155/2012/810370 · Cited by 38
Spence, C. J. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn214 · Cited by 44
Audiovisual Non-Verbal Dynamic Faces Elicit Converging fMRI and ERP Responses
Brefczynski‐Lewis, J. A., Lowitszch, S., Parsons, M. W., Lemieux, S. K., & Puce, A. (2009) · Brain Topography · doi:10.1007/s10548-009-0093-6 · Cited by 37
“In the current study we were particularly interested in multisensory effects in pSTS due to its postulated role in social related processes (Redcay 2008), and links to different visual, auditory, and motor processes (Beauchamp et al. 2004).”
BackgroundChan, H., Smidts, A., Schoots, V. C., Dietvorst, R. C., & Boksem, M. A. S. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.076 · Cited by 39
The Human Brain Maintains Contradictory and Redundant Auditory Sensory Predictions
Pieszek, M., Widmann, A., Gruber, T., & Schröger, E. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053634 · Cited by 36
Uncovering Multisensory Processing through Non-Invasive Brain Stimulation
Bolognini, N., & Maravita, A. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00046 · Cited by 33
“Anatomical and physiological studies in human and non-human primates have suggested that the superior temporal sulcus (STS) is involved in audio–visual integration for both speech and non-speech stimuli (Calvert, 2001; Beauchamp et al., 2004).”
BackgroundMusical Interaction Reveals Music as Embodied Language
Dell’Anna, A., Leman, M., & Berti, A. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.667838 · Cited by 36
Spatial Heterogeneity of Cortical Receptive Fields and Its Impact on Multisensory Interactions
Carriere, B. N., Royal, D. W., & Wallace, M. T. (2008) · Journal of Neurophysiology · doi:10.1152/jn.01386.2007 · Cited by 36
Supramodal processing optimizes visual perceptual learning and plasticity
Zilber, N., Ciuciu, P., Gramfort, A., Azizi, L., & van Wassenhove, V. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.02.017 · Cited by 35
“First, mSTS is characterized by a patchy organization of multisensory, auditory and visual selective neurons (Beauchamp et al., 2004a) and has systematically been implicated in the analysis of multisensory timing with possible feedback to sensory cortices (Noesselt et al., 2007).”
BackgroundLewis, J. W., Frum, C., Brefczynski‐Lewis, J. A., Talkington, W. J., Walker, N. A., Rapuano, K. M., & Kovach, A. L. (2011) · Human Brain Mapping · doi:10.1002/hbm.21185 · Cited by 36
Ripp, I., Nieden, A. Z., Blankenagel, S., Franzmeier, N., Lundström, J. N., & Freiherr, J. (2018) · Human Brain Mapping · doi:10.1002/hbm.24206 · Cited by 33
Hoefer, M., Tyll, S., Kanowski, M., Brosch, M., Schoenfeld, M. A., Heinze, H. –., & Noesselt, T. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.119 · Cited by 36
“No enhanced fMRI-signals for bimodal stimuli were found in the multisensory STS, which is known to be a convergence zone for audio–visual stimuli (Beauchamp et al., 2004; Noesselt et al., 2007, 2010; Sadaghiani et al., 2009; Schroeder and Foxe, 2002; Werner and Noppeney, 2010a, 2010b; for review see: Calvert and These…”
Stickel, S., Weismann, P., Kellermann, T., Regenbogen, C., Habel, U., Freiherr, J., & Chechko, N. (2019) · Human Brain Mapping · doi:10.1002/hbm.24715 · Cited by 31
Timing in audiovisual speech perception: A mini review and new psychophysical data
Venezia, J. H., Thurman, S. M., Matchin, W., George, S. E., & Hickok, G. S. (2015) · Attention Perception & Psychophysics · doi:10.3758/s13414-015-1026-y · Cited by 34
Direct Structural Connections between Auditory and Visual Motion-Selective Regions in Humans
Gurtubay-Antolín, A., Battal, C., Maffei, C., Rezk, M., Mattioni, S., Jovicich, J., & Collignon, O. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.1552-20.2021 · Cited by 32
A modality-independent proto-organization of human multisensory areas
Setti, F., Handjaras, G., Bottari, D., Leo, A., Diano, M., Bruno, V., Tinti, C., Cecchetti, L., Garbarini, F., Pietrini, P., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01507-3 · Cited by 35
Metzger, B. A., Magnotti, J. F., Wang, Z., Nesbitt, E., Karas, P. J., Yoshor, D., & Beauchamp, M. S. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0279-20.2020 · Cited by 31
“…comprise auditory speech (Belin et al., 2000; Formisano et al., 2008; Mesgarani et al., 2014) and the mouth movements that comprise visual speech (Beauchamp et al., 2004; Bernstein et al., 2011; Rhone et al., 2016; Ozker et al., 2017; Zhu and Beauchamp, 2017; Ozker et al., 2018b; Rennig and…”
BackgroundSelf-citationVisual face-movement sensitive cortex is relevant for auditory-only speech recognition
Riedel, P., Ragert, P., Schelinski, S., Kiebel, S. J., & von Kriegstein, K. (2014) · Cortex · doi:10.1016/j.cortex.2014.11.016 · Cited by 30
Is Vivaldi smooth and takete? Non-verbal sensory scales for describing music qualities
Murari, M., Rodà, A., Canazza, S., Poli, G. D., & Pos, O. D. (2015) · Journal of New Music Research · doi:10.1080/09298215.2015.1101475 · Cited by 30
“As regards the neural substrates underlying crossmodal correspondences, polysensory areas in the temporal cortex have been shown to respond more vigorously to crossmodally congruent pairings of simultaneously presented auditory and visual action stimuli (Beauchamp et al., 2004).”
BackgroundNoppeney, U. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-17 · Cited by 33
The Role of Iconic Gestures in Speech Comprehension: An Overview of Various Methodologies
Arachchige, K. K., Loureiro, I. S., Blekić, W., Rossignol, M., & Lefèbvre, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.634074 · Cited by 29
Dissociable Effects of Aging and Mild Cognitive Impairment on Bottom-Up Audiovisual Integration
Festa, E. K., Katz, A. P., Ott, B. R., Tremont, G. N., & Heindel, W. C. (2017) · Journal of Alzheimer s Disease · doi:10.3233/jad-161062 · Cited by 32
“A decreased ability of amnestic MCI patients to effectively integrate audiovisual speech information under weak discrepant stimulus conditions can be interpreted within a framework developed through neuroimaging studies investigating the role of the STS in audiovisual integration [33, 34, 39].”
Brain Development: Critical Periods for Cross-Sensory Plasticity
Morrone, M. C. (2010) · Current Biology · doi:10.1016/j.cub.2010.09.052 · Cited by 30
“In normal adult monkeys, STS has a patched or columnar organization that interleaves pure auditory, pure visual and multisensory neurons [14].”
BackgroundAn fMRI study of multimodal selective attention in schizophrenia
Mayer, A. R., Hanlon, F. M., Teshiba, T. M., Klimaj, S. D., Ling, J. M., Dodd, A. B., Calhoun, V. D., Bustillo, J., & Toulouse, T. (2015) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.114.155499 · Cited by 30
The sound and the fury: Late positive potential is sensitive to sound affect
Brown, D. R., & Cavanagh, J. F. (2017) · Psychophysiology · doi:10.1111/psyp.12959 · Cited by 28
Modulation of Brain Activity by Selective Attention to Audiovisual Dialogues
Leminen, A., Verwoert, M., Moisala, M., Salmela, V. R., Wikman, P. A., & Alho, K. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00436 · Cited by 30
Rapid changes in brain activity during learning of grapheme-phoneme associations in adults
Xu, W., Kolozsvári, O., Oostenveld, R., & Hämäläinen, J. A. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117058 · Cited by 30
A study in affect: Predicting valence from fMRI data
Kim, J., Weber, C. E., Gao, C., Schulteis, S., Wedell, D. H., & Shinkareva, S. V. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107473 · Cited by 33
Neuromodulation of Early Multisensory Interactions in the Visual Cortex
Convento, S., Vallar, G., Galantini, C., & Bolognini, N. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00347 · Cited by 29
“, 2011; Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004; Calvert, 2001), as well as in the multisensory enhancement of detection sensitivity for low-contrast visual stimuli by co-occurring sounds (Noesselt et al., 2010; Beauchamp et al., 2004; Calvert, 2001).”
BackgroundDrijvers, L., Özyürek, A., & Jensen, O. B. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01301 · Cited by 27
“…speech) have suggested that the STS might be related to associating the auditory and visual modalities at a lower-level stage of multimodal matching (e.g., Beauchamp, 2005; Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004; Beauchamp, Lee, Argall, & Martin, 2004; Callan et al., 2004; Calvert, 2001).”
Wroblewski, A., He, Y., & Straube, B. (2019) · Schizophrenia Research · doi:10.1016/j.schres.2019.12.005 · Cited by 30
Trimodal processing of complex stimuli in inferior parietal cortex is modality-independent
Porada, D. K., Regenbogen, C., Freiherr, J., Seubert, J., & Lundström, J. N. (2021) · Cortex · doi:10.1016/j.cortex.2021.03.008 · Cited by 26
The relationship between multisensory associative learning and multisensory integration
Lauzon, S., Abraham, A. E., Curcin, K., Butler, B. E., & Stevenson, R. A. (2022) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2022.108336 · Cited by 29
Visual stimulus locking of EEG is modulated by temporal congruency of auditory stimuli
Schall, S., Quigley, C., Onat, S., & König, P. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1867-5 · Cited by 28
Common cortical responses evoked by appearance, disappearance and change of the human face
Tanaka, E., Inui, K., Kida, T., & Kakigi, R. (2009) · BMC Neuroscience · doi:10.1186/1471-2202-10-38 · Cited by 27
“fMRI studies have emphasized the importance of the TPJ in multimodal integration [48,49].”
BackgroundNeural dynamics of learning sound-action associations
McNamara, A., Buccino, G., Menz, M. M., Gläscher, J., Wolbers, T., Baumgärtner, A., & Binkofski, F. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003845 · Cited by 25
“This, as well as the lack of activation in the multi-sensory regions of the superior temporal sulcus sensitive to human movement [54–56] might be due to the stimuli not having common features across modalities [57].”
BackgroundPeelle, J. E., Spehar, B., Jones, M. S., McConkey, S. M., Myerson, J., Hale, S., Sommers, M. S., & Tye‐Murray, N. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.0114-21.2021 · Cited by 25
Metadata
- Authors
- Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Beauchamp, Michael S
- Venue
- Nature Neuroscience
- Published
- 2004-10-10
- Volume
- 7
- Issue
- 11
- Pages
- 1190-1192
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W1970618766
- Cited by
- 513
- References
- 16
- Citations by year
- 2026: 14 · 2025: 12 · 2024: 9 · 2023: 9 · 2022: 17 · 2021: 29 · 2020: 21 · 2019: 22 · 2018: 21 · 2017: 24 · 2016: 17 · 2015: 19 · 2014: 27 · 2013: 31 · 2012: 29
- FWCI
- 36.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- multisensory integration, superior temporal sulcus, functional architecture, parallel imaging, high-resolution fMRI, human cortex
- MeSH terms
- Acoustic Stimulation, Auditory Perception, Brain Mapping, Humans, Image Processing, Computer-Assisted, Functional Laterality, Magnetic Resonance Imaging, Oxygen, Photic Stimulation, Somatosensory Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.