Unraveling multisensory integration: patchy organization within human STS multisensory cortex
The DOI matches its Crossref record; 15 of the 16 references it cites were found in a registry or an index.
Abstract
Although early sensory cortex is organized along dimensions encoded by receptor organs, little is known about the organization of higher areas in which different modalities are integrated. We investigated multisensory integration in human superior temporal sulcus using recent advances in parallel imaging to perform functional magnetic resonance imaging (fMRI) at very high resolution. These studies suggest a functional architecture in which information from different modalities is brought into close proximity via a patchy distribution of inputs, followed by integration in the intervening cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Self-citationIntegration of Letters and Speech Sounds in the Human Brain
van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.025 · Cited by 544
Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements
Beauchamp, M. S., Lee, K. E., Haxby, J. V., & Martin, A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00642-6 · Cited by 528
Self-citationHuman Ocular Dominance Columns as Revealed by High-Field Functional Magnetic Resonance Imaging
Cheng, K., Waggoner, R. A., & Tanaka, K. (2001) · Neuron · doi:10.1016/s0896-6273(01)00477-9 · Cited by 383
A revised view of sensory cortical parcellation
Wallace, M. T., Ramachandran, R., & Stein, B. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0305697101 · Cited by 343
Seltzer, B., & Pandya, D. N. (1994) · Journal of Comparative Neurology · doi:10.1002/cne.903430308 · Cited by 327
Hikosaka, K., Iwai, E., Saito, H., & Tanaka, K. (1988) · Journal of Neurophysiology · doi:10.1152/jn.1988.60.5.1615 · Cited by 296
Benevento, L. A., Fallon, J., Davis, B. J., & Rezak, M. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90112-1 · Cited by 288
Cited by
Items 301–400 of 532
When a photograph can be heard: Vision activates the auditory cortex within 110 ms
Proverbio, A. M., D’Aniello, G. E., Adorni, R., & Zani, A. (2011) · Scientific Reports · doi:10.1038/srep00054 · Cited by 25
Who's that Knocking at My Door? Neural Bases of Sound Source Identification
Lemaître, G., Pyles, J. A., Halpern, A. R., Navolio, N., Lehet, M. I., & Heller, L. M. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw397 · Cited by 26
“The pSTS/MTG complex is sensitive to audio, visual, and audiovisual presentations of nonbiological and biological motions (Beauchamp et al. 2002, 2003, 2004; Bidet-Caulet et al. 2005; Grossman et al. 2005; Doehrmann et al. 2008), and even words denoting action (Kiefer et al. 2012).”
BackgroundBrain activations associated with scientific reasoning: a literature review
Nenciovici, L., Allaire‐Duquette, G., & Masson, S. (2018) · Cognitive Processing · doi:10.1007/s10339-018-0896-z · Cited by 25
Dorsal and Ventral Cortical Pathways for Visuo-haptic Shape Integration Revealed Using fMRI
James, T. W., & Kim, S. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5615-6_13 · Cited by 27
“It is possible that this type of influence may explain the inconsistency in results from different research groups using superadditivity as a criterion (Beauchamp, 2005a, b; Beauchamp et al., 2004a, b; Laurienti et al., 2006; Peiffer et al., 2007; Stevenson and James, 2009; Stevenson et al., 2007).”
ResultThe effect of attention on the illusory capture of motion in bimodal stimuli
Oruç, İ., Sinnett, S., Bischof, W. F., Soto‐Faraco, S., Lock, K., & Kingstone, A. F. (2008) · Brain Research · doi:10.1016/j.brainres.2008.04.014 · Cited by 27
“…and faster behavioural reactions, but also in terms of earlier and stronger neural correlates using electrophysiology and brain imaging techniques (Beauchamp et al., 2004a,b; Calvert et al., 2000; Foxe et al., 2000, 2002; Molholm et al., 2002; Murray et al., 2005; Senkowski et al., 2006, 2007).”
BackgroundChechlacz, M., Terry, A., Demeyere, N., Douis, H., Bickerton, W., Rotshtein, P., & Humphreys, G. W. (2013) · NeuroImage Clinical · doi:10.1016/j.nicl.2013.01.013 · Cited by 29
“While earlier studies indicated that the STS multisensory region (STSms) underlies processing of auditory and visual information (Beauchamp et al., 2004a, 2004b; Calvert, 2001; Noesselt et al., 2007), later reports have confirmed that it is also involved in touch perception (Beauchamp et al., 2008).”
Putative mechanisms mediating tolerance for audiovisual stimulus onset asynchrony
Bhat, J., Miller, L. M., Pitt, M. A., & Shahin, A. J. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00200.2014 · Cited by 26
“A possible neural network facilitating this kind of integration is the posterior superior temporal sulcus-gyrus (pSTS-G) (Beauchamp et al. 2004a, 2004b; Bishop and Miller 2009; Keil et al. 2011; Miller and D’Esposito 2005; Nath and Beauchamp 2011; Okada et al. 2010).”
BackgroundInfluentialBasile, G. A., Tatti, E., Bertino, S., Milardi, D., Genovese, G., Bruno, A., Muscatello, M. R. A., Ciurleo, R., Cerasa, A., Quartarone, A., et al. (2024) · Brain Structure and Function · doi:10.1007/s00429-024-02781-9 · Cited by 24
“…along with being activated by auditory looming stimuli (Seifritz et al. 2002; Hall and Moore 2003; Bach et al. 2009), is involved in multi-sensory integration, as it contains visual neurons responding to the sight of movement (Beauchamp et al. 2004; Barraclough et al. 2005; Huang et al. 2018).”
BackgroundSocial and Affective Neuroscience of Everyday Human Interaction: From Theory to Methodology
Boggio, P. S., Wingenbach, T. S. H., Coêlho, M. L. D. S., Comfort, W. E., Marques, L. M., & Alves, M. V. (2022) · Springer eBooks · doi:10.1007/978-3-031-08651-9 · Cited by 31
Cuppini, C., Ursino, M., Magosso, E., Ross, L. A., Foxe, J. J., & Molholm, S. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00518 · Cited by 25
“The third downstream area simulates multisensory neurons in a cortical region (pSTG/S) known to be involved in speech processing and MSI (Beauchamp et al., 2004; Saint-Amour et al., 2007; Matchin et al., 2014; Erickson et al., 2015).”
BackgroundRennig, J., & Beauchamp, M. S. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.08.008 · Cited by 23
Self-citationImpairments in Multisensory Integration after Stroke
der Stoep, N. V., der Stigchel, S. V., Engelen, R. C. V., Biesbroek, J. M., & Nijboer, T. C. W. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01389 · Cited by 26
Brain responses to auditory and visual stimulus offset: Shared representations of temporal edges
Herdener, M., Lehmann, C. U., Esposito, F., Salle, F. D., Federspiel, A., Bach, D. R., Scheffler, K., & Seifritz, E. (2008) · Human Brain Mapping · doi:10.1002/hbm.20539 · Cited by 25
“Most neuroimaging studies in humans that have demonstrated multisensory properties of STS used complex auditory and visual objects like pictures or sound recordings of tools or living objects [Beauchamp et al., 2004b] or linguistic material [Calvert et al., 2000; Raij et al., 2000] as stimuli.”
BackgroundInfluentialBenetti, S., Ferrari, A., & Pavani, F. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1108354 · Cited by 24
“Consistently, multimodal integration in pSTS may allow the creation of meaningful neural representations (Beauchamp et al., 2004; Noppeney et al., 2018), including those bearing semantic and pragmatic values for social communication (i.”
BackgroundAltvater‐Mackensen, N., & Großmann, T. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.10.002 · Cited by 23
Matusz, P. J., Turoman, N., Tivadar, R. I., Retsa, C., & Murray, M. M. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01360 · Cited by 24
Yang, Y., Yang, Y., Li, J., Xu, M., & Bi, H. (2019) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2019.100884 · Cited by 24
Striem-Amit, E., Bubic, R., & Amedi, A. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-27 · Cited by 26
Multimodal Music Perception Engages Motor Prediction: A TMS Study
Gordon, C. L., Iacoboni, M., & Balasubramaniam, R. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00736 · Cited by 23
Visual speech differentially modulates beta, theta, and high gamma bands in auditory cortex
Ganesan, K., Plass, J., Beltz, A. M., Liu, Z., Grabowecky, M., Suzuki, S., Stacey, W. C., Wasade, V. S., Towle, V. L., Tao, J. X., et al. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15482 · Cited by 21
“This region demonstrates strong differences between auditory-alone and audiovisual stimuli in both fMRI and iEEG research (Beauchamp et al., 2004; Okada et al., 2013; Ozker et al., 2017, 2018), and has potential causal roles in audiovisual speech integration as revealed by lesion mapping (Brang et…”
Schall, S., & von Kriegstein, K. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086325 · Cited by 22
“With regard to the functional specificity of the pSTS, it is difficult to entirely dissociate face-movement sensitive and multisensory regions in the STS as they are partially overlapping [43,44].”
BackgroundNeural Basis of Impaired Emotion Recognition in Adult Attention-Deficit/Hyperactivity Disorder
Zuberer, A., Schwarz, L., Kreifelts, B., Wildgruber, D., Erb, M., Fallgatter, A. J., Scheffler, K., & Ethofer, T. (2020) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.11.013 · Cited by 26
[i] is Lighter and More Greenish Than [o]: Intrinsic Association Between Vowel Sounds and Colors
Kim, H.-W., Nam, H., & Kim, C.-Y. (2017) · Multisensory Research · doi:10.1163/22134808-00002581 · Cited by 20
Right STS responses to biological motion in infancy – An fNIRS study using point-light walkers
Lisboa, I. C., Miguel, H. O., Sampaio, A., Mouta, S. S., Santos, J. A., & Pereira, A. F. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107668 · Cited by 21
Chu, Y.-H., Lin, F., Chou, Y.-J., Tsai, K. W., Kuo, W., & Jääskeläinen, I. P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080265 · Cited by 21
“These studies have suggested that auditory processing is robustly modulated especially in the left hemisphere posterior superior temporal gyrus/sulcus (pSTG/S) [4–17].”
BackgroundSemantic Congruence Alters Functional Connectivity during Olfactory-Visual Perception
Sijben, R., Hoffmann-Hensel, S. M., Rodriguez‐Raecke, R., Haarmeier, T., & Freiherr, J. (2018) · Chemical Senses · doi:10.1093/chemse/bjy048 · Cited by 19
Møller, C. M., Garza‐Villarreal, E. A., Hansen, N. C., Højlund, A., Bærentsen, K. B., Chakravarty, M. M., & Vuust, P. (2021) · Scientific Reports · doi:10.1038/s41598-021-83135-x · Cited by 20
Steines, M., Nagels, A., Kircher, T. T. J., & Straube, B. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118182 · Cited by 20
Ohla, K., Höchenberger, R., Freiherr, J., & Lundström, J. N. (2017) · Chemical Senses · doi:10.1093/chemse/bjx068 · Cited by 20
“…neuroimaging studies has implicated heteromodal frontal, temporal, and parietal areas in the human brain in multisensory processing, i.e., the (posterior) STS, IPS, and inferior frontal gyrus (IFG) (Calvert et al. 2000; Beauchamp et al. 2004a; Beauchamp et al. 2004b; Ghazanfar and Schroeder 2006).”
BackgroundNaturalizing the Acting Self: Subjective vs. Anonymous Agency
Legrand, D. (2007) · Philosophical Psychology · doi:10.1080/09515080701441736 · Cited by 21
“Using tenfold higher resolution fMRI, Beauchamp et al. (2004) have unravelled a patchy organization, with specific sub-areas of the human superior temporal sulcus multisensory area (STS-MS) activated maximally by auditory, visual or auditory-visual stimuli, respectively.”
BackgroundNeural reflections of meaning in gesture, language, and action
Willems, R. M. (2009) · MPG.PuRe (Max Planck Society) · Cited by 30
Yang, J., Asano, M., Kanazawa, S., Yamaguchi, M. K., & Imai, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-49917-0 · Cited by 18
Babo-Rebelo, M., Puce, A., Bullock, D. N., Hugueville, L., Pestilli, F., Adam, C., Lehongre, K., Lambrecq, V., Dinkelacker, V., & George, N. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab212 · Cited by 19
“The core face network also includes the STS, a region associated with multisensory integration (Beauchamp et al. 2004), the processing of biological motion (Bonda et al. 1996), facial motion (Puce et al. 1998), and social attention (Allison et al. 2000).”
BackgroundSpatiotemporal integration of looming visual and tactile stimuli near the face
Huang, R., Chen, C., & Sereno, M. I. (2018) · Human Brain Mapping · doi:10.1002/hbm.23995 · Cited by 17
“…and stimuli: (1) stimulus modalities (visual, auditory, tactile, and so on); (2) semantic or content congruency across modalities (Beauchamp, 2005b; Beauchamp et al., 2004a, 2004b; Calvert, 2001); (3) spatial congruency (Macaluso & Driver, 2001, 2005) or precise alignment of receptive fields…”
BackgroundMethodInfluentialMapping of facial and vocal processing in common marmosets with ultra-high field fMRI
Dureux, A., Zanini, A., & Everling, S. (2024) · Communications Biology · doi:10.1038/s42003-024-06002-1 · Cited by 22
Normal recognition of famous voices in developmental prosopagnosia
Tsantani, M., & Cook, R. (2020) · Scientific Reports · doi:10.1038/s41598-020-76819-3 · Cited by 19
Barutchu, A., & Spence, C. J. (2021) · Experimental Brain Research · doi:10.1007/s00221-020-06014-3 · Cited by 17
Contextual control of audiovisual integration in low‐level sensory cortices
van Atteveldt, N., Peterson, B. S., & Schroeder, C. E. (2013) · Human Brain Mapping · doi:10.1002/hbm.22336 · Cited by 18
Retter, T. L., Webster, M. A., & Jiang, F. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01378 · Cited by 17
Multisensory Influences on Auditory Processing: Perspectives from fMRI and Electrophysiology
Kayser, C., Petkov, C. I., Remedios, R., & Logothetis, N. K. (2011) · Frontiers in neuroscience · doi:10.1201/9781439812174-9 · Cited by 17
Single-Trial Multisensory Learning and Memory Retrieval
Murray, M. M., & Sperdin, H. F. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5615-6_11 · Cited by 17
“Beauchamp et al., 2004; Calvert, 2001; Hein et al., 2007; Laurienti et al., 2003, 2004; Molholm et al., 2004).”
Evidence of multisensory plasticity: Asymmetrical medial geniculate body in people with one eye
Moro, S. S., Kelly, K. R., McKetton, L., Gallie, B. L., & Steeves, J. K. E. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.09.016 · Cited by 16
“, 1993) and audiovisualmultisensory integration (Beauchamp et al., 2004), respectively, indicating reorganization in cortical areas outside of primary visual regions following early monocular enucleation (Kelly et al.”
Li, Y., Wang, G., Long, J., Yu, Z., Huang, B., Li, X., Yu, T., Liang, C., Li, Z., & Sun, P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020801 · Cited by 16
“This may be a superadditive BOLD response and supports existing theory about audiovisual integration [28,29].”
BackgroundInfluentialThe Role of Speech Production System in Audiovisual Speech Perception
Jääskeläinen, I. P. (2010) · The Open Neuroimaging Journal · doi:10.2174/1874440001004020030 · Cited by 18
“Further, much like what has been observed in animal studies [42], there appears to be patches of cortex adjacent to each other within the human pSTS responding to auditory, visual, and audiovisual stimulation [31].”
BackgroundAudio-Visual Perception of Everyday Natural Objects – Hemodynamic Studies in Humans
Lewis, J. W. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5615-6_10 · Cited by 19
Neuropsychological implications of selective attentional functioning in psychopathic offenders.
Mayer, A. R., Kosson, D. S., & Bedrick, E. J. (2006) · Neuropsychology · doi:10.1037/0894-4105.20.5.614 · Cited by 16
“Because cross-modal processing requires integration of information across different sensory modalities, it appears to depend, in part, on different cortical processing systems in the temporal lobes more than does unimodal processing ( Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004 ).”
BackgroundBeta resting-state functional connectivity predicts tactile spatial acuity
Sasaki, R., Kojima, S., Otsuru, N., Yokota, H., Saito, K., Shirozu, H., & Onishi, H. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad221 · Cited by 16
“Furthermore, previous works suggest that the temporal lobe integrates multisensory information (Schroeder et al. 2001; Beauchamp et al. 2004).”
BackgroundDureux, A., Zanini, A., Trapeau, R., Belin, P., & Everling, S. (2025) · Current Biology · doi:10.1016/j.cub.2025.07.008 · Cited by 14
Sea Urchins as an Inspiration for Robotic Designs
Stiefel, K. M., & Barrett, G. A. (2018) · Journal of Marine Science and Engineering · doi:10.3390/jmse6040112 · Cited by 15
Bretas, R. V., Taoka, M., Hihara, S., Cleeremans, A., & Iriki, A. (2021) · Brain Sciences · doi:10.3390/brainsci11020157 · Cited by 18
Neural basis of multi-sensory communication in primates
Sliwa, J., Mallet, M., Christiaens, M., & Takahashi, D. Y. (2022) · Ethology Ecology & Evolution · doi:10.1080/03949370.2021.2024266 · Cited by 13
“This is evident from the grouping of similar functional processes in nearby brain regions irrespective of signal modality; and by the existence of large brain region, such as dorsal STS, maximally engaged when signals are presented in multiple modalities (Beauchamp et al. 2004; Chandrasekaran & Ghazanfar 2009; Dahl et…”
BackgroundMultisensory mental imagery of fatigue : Evidence from an fMRI study
Tomasino, B., Negro, I. D., Garbo, R., Gigli, G. L., D’Agostini, S., & Valente, M. R. (2022) · Human Brain Mapping · doi:10.1002/hbm.25839 · Cited by 16
The assessment of auditory function in CSWS: Lessons from long‐term outcome
Metz‐Lutz, M. (2009) · Epilepsia · doi:10.1111/j.1528-1167.2009.02225.x · Cited by 15
“Data from recent neuroimaging studies provide evidence for the role of the superior temporal sulcus multisensory area in integrating auditory and visual information, not only about speech but also about objects and other behaviorally relevant stimuli (Beauchamp et al., 2004a,b).”
BackgroundDorsal‐movement and ventral‐form regions are functionally connected during visual‐speech recognition
Borowiak, K., Maguinness, C., & von Kriegstein, K. (2019) · Human Brain Mapping · doi:10.1002/hbm.24852 · Cited by 16
Optic flow selectivity in the macaque parieto-occipital sulcus
Pitzalis, S., Hadj‐Bouziane, F., Bò, G. D., Guedj, C., Strappini, F., Meunier, M., Farnè, A., Fattori, P., & Galletti, C. (2021) · Brain Structure and Function · doi:10.1007/s00429-021-02293-w · Cited by 16
Optimizing brain tissue contrast with EPI: A simulated annealing approach
Ikonomidou, V. N., van Gelderen, P., de Zwart, J. A., Fukunaga, M., & Duyn, J. H. (2005) · Magnetic Resonance in Medicine · doi:10.1002/mrm.20561 · Cited by 15
“This should facilitate fMRI interpretation on a case-by-case basis, particularly for high-resolution scans (29,30); however, it will not necessarily simplify the analysis of group data.”
BackgroundSelf-citationZhao, B., Zhang, Y., & Chen, A. (2021) · The Journal of Physiology · doi:10.1113/jp281913 · Cited by 15
“In particular, a human polysensory region homologous withmacaque STP (STSms; Beauchamp et al. 2004b; Beauchamp et al. 2008) has been found to respond strongly to artificial vestibular stimulation (Smith et al. 2012).”
BackgroundResultInfluentialEvent-related potentials in semantic memory retrieval
Brier, M. R., Maguire, M. J., Tillman, G. D., Hart, J., & Kraut, M. A. (2008) · Journal of the International Neuropsychological Society · doi:10.1017/s135561770808096x · Cited by 15
“, 1998), and the superior temporal gyrus (Beauchamp et al., 2004), in addition to areas Correspondence and reprint requests to: Michael A.”
Multimodal access to verbal name codes
Berryhill, M. E., Kveraga, K., Webb, L., & Hughes, H. C. (2007) · Perception & Psychophysics · doi:10.3758/bf03193920 · Cited by 14
“Integration of auditory and visual inputs during speech processing has also been investigated using neuroimaging and electrophysiological techniques ( Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004; Calvert, 2001; Cal-MULTIMODAL ACCESS 631”
Reilly, J. J., Garcia, A. M., & Binney, R. J. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.05.006 · Cited by 14
Shahin, A. J., Shen, S., & Kerlin, J. R. (2017) · Language Cognition and Neuroscience · doi:10.1080/23273798.2017.1283428 · Cited by 14
Gentile, F., van Atteveldt, N., Martino, F. D., & Goebel, R. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.0146-17.2017 · Cited by 15
“Previous high-resolution studies on multisensory integration, for example, that used natural stimuli: movie clips of tools being used (Beauchamp et al., 2004b) or monkey vocalizations (Dahl et al., 2009), showed a proportion of visual voxels within the bSTC much larger and comparable with auditory…”
BackgroundMethodResultInfluentialA functional MRI investigation of crossmodal interference in an audiovisual Stroop task
Fitzhugh, M. C., Whitehead, P. S., Johnson, L., Cai, J., Baxter, L. C., & Rogalsky, C. (2019) · PLoS ONE · doi:10.1371/journal.pone.0210736 · Cited by 18
The Other-Race-Effect on Audiovisual Speech Integration in Infants: A NIRS Study
Ujiie, Y., Kanazawa, S., & Yamaguchi, M. K. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00971 · Cited by 14
“for processing audiovisual speech (e.g., Calvert et al., 2000; Beauchamp et al., 2004), is responsible for the McGurk effect (Beauchamp et al.”
BackgroundAuditory cortex encodes lipreading information through spatially distributed activity
Karthik, G., Cao, C. Z., Demidenko, M. I., Jahn, A., Stacey, W. C., Wasade, V. S., & Brang, D. (2024) · Current Biology · doi:10.1016/j.cub.2024.07.073 · Cited by 13
Pietro, S. V. D., Karipidis, I. I., Pleisch, G., & Brem, S. (2023) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2023.101255 · Cited by 13
“Whereas the vOTC is crucial for processing written language, the brain areas for processing speech and for audiovisual integration are mainly located within the superior temporal cortex, its sulcus and gyrus, and the primary auditory cortex (Beauchamp et al., 2004; Booth et al., 2001; Raij et al., 2000; van Atteveldt…”
BackgroundDistributed neural signatures of natural audiovisual speech and music in the human auditory cortex
Salmi, J., Koistinen, O.-P., Glerean, E., Jylänki, P., Vehtari, A., Jääskeläinen, I. P., Mäkelä, S., Nummenmaa, L., Nummi-Kuisma, K., Nummi, I., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.12.005 · Cited by 14
“As many previous studies (Beauchamp et al. 2004, Romanski & Hwang 2012, Wayne & Johnsrude 2012, Conrad et al. 2013, Li et al. 2015), we used complex naturalistic stimuli in order to activate widespread temporal cortex areas associated with audiovisual processing.”
Chi, Y., Yue, Z., Liu, Y., Mo, L., & Chen, Q. (2014) · Human Brain Mapping · doi:10.1002/hbm.22454 · Cited by 13
Inputs, Outputs, and Multisensory Processing
Rohe, T., & Zeise, M. L. (2020) · Springer eBooks · doi:10.1007/978-3-030-47645-8_6 · Cited by 14
Visuomotor decision-making through multifeature convergence in the larval zebrafish hindbrain
Slangewal, K., Aimon, S., Capelle, M. Q., Kämpf, F., Naumann, H., Slanchev, K., Baier, H., & Bahl, A. (2026) · Nature Communications · doi:10.1038/s41467-026-69633-4 · Cited by 14
“In humans, multisensory regions like the posterior superior temporal sulcus and middle temporal gyrus exhibit modality-speci fi c substreamsthat interact depending on taskcontext 62 .”
On perceived synchrony—neural dynamics of audiovisual illusions and suppressions
Noesselt, T., Bonath, B., Boehler, C. N., Schoenfeld, M. A., & Heinze, H. (2007) · Brain Research · doi:10.1016/j.brainres.2007.09.045 · Cited by 15
Impact of language on functional connectivity for audiovisual speech integration
Shinozaki, J., Hiroe, N., Sato, M.-A., Nagamine, T., & Sekiyama, K. (2016) · Scientific Reports · doi:10.1038/srep31388 · Cited by 15
Crossmodal association of auditory and visual material properties in infants
Ujiie, Y., Yamashita, W., Fujisaki, W., Kanazawa, S., & Yamaguchi, M. K. (2018) · Scientific Reports · doi:10.1038/s41598-018-27153-2 · Cited by 12
Schulze, M., Aslan, B., Farrher, E., Grinberg, F., Shah, N. J., Schirmer, M. D., Radbruch, A., Stöcker, T., Lux, S., & Philipsen, A. (2023) · Brain Sciences · doi:10.3390/brainsci13030388 · Cited by 11
“STG is also referred to as a parabelt region of the auditory cortex and has been reported to play a sensitive role in MI [44,45].”
BackgroundMirror Neurons in Action: ERPs and Neuroimaging Evidence
Proverbio, A. M., & Zani, A. (2022) · Springer eBooks · doi:10.1007/978-3-031-08651-9_5 · Cited by 24
Borowiak, K., & von Kriegstein, K. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-00903-5 · Cited by 13
Audiovisual Integration of Emotional Information from Voice and Face
Kreifelts, B., Wildgruber, D., & Ethofer, T. (2012) · Springer eBooks · doi:10.1007/978-1-4614-3585-3_12 · Cited by 14
Involvement of superior temporal areas in audiovisual and audiomotor speech integration
Komeilipoor, N., Cesari, P., & Daffertshofer, A. (2016) · Neuroscience · doi:10.1016/j.neuroscience.2016.03.047 · Cited by 11
“…(Van Atteveldt et al., 2004), emotions Please cite this article in press as: Komeilipoor N et al. Involvement of superior roscience (2016), http://dx.doi.org/10.1016/j.neuroscience.2016.03.047 (Kreifelts et al., 2007), animals (Beauchamp et al., 2004b), and tools (Beauchamp et al., 2004a,b).”
InfluentialFusion and combination in audio-visual integration
Omata, K., & Mogi, K. (2007) · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rspa.2007.1910 · Cited by 15
“Blind children, compared with sighted children, are at a disadvantage in language acquisition (Mills 1983, 1988; Andersen et al. 1993; Warren 1994).”
BackgroundNeural Mechanisms for Biological Motion and Animacy
Pyles, J. A., & Grossman, E. D. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195393705.003.0017 · Cited by 11
Functional localization of audiovisual speech using near infrared spectroscopy
Butera, I. M., Larson, E. D., DeFreese, A. J., Lee, A. K. C., Gifford, R. H., & Wallace, M. T. (2022) · Brain Topography · doi:10.1007/s10548-022-00904-1 · Cited by 12
“In particular, the superior temporal sulcus (STS) receives convergent input from both auditory association areas and extrastriate visual areas, and has been implicated in both AV speech integration as well as perception of the McGurk illusion (Beauchamp et al. 2004, 2010).”
BackgroundGrill-Spector, K. (2008) · Elsevier eBooks · doi:10.1016/b978-012370509-9.00130-3 · Cited by 12
Receptive Language Organization in High-Functioning Autism
Frye, R. E., & Beauchamp, M. S. (2009) · Journal of Child Neurology · doi:10.1177/0883073808329572 · Cited by 12
“The posterior superior temporal gyrus, a brain area involved in verbal language processing, appears to be critical for multisensory integration.(15) Thus, posterior superior temporal gyrus abnormalities may affect the development of language and multisensory integration.”
BackgroundSelf-citationLearned face–voice pairings facilitate visual search
Zweig, L. J., Suzuki, S., & Grabowecky, M. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0685-3 · Cited by 11
“…maximally to multisensory person-identity representations, which may include areas proposed to be involved in multisensory object recognition (Amedi, von Kriegstein, van Atteveldt, Beauchamp, & Naumer, 2005; Beauchamp et al., 2004; Dahl, Logothetis, & Kayser, 2009; Zheng, Wild, & Trang, 2010).”
BackgroundBhat, J., Pitt, M. A., & Shahin, A. J. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00173 · Cited by 11
Francisco, A. A., Takashima, A., McQueen, J. M., van den Bunt, M. R., Jesse, A., & Groen, M. A. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.07.009 · Cited by 10
Multisensory Interactions in Speech Perception
Navarra, J., Yeung, H. H., Werker, J. F., & Soto‐Faraco, S. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8466.003.0038 · Cited by 16
The other-race effect on the McGurk effect in infancy
Ujiie, Y., Kanazawa, S., & Yamaguchi, M. K. (2021) · Attention Perception & Psychophysics · doi:10.3758/s13414-021-02342-w · Cited by 9
Rennig, J., & Beauchamp, M. S. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118796 · Cited by 9
Self-citationFunctional Anatomy of the Sense of Agency: Past Evidence and Future Driections
David, N. (2010) · Springer eBooks · doi:10.1007/978-88-470-1587-6_4 · Cited by 13
Inside Speech: Multisensory and Modality-specific Processing of Tongue and Lip Speech Actions
Treille, A., Vilain, C., Hueber, T., Lamalle, L., & Sato, M. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01057 · Cited by 10
Catching Audiovisual Interactions With a First-Person Fisherman Video Game
Sun, Y., Hickey, T. J., Shinn‐Cunningham, B. G., & Sekuler, R. (2016) · Perception · doi:10.1177/0301006616682755 · Cited by 9
Saalasti, S., ALHO, J. S., Lahnakoski, J. M., Bacha‐Trams, M., Glerean, E., Jääskeläinen, I. P., Hasson, U., & Sams, M. E. (2022) · Brain and Behavior · doi:10.1002/brb3.2869 · Cited by 8
Cross-modal enhancement of defensive behavior via parabigemino-collicular projections
Peng, B., Huang, J., Li, Z., Zhang, L. I., & Tao, H. W. (2024) · Current Biology · doi:10.1016/j.cub.2024.06.052 · Cited by 8
Dynamics of Within-, Inter-, and Cross-Modal Attentional Modulation
Kida, T., Inui, K., Tanaka, E., & Kakigi, R. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00807.2009 · Cited by 8
“The MEG signal was recorded with a helmet-shaped detector array (Vectorview, ELEKTA Neuromag Yo, Helsinki, Finland), which in each of 102 locations has three sensors (306 sensors in all), two orthogonal planar gradiometers, and one magnetometer coupled to a multi-SQUID (superconducting quantum interference device).”
BackgroundResultInfluentialAuditory Cortex Anatomy and Asymmetry in Schizophrenia
Smiley, J. F. (2009) · Springer eBooks · doi:10.1007/978-0-387-30410-6_11 · Cited by 8
Neuroplasticity in the blind and sensory substitution for vision
Striem-Amit, E. (2014) · doi:10.13140/2.1.2640.2247 · Cited by 7
Multisensory contributions to object recognition and memory across the life span
Matusz, P. J., Wallace, M. T., & Murray, M. M. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-812492-5.00006-1 · Cited by 8
Crossmodal Postdiction: Conscious Perception as Revisionist History
Stiles, N. R. B., Tanguay, A. R., & Shimojo, S. (2022) · Journal of Perceptual Imaging · doi:10.2352/j.percept.imaging.2022.5.000403 · Cited by 9
Brain regions involved in speech production, mechanism and development
Jahanaray, M., Jahanaray, A., & Zohoorian, Z. (2022) · Neuroscience Research Notes · doi:10.31117/neuroscirn.v5i4.178 · Cited by 8
“These regions respond to auditory and visual stimuli such as faces and voices, letters and voices, and recordings and videos of objects (Atteveldt et al., 2004; Beauchamp et al., 2004; Calvert et al., 2000; Foxe et al., 2002; Miller & D'Esposito, 2005; Reale et al., 2007).”
Metadata
- Authors
- Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Beauchamp, Michael S
- Venue
- Nature Neuroscience
- Published
- 2004-10-10
- Volume
- 7
- Issue
- 11
- Pages
- 1190-1192
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W1970618766
- Cited by
- 513
- References
- 16
- Citations by year
- 2026: 14 · 2025: 12 · 2024: 9 · 2023: 9 · 2022: 17 · 2021: 29 · 2020: 21 · 2019: 22 · 2018: 21 · 2017: 24 · 2016: 17 · 2015: 19 · 2014: 27 · 2013: 31 · 2012: 29
- FWCI
- 36.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- multisensory integration, superior temporal sulcus, functional architecture, parallel imaging, high-resolution fMRI, human cortex
- MeSH terms
- Acoustic Stimulation, Auditory Perception, Brain Mapping, Humans, Image Processing, Computer-Assisted, Functional Laterality, Magnetic Resonance Imaging, Oxygen, Photic Stimulation, Somatosensory Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.