Unraveling multisensory integration: patchy organization within human STS multisensory cortex
The DOI matches its Crossref record; 15 of the 16 references it cites were found in a registry or an index.
Abstract
Although early sensory cortex is organized along dimensions encoded by receptor organs, little is known about the organization of higher areas in which different modalities are integrated. We investigated multisensory integration in human superior temporal sulcus using recent advances in parallel imaging to perform functional magnetic resonance imaging (fMRI) at very high resolution. These studies suggest a functional architecture in which information from different modalities is brought into close proximity via a patchy distribution of inputs, followed by integration in the intervening cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Self-citationIntegration of Letters and Speech Sounds in the Human Brain
van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.025 · Cited by 544
Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements
Beauchamp, M. S., Lee, K. E., Haxby, J. V., & Martin, A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00642-6 · Cited by 528
Self-citationHuman Ocular Dominance Columns as Revealed by High-Field Functional Magnetic Resonance Imaging
Cheng, K., Waggoner, R. A., & Tanaka, K. (2001) · Neuron · doi:10.1016/s0896-6273(01)00477-9 · Cited by 383
A revised view of sensory cortical parcellation
Wallace, M. T., Ramachandran, R., & Stein, B. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0305697101 · Cited by 343
Seltzer, B., & Pandya, D. N. (1994) · Journal of Comparative Neurology · doi:10.1002/cne.903430308 · Cited by 327
Hikosaka, K., Iwai, E., Saito, H., & Tanaka, K. (1988) · Journal of Neurophysiology · doi:10.1152/jn.1988.60.5.1615 · Cited by 296
Benevento, L. A., Fallon, J., Davis, B. J., & Rezak, M. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90112-1 · Cited by 288
Cited by
Where do you know what you know? The representation of semantic knowledge in the human brain
Patterson, K., Nestor, P. J., & Rogers, T. T. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2277 · Cited by 2,706
Repetition and the brain: neural models of stimulus-specific effects
Grill-Spector, K., Henson, R., & Martin, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.11.006 · Cited by 2,256
“Improvements in the spatial resolution of fMRI [ 78 ] are likely to be important for distinguishing between models.”
BackgroundSelf-citationCrossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463
“unimodal regions that overlap to produce a border zone that is multisensory in nature [ 80 ].”
BackgroundUnderstanding the recognition of facial identity and facial expression
Calder, A. J., & Young, A. W. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1724 · Cited by 948
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
“Recent invasive physiological studies indicate that neurons receiving afferents from multiple senses might be found at the border of some strictly unisensory visual and auditory areas (e.g., Wallace et al., 2004; see also Beauchamp et al., 2004, for a high-resolution fMRI study).”
Bilateral brain processes for comprehending natural language
Jung-Beeman, M. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.09.009 · Cited by 908
Separate Face and Body Selectivity on the Fusiform Gyrus
Schwarzlose, R. F., Baker, C. I., & Kanwisher, N. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2621-05.2005 · Cited by 512
“One previous study has suggested that the area of overlap between two functional regions might play a role in the integration of information processed by the neighboring regions (Beauchamp et al., 2004).”
BackgroundCortical Networks Related to Human Use of Tools
Lewis, J. W. (2006) · The Neuroscientist · doi:10.1177/1073858406288327 · Cited by 451
Supramodal Representations of Perceived Emotions in the Human Brain
Peelen, M. V., Atkinson, A. P., & Vuilleumier, P. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2161-10.2010 · Cited by 422
“By contrast, the left STS identified here appears to differ from more anterior parts of STS that contain multisensory sectors activated by voices and faces, as well as their combined presentation (Beauchamp et al., 2004; Kreifelts et al., 2009).”
BackgroundPowell, H. W. R., Parker, G. J. M., Alexander, D. C., Symms, M. R., Boulby, P. A., Wheeler-Kingshott, C. A. M., Barker, G. J., Noppeney, U., Koepp, M. J., & Duncan, J. S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.03.011 · Cited by 414
“Studies have suggested that the superior temporal sulcus is a multisensory area important for integrating auditory and visual information (Beauchamp et al., 2004a,b; van Atteveldt et al., 2004), and electrophysiological studies have shown individual neurons in monkey STS that respond to both…”
BackgroundSee me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex
Beauchamp, M. S. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.03.011 · Cited by 401
“Recently, a potential functional counterpart to this patchy anatomical organization has been described in human STS (Figure 3; [19 ]).”
BackgroundSelf-citationMurphy, K., Bodurka, J., & Bandettini, P. A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.032 · Cited by 404
“Recent techniques in fMRI that examine patterns of activation (Beauchamp et al., 2004; Haxby et al., 2001; Haynes and Rees, 2005; Kamitani and Tong, 2005; Kriegeskorte et al., 2006) should also benefit from reliable high-resolution single subject activation maps.”
BackgroundSelf-citationRedcay, E. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.06.004 · Cited by 349
Sound alters activity in human V1 in association with illusory visual perception
Watkins, S., Shams, L., Tanaka, S., Haynes, J.-D., & Rees, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.016 · Cited by 343
“In particular, the STS may be the human homologue of macaque area STP and has been consistently associated with integration between visual and auditory stimulation (Beauchamp, 2005; Beauchamp et al., 2004; Calvert et al., 2000; Olson et al., 2002), particularly in speech recognition (Pekkola et al.”
BackgroundCortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception
Rohe, T., & Noppeney, U. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002073 · Cited by 344
Perceptual Fusion and Stimulus Coincidence in the Cross-Modal Integration of Speech
Miller, L. M., & D'Esposito, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0896-05.2005 · Cited by 322
Stepwise Connectivity of the Modal Cortex Reveals the Multimodal Organization of the Human Brain
Sepulcre, J., Sabuncu, M. R., Yeo, T. B., Liu, H., & Johnson, K. A. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0759-12.2012 · Cited by 323
“…posterior temporal lobe and the lateral occipitotemporal junction (LOTJ), as well as areas in the posterior parietal lobe, have been consistently described as critical for bimodal or trimodal integration processing (Beauchamp, 2005; Beauchamp et al., 2004; Calvert, 2001; Driver and Noesselt, 2008).”
BackgroundAudiovisual integration of emotional signals in voice and face: An event-related fMRI study
Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., & Wildgruber, D. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.020 · Cited by 303
“These findings of activations adjacent to the superior temporal sulcus (STS) correspond well with reports on enhanced responses in pSTS during audiovisual presentation of animals (Beauchamp et al., 2004b) and tools ( Beauchamp et al., 2004a, b), speech (Calvert et al., 2000; van Atteveldt et al., 2004; Wright et al.,…”
BackgroundResultInfluentialConverging language streams in the human temporal lobe
Spitsyna, G., Warren, J. E., Scott, S. K., Turkheimer, F. E., & Wise, R. J. S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0559-06.2006 · Cited by 312
“However, heteromodal responses within the left STS are not language-specific; the human STS also responds to nonverbal auditory and visual stimuli (Beauchamp et al., 2004).”
BackgroundBlau, V., Reithler, J., van Atteveldt, N., Seitz, J., Gerretsen, P., Goebel, R., & Blomert, L. (2010) · Brain · doi:10.1093/brain/awp308 · Cited by 301
“…superior temporal sulcus is a well-known heteromodal structure that receives input from multiple senses via cortical and subcortical connections (Beauchamp et al., 2004; Macaluso et al., 2004), planum temporale/Heschl sulcus activation has been generally associated with the processing of speech…”
BackgroundPerceiving social interactions in the posterior superior temporal sulcus
Isik, L., Koldewyn, K., Beeler, D., & Kanwisher, N. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1714471114 · Cited by 289
“The pSTS face region has remained an intriguing mystery ever since it was shown to respond threefold more strongly to dynamic faces than to static faces (34), and to respond equally to videos of faces and recordings of voices (31, 33, 39).”
BackgroundNoesselt, T., Rieger, J. W., Schoenfeld, M. A., Kanowski, M., Hinrichs, H., Heinze, H.-J., & Driver, J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2252-07.2007 · Cited by 292
“…inputs (Kaas and Collins, 2004) and is thought to contribute to multisensory integration (Benevento et al., 1977; Bruce et al., 1981; Cusick, 1997; Beauchamp et al., 2004b). mSTS was influenced by audiovisual synchrony in some previous function magnetic resonance imaging (fMRI) studies that used…”
BackgroundResultMultisensory Interactions within Human Primary Cortices Revealed by BOLD Dynamics
Martuzzi, R., Murray, M. M., Michel, C. M., Thiran, J.-P., Maeder, P. P., Clarke, S., & Meuli, R. A. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl077 · Cited by 285
Analyzing for information, not activation, to exploit high-resolution fMRI
Kriegeskorte, N., & Bandettini, P. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.02.022 · Cited by 270
Whole brain functional connectivity in the early blind
Liu, Y., Yu, C., Liang, M., Li, J., Tian, L., Zhou, Y., Qin, W., Li, K., & Jiang, T. (2007) · Brain · doi:10.1093/brain/awm121 · Cited by 278
“The STG is considered to be an important multisensory functional brain region, which integrates visual, auditory and language information (Wright et al., 2003; Beauchamp, 2004a, b).”
BackgroundStevenson, R. A., Zemtsov, R. K., & Wallace, M. T. (2012) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0027339 · Cited by 269
Stevenson, R. A., & James, T. W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.034 · Cited by 250
“…sensory systems have demonstrated main effects of BOLD response with multisensory stimuli exceeding that of unisensory stimuli (Beauchamp, 2005; Beauchamp et al., 2004a,b; Calvert, 2001; Calvert et al., 2000, 2001; Stevenson et al., 2007), as well as increased BOLD response with increased SNR…”
BackgroundMethodResultInfluentialNotation-Dependent and -Independent Representations of Numbers in the Parietal Lobes
Cohen Kadosh, R., Cohen Kadosh, K., Kaas, A., Henik, A., & Goebel, R. (2007) · Neuron · doi:10.1016/j.neuron.2006.12.025 · Cited by 262
“For example, Beauchamp et al. (2004) were able to detect separate organization of visual and auditory stimuli within the human superior temporal sulcus (STS) by using a smaller voxel size than in the current study (1.6 3 1.6 3 1.6 mm 3 ).”
MethodInfluentialStudying Brain Organization via Spontaneous fMRI Signal
Power, J. D., Schlaggar, B. L., & Petersen, S. E. (2014) · Neuron · doi:10.1016/j.neuron.2014.09.007 · Cited by 262
“Activity that is shared across conditions in a larger voxel, when reexamined at a higher resolution, may turn out to reflect blurring across separate (and separable) neural populations (Beauchamp et al., 2004).”
BackgroundBinding crossmodal object features in perirhinal cortex
Taylor, K. I., Moss, H. E., Stamatakis, E. A., & Tyler, L. K. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0509704103 · Cited by 248
Identifying and Quantifying Multisensory Integration: A Tutorial Review
Stevenson, R. A., Ghose, D., Fister, J. K., Sarko, D. K., Altieri, N. A., Nidiffer, A. R., Kurela, L. R., Siemann, J. K., James, T. W., & Wallace, M. T. (2014) · Brain Topography · doi:10.1007/s10548-014-0365-7 · Cited by 239
“Briefly, as suggested by Fetsch et al. (2013), in a highly simplified system, we may assume the existence of two populations of primary sensory neurons, each receiving unisensory information from different modalities.”
BackgroundPrediction and constraint in audiovisual speech perception
Peelle, J. E., & Sommers, M. S. (2015) · Cortex · doi:10.1016/j.cortex.2015.03.006 · Cited by 246
Crossmodal influences on visual perception
Shams, L., & Kim, R. (2010) · Physics of Life Reviews · doi:10.1016/j.plrev.2010.04.006 · Cited by 227
“Additionally, multisensory neurons may be organized in patches amongst unisensory neurons [7], making it difficult to find multisensory effects with the relatively coarse resolution of human brain imaging studies.”
BackgroundDual Neural Routing of Visual Facilitation in Speech Processing
Arnal, L. H., Morillon, B., Kell, C. A., & Giraud, A.-L. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3194-09.2009 · Cited by 241
“(Calvert and Campbell, 2003; Beauchamp et al., 2004a,b; Hertrich et al., 2007; Ghazanfar et al., 2008; Kayser and Logothetis, 2009).”
InfluentialBeauchamp, M. S., Nath, A. R., & Pasalar, S. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4865-09.2010 · Cited by 240
“High-resolution fMRI and single-unit recording studies have shown that cortex in the STS contains a patchy distribution of neurons that respond to auditory, visual, or auditory– visual stimuli (Beauchamp et al., 2004b; Dahl et al., 2009).”
BackgroundSelf-citationAnterior temporal lobe degeneration produces widespread network-driven dysfunction
Guo, C. C., Gorno-Tempini, M. L., Gesierich, B., Henry, M., Trujillo, A., Shany-Ur, T., Jovicich, J., Robinson, S. D., Kramer, J. H., Rankin, K. P., et al. (2013) · Brain · doi:10.1093/brain/awt222 · Cited by 236
“The concept of the ATL as a semantic hub overlaps with the idea of multimodal ‘convergence zones’ long hypothesized in the neuroscience and cognitive psychology literatures (Geschwind, 1965; Damasio, 1989; Hart and Gordon, 1992; Damasio et al., 1996; Mesulam, 1998; Grossman et al., 2002; Beauchamp et al., 2004).”
BackgroundStatistical Criteria in fMRI Studies of Multisensory Integration
Beauchamp, M. S. (2005) · Neuroinformatics · doi:10.1385/ni:3:2:093 · Cited by 227
“Each step of the analysis is illustrated in detail, while the neuroscience results are reported elsewhere ( Beauchamp et al., 2004a, b).”
BackgroundMethodSelf-citationSelective visuo‐haptic processing of shape and texture
Stilla, R., & Sathian, K. (2008) · Human Brain Mapping · doi:10.1002/hbm.20456 · Cited by 228
“Fine-grained analysis of multisensory activity in the human superior temporal sulcus (STS) has revealed intermingling of unisensory patches with differing modality specificity, with intervening multisensory patches (Beauchamp et al., 2004).”
BackgroundInfluentialNeural mechanisms for voice recognition
Andics, A., McQueen, J. M., Petersson, K. M., Gál, V., Rudas, G., & Vidnyánszky, Z. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.048 · Cited by 222
“The STS is a region that is highly heterogeneous functionally (e.g., Beauchamp et al., 2004), and the middle/posterior STS was proposed to be crucial for different stages of voice-identity processing (von Kriegstein and Giraud, 2004; Warren et al., 2006).”
BackgroundChen, Y.-C., & Spence, C. (2010) · Cognition · doi:10.1016/j.cognition.2009.10.012 · Cited by 221
Hein, G., Doehrmann, O., Müller, N. G., Kaiser, J., Muckli, L., & Naumer, M. J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1740-07.2007 · Cited by 203
“Our findings are in line with the results of previous studies that have indicated an important role of pSTS in AV integration (Beauchamp et al., 2004a,b; van Atteveldt et al., 2004, 2007; Taylor et al., 2006).”
BackgroundResultInfluentialNeural correlates of the processing of co-speech gestures
Holle, H., Gunter, T. C., Rüschemeyer, S.-A., Hennenlotter, A., & Iacoboni, M. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.055 · Cited by 205
“…and auditory information can be mapped onto each other on the basis of their form, there is evidence that the STS is also involved in more complex mapping processes at a higher semantic level, such as the integration of pictures of animals and their corresponding sounds (Beauchamp et al., 2004b).”
BackgroundTouch, sound and vision in human superior temporal sulcus
Beauchamp, M. S., Yasar, N. E., Frye, R. E., & Ro, T. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.015 · Cited by 208
“In the third localizer, subjects heard brief (1–2 s) recordings of a variety of non-linguistic stimuli, including recordings of animal calls, recordings of man–made objects (both manual and powered), scrambled versions of these recordings, and pure tones (Beauchamp et al., 2004b).”
InfluentialSelf-citationWerner, S., & Noppeney, U. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5091-09.2010 · Cited by 202
“…implicated the STS and IPS in audiovisual integration (Calvert et al., 2000; Schroeder and Foxe, 2002; Macaluso et al., 2003; Wright et al., 2003; Beauchamp et al., 2004b; Barraclough et al., 2005; Miller and D’Esposito, 2005; Saito et al., 2005; Avillac et al., 2007; Ghazanfar et al., 2008;…”
BackgroundCausal Inference in the Multisensory Brain
Cao, Y., Summerfield, C., Park, H., Giordano, B. L., & Kayser, C. (2019) · Neuron · doi:10.1016/j.neuron.2019.03.043 · Cited by 202
Simplified intersubject averaging on the cortical surface using SUMA
Argall, B. D., Saad, Z. S., & Beauchamp, M. S. (2006) · Human Brain Mapping · doi:10.1002/hbm.20158 · Cited by 200
“The match between the spatial resolution of the technique and the resolution of intersubject averaging methods will become even more important as fMRI reaches higher and higher spatial resolutions [Beauchamp et al., 2004a].”
MethodSelf-citationLong-term music training tunes how the brain temporally binds signals from multiple senses
Lee, H., & Noppeney, U. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1115267108 · Cited by 188
“Hence, audiovisual asynchrony is detected automatically not only along the sensory processing hierarchies and classical audiovisual integration areas such as STS (7, 20, 21) but also in a premotor-cerebellar circuitry.”
BackgroundThe interactions of multisensory integration with endogenous and exogenous attention
Tang, X., Wu, J., & Shen, Y. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.11.002 · Cited by 168
“…level of object recognition (Werner and Noppeney, 2010b), especially for biologically relevant stimuli from different modalities; such stimuli include speech (Senkowski et al., 2008), faces/voices (Ghazanfar et al., 2005), and real-life objects (Beauchamp et al., 2004; Werner and Noppeney, 2010a).”
Function-based Intersubject Alignment of Human Cortical Anatomy
Sabuncu, M. R., Singer, B. D., Conroy, B., Bryan, R. E., Ramadge, P. J., & Haxby, J. V. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp085 · Cited by 169
“These cortices are known to be polysensory (Beauchamp et al. 2004) and to play an important role in action understanding and social cognition (Allison et al. 2000; Haxby et al. 2000; Gobbini et al. 2007).”
BackgroundThe Effect of Prior Visual Information on Recognition of Speech and Sounds
Noppeney, U., Josephs, O., Hocking, J., Price, C. J., & Friston, K. J. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm091 · Cited by 172
“In particular, recognition of complex audiovisual stimuli such as familiar objects (Gottfried and Dolan 2003; Laurienti et al. 2003, 2004; Molholm et al. 2004; Beauchamp, Argall, et al. 2004; Beauchamp, Lee, et al. 2004), actions (Barraclough et al. 2005), or speech (Calvert et al. 2000; Raij et al. 2000; Olson et al.…”
BackgroundMonzalvo, K., Fluss, J., Billard, C., Dehaene, S., & Dehaene-Lambertz, G. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.035 · Cited by 162
Pinel, P., Thirion, B., Mériaux, S., Jobert, A., Serres, J., Bihan, D. L., Poline, J., & Dehaene, S. (2007) · BMC Neuroscience · doi:10.1186/1471-2202-8-91 · Cited by 186
“In particular the left posterior temporal gyrus that has been described as a multimodal integration region [47,48] could be a candidate for convergence of visual, verbal and non-verbal magnitude codes.”
BackgroundActivation of Sensory-Motor Areas in Sentence Comprehension
Desai, R. H., Binder, J. R., Conant, L. L., & Seidenberg, M. S. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp115 · Cited by 168
“Bilateral posterior MTG activation is frequently associated with processing visually or auditorily presented or imagined tools and manipulable objects (e.g., Chao et al. 1999; Beauchamp et al. 2004; Johnson-Frey et al. 2005; Lewis et al. 2006).”
Werner, S., & Noppeney, U. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp248 · Cited by 168
“Cerebral Cortex August 2010;20:1829--1842 doi:10.1093/cercor/bhp248 Advance Access publication November 18, 2009”
InfluentialLewis, R., & Noppeney, U. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5745-09.2010 · Cited by 167
“…bimodal neurons in nonhuman primates (Benevento et al., 1977; Bruce et al., 1981; Hikosaka et al., 1988) and more recently in several human brain imaging studies (Calvert et al., 2000, 2001; Beauchamp et al., 2004a,b; Stevenson et al., 2007; Stevenson and James, 2009; Werner and Noppeney, 2010a,b).”
BackgroundGrounding Object Concepts in Perception and Action: Evidence from FMRI Studies of Tools
Beauchamp, M. S., & Martin, A. (2007) · Cortex · doi:10.1016/s0010-9452(08)70470-2 · Cited by 165
“Our attempt to address this issue has revealed that auditory-visual multisensory integration about tools may be dependent on an associative region located in lateral temporal cortex superior and anterior to MTG (Beauchamp et al., 2004a, 2004b).”
BackgroundSelf-citationPre-lexical abstraction of speech in the auditory cortex
Obleser, J., & Eisner, F. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.09.005 · Cited by 165
Multisensory cues capture spatial attention regardless of perceptual load.
Santangelo, V., & Spence, C. (2007) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.33.6.1311 · Cited by 170
Willems, R. M., Özyürek, A., & Hagoort, P. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.066 · Cited by 167
“Also studies of multimodal integration have successfully employed a mismatch paradigm (Beauchamp et al., 2004b; Hein et al., 2007; van Atteveldt et al., 2007; Fuhrmann Alpert et al., 2008; Hocking and Price, 2008).”
InfluentialRohe, T., & Noppeney, U. (2016) · Current Biology · doi:10.1016/j.cub.2015.12.056 · Cited by 178
Holle, H., Obleser, J., Rueschemeyer, S., & Gunter, T. C. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.058 · Cited by 181
Developmental changes in the multisensory temporal binding window persist into adolescence
Hillock‐Dunn, A., & Wallace, M. T. (2012) · Developmental Science · doi:10.1111/j.1467-7687.2012.01171.x · Cited by 173
Noesselt, T., Tyll, S., Boehler, C. N., Budinger, E., Heinze, H., & Driver, J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.4524-09.2010 · Cited by 174
“Finally, candidate heteromodal regions that responded significantly both to visual stimuli and also to sounds included posterior STS, plus parietal and dorsolateral prefrontal regions, all in accord with previous studies (Beauchamp et al., 2004; Noesselt et al., 2007) (see supplemental Table S1c, available at www.”
BackgroundResultNeural Basis of the Ventriloquist Illusion
Bonath, B., Noesselt, T., Martínez, A., Mishra, J., Schwiecker, K., Heinze, H., & Hillyard, S. A. (2007) · Current Biology · doi:10.1016/j.cub.2007.08.050 · Cited by 182
“Interactions between sensory inputs in different modalities have been observed in multiple brain regions including multimodal cortical areas [16, 19, 21, 22] as well as in cortical regions traditionally considered unimodal [16, 17, 19, 23–25].”
Bodurka, J., Ye, F., Petridou, N., Murphy, K., & Bandettini, P. A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.039 · Cited by 158
“Nevertheless, even the “suggested” volume offers higher spatial resolution relative to the typical 3×3×5 mm(3) volumes used—therefore minimizing partial volume averaging and increasing spatial localization while still maintaining sufficient BOLD sensitivity (Beauchamp et al., 2004).”
BackgroundMethodSelf-citationHearing Faces: How the Infant Brain Matches the Face It Sees with the Speech It Hears
Bristow, D., Dehaene‐Lambertz, G., Mattout, J., Soarès, C., Gliga, T., Baillet, S., & Mangin, J. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21076 · Cited by 162
“This is in agreement with data from human adults (Beauchamp et al., 2004) and monkeys (Poremba et al., 2003) showing that regions responding to auditory and visual stimuli overlap along the entire length of the STS.”
ResultAuditory–Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources
Cappe, C., Thut, G., Romei, V., & Murray, M. M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1099-10.2010 · Cited by 170
“organization (at least in auditory association cortices) of neurons responsive to unisensory versus multisensory stimulation (Beauchamp et al., 2004; Dahl et al., 2009).”
BackgroundInfluentialHuot, P., Johnston, T. H., Darr, T., Hazrati, L., Visanji, N. P., Pires, D., Brotchie, J. M., & Fox, S. H. (2010) · Movement Disorders · doi:10.1002/mds.23083 · Cited by 153
“The temporal cortex is part of the ventral visual stream and plays a role in the recognition of objects and faces(48,49) as well as in auditory and visual integration.(50,51) As previously mentioned, degenerative changes occur in the temporal lobe of PD patients with VH, and Lewy bodies have been documented.”
BackgroundNeural pathways for visual speech perception
Bernstein, L. E., & Liebenthal, E. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00386 · Cited by 165
“However, high-resolution examination of pSTS demonstrates clusters of neurons in the dorsal and ventral bank of bilateral pSTS that respond to either auditory or visual input, with intervening clusters responding most strongly to audiovisual input (Beauchamp et al., 2004).”
BackgroundSpatial attention can modulate audiovisual integration at multiple cortical and subcortical sites
Fairhall, S. L., & Macaluso, E. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06688.x · Cited by 162
“The STS receives convergent input from auditory, visual and somatosensory regions (see Padberg et al., 2003; Schmahmann & Pandya, 1991) and has been frequently associated with MI (Calvert et al., 2000; Beauchamp et al., 2004b, a; Miller & D’Esposito, 2005; Noesselt et al., 2007).”
BackgroundInfluentialActivity in human V1 follows multisensory perception
Watkins, S., Shams, L. B., Josephs, O., & Rees, G. E. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.05.027 · Cited by 160
“The STS has been consistently associated with integration between visual and auditory stimulation (Barraclough et al., 2005; Beauchamp et al., 2004; Beauchamp, 2005; Calvert et al., 2000; Ghazanfar et al., 2005; Olson et al., 2002; Schroeder and Foxe, 2002).”
BackgroundVestibular Inputs to Human Motion-Sensitive Visual Cortex
Smith, A. T., Wall, M. B., & Thilo, K. V. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr179 · Cited by 155
Distinct roles for medial temporal lobe structures in memory for objects and their locationsPreprint
Buffalo, E. A., Bellgowan, P. S. F., & Martin, A. D. (2006) · Learning & Memory · doi:10.1101/lm.251906 · Cited by 140
Self-citationPinel, P., & Dehaene, S. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21184 · Cited by 156
“The pSTS can be activated by either written and spoken words or sentences (Beauchamp, Argall, Bodurka, Duy, & Martin, 2004 ), it appears essential for semantic-level processing of words and pictures (Vandenbulcke, Peeters, Dupont, Van Hecke, & Vandenberghe, 2007 ; Vandenberghe, Price, Wise, Josephs, & Frackowiak, 1996…”
BackgroundTemporal event structure and timing in schizophrenia: Preserved binding in a longer “now”
Martin, B., Giersch, A., Huron, C., & van Wassenhove, V. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.07.002 · Cited by 147
Does tool-related fMRI activity within the intraparietal sulcus reflect the plan to grasp?
Valyear, K. F., Cavina‐Pratesi, C., Stiglick, A. J., & Culham, J. C. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.03.031 · Cited by 148
“Interestingly, this area also preferentially responds to the sounds of tools in action (Beauchamp et al., 2004a,b; Lewis et al., 2005).”
BackgroundListening to a walking human activates the temporal biological motion area
Bidet‐Caulet, A., Voisin, J. I. A., Bertrand, O., & Fonlupt, P. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.018 · Cited by 146
“In addition, it has been involved in polysensory interaction (Beauchamp et al., 2004; Puce and Perrett, 2003; Van Atteveldt et al., 2004; Wright et al., 2003), environmental sound recognition (Lewis et al.”
BackgroundResultPsychosis in Parkinson’s Disease: Epidemiology, Pathophysiology, and Management
Chang, A., & Fox, S. H. (2016) · Drugs · doi:10.1007/s40265-016-0600-5 · Cited by 144
“The temporal cortex is part of the ventral visual stream involved in recognition of objects and faces [159, 160] as well as in auditory and visual integration [161, 162].”
BackgroundVatakis, A., & Spence, C. J. (2007) · Acta Psychologica · doi:10.1016/j.actpsy.2006.12.002 · Cited by 141
The Role of the Posterior Superior Temporal Sulcus in Audiovisual Processing
Hocking, J., & Price, C. J. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn007 · Cited by 134
“…this explanation is that it does not explain why pSTS has been associated with audiovisual binding in studies using temporally brief sounds and words (Wright et al. 2003; Beauchamp, Lee, et al. 2004; van Atteveldt et al. 2004; Kreifelts et al. 2007; van Atteveldt, Formisano, Blomert, et al. 2007).”
Renier, L. A., Anurova, I., Volder, A. D., Carlson, S., VanMeter, J. W., & Rauschecker, J. P. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0910-09.2009 · Cited by 137
Cue Integration: A Common Framework for Social Cognition and Physical Perception
Zaki, J. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613475454 · Cited by 137
Neural integration of iconic and unrelated coverbal gestures: A functional MRI study
Green, A., Straube, B., Weis, S., Jansen, A., Willmes, K., Konrad, K., & Kircher, T. T. J. (2009) · Human Brain Mapping · doi:10.1002/hbm.20753 · Cited by 131
Characteristic sounds facilitate visual search
Iordanescu, L., Guzman-Martinez, E., Grabowecky, M., & SUZUKI, S. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.3.548 · Cited by 125
Sevy, A., Bortfeld, H., Huppert, T. J., Beauchamp, M. S., Tonini, R. E., & Oghalai, J. S. (2010) · Hearing Research · doi:10.1016/j.heares.2010.09.010 · Cited by 123
“This procedure is similar to analyses we have previously used for fMRI (Beauchamp, 2005; Beauchamp et al., 2007, 2004).”
Self-citationNeural processing of asynchronous audiovisual speech perception
Stevenson, R. A., Altieri, N. A., Kim, S., Pisoni, D. B., & James, T. W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.001 · Cited by 123
“Previous studies using similar functional definitions have suggested that mSTC may be functionally heterogeneous, in particular, that there may be a patchy organization of subregions with small unisensory subregions that feed forward into integrative subregions (Beauchamp et al., 2004a).”
InfluentialSokolov, A. A., Erb, M., Grodd, W., & Pavlova, M. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs346 · Cited by 125
“…(e.g., Scoville and Milner 1957; Perrett et al. 1985; Howard et al. 1996; Gloor 1997; Allison et al. 2000; Grossman et al. 2000; Vaina et al. 2001; Beauchamp et al. 2004; Ohnishi et al. 2004; Pavlova et al. 2004; Pelphrey et al. 2005; Gobbini et al. 2007; Saygin 2007; Hein and Knight 2008; Da…”
BackgroundThe rTPJ’s overarching cognitive function in networks for attention and theory of mind
Schuwerk, T., Schurz, M., Müller, F., Rupprecht, R., & Sommer, M. (2016) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw163 · Cited by 125
“Thus, not only the rTPJ/ rMTG, a region processing sensory input (Beauchamp et al., 2004) responded to stimulus presentation, but also the ACC, a region relatively higher in the cortical hierarchy (Friston et al., 2010).”
BackgroundSupramodal Representation of Emotions
Klasen, M., Kenworthy, C. A., Mathiak, K. A., Kircher, T. T. J., & Mathiak, K. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2833-11.2011 · Cited by 128
“, 2004; Miller and D’Esposito, 2005) as well as with sounds and images of tools and animals (Beauchamp et al., 2004; Fuhrmann Alpert et al., 2008), suggesting a more general role of these structures in multimodal perception.”
BackgroundAuditory and auditory-tactile processing in congenitally blind humans
Hötting, K., & Röder, B. (2009) · Hearing Research · doi:10.1016/j.heares.2009.07.012 · Cited by 120
“…cortical level, several regions in the temporal, parietal or frontal lobe have been described as multisensory 3 , for example the superior temporal sulcus (Beauchamp et al., 2004), the superior parietal lobule (Molholm et al., 2006), or the ventrolateral prefrontal cortex (Sugihara et al., 2006).”
Investigating audiovisual integration of emotional signals in the human brain
Ethofer, T., Pourtois, G., & Wildgruber, D. (2006) · Progress in brain research · doi:10.1016/s0079-6123(06)56019-4 · Cited by 129
“The activation cluster in the left posterior STS was significant (SVC on a 6mm radius spherical volume of interest centred at x ¼ –50, y ¼ –54, z ¼ 6, a priori coordinates derived from Beauchamp et al., 2004b).”
MethodResultInfluentialCurrent perspectives and methods in studying neural mechanisms of multisensory interactions
Klemen, J., & Chambers, C. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.015 · Cited by 132
“he STS is also activated by acoustically and visually presented tools nd shows enhanced activation for audio-visual stimulus presentaion than either unimodal presentation (Beauchamp et al., 2004b). ecently it has been shown that the visual, auditory and somatosenory responses overlap in part of the human STS (Beaucham…”
BackgroundMethodWatson, R., Latinus, M., Noguchi, T., Garrod, O., Crabbe, F., & Belin, P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4478-13.2014 · Cited by 127
“…we observed a cross- modal adaptation effect in the right pSTS, a region that has been well documented as a multimodal region, in both humans (Beauchamp et al., 2004; Ethofer et al., 2006; Kreifelts et al., 2007, 2010; Watson et al., 2013) and nonhuman primates (Benevento et al., 1977;…”
BackgroundResultExtensive Cochleotopic Mapping of Human Auditory Cortical Fields Obtained with Phase-Encoding fMRI
Striem-Amit, E., Hertz, U., & Amedi, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017832 · Cited by 119
“These areas clearly extend far beyond typical core [35,38] and belt [37,41] areas, all the way to superior temporal sulcus, well into regions which are traditionally considered non-cochleotopic [56], and which engage both in complex auditory processing and multisensory integration [43,44,45,84,85,86,87].”
BackgroundIntegration of Bimodal Looming Signals through Neuronal Coherence in the Temporal Lobe
Maier, J. X., Chandrasekaran, C., & Ghazanfar, A. A. (2008) · Current Biology · doi:10.1016/j.cub.2008.05.043 · Cited by 117
The social mysteries of the superior temporal sulcus
Beauchamp, M. S. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.002 · Cited by 118
Self-citationNeural interaction of speech and gesture: Differential activations of metaphoric co-verbal gestures
Kircher, T. T. J., Straube, B., Leube, D., Weis, S., Sachs, O., Willmes, K., Konrad, K., & Green, A. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.08.009 · Cited by 122
The sound-induced flash illusion reveals dissociable age-related effects in multisensory integration
McGovern, D. P., Roudaia, E., Stapleton, J., McGinnity, T. M., & Newell, F. N. (2014) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2014.00250 · Cited by 115
“…al., 2008) investigating the neural correlates of the fusion illusion have demonstrated a causal role between activity in the superior temporal sulcus, a brain region believed to play a pivotal role in multisensory integration (Beauchamp et al., 2004), and the subjective experience of the illusion.”
BackgroundScott, G. D., Karns, C. M., Dow, M. W., Stevens, C., & Neville, H. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00177 · Cited by 125
“…1997; Buchel et al., 1998; Beauchamp et al., 2001; Serences et al., 2005; Saygin and Sereno, 2008) as well as multisensory integration (Hagen et al., 2002; Laurienti et al., 2003; Beauchamp et al., 2004; Blake et al., 2004; Woldoff et al., 2004; Mulette-Gillman et al., 2005; Mukai et al., 2007).”
Background
Metadata
- Authors
- Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Beauchamp, Michael S
- Venue
- Nature Neuroscience
- Published
- 2004-10-10
- Volume
- 7
- Issue
- 11
- Pages
- 1190-1192
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W1970618766
- Cited by
- 513
- References
- 16
- Citations by year
- 2026: 14 · 2025: 12 · 2024: 9 · 2023: 9 · 2022: 17 · 2021: 29 · 2020: 21 · 2019: 22 · 2018: 21 · 2017: 24 · 2016: 17 · 2015: 19 · 2014: 27 · 2013: 31 · 2012: 29
- FWCI
- 36.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- multisensory integration, superior temporal sulcus, functional architecture, parallel imaging, high-resolution fMRI, human cortex
- MeSH terms
- Acoustic Stimulation, Auditory Perception, Brain Mapping, Humans, Image Processing, Computer-Assisted, Functional Laterality, Magnetic Resonance Imaging, Oxygen, Photic Stimulation, Somatosensory Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.