Unraveling multisensory integration: patchy organization within human STS multisensory cortex
The DOI matches its Crossref record; 15 of the 16 references it cites were found in a registry or an index.
Abstract
Although early sensory cortex is organized along dimensions encoded by receptor organs, little is known about the organization of higher areas in which different modalities are integrated. We investigated multisensory integration in human superior temporal sulcus using recent advances in parallel imaging to perform functional magnetic resonance imaging (fMRI) at very high resolution. These studies suggest a functional architecture in which information from different modalities is brought into close proximity via a patchy distribution of inputs, followed by integration in the intervening cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Self-citationIntegration of Letters and Speech Sounds in the Human Brain
van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.025 · Cited by 544
Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements
Beauchamp, M. S., Lee, K. E., Haxby, J. V., & Martin, A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00642-6 · Cited by 528
Self-citationHuman Ocular Dominance Columns as Revealed by High-Field Functional Magnetic Resonance Imaging
Cheng, K., Waggoner, R. A., & Tanaka, K. (2001) · Neuron · doi:10.1016/s0896-6273(01)00477-9 · Cited by 383
A revised view of sensory cortical parcellation
Wallace, M. T., Ramachandran, R., & Stein, B. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0305697101 · Cited by 343
Seltzer, B., & Pandya, D. N. (1994) · Journal of Comparative Neurology · doi:10.1002/cne.903430308 · Cited by 327
Hikosaka, K., Iwai, E., Saito, H., & Tanaka, K. (1988) · Journal of Neurophysiology · doi:10.1152/jn.1988.60.5.1615 · Cited by 296
Benevento, L. A., Fallon, J., Davis, B. J., & Rezak, M. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90112-1 · Cited by 288
Cited by
Items 101–200 of 532
Kitada, R., Johnsrude, I. S., Kochiyama, T., & Lederman, S. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.014 · Cited by 113
“…the visual observation of human nonverbal gestures (Grafton et al., 1996; Iacoboni et al., 1999; Gorno-Tempini et al., 2001; Narumoto et al., 2001; Nishitani and Hari, 2002; Carr et al., 2003) and in the auditory perception of another person's actions (Beauchamp et al., 2004; Lahav et al., 2007).”
Cross-modal interactions between human faces and voices involved in person recognition
Joassin, F., Pesenti, M., Maurage, P., Verreckt, E., Bruyer, R., & Campanella, S. (2010) · Cortex · doi:10.1016/j.cortex.2010.03.003 · Cited by 119
Different categories of living and non-living sound-sources activate distinct cortical networks
Engel, L. R., Frum, C., Puce, A., Walker, N. A., & Lewis, J. W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.041 · Cited by 118
“These regions show activity to a wide variety of sensory action events, including the recognition of nonverbal action sounds (Maeder et al., 2001; Beauchamp et al., 2004; Lewis et al., 2004; Engelien et al., 2005), plus complex visual motion processing together with audio-visual and sensory-motor…”
BackgroundWhat you see is what you hear: Twenty years of research using the Sound-Induced Flash Illusion
Hirst, R. J., McGovern, D. P., Setti, A., Shams, L. B., & Newell, F. N. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.09.006 · Cited by 124
Orienting of spatial attention and the interplay between the senses
Macaluso, E. (2009) · Cortex · doi:10.1016/j.cortex.2009.05.010 · Cited by 129
Multisensory Integration in Cochlear Implant Recipients
Stevenson, R. A., Sheffield, S. W., Butera, I. M., Gifford, R. H., & Wallace, M. T. (2017) · Ear and Hearing · doi:10.1097/aud.0000000000000435 · Cited by 119
Superadditive BOLD activation in superior temporal sulcus with threshold non-speech objects
Stevenson, R. A., Geoghegan, M. L., & James, T. W. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0770-6 · Cited by 119
“Other neuroimaging studies have claimed to Wnd integrative BOLD activation in STS with non-speech objects, but these claims have been based on more liberal criteria, such as the maximum rule (Beauchamp et al. 2004a) or the mean rule (Beauchamp et al. 2004b).”
BackgroundMethodInfluentialSpatial Organization of Multisensory Responses in Temporal Association Cortex
Dahl, C. D., Logothetis, N. K., & Kayser, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3437-09.2009 · Cited by 109
“In fact, our findings might provide a direct neural “explanation” for the observation of a “patchy” organization in the human STS by a previous human imaging study by Beauchamp et al. (2004b).”
BackgroundMethodInfluentialBalz, J., KEIL, J. E., Romero, Y. R., Mekle, R., Schubert, F., Aydın, S., Ittermann, B., Gallinat, J., & Senkowski, D. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.10.087 · Cited by 119
“GABA and glutamate concentrations were obtained from a voxel in the superior temporal sulcus (STS) — a key area in multisensory processing (Beauchamp et al., 2004; Calvert, 2001; Noesselt et al., 2007).”
MethodA Multisensory Cortical Network for Understanding Speech in Noise
Bishop, C. W., & Miller, L. M. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21118 · Cited by 119
“Imaging studies using speech as well as nonlinguistic stimuli consistently implicate the middle or posterior STS as a locus for audiovisual integration (Miller & D’Esposito, 2005; Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004; Macaluso, George, Dolan, Spence, & Driver, 2004; Wright, Pelphrey, Allison, McKeown, & Mc…”
Sub-exemplar Shape Tuning in Human Face-Related Areas
Gilaie‐Dotan, S., & Malach, R. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj150 · Cited by 121
“However, as we have argued previously (Grill-Spector and others 1999), measuring the averaged neuronal activity within a voxel might mask a more finely organized heterogeneous population of neurons, providing the apparent impression of a nonselective behavior (Beauchamp and others 2004).”
BackgroundConceptual structure: Towards an integrated neurocognitive account
Taylor, K. I., Devereux, B. J., & TYLER, L. K. (2011) · Language and Cognitive Processes · doi:10.1080/01690965.2011.568227 · Cited by 119
Reilly, J., Peelle, J. E., Antonucci, S. M., & Grossman, M. (2011) · Neuropsychology · doi:10.1037/a0022738 · Cited by 92
The differentiation of iconic and metaphoric gestures: Common and unique integration processes
Straube, B., Green, A., Bromberger, B., & Kircher, T. (2011) · Human Brain Mapping · doi:10.1002/hbm.21041 · Cited by 104
Discrete neural substrates underlie complementary audiovisual speech integration processes
Stevenson, R. A., VanDerKlok, R. M., Pisoni, D. B., & James, T. W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.12.063 · Cited by 95
“Furthermore, there is now other converging evidence that mSTC may be composed of several subregions with distinct responses based on input modality (Beauchamp et al., 2004) which are differentially driven by synchrony, with one subregion responding only when sensory inputs are precisely…”
InfluentialSpatiotemporal dynamics of audiovisual speech processing
Bernstein, L. E., Auer, E. T., Wagner, M., & Ponton, C. W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.035 · Cited by 110
“This pathway is plausible, given that these regions are among ones whose activity is replicated across audiovisual speech and face–voice experiments (Beauchamp et al., 2004; Callan et al., 2003; Calvert et al., 2000), and given that anatomical studies have shown connections among these areas (Pandya and Yeterian, 1996…”
Reading embossed capital letters: An fMRI study in blind and sighted individuals
Burton, H., McLaren, D. G., & Sinclair, R. J. (2006) · Human Brain Mapping · doi:10.1002/hbm.20188 · Cited by 103
“A developmental model proposed for cortical multisensory organization suggests that “auditory and visual inputs arrive in the STS-MS in separate patches, followed by integration in the intervening cortex” [ Beauchamp et al., 2004a, p. 1192 ].”
BackgroundInfluentialCausal inference of asynchronous audiovisual speech
Magnotti, J. F., Ma, W. J., & Beauchamp, M. S. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00798 · Cited by 96
“For instance, audiovisual spatial localization likely occurs in the parietal lobe (Zatorre et al., 2002) while multisensory speech perception is thought to occur in the superior temporal sulcus (Beauchamp et al., 2004).”
BackgroundSelf-citationHow reading acquisition changes children’s spoken language network
Monzalvo, K., & Dehaene‐Lambertz, G. (2013) · Brain and Language · doi:10.1016/j.bandl.2013.10.009 · Cited by 117
Observing Learned Object-specific Functional Grasps Preferentially Activates the Ventral Stream
Valyear, K. F., & Culham, J. C. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21256 · Cited by 107
“... naming tools relative to other objects (e.g., Valyear et al., 2007; Martin et al., 1996), during the retrieval of semantic information about object function and manipulability (Boronat et al., 2005; Kellenbach et al., 2003), during pantomime object use (e.g., Fridman et al., 2006; Johnson-Frey et al., 2005), and i…”
BackgroundCapturing spatial attention with multisensory cues
Santangelo, V., Ho, C., & Spence, C. J. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.2.398 · Cited by 102
Superior Temporal Sulcus Disconnectivity During Processing of Metaphoric Gestures in Schizophrenia
Straube, B., Green, A., Sass, K., & Kircher, T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt110 · Cited by 97
Reliable identification of the auditory thalamus using multi-modal structural analyses
Devlin, J. T., Sillery, E. L., Hall, D. A., Hobden, P., Behrens, T. E. J., Nunes, R. G., Clare, S., Matthews, P. M., Moore, D. R., & Johansen-Berg, H. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.025 · Cited by 95
“The anatomical methods present here combined with higher resolution functional imaging more suited to imaging such a small structure (Beauchamp et al., 2004; Bridge et al., 2005) will hopefully complement, extend, and objectify further functional characterizations of this increasingly interesting nuclear group.”
MethodNeural Substrates of Sound–Touch Synesthesia after a Thalamic Lesion
Beauchamp, M. S., & Ro, T. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3872-08.2008 · Cited by 92
“…for 20 s and contained 10 different auditory stimuli consisting of a variety of natural and artificial sound samples, including recordings of animal calls, recordings of man-made objects (both manual and powered), scrambled versions of these recordings, and pure tones (Beauchamp et al., 2004a,b).”
BackgroundSelf-citationNeuromodulation of multisensory perception: A tDCS study of the sound-induced flash illusion
Bolognini, N., Rossetti, A., Casati, C., Mancini, F., & Vallar, G. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.11.015 · Cited by 100
The brain uses single-trial multisensory memories to discriminate without awareness
Murray, M. M., Foxe, J. J., & Wylie, G. R. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.04.016 · Cited by 104
“Similarly, recent fMRI results are providing evidence that regions of the superior temporal sulcus (STS) might likewise contain a Fpatchy_ distribution for unisensory (auditory or visual) and multisensory (auditory–visual) object representations (Beauchamp et al., 2004).”
Speech comprehension aided by multiple modalities: Behavioural and neural interactions
McGettigan, C., Faulkner, A., Altarelli, I., Obleser, J., Baverstock, H., & Scott, S. K. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.01.010 · Cited by 106
FFA and OFA Encode Distinct Types of Face Identity Information
Tsantani, M., Kriegeskorte, N., Storrs, K. R., Williams, A. L., McGettigan, C., & Garrido, L. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.1449-20.2020 · Cited by 101
Senkowski, D., Saint‐Amour, D., Kelly, S. P., & Foxe, J. J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.01.053 · Cited by 90
“The processing of naturalistic multisensory objects in motion has been examined in recent fMRI studies by Beauchamp and colleagues (Beauchamp et al., 2004a,b; Beauchamp, 2005).”
MethodResultA multisensory perspective on object memory
Matusz, P. J., Wallace, M. T., & Murray, M. M. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.04.008 · Cited by 101
Specific Visual Subregions of TPJ Mediate Reorienting of Spatial Attention
Dugué, L., Merriam, E. P., Heeger, D. J., & Carrasco, M. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx140 · Cited by 90
“The TPJ, proximal to the temporal, parietal, and occipital lobes, extends from the ventral bank of the intraparietal sulcus (IPS) to the dorsal bank of the superior temporal sulcus (STS) (Mars et al. 2012; Igelstrom et al. 2015), and is implicated in a broad variety of cognitive and social functions; for example, atte…”
InfluentialEthofer, T., Bretscher, J., Wiethoff, S., Bisch, J., Schlipf, S., Wildgruber, D., & Kreifelts, B. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.064 · Cited by 90
“Moreover, neuroimaging data using high resolution fMRI demonstrated a patchy organization of these cells within the pSTS (Beauchamp et al., 2004).”
Multi-sensory learning and learning to read
Blomert, L., & Froyen, D. (2010) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2010.06.025 · Cited by 96
Motoki, K., Suzuki, S., Kawashima, R., & Sugiura, M. (2020) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2020.06.003 · Cited by 102
“For example, the integration of sounds and images in audiovisual stimuli involves brain regions that partially overlap with those used in the social-related neural measures (Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004; Ghazanfar & Schroeder, 2006; Nath & Beauchamp, 2011; Wong & Gallate, 2012).”
MethodSpeech through ears and eyes: interfacing the senses with the supramodal brain
van Wassenhove, V. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00388 · Cited by 87
Bellgowan, P. S. F., Bandettini, P. A., van Gelderen, P., Martin, A., & Bodurka, J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.08.042 · Cited by 84
“One of the more significant benefits to neuroscientist using this MRI coil design is to achieve a higher spatial resolution (Beauchamp et al., 2004).”
BackgroundSelf-citationYou had me at “Hello”: Rapid extraction of dialect information from spoken words
Scharinger, M., Monahan, P. J., & Idsardi, W. J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.04.007 · Cited by 84
“Furthermore, voice selective areas in STS occupy brain regions that also subserve multisensory integration of visual (faces) and auditory (voices) information during speech perception (Beauchamp et al., 2004; Ghazanfar et al., 2008).”
BackgroundHand or spoon? Exploring the neural basis of affective touch in 5-month-old infants
Pirazzoli, L., Lloyd‐Fox, S., Braukmann, R., Johnson, M. H., & Gliga, T. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.06.002 · Cited by 89
The Functional Role of Neural Oscillations in Non-Verbal Emotional Communication
Symons, A. E., El-Deredy, W., Schwartze, M., & Kotz, S. A. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00239 · Cited by 81
“Receiving input from both visual and auditory cortices, the STS also plays a key role in audiovisual integration (i.e., Calvert et al., 2000, 2001; Beauchamp et al., 2004a,b; Stevenson et al., 2007; Stevenson and James, 2009).”
BackgroundCommon fronto-temporal effective connectivity in humans and monkeys
Rocchi, F., Oya, H., Balezeau, F., Billig, A. J., Kocsis, Z., Jenison, R. L., Nourski, K. V., Kovach, C. K., Steinschneider, M., Kikuchi, Y., et al. (2021) · Neuron · doi:10.1016/j.neuron.2020.12.026 · Cited by 84
The Fusion of Mental Imagery and Sensation in the Temporal Association Cortex
Berger, C. C., & Ehrsson, H. H. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0943-14.2014 · Cited by 79
“…an illusory translocation of auditory stimuli and was associated with increased activity in the left superior temporal sulcus (L. STS), a key site for the integration of real audiovisual stimuli (Beauchamp et al., 2004a, 2010; Driver and Noesselt, 2008; Ghazanfar et al., 2008; Dahl et al., 2009).”
BackgroundMultisensory integration for timing engages different brain networks
Dhamala, M., Assisi, C. G., Jirsa, V., Steinberg, F. L., & Kelso, J. A. S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.044 · Cited by 86
“In some other recent fMRI studies (Beauchamp et al., 2004; Van Atteveldt et al., 2004), for example, superadditivity has not been observed either.”
Lefties Get It “Right” When Hearing Tool Sounds
Lewis, J. W., Phinney, R. E., Brefczynski‐Lewis, J. A., & DeYoe, E. A. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.8.1314 · Cited by 82
“…(Manthey et al., 2003), identified tools on the basis of combined visual plus auditory features (Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004; Beauchamp, Lee, et al., 2004), imagined hearing complex environmental sounds to familiar video clips (Bunzeck et al., 2005), or when preparing or…”
Auditory-Visual Crossmodal Integration in Perception of Face Gender
Smith, E. L., Grabowecky, M., & Suzuki, S. (2007) · Current Biology · doi:10.1016/j.cub.2007.08.043 · Cited by 78
Mean-based neural coding of voices
Andics, A., McQueen, J. M., & Petersson, K. M. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.002 · Cited by 79
“Even though there is agreement that the STS is a functionally highly heterogeneous region (Beauchamp et al., 2004), with distinct subregions having different properties and functions, even within the domain of voice processing (von Kriegstein and Giraud, 2004), its exact role in the hierarchical model of voice recogni…”
Characteristic sounds make you look at target objects more quickly
Iordanescu, L., Grabowecky, M., Franconeri, S., Theeuwes, J., & Suzuki, S. (2010) · Attention Perception & Psychophysics · doi:10.3758/app.72.7.1736 · Cited by 86
Common neural substrates support speech and non-speech vocal tract gestures
Chang, S.-E., Kenney, M. K., Loucks, T. M. J., Poletto, C. J., & Ludlow, C. L. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.032 · Cited by 76
Zangenehpour, S., & Zatorre, R. J. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.10.022 · Cited by 86
Reliability-Weighted Integration of Audiovisual Signals Can Be Modulated by Top-down Attention
Rohe, T., & Noppeney, U. (2018) · eneuro · doi:10.1523/eneuro.0315-17.2018 · Cited by 73
“…accumulating evidence has shown that multisensory integration is not deferred until later processing stages in higher-order association cortices (Beauchamp et al., 2004; Sadaghiani et al., 2009), but starts already at the primary cortical level (Foxe et al., 2000; Ghazanfar and Schroeder, 2006;…”
BackgroundNeural basis of multisensory looming signals
Tyll, S., Bonath, B., Schoenfeld, M. A., Heinze, H.-J., Ohl, F. W., & Noesselt, T. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.056 · Cited by 75
“This included activations in the visual cortex (e.g. Beauchamp, 2005a; Lewis and Noppeney, 2010; Noesselt et al., 2007), the auditory cortex (e.g. Doehrmann et al., 2010; Ghazanfar et al., 2005, 2008) and the STS (e.g. Beauchamp et al., 2004; Marchant et al., 2012; Noesselt et al., 2010).”
Approaches to Understanding Multisensory Dysfunction in Autism Spectrum Disorder
Siemann, J. K., Veenstra‐VanderWeele, J., & Wallace, M. T. (2020) · Autism Research · doi:10.1002/aur.2375 · Cited by 74
Rapid invisible frequency tagging reveals nonlinear integration of auditory and visual information
Drijvers, L., Jensen, O. B., & Spaak, E. (2020) · Human Brain Mapping · doi:10.1002/hbm.25282 · Cited by 77
“…audiovisual inputs can occur as early as 50-100 ms after stimulus onset (e.g., Giard & Peronnet, 1999; Molholm et al., 2002; Talsma et al., 2010), and encompasses a widespread network of primary sensory and higher-order regions (e.g., Beauchamp et al., 2004; Calvert, 2001; Werner & Noppeney, 2010).”
BackgroundThe conceptual structure account: A cognitive model of semantic memory and its neural instantiation
Taylor, K. I., Moss, H. E., & TYLER, L. K. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511544965.012 · Cited by 89
Multimodal action representation in human left ventral premotor cortex
Kaplan, J., & Iacoboni, M. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0165-z · Cited by 76
“Recently, Beauchamp et al. (2004) investigated the audiovisual properties of STS using fMRI.”
BackgroundTranel, D., Grabowski, T. J., Lyon, J., & Damasio, H. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929055002508 · Cited by 73
“Finally, there has been work aimed at elucidating cross-modal and multimodal sensory perception, but this has not addressed the issue of naming (e.g., Amedi, Jacobson, Hendler, Malach, & Zohary, 2002; Amedi, Malach, Hendler, Peled, & Zohary, 2001; Beauchamp et al., 2004).”
BackgroundWho is That? Brain Networks and Mechanisms for Identifying Individuals
Perrodin, C., Kayser, C., Abel, T. J., Logothetis, N. K., & Petkov, C. I. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.09.002 · Cited by 78
Auditory motion affects visual biological motion processing
Brooks, A., van der Zwan, R., Billard, A., Petresкa, B., Clarke, S., & Blanke, O. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.12.012 · Cited by 83
Auditory and Visual Modulation of Temporal Lobe Neurons in Voice-Sensitive and Association Cortices
Perrodin, C., Kayser, C., Logothetis, N. K., & Petkov, C. I. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.2805-13.2014 · Cited by 78
Contributions of local speech encoding and functional connectivity to audio-visual speech perception
Giordano, B. L., Ince, R. A. A., Groß, J., Panzeri, S., Schyns, P. G., & Kayser, C. (2017) · eLife · doi:10.7554/elife.24763 · Cited by 76
“DOI: 10.7554/eLife.24763 1 of 27 Previous work has implicated many brain regions in the visual enhancement of speech, including superior temporal (Beauchamp et al., 2004; Nath and Beauchamp, 2011; Riedel et al., 2015; van Atteveldt et al., 2004), premotor and inferior frontal cortices (Arnal et…”
BackgroundInfluentialOkada, K., & Hickok, G. S. (2009) · Neuroscience Letters · doi:10.1016/j.neulet.2009.01.060 · Cited by 75
“…of speech via multisensory integration in the STS, aligns well with evidence from studies in both human and non-human primates that implicates the posterior STS in crosssensory integration (Beauchamp et al., 2004; Barraclough et al., 2005; Noesselt et al., 2007; Stein and Stanford, 2008).”
Audiovisual integration in the human brain: a coordinate-based meta-analysis
Gao, C., Green, J. J., Yang, X., Oh, S., Kim, J., & Shinkareva, S. V. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhac443 · Cited by 84
“Although this finding is consistent with the extensive prior literature suggesting the importance of superior temporal cortex in audiovisual integration (Beauchamp et al. 2004; Calvert and Thesen 2004; Werner and Noppeney 2010), our results highlight that there is not a singular integration region within the superior…”
ResultThe neural mechanisms of reliability weighted integration of shape information from vision and touch
Helbig, H. B., Ernst, M. O., Ricciardi, E., Pietrini, P., Thielscher, A., Mayer, K. M., Schultz, J., & Noppeney, U. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.072 · Cited by 74
Stevenson, R. A., Bushmakin, M. A., Kim, S., Wallace, M. T., Puce, A., & James, T. W. (2012) · Brain Topography · doi:10.1007/s10548-012-0220-7 · Cited by 73
“8c) may reflect activation in superior temporal cortex (STC), a known site of audiovisual speech integration (Beauchamp et al. 2004a, b, 2008; Calvert et al. 2000, 2001; Stevenson et al. 2009, 2010, 2011; Stevenson and James 2009; Werner and Noppeney 2009, among others).”
BackgroundVanzella, P., Balardin, J. B., Furucho, R. A., Morais, G. A. Z., Janzen, T. B., Sammler, D., & Sato, J. R. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00164 · Cited by 76
The left fusiform gyrus hosts trisensory representations of manipulable objects
Kassuba, T., Klinge, C., Hölig, C., Menz, M. M., Ptito, M., Röder, B., & Siebner, H. R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.02.032 · Cited by 71
“…(Lancaster et al., 2007): the LO was corrected using a sphere of 10 mm radius at x=−50, y=−66, z=−7 (Amedi et al., 2001: x=−45, y=−62, z=−9, Talairach); the pSTS was corrected using a sphere of 10 mm radius at x=−53, y=−57, z=10 (Beauchamp et al., 2004b: x=−50, y=−55, z=7, Talairach).”
BackgroundMethodResultInfluentialA link between individual differences in multisensory speech perception and eye movements
Gurler, D., Doyle, N., Walker, E. Y., Magnotti, J. F., & Beauchamp, M. S. (2015) · Attention Perception & Psychophysics · doi:10.3758/s13414-014-0821-1 · Cited by 67
“Implications for neural mechanisms The left superior temporal sulcus (STS) plays an important role in integration of auditory and visual information and eye movements (Beauchamp et al., 2004a; Beauchamp, Lee, Argall, and Martin 2004b).”
Self-citationBandettini, P. A. (2006) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2006.03.016 · Cited by 74
“As high resolution fMRI comes into more common usage (Beauchamp et al., 2004; Kim and Ogawa, 2002; Ugurbil et al., 1999) , several unique imaging, post processing, and data handling challenges and opportunities will be brought to the forefront.”
BackgroundSubcortical, Modality-Specific Pathways Contribute to Multisensory Processing in Humans
van den Brink, R. L., Cohen, M. X., der Burg, E. V., Talsma, D., Vissers, M. E., & Slagter, H. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht069 · Cited by 75
Multisensory interactions in the depth plane in front and rear space: A review
der Stoep, N. V., Nijboer, T. C. W., der Stigchel, S. V., & Spence, C. J. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.12.007 · Cited by 69
Auditory, Visual and Audiovisual Speech Processing Streams in Superior Temporal Sulcus
Venezia, J. H., Vaden, K. I., Rong, F., Maddox, D., Saberi, K., & Hickok, G. S. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00174 · Cited by 74
“…functional neuroimaging evidence supports the notion that the STS is a multisensory convergence zone for speech (Calvert et al., 2000; Wright et al., 2003; Beauchamp et al., 2004a, 2010; Szycik et al., 2008; Stevenson and James, 2009; Stevenson et al., 2010, 2011; Nath and Beauchamp, 2011, 2012).”
BackgroundMethodBlau, V. C., van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06350.x · Cited by 72
“STS is a well-known candidate structure for the integration of audiovisual (and tactile) information as it receives input from multiple senses via cortical and subcortical connections (Beauchamp et al., 2004; Macaluso et al., 2004).”
BackgroundResultInfluentialTanaka, E., Inui, K., Kida, T., Miyazaki, T., Takeshima, Y., & Kakigi, R. (2008) · BMC Neuroscience · doi:10.1186/1471-2202-9-116 · Cited by 66
“Although there is a large and growing number of studies on multimodal interaction using electroencephalography (EEG) and MEG [813] as well as multimodal activation and interaction using functional magnetic resonance imaging (fMRI) [14-17], it is unclear whether or not the timing of the transition from unimodal to mult…”
BackgroundDistinct cortical locations for integration of audiovisual speech and the McGurk effect
Erickson, L. C., Zielinski, B. A., Zielinski, J. E. V., Liu, G., Turkeltaub, P. E., Leaver, A. M., & Rauschecker, J. P. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00534 · Cited by 69
“…is important for multisensory integration (Beauchamp, 2005a; Beauchamp et al., 2008), particularly AV integration of language (Calvert et al., 2000; Beauchamp et al., 2004a; van Atteveldt et al., 2004; Stein and Stanford, 2008; Nath and Beauchamp, 2011) and other stimuli (Beauchamp et al., 2004b;…”
BackgroundTask-Guided Selection of the Dual Neural Pathways for Reading
Nakamura, K., Hara, N., Kouider, S., Takayama, Y., Hanajima, R., Sakai, K., & Ugawa, Y. (2006) · Neuron · doi:10.1016/j.neuron.2006.09.030 · Cited by 69
“Unraveling multisensory integration: patchy organization within human STS multisensory cortex.”
BackgroundInfluentialMultisensory Integration in Speech Processing: Neural Mechanisms of Cross-Modal Aftereffects
Kilian-Hütten, N., Formisano, E., & Vroomen, J. (2017) · Innovations in cognitive neuroscience · doi:10.1007/978-1-4939-7325-5_6 · Cited by 67
Mégevand, P., Mercier, M. R., Groppe, D. M., Golumbic, E. Z., Mesgarani, N., Beauchamp, M. S., Schroeder, C. E., & Mehta, A. D. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0555-20.2020 · Cited by 67
“…cortical patches of auditory-responsive cortex that are also sensitive to visual speech cues could be interspersed within regions that only respond to one or the other modality, as was shown in the superior temporal sulcus of humans and monkeys (Beauchamp et al., 2004; Dahl et al., 2009).”
BackgroundSelf-citationNeural responses elicited to face motion and vocalization pairings
Puce, A., Epling, J. A., Thompson, J. C., & Carrick, O. K. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.04.017 · Cited by 70
Crossmodal integration of object features: Voxel-based correlations in brain-damaged patients
Taylor, K. I., Stamatakis, E. A., & TYLER, L. K. (2009) · Brain · doi:10.1093/brain/awn361 · Cited by 65
“The discrepancy between previous fMRI findings of crossmodal integration effects in pSTS/MTG (Beauchamp et al., 2004a, b; Figure 5 Patients with pSTS/MTG lesions do not show crossmodal integration deficits.”
Auditory motion processing after early blindness
Jiang, F., Stecker, G. C., & Fine, I. (2014) · Journal of Vision · doi:10.1167/14.13.4 · Cited by 73
Audiovisual bounce-inducing effect: When sound congruence affects grouping in vision
Grassi, M., & Casco, C. (2010) · Attention Perception & Psychophysics · doi:10.3758/app.72.2.378 · Cited by 64
van Atteveldt, N. M., Blau, V. C., Blomert, L., & Goebel, R. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-11 · Cited by 64
“Moreover, recent high-resolution fMRI evidence suggests that the human STS is composed of a patchy distribution of unisensory and multisensory neuronal subpopulations, at a resolution below the typical fMRI voxel size (millimeter range, [22]).”
InfluentialFrey, H.-P., Molholm, S., Lalor, E. C., Russo, N. N., & Foxe, J. J. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12243 · Cited by 62
“…Pelphrey et al., 2011), a dorsal region associated with the processing of visual biological motion (Grossman et al., 2005; Michels et al., 2005; Krakowski et al., 2011), social information (Wyk et al., 2009), as well as multisensory integration (Beauchamp et al., 2004; Saint-Amour et al., 2007).”
BackgroundThe Contributions of Transient and Sustained Response Codes to Audiovisual Integration
Werner, S., & Noppeney, U. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq161 · Cited by 67
The COGs (context, object, and goals) in multisensory processing
ten Oever, S., Romei, V., van Atteveldt, N., Soto‐Faraco, S., Murray, M. M., & Matusz, P. J. (2016) · Experimental Brain Research · doi:10.1007/s00221-016-4590-z · Cited by 68
“…superior temporal cortex (bmSTC) subregion, has been repeatedly implicated in the processing of naturalistic multisensory stimuli (e.g. Beauchamp et al. 2004; Stevenson et al. 2010; see Perrodin et al. 2015 for a recent review indicating anterior temporal cortices as supporting…”
BackgroundDiffusion tensor studies dissociated two fronto-temporal pathways in the human memory system
Takahashi, E., Ohki, K., & Kim, D. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.10.009 · Cited by 67
“This appears to be homologues to connections between DLPFC and area TPO in the monkey brain.”
BackgroundInfluentialOrtega, L., Guzman-Martinez, E., Grabowecky, M., & Suzuki, S. (2014) · Attention Perception & Psychophysics · doi:10.3758/s13414-014-0663-x · Cited by 69
Coding of multisensory temporal patterns in human superior temporal sulcus
Noesselt, T., Bergmann, D., Heinze, H., Münte, T. F., & Spence, C. J. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00064 · Cited by 63
“In a functional imaging study, Beauchamp et al. (2004a) reported that STS-c can be parcellated into unisensory auditory, visual, and multisensory patches.”
BackgroundMethodCortical response to naturalistic stimuli is largely predictable with deep neural networks
Khosla, M., Ngo, G. H., Jamison, K. W., Kuceyeski, A. F., & Sabuncu, M. R. (2021) · Science Advances · doi:10.1126/sciadv.abe7547 · Cited by 77
Hirst, P., Javadi, P., Gharat, A., & Zangenehpour, S. (2012) · Neural Plasticity · doi:10.1155/2012/197264 · Cited by 58
“When the time scale of such interactions is expanded beyond minutes and hours, one comes across situations where a stimulus presented in only one sensory modality recruits regions pertaining to a different modality (such as in the case of lipreading [32–35] or the case where visual cortical areas have been shown to re…”
BackgroundLee, H., & Noppeney, U. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6510-10.2011 · Cited by 58
“…AV integration profile common to all stimulus classes regardless of their spectrotemporal structure or speech intelligibility (Wright et al., 2003; Beauchamp et al., 2004, 2008; van Atteveldt et al., 2004; Amedi et al., 2005; Barraclough et al., 2005; Beauchamp, 2005; Miller and D’Esposito, 2005;…”
BackgroundInfluentialThe functional architecture of S1 during touch observation described with 7 T fMRI
Kuehn, E., Mueller, K., Turner, R., & Schütz‐Bosbach, S. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0489-z · Cited by 63
“Importantly, suppressive interactions were also found in voxels that did not overlap between index and middle finger RFs, making vascular ceiling or saturation effects an unlikely explanation for the observed effects (Beauchamp et al. 2004; Gardner and Costanzo 1980).”
BackgroundNeural Mechanisms of Communication
Sliwa, J., Takahashi, D. Y., & Shepherd, S. V. (2016) · Wiley eBooks · doi:10.1002/9781118316757.ch16 · Cited by 58
Neural Correlates of Visuomotor Learning in Autism
Sharer, E. A., Crocetti, D., Muschelli, J., Barber, A. D., Nebel, M. B., Caffo, B. S., Pekar, J. J., & Mostofsky, S. H. (2015) · Journal of Child Neurology · doi:10.1177/0883073815600869 · Cited by 60
“The superior temporal sulcus, broadly, is a higher association area where sensory information converges(35-39) and form and motion integrate.(36,40) Though engaged during action observation, it is a higher-order perceptual region, and is not involved in action execution beyond the initial observational ‘‘pictorial’’ d…”
BackgroundGiani, A. S., O, B. P. E., Belardinelli, P., Kleiner, M., Preissl, H., & Noppeney, U. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.114 · Cited by 62
“…from multiple senses emerges in a widespread system encompassing subcortical, primary sensory and higher order association cortices (e.g.: Beauchamp et al., 2004; Calvert, 2001; Ghazanfar et al., 2008; Kayser et al., 2007; Lakatos et al., 2007; Noesselt et al., 2007, 2008; Noppeney et…”
BackgroundSenkowski, D., Gomez‐Ramirez, M., Lakatos, P., Wylie, G. R., Molholm, S., Schroeder, C. E., & Foxe, J. J. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0664-7 · Cited by 61
Wible, C. G. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00180 · Cited by 56
“…information within neurons in this system is proposed to form a basis for understanding action and may be used to anticipate and keep track of other’s behavior without reference to the motor circuits that generate the action (Beauchamp et al., 2004; Barraclough et al., 2005; Beauchamp, 2005).”
BackgroundJola, C., McAleer, P., Grosbras, M., Love, S., Morison, G., & Pollick, F. E. (2013) · i-Perception · doi:10.1068/i0536 · Cited by 64
“Thus, similar to the STS in Beauchamp et al. (2004), we found hemispheric differences in STG. Importantly, the Indian dance performance consisted of gestural movements and the music involved a singer reciting a text in Tamil.”
Utilizing the ventriloquism-effect to investigate audio-visual binding
Bischoff, M., Walter, B., Blecker, C. R., Morgen, K., Vaitl, D., & Sammer, G. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.008 · Cited by 63
Meyer, G. F., Greenlee, M., & Wuerger, S. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21593 · Cited by 52
“Superadditive effects in the posterior STS (pSTS) are also the basis for the claim that this structure is an audiovisual binding site (eg, Beauchamp, Argall, Bodurka, Duyn, & Martin, 2004 ; Calvert, 2001 ), which may not require semantics at all.”
BackgroundTop-down attention regulates the neural expression of audiovisual integration
Fernández, L. M., Visser, M., Ventura‐Campos, N., Ávila, C., & Soto‐Faraco, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.06.052 · Cited by 65
“…the STS, a region that has been proved inmany past studies to be responsive to multisensory stimulation in speech and other, meaningful, stimuli (Beauchamp et al., 2004a; Calvert et al., 2000; Fairhall and Macaluso, 2009; Miller and D'Esposito, 2005; Nath and Beauchamp, 2012; Noesselt et al.,…”
Influential
Metadata
- Authors
- Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Beauchamp, Michael S
- Venue
- Nature Neuroscience
- Published
- 2004-10-10
- Volume
- 7
- Issue
- 11
- Pages
- 1190-1192
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W1970618766
- Cited by
- 513
- References
- 16
- Citations by year
- 2026: 14 · 2025: 12 · 2024: 9 · 2023: 9 · 2022: 17 · 2021: 29 · 2020: 21 · 2019: 22 · 2018: 21 · 2017: 24 · 2016: 17 · 2015: 19 · 2014: 27 · 2013: 31 · 2012: 29
- FWCI
- 36.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- multisensory integration, superior temporal sulcus, functional architecture, parallel imaging, high-resolution fMRI, human cortex
- MeSH terms
- Acoustic Stimulation, Auditory Perception, Brain Mapping, Humans, Image Processing, Computer-Assisted, Functional Laterality, Magnetic Resonance Imaging, Oxygen, Photic Stimulation, Somatosensory Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.