The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Dynamic Changes in Superior Temporal Sulcus Connectivity during Perception of Noisy Audiovisual Speech
Open accessAbstract
Humans are remarkably adept at understanding speech, even when it is contaminated by noise. Multisensory integration may explain some of this ability: combining independent information from the auditory modality (vocalizations) and the visual modality (mouth movements) reduces noise and increases accuracy. Converging evidence suggests that the superior temporal sulcus (STS) is a critical brain area for multisensory integration, but little is known about its role in the perception of noisy speech. Behavioral studies have shown that perceptual judgments are weighted by the reliability of the sensory modality: more reliable modalities are weighted more strongly, even if the reliability changes rapidly. We hypothesized that changes in the functional connectivity of STS with auditory and visual cortex could provide a neural mechanism for perceptual reliability weighting. To test this idea, we performed five blood oxygenation level-dependent functional magnetic resonance imaging and behavioral experiments in 34 healthy subjects. We found increased functional connectivity between the STS and auditory cortex when the auditory modality was more reliable (less noisy) and increased functional connectivity between the STS and visual cortex when the visual modality was more reliable, even when the reliability changed rapidly during presentation of successive words. This finding matched the results of a behavioral experiment in which the perception of incongruent audiovisual syllables was biased toward the more reliable modality, even with rapidly changing reliability. Changes in STS functional connectivity may be an important neural mechanism underlying the perception of noisy speech.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
The cortical organization of speech processing
Hickok, G., & Poeppel, D. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2113 · Cited by 5,495 · cited 1×
“…visual cortex processes cues from lip movements, and the STS integrates the auditory and visual information (Binder et al., 1997; Price, 2000; Scott and Johnsrude, 2003; Belin et al., 2004; Hickok and Poeppel, 2007; Zatorre, 2007; Bernstein et al., 2008, 2010; Campbell, 2008; Poeppel et al., 2008).”
BackgroundThresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Psychophysiological and Modulatory Interactions in Neuroimaging
Friston, K. J., Buechel, C., Fink, G. R., Morris, J., Rolls, E., & Dolan, R. J. (1997) · NeuroImage · doi:10.1006/nimg.1997.0291 · Cited by 3,097 · cited 3×
“In addition, we performed a whole-brain connectivity analysis on the experiment 1 data to determine whether any other regions outside the auditory and visual cortex ROIs showed condition-dependent changes in connection strength with STS, similar to a psychophysiological interaction (Friston et al., 1997).”
MethodInfluentialCircular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 3×
“A number of behavioral studies show that the presence of information from both the auditory and visual modalities aids the perception of noisy speech (Sumby and Pollack, 1954; Hauser, 1996; Kryter, 1996; Grant and Seitz, 2000; MacDonald et al., 2000; Shahin and Miller, 2009).”
BackgroundA cortical area selective for visual processing of the human body
Downing, P. E., Jiang, Y., Shuman, M., & Kanwisher, N. (2001) · Science · doi:10.1126/science.1063414 · Cited by 2,043
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 3×
“Behavioral studies have shown that perception of multisensory stimuli is reliability weighted: information from the more reliable modality is given a stronger weight (Ernst and Banks, 2002; Alais and Burr, 2004; Ma et al., 2009).”
BackgroundMethodThe fusiform face area: a cortical region specialized for the perception of faces
Kanwisher, N., & Yovel, G. (2006) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.1934 · Cited by 1,718
The Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457 · cited 1×
“One possible explanation is that STS neurons are driven by only a subset of neurons within sensory cortex, with a normalization that divides the strongest response in the input population by the pooled background activity (Ghose, 2009; Lee and Maunsell, 2009; Reynolds and Heeger, 2009).”
BackgroundObject perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269
A Population-Average, Landmark- and Surface-based (PALS) atlas of human cerebral cortex
Van Essen, D. C. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.058 · Cited by 1,151
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Detection of functional connectivity using temporal correlations in MR images
Hampson, M., Peterson, B. S., Skudlarski, P., Gatenby, J. C., & Gore, J. C. (2002) · Human Brain Mapping · doi:10.1002/hbm.10022 · Cited by 699 · cited 2×
“Changes in functional connectivity have been observed in other studies of multisensory integration (Hampson et al., 2002; Horwitz and Braun, 2004; Fu et al., 2006; Patel et al., 2006; Gruber et al., 2007; Kreifelts et al., 2007; Noesselt et al., 2007; Obleser et al., 2007; Noppeney et al., 2008), with stronger weights…”
BackgroundDavis, M. H., Johnsrude, I. S., Hervais-Adelman, A., Taylor, K., & McGettigan, C. (2005) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.134.2.222 · Cited by 531
Shape perception reduces activity in human primary visual cortex
Murray, S. O., Kersten, D., Olshausen, B. A., Schrater, P., & Woods, D. L. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.192579399 · Cited by 496 · cited 1×
“However, there are both top-down and bottom-up connections throughout the cortical processing hierarchy (Felleman and Van Essen, 1991; Murray et al., 2002; de la Mothe et al., 2006; Winer, 2006; van Atteveldt et al., 2009).”
BackgroundSuperior Temporal Sulcus—It's My Area: Or Is It?
Hein, G., & Knight, R. T. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20148 · Cited by 486 · cited 1×
“For brevity, we have referred to the human homolog of this region as “STS” while noting that the STS also contains other functionally and anatomically heterogeneous regions (Beauchamp, 2005b; Van Essen, 2005; Hein and Knight, 2008).”
MethodA new method for improving functional-to-structural MRI alignment using local Pearson correlation
Saad, Z. S., Glen, D. R., Chen, G., Beauchamp, M. S., Desai, R., & Cox, R. W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.037 · Cited by 405 · cited 1×
“Functional data were aligned to the average anatomical dataset and motion corrected for each voxel in each subject using a local Pearson correlation (Saad et al., 2009).”
MethodSelf-citationA validated network of effective amygdala connectivity
Stein, J. L., Wiedholz, L. M., Bassett, D. S., Weinberger, D. R., Zink, C. F., Mattay, V. S., & Meyer-Lindenberg, A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.03.022 · Cited by 392
Pelphrey, K. A., Morris, J. P., Michelich, C. R., Allison, T., & McCarthy, G. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi064 · Cited by 369 · cited 2×
“, 2000) within extrastriate lateral occipital cortex, a brain region critical for processing moving and biological stimuli that includes the middle temporal visual area and the extrastriate body area (Tootell et al., 1995; Beauchamp et al., 1997, 2002, 2003; Downing et al., 2001; Pelphrey et al., 2005).”
BackgroundObleser, J., Wise, R. J. S., Alex Dresner, M., & Scott, S. K. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4663-06.2007 · Cited by 354
A Normalization Model of Attentional Modulation of Single Unit Responses
Lee, J., & Maunsell, J. H. R. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004651 · Cited by 257
Defining a left-lateralized response specific to intelligible speech using fMRI
Narain, C. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg083 · Cited by 246
Giraud, A. L. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhg124 · Cited by 213 · cited 2×
“…using a noisevocoded filter (as used in our study) resulted in reduced activity in auditory cortex (Scott et al., 2000; Narain et al., 2003; Giraud et al., 2004; Davis et al., 2005; Obleser et al., 2007) and low-contrast images (such as the blurred videos in our study) resulted in reduced…”
MethodResultTouch, sound and vision in human superior temporal sulcus
Beauchamp, M. S., Yasar, N. E., Frye, R. E., & Ro, T. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.015 · Cited by 208
Self-citationPredictive Coding or Evidence Accumulation? False Inference and Neuronal Fluctuations
Hesselmann, G., Sadaghiani, S., Friston, K. J., & Kleinschmidt, A. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009926 · Cited by 117 · cited 1×
“…cortex is higher when a correct inference (hit) is made about auditory or visual stimuli than during misses of identical stimuli or false alarms (Hesselmann et al., 2010), suggesting that the BOLD signal in sensory cortex could be a measure of the brain’s confidence about the perceptual…”
BackgroundWhat does the right hemisphere know about phoneme categories?
Wolmetz, M., Poeppel, D., & Rapp, B. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21495 · Cited by 38 · cited 1×
“Models of the right hemisphere showed weaker reliability weighting, perhaps reflecting the less important role of the right hemisphere in speech perception (Wolmetz et al., 2011).”
Background
Cited by
Price, C. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.062 · Cited by 2,159
Phoneme and word recognition in the auditory ventral stream
DeWitt, I., & Rauschecker, J. P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1113427109 · Cited by 465
Wallace, M. T., & Stevenson, R. A. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.08.005 · Cited by 315
A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion
Nath, A. R., & Beauchamp, M. S. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.024 · Cited by 280
Self-citationStevenson, R. A., Zemtsov, R. K., & Wallace, M. T. (2012) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0027339 · Cited by 269
Metadata
- Authors
- Nath, A. R., & Beauchamp, M. S.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2011-02-02
- Volume
- 31
- Issue
- 5
- Pages
- 1704-1714
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2014481898
- Cited by
- 171
- References
- 29
- FWCI
- 20.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.