Multisensory and modality specific processing of visual speech in different regions of the premotor cortex
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Behavioral and neuroimaging studies have demonstrated that brain regions involved with speech production also support speech perception, especially under degraded conditions. The premotor cortex (PMC) has been shown to be active during both observation and execution of action ("Mirror System" properties), and may facilitate speech perception by mapping unimodal and multimodal sensory features onto articulatory speech gestures. For this functional magnetic resonance imaging (fMRI) study, participants identified vowels produced by a speaker in audio-visual (saw the speaker's articulating face and heard her voice), visual only (only saw the speaker's articulating face), and audio only (only heard the speaker's voice) conditions with varying audio signal-to-noise ratios in order to determine the regions of the PMC involved with multisensory and modality specific processing of visual speech gestures. The task was designed so that identification could be made with a high level of accuracy from visual only stimuli to control for task difficulty and differences in intelligibility. The results of the functional magnetic resonance imaging (fMRI) analysis for visual only and audio-visual conditions showed overlapping activity in inferior frontal gyrus and PMC. The left ventral inferior premotor cortex (PMvi) showed properties of multimodal (audio-visual) enhancement with a degraded auditory signal. The left inferior parietal lobule and right cerebellum also showed these properties. The left ventral superior and dorsal premotor cortex (PMvs/PMd) did not show this multisensory enhancement effect, but there was greater activity for the visual only over audio-visual conditions in these areas. The results suggest that the inferior regions of the ventral premotor cortex are involved with integrating multisensory information, whereas, more superior and dorsal regions of the PMC are involved with mapping unimodal (in this case visual) sensory features of the speech signal with articulatory speech gestures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Internal models for motor control and trajectory planning.
Kawato, M. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00028-8 · Cited by 2,685
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 1×
“Visual observation of gestural information available from a speaker’s face improves speech perception, especially under noisy conditions (Sumby and Pollack, 1954; Grant and Braida, 1991; Callan et al., 2001, 2003).”
BackgroundHickok, G., & Poeppel, D. (2004) · Cognition · doi:10.1016/j.cognition.2003.10.011 · Cited by 2,212
Human cerebellar activity reflecting an acquired internal model of a new tool
Imamizu, H., Miyauchi, S., Tamada, T., Sasaki, Y., Takino, R., Pütz, B., Yoshioka, T., & Kawato, M. (2000) · Nature · doi:10.1038/35003194 · Cited by 1,000 · cited 2×
“ORIGINAL RESEARCH ARTICLE published: 05 May 2014 doi: 10.3389/fpsyg.2014.00389 Multisensory and modality specific processing of visual speech in different regions of the premotor cortex”
BackgroundMethodInfluentialCalvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Listening to speech activates motor areas involved in speech production
Wilson, S. M., Saygin, A. P., Sereno, M. I., & Iacoboni, M. (2004) · Nature Neuroscience · doi:10.1038/nn1263 · Cited by 885 · cited 3×
“…ventral superior and dorsal premotor cortex (PMvs/PMd), during speech production and perception has provided support for theories that propose a role for the motor system in speech perception (Callan et al., 2000a,b, 2006a,b, 2010; Wilson et al., 2004; Nishitani et al., 2005; Meister et al., 2007).”
BackgroundMethodInfluentialSchmahmann, J. D., & Pandya, D. N. (1997) · International Review of Neurobiology · doi:10.1016/s0074-7742(08)60346-3 · Cited by 774
The DIVA model: A neural theory of speech acquisition and production
Tourville, J. A., & Guenther, F. H. (2011) · Language and Cognitive Processes · doi:10.1080/01690960903498424 · Cited by 748 · cited 3×
“It is rather uncontroversial that during the development of speech production, auditory-articulatory and orosensoryarticulatory relationships must be established and encoded into internal models (Callan et al., 2000b; Tourville and Guenther, 2011; Guenther and Vladusich, 2012).”
BackgroundMethodInfluentialSong and speech: brain regions involved with perception and covert production
Callan, D. E., Tsytsarev, V., Hanakawa, T., Callan, A. M., Katsuhara, M., Fukuyama, H., & Turner, R. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.036 · Cited by 287
Self-citationMiddleton, F. A., & Strick, P. L. (1997) · International Review of Neurobiology · doi:10.1016/s0074-7742(08)60347-5 · Cited by 277
Premotor cortex mediates perceptual performance
Callan, D., Callan, A., Gamez, M., Sato, M.-A., & Kawato, M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.027 · Cited by 104 · cited 4×
“Callan et al. (2004a, 2010) suggested that the auditory consequences of internally simulated articulatory control signals (articulatory-auditory internal models for various phonemes) are used to constrain and facilitate speech perception under ambiguous conditions (e.g., speech perception in noisy…”
BackgroundMethodInfluentialSelf-citationSensory-motor brain network connectivity for speech comprehension
Londei, A., D'Ausilio, A., Basso, D., Sestieri, C., Gratta, C. D., Romani, G., & Belardinelli, M. O. (2010) · Human Brain Mapping · doi:10.1002/hbm.20888 · Cited by 90 · cited 2×
“…thought to be involved with facilitative processing of visual speech information, including the PMC, Broca’s area, Sylvian parietal temporal area Spt, IPL, and STG/S, have also been shown to be involved in increased intelligibility and comprehension (Callan et al., 2010; Londei et al., 2010).”
BackgroundMethodInfluential
Cited by
What Happened to Mirror Neurons?
Heyes, C., & Catmur, C. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691621990638 · Cited by 286
Ozker, M., Doyle, W., Devinsky, O., & Flinker, A. (2022) · PLOS Biology · doi:10.1371/journal.pbio.3001493 · Cited by 59
Frontal cortex selects representations of the talker’s mouth to aid in speech perception
Ozker, M., Yoshor, D., & Beauchamp, M. S. (2018) · eLife · doi:10.7554/elife.30387 · Cited by 24
“, 2015) raising an obvious question: since visual cortex presumably cannot assess the quality of auditory speech on its own, what is the origin of the top-down modulation that enhances visual speech processing ? Neuroimaging studies have shown that speech reading (perception of visual-only speech) leads to strong resp…”
BackgroundBorowiak, K., Schelinski, S., & von Kriegstein, K. (2018) · NeuroImage: Clinical · doi:10.1016/j.nicl.2018.09.019 · Cited by 17
Metadata
- Authors
- Callan, D. E., Jones, J. A., & Callan, A.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2014-05-05
- Volume
- 5
- Pages
- 389-389
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2142498917
- Cited by
- 45
- References
- 12
- FWCI
- 7.10
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.