The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Hearing Lips and Seeing Voices: How Cortical Areas Supporting Speech Production Mediate Audiovisual Speech Perception
Open accessAbstract
Observing a speaker's mouth profoundly influences speech perception. For example, listeners perceive an "illusory" "ta" when the video of a face producing /ka/ is dubbed onto an audio /pa/. Here, we show how cortical areas supporting speech production mediate this illusory percept and audiovisual (AV) speech perception more generally. Specifically, cortical activity during AV speech perception occurs in many of the same areas that are active during speech production. We find that different perceptions of the same syllable and the perception of different syllables are associated with different distributions of activity in frontal motor areas involved in speech production. Activity patterns in these frontal motor areas resulting from the illusory "ta" percept are more similar to the activity patterns evoked by AV(/ta/) than they are to patterns evoked by AV(/pa/) or AV(/ka/). In contrast to the activity in frontal motor areas, stimulus-evoked activity for the illusory "ta" in auditory and somatosensory areas and visual areas initially resembles activity evoked by AV(/pa/) and AV(/ka/), respectively. Ultimately, though, activity in these regions comes to resemble activity evoked by AV(/ta/). Together, these results suggest that AV speech elicits in the listener a motor plan for the production of the phoneme that the speaker might have been attempting to produce, and that feedback in the form of efference copy from the motor system ultimately influences the phonetic interpretation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
Rizzolatti, G., & Craighero, L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144230 · Cited by 7,433
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Cortical Surface-Based Analysis
Fischl, B., Sereno, M. I., & Dale, A. M. (1999) · NeuroImage · doi:10.1006/nimg.1998.0396 · Cited by 6,147
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Receptive fields of single neurones in the cat's striate cortex
Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653
Automatically Parcellating the Human Cerebral Cortex
Fischl, B. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhg087 · Cited by 4,253
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Cited by
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Predictive top-down integration of prior knowledge during speech perception
Sohoglu, E., Peelle, J. E., Carlyon, R. P., & Davis, M. H. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.5069-11.2012 · Cited by 388
The Representation of Tool Use in Humans and Monkeys: Common and Uniquely Human Features
Peeters, R., Simone, L., Nelissen, K., Fabbri-Destro, M., Vanduffel, W., Rizzolatti, G., & Orban, G. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2040-09.2009 · Cited by 364
The signing brain: the neurobiology of sign language
MacSweeney, M., Capek, C. M., Campbell, R., & Woll, B. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.07.010 · Cited by 331
Mental imagery of speech and movement implicates the dynamics of internal forward models
Tian, X. (2010) · Frontiers in Psychology · doi:10.3389/fpsyg.2010.00166 · Cited by 259
“…can be induced by visual presentation of a face and that following auditory stimuli can be affected (see Jaaskelainen, 2010 for recent discussion of AV integration models; Sams et al., 1991; van Wassenhove et al., 2005; Von Kriegstein and Giraud, 2006; Skipper et al., 2007; Poeppel et al., 2008).”
InfluentialSpeech-associated gestures, Broca’s area, and the human mirror system
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2007) · Brain and Language · doi:10.1016/j.bandl.2007.02.008 · Cited by 252
Self-citationReflections on mirror neurons and speech perception
Lotto, A. J., Hickok, G. S., & Holt, L. L. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.11.008 · Cited by 247
Tian, X., & Poeppel, D. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00381 · Cited by 172
The neuropsychological impact of insular cortex lesions
Jones, C. L., Ward, J., & Critchley, H. D. (2010) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2009.193672 · Cited by 158
How prior expectations shape multisensory perception
Gau, R., & Noppeney, U. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.045 · Cited by 109
“For instance, using multivariate analyses Skipper et al. (2007) have previously shown that ventral premotor activation patterns evoked by a McGurk– MacDonald syllable are more similar to the perceived phoneme (e.g. ‘ta’) than to the auditory phoneme component ‘ba’.”
BackgroundMethodPremotor cortex mediates perceptual performance
Callan, D., Callan, A., Gamez, M., Sato, M.-A., & Kawato, M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.027 · Cited by 104
The corollary discharge in humans is related to synchronous neural oscillations
Chen, C.-M. A., Mathalon, D. H., Roach, B. J., Cavus, I., Spencer, D. D., & Ford, J. M. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21589 · Cited by 86
Kauramäki, J., Jääskeläinen, I. P., Hari, R., Möttönen, R., Rauschecker, J. P., & Sams, M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1950-09.2010 · Cited by 47
Zevin, J. D., Yang, J., Skipper, J. I., & McCandliss, B. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4599-09.2010 · Cited by 36
“Specifically, we propose that change detection occurs via a predictive mechanism involving the motor system in which predicted behaviorally relevant stimulus features are compared with the current description of the sensory state of the listener in posterior superior temporal and inferior parietal cortices (Skipper et…”
Self-citationChen, W.-L., Ye, Q., Zhang, S.-C., Xia, Y., Yang, X., Yuan, T.-F., Shan, C.-L., & Li, J.-A. (2019) · Neural Regeneration Research · doi:10.4103/1673-5374.250580 · Cited by 32
“The core network of mirror neurons, i.e ., the mirror neuron system, are activated during execution of a particular action as well as during observation of the same action executed by another person (Buccino et al., 2001; Skipper et al., 2007).”
A voice without a mouth no more: The neurobiology of language and consciousness
Skipper, J. I. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104772 · Cited by 31
Self-citationAuditory Deficits in Audiovisual Speech Perception in Adult Asperger’s Syndrome: fMRI Study
Tietze, F.-A., Hundertmark, L., Roy, M., Zerr, M., Sinke, C., Wiswede, D., Walter, M., Münte, T. F., & Szycik, G. R. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02286 · Cited by 16
Valagussa, G., Trentin, L., Balatti, V., & Grossi, E. (2017) · Autism Research · doi:10.1002/aur.1796 · Cited by 9
(2010) · doi:10.1044/1092-4388(2009/08-0243
Metadata
- Authors
- Skipper, J. I., van Wassenhove, V., Nusbaum, H. C., & Small, S. L.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-01-11
- Volume
- 17
- Issue
- 10
- Pages
- 2387-2399
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2102133930
- Cited by
- 369
- References
- 84
- FWCI
- 32.95
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.