The DOI matches its Crossref record; 99 of the 99 references it cites were found in a registry or an index.
Reading Speech from Still and Moving Faces: The Neural Substrates of Visible Speech
Abstract
Speech is perceived both by ear and by eye. Unlike heard speech, some seen speech gestures can be captured in stilled image sequences. Previous studies have shown that in hearing people, natural time-varying silent seen speech can access the auditory cortex (left superior temporal regions). Using functional magnetic resonance imaging (fMRI), the present study explored the extent to which this circuitry was activated when seen speech was deprived of its time-varying characteristics. In the scanner, hearing participants were instructed to look for a prespecified visible speech target sequence (“voo” or “ahv”) among other monosyllables. In one condition, the image sequence comprised a series of stilled key frames showing apical gestures (e.g., separate frames for “v” and “oo” [from the target] or “ee” and “m” [i.e., from nontarget syllables]). In the other condition, natural speech movement of the same overall segment duration was seen. In contrast to a baseline condition in which the letter “V” was superimposed on a resting face, stilled speech face images generated activation in posterior cortical regions associated with the perception of biological movement, despite the lack of apparent movement in the speech image sequence. Activation was also detected in traditional speech-processing regions including the left inferior frontal (Broca's) area, left superior temporal sulcus (STS), and left supramarginal gyrus (the dorsal aspect of Wernicke's area). Stilled speech sequences also generated activation in the ventral premotor cortex and anterior inferior parietal sulcus bilaterally. Moving faces generated significantly greater cortical activation than stilled face sequences, and in similar regions. However, a number of differences between stilled and moving speech were also observed. In the visual cortex, stilled faces generated relatively more activation in primary visual regions (V1/V2), while visual movement areas (V5/MT+) were activated to a greater extent by moving faces. Cortical regions activated more by naturally moving speaking faces included the auditory cortex (Brodmann's Areas 41/42; lateral parts of Heschl's gyrus) and the left STS and inferior frontal gyrus. Seen speech with normal time-varying characteristics appears to have preferential access to “purely” auditory processing regions specialized for language, possibly via acquired dynamic audiovisual integration mechanisms in STS. When seen speech lacks natural time-varying characteristics, access to speech-processing systems in the left temporal lobe may be achieved predominantly via action-based speech representations, realized in the ventral premotor cortex.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 6,872
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Action recognition in the premotor cortex
Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996) · Brain · doi:10.1093/brain/119.2.593 · Cited by 4,968
The distributed human neural system for face perception
Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01482-0 · Cited by 4,891
Premotor cortex and the recognition of motor actions
Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996) · Cognitive Brain Research · doi:10.1016/0926-6410(95)00038-0 · Cited by 4,870
Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data
Woolrich, M. W., Ripley, B. D., Brady, M., & Smith, S. M. (2001) · NeuroImage · doi:10.1006/nimg.2001.0931 · Cited by 2,852
Cortical mechanisms of human imitation
Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C., & Rizzolatti, G. (1999) · Science · doi:10.1126/science.286.5449.2526 · Cited by 2,683
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 3×
“…a topic of interest to clinical researchers interested in the implications of hearing loss, deafness ( Jeffers & Barley, 1971), or hearing in noise (Sumby & Pollack, 1954), but is increasingly seen to have implications for understanding the mechanisms of speech and language processing more…”
BackgroundAction observation activates premotor and parietal areas in a somatotopic manner: an fMRI study
Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., Seitz, R. J., Zilles, K., Rizzolatti, G., & Freund, H. ‐. (2001) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2001.01385.x · Cited by 2,488
Cited by
ALE meta-analysis of action observation and imitation in the human brain
Caspers, S., Zilles, K., Laird, A. R., & Eickhoff, S. B. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.112 · Cited by 1,386
Understanding others' actions and goals by mirror and mentalizing systems: a meta-analysis
Van Overwalle, F., & Baetens, K. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.009 · Cited by 1,329
Huth, A. G., Nishimoto, S., Vu, A. T., & Gallant, J. L. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.014 · Cited by 896
Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study
Buccino, G., Lui, F., Canessa, N., Patteri, I., Lagravinese, G., Benuzzi, F., Porro, C. A., & Rizzolatti, G. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322755601 · Cited by 762
Odor/taste integration and the perception of flavor
Small, D. M., & Prescott, J. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2376-9 · Cited by 712
Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl024 · Cited by 650
Oberman, L. M., & Ramachandran, V. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.2.310 · Cited by 630
Integration of Letters and Speech Sounds in the Human Brain
van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.025 · Cited by 544
Visual Modulation of Neurons in Auditory Cortex
Kayser, C., Petkov, C. I., & Logothetis, N. K. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm187 · Cited by 509
Social cognition and the cerebellum: A meta-analysis of over 350 fMRI studies
Van Overwalle, F., Baetens, K., Mariën, P., & Vandekerckhove, M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.09.033 · Cited by 474
The functional neuroanatomy of language
Hickok, G. (2009) · Physics of Life Reviews · doi:10.1016/j.plrev.2009.06.001 · Cited by 444
Pelphrey, K. A., Morris, J. P., Michelich, C. R., Allison, T., & McCarthy, G. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi064 · Cited by 369
“…the more anterior focus of mouth activity is well positioned near polysensory regions of the left and right STS and STG, which are known to be involved in the integration of audio and visual components of speech (Calvert et al., 1997, 2001; Calvert and Campbell, 2003; Wright et al., 2003).”
BackgroundSkipper, J. I., van Wassenhove, V., Nusbaum, H. C., & Small, S. L. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl147 · Cited by 369
The Representation of Tool Use in Humans and Monkeys: Common and Uniquely Human Features
Peeters, R., Simone, L., Nelissen, K., Fabbri-Destro, M., Vanduffel, W., Rizzolatti, G., & Orban, G. A. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2040-09.2009 · Cited by 364
Functional imaging of human crossmodal identification and object recognition
Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M. S., & Naumer, M. J. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2396-5 · Cited by 353
Neural Correlates of Multisensory Integration of Ecologically Valid Audiovisual Events
Stekelenburg, J. J., & Vroomen, J. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.12.1964 · Cited by 336
Sound symbolism in infancy: Evidence for sound–shape cross-modal correspondences in 4-month-olds
Ozturk, O., Krehm, M., & Vouloumanos, A. (2013) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2012.05.004 · Cited by 327
Listening to talking faces: motor cortical activation during speech perception
Skipper, J. I., Nusbaum, H. C., & Small, S. L. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.11.006 · Cited by 324
Bimodal speech: early suppressive visual effects in human auditory cortex
Besle, J., Fort, A., Delpuech, C., & Giard, M. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03670.x · Cited by 323
Context modulates attention to social scenes in toddlers with autism
Chawarska, K., Macari, S., & Shic, F. (2012) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2012.02538.x · Cited by 317
Implicit multisensory associations influence voice recognition
von Kriegstein, K., & Giraud, A.-L. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040326 · Cited by 309
Brain regions involved in human movement perception: A quantitative voxel‐based meta‐analysis
Grosbras, M., Beaton, S., & Eickhoff, S. B. (2012) · Human Brain Mapping · doi:10.1002/hbm.21222 · Cited by 284
Neural correlates of switching from auditory to speech perception
Dehaene-Lambertz, G., Pallier, C., Serniclaes, W., Sprenger-Charolles, L., Jobert, A., & Dehaene, S. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.09.039 · Cited by 283
The processing of audio-visual speech: empirical and neural bases
Campbell, R. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2155 · Cited by 282
Self-citationModulation of Motor Excitability during Speech Perception: The Role of Broca's Area
Watkins, K., & Paus, T. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929041502616 · Cited by 266
Dual Neural Routing of Visual Facilitation in Speech Processing
Arnal, L. H., Morillon, B., Kell, C. A., & Giraud, A.-L. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3194-09.2009 · Cited by 241
Wandering tales: evolutionary origins of mental time travel and language
Corballis, M. C. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00485 · Cited by 141
“Other studies show the parts of the brain involved in producing speech are activated when people simply watch silent videos of people speaking (Calvert and Campbell, 2003; Watkins et al., 2003).”
BackgroundPremotor cortex mediates perceptual performance
Callan, D., Callan, A., Gamez, M., Sato, M.-A., & Kawato, M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.027 · Cited by 104
Multistable representation of speech forms: a functional MRI study of verbal transformations.
Sato, M., Baciu, M., Lœvenbruck, H., Schwartz, J.-L., Cathiard, M.-A., Segebarth, C., & Abry, C. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.055 · Cited by 78
Unification of sentence processing via ear and eye: An fMRI study
Braze, D., Mencl, W. E., Tabor, W., Pugh, K. R., Todd Constable, R., Fulbright, R. K., Magnuson, J. S., Van Dyke, J. A., & Shankweiler, D. P. (2011) · Cortex · doi:10.1016/j.cortex.2009.11.005 · Cited by 69
Wible, C. G. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00180 · Cited by 56
Lœvenbruck, H., Baciu, M., Segebarth, C., & Abry, C. (2005) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2004.12.002 · Cited by 42
Frontal cortex selects representations of the talker’s mouth to aid in speech perception
Ozker, M., Yoshor, D., & Beauchamp, M. S. (2018) · eLife · doi:10.7554/elife.30387 · Cited by 24
Borowiak, K., Schelinski, S., & von Kriegstein, K. (2018) · NeuroImage: Clinical · doi:10.1016/j.nicl.2018.09.019 · Cited by 17
Fridriksson (2009) · doi:10.1044/1092-4388(2008/06-0197
Metadata
- Authors
- Calvert, G. A., & Campbell, R.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2003-01-01
- Volume
- 15
- Issue
- 1
- Pages
- 57-70
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2131471636
- Cited by
- 332
- References
- 99
- FWCI
- 8.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.