Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index.

Vocal Tract Images Reveal Neural Representations of Sensorimotor Transformation During Speech Imitation

Open access

Abstract

Imitating speech necessitates the transformation from sensory targets to vocal tract motor output, yet little is known about the representational basis of this process in the human brain. Here, we address this question by using real-time MR imaging (rtMRI) of the vocal tract and functional MRI (fMRI) of the brain in a speech imitation paradigm. Participants trained on imitating a native vowel and a similar nonnative vowel that required lip rounding. Later, participants imitated these vowels and an untrained vowel pair during separate fMRI and rtMRI runs. Univariate fMRI analyses revealed that regions including left inferior frontal gyrus were more active during sensorimotor transformation (ST) and production of nonnative vowels, compared with native vowels; further, ST for nonnative vowels activated somatomotor cortex bilaterally, compared with ST of native vowels. Using test representational similarity analysis (RSA) models constructed from participants' vocal tract images and from stimulus formant distances, we found that RSA searchlight analyses of fMRI data showed either type of model could be represented in somatomotor, temporal, cerebellar, and hippocampal neural activation patterns during ST. We thus provide the first evidence of widespread and robust cortical and subcortical neural representation of vocal tract and/or formant parameters, during prearticulatory ST.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/cercor/bhx056

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Overview of experimental paradigm and analysis framework. Upper row. (1) Participants trained on imitating one native and one nonnative vowel in blocks; all 10 tokens from a single category (e.g., /i/ or /y/) were imitated in randomized order in a given block (stimuli F1 and F2 are plotted in mel space—see lower inset). (2) Training was followed by scanning, during which participants imitated the trained pair and a further untrained pair. Scans comprised 3 fMRI blocks (140 trials, ~12 min), each preceded by a pair of rtMRI blocks (40 trials, ~3 min). Data analyses (a–d). (a) rtMRI data were analyzed with the Matlab toolbox of Kim et al. (2014), yielding measures of lip position per vowel (red trace on panels). (b) fMRI data were first analyzed with SPM, with contrasts specified for main effects (Imitation > rest; Listen preimitate > rest) (surface shown presents all imitation > rest second-level contrast, for illustrative purposes). Further contrasts were specified for each vowel > rest, for listen preimitation and imitation stages of the task. ROIs were defined with a Jackknifed “leave-one-out” procedure using the listen preimitate or imitation main effects (all vowels > rest). (c) rtMRI images frames were first averaged within a single trial (using the method of Scott et al. 2013). Images were then masked with the RSA toolbox, restricting FOV to the vocal tract. Masked images were cross-correlated on a trial-wise basis, creating three 40 × 40 RDMs (one per rtMRI block pair). Converting RDMs from correlation distance to z-score (with Fisher transform), each RDM was reduced to 4 × 4 matrix, and 4 × 4 matrices were averaged to give a single 4 × 4 matrix per subject. Single-subject 4 × 4 models were averaged to produce a full cohort 4 × 4 average model. Single-subject and full cohort models were used in searchlight analyses. (d) Schematic of the RSA searchlight procedure. Jackknifed ROIs constrained the searchlight analyses to regions active for imitation (all imitation > rest) and ST (all listen preimitate > rest). In each searchlight, the RDM pattern from the t-maps for the vowel conditions was correlated with the vocal tract image-derived model, the stimulus PSD acoustic-derived model, or the stimulus F1–F2 2D Euclidean distance derived model (see Materials and Methods).
Figure 1. Overview of experimental paradigm and analysis framework. Upper row. (1) Participants trained on imitating one native and one nonnative vowel in blocks; all 10 tokens from a single category (e.g., /i/ or /y/) were imitated in randomized order in a given block (stimuli F1 and F2 are plotted in mel space—see lower inset). (2) Training was followed by scanning, during which participants imitated the trained pair and a further untrained pair. Scans comprised 3 fMRI blocks (140 trials, ~12 min), each preceded by a pair of rtMRI blocks (40 trials, ~3 min). Data analyses (a–d). (a) rtMRI data were analyzed with the Matlab toolbox of Kim et al. (2014), yielding measures of lip position per vowel (red trace on panels). (b) fMRI data were first analyzed with SPM, with contrasts specified for main effects (Imitation > rest; Listen preimitate > rest) (surface shown presents all imitation > rest second-level contrast, for illustrative purposes). Further contrasts were specified for each vowel > rest, for listen preimitation and imitation stages of the task. ROIs were defined with a Jackknifed “leave-one-out” procedure using the listen preimitate or imitation main effects (all vowels > rest). (c) rtMRI images frames were first averaged within a single trial (using the method of Scott et al. 2013). Images were then masked with the RSA toolbox, restricting FOV to the vocal tract. Masked images were cross-correlated on a trial-wise basis, creating three 40 × 40 RDMs (one per rtMRI block pair). Converting RDMs from correlation distance to z-score (with Fisher transform), each RDM was reduced to 4 × 4 matrix, and 4 × 4 matrices were averaged to give a single 4 × 4 matrix per subject. Single-subject 4 × 4 models were averaged to produce a full cohort 4 × 4 average model. Single-subject and full cohort models were used in searchlight analyses. (d) Schematic of the RSA searchlight procedure. Jackknifed ROIs constrained the searchlight analyses to regions active for imitation (all imitation > rest) and ST (all listen preimitate > rest). In each searchlight, the RDM pattern from the t-maps for the vowel conditions was correlated with the vocal tract image-derived model, the stimulus PSD acoustic-derived model, or the stimulus F1–F2 2D Euclidean distance derived model (see Materials and Methods).CC BY · PubMed Central
Figure 2. Left: Example lip (red) position traces as measured from rtMRI images in a single subject. Right: Lip protrusion difference metrics per group (unrounded – rounded lip × co-ordinate). Positive values indicate relatively greater protrusion for the rounded than unrounded vowel; note that all means are significantly greater than 0 (all P < 0.005; see Results). See Results for description of statistical interaction.
Figure 2. Left: Example lip (red) position traces as measured from rtMRI images in a single subject. Right: Lip protrusion difference metrics per group (unrounded – rounded lip × co-ordinate). Positive values indicate relatively greater protrusion for the rounded than unrounded vowel; note that all means are significantly greater than 0 (all P < 0.005; see Results). See Results for description of statistical interaction.CC BY · PubMed Central
Figure 3. Univariate 2 × 2 ANOVA results (factors: training, native/nonnative) for ST (blue) and imitation (green) fMRI data. (a) Native/nonnative 2 × 2 main effect results for ST (blue) and imitation (green), significant at cluster-corrected FDR level (q < 0.05). Bar plots display mean beta parameter estimates (adjusted response) for cluster peak voxels (peak co-ordinates in parentheses). Conditions: NT, native trained; NU, native untrained; NnT, nonnative trained; NnU, nonnative untrained. (b) Training main effect results for ST (blue), significant at P < 0.0001 (k = 30) (did not survive at cluster-level FDR for voxel-height threshold of P < 0.0015, k = 50; q > 0.05).
Figure 3. Univariate 2 × 2 ANOVA results (factors: training, native/nonnative) for ST (blue) and imitation (green) fMRI data. (a) Native/nonnative 2 × 2 main effect results for ST (blue) and imitation (green), significant at cluster-corrected FDR level (q < 0.05). Bar plots display mean beta parameter estimates (adjusted response) for cluster peak voxels (peak co-ordinates in parentheses). Conditions: NT, native trained; NU, native untrained; NnT, nonnative trained; NnU, nonnative untrained. (b) Training main effect results for ST (blue), significant at P < 0.0001 (k = 30) (did not survive at cluster-level FDR for voxel-height threshold of P < 0.0015, k = 50; q > 0.05).CC BY · PubMed Central
Figure 4. RSA searchlight results. (a) Vocal tract group average RDM model pattern correlates with fMRI activation patterns in bilateral somatomotor, left superior temporal, bilateral medial temporal and right cerebellar regions for ST. The stimulus acoustic-derived RDM pattern did not correlate robustly with fMRI t-map RDMs; tests of the correlation coefficients from both analyses showed significantly more robust correlations for the vocal tract model than the stimulus model (note that this overlapped with all voxels where significant vocal tract model and fMRI t-map correlations emerged; q < 0.05, FDR-corrected). (b) Vocal tract group average model correlates nonrobustly with fMRI activation patterns for imitation in left ventral M1/lateral Heschl's gyrus, and right lateral somatomotor cortex. Transparent underlays in (a) and (b) show the boundaries of the searchlight ROI volume—blue: ST ROI; green: imitation ROI. Scale bar minimum in (a) shows the equivalent uncorrected threshold at which voxel-height FDR correction (q < 0.05) is achieved; for consistency, the same scale bar range is used in (b), but note that (b) correlations are nonsignificant with FDR correction (q > 0.05).
Figure 4. RSA searchlight results. (a) Vocal tract group average RDM model pattern correlates with fMRI activation patterns in bilateral somatomotor, left superior temporal, bilateral medial temporal and right cerebellar regions for ST. The stimulus acoustic-derived RDM pattern did not correlate robustly with fMRI t-map RDMs; tests of the correlation coefficients from both analyses showed significantly more robust correlations for the vocal tract model than the stimulus model (note that this overlapped with all voxels where significant vocal tract model and fMRI t-map correlations emerged; q < 0.05, FDR-corrected). (b) Vocal tract group average model correlates nonrobustly with fMRI activation patterns for imitation in left ventral M1/lateral Heschl's gyrus, and right lateral somatomotor cortex. Transparent underlays in (a) and (b) show the boundaries of the searchlight ROI volume—blue: ST ROI; green: imitation ROI. Scale bar minimum in (a) shows the equivalent uncorrected threshold at which voxel-height FDR correction (q < 0.05) is achieved; for consistency, the same scale bar range is used in (b), but note that (b) correlations are nonsignificant with FDR correction (q > 0.05).CC BY · PubMed Central
Figure 5. RSA searchlight results using F1–F2 2D Euclidean distance RDM test model. The F1–F2 2D Euclidean distance model reveals correlations that overlap most of the regions that manifested significant searchlight correlations for the group average vocal tract model (see Fig. 4). Voxel-wise Wilcoxon signed-rank tests of the correlation maps derived from the vocal tract average model and the correlation maps from the F1–F2 2D Euclidean distance model, did not reveal any significant differences in robustness of the correlations across the 2 analyses (all FDR q > 0.05). All other parameters as per Figure 4.
Figure 5. RSA searchlight results using F1–F2 2D Euclidean distance RDM test model. The F1–F2 2D Euclidean distance model reveals correlations that overlap most of the regions that manifested significant searchlight correlations for the group average vocal tract model (see Fig. 4). Voxel-wise Wilcoxon signed-rank tests of the correlation maps derived from the vocal tract average model and the correlation maps from the F1–F2 2D Euclidean distance model, did not reveal any significant differences in robustness of the correlations across the 2 analyses (all FDR q > 0.05). All other parameters as per Figure 4.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 69 references

Cited by

See all 35

Metadata

Authors
Carey, D., Miquel, M. E., Evans, B. G., Adank, P., & McGettigan, C.
Affiliations
  • Royal Holloway University of London (GB)
  • Queen Mary University of London (GB)
  • University College London (GB)
Corresponding author
McGettigan, Carolyn
Venue
Cerebral Cortex
Published
2017-03-18
Volume
27
Issue
5
Pages
3064-3079
ISSN
  • 1047-3211 (ISSN-L)
  • 1460-2199
OpenAlex
W2610838041
Cited by
32
References
69
Citations by year
2026: 2 · 2025: 5 · 2024: 3 · 2023: 4 · 2022: 4 · 2021: 4 · 2020: 4 · 2019: 2 · 2018: 3 · 2017: 1
FWCI
1.57
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Cerebral Cortex (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
Funders
Economic and Social Research Council (ES/L01257X/1)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
  • Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
Keywords
speech imitation, sensorimotor transformation, vocal tract, real-time MRI, lip rounding, somatomotor cortex, inferior frontal gyrus, neural representation of speech, representational similarity analysis, hippocampus, cerebellum
MeSH terms
Adult, Brain Mapping, Female, Humans, Image Processing, Computer-Assisted, Larynx, Lip, Magnetic Resonance Imaging, Male, Oxygen, Palate, Soft, Speech, Speech Acoustics, Tongue, Young Adult, Sensorimotor Cortex

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Vocal Tract Images Reveal Neural Representations of Sensorimotor Transformation During Speech Imitation. https://app.cochat.ai/papers/10.1093/cercor/bhx056
The paper
Carey, D., Miquel, M. E., Evans, B. G., Adank, P., & McGettigan, C. (2017). Vocal Tract Images Reveal Neural Representations of Sensorimotor Transformation During Speech Imitation. Cerebral Cortex. https://doi.org/10.1093/cercor/bhx056

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.