Decoding Articulatory Features from fMRI Responses in Dorsal Speech Regions
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
The brain's circuitry for perceiving and producing speech may show a notable level of overlap that is crucial for normal development and behavior. The extent to which sensorimotor integration plays a role in speech perception remains highly controversial, however. Methodological constraints related to experimental designs and analysis methods have so far prevented the disentanglement of neural responses to acoustic versus articulatory speech features. Using a passive listening paradigm and multivariate decoding of single-trial fMRI responses to spoken syllables, we investigated brain-based generalization of articulatory features (place and manner of articulation, and voicing) beyond their acoustic (surface) form in adult human listeners. For example, we trained a classifier to discriminate place of articulation within stop syllables (e.g., /pa/ vs /ta/) and tested whether this training generalizes to fricatives (e.g., /fa/ vs /sa/). This novel approach revealed generalization of place and manner of articulation at multiple cortical levels within the dorsal auditory pathway, including auditory, sensorimotor, motor, and somatosensory regions, suggesting the representation of sensorimotor information. Additionally, generalization of voicing included the right anterior superior temporal sulcus associated with the perception of human voices as well as somatosensory regions bilaterally. Our findings highlight the close connection between brain systems for speech perception and production, and in particular, indicate the availability of articulatory codes during passive speech perception. SIGNIFICANCE STATEMENT Sensorimotor integration is central to verbal communication and provides a link between auditory signals of speech perception and motor programs of speech production. It remains highly controversial, however, to what extent the brain's speech perception system actively uses articulatory (motor), in addition to acoustic/phonetic, representations. In this study, we examine the role of articulatory representations during passive listening using carefully controlled stimuli (spoken syllables) in combination with multivariate fMRI decoding. Our approach enabled us to disentangle brain responses to acoustic and articulatory speech properties. In particular, it revealed articulatory-specific brain responses of speech at multiple cortical levels, including auditory, sensorimotor, and motor regions, suggesting the representation of sensorimotor information during passive speech perception.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The cortical organization of speech processing
Hickok, G., & Poeppel, D. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2113 · Cited by 5,495 · cited 8×
“, 2014) and have been suggested to be specifically important for the performance of tasks requiring subvocal rehearsal (Hickok and Poeppel, 2007; Krieger-Redwood et al., 2013).”
BackgroundInfluentialForman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202 · cited 2×
“%) after setting an initial vertex-level threshold ( p 0.05, uncorrected) and submitting the maps to a correction criterion based on the estimate of the spatial smoothness of the map (Forman et al., 1995; Goebel et al., 2006; Hagler et al., 2006).”
MethodInfluentialBeyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271 · cited 1×
“To avoid degraded performances of the classification algorithm attributable to the high dimensionality of the feature space (model overfitting; for a description, see Norman et al., 2006), a reduction of the number of fMRI features is usually performed.”
MethodThe phonological loop as a language learning device.
Baddeley, A., Gathercole, S., & Papagno, C. (1998) · Psychological Review · doi:10.1037/0033-295x.105.1.158 · Cited by 2,199 · cited 1×
“…such as speech repetition (Caplan and Waters, 1995; Hickok et al., 2009), humming (Hickok et al., 2003), and verbal rehearsal in working memory (Baddeley et al., 1998; Jacquemot and Scott, 2006; Buchsbaum et al., 2011), activate the dorsal auditory pathway, including sensorimotor regions at…”
BackgroundLateralization of phonetic and pitch discrimination in speech processing
Zatorre, R. J., Evans, A. C., Meyer, E., & Gjedde, A. (1992) · Science · doi:10.1126/science.256.5058.846 · Cited by 1,507
Goebel, R., Esposito, F., & Formisano, E. (2006) · Human Brain Mapping · doi:10.1002/hbm.20249 · Cited by 1,053 · cited 6×
“Functional data were 3D motion-corrected (trilinear sinc interpolation), corrected for slice scan time differences, and temporally filtered by removing frequency components of 5 cycles per time course (Goebel et al., 2006).”
MethodInfluentialPhonetic Feature Encoding in Human Superior Temporal Gyrus
Mesgarani, N., Cheung, C., Johnson, K., & Chang, E. F. (2014) · Science · doi:10.1126/science.1245994 · Cited by 993 · cited 2×
“In a recent study, intracranical EEG responses to English phonemes indicated a phonetic organization in the left superior temporal cortex, especially in terms of manner of articulation and to a lesser extent also of place of articulation and voice onset time (Mesgarani et al., 2014).”
BackgroundListening to speech activates motor areas involved in speech production
Wilson, S. M., Saygin, A. P., Sereno, M. I., & Iacoboni, M. (2004) · Nature Neuroscience · doi:10.1038/nn1263 · Cited by 885
Smoothing and cluster thresholding for cortical surface-based group analysis of fMRI data
Hagler, D. J., Saygin, A. P., & Sereno, M. I. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.036 · Cited by 752
Auditory-motor interaction revealed by fMRI: speech, music, and working memory in area Spt
Hickok, G., Buchsbaum, B., Humphries, C., & Muftuler, T. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903322307393 · Cited by 700 · cited 3×
“Tasks explicitly requiring sensoryto-motor control, such as speech repetition (Caplan and Waters, 1995; Hickok et al., 2009), humming (Hickok et al., 2003), and verbal rehearsal in working memory (Baddeley et al., 1998; Jacquemot and Scott, 2006; Buchsbaum et al., 2011), activate the dorsal…”
BackgroundFunctional organization of human sensorimotor cortex for speech articulation
Bouchard, K. E., Mesgarani, N., Johnson, K., & Chang, E. F. (2013) · Nature · doi:10.1038/nature11911 · Cited by 686
Who “Is Saying What”? Brain-based decoding of human voice and speech
Formisano, E., De Martino, F., Bonte, M., & Goebel, R. (2008) · Science · doi:10.1126/science.1164318 · Cited by 599 · cited 5×
“…variation across other stimulus dimensions, such as the representation of vowels independent of acoustic variation across speakers’ pronunciations (Formisano et al., 2008) or the representation of semantic concepts independent of the input language in bilingual listeners (Correia et al., 2014).”
BackgroundMethodInfluentialSelf-citationSpeech Production as State Feedback Control
Houde, J. F., & Nagarajan, S. S. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00082 · Cited by 463 · cited 2×
“In particular, they may indicate automatic information transfer from auditory to somatosensory representations during speech perception (Cogan et al., 2014) similar to their integration as part of SFC systems for speech production.”
BackgroundSensory–motor transformations for speech occur bilaterally
Cogan, G. B., Thesen, T., Carlson, C., Doyle, W., Devinsky, O., & Pesaran, B. (2014) · Nature · doi:10.1038/nature12935 · Cited by 273 · cited 3×
“In particular, they may indicate automatic information transfer from auditory to somatosensory representations during speech perception (Cogan et al., 2014) similar to their integration as part of SFC systems for speech production.”
BackgroundModality-Independent Decoding of Semantic Information from the Human Brain
Simanova, I., Hagoort, P., Oostenveld, R., & van Gerven, M. A. J. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs324 · Cited by 138
Evans, S., & Davis, M. H. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv136 · Cited by 130
Distributed neural representations of phonological features during speech perception
Arsenault, J. S., & Buchsbaum, B. R. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2454-14.2015 · Cited by 111
Cited by
Blank, H., & Davis, M. H. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002577 · Cited by 181
Carey, D., Krishnan, S., Callaghan, M. F., Sereno, M. I., & Dick, F. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhw393 · Cited by 63
Carey, D., Miquel, M. E., Evans, B. G., Adank, P., & McGettigan, C. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx056 · Cited by 32
Zhang, W., Liu, Y., Wang, X., & Tian, X. (2020) · Cognitive Neuroscience · doi:10.1080/17588928.2020.1792868 · Cited by 26
“According to previous literature (Correia et al., 2015), there are three articulatory dimensions in consonants: articulation manner, articulation place, and voicing.”
Background
Metadata
- Authors
- Correia, J. M., Jansma, B. M. B., & Bonte, M.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2015-11-11
- Volume
- 35
- Issue
- 45
- Pages
- 15015-15025
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2181286512
- Cited by
- 99
- References
- 17
- FWCI
- 6.27
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.