Vowel Category Boundaries Enhance Cortical and Behavioral Responses to Speech Feedback Alterations
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Auditory feedback is instrumental in the online control of speech, allowing speakers to compare their self-produced speech signal with a desired auditory target and correct for errors. However, there is little account of the representation of "target" and "error": does error depend purely on acoustic distance from a target, or is error enhanced by phoneme category changes? Here, we show an effect of vowel boundaries on compensatory responses to a real-time auditory perturbation. While human subjects spoke monosyllabic words, event-triggered functional magnetic resonance imaging was used to characterize neural responses to unexpected changes in auditory feedback. Capitalizing on speakers' natural variability, we contrasted the responses to feedback perturbations applied to two classes of utterances: (1) those that fell nearer to the category boundary, for which perturbations were designed to change the phonemic identity of the heard speech; and (2) those that fell farther from the boundary, for which perturbations resulted in only sub-phonemic auditory differences. Subjects' behavioral compensation was more than three times greater when feedback shifts were applied nearer to a category boundary. Furthermore, a near-boundary shift resulted in stronger cortical responses, most notably in right posterior superior temporal gyrus, than an identical shift that occurred far from the boundary. Across participants, a correlation was found between the amount of compensation to the perturbation and the amount of activity in a network of superior temporal and inferior frontal brain regions. Together, these results demonstrate that auditory feedback control of speech is sensitive to linguistic categories learned through auditory experience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910 · cited 3×
“Freesurfer was used to segment each anatomical volume into gray and white matter structures and to perform cortical surface reconstruction.”
MethodFast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496 · cited 2×
“The functional imaging data were preprocessed and analyzed using Nipype (Gorgolewski et al., 2011), a pipeline platform chaining together publicly available software packages, including SPM (Friston et al., 1995), Freesurfer (Dale et al., 1999; Fischl et al., 1999), and FSL [for FMRIB (Functional MRI of the Brain) Sof…”
MethodCortical Surface-Based Analysis
Fischl, B., Sereno, M. I., & Dale, A. M. (1999) · NeuroImage · doi:10.1006/nimg.1998.0396 · Cited by 6,147 · cited 1×
“…a pipeline platform chaining together publicly available software packages, including SPM (Friston et al., 1995), Freesurfer (Dale et al., 1999; Fischl et al., 1999), and FSL [for FMRIB (Functional MRI of the Brain) Software Library] (Smith et al., 2004; Woolrich et al., 2009) into one…”
MethodThresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923 · cited 1×
“The FDR threshold controls the average proportion of false positives among all voxels declared active (Genovese et al., 2002).”
BackgroundFant, G. (1971) · De Gruyter eBooks · doi:10.1515/9783110873429 · Cited by 2,945
Bayesian analysis of neuroimaging data in FSL
Woolrich, M. W., Jbabdi, S., Patenaude, B., Chappell, M., Makni, S., Behrens, T., Beckmann, C., Jenkinson, M., & Smith, S. M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.055 · Cited by 2,385 · cited 2×
“, 1999), and FSL [for FMRIB (Functional MRI of the Brain) Software Library] (Smith et al., 2004; Woolrich et al., 2009) into one workflow.”
MethodNipype: A Flexible, Lightweight and Extensible Neuroimaging Data Processing Framework in Python
Gorgolewski, K., Burns, C. D., Madison, C., Clark, D., Halchenko, Y. O., Waskom, M. L., & Ghosh, S. S. (2011) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2011.00013 · Cited by 2,186 · cited 3×
“Functional imaging analyses The functional imaging data were preprocessed and analyzed using Nipype (Gorgolewski et al., 2011), a pipeline platform chaining together publicly available software packages, including SPM (Friston et al.”
MethodThe spatial and temporal signatures of word production components
Indefrey, P., & Levelt, W. J. M. (2004) · Cognition · doi:10.1016/j.cognition.2002.06.001 · Cited by 2,144 · cited 1×
“However, SMAs, implicated in motor sequencing (Wildgruber et al., 1999) and articulatory planning (Indefrey and Levelt, 2004), were found to be active in the Near–”
BackgroundThe discrimination of speech sounds within and across phoneme boundaries.
Liberman, A. M., Harris, K. S., Hoffman, H. S., & Griffith, B. C. (1957) · Journal of Experimental Psychology · doi:10.1037/h0044417 · Cited by 1,690 · cited 1×
“However, evidence from the speech perception literature suggests that not all auditory space is created equal: sounds that straddle a category boundary are more discriminable than those from the same phoneme category (Liberman et al., 1957).”
Background3D statistical neuroanatomical models from 305 MRI volumes
Evans, A. C., Collins, D. L., Mills, S. R., Brown, E. D., Kelly, R. L., & Peters, T. M. (2005) · 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference · doi:10.1109/nssmic.1993.373602 · Cited by 1,487
Kuhl, P. K. (1991) · Perception & Psychophysics · doi:10.3758/bf03212211 · Cited by 1,331
A Scale for the Measurement of the Psychological Magnitude Pitch
Stevens, S. S., Volkmann, J., & Newman, E. B. (1937) · The Journal of the Acoustical Society of America · doi:10.1121/1.1915893 · Cited by 1,107 · cited 1×
“…of hertz because the mel scale better reflects the sensitivities of the ear to changes in different regions of frequency space; that is, a fixed distance in mel space is approximately equally discriminable regardless of where along the frequency dimension it is located (Stevens et al., 1937).”
BackgroundKuhl, P. K., Conboy, B. T., Coffey-Corina, S., Padden, D., Rivera-Gaxiola, M., & Nelson, T. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2154 · Cited by 886 · cited 1×
“Discrimination ability is also increased when auditory stimuli lie nearer to category boundaries, a phenomenon called the perceptual magnet effect (Kuhl, 1991; Iverson and Kuhl, 1995; Kuhl et al., 2008).”
BackgroundNeural modeling and imaging of the cortical interactions underlying syllable production
Guenther, F. H., Ghosh, S. S., & Tourville, J. A. (2006) · Brain and Language · doi:10.1016/j.bandl.2005.06.001 · Cited by 879 · cited 3×
“In speech models such as the Directions Into Velocities of Articulators (DIVA) model (Guenther, 1994, 1995; Guenther et al., 2006; Golfinopoulos et al., 2010), speech sounds have corresponding target regions in auditory perceptual space, and auditory feedback is used to update and refine the motor commands that guide…”
MethodSelf-citationNeural mechanisms underlying auditory feedback control of speech
Tourville, J. A., Reilly, K. J., & Guenther, F. H. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.054 · Cited by 649
Self-citationCharacterizing Dynamic Brain Responses with fMRI: A Multivariate Approach
Friston, K. J., Frith, C. D., Frackowiak, R. S. J., & Turner, R. (1995) · NeuroImage · doi:10.1006/nimg.1995.1019 · Cited by 568
An fMRI investigation of syllable sequence production
Bohland, J. W., & Guenther, F. H. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.04.173 · Cited by 542 · cited 1×
“1D), using sparse sampling and a triggering mechanism to coordinate stimulus timing with image acquisitions (Birn et al., 2004; Bohland and Guenther, 2006; Ghosh et al., 2008; Tourville et al., 2008).”
Self-citationVoice F0 responses to manipulations in pitch feedback
Burnett, T. A., Freedland, M. B., Larson, C. R., & Hain, T. C. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.423073 · Cited by 506 · cited 2×
“Although these responses can vary across subjects and experimental parameters (Burnett et al., 1998), the most commonly observed response is compensatory, in which the adjustments to speech output serve to counteract the imposed perturbation, raising the first formant if it has been lowered, for…”
BackgroundNeural substrates of vocalization feedback monitoring in primate auditory cortex
Eliades, S. J., & Wang, X. (2008) · Nature · doi:10.1038/nature06910 · Cited by 479
O’Shaughnessy, D. D. (1987) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 452
Speech communication, human and machine
Karjalainen, M. (1988) · Signal Processing · doi:10.1016/0165-1684(88)90074-6 · Cited by 410
Iverson, P., & Kuhl, P. K. (1995) · The Journal of the Acoustical Society of America · doi:10.1121/1.412280 · Cited by 352 · cited 1×
“Discrimination ability is also increased when auditory stimuli lie nearer to category boundaries, a phenomenon called the perceptual magnet effect (Kuhl, 1991; Iverson and Kuhl, 1995; Kuhl et al., 2008).”
BackgroundGuenther, F. H. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.594 · Cited by 335
Self-citationAuditory Cortex Accesses Phonological Categories: An MEG Mismatch Study
Phillips, C., Pellathy, T., Marantz, A., Yellin, E., Wexler, K., Poeppel, D., McGinnis, M., & Roberts, T. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/08989290051137567 · Cited by 299
A neural network model of speech acquisition and motor equivalent speech production
Guenther, F. H. (1994) · Biological Cybernetics · doi:10.1007/bf00206237 · Cited by 263 · cited 1×
“In speech models such as the Directions Into Velocities of Articulators (DIVA) model (Guenther, 1994, 1995; Guenther et al., 2006; Golfinopoulos et al., 2010), speech sounds have corresponding target regions in auditory perceptual space, and auditory feedback is used to update and refine the motor…”
MethodSelf-citationCortical auditory evoked potential correlates of categorical perception of voice-onset time
Sharma, A., & Dorman, M. F. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.428048 · Cited by 250 · cited 1×
“Auditory evoked potentials (Dorman, 1974) and mismatch negativity (MMN) responses elicited in an oddball paradigm (Sharma and Dorman, 1999; Phillips et al., 2000) were found to be larger for cross-category than within-category contrasts.”
BackgroundCompensation following real-time manipulation of formants in isolated vowels
Purcell, D. W., & Munhall, K. G. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2173514 · Cited by 243 · cited 3×
“The average compensation in the Near condition reached 25% of the shift by 400 ms, double that reported previously in studies of unexpected perturbations with shifts of this magnitude (Purcell and Munhall, 2006; Tourville et al., 2008).”
ResultMixed-effects and fMRI studies
Friston, K. J., Stephan, K. E., Lund, T. E., Morcom, A., & Kiebel, S. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.08.055 · Cited by 206 · cited 1×
“A standard hierarchical group model approach was used to model within-subjects and between-subjects effects (Friston et al., 2005).”
Golfinopoulos, E., Tourville, J. A., & Guenther, F. H. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.023 · Cited by 200 · cited 2×
“In speech models such as the Directions Into Velocities of Articulators (DIVA) model (Guenther, 1994, 1995; Guenther et al., 2006; Golfinopoulos et al., 2010), speech sounds have corresponding target regions in auditory perceptual space, and auditory feedback is used to update and refine the motor commands that guide…”
MethodSelf-citationHashimoto, Y., & Sakai, K. L. (2003) · Human Brain Mapping · doi:10.1002/hbm.10119 · Cited by 186 · cited 2×
“, 2007) and auditory feedback delay (Hashimoto and Sakai, 2003).”
ResultRegion of interest based analysis of functional imaging data
Nieto-Castanon, A., Ghosh, S. S., Tourville, J. A., & Guenther, F. H. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00188-5 · Cited by 176 · cited 2×
“A cortical labeling system tailored for studies of speech (Nieto-Castanon et al., 2003; Tourville and Guenther, 2012) was used to identify anatomical regions for active clusters in the activation maps.”
MethodSelf-citationBauer, J. J., Mittal, J., Larson, C. R., & Hain, T. C. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2173513 · Cited by 166 · cited 1×
“For example, speech output is modified dynamically in response to unexpected perturbations in auditory feedback (Jones and Munhall, 2002; Bauer et al., 2006; Cai et al., 2011), with responses starting within the first few hundred milliseconds of perturbation onset.”
BackgroundVoice F responses to pitch-shifted voice feedback during English speech
Chen, S. H., Liu, H., Xu, Y., & Larson, C. R. (2007) · The Journal of the Acoustical Society of America · doi:10.1121/1.2404624 · Cited by 159 · cited 1×
“…by unexpected shifts in the current study (Purcell and Munhall, 2006; Katseff et al., 2012); however, this interpretation is also supported by several experiments using unexpected F0 perturbation, to both Mandarin bi-tonal disyllables (Xu et al., 2004) and prosodic contour (Chen et al., 2007).”
ResultExperimental designs and processing strategies for fMRI studies involving overt verbal responses
Birn, R. M., Cox, R. W., & Bandettini, P. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.039 · Cited by 154 · cited 1×
“1D), using sparse sampling and a triggering mechanism to coordinate stimulus timing with image acquisitions (Birn et al., 2004; Bohland and Guenther, 2006; Ghosh et al., 2008; Tourville et al., 2008).”
The role of auditory feedback during phonation: studies of Mandarin tone production
Jones, J. A., & Munhall, K. G. (2002) · Journal of Phonetics · doi:10.1006/jpho.2001.0160 · Cited by 134 · cited 1×
“For example, speech output is modified dynamically in response to unexpected perturbations in auditory feedback (Jones and Munhall, 2002; Bauer et al., 2006; Cai et al., 2011), with responses starting within the first few hundred milliseconds of perturbation onset.”
BackgroundPerceptual magnet effect in the light of behavioral and psychophysiological data
Aaltonen, O., Eerola, O., Hellström, Å., Uusipaikka, E., & Lang, A. H. (1997) · The Journal of the Acoustical Society of America · doi:10.1121/1.418031 · Cited by 122 · cited 1×
“…magnet effect, “good” categorizers showed poorer discrimination and weaker MMN amplitudes for contrasts involving a prototype vowel than for contrasts involving nonprototype vowels (Aaltonen et al., 1997), although all vowels tested were rated as being in the same phonetic category (/i/).”
BackgroundCai, S., Ghosh, S., Guenther, F. H., & Perkell, J. S. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3653-11.2011 · Cited by 116
Self-citationPartial Compensation for Altered Auditory Feedback: A Tradeoff with Somatosensory Feedback?
Katseff, S., Houde, J., & Johnson, K. (2012) · Language and Speech · doi:10.1177/0023830911417802 · Cited by 115 · cited 1×
“…somewhat different mechanisms than the rapid compensatory responses elicited by unexpected shifts in the current study (Purcell and Munhall, 2006; Katseff et al., 2012); however, this interpretation is also supported by several experiments using unexpected F0 perturbation, to both Mandarin…”
ResultNeural correlates of auditory feedback control in human
Toyomura, A., Koyama, S., Miyamaoto, T., Terao, A., Omori, T., Murohashi, H., & Kuriki, S. (2007) · Neuroscience · doi:10.1016/j.neuroscience.2007.02.023 · Cited by 114
Compensation for pitch-shifted auditory feedback during the production of Mandarin tone sequences
Xu, Y., Larson, C. R., Bauer, J. J., & Hain, T. C. (2004) · The Journal of the Acoustical Society of America · doi:10.1121/1.1763952 · Cited by 103 · cited 3×
“2), as has been demonstrated previously (Xu et al., 2004; Tourville et al., 2008).”
ResultDynamic pattern of brain activation during sequencing of word strings evaluated by fMRI
Wildgruber, D., Kischka, U., Ackermann, H., Klose, U., & Grodd, W. (1999) · Cognitive Brain Research · doi:10.1016/s0926-6410(98)00031-7 · Cited by 67
Neural Substrates Governing Audiovocal Integration for Vocal Pitch Regulation in Singing
ZARATE, J. M., & ZATORRE, R. J. (2005) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1360.058 · Cited by 57 · cited 2×
“(2008) in a similar fMRI study of unexpected formant perturbation and by several other studies involving pitch shifts (Zarate and Zatorre, 2005; Toyomura et al., 2007) and auditory feedback delay (Hashimoto and Sakai, 2003).”
ResultA cross-language study of compensation in response to real-time formant perturbation
Mitsuya, T., MacDonald, E., Purcell, D. W., & Munhall, K. G. (2011) · The Journal of the Acoustical Society of America · doi:10.1121/1.3643826 · Cited by 52 · cited 1×
“In line with this idea, Mitsuya et al. (2011) showed an effect of phonological processing on speech feedback control by contrasting the responses of English and Japanese speakers to a gradual increase in F1 feedback.”
BackgroundManipulation of a Central Auditory Representation Shapes Learned Vocal Output
Lei, H., & MOONEY, R. D. (2010) · Neuron · doi:10.1016/j.neuron.2009.12.008 · Cited by 30
Ghosh, S., Kovelman, I., Lymberis, J., & Gabrieli, J. D. E. (2009) · NeuroImage · doi:10.1016/s1053-8119(09)71199-1 · Cited by 6
Ghosh (2008) · doi:10.1044/1092-4388(2008/07-0119 · cited 1×
“1D), using sparse sampling and a triggering mechanism to coordinate stimulus timing with image acquisitions (Birn et al., 2004; Bohland and Guenther, 2006; Ghosh et al., 2008; Tourville et al., 2008).”
Cited by
What does motor efference copy represent? Evidence from speech production
Niziolek, C. A., Nagarajan, S. S., & Houde, J. F. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2137-13.2013 · Cited by 222
Self-citationThe architecture of speech production and the role of the phoneme in speech processing
Hickok, G. (2014) · Language, Cognition and Neuroscience · doi:10.1080/01690965.2013.834370 · Cited by 194
“…example, assumes that the representations are categorical and correspond to phoneme representations (Guenther, 1995), but recent evidence suggests that talkers will compensate for within category acoustic shifts, although to a lesser extent than cross category shifts (Niziolek & Guenther, 2013).”
BackgroundMental imagery of speech implicates two mechanisms of perceptual reactivation.
Tian, X., Zarate, J. M., & Poeppel, D. (2016) · Cortex · doi:10.1016/j.cortex.2016.01.002 · Cited by 178
Modeling the Role of Sensory Feedback in Speech Motor Control and Learning
Parrell, B., & Houde, J. (2019) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2019_jslhr-s-csmc7-18-0127 · Cited by 75
Ozker, M., Doyle, W., Devinsky, O., & Flinker, A. (2022) · PLOS Biology · doi:10.1371/journal.pbio.3001493 · Cited by 59
Metadata
- Authors
- Niziolek, C. A., & Guenther, F. H.
- Venue
- Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2013-07-17
- Volume
- 33
- Issue
- 29
- Pages
- 12090-12098
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2042041089
- Cited by
- 191
- References
- 47
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.