The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
The impact of speech type on listening effort and intelligibility for native and non-native listeners
Abstract
Listeners are routinely exposed to many different types of speech, including artificially-enhanced and synthetic speech, styles which deviate to a greater or lesser extent from naturally-spoken exemplars. While the impact of differing speech types on intelligibility is well-studied, it is less clear how such types affect cognitive processing demands, and in particular whether those speech forms with the greatest intelligibility in noise have a commensurately lower listening effort. The current study measured intelligibility, self-reported listening effort, and a pupillometry-based measure of cognitive load for four distinct types of speech: (i) plain i.e. natural unmodified speech; (ii) Lombard speech, a naturally-enhanced form which occurs when speaking in the presence of noise; (iii) artificially-enhanced speech which involves spectral shaping and dynamic range compression; and (iv) speech synthesized from text. In the first experiment a cohort of 26 native listeners responded to the four speech types in three levels of speech-shaped noise. In a second experiment, 31 non-native listeners underwent the same procedure at more favorable signal-to-noise ratios, chosen since second language listening in noise has a more detrimental effect on intelligibility than listening in a first language. For both native and non-native listeners, artificially-enhanced speech was the most intelligible and led to the lowest subjective effort ratings, while the reverse was true for synthetic speech. However, pupil data suggested that Lombard speech elicited the lowest processing demands overall. These outcomes indicate that the relationship between intelligibility and cognitive processing demands is not a simple inverse, but is mediated by speech type. The findings of the current study motivate the search for speech modification algorithms that are optimized for both intelligibility and listening effort.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing Impairment and Cognitive Energy: The Framework for Understanding Effortful Listening (FUEL)
Pichora-Fuller, M. K., Kramer, S. E., Eckert, M. A., Edwards, B., Hornsby, B. W. Y., Humes, L. E., Lemke, U., Lunner, T., Matthen, M., Mackersie, C. L., et al. (2016) · Ear & Hearing · doi:10.1097/aud.0000000000000312 · Cited by 1,318 · cited 1×
“, do non-native listeners also suffer a disproportionate increase in effort when processing challenging forms of speech compared to the effort experienced by native listeners? While non-native speech perception is an important factor in the Framework for Effortful Listening (Pichora-Fuller et al., 2016), there have be…”
BackgroundSpeech recognition in adverse conditions: A review.
Mattys, S. L., Davis, M. H., Bradlow, A. R., & Scott, S. K. (2012) · Language and Cognitive Processes · doi:10.1080/01690965.2012.705006 · Cited by 809 · cited 1×
“Listening in a non-native language is known to affect intelligibility, with the greatest impact felt under adverse conditions (García Lecumberri et al., 2010; Mattys et al., 2012), broadly defined to include challenging listening conditions such as noise and reverberation and, of relevance for the current study, atypi…”
BackgroundMcGarrigle, R., Munro, K. J., Dawes, P., Stewart, A. J., Moore, D. R., Barry, J. G., & Amitay, S. (2014) · International Journal of Audiology · doi:10.3109/14992027.2014.890296 · Cited by 532
A taxonomy of fatigue concepts and their relation to hearing loss.
Hornsby, B. W. Y., Naylor, G., & Bess, F. H. (2016) · Ear & Hearing · doi:10.1097/aud.0000000000000289 · Cited by 188
Borghini, G., & Hazan, V. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00152 · Cited by 127
Second language experience modulates word retrieval effort in bilinguals: evidence from pupillometry
Schmidtke, J. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00137 · Cited by 116
Peng, Z. E., & Wang, L. M. (2019) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2018_jslhr-h-17-0423 · Cited by 81
Borghini, G., & Hazan, V. (2020) · The Journal of the Acoustical Society of America · doi:10.1121/10.0001126 · Cited by 44
McGarrigle, R., Rakusen, L., & Mattys, S. (2021) · Psychophysiology · doi:10.1111/psyp.13703 · Cited by 43
Research works printed but not linked: 64
- Axmear, 2005, Synthesized speech intelligibility in sentences, Lang. Speech Hear. Serv. Sch, 36, 244, 10.1044/0161-1461(2005/024) · doi:10.1044/0161-1461(2005/024
- Baese-Berk, 2023, Intelligibility as a measure of speech perception: Current approaches, challenges, and recommendations, J. Acoust. Soc. Am, 153, 68, 10.1121/10.0016806 · DOI · Paper page
- Bakdash, 2017, Repeated measures correlation, Front. Psychol, 10.3389/fpsyg.2017.00456 · DOI · Paper page
- Bates, 2015, Fitting linear mixed-effects models using lme4, J. Stat. Softw, 67, 1, 10.18637/jss.v067.i01 · DOI · Paper page
- Bentler, 2008, Digital noise reduction: Outcomes from laboratory and field studies, Int. J. Audiol, 47, 447, 10.1080/14992020802033091 · DOI
- Cooke, 2012, The intelligibility of Lombard speech for non-native listeners, J. Acoust. Soc. Am, 132, 1120, 10.1121/1.4732062 · doi:10.1121/1.4732062
- Cooke, 2016, “The effects of modified speech styles on intelligibility for non-native listeners,”, Proceedings of the Interspeech, 10.21437/Interspeech.2016-41 · doi:10.21437/interspeech.2016-41
- Cooke, 2013, Evaluating the intelligibility benefit of speech modifications in known noise conditions, Speech Commun, 55, 572, 10.1016/j.specom.2013.01.001 · DOI
- Dawes, 2014, Acclimatization to hearing aids, Ear. Hear, 35, 203, 10.1097/AUD.0b013e3182a8eda4 · doi:10.1097/aud.0b013e3182a8eda4
- Dreher, 1957, Effects of ambient noise on speaker intelligibility for words and phrases, J. Acoust. Soc. Am, 29, 1320, 10.1121/1.1908780 · DOI
- Gabrielsson, 1988, The effects of different frequency responses on sound quality judgments and speech intelligibility, J. Speech Lang. Hear. Res, 31, 166, 10.1044/jshr.3102.166 · DOI
- Gagné, 2017, Behavioral assessment of listening effort using a dual-task paradigm: a review, Trends Hear, 10.1177/2331216516687287 · DOI · Paper page
- García Lecumberri, 2010, Non-native speech perception in adverse conditions: a review, Speech Commun, 52, 864, 10.1016/j.specom.2010.08.014 · DOI · Paper page
- Govender, “Measuring the cognitive load of synthetic speech using a dual task paradigm,”, Proceedings of the Interspeech, 10.21437/Interspeech.2018-1199 · DOI
- Govender, “Using pupillometry to measure the cognitive load of synthetic speech,”, Proceedings of the Interspeech, 10.21437/Interspeech.2018-1174 · DOI
- Govender, 2019, “Using pupil dilation to measure cognitive load when listening to text-to-speech in quiet and in noise,”, Proceedings of the Interspeech, pages, 10.21437/Interspeech.2019-1783 · DOI
- Hart, 1988, “Development of NASA-TLX (task load index): results of empirical and theoretical research,”, 139
- Hickok, 2007, The cortical organization of speech processing, Nat. Rev. Neurosci, 8, 393, 10.1038/nrn2113 · DOI · Paper page
- Houben, 2013, Using response time to speech as a measure for listening effort, Int. J. Audiol, 52, 753, 10.3109/14992027.2013.832415 · DOI · Paper page
- Kim, 2021, Pre- and post-target cortical processes predict speech-in-noise performance, NeuroImage, 228, 117699, 10.1016/j.neuroimage.2020.117699 · DOI
- Kim, 2022, Effect of noise reduction on cortical speech-in-noise processing and its variance due to individual noise tolerance, Ear. Hear, 43, 849, 10.1097/AUD.0000000000001144 · DOI
- King, 2011, “The Blizzard Challenge 2011,”, 10.21437/Blizzard.2011-1 · doi:10.21437/blizzard.2011-1
- Koch, 2016, Speech rate effects on the processing of conversational speech across the adult life span, J. Acoust. Soc. Am, 139, 1618, 10.1121/1.4944032 · DOI · Paper page
- Koelewijn, 2015, The pupil response reveals increased listening effort when it is difficult to focus attention, Hear. Res, 323, 81, 10.1016/j.heares.2015.02.004 · DOI
- Koelewijn, 2012, Pupil dilation uncovers extra listening effort in the presence of a single-talker masker, Ear. Hear, 33, 291, 10.1097/AUD.0b013e3182310019 · DOI · Paper page
- Koelewijn, 2014, The influence of informational masking on speech perception and pupil response in adults with hearing impairment, J. Acoust. Soc. Am, 135, 1596, 10.1121/1.4863198 · DOI · Paper page
- Lam, 2018, Effects of classroom acoustics on speech intelligibility and response time: A comparison between native and non-native listeners, Build. Acoust, 25, 35, 10.1177/1351010X18758477 · DOI · Paper page
- Lenth, 2021, EMMEANS: Estimated Marginal Means, aka Least-Squares Means
- Lombard, 1911, Le signe de l'elevation de la voix, Ann. Mal. de L' Oreille et du Larynx, 37, 101
- Mackersie, 2011, Subjective and psychophysiological indexes of listening effort in a competing-talker task, J. Acoust. Soc. Am, 22, 113, 10.3766/jaaa.22.2.6 · DOI · Paper page
- Marcoux, 2022, The Lombard intelligibility benefit of native and non-native speech for native and non-native listeners, Speech Commun, 136, 53, 10.1016/j.specom.2021.11.007 · DOI
- Mirman, 2014, Growth Curve Analysis and Visualization Using R
- Ohlenforst, Effects of hearing impairment and hearing aid amplification on listening effort: A systematic review, Ear. Hear, 38, 267, 10.1097/AUD.0000000000000396 · DOI · Paper page
- Ohlenforst, Impact of stimulus-related factors and hearing impairment on listening effort as indicated by pupil dilation, Hear. Res, 351, 68, 10.1016/j.heares.2017.05.012 · DOI · Paper page
- Pearsons, 1977, Speech levels in various noise environments
- Pittman, 2001, Recognition of Speech Produced in Noise, J. Speech Lang. Hear. Res, 44, 487, 10.1044/1092-4388(2001/038) · doi:10.1044/1092-4388(2001/038
- 2021, R: A Language and Environment for Statistical Computing
- Rennies, 2020, “Intelligibility- 2.0,” enhancing speech modifications - the hurricane challenge,”, Proceedings of the Interspeech, 10.21437/Interspeech.2020-1641 · doi:10.21437/interspeech.2020-1641
- Rothauser, 1969, IEEE recommended practice for speech quality measurements, IEEE Trans. Audio Electroacoust, 17, 225, 10.1109/TAU.1969.1162058 · DOI · Paper page
- Sankowska, 2011, Interaction of intrinsic vowel and consonant durational correlates with foreigner directed speech, Poznań Stud. Contemp. Linguist, 47, 109, 10.2478/psicl-2011-0009 · doi:10.2478/psicl-2011-0009
- Sauert, 2009, “Near end listening enhancement optimized with respect to Speech Intelligibility Index,”, 2009 17th European Signal Processing Conference, 1844
- Scharenborg, 2018, The effect of background noise on the word activation process in nonnative spoken-word recognition, J. Exp. Psychol. Learn. Mem. Cogn, 44, 233, 10.1037/xlm0000441 · DOI · Paper page
- Simantiraki, 2020, “Effects of spectral tilt on listeners' preferences and intelligibility,”, Proceedings of the ICASSP, 10.1109/ICASSP40776.2020.9054117 · doi:10.1109/icassp40776.2020.9054117
- Smeds, 2015, Estimation of signal-to-noise ratios in realistic sound scenarios, J. Am. Acad. Audiol, 26, 183, 10.3766/jaaa.26.2.7 · DOI · Paper page
- Song, 2018, Listening effort during speech perception enhances auditory and lexical processing for non-native listeners and accents, Cognition, 179, 163, 10.1016/j.cognition.2018.06.001 · DOI · Paper page
- Studebaker, 1985, A “rationalized” arcsine transform, J. Speech Lang. Hear. Res, 28, 455, 10.1044/jshr.2803.455 · DOI · Paper page
- Summers, 1988, Effects of noise on speech production: Acoustic and perceptual analyses, J. Acoust. Soc. Am, 84, 917, 10.1121/1.396660 · DOI · Paper page
- Tang, 2018, A study on the relationship between the intelligibility and quality of algorithmically-modified speech for normal hearing listeners, J. Otorhinolaryngol. Hear. Balance Med, 10.3390/ohbm1010005 · doi:10.3390/ohbm1010005
- Tang, 2012, “Optimised spectral weightings for noise-dependent speech intelligibility enhancement,”, Proceedings of the Interspeech 2012, 10.21437/Interspeech.2012-285 · doi:10.21437/interspeech.2012-285
- Van Der Meer, 2010, Resource allocation and fluid intelligence: Insights from pupillometry, Psychophysiology, 47, 158, 10.1111/j.1469-8986.2009.00884.x · DOI · Paper page
- Venkatagiri, 2003, Segmental intelligibility of four currently used text-to-speech synthesis methods, J. Acoust. Soc. Am, 113, 2095, 10.1121/1.1558356 · DOI
- Visentin, 2019, Speech intelligibility and listening effort in university classrooms for native and non-native Italian listeners, Build. Acoust, 26, 275, 10.1177/1351010X19882314 · DOI · Paper page
- Wagner, 2015, “How hard can it be to ignore the pan in panda? Effort of lexical competition as measured in pupil dilation,”, 18th ICPhS
- Weber, 2004, Lexical competition in non-native spoken-word recognition, J. Mem. Lang, 50, 1, 10.1016/S0749-596X(03)00105-0 · DOI · Paper page
- Wendt, 2016, Impact of background noise and sentence complexity on processing demands during sentence comprehension, Front. Psychol, 10.3389/fpsyg.2016.00345 · DOI · Paper page
- Winn, 2015, The impact of auditory spectral resolution on listening effort revealed by pupil dilation, Ear. Hear, 36, e153, 10.1097/AUD.0000000000000145 · DOI · Paper page
- Winn, 2018, Best practices and advice for using pupillometry to measure listening effort: an introduction for those who want to get started, Trends Hear, 10.1177/2331216518800869 · DOI · Paper page
- Wu, 2018, Characteristics of real-world signal to noise ratios and speech listening situations of older adults with mild to moderate hearing loss, Ear. Hear, 10.1097/AUD.0000000000000486 · DOI · Paper page
- Wu, 2016, Psychometric functions of dual-task paradigms for measuring listening effort, Ear. Hear, 37, 660, 10.1097/AUD.0000000000000335 · DOI
- Yamagishi, 2009, Robust speaker-adaptive HMM-based text-to-speech synthesis, IEEE Trans. Audio Speech Lang. Proc, 17, 1208, 10.1109/TASL.2009.2016394 · DOI · Paper page
- Zekveld, 2014, Cognitive processing load across a wide range of listening conditions: Insights from pupillometry, Psychophysiology, 51, 277, 10.1111/psyp.12151 · DOI · Paper page
- Zekveld, 2010, Pupil response as an indication of effortful listening: The influence of sentence intelligibility, Ear. Hear, 31, 480, 10.1097/AUD.0b013e3181d4f251 · DOI · Paper page
- Zekveld, 2011, Cognitive load during speech perception in noise: the influence of age, hearing loss, and cognition on the pupil response, Ear. Hear, 32, 498, 10.1097/AUD.0b013e31820512bb · DOI · Paper page
- Zorila, 2012, “Speech-in-noise intelligibility improvement based on spectral shaping and dynamic range compression,”, Proceedings of the Interspeech, 10.21437/Interspeech.2012-197 · DOI
Metadata
- Authors
- Simantiraki, O., Wagner, A. E., & Cooke, M.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2023-09-28
- Volume
- 17
- ISSN
- 1662-453X
- Cited by
- 7
- References
- 9
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The impact of speech type on listening effort and intelligibility for native and non-native listeners. https://app.cochat.ai/papers/10.3389/fnins.2023.1235911
- The paper
- Simantiraki, O., Wagner, A. E., & Cooke, M. (2023). The impact of speech type on listening effort and intelligibility for native and non-native listeners. Frontiers in Neuroscience. https://doi.org/10.3389/fnins.2023.1235911
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.