CoChat
Cited by 7

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

The impact of speech type on listening effort and intelligibility for native and non-native listeners

Simantiraki, Olympia, Wagner, Anita E., Cooke, Martin · 2023 · Frontiers in Neuroscience

Abstract

Listeners are routinely exposed to many different types of speech, including artificially-enhanced and synthetic speech, styles which deviate to a greater or lesser extent from naturally-spoken exemplars. While the impact of differing speech types on intelligibility is well-studied, it is less clear how such types affect cognitive processing demands, and in particular whether those speech forms with the greatest intelligibility in noise have a commensurately lower listening effort. The current study measured intelligibility, self-reported listening effort, and a pupillometry-based measure of cognitive load for four distinct types of speech: (i) plain i.e. natural unmodified speech; (ii) Lombard speech, a naturally-enhanced form which occurs when speaking in the presence of noise; (iii) artificially-enhanced speech which involves spectral shaping and dynamic range compression; and (iv) speech synthesized from text. In the first experiment a cohort of 26 native listeners responded to the four speech types in three levels of speech-shaped noise. In a second experiment, 31 non-native listeners underwent the same procedure at more favorable signal-to-noise ratios, chosen since second language listening in noise has a more detrimental effect on intelligibility than listening in a first language. For both native and non-native listeners, artificially-enhanced speech was the most intelligible and led to the lowest subjective effort ratings, while the reverse was true for synthetic speech. However, pupil data suggested that Lombard speech elicited the lowest processing demands overall. These outcomes indicate that the relationship between intelligibility and cognitive processing demands is not a simple inverse, but is mediated by speech type. The findings of the current study motivate the search for speech modification algorithms that are optimized for both intelligibility and listening effort.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fnins.2023.1235911

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 64

  1. Axmear, 2005, Synthesized speech intelligibility in sentences, Lang. Speech Hear. Serv. Sch, 36, 244, 10.1044/0161-1461(2005/024) · doi:10.1044/0161-1461(2005/024
  2. Baese-Berk, 2023, Intelligibility as a measure of speech perception: Current approaches, challenges, and recommendations, J. Acoust. Soc. Am, 153, 68, 10.1121/10.0016806 · DOI · Paper page
  3. Bakdash, 2017, Repeated measures correlation, Front. Psychol, 10.3389/fpsyg.2017.00456 · DOI · Paper page
  4. Bates, 2015, Fitting linear mixed-effects models using lme4, J. Stat. Softw, 67, 1, 10.18637/jss.v067.i01 · DOI · Paper page
  5. Bentler, 2008, Digital noise reduction: Outcomes from laboratory and field studies, Int. J. Audiol, 47, 447, 10.1080/14992020802033091 · DOI
  6. Cooke, 2012, The intelligibility of Lombard speech for non-native listeners, J. Acoust. Soc. Am, 132, 1120, 10.1121/1.4732062 · doi:10.1121/1.4732062
  7. Cooke, 2016, “The effects of modified speech styles on intelligibility for non-native listeners,”, Proceedings of the Interspeech, 10.21437/Interspeech.2016-41 · doi:10.21437/interspeech.2016-41
  8. Cooke, 2013, Evaluating the intelligibility benefit of speech modifications in known noise conditions, Speech Commun, 55, 572, 10.1016/j.specom.2013.01.001 · DOI
  9. Dawes, 2014, Acclimatization to hearing aids, Ear. Hear, 35, 203, 10.1097/AUD.0b013e3182a8eda4 · doi:10.1097/aud.0b013e3182a8eda4
  10. Dreher, 1957, Effects of ambient noise on speaker intelligibility for words and phrases, J. Acoust. Soc. Am, 29, 1320, 10.1121/1.1908780 · DOI
  11. Gabrielsson, 1988, The effects of different frequency responses on sound quality judgments and speech intelligibility, J. Speech Lang. Hear. Res, 31, 166, 10.1044/jshr.3102.166 · DOI
  12. Gagné, 2017, Behavioral assessment of listening effort using a dual-task paradigm: a review, Trends Hear, 10.1177/2331216516687287 · DOI · Paper page
  13. García Lecumberri, 2010, Non-native speech perception in adverse conditions: a review, Speech Commun, 52, 864, 10.1016/j.specom.2010.08.014 · DOI · Paper page
  14. Govender, “Measuring the cognitive load of synthetic speech using a dual task paradigm,”, Proceedings of the Interspeech, 10.21437/Interspeech.2018-1199 · DOI
  15. Govender, “Using pupillometry to measure the cognitive load of synthetic speech,”, Proceedings of the Interspeech, 10.21437/Interspeech.2018-1174 · DOI
  16. Govender, 2019, “Using pupil dilation to measure cognitive load when listening to text-to-speech in quiet and in noise,”, Proceedings of the Interspeech, pages, 10.21437/Interspeech.2019-1783 · DOI
  17. Hart, 1988, “Development of NASA-TLX (task load index): results of empirical and theoretical research,”, 139
  18. Hickok, 2007, The cortical organization of speech processing, Nat. Rev. Neurosci, 8, 393, 10.1038/nrn2113 · DOI · Paper page
  19. Houben, 2013, Using response time to speech as a measure for listening effort, Int. J. Audiol, 52, 753, 10.3109/14992027.2013.832415 · DOI · Paper page
  20. Kim, 2021, Pre- and post-target cortical processes predict speech-in-noise performance, NeuroImage, 228, 117699, 10.1016/j.neuroimage.2020.117699 · DOI
  21. Kim, 2022, Effect of noise reduction on cortical speech-in-noise processing and its variance due to individual noise tolerance, Ear. Hear, 43, 849, 10.1097/AUD.0000000000001144 · DOI
  22. King, 2011, “The Blizzard Challenge 2011,”, 10.21437/Blizzard.2011-1 · doi:10.21437/blizzard.2011-1
  23. Koch, 2016, Speech rate effects on the processing of conversational speech across the adult life span, J. Acoust. Soc. Am, 139, 1618, 10.1121/1.4944032 · DOI · Paper page
  24. Koelewijn, 2015, The pupil response reveals increased listening effort when it is difficult to focus attention, Hear. Res, 323, 81, 10.1016/j.heares.2015.02.004 · DOI
  25. Koelewijn, 2012, Pupil dilation uncovers extra listening effort in the presence of a single-talker masker, Ear. Hear, 33, 291, 10.1097/AUD.0b013e3182310019 · DOI · Paper page
  26. Koelewijn, 2014, The influence of informational masking on speech perception and pupil response in adults with hearing impairment, J. Acoust. Soc. Am, 135, 1596, 10.1121/1.4863198 · DOI · Paper page
  27. Lam, 2018, Effects of classroom acoustics on speech intelligibility and response time: A comparison between native and non-native listeners, Build. Acoust, 25, 35, 10.1177/1351010X18758477 · DOI · Paper page
  28. Lenth, 2021, EMMEANS: Estimated Marginal Means, aka Least-Squares Means
  29. Lombard, 1911, Le signe de l'elevation de la voix, Ann. Mal. de L' Oreille et du Larynx, 37, 101
  30. Mackersie, 2011, Subjective and psychophysiological indexes of listening effort in a competing-talker task, J. Acoust. Soc. Am, 22, 113, 10.3766/jaaa.22.2.6 · DOI · Paper page
  31. Marcoux, 2022, The Lombard intelligibility benefit of native and non-native speech for native and non-native listeners, Speech Commun, 136, 53, 10.1016/j.specom.2021.11.007 · DOI
  32. Mirman, 2014, Growth Curve Analysis and Visualization Using R
  33. Ohlenforst, Effects of hearing impairment and hearing aid amplification on listening effort: A systematic review, Ear. Hear, 38, 267, 10.1097/AUD.0000000000000396 · DOI · Paper page
  34. Ohlenforst, Impact of stimulus-related factors and hearing impairment on listening effort as indicated by pupil dilation, Hear. Res, 351, 68, 10.1016/j.heares.2017.05.012 · DOI · Paper page
  35. Pearsons, 1977, Speech levels in various noise environments
  36. Pittman, 2001, Recognition of Speech Produced in Noise, J. Speech Lang. Hear. Res, 44, 487, 10.1044/1092-4388(2001/038) · doi:10.1044/1092-4388(2001/038
  37. 2021, R: A Language and Environment for Statistical Computing
  38. Rennies, 2020, “Intelligibility- 2.0,” enhancing speech modifications - the hurricane challenge,”, Proceedings of the Interspeech, 10.21437/Interspeech.2020-1641 · doi:10.21437/interspeech.2020-1641
  39. Rothauser, 1969, IEEE recommended practice for speech quality measurements, IEEE Trans. Audio Electroacoust, 17, 225, 10.1109/TAU.1969.1162058 · DOI · Paper page
  40. Sankowska, 2011, Interaction of intrinsic vowel and consonant durational correlates with foreigner directed speech, Poznań Stud. Contemp. Linguist, 47, 109, 10.2478/psicl-2011-0009 · doi:10.2478/psicl-2011-0009
  41. Sauert, 2009, “Near end listening enhancement optimized with respect to Speech Intelligibility Index,”, 2009 17th European Signal Processing Conference, 1844
  42. Scharenborg, 2018, The effect of background noise on the word activation process in nonnative spoken-word recognition, J. Exp. Psychol. Learn. Mem. Cogn, 44, 233, 10.1037/xlm0000441 · DOI · Paper page
  43. Simantiraki, 2020, “Effects of spectral tilt on listeners' preferences and intelligibility,”, Proceedings of the ICASSP, 10.1109/ICASSP40776.2020.9054117 · doi:10.1109/icassp40776.2020.9054117
  44. Smeds, 2015, Estimation of signal-to-noise ratios in realistic sound scenarios, J. Am. Acad. Audiol, 26, 183, 10.3766/jaaa.26.2.7 · DOI · Paper page
  45. Song, 2018, Listening effort during speech perception enhances auditory and lexical processing for non-native listeners and accents, Cognition, 179, 163, 10.1016/j.cognition.2018.06.001 · DOI · Paper page
  46. Studebaker, 1985, A “rationalized” arcsine transform, J. Speech Lang. Hear. Res, 28, 455, 10.1044/jshr.2803.455 · DOI · Paper page
  47. Summers, 1988, Effects of noise on speech production: Acoustic and perceptual analyses, J. Acoust. Soc. Am, 84, 917, 10.1121/1.396660 · DOI · Paper page
  48. Tang, 2018, A study on the relationship between the intelligibility and quality of algorithmically-modified speech for normal hearing listeners, J. Otorhinolaryngol. Hear. Balance Med, 10.3390/ohbm1010005 · doi:10.3390/ohbm1010005
  49. Tang, 2012, “Optimised spectral weightings for noise-dependent speech intelligibility enhancement,”, Proceedings of the Interspeech 2012, 10.21437/Interspeech.2012-285 · doi:10.21437/interspeech.2012-285
  50. Van Der Meer, 2010, Resource allocation and fluid intelligence: Insights from pupillometry, Psychophysiology, 47, 158, 10.1111/j.1469-8986.2009.00884.x · DOI · Paper page
  51. Venkatagiri, 2003, Segmental intelligibility of four currently used text-to-speech synthesis methods, J. Acoust. Soc. Am, 113, 2095, 10.1121/1.1558356 · DOI
  52. Visentin, 2019, Speech intelligibility and listening effort in university classrooms for native and non-native Italian listeners, Build. Acoust, 26, 275, 10.1177/1351010X19882314 · DOI · Paper page
  53. Wagner, 2015, “How hard can it be to ignore the pan in panda? Effort of lexical competition as measured in pupil dilation,”, 18th ICPhS
  54. Weber, 2004, Lexical competition in non-native spoken-word recognition, J. Mem. Lang, 50, 1, 10.1016/S0749-596X(03)00105-0 · DOI · Paper page
  55. Wendt, 2016, Impact of background noise and sentence complexity on processing demands during sentence comprehension, Front. Psychol, 10.3389/fpsyg.2016.00345 · DOI · Paper page
  56. Winn, 2015, The impact of auditory spectral resolution on listening effort revealed by pupil dilation, Ear. Hear, 36, e153, 10.1097/AUD.0000000000000145 · DOI · Paper page
  57. Winn, 2018, Best practices and advice for using pupillometry to measure listening effort: an introduction for those who want to get started, Trends Hear, 10.1177/2331216518800869 · DOI · Paper page
  58. Wu, 2018, Characteristics of real-world signal to noise ratios and speech listening situations of older adults with mild to moderate hearing loss, Ear. Hear, 10.1097/AUD.0000000000000486 · DOI · Paper page
  59. Wu, 2016, Psychometric functions of dual-task paradigms for measuring listening effort, Ear. Hear, 37, 660, 10.1097/AUD.0000000000000335 · DOI
  60. Yamagishi, 2009, Robust speaker-adaptive HMM-based text-to-speech synthesis, IEEE Trans. Audio Speech Lang. Proc, 17, 1208, 10.1109/TASL.2009.2016394 · DOI · Paper page
  61. Zekveld, 2014, Cognitive processing load across a wide range of listening conditions: Insights from pupillometry, Psychophysiology, 51, 277, 10.1111/psyp.12151 · DOI · Paper page
  62. Zekveld, 2010, Pupil response as an indication of effortful listening: The influence of sentence intelligibility, Ear. Hear, 31, 480, 10.1097/AUD.0b013e3181d4f251 · DOI · Paper page
  63. Zekveld, 2011, Cognitive load during speech perception in noise: the influence of age, hearing loss, and cognition on the pupil response, Ear. Hear, 32, 498, 10.1097/AUD.0b013e31820512bb · DOI · Paper page
  64. Zorila, 2012, “Speech-in-noise intelligibility improvement based on spectral shaping and dynamic range compression,”, Proceedings of the Interspeech, 10.21437/Interspeech.2012-197 · DOI

Metadata

Authors
Simantiraki, O., Wagner, A. E., & Cooke, M.
Venue
Frontiers in Neuroscience
Published
2023-09-28
Volume
17
ISSN
1662-453X
Cited by
7
References
9

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The impact of speech type on listening effort and intelligibility for native and non-native listeners. https://app.cochat.ai/papers/10.3389/fnins.2023.1235911
The paper
Simantiraki, O., Wagner, A. E., & Cooke, M. (2023). The impact of speech type on listening effort and intelligibility for native and non-native listeners. Frontiers in Neuroscience. https://doi.org/10.3389/fnins.2023.1235911

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.