The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Investigating the Reliability of Pupillometry as a Measure of Individualized Listening Effort
Abstract
Recordings of the pupillary response have been used in numerous studies to assess listening effort during a speech-in-noise task. Most studies focused on averaged responses across listeners, whereas less is known about pupil dilation as an indicator of the individuals’ listening effort. The present study investigated the reliability of several pupil features as potential indicators of individual listening effort and the impact of different normalization procedures on the reliability. The pupil diameters of 31 normal-hearing listeners were recorded during multiple visits while performing a speech-in-noise task. The signal-to-noise ratios (SNRs) of the stimuli ranged from [Formula: see text]12 dB to [Formula: see text]4 dB. All listeners were measured twice at separate visits, and 11 were re-tested at a third visit. To examine the reliability of the pupil responses across visits, the intraclass correlation coefficient was applied to the peak and mean pupil dilation and to the temporal features of the pupil response, extracted using growth curve analysis. The reliability of the pupillary response was assessed in relation to SNR and different normalization procedures over multiple visits. The most reliable pupil features were the traditional mean and peak pupil dilation. The highest reliability results were obtained when the data were baseline-corrected and normalized to the individual pupil response range across all visits. Moreover, the present study results showed only a minor impact of the SNR and the number of visits on the reliability of the pupil response. Overall, the results may provide an important basis for developing a standardized test for pupillometry in the clinic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another body of research has shown that degradation of the speech signal itself can result in larger pupil dilation responses (e.g., Colby & McMurray, 2021;McGarrigle et al., 2017;Neagu et al., 2023;Winn et al., 2015;Zekveld et al., 2010).”
From Listening Effort Across Non-Native and Regional Accents: A Pupillometry Study (2025) · cites this paper as Neagu et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Task-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959 · cited 2×
“…while some studies argued that the normalization of task-evoked changes in pupil size should be done independently of the baseline pupil size (Beatty, 1982; Bradshaw, 1969), others stated that different ways of baseline scaling could produce disparities in the reported pupil size results…”
ResultHearing Impairment and Cognitive Energy: The Framework for Understanding Effortful Listening (FUEL)
Pichora-Fuller, M. K., Kramer, S. E., Eckert, M. A., Edwards, B., Hornsby, B. W. Y., Humes, L. E., Lemke, U., Lunner, T., Matthen, M., Mackersie, C. L., et al. (2016) · Ear & Hearing · doi:10.1097/aud.0000000000000312 · Cited by 1,318
Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex
Reimer, J., McGinley, M. J., Liu, Y., Rodenkirch, C., Wang, Q., McCormick, D. A., & Tolias, A. S. (2016) · Nature Communications · doi:10.1038/ncomms13289 · Cited by 926 · cited 1×
“Reimer et al. (2016) suggested that nonluminance-related 1Department of Health Technology, DTU Hearing Systems, Denmark 2Copenhagen Hearing and Balance Centre, Rigshospitalet, Copenhagen University Hospital, Denmark 3Department of Applied Mathematics and Computer Science, DTU Cognitive systems,…”
BackgroundPupil size variation as an indication of affective processing
Partala, T., & Surakka, V. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00017-x · Cited by 836 · cited 1×
“The transition from pupillometry assessed on a group level to an individual listener level is challenging because the pupil response has numerous sources of variation (Zekveld et al., 2011, 2018; Koelewijn et al., 2012; Wang et al., 2018; Partala & Surakka, 2003).”
BackgroundMcGarrigle, R., Munro, K. J., Dawes, P., Stewart, A. J., Moore, D. R., Barry, J. G., & Amitay, S. (2014) · International Journal of Audiology · doi:10.3109/14992027.2014.890296 · Cited by 532 · cited 1×
“Several studies examined the impact of the level of speech intelligibility, signal-to-noise-ratio (SNR), linguistic complexity and hearing-aid signal processing on listening effort (Zekveld et al., 2011; Kuchinsky et al., 2013, 2014; McGarrigle et al., 2014; Winn, 2016; Wendt et al., 2018).”
BackgroundDuchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., Kiefer, P., Raubal, M., & Giannopoulos, I. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173856 · Cited by 228
Borghini, G., & Hazan, V. (2020) · The Journal of the Acoustical Society of America · doi:10.1121/10.0001126 · Cited by 44
Research works printed but not linked: 52
- 10.1007/s10339-018-0886-1 · DOI
- 10.1523/JNEUROSCI.3010-18.2019 · DOI
- 10.1097/AUD.0000000000000697 · DOI · Paper page
- 10.1146/annurev.neuro.28.061604.135709 · DOI · Paper page
- 10.3758/BF03329118 · DOI
- 10.17265/2159-5313/2016.09.003 · DOI · Paper page
- 10.1007/s10286-009-0515-2 · DOI
- 10.1038/nn.2682 · DOI · Paper page
- 10.1037/1040-3590.6.4.284 · DOI · Paper page
- Daguet I., 2019, Frontiers in Neurology, 10, 10.3389/fneur.2019.00108 · DOI
- 10.1097/AUD.0000000000000028 · DOI · Paper page
- 10.1016/j.dcn.2016.11.001 · DOI · Paper page
- 10.1037/0882-7974.12.3.479 · doi:10.1037/0882-7974.12.3.479 · Paper page
- 10.1002/wcs.1514 · DOI
- Giuliani N. P., Brown C. J., Wu Y. H. (2020). Comparisons of the Sensitivity and Reliability of Multiple Measures of Listening Effort. Ear & Hearing Publish Ah: 1–10. https://doi.org/10.1097/AUD.0000000000000950. https://journals.lww.com/10.1097/AUD.0000000000000950. · DOI
- 10.1177/2331216520967850 · DOI
- 10.1080/14992027.2018.1432901 · DOI
- 10.1097/AUD.0b013e31828003d8 · DOI · Paper page
- 10.1044/2015_AJA-14-0058 · DOI
- 10.1016/S0079-6123(03)45011-5 · DOI · Paper page
- Kahneman D. (1973). Attention and effort . Citesser. ISBN 0-13-050518-8. https://doi.org/10.1.1.398.5285. https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.398.5285.
- 10.1155/2012/865731 · DOI
- 10.3109/00206099709071969 · DOI · Paper page
- 10.1371/journal.pone.0203629 · DOI · Paper page
- 10.1111/psyp.12242 · DOI
- 10.1111/j.1469-8986.2012.01477.x · DOI · Paper page
- 10.1080/0361073X.2016.1108712 · DOI
- 10.1016/j.neuron.2012.09.012 · DOI · Paper page
- Loewenfeld I. E., 1993, The pupil: Anatomy, physiology, and clinical applications, 2
- 10.3758/s13428-017-1007-2 · DOI · Paper page
- MATLAB, 2018, 9.7.0.1190202 (R2019b)
- 10.1093/acrefore/9780190264086.013.276 · doi:10.1093/acrefore/9780190264086.013.276
- 10.1121/1.4943787 · DOI
- 10.1016/j.jml.2007.11.006 · DOI · Paper page
- 10.3109/14992027.2010.524254 · DOI
- 10.1016/j.heares.2017.05.012 · DOI · Paper page
- 10.1111/j.1469-8986.2009.00947.x · DOI · Paper page
- 10.3758/s13428-018-1134-4 · DOI
- 10.1044/2018_JSLHR-H-17-0257 · DOI · Paper page
- 10.1037/a0014802 · DOI · Paper page
- 10.1177/2331216518816603 · DOI
- Wang Y., 2016, PLoS ONE, 11, 1
- 10.1097/AUD.0000000000000454 · DOI · Paper page
- 10.1016/j.heares.2018.05.006 · DOI · Paper page
- 10.1016/j.biopsycho.2018.01.010 · DOI
- 10.1177/2331216516669723 · DOI · Paper page
- 10.1097/AUD.0000000000000145 · DOI · Paper page
- 10.1177/2331216518800869 · DOI · Paper page
- 10.1177/2331216518777174 · DOI · Paper page
- 10.1097/AUD.0b013e3181d4f251 · DOI · Paper page
- 10.1097/AUD.0b013e31820512bb · DOI · Paper page
- 10.1093/sleep/11.6.562 · DOI
Cited by
Listening Effort Across Non-Native and Regional Accents: A Pupillometry Study
Barnard, M., Kunkel, S., Lamarque, R., & Chong, A. J. (2025) · Language and Speech · doi:10.1177/00238309251389573 · Cited by 2
Metadata
- Authors
- Neagu, M.-B., Kressner, A. A., Relaño-Iborra, H., Bækgaard, P., Dau, T., & Wendt, D.
- Affiliations
- Department of Health Technology, DTU Hearing Systems, Denmark
- Department of Applied Mathematics and Computer Science, DTU Cognitive systems, Denmark
- Venue
- Trends in Hearing
- Publisher
- SAGE Publications
- Published
- 2023-01
- Volume
- 27
- ISSN
- 2331-2165
- Cited by
- 28
- References
- 9
- Language
- en
- Funders
- William Demant Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating the Reliability of Pupillometry as a Measure of Individualized Listening Effort. https://app.cochat.ai/papers/10.1177/23312165231153288
- The paper
- Neagu, M.-B., Kressner, A. A., Relaño-Iborra, H., Bækgaard, P., Dau, T., & Wendt, D. (2023). Investigating the Reliability of Pupillometry as a Measure of Individualized Listening Effort. Trends in Hearing. https://doi.org/10.1177/23312165231153288
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.