CoChat

The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index; none of the 67 sources its claims cite is checked for support yet.

Effortful listening under the microscope: Examining relations between pupillometric and subjective markers of effort and tiredness from listening

Open access
McGarrigle, Ronan, Rakusen, Lyndon, Mattys, Sven · 2021 · Psychophysiology

Abstract

Effort during listening is commonly measured using the task‐evoked pupil response (TEPR); a pupillometric marker of physiological arousal. However, studies to date report no association between TEPR and perceived effort. One possible reason for this is the way in which self‐report effort measures are typically administered, namely as a single data point collected at the end of a testing session. Another possible reason is that TEPR might relate more closely to the experience of tiredness from listening than to effort per se. To examine these possibilities, we conducted two preregistered experiments that recorded subjective ratings of effort and tiredness from listening at multiple time points and examined their covariance with TEPR over the course of listening tasks varying in levels of acoustic and attentional demand. In both experiments, we showed a within‐subject association between TEPR and tiredness from listening, but no association between TEPR and effort. The data also suggest that the effect of task difficulty on the experience of tiredness from listening may go undetected using the traditional approach of collecting a single data point at the end of a listening block. Finally, this study demonstrates the utility of a novel correlation analysis technique (“rmcorr”), which can be used to overcome statistical power constraints commonly found in the literature. Teasing apart the subjective and physiological mechanisms that underpin effortful listening is a crucial step toward addressing these difficulties in older and/or hearing‐impaired individuals.

Overview

CoChat Summary

TL;DR

Across two preregistered experiments, task-evoked pupil response (TEPR) tracked within-subject changes in tiredness from listening but not subjective effort. The authors argue TEPR may be a physiological marker of listening-related tiredness/arousal rather than effort per se.

Key findings

  • In Experiment 1, TEPR was larger in the hard than easy condition (hard M = 154.94, SE = 25.79; easy M = 77.06, SE = 19.98; F(1,27) = 30.51, p < .001, partial η² = 0.53), and TEPR decreased over time (F(1,27) = 39.82, p < .001, partial η² = 0.60).
  • Subjective effort and tiredness from listening were higher in the hard than easy condition in Experiment 1: effort hard M = 66.49, SE = 2.23 vs. easy M = 32.28, SE = 2.49, F(1,27) = 196.78, p < .001, partial η² = 0.88; tiredness hard M = 16.85, SE = 2.69 vs. easy M = 7.07, SE = 2.77, F(1,27) = 5.35, p = .03, partial η² = 0.17.
  • Rmcorr showed a negative within-subject association between TEPR and tiredness from listening in Experiment 1 (r = −.40, 95% CI [−.53, −.25]) and Experiment 2 (r = −.48, 95% CI [−.63, −.31]), but no association between TEPR and effort in either experiment (Exp 1 r = .03, 95% CI [−.14, .19]; Exp 2 r = .03, 95% CI [−.18, .23]).
  • In Experiment 2, TEPR decreased over time (F(1,18) = 35.54, p < .001, partial η² = 0.66) and tiredness from listening increased over time (F(1,19) = 77.61, p < .001, partial η² = 0.80), while effort ratings showed no linear change over time (F(1,19) = 0.65, p = .43, partial η² = 0.03).

Methods

  • Two preregistered experiments used speech recognition with IEEE sentences in a competing female-talker masker. Experiment 1 included 28 young adults (5 male), aged 18–30, with normal hearing; participants completed easy and hard SNR blocks (hard mean adapted SNR = −9.5 dB, SD = 1.75; easy = hard + 10 dB). Experiment 2 included 20 healthy young adults (2 male), aged 18–30, who completed one hard condition only (mean adapted SNR = −8.6 dB, SD = 1.88) over 120 trials lasting approximately 35–40 min.
  • Pupil size was recorded with EyeLink 1000 Plus at 250 Hz; TEPR was baseline-corrected using the 2-s masker preceding target onset and calculated as relative change during the 3-s window after target speech onset.
  • Subjective effort, tiredness from listening, and performance evaluation were collected repeatedly during listening. Analyses included repeated-measures ANOVAs, standard Pearson/Spearman correlations, and repeated-measures correlation (“rmcorr”) to examine within-subject associations.

Limitations

  • The paper states that of 48 participants, only seven were male, so sex-related differences cannot be ruled out; it advocates a more balanced sex ratio in future research.
  • The paper states that causality cannot be inferred from these correlational findings, and notes at least two possible causal interpretations for the negative TEPR–tiredness association.
  • The text makes evident that both experiments used young, normal-hearing adults, so findings may not generalize to older and/or hearing-impaired individuals; Experiment 1’s rmcorr analyses were also not preregistered and were treated as exploratory.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1111/psyp.13703

Cites

60 of 60 references verified0 citation errors · 0 not checkable

Statistics

Figures

4 The rmcorr analysis method was not preregistered prior to Experiment 1 data collection and so results therein are treated as exploratory. FIGURE 1 Left panel: Mean % correct speech recognition performance for each condition and block. Right panel: Mean TEPR for each condition and block. Error bars represent the standard error of the mean, SE
4 The rmcorr analysis method was not preregistered prior to Experiment 1 data collection and so results therein are treated as exploratory. FIGURE 1 Left panel: Mean % correct speech recognition performance for each condition and block. Right panel: Mean TEPR for each condition and block. Error bars represent the standard error of the mean, SECC-BY · From the PDF
FIGURE 2 Mean baseline-corrected task-evoked pupil response (TEPR; in arbitrary units representing number of thresholded pixels) in the easy and hard conditions. Error bars represent the standard error of the mean, SE . Vertical dotted lines represent the beginning and end of the TEPR interval
FIGURE 2 Mean baseline-corrected task-evoked pupil response (TEPR; in arbitrary units representing number of thresholded pixels) in the easy and hard conditions. Error bars represent the standard error of the mean, SE . Vertical dotted lines represent the beginning and end of the TEPR intervalCC-BY · From the PDF
FIGURE 3 Mean subjective ratings (0-100 scale) for the easy and hard conditions as a function of block. Tiredness from listening ratings were calculated as the relative change from a baseline recorded at the beginning of block 1. Error bars represent the standard error of the mean, SE
FIGURE 3 Mean subjective ratings (0-100 scale) for the easy and hard conditions as a function of block. Tiredness from listening ratings were calculated as the relative change from a baseline recorded at the beginning of block 1. Error bars represent the standard error of the mean, SECC-BY · From the PDF
Image 4
CC-BY · From the PDF
FIGURE 4 Left panel: Mean % correct speech recognition performance accuracy as a function of block. Right panel: Overall mean taskevoked pupil response (TEPR; in arbitrary units representing number of thresholded pixels) as a function of block. Error bars represent the standard error of the mean, SE
FIGURE 4 Left panel: Mean % correct speech recognition performance accuracy as a function of block. Right panel: Overall mean taskevoked pupil response (TEPR; in arbitrary units representing number of thresholded pixels) as a function of block. Error bars represent the standard error of the mean, SECC-BY · From the PDF
Image 6
CC-BY · From the PDF
FIGURE 5 Mean subjective rating scores as a function of block. Rating scores on the y axis ranged from 0 to 100. Tiredness from listening rating scores were calculated as the relative change from a baseline recorded at the beginning of block 1. Error bars represent the standard error of the mean, SE
FIGURE 5 Mean subjective rating scores as a function of block. Rating scores on the y axis ranged from 0 to 100. Tiredness from listening rating scores were calculated as the relative change from a baseline recorded at the beginning of block 1. Error bars represent the standard error of the mean, SECC-BY · From the PDF
FIGURE 6 Rmcorr scatterplots showing within-subject associations between TEPR, effort ratings, tiredness from listening ratings (reported as a change from baseline), and performance evaluation ratings. Observations from a given participant are plotted in the same color, with corresponding lines showing the rmcorr fit (i.e., the common regression slope) imposed on each participant's raw data. A single data point represents the aggregate mean value for each subject on each of the six blocks. Mean data aggregation was performed over the following trials: (1) TEPR; 20 trials within each block, (2) Effort and Performance evaluation ratings; four ratings recorded after every five trials within each block, and (3) Tiredness from listening rating; a single self-report rating value at the end of each block of 20 trials
FIGURE 6 Rmcorr scatterplots showing within-subject associations between TEPR, effort ratings, tiredness from listening ratings (reported as a change from baseline), and performance evaluation ratings. Observations from a given participant are plotted in the same color, with corresponding lines showing the rmcorr fit (i.e., the common regression slope) imposed on each participant's raw data. A single data point represents the aggregate mean value for each subject on each of the six blocks. Mean data aggregation was performed over the following trials: (1) TEPR; 20 trials within each block, (2) Effort and Performance evaluation ratings; four ratings recorded after every five trials within each block, and (3) Tiredness from listening rating; a single self-report rating value at the end of each block of 20 trialsCC-BY · From the PDF
Image 9
CC-BY · From the PDF
FIGURE 7 Hypothetical schematic diagram of within-subject change over time during a sustained effortful listening task for perceived effort, performance evaluation, task-evoked pupil response (TEPR), and perceived tiredness from listening. Perceived effort is relatively high (and performance evaluation relatively low) on the y axis to reflect the fixed (high) level of listening demand. Both display a similar rate of change over time, with perceived effort increases coinciding with reduced performance evaluation ratings. On the contrary, TEPR starts high (and tiredness from listening low) on the y axis to reflect early heightened levels of task engagement and arousal and the fact that fatigue has not yet started to accumulate. Both TEPR and tiredness then show a similarly steep rate of change over time (albeit in opposite directions), to reflect the more pronounced cumulative effect of time-on-task on both TEPR and tiredness from listening
FIGURE 7 Hypothetical schematic diagram of within-subject change over time during a sustained effortful listening task for perceived effort, performance evaluation, task-evoked pupil response (TEPR), and perceived tiredness from listening. Perceived effort is relatively high (and performance evaluation relatively low) on the y axis to reflect the fixed (high) level of listening demand. Both display a similar rate of change over time, with perceived effort increases coinciding with reduced performance evaluation ratings. On the contrary, TEPR starts high (and tiredness from listening low) on the y axis to reflect early heightened levels of task engagement and arousal and the fact that fatigue has not yet started to accumulate. Both TEPR and tiredness then show a similarly steep rate of change over time (albeit in opposite directions), to reflect the more pronounced cumulative effect of time-on-task on both TEPR and tiredness from listeningCC-BY · From the PDF
Image 11
CC-BY · From the PDF

Verification

Claims the paper makes

0 Valid · 1 Not valid · 52 Not checked · 131 Own results and interpretations

105 more claims

Create a free account to see all 184 claims and to verify the 55 references still open.

See all claims — free account
  • It may state two separate claims as one. 43
  • Probably not a substantial claim. 37
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • ConsistentF(1, 27) = 213.95reported p < .001 · recomputed p < .001

    “F (1,27) = 213.95,p < .001”

  • ConsistentF(1, 27) = 29.6reported p < .001 · recomputed p < .001

    “F (1,27) = 29.60,p < .001”

  • ConsistentF(1, 27) = 2.64reported p = .12 · recomputed p = .116

    “F (1,27) = 2.64, p = .12”

  • ConsistentF(1, 27) = 30.51reported p < .001 · recomputed p < .001

    “F (1,27) = 30.51,p < .001”

  • ConsistentF(1, 27) = 39.82reported p < .001 · recomputed p < .001

    “F (1,27) = 39.82,p < .001”

5 of 19 · the rest aren’t loaded

14 more recomputed tests

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Research works printed but not linked: 3

  1. Hart S. G., 1988, Advances in psychology, 139
  2. Nike, 2020, Speech in noise mixing, signal to noise ratio
  3. RStudio Team, 2019, RStudio: Integrated Development for R

Cited by

See all 43

Metadata

Authors
McGarrigle, R., Rakusen, L., & Mattys, S.
Affiliations
University of York (GB)
Corresponding author
McGarrigle, Ronan
Venue
Psychophysiology
Publisher
Wiley
Published
2020-10-08
Volume
58
Issue
1
Pages
e13703-e13703
ISSN
  • 0048-5772 (ISSN-L)
  • 1469-8986
OpenAlex
W3092441470
Cited by
43
References
60
Citations by year
2026: 1 · 2025: 8 · 2024: 8 · 2023: 14 · 2022: 5 · 2021: 7
FWCI
5.83
Type
journal article
Language
en
Open access
Locations
  • Psychophysiology (publishedVersion, cc-by)
  • PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
  • PubMed (publishedVersion)
  • White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (submittedVersion)
  • PsyArXiv (OSF Preprints) (submittedVersion)
Funders
Economic and Social Research Council (ES/R003572/1)
Topics
  • Health Sciences › Health Professions › Speech and Hearing › Hearing Loss and Rehabilitation
  • Life Sciences › Neuroscience › Sensory Systems › Hearing, Cochlea, Tinnitus, Genetics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
Keywords
listening effort, pupillometry, perceived effort, task difficulty, attentional demands, statistical power, older adults, hearing-impaired listeners
MeSH terms
Adolescent, Adult, Attention, Female, Humans, Male, Pupil, Speech Acoustics, Speech Perception, Recognition, Psychology, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.