CoChat

The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 52 sources its claims cite is checked for support yet.

Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety

Open access
Holzknecht, Franz, Harding, Luke · 2024 · TESOL Quarterly

Abstract

In second language listening assessment and pedagogy, practitioners hold different views on whether to repeat a listening text in contexts where inferences about listening ability are to be drawn from task performance. To address this issue, we investigated the effects of repeating the listening text (double play) on listener performance, listening strategies, test‐taking strategies, test‐taking anxiety, and listening anxiety. Three hundred six Austrian secondary school students responded to four listening tasks drawn from the Austrian Matura exam and completed questionnaires measuring strategic behavior and anxiety in a counter‐balanced research design. Data were analyzed using many‐facet Rasch measurement (MFRM), factor analysis, and inferential statistics. Findings confirmed that double play led to higher levels of listener performance across two task types (multiple‐choice items and note completion), however, scores were higher in the single play condition compared to the first play of double play. Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test‐taking strategies in double play compared to single play with small effect sizes. We discuss the importance of balancing an empirically derived understanding of the effects of repeating the listening text with considerations of the purpose of an assessment, and the characteristics of the target language use domain.

Overview

CoChat Summary

TL;DR

In 306 Austrian secondary students, double play improved listening performance across four B2 Matura tasks, but single-play scores were higher than first-play scores in the double-play condition. Double play was also associated with lower anxiety and more listening strategy use but fewer test-taking strategies, with small effect sizes.

Key findings

  • Double play led to higher listener performance than single play across all four tasks; MFRM bias effects were significant (all t-values > ±2.00) with small effect sizes (MC1 d = −0.36, MC2 d = −0.35, NF1 d = −0.11, NF2 d = −0.32).
  • Performance in single play was significantly higher than in the first play of double play; all pairwise t-values exceeded ±2.00 with small effects (MC1 d = −0.26, MC2 d = −0.30, NF1 d = −0.22, NF2 d = −0.14). MC non-responses were 0.7% in single play vs. 31.6% in first play of double play; NF non-responses were 28.8% vs. 28.2%.
  • Questionnaire results showed double play was associated with slightly less test-taking strategy use (M = 2.10 vs. 2.18, p = .023, d = 0.13), slightly more listening strategy use (M = 2.02 vs. 1.91, p < .001, d = −0.23), and lower anxiety (M = 3.01 vs. 3.17, p < .001, d = 0.35).
  • Test reliability was high (Cronbach’s α = .82 for group 1 and .83 for group 2); questionnaire subscale reliabilities were α = .70 for test-taking strategies, .75 for listening strategies, and .93 for anxiety.

Methods

  • 306 Austrian Grade 7 academic upper secondary students (197 female, 109 male; 16 classes, 5 schools, 3 regions; 69.9% aged 16, 26.5% aged 17; 91.2% L1 German) completed four CEFR B2 listening tasks from the Austrian Matura: two multiple-choice and two note-form tasks.
  • A counterbalanced design with 16 test versions assigned single play or double play by task format; blue and red pens separated first-play and second-play answers in double play, and questionnaires were administered after each condition.
  • Analyses used Classical Test Theory reliability, many-facet Rasch measurement (MFRM) bias analyses with students, items, tasks, and conditions facets, exploratory factor analysis (principal axis factoring with Varimax rotation), and paired samples t-tests.

Limitations

  • The paper states that the design did not include conditions where listeners heard the same task type in both single and double play, that intact paper-based classes were used, and that future computer-delivered designs could randomly assign tasks to individual listeners.
  • The paper states the sample was specific: participants were accustomed to double play because it is standard in the Austrian school system and Matura, and the Matura represents a particular approach to assessing listening in task types and skills focus.
  • Evident from the text: NF2 had a shorter audio file and was more difficult (facility value 43%) than the other tasks, included because few tasks matched the selection criteria; the questionnaire was self-report and most effects were small, with qualitative response-process findings reported elsewhere.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1002/tesq.3249

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

FIGURE 1 Wright maps of the MFRM analyses (Tasks and Conditions were dummy facets and thus anchored at 0 logits, so they are not displayed in the Wright maps).
FIGURE 1 Wright maps of the MFRM analyses (Tasks and Conditions were dummy facets and thus anchored at 0 logits, so they are not displayed in the Wright maps).CC-BY · From the PDF
FIGURE 2 Facets bias analysis and associated t -values between single play and double play across the four tasks.
FIGURE 2 Facets bias analysis and associated t -values between single play and double play across the four tasks.CC-BY · From the PDF
FIGURE 3 Facets bias analysis and associated t-values between the first play in double play and single play across the four tasks.
FIGURE 3 Facets bias analysis and associated t-values between the first play in double play and single play across the four tasks.CC-BY · From the PDF

Verification

Claims the paper makes

0 Valid · 3 Not valid · 40 Not checked · 57 Own results and interpretations

29 more claims

Create a free account to see all 100 claims and to verify the 33 references still open.

See all claims — free account
  • It may state two separate claims as one. 36
  • The quote only partly states this claim. 3
  • Probably not a substantial claim. 41

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Research works printed but not linked: 7

  1. Council of Europe, 2009, Manual for relating language examinations to the common European framework of reference for languages (CEFR)
  2. Field J., 2013, Examining listening, 77
  3. Fortune A. J., 2004, Testing listening comprehension in a foreign language – Does the number of times a text is heard affect performance?
  4. Jones G., 2011, Research summary: Once or twice? A critical review of current literature on the question how many times the audio recording should be played in listening comprehension testing items
  5. 10.17936/pkelt.2017.29.2.2 · doi:10.17936/pkelt.2017.29.2.2
  6. Pallant J., 2007, SPSS survival manual
  7. Spöttl C., 2018, Language testing in Austria: Taking stock (Sprachtesten in Österreich: Eine Bestandsaufnahme), 219

Cited by

See all 18

Metadata

Authors
Holzknecht, F., & Harding, L.
Affiliations
  • University of Teacher Education in Special Needs (CH)
  • Lancaster University (GB)
Corresponding author
Harding, Luke
Venue
TESOL Quarterly
Publisher
Wiley
Published
2023-08-01
Volume
58
Issue
1
Pages
451-478
ISSN
  • 0039-8322 (ISSN-L)
  • 1545-7249
OpenAlex
W4385460248
Cited by
18
References
50
Citations by year
2026: 5 · 2025: 8 · 2024: 5
FWCI
8.33
Type
journal article
Language
en
Open access
Licence
Locations
  • TESOL Quarterly (publishedVersion, cc-by)
  • Lancaster EPrints (Lancaster University) (acceptedVersion, public-domain)
Topics
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
  • Social Sciences › Arts and Humanities › Language and Linguistics › Subtitles and Audiovisual Media
Keywords
double play, second language listening, listening comprehension, listening strategies, metacognitive strategy use, test-taking strategies, test anxiety, listening anxiety, listening assessment, Matura exam, high school students

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.