The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 52 sources its claims cite is checked for support yet.
Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety
Open accessAbstract
In second language listening assessment and pedagogy, practitioners hold different views on whether to repeat a listening text in contexts where inferences about listening ability are to be drawn from task performance. To address this issue, we investigated the effects of repeating the listening text (double play) on listener performance, listening strategies, test‐taking strategies, test‐taking anxiety, and listening anxiety. Three hundred six Austrian secondary school students responded to four listening tasks drawn from the Austrian Matura exam and completed questionnaires measuring strategic behavior and anxiety in a counter‐balanced research design. Data were analyzed using many‐facet Rasch measurement (MFRM), factor analysis, and inferential statistics. Findings confirmed that double play led to higher levels of listener performance across two task types (multiple‐choice items and note completion), however, scores were higher in the single play condition compared to the first play of double play. Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test‐taking strategies in double play compared to single play with small effect sizes. We discuss the importance of balancing an empirically derived understanding of the effects of repeating the listening text with considerations of the purpose of an assessment, and the characteristics of the target language use domain.
Overview
CoChat Summary
TL;DR
In 306 Austrian secondary students, double play improved listening performance across four B2 Matura tasks, but single-play scores were higher than first-play scores in the double-play condition. Double play was also associated with lower anxiety and more listening strategy use but fewer test-taking strategies, with small effect sizes.
Key findings
- Double play led to higher listener performance than single play across all four tasks; MFRM bias effects were significant (all t-values > ±2.00) with small effect sizes (MC1 d = −0.36, MC2 d = −0.35, NF1 d = −0.11, NF2 d = −0.32).
- Performance in single play was significantly higher than in the first play of double play; all pairwise t-values exceeded ±2.00 with small effects (MC1 d = −0.26, MC2 d = −0.30, NF1 d = −0.22, NF2 d = −0.14). MC non-responses were 0.7% in single play vs. 31.6% in first play of double play; NF non-responses were 28.8% vs. 28.2%.
- Questionnaire results showed double play was associated with slightly less test-taking strategy use (M = 2.10 vs. 2.18, p = .023, d = 0.13), slightly more listening strategy use (M = 2.02 vs. 1.91, p < .001, d = −0.23), and lower anxiety (M = 3.01 vs. 3.17, p < .001, d = 0.35).
- Test reliability was high (Cronbach’s α = .82 for group 1 and .83 for group 2); questionnaire subscale reliabilities were α = .70 for test-taking strategies, .75 for listening strategies, and .93 for anxiety.
Methods
- 306 Austrian Grade 7 academic upper secondary students (197 female, 109 male; 16 classes, 5 schools, 3 regions; 69.9% aged 16, 26.5% aged 17; 91.2% L1 German) completed four CEFR B2 listening tasks from the Austrian Matura: two multiple-choice and two note-form tasks.
- A counterbalanced design with 16 test versions assigned single play or double play by task format; blue and red pens separated first-play and second-play answers in double play, and questionnaires were administered after each condition.
- Analyses used Classical Test Theory reliability, many-facet Rasch measurement (MFRM) bias analyses with students, items, tasks, and conditions facets, exploratory factor analysis (principal axis factoring with Varimax rotation), and paired samples t-tests.
Limitations
- The paper states that the design did not include conditions where listeners heard the same task type in both single and double play, that intact paper-based classes were used, and that future computer-delivered designs could randomly assign tasks to individual listeners.
- The paper states the sample was specific: participants were accustomed to double play because it is standard in the Austrian school system and Matura, and the Matura represents a particular approach to assessing listening in task types and skills focus.
- Evident from the text: NF2 had a shorter audio file and was more difficult (facility value 43%) than the other tasks, included because few tasks matched the selection criteria; the questionnaire was self-report and most effects were small, with qualitative response-process findings reported elsewhere.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
0 Valid · 3 Not valid · 40 Not checked · 57 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test-taking strategies in double play compared to single play with small effect sizes.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Findings confirmed that double play led to higher levels of listener performance across two task types (multiple-choice items and note completion), however, scores were higher in the single play condition compared to the first play of double play.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test-taking strategies in double play compared to single play with small effect sizes.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test-taking strategies in double play compared to single play with small effect sizes.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Findings confirmed that double play led to higher levels of listener performance across two task types (multiple-choice items and note completion), however, scores were higher in the single play condition compared to the first play of double play.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
29 more claims
Create a free account to see all 100 claims and to verify the 33 references still open.
- It may state two separate claims as one. 36
- The quote only partly states this claim. 3
- Probably not a substantial claim. 41
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > RQ2 and RQ3
“the data for the negatively formulated statements (statements 8-13 and 20-23) were reversed before calculating the mean”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > THE AUTHORS
“the data for positively formulated anxiety statements (7, 24, 25) were reversedcoded to allow for cross-comparisons.”
Citations
Cites
Costello, A. B., & Osborne, J. (2005) · University of Massachusetts Amherst · doi:10.7275/jyj1-4868 · Cited by 10,297
Common European Framework of Reference for Languages: learning, teaching, assessment
Verhelst, N. D., Avermaet, P. V., Takala, S., Figueras, N., & North, B. (2009) · Ghent University Academic Bibliography (Ghent University) · Cited by 6,120
Common European framework of reference for languages: learning, teaching, assessment
Council of Europe (2001) · International Linear Collider · Cited by 5,982
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
(2007) · Cited by 3,005
The Subtle Effects of Language Anxiety on Cognitive Processing in the Second Language
MacIntyre, P. D., & Gardner, R. C. (1994) · Language Learning · doi:10.1111/j.1467-1770.1994.tb01103.x · Cited by 1,823
Cognitive test anxiety and academic performance
Cassady, J. C., & Johnson, R. E. (2002) · Contemporary Educational Psychology · doi:10.1006/ceps.2001.1094 · Cited by 1,315
Measuring Second Language Performance
Kleinsasser, R. C., & McNamara, T. (1998) · The Modern Language Journal · doi:10.2307/330236 · Cited by 1,253
Online Education and Its Effective Practice: A Research Review
Sun, A., & Chen, X. (2016) · Journal of Information Technology Education: Research · doi:10.28945/3502 · Cited by 908
Teaching L2 Learners How to Listen Does Make a Difference: An Empirical Study
Vandergrift, L., & Tafaghodtari, M. H. (2010) · Language Learning · doi:10.1111/j.1467-9922.2009.00559.x · Cited by 666
Research works printed but not linked: 7
- Council of Europe, 2009, Manual for relating language examinations to the common European framework of reference for languages (CEFR)
- Field J., 2013, Examining listening, 77
- Fortune A. J., 2004, Testing listening comprehension in a foreign language – Does the number of times a text is heard affect performance?
- Jones G., 2011, Research summary: Once or twice? A critical review of current literature on the question how many times the audio recording should be played in listening comprehension testing items
- 10.17936/pkelt.2017.29.2.2 · doi:10.17936/pkelt.2017.29.2.2
- Pallant J., 2007, SPSS survival manual
- Spöttl C., 2018, Language testing in Austria: Taking stock (Sprachtesten in Österreich: Eine Bestandsaufnahme), 219
Cited by
Teaching and Researching Listening
Rost, M. (2024) · Routledge eBooks · doi:10.4324/9781003390794 · Cited by 75
Hwang, G., Rahimi, M., & Fathi, J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2534067 · Cited by 8
Metacognitive Strategies in Learning English: A Think-Aloud Protocol in Completing Grammar Tasks
Lat, M. E. M., & Yumarnamto, M. (2025) · INTERNATIONAL JOURNAL OF LANGUAGE TEACHING AND EDUCATION · doi:10.22437/ijolte.v9i1.44317 · Cited by 5
Review of the Canadian English Language Proficiency Index Program (CELPIP)
Qin, C. Y., & Baker, B. A. (2024) · Language Testing · doi:10.1177/02655322241291764 · Cited by 5
Kormos, J., Eberharter, K., Guggenbichler, E., Baumgartinger, S., Ebner, V., & Kremmel, B. (2024) · Language Assessment Quarterly · doi:10.1080/15434303.2024.2435811 · Cited by 4
Metadata
- Authors
- Holzknecht, F., & Harding, L.
- Affiliations
- University of Teacher Education in Special Needs (CH)
- Lancaster University (GB)
- Corresponding author
- Harding, Luke
- Venue
- TESOL Quarterly
- Publisher
- Wiley
- Published
- 2023-08-01
- Volume
- 58
- Issue
- 1
- Pages
- 451-478
- ISSN
- 0039-8322 (ISSN-L)
- 1545-7249
- OpenAlex
- W4385460248
- Cited by
- 18
- References
- 50
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 5
- FWCI
- 8.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (vor)
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- Locations
- TESOL Quarterly (publishedVersion, cc-by)
- Lancaster EPrints (Lancaster University) (acceptedVersion, public-domain)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Arts and Humanities › Language and Linguistics › Subtitles and Audiovisual Media
- Keywords
- double play, second language listening, listening comprehension, listening strategies, metacognitive strategy use, test-taking strategies, test anxiety, listening anxiety, listening assessment, Matura exam, high school students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.