The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 52 sources its claims cite is checked for support yet.
Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety
Open accessAbstract
In second language listening assessment and pedagogy, practitioners hold different views on whether to repeat a listening text in contexts where inferences about listening ability are to be drawn from task performance. To address this issue, we investigated the effects of repeating the listening text (double play) on listener performance, listening strategies, test‐taking strategies, test‐taking anxiety, and listening anxiety. Three hundred six Austrian secondary school students responded to four listening tasks drawn from the Austrian Matura exam and completed questionnaires measuring strategic behavior and anxiety in a counter‐balanced research design. Data were analyzed using many‐facet Rasch measurement (MFRM), factor analysis, and inferential statistics. Findings confirmed that double play led to higher levels of listener performance across two task types (multiple‐choice items and note completion), however, scores were higher in the single play condition compared to the first play of double play. Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test‐taking strategies in double play compared to single play with small effect sizes. We discuss the importance of balancing an empirically derived understanding of the effects of repeating the listening text with considerations of the purpose of an assessment, and the characteristics of the target language use domain.
Overview
CoChat Summary
TL;DR
In 306 Austrian secondary students, double play improved listening performance across four B2 Matura tasks, but single-play scores were higher than first-play scores in the double-play condition. Double play was also associated with lower anxiety and more listening strategy use but fewer test-taking strategies, with small effect sizes.
Key findings
- Double play led to higher listener performance than single play across all four tasks; MFRM bias effects were significant (all t-values > ±2.00) with small effect sizes (MC1 d = −0.36, MC2 d = −0.35, NF1 d = −0.11, NF2 d = −0.32).
- Performance in single play was significantly higher than in the first play of double play; all pairwise t-values exceeded ±2.00 with small effects (MC1 d = −0.26, MC2 d = −0.30, NF1 d = −0.22, NF2 d = −0.14). MC non-responses were 0.7% in single play vs. 31.6% in first play of double play; NF non-responses were 28.8% vs. 28.2%.
- Questionnaire results showed double play was associated with slightly less test-taking strategy use (M = 2.10 vs. 2.18, p = .023, d = 0.13), slightly more listening strategy use (M = 2.02 vs. 1.91, p < .001, d = −0.23), and lower anxiety (M = 3.01 vs. 3.17, p < .001, d = 0.35).
- Test reliability was high (Cronbach’s α = .82 for group 1 and .83 for group 2); questionnaire subscale reliabilities were α = .70 for test-taking strategies, .75 for listening strategies, and .93 for anxiety.
Methods
- 306 Austrian Grade 7 academic upper secondary students (197 female, 109 male; 16 classes, 5 schools, 3 regions; 69.9% aged 16, 26.5% aged 17; 91.2% L1 German) completed four CEFR B2 listening tasks from the Austrian Matura: two multiple-choice and two note-form tasks.
- A counterbalanced design with 16 test versions assigned single play or double play by task format; blue and red pens separated first-play and second-play answers in double play, and questionnaires were administered after each condition.
- Analyses used Classical Test Theory reliability, many-facet Rasch measurement (MFRM) bias analyses with students, items, tasks, and conditions facets, exploratory factor analysis (principal axis factoring with Varimax rotation), and paired samples t-tests.
Limitations
- The paper states that the design did not include conditions where listeners heard the same task type in both single and double play, that intact paper-based classes were used, and that future computer-delivered designs could randomly assign tasks to individual listeners.
- The paper states the sample was specific: participants were accustomed to double play because it is standard in the Austrian school system and Matura, and the Matura represents a particular approach to assessing listening in task types and skills focus.
- Evident from the text: NF2 had a shorter audio file and was more difficult (facility value 43%) than the other tasks, included because few tasks matched the selection criteria; the questionnaire was self-report and most effects were small, with qualitative response-process findings reported elsewhere.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
0 Valid · 3 Not valid · 40 Not checked · 57 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test-taking strategies in double play compared to single play with small effect sizes.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Findings confirmed that double play led to higher levels of listener performance across two task types (multiple-choice items and note completion), however, scores were higher in the single play condition compared to the first play of double play.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test-taking strategies in double play compared to single play with small effect sizes.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students also reported lower levels of anxiety, and the use of more listening strategies and fewer test-taking strategies in double play compared to single play with small effect sizes.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Findings confirmed that double play led to higher levels of listener performance across two task types (multiple-choice items and note completion), however, scores were higher in the single play condition compared to the first play of double play.”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > Abstract
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
29 more claims
Create a free account to see all 100 claims and to verify the 33 references still open.
- It may state two separate claims as one. 36
- The quote only partly states this claim. 3
- Probably not a substantial claim. 41
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > RQ2 and RQ3
“the data for the negatively formulated statements (statements 8-13 and 20-23) were reversed before calculating the mean”
§ Repeating the Listening Text: Effects on Listener Performance, Metacognitive Strategy Use, and Anxiety > THE AUTHORS
“the data for positively formulated anxiety statements (7, 24, 25) were reversedcoded to allow for cross-comparisons.”
Citations
Cites
Costello, A. B., & Osborne, J. (2005) · University of Massachusetts Amherst · doi:10.7275/jyj1-4868 · Cited by 10,297
Common European Framework of Reference for Languages: learning, teaching, assessment
Verhelst, N. D., Avermaet, P. V., Takala, S., Figueras, N., & North, B. (2009) · Ghent University Academic Bibliography (Ghent University) · Cited by 6,120
Common European framework of reference for languages: learning, teaching, assessment
Council of Europe (2001) · International Linear Collider · Cited by 5,982
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
(2007) · Cited by 3,005
The Subtle Effects of Language Anxiety on Cognitive Processing in the Second Language
MacIntyre, P. D., & Gardner, R. C. (1994) · Language Learning · doi:10.1111/j.1467-1770.1994.tb01103.x · Cited by 1,823
Cognitive test anxiety and academic performance
Cassady, J. C., & Johnson, R. E. (2002) · Contemporary Educational Psychology · doi:10.1006/ceps.2001.1094 · Cited by 1,315
Measuring Second Language Performance
Kleinsasser, R. C., & McNamara, T. (1998) · The Modern Language Journal · doi:10.2307/330236 · Cited by 1,253
Online Education and Its Effective Practice: A Research Review
Sun, A., & Chen, X. (2016) · Journal of Information Technology Education: Research · doi:10.28945/3502 · Cited by 908
Teaching L2 Learners How to Listen Does Make a Difference: An Empirical Study
Vandergrift, L., & Tafaghodtari, M. H. (2010) · Language Learning · doi:10.1111/j.1467-9922.2009.00559.x · Cited by 666
Listening Comprehension and Anxiety in the Arabic Language Classroom
ELKHAFAIFI, H. (2005) · The Modern Language Journal · doi:10.1111/j.1540-4781.2005.00275.x · Cited by 646
Teaching and Learning Second Language Listening
Goh, C. C. M., & Vandergrift, L. (2012) · Routledge eBooks · doi:10.4324/9780203843376 · Cited by 596
Linacre, J. M. (1994) · Medical Entomology and Zoology · Cited by 528
Questionnaires in Second Language Research: Construction, Administration, and Processing
Dörnyei, Z., & Taguchi, T. (2009) · Routledge eBooks · doi:10.4324/9780203864739 · Cited by 470
Quantitative research methods for professionals
Vogt, W. (2006) · Medical Entomology and Zoology · Cited by 461
Listening comprehension: The learners’ perspective
Graham, S. (2006) · System · doi:10.1016/j.system.2005.11.001 · Cited by 416
Listening in the Language Classroom
Field, J. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511575945 · Cited by 412
The Comprehension Strategies of Second Language (French) Listeners: A Descriptive Study
Vandergrift, L. (1997) · Foreign Language Annals · doi:10.1111/j.1944-9720.1997.tb02362.x · Cited by 391
de Winter, J. C. F., & Dodou, D. (2012) · Journal of Applied Statistics · doi:10.1080/02664763.2011.610445 · Cited by 385
Listening Comprehension Anxiety: Students' Reported Sources and Solutions
Vogely, A. J. (1998) · Foreign Language Annals · doi:10.1111/j.1944-9720.1998.tb01333.x · Cited by 255
The Effects of Listening Support on the Listening Performance of EFL Learners
Chang, A. C.-S., & Read, J. (2006) · TESOL Quarterly · doi:10.2307/40264527 · Cited by 247
A Comparison of Second Language Listening and Reading Comprehension
LUND, R. J. (1991) · The Modern Language Journal · doi:10.1111/j.1540-4781.1991.tb05350.x · Cited by 238
TEXT CHARACTERISTICS OF TASK INPUT AND DIFFICULTY IN SECOND LANGUAGE LISTENING COMPREHENSION
Révész, A., & Brunfaut, T. (2013) · Studies in Second Language Acquisition · doi:10.1017/s0272263112000678 · Cited by 176
The Role of Task and Listener Characteristics in Second Language Listening
Brunfaut, T., & Révész, A. (2014) · TESOL Quarterly · doi:10.1002/tesq.168 · Cited by 175
Introduction to Many-Facet Rasch Measurement
Eckes, T. (2011) · doi:10.3726/978-3-653-04844-5 · Cited by 170
Exact Repetition as Input Enhancement in Second Language Acquisition
Jensen, E. D., & Vinther, T. (2003) · Language Learning · doi:10.1111/1467-9922.00230 · Cited by 168
Hulstijn, J. H. (2003) · Computer Assisted Language Learning · doi:10.1076/call.16.5.413.29488 · Cited by 166
The Routledge Handbook of Second Language Acquisition and Language Testing
Winke, P., & Brunfaut, T. (2020) · Routledge eBooks · doi:10.4324/9781351034784 · Cited by 164
Repetition in Conversation: A Look at "First and Second Sayings"
Wong, J. (2000) · Research on Language and Social Interaction · doi:10.1207/s15327973rlsi3304_03 · Cited by 134
`I want to go back to the text': Response strategies on the reading subtest of the new TOEFL®
Cohen, A. D., & Upton, T. A. (2007) · Language Testing · doi:10.1177/0265532207076364 · Cited by 93
Fairness, Justice, and Language Assessment
Elnegahy, S., Jin, H., & Kim, H. (2021) · Language Assessment Quarterly · doi:10.1080/15434303.2021.1922412 · Cited by 86
Response Processes in the Context of Validity: Setting the Stage
Hubley, A. M., & Zumbo, B. D. (2017) · Social indicators research series · doi:10.1007/978-3-319-56129-5_1 · Cited by 77
Exploring task difficulty in ESL listening assessment
Brindley, G., & Slatyer, H. (2002) · Language Testing · doi:10.1191/0265532202lt236oa · Cited by 76
The effect of question preview in listening comprehension tests
Sherman, J. (1997) · Language Testing · doi:10.1177/026553229701400204 · Cited by 73
How Does Varying Pre-listening Activities Affect Second Language Listening Comprehension?
Berne, J. E. (1995) · Hispania · doi:10.2307/345428 · Cited by 43
Effect of Repetition of Exposure and Proficiency Level in L2 Listening Tests
Sakai, H. (2009) · TESOL Quarterly · doi:10.1002/j.1545-7249.2009.tb00179.x · Cited by 39
Low, A. R. L., & Aryadoust, V. (2021) · International Journal of Listening · doi:10.1080/10904018.2021.1883433 · Cited by 33
Cognitive validity [Examining Listening]
Field, J. (2013) · University of Bedfordshire Repository (University of Bedfordshire) · Cited by 30
Aryadoust, V. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2019.1574267 · Cited by 27
Technologies for Teaching and Learning L2 Listening
Hubbard, P. (2017) · Wiley eBooks · doi:10.1002/9781118914069.ch7 · Cited by 23
International Experiences in Language Testing and Assessment
Tsagari, D., Papadima-Sophocleous, S., & Ioannou‐Georgiou, S. (2013) · Peter Lang D eBooks · doi:10.3726/978-3-653-02511-8 · Cited by 19
Henning, G. H. (1990) · ETS Research Report Series · doi:10.1002/j.2333-8504.1990.tb01354.x · Cited by 17
Green, R. (2017) · doi:10.1057/978-1-349-68771-8 · Cited by 17
Double play in listening assessment
Holzknecht, F. (2019) · Lancaster EPrints (Lancaster University) · doi:10.17635/lancaster/thesis/812 · Cited by 17
Self-citationPlaying the Recording Once or Twice: Effects on Listening Test Performances
Ruhm, R., Leitner-Jones, C., Kulmhofer-Bommer, A., Kiefer, T., Mlakar, H., & Itzlinger-Bruneforth, U. (2016) · International Journal of Listening · doi:10.1080/10904018.2015.1104252 · Cited by 14
The Listening Process : Effects of Question Types and Repetition
Iimura, H. (2007) · Language education & technology · Cited by 13
Individual Difference Factors for Second Language Listening
Holzknecht, F., & Brunfaut, T. (2022) · The Routledge Handbook of Second Language Acquisition and Individual Differences · doi:10.4324/9781003270546-27 · Cited by 3
Self-citation(2014)
The effects of single and double play upon listening test outcomes and cognitive processing
Field, J. (2015) · British Council · doi:10.57884/vb82-wv20
(2019)
Research works printed but not linked: 7
- Council of Europe, 2009, Manual for relating language examinations to the common European framework of reference for languages (CEFR)
- Field J., 2013, Examining listening, 77
- Fortune A. J., 2004, Testing listening comprehension in a foreign language – Does the number of times a text is heard affect performance?
- Jones G., 2011, Research summary: Once or twice? A critical review of current literature on the question how many times the audio recording should be played in listening comprehension testing items
- 10.17936/pkelt.2017.29.2.2 · doi:10.17936/pkelt.2017.29.2.2
- Pallant J., 2007, SPSS survival manual
- Spöttl C., 2018, Language testing in Austria: Taking stock (Sprachtesten in Österreich: Eine Bestandsaufnahme), 219
Cited by
Teaching and Researching Listening
Rost, M. (2024) · Routledge eBooks · doi:10.4324/9781003390794 · Cited by 75
Hwang, G., Rahimi, M., & Fathi, J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2534067 · Cited by 8
Metacognitive Strategies in Learning English: A Think-Aloud Protocol in Completing Grammar Tasks
Lat, M. E. M., & Yumarnamto, M. (2025) · INTERNATIONAL JOURNAL OF LANGUAGE TEACHING AND EDUCATION · doi:10.22437/ijolte.v9i1.44317 · Cited by 5
Review of the Canadian English Language Proficiency Index Program (CELPIP)
Qin, C. Y., & Baker, B. A. (2024) · Language Testing · doi:10.1177/02655322241291764 · Cited by 5
Kormos, J., Eberharter, K., Guggenbichler, E., Baumgartinger, S., Ebner, V., & Kremmel, B. (2024) · Language Assessment Quarterly · doi:10.1080/15434303.2024.2435811 · Cited by 4
Metadata
- Authors
- Holzknecht, F., & Harding, L.
- Affiliations
- University of Teacher Education in Special Needs (CH)
- Lancaster University (GB)
- Corresponding author
- Harding, Luke
- Venue
- TESOL Quarterly
- Publisher
- Wiley
- Published
- 2023-08-01
- Volume
- 58
- Issue
- 1
- Pages
- 451-478
- ISSN
- 0039-8322 (ISSN-L)
- 1545-7249
- OpenAlex
- W4385460248
- Cited by
- 18
- References
- 50
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 5
- FWCI
- 8.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (vor)
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- Locations
- TESOL Quarterly (publishedVersion, cc-by)
- Lancaster EPrints (Lancaster University) (acceptedVersion, public-domain)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Arts and Humanities › Language and Linguistics › Subtitles and Audiovisual Media
- Keywords
- double play, second language listening, listening comprehension, listening strategies, metacognitive strategy use, test-taking strategies, test anxiety, listening anxiety, listening assessment, Matura exam, high school students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.