The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Feedforwarding diagnostic language assessment: Artificial intelligence- (AI-) driven weakness identification and contextualised feedback for second language speaking
Open accessAbstract
The current study proposes a new approach to weakness identification in diagnostic language assessment (DLA) for speaking skills. We also propose to design actionable and contextualised diagnostic feedback through the systematic integration of feedback and remedial learning activities. Focusing on lexical use in second language speaking, the current study developed and validated our DLA programme in terms of actual learning gains, using an experimental design. A total of 59 beginner-to-intermediate-level Japanese learners of English were randomly assigned to control or experimental groups. While both groups engaged in task repetition with a conversational artificial intelligence (AI) agent on six occasions, only the experimental group received the diagnostic feedback on lexical use including the paraphrased utterances of their original utterance. The results showed that the control group (task repetition only) demonstrated significant improvement during the task repetition sessions but failed to transfer and retain the learning gains. In contrast, despite the lack of practice effects, the experimental group (task repetition with diagnostic feedback) outperformed the control group at the posttest with a near-medium effect size. A qualitative investigation into learners’ perceptions further confirmed that the proposed contextualised diagnostic feedback succeeded in heightening their awareness of weaknesses.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
How Big Is “Big”? Interpreting Effect Sizes in L2 Research
Plonsky, L., & Oswald, F. L. (2014) · Language Learning · doi:10.1111/lang.12079 · Cited by 1,960
(2014) · Cited by 1,210
Memory and Metamemory Considerations in the Training of Human Beings
Bjork, R. A. (1994) · Metacognition · doi:10.7551/mitpress/4561.003.0011 · Cited by 1,084
Bachman, L. F., & Palmer, A. S. (2010) · Cited by 1,008
Cognitive Bases of Second Language Fluency
Segalowitz, N. (2010) · doi:10.4324/9780203851357 · Cited by 881
Research works printed but not linked: 3
- OpenAI Achiam J. Adler S. Agarwal S. Ahmad L. Akkaya I. Aleman F. L. Almeida D. Altenschmidt J. Altman S. Anadkat S. Avila R. Babuschkin I. Balaji S. Balcom V. Baltescu P. Bao H. Bavarian M. Belgum J. . . . Zoph B. (2023). GPT-4 technical report. http://arxiv.org/abs/2303.08774 · arXiv
- Takatsu H., Suzuki S., Matsuura R., Koyama M., Matsuyama Y. (forthcoming). A personalized diagnostic feedback system to enhance conversational vocabulary competence of second language learners.
- Vaswani A. Shazeer N. Parmar N. Uszkoreit J. Jones L. Gomez A. N. Kaiser L. Polosukhin I. (2017). Attention is all you need. http://arxiv.org/abs/1706.03762 · arXiv
Cited by
Jang, E. E., & Sawaki, Y. (2025) · Language Testing · doi:10.1177/02655322251348685 · Cited by 31
Quan, Y. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102192 · Cited by 27
Harding, L. (2025) · Language Testing · doi:10.1177/02655322251350717 · Cited by 7
Gablasová, D., Harding, L., Březina, V., Hazelhurst, E. T., O’Sullivan, B., & Spiby, R. (2026) · Language Testing · doi:10.1177/02655322261453702 · Cited by 6
Meng, F., & Zou, B. (2026) · Journal of China Computer-Assisted Language Learning · doi:10.1515/jccall-2025-0033 · Cited by 4
Metadata
- Authors
- Suzuki, S., Takatsu, H., Matsuura, R., Koyama, M., Saeki, M., & Matsuyama, Y.
- Affiliations
- Waseda University (JP)
- Corresponding author
- Suzuki, Shungo
- Venue
- Language Testing
- Publisher
- SAGE Publications
- Published
- 2025-07-28
- Volume
- 42
- Issue
- 4
- Pages
- 476-507
- ISSN
- 0265-5322 (ISSN-L)
- 1477-0946
- OpenAlex
- W4412694316
- Cited by
- 6
- References
- 71
- Citations by year
- 2026: 3 · 2025: 3
- FWCI
- 21.61
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- creativecommons.org/licenses/by-nc/4.0/ (vor)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Language Testing (publishedVersion, cc-by-nc)
- Funders
- New Energy and Industrial Technology Development Organization (JPNP20006)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Keywords
- second language speaking, conversational AI agents, Japanese learners of English, task repetition, transfer of learning, learner awareness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Feedforwarding diagnostic language assessment: Artificial intelligence- (AI-) driven weakness identification and contextualised feedback for second language speaking. https://app.cochat.ai/papers/10.1177/02655322251348725
- The paper
- Suzuki, S., Takatsu, H., Matsuura, R., Koyama, M., Saeki, M., & Matsuyama, Y. (2025). Feedforwarding diagnostic language assessment: Artificial intelligence- (AI-) driven weakness identification and contextualised feedback for second language speaking. Language Testing. https://doi.org/10.1177/02655322251348725
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.