The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction
Open accessAbstract
Artificial intelligence (AI) technology is gradually penetrating the domain of education, opening up many possibilities for teaching and learning. Many educators, faced with the burden of commenting on substantial student essays, have introduced automated writing evaluation (AWE) into second language (L2) writing considering its affordance of immediate scores and diagnostic information. However, students’ processing strategies and perceptions of such computer-generated feedback and its impact on student writing quality, particularly as mediated by language proficiency, remain under-explored. This study examines the impact of Pigai , a Chinese AWE system, on revision processes and writing products of 42 English as a foreign language (EFL) learners with varying language levels by analyzing feedback points, feedback uptake, text quality in complexity, accuracy, and fluency (CAF), and perceptions. The findings are as follows. When confronted with AWE instruction, the majority of student work focuses on correcting errors, but higher-level students exhibit an emphasis on language improvement beyond the surface level compared to lower-level students. According to CAF measures, automated feedback exerts greater effects on accuracy for unskilled learners and lexical complexity for skilled learners in the development of interlanguage. Learner profiles and perceptions of students at different levels are explored along four dimensions: writing quality, cognitive engagement, behavioral engagement, and affective engagement. Finally, the potential issues of such technology-based writing instruction are pointed out.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, AI tools provide immediate, individualized diagnostic feedback on linguistic accuracy, syntactic complexity, and genre-level organization—otherwise constrained by class size and instructor availability—enabling students to identify and repair surface and structural weaknesses across multiple drafting cycles (Chan et al., 2024; Mekheimer, 2025; Shen et al., 2023; Song and Song, 2023).”
From From tool to scaffold: structured human–AI collaboration and its effects on academic writing and digital critical thinking among Saudi EFL learners (2026) · cites this paper as Shen et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Few studies have looked at the long-term effects of ChatGPT and similar tools on the development of writing skills, particularly in actual classroom settings.”
From Evaluating the impact of using ChatGPT on EFL students’ argumentative skills (2026) · cites this paper as Chen et al. [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, Chen et al. [5] found that computer-generated feedback could enhance EFL learners’ engagement and improve the quality of written products”
From Evaluating the impact of using ChatGPT on EFL students’ argumentative skills (2026) · cites this paper as Chen et al. [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies found stronger effects among lower-proficiency learners (Wei et al., 2023; Shen et al., 2023)”
From The Use of Artificial Intelligence Tools in English Academic Writing among University Students: A Scoping Review (2025) · cites this paper as Shen et al., 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Qualitative Inquiry and Research Design: Choosing Among Five Approaches
Lewis, S. (2015) · Health Promotion Practice · doi:10.1177/1524839915580941 · Cited by 22,105
Cohen, L., Manion, L., & Morrison, K. (2007) · Routledge eBooks · doi:10.4324/9780203029053 · Cited by 20,105
(2017) · Cited by 16,319
Complex Systems and Applied Linguistics
Cameron, L., & Larsen‐Freeman, D. (2007) · International Journal of Applied Linguistics · doi:10.1111/j.1473-4192.2007.00148.x · Cited by 1,349
Error feedback in L2 writing classes
Ferris, D., & Roberts, B. (2001) · Journal of Second Language Writing · doi:10.1016/s1060-3743(01)00039-x · Cited by 981
Complexity, accuracy and fluency in second language acquisition
Housen, A., & Kuiken, F. (2009) · Applied Linguistics · doi:10.1093/applin/amp048 · Cited by 863
Larsen-Freeman, D. (2006) · Applied Linguistics · doi:10.1093/applin/aml029 · Cited by 805
LU, X. (2011) · TESOL Quarterly · doi:10.5054/tq.2011.240859 · Cited by 744
Research works printed but not linked: 1
- Wolfe-Quintero, 1998, Second language development in writing: Measures of fluency, accuracy, & complexity
Cited by
Cai, L., Msafiri, M. M., & Kangwa, D. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13112-0 · Cited by 104
The Impact of AI on the Personal and Collaborative Learning Environments in Higher Education
Msambwa, M. M., Wen, Z., & Daniel, K. (2025) · European Journal of Education · doi:10.1111/ejed.12909 · Cited by 76
Daniel, K., Msambwa, M. M., & Wen, Z. (2025) · European Journal of Education · doi:10.1111/ejed.70036 · Cited by 71
A systematic review of AI-based feedback in educational settings
Durak, H. Y., & Onan, A. (2025) · Journal of Computational Social Science · doi:10.1007/s42001-025-00428-1 · Cited by 78
Min, H., Abbasi, B. N., & Jing, H. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05817-5 · Cited by 59
Metadata
- Authors
- Shen, C., Shi, P., Guo, J., Xu, S., & Tian, J.
- Affiliations
- Chang'an University (CN)
- Xi'an Jiaotong University (CN)
- Xi'an Jiaotong University City College (CN)
- Air Force Engineering University (CN)
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2023-10-23
- Volume
- 14
- Pages
- 1258286-1258286
- ISSN
- 1664-1078 (ISSN-L)
- PMC
- PMC10701688
- OpenAlex
- W4387878129
- Cited by
- 42
- References
- 54
- Citations by year
- 2026: 17 · 2025: 21 · 2024: 4
- FWCI
- 47.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Education › English Language Learning and Teaching
- Keywords
- automated writing evaluation, automated feedback, EFL writing, second language writing, revision strategies, feedback uptake, language proficiency, interlanguage development, writing quality, student engagement, student perceptions, error correction, lexical complexity, fluency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction. https://app.cochat.ai/papers/10.3389/fpsyg.2023.1258286
- The paper
- Shen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023). From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2023.1258286
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
