CoChat

Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes?

Open access
Chen, Chi-Fen Emily, Cheng, Wei-Yuan Eugene Cheng · 2008 · Language Learning & Technology

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

Abstract

Automated writing evaluation (AWE) software is designed to provide instant computergenerated scores for a submitted essay along with diagnostic feedback.Most studies on AWE have been conducted on psychometric evaluations of its validity; however, studies on how effectively AWE is used in writing classes as a pedagogical tool are limited.This study employs a naturalistic classroom-based approach to explore the interaction between how an AWE program, MY Access!, was implemented in three different ways in three EFL college writing classes in Taiwan and how students perceived its effectiveness in improving writing.The findings show that, although the implementation of AWE was not in general perceived very positively by the three classes, it was perceived comparatively more favorably when the program was used to facilitate students' early drafting and revising process, followed by human feedback from both the teacher and peers during the later process.This study also reveals that the autonomous use of AWE as a surrogate writing coach with minimal human facilitation caused frustration to students and limited their learning of writing.In addition, teachers' attitudes toward AWE use and their technology-use skills, as well as students' learner characteristics and goals for learning to write, may also play vital roles in determining the effectiveness of AWE.With limitations inherent in the design of AWE technology, language teachers need to be more critically aware that the implementation of AWE requires well thought-out pedagogical designs and thorough considerations for its relevance to the objectives of the learning of writing.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.64152/10125/44145

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

This paper’s reference list could not be split into single entries.

Metadata

Authors
Chen, C.-F. E., & Cheng, W.-Y. E. C.
Affiliations
National Kaohsiung First University of Science and Technology (TW)
Venue
Language Learning & Technology
Published
2008-06-01
Volume
12
Issue
2
Pages
94-112
ISSN
1094-3501 (ISSN-L)
OpenAlex
W2122946606
Cited by
304
References
17
Citations by year
2026: 22 · 2025: 17 · 2024: 33 · 2023: 32 · 2022: 28 · 2021: 29 · 2020: 15 · 2019: 16 · 2018: 19 · 2017: 11 · 2016: 17 · 2015: 17 · 2014: 13 · 2013: 13 · 2012: 9
FWCI
43.13
Type
journal article
Language
en
Open access
Locations
  • Language learning & technology (publishedVersion, cc-by-nc-nd)
  • ScholarSpace (University of Hawaii at Manoa) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Language learning & technology (cc-by-nc-nd)
Topics
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Social Sciences › Education › English Language Learning and Teaching
  • Social Sciences › Education › Student Assessment and Feedback
Keywords
automated writing evaluation, EFL writing, writing instruction, student perceptions, human feedback, peer feedback, teacher attitudes, learner characteristics, technology-enhanced language learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.