Cited by 71Student Assessment and FeedbackDiscourse Analysis in Language StudiesEFL/ESL Teaching and Learning

The alignment of written peer feedback with draft problems and its impact on revision in peer assessment

Gao, Ying, Schunn, Christian Dieter D., Yu, Qiuying·2019·Assessment & Evaluation in Higher Education

Abstract

Despite the wide use of peer assessment, questions about the helpfulness of peer feedback are frequently raised. In particular, it is unknown whether, how and to what extent peer feedback can help solve problems in initial texts in complex writing tasks. We investigated this research gap by focusing on the case of writing literature reviews in an academic writing course. The dataset includes two drafts from 21 students, sampled to represent a wide range of document qualities, and 84 anonymous peer reviews, involving 1,289 idea units. Our study revealed that: (1) at both substance and high prose levels, drafts of all quality levels demonstrated more common problems on advanced writing issues (e.g. counter-argument); (2) peer feedback was driven by difficulty of the problem rather than overall draft quality, peer comments were not well aligned with the relative frequency of problems, more comments were given to less difficult problems; (3) peer feedback had a moderate impact on revision, and importantly, receiving multiple comments on the same issue led to more repairs and improvement of draft quality, but consistent with the comments received, authors tended to fix basic problems more often. Implications for practice and research are drawn from these findings.

Integrity signals

Registry

Crossref · 10.1080/02602938.2018.1499075

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Students often grapple not just with superficial aspects like vocabulary and grammar but also with advanced facets of academic writing, including research methodology and significance of research.

    “Students often grapple not just with superficial aspects like vocabulary and grammar but also with advanced facets of academic writing (Gao et al., 2019), including research methodology and the significance of research (Man et al., 2018).”
  • Studies have revealed a tendency among students to selectively incorporate feedback, prioritizing simpler suggestions over more complex ones when revising academic writing.

    “Studies have revealed a tendency among students to selectively incorporate feedback, giving priority to simpler suggestions over more complex ones when revising their academic writing (Shulgina et al., 2024a; Gao et al., 2019; Zhang et al., 2020).”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Gao, Y., Schunn, C. D. D., & Yu, Q.
Affiliations
  • University of Pittsburgh (US)
  • School of Foreign Languages, Northeast Normal University, Changchun, China;
Corresponding author
Schunn, Christian Dieter D.
Venue
Assessment & Evaluation in Higher Education
Published
2018-09-26
Volume
44
Issue
2
Pages
294-308
ISSN
  • 0260-2938 (ISSN-L)
  • 1469-297X
OpenAlex
W2892447306
Cited by
71
References
59
Citations by year
2026: 10 · 2025: 11 · 2024: 14 · 2023: 13 · 2022: 10 · 2021: 6 · 2020: 6 · 2019: 1
FWCI
10.54
Type
journal article
Language
en
Open access
closed
Locations
Assessment & Evaluation in Higher Education (publishedVersion)
Funders
The National Social Science Fund of China (18BYY114)
Topics
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Arts and Humanities › Literature and Literary Theory › Discourse Analysis in Language Studies
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
Keywords
peer feedback, peer assessment, writing revision, literature review writing, academic writing, writing difficulties, peer review comments, college writing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review