The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index; 7 of the 98 sources its claims cite were checked for support.
The impact of formative peer feedback on higher education students' academic writing: a Meta-Analysis
Open accessAbstract
Peer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’ writing performance. The current study conveyed two types of observations. First, regarding the impact of peer feedback on writing performance, this study synthesized the results of 24 quantitative studies reporting on higher education students’ academic writing performance after peer feedback. Engagement in peer feedback resulted in larger writing improvements compared to (no-feedback) controls (g = 0.91 [0.41, 1.42]) and compared to self-assessment (g = 0.33 [0.01, 0.64]). Peer feedback and teacher feedback resulted in similar writing improvements (g = 0.46 [-0.44, 1.36]). The nature of the peer feedback significantly moderated the impact that peer feedback had on students’ writing improvement, whereas only a theoretically plausible, though non-significant moderating pattern was found for the number of peers that students engaged with. Second, this study shows that the number of well-controlled studies into the effects of peer feedback on writing is still low, indicating the need for more quantitative, methodologically sound research in this field. Findings and implications are discussed both for higher education teaching practice and future research approaches and directions.
Overview
CoChat Summary
TL;DR
This meta-analysis of 24 higher education studies found that formative peer feedback improved academic writing more than no feedback (g = 0.91) and more than self-assessment (g = 0.33), but did not differ significantly from teacher feedback (g = 0.46). Combining peer comments with grades and engaging multiple peers showed positive patterns, though the number-of-peers moderator was non-significant and evidence was limited.
Key findings
- Peer feedback versus no feedback produced a large composite effect, 0.91 [0.41, 1.42], based on two studies (Cho & MacArthur 2011; Tsai & Chuang 2013).
- Peer feedback versus self-assessment produced a small but significant composite effect, 0.33 [0.01, 0.64], based on three studies.
- Peer feedback versus teaching staff produced an intermediate, non-significant composite effect, 0.46 [−0.44, 1.36], based on three studies; the paper concludes writing performance does not appear differentially affected by peer versus teacher feedback.
- The nature of peer feedback significantly moderated writing improvement: combining comments and grades resulted in larger improvements than either alone (b = 0.61, z = 2.02; QM(1) = 4.10, p = .043, I² = 95.5%). The number of peers did not significantly moderate improvement (b = 0.60, z = 1.27; QM(1) = 1.62, p = .202, I² = 96.2%), though one-group pretest-posttest studies showed a composite of 1.00 [0.28, 1.72] for multiple peers versus 0.37 [0.23, 0.51] for a single peer.
Methods
- Systematic search from 1 January 1998 to 31 October 2016 via EBSCOhost and Web of Science; 934 unique hits yielded 289 selected articles, 287 retrieved full texts, and 24 included articles (8.4%). Sixteen included articles had a reference group; three of those lacked sufficient data for effect-size calculation and were included only qualitatively.
- Three separate random-effects meta-analyses compared peer feedback with no feedback, self-assessment, and teaching staff. Two mixed-effects moderator analyses examined the nature of peer feedback and the number of peers engaged with. Effect sizes were Hedges’ g, weighted by inverse variance, with REML estimation using the metafor package in R.
- One-group pretest-posttest studies were analyzed separately using standardized gain scores; effect sizes were based on gain scores where possible, otherwise on posttest scores when groups did not significantly differ at pretest.
Limitations
- Stated: the limited number of well-controlled quantitative studies (24, 8.4% of retrieved full texts) restricts generalizability; some data were insufficient; for Cho & MacArthur (2011), one of two control conditions was randomly excluded, so findings might have varied; peer-grade weighting varied or was unclear across three moderator studies; and the number-of-peers inference is limited by too few studies.
- Stated: one-group pretest-posttest designs tend to overestimate treatment effects and were therefore incorporated separately.
- Evident from the text: several comparisons relied on only two or three studies with wide confidence intervals, and moderator analyses showed very high heterogeneity (I² = 95.5% and 96.2%), so pooled estimates should be interpreted cautiously.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
5 Valid · 2 Not valid · 63 Not checked · 52 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“for example because it requires students to actively consider the assessment criteria (Huisman et al. 2018).”
What the sources say
- Supportedcites Huisman et al. 2018 source
The ‘Providing versus receiving peer feedback’ section (p. 4) says that providing peer feedback stimulates students to actively consider task-specific processes and criteria. This supports the citing sentence’s paraphrase about considering assessment criteria. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“this metaanalysis found a strong and positive impact on writing quality when comparing students who were engaged in ' peer assistance ' with students who wrote alone (weighted effect size 0.75 [0.54-0.97]).”
What the sources say
- Partly supportedcites Graham and Perin 2007 sourceExperimental — accuracy not yet measured
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In the context of online education, however, self-assessments may be biased (e.g., Admiraal, Huisman and Pilli 2015)”
What the sources say
- Supportedcites Admiraal, Huisman and Pilli 2015
The Discussion and conclusion explicitly says the findings suggest a bias in self-assessments in the MOOCs studied. Because the claim says self-assessments *may* be biased and cites the paper as an example, it matches the source's qualified conclusion. (LLM, conf=0.93)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
In the paper
“In only one study (Greenberg 2015) peer feedback was instructed to be merely quantitative (e.g., scores; see Table 1).”
What the sources say
- Not checked — no full text of the sourcecites Greenberg 2015 source
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Among the studies without a reference group, three studies included both qualitative peer comments as well as quantitative peer grading or ranking (Cheng, Liang, and Tsai 2015; Sampson and Walker 2012; Cho and Cho 2011). Their respective effect sizes ranged between small (0.35 [-0.05, 0.76]) and large (1.71 [0.95, 2.47] and 2.14 [1.67, 2.62]), which weighted into a composite effect size of 1.39 [0”
What the sources say
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
54 more claims
Create a free account to see all 122 claims and to verify the 7 references still open.
- Probably not a substantial claim. 53
- It may state two separate claims as one. 22
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“This finding is in line with the results of other meta-analyses, which also found no effects in moderator analyses of different types of instructional support on learning outcomes that are assessed after peer-feedback scenarios (e.g., Double et al., 2020;Huisman et al., 2019;Li et al., 2020).”
From Enhancing the Peer-Feedback Process Through Instructional Support: A Meta-Analysis (2025) · cites this paper as Huisman et al., 2019
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Formative feedback positively impacts students' writing (Anderson & Ayaawan, 2023;Butterfuss et al., 2022Huisman et al., 2019).”
From Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study (2024) · cites this paper as Huisman et al., 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, the meta-analyses (Double et al., 2020;Huisman et al., 2019;Li et al., 2020) showed that different moderator variables can improve the effects of peer-feedback on processes and outcomes.”
From Enhancing the Peer-Feedback Process Through Instructional Support: A Meta-Analysis (2025) · cites this paper as Huisman et al., 2019
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Peer-feedback has great potential to enhance students' learning processes and outcomes (e.g., Double et al., 2020;Huisman et al., 2019).”
From Enhancing the Peer-Feedback Process Through Instructional Support: A Meta-Analysis (2025) · cites this paper as Huisman et al., 2019
In the citing paper
“Taken together, the results of these meta-analyses demonstrated that peer-feedback yields better outcomes than no peer-feedback or, in some cases, other forms of feedback, including teacher feedback and self-assessment.”
From Enhancing the Peer-Feedback Process Through Instructional Support: A Meta-Analysis (2025) · cites this paper as Huisman et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Nature of the peer feedback
“an effect size of 0.32 [0.11, 53] was reported.”
§ Number of peers engaged with
“| Greenberg, 2015 | 46 | 1 | | 0.32 [0.11, 0.53] |”
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631 · cited 2×
“Based on the definition of peer assessment by Topping (1998) and the definition of formative feedback by Shute (2008), formative peer feedback in this study is defined as ‘all task-related information that a learner communicates to a peer of similar status which can be used to improve his or her…”
MethodThe Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Formative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285
Research works printed but not linked: 6
- Ajzen I., 2005, The handbook of attitudes, 173
- Cohen J. C, 1988, Statistical power analysis for the behavioural sciences
- Gunersel A. B., 2008, Journal of the Scholarship of Teaching and Learning, 8, 25
- Hartberg Y., 2008, Journal of the Scholarship of Teaching and Learning, 8, 29
- Lee C.-Y, 2015, TOJET: The Turkish Online Journal of Educational Technology, 14, 123
- Lipsey M. W., 2001, Practical Meta-analysis, applied social research methods series. Thousand oaks
Cited by
Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study
Mahapatra, S. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00295-9 · Cited by 398
Carless, D. (2022) · Active Learning in Higher Education · doi:10.1177/1469787420945845 · Cited by 276
Latifi, S., Noroozi, O., & Talaee, E. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13054 · Cited by 163
Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic writing?
Lu, Q., Yao, Y., Xiao, L., Yuan, M., Wang, J., & Zhu, X. (2024) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2024.2301722 · Cited by 190
The Effectiveness of Automated Writing Evaluation on Writing Quality: A Meta-Analysis
Zhai, N., & Ma, X. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221127300 · Cited by 200
Metadata
- Authors
- Huisman, B., Saab, N., van den Broek, P., & van Driel, J.
- Affiliations
- Leiden University (NL)
- University of Melbourne, Australia
- Corresponding author
- Huisman, Bart
- Venue
- Assessment & Evaluation in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2018-12-29
- Volume
- 44
- Issue
- 6
- Pages
- 863-880
- ISSN
- 0260-2938 (ISSN-L)
- 1469-297X
- OpenAlex
- W2907199351
- Semantic Scholar
- 6996a8d31feb0fbac4cd7e23b1deb482707b613e
- Cited by
- 306
- References
- 77
- Citations by year
- 2026: 40 · 2025: 52 · 2024: 63 · 2023: 47 · 2022: 44 · 2021: 35 · 2020: 20 · 2019: 5
- FWCI
- 6.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Assessment & Evaluation in Higher Education (publishedVersion, cc-by-nc-nd)
- Leiden Repository (Leiden University) (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › Evaluation of Teaching Practices
- Keywords
- peer feedback, formative feedback, academic writing, writing performance, university students, self-assessment, teacher feedback, writing improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The impact of formative peer feedback on higher education students' academic writing: a Meta-Analysis. https://app.cochat.ai/papers/10.1080/02602938.2018.1545896
- The paper
- Huisman, B., Saab, N., van den Broek, P., & van Driel, J. (2019). The impact of formative peer feedback on higher education students' academic writing: a Meta-Analysis. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2018.1545896
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.