The DOI matches its Crossref record; 128 of the 130 references it cites were found in a registry or an index; 36 of the 194 sources its claims cite were checked for support.
Online peer feedback in higher education: A synthesis of the literature
Open accessAbstract
Abstract Online peer feedback is an effective instructional strategy to enhance students' learning processes and outcomes. However, the literature lacks a comprehensive understanding of the influential factors that play a key role in the effective implementation of online peer feedback. This systematic review provides an overview of the current state of online peer feedback implementation in higher education contexts and explores the role of students' characteristics and online learning environments in relation to their learning processes and outcomes. To achieve this goal, the PRISMA method was followed, and a coding scheme was developed to create a framework that can guide the implementation of online peer feedback in higher education settings. This framework depicts factors that should be taken into account for effective implementation of online peer feedback in terms of four dimensions: students' characteristics (demographic characteristics, academic background, and personality and psychological features), environmental conditions (learning platform and setting), learning processes (content, feedback activity design, and technology), and learning outcomes including cognitive outcomes (e.g., acquisition of knowledge, comprehension, application, analysis, synthesis, and evaluation), behavioral outcomes (engagement, communication, and teamwork), and affective outcomes (satisfaction, motivation, attitude, self-efficacy, sense of autonomy, and confidence). We conclude this study by discussing the framework, limitations, and ideas for future research and practice.
Overview
CoChat Summary
TL;DR
This systematic review synthesizes 83 empirical studies on online peer feedback in higher education using Biggs’ model and proposes a four-dimension framework: student characteristics, learning environment, learning processes/activities, and learning outcomes. It finds that gender, platform/setting, feedback design, technology, and cognitive/behavioral/affective outcomes are key considerations for effective implementation.
Key findings
- From 2,221 identified records, 105 studies underwent quality appraisal and 83 were included. Coding produced 36 codes for student characteristics, 39 for learning environment conditions, 107 for learning processes/activities, and 165 for learning outcomes (104 cognitive, 16 behavioral, 45 affective).
- Gender was a consistently significant demographic factor: female students tended to produce higher-quality feedback and more cautious negative comments, while male students produced higher-quality argumentative essays based on peer feedback (Noroozi et al., 2020, 2022; Slee & Jacobs, 2017; Lane et al., 2018).
- Design features influenced outcomes: voluntary peer feedback led to more accurate peer rater scores than compulsory feedback; anonymity enhanced essay writing, high-quality cognitive feedback, and constructive feedback; more rounds improved writing performance and peer score validity; worked examples and scripting improved argumentative essay quality and domain-specific knowledge.
- Application was the most studied cognitive outcome (50 studies), engagement the main behavioral outcome (7 studies), and perception and attitude the main affective outcomes (12 and 14 studies, respectively).
Methods
- PRISMA-guided systematic review; Web of Science and Scopus searched; inclusion required peer-reviewed English empirical intervention studies from 2000–2023, in higher education, and in online learning environments; K-12, blended/hybrid/face-to-face, non-experimental, and conceptual works were excluded.
- Screening: 2,221 records identified; 368 duplicates removed; 491 full-text screened; 386 dropped; 105 quality-appraised; 22 failed minimum quality criteria; 83 included.
- A coding scheme based on Biggs’ (2003) four dimensions was applied in ATLAS.ti 9; inter-rater reliability was κ=0.84, p<0.001, with 84% agreement; analysis was deductive thematic coding.
Limitations
- Stated by the authors: only empirical studies were included, excluding reviews and conceptual papers; databases may have missed unindexed studies; publication bias may affect generalizability; only higher education was examined, not K-12; only English-language studies were included; and only articles from 2000–2023 were included.
- Evident from the text: included studies were geographically concentrated (30 from Taiwan, 36%; 11 from the Netherlands, 13%; 9 from the United States, 11%; 6 from China, 7%; 4 from Iran, 8%; 3 from Spain, 4%), which may limit generalizability.
- Evident from the text: the review is a qualitative synthesis without meta-analytic effect sizes; the authors themselves suggest a future meta-analysis to examine effect size.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
29 Valid · 5 Not valid · 113 Not checked · 56 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“Female students tended to produce higher-quality feedback (Noroozi etal., 2020, 2022; Slee & Jacobs, 2017) while providing negative comments with more caution (Lane etal., 2018).”
What the sources say
- Not matchedcites Noroozi etal., 2020, 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Disputedcites Slee & Jacobs, 2017 sourceExperimental — accuracy not yet measured
The 'Overall analysis of the three stages' reports higher marks for female students in stages 1 and 3, but explicitly says there was no significant gender difference in stage 2 peer-assessment marks. Stage 2 is the paper’s assessment of students’ peer feedback, so the reported gender result does not support the attributed tendency toward higher-quality feedback from female students. No page number is available in our copy. (LLM, conf=0.79)
Checked by a reasoning model — may be wrong.
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although the literature confirms the impacts of online learning environments on peer feedback performance (e.g., Lin, 2016, 2018a; Noroozi & Mulder, 2017), it does not say how different elements of learning environments can influence the design of peer feedback and its implementation.”
What the sources say
- Not matchedcites Lin, 2016, 2018a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Noroozi & Mulder, 2017 sourceExperimental — accuracy not yet measured
The Conclusions (page unavailable) say that peer-feedback support in this digital module seemed to help students provide constructive and critical feedback. That supports an effect on feedback practice, but the paper's hedged finding about one guided module does not confirm an impact of online learning environments generally on peer-feedback performance. (LLM, conf=0.82)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Some of these challenges regard students' attitudes and perceptions of peers and their feedback, such as the level of trust and low tolerance for critical feedback and resistance (Hu & Lam, 2010; Panadero & Alonso-Tapia, 2013).”
What the sources say
- Not checked — no full text of the sourcecites Hu & Lam, 2010 source
- Could not verifycites Panadero & Alonso-Tapia, 2013 sourceExperimental — accuracy not yet measured
The section “Condiciones que fomentan la autoevaluación” (page unavailable) discusses students’ motivation to assess their own work and instructional support for doing so, not challenges in receiving peer feedback. Searches for trust in peers, tolerance of criticism, and resistance found no passage in our copy addressing those claims. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“There were no significant differences in the mean grades of students allocated at different educational levels (Slee & Jacobs, 2017).”
What the sources say
- Partly supportedcites Slee & Jacobs, 2017 sourceExperimental — accuracy not yet measured
The ‘Overall analysis of the three stages’ section (page unavailable) reports no significant difference in mean marks between allocated groups or degree schemes. It does not compare educational levels: the Methods section (page unavailable) says the students were all taking a Level 4 module. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Peer feedback training has also been found to have positive effects on writing improvement (Jiang & Yu, 2014) and text revisions (Yang & Meng, 2013), although no significant increases were observed in student assessment knowledge when participating in peer assessment training (Hoffman, 2019).”
What the sources say
- Supportedcites Yang & Meng, 2013 source
The Discussion and Conclusion states that online training in providing peer feedback had positive effects on EFL college students’ text revisions. It adds that the gains were greater for less-proficient students; the citing sentence does not claim otherwise. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
111 more claims · 18 with their cited sources checked
Create a free account to see all 203 claims and to verify the 3 references still open.
- Probably not a substantial claim. 47
- It may state two separate claims as one. 52
- The quote only partly states this claim. 2
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“4 publications from Iran (8%)”
Reported 8 · recomputed 4.819277
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| | Group awareness tools | 1 | 1% | Su et al., 2022 |”
Reported 1 · recomputed 6.25
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Bhagat, R. S., & Hofstede, G. (2002) · Academy of Management Review · doi:10.5465/amr.2002.7389951 · Cited by 21,690
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
(2001) · Cited by 2,945
Contemporary Issues in Technology and Teacher Education
(2025) · Contemporary issues in technology and teacher education · doi:10.70725/833004pqfpbd · Cited by 2,368
Peer Assessment between Students in Colleges and Universities
Topping, K. (1998) · Review of Educational Research · doi:10.2307/1170598 · Cited by 2,173
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384
Self-citationBurston, J. (2013) · IALLT Journal of Language Learning Technologies · doi:10.17161/iallt.v43i2.8528 · Cited by 893
Winstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2017) · Educational Psychologist · doi:10.1080/00461520.2016.1207538 · Cited by 884
Research works printed but not linked: 8
- Al Abri, A., Al Baimani, S., & Al Bahlani, S. (2021). The role of web-based peer feedback in advancing EFL essay writing. Computer-Assisted Language Learning Electronic Journal (CALL-EJ), 22(1), 374-390. 10.29140/call-ej.v22i1.420 · doi:10.29140/call-ej.v22i1.420
- Biggs, J. B. (2003). Teaching for quality learning at university: What the student does (2nd ed.). Buckingham: Open University Press
- Golonka, L. D., & Lance, T. S. (2020). Cultural Factors in Online Learning. In L. D. Golonka & T. S. Lance (Eds.), Online learning across a random family (1st ed., pp. 69–80). Routledge.
- Li, N., Zhao, Y., Huang, X., & Tan, X. (2019b). The impact of personality traits on peer feedback in online learning environment. International Journal of Emerging Technologies in Learning, 14(19), 77–91. https://doi.org/10.3991/ijet.v14i19.10605 · doi:10.3991/ijet.v14i19.10605
- Li, N., Huang, X., Zhao, Y., & Tan, X. (2021). Understanding college students' perceptions and use of peer feedback in online learning environments: The roles of prior knowledge and educational level. Educational Technology Research and Development, 69(1), 251–272. https://doi.org/10.1007/s11423-020-09959-8 · doi:10.1007/s11423-020-09959-8
- Liu, E. Z. F., & Lee, C. Y. (2013). Using peer feedback to improve learning via online peer assessment. Turkish Online Journal of Educational Technology, 12(1), 187–199.
- Ritzhaupt, A. D., & Kumar, P. (2015). The impact of peer feedback on communication skills in online discussions. Journal of Educational Computing Research, 53(1), 31–50. https://doi.org/10.1177/0735633115592429 · doi:10.1177/0735633115592429
- Theelen, T., van der Slikke, R. M. A., de Mul, M., & van der Steen, J. (2019). Quality appraisal of systematic reviews on end-of-life care: A systematic review. Palliative medicine, 33(2), 179–188. https://doi.org/10.1177/0269216318820464 · doi:10.1177/0269216318820464
Cited by
Feedback sources in essay writing: peer-generated or AI-generated feedback?
Banihashem, S. K., Kerman, N. T., Noroozi, O., Moon, J., & Drachsler, H. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00455-4 · Cited by 282
“In response to this challenge, various solutions have emerged, among which peer feed-back has arisen as a promising alternative instructional approach (Er et al., 2021; Gao et al., 2024; Noroozi et al., 2023; Kerman et al., 2024).”
BackgroundSelf-citationGuo, K., Pan, M., Li, Y., & Lai, C. (2024) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100962 · Cited by 173
XGBoost To Enhance Learner Performance Prediction
Hakkal, S., & Lahcen, A. A. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100254 · Cited by 175
Does perception mean learning? Insights from an online peer feedback setting
Noroozi, O., Alqassab, M., Kerman, N. T., Banihashem, S. K., & Panadero, E. (2024) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2024.2345669 · Cited by 91
“Additionally, gender is increasingly recognized as a crucial factor in online learning environments, including peer feedback (Taghizadeh Kerman et al. 2023a).”
InfluentialSelf-citationA systematic review of the key components of online peer feedback practices in higher education
Gao, X., Noroozi, O., Gulikers, J., Biemans, H. J. A., & Banihashem, S. K. (2024) · Educational Research Review · doi:10.1016/j.edurev.2023.100588 · Cited by 61
Self-citation
Metadata
- Authors
- Kerman, N. T., Banihashem, S. K., Karami, M., Er, E., van Ginkel, S., & Noroozi, O.
- Affiliations
- Ferdowsi University of Mashhad (IR)
- Open University of the Netherlands (NL)
- Middle East Technical University (TR)
- Wageningen University & Research (NL)
- Corresponding author
- Noroozi, Omid
- Venue
- Education and Information Technologies
- Published
- 2023-11-14
- Volume
- 29
- Issue
- 1
- Pages
- 763-813
- ISSN
- 1360-2357 (ISSN-L)
- 1573-7608
- OpenAlex
- W4388669995
- Cited by
- 109
- References
- 124
- Citations by year
- 2026: 37 · 2025: 52 · 2024: 19 · 2023: 1
- FWCI
- 80.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Education and Information Technologies (publishedVersion, cc-by)
- OpenMETU (Middle East Technical University) (submittedVersion, cc-by-nc-nd)
- Socio-Environmental Systems Modeling (submittedVersion, cc-by)
- DSpace (Open University in the Netherlands) (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- online peer feedback, higher education, implementation factors, student characteristics, virtual learning environments, learning outcomes, self-efficacy, student motivation, student engagement, teamwork, learning platforms, teaching methods
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Online peer feedback in higher education: A synthesis of the literature. https://app.cochat.ai/papers/10.1007/s10639-023-12273-8
- The paper
- Kerman, N. T., Banihashem, S. K., Karami, M., Er, E., van Ginkel, S., & Noroozi, O. (2024). Online peer feedback in higher education: A synthesis of the literature. Education and Information Technologies. https://doi.org/10.1007/s10639-023-12273-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

