Effects of online peer assessment on higher‐order thinking: A meta‐analysis
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Online peer assessment (OPA) has been increasingly adopted to develop students' higher‐order thinking (HOT). However, there has not been a synthesis of research findings on its effects. To fill this gap, 17 papers (published from 2000 to 2022) that reported either a comparison between a group using OPA ( n = 7; k = 22) and a control group or a pre–post comparison ( n = 10; k = 17) were reviewed in this meta‐analysis. The overall effect of OPA on HOT was significant ( g = 0.76). Furthermore, OPA exerted more significant effects on convergent HOT (eg, critical thinking, reasoning and reflective thinking; g = 0.97) than on divergent HOT (eg, creativity and problem‐solving; g = 0.38). Reciprocal roles and anonymity were found to positively moderate the impacts of OPA on HOT, although their moderating effects were not statistically significant because of small sample size of studies in the analysis. The results of the meta‐analysis reinforce the arguments for regarding OPA as a powerful learning tool to facilitate students' HOT development and reveal important factors that should be considered when adopting OPA to enhance students' HOT. Practitioner notes: What is already known about this topic Online peer assessment (OPA) has significant positive impacts on learning achievement. OPA has been regarded as a potential approach to cultivating students' higher‐order thinking (HOT) but has not been proved by meta‐analysis. OPA should be carefully designed to maximise its effectiveness on learning. What this paper adds OPA has been proved to significantly positively influence students' HOT via meta‐analysis. OPA exerted more significant effects on convergent HOT than on divergent HOT. The potential of reciprocal roles and anonymity for moderating the impacts of OPA on HOT should not be underestimated. Implications for practice and/or policy OPA could be a wise choice for practitioners when they help students to achieve a balanced development of HOT dispositions and skills. Students' divergent HOT can be encouraged in their uptake of peer feedback and by allowing them autonomy in deciding assessment criteria. OPA with design elements of reciprocal roles and anonymity has great potential to promote students' HOT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01686 · Cited by 22,138
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Peer Assessment between Students in Colleges and Universities
Topping, K. (1998) · Review of Educational Research · doi:10.2307/1170598 · Cited by 2,173
Doing Meta-Analysis with R: A Hands-On Guide
Harrer, M., Cuijpers, P., Furukawa, T. A., & Ebert, D. D. (2021) · doi:10.1201/9781003107347 · Cited by 1,850
Synthesizing standardized mean‐change measures
Becker, B. J. (1988) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1988.tb00901.x · Cited by 889
Developing evaluative judgement: enabling students to make decisions about the quality of work
Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018) · Higher Education · doi:10.1007/s10734-017-0220-3 · Cited by 810
Effective peer assessment processes: Research findings and future directions
van Zundert, M., Sluijsmans, D., & van Merriënboer, J. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.004 · Cited by 536
The Impact of Peer Assessment on Academic Performance: A Meta-analysis of Control Group Studies
Double, K. S., McGrane, J. A., & Hopfenbeck, T. N. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09510-3 · Cited by 446
West, R. F., Toplak, M. E., & Stanovich, K. E. (2008) · Journal of Educational Psychology · doi:10.1037/a0012842 · Cited by 416
Cited by
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Effects of GenAI Interventions on Student Academic Performance: A Meta-Analysis
Gu, J., & Yan, Z. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251349620 · Cited by 30
“As few correlations have been reported in published articles, drawing from related studies (Borenstein et al., 2021), this study adopted a pre-post correlation of 0.5, a conventional practice commonly used in many meta-analyses (e.g., Yan et al., 2022; Zhan et al., 2023).”
InfluentialSelf-citationNie, X., Tian, Y., Liu, M., Wu, D., & Guo, Y. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13735-x · Cited by 20
“Drawing on prior meta-analysis studies of HOT (Ilgun Dibek et al., 2024; Wahono et al., 2020; Zhan et al., 2023; Zhang & Ma, 2023), this study incorporates subcat-egories such as critical thinking, metacognitive thinking, reflection, problem-solving, creativity, and computational thinking.”
InfluentialRen, X., & Zhou, Y. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2479167 · Cited by 3
Metadata
- Authors
- Zhan, Y., Yan, Z., Wan, Z. H., Wang, X., Zeng, Y., Yang, M., & Yang, L.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2023-02-22
- Volume
- 54
- Issue
- 4
- Pages
- 817-835
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W4321600721
- Cited by
- 66
- References
- 27
- FWCI
- 48.93
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Effects of online peer assessment on higher‐order thinking: A meta‐analysis. https://app.cochat.ai/papers/10.1111/bjet.13310
- The paper
- Zhan, Y., Yan, Z., Wan, Z. H., Wang, X., Zeng, Y., Yang, M., & Yang, L. (2023). Effects of online peer assessment on higher‐order thinking: A meta‐analysis. British Journal of Educational Technology. https://doi.org/10.1111/bjet.13310
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.