Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Many aspects of higher education must be reconceptualised for massive open online courses (MOOCs). Formative and summative assessment of qualitative work in particular requires novel approaches to cope with the numbers involved. Peer review has been proposed as one solution, and has been widely adopted by major MOOC providers, but there is currently little evidence about whether it is appropriate or under what conditions. Here, we examine student participation, performance and opinions of a peer review task in a biomedical science MOOC. We evaluate data from approximately 200 student topic summaries and 300 qualitative peer reviews of those summaries, and compare these to student demographic data (gender, age, employment status, education, national language) and to performance in multiple choice tests. We show that higher performance in the written topic summary correlated with both higher participation in the peer review task and with writing higher quality peer reviews. Qualitative analysis of student comments revealed that student opinion on the usefulness of the peer review task was mixed: some strongly believed it benefitted their learning, while others did not find it useful or did not participate. We suggest instructional design strategies to improve student participation and increase learning gain from peer review in the MOOC context.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Peer Assessment between Students in Colleges and Universities
Topping, K. (1998) · Review of Educational Research · doi:10.2307/1170598 · Cited by 2,173 · cited 1×
“This is less studied than quantitative peer assessment (Topping 1998), and as such has less support from the literature.”
BackgroundStudent Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170
Topping, K. J. (2009) · Theory Into Practice · doi:10.1080/00405840802577569 · Cited by 785 · cited 1×
“The benefits of using peer assessment and review in teaching include the capacity to give feedback to large numbers (Topping 2009), and the transferable skills gained by students during the process (Morris 2001).”
BackgroundImproving the effectiveness of peer feedback for learning
Gielen, S., Peeters, E., Dochy, F., Onghena, P., & Struyven, K. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.007 · Cited by 615 · cited 3×
“Marking criteria for peer reviews gielen et al. (2010) summarise criteria used to define ‘good’ qualitative feedback such as the presence of thought-provoking questions or comments, and constructive suggestions.”
BackgroundInfluentialPeer reviewers learn from giving comments
Cho, Y. H., & Cho, K. (2011) · Instructional Science · doi:10.1007/s11251-010-9146-1 · Cited by 294 · cited 1×
“Cho and Cho (2011) show that peer feedback without grading improves student performance, and suggest that quality comments focusing on meaning rather than surface features are more likely to have this beneficial effect.”
BackgroundDemiraslan Çevik, Y. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.05.056 · Cited by 42
Cited by
Teacher feedback literacy and its interplay with student feedback literacy
Carless, D., & Winstone, N. (2023) · Teaching in Higher Education · doi:10.1080/13562517.2020.1782372 · Cited by 603
Progress and new directions for teaching and learning in MOOCs
Deng, R., Benckendorff, P., & Gannaway, D. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.10.019 · Cited by 273
Liu, X., & Zhong, B. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100741 · Cited by 78
Zhan, Y. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1804826 · Cited by 59
Pereira, J., Fernández-Raga, M., Osuna-Acedo, S., Roura-Redondo, M., Almazán-López, O., & Buldón-Olalla, A. (2019) · Technology Knowledge and Learning · doi:10.1007/s10758-019-09414-9 · Cited by 59
Metadata
- Authors
- Meek, S. E. M., Blakemore, L., & Marks, L.
- Venue
- Assessment & Evaluation in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2016-08-15
- Volume
- 42
- Issue
- 6
- Pages
- 1000-1013
- ISSN
- 0260-2938 (ISSN-L)
- 1469-297X
- OpenAlex
- W2516204696
- Cited by
- 97
- References
- 6
- FWCI
- 53.08
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review. https://app.cochat.ai/papers/10.1080/02602938.2016.1221052
- The paper
- Meek, S. E. M., Blakemore, L., & Marks, L. (2017). Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2016.1221052
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.