Structuring the peer assessment process: a multilevel approach for the impact on product improvement and peer feedback quality
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
In order to optimize students' peer feedback processes, this study investigates how an instructional intervention in the peer assessment process can have a beneficial effect on students' performance in a wiki environment in first‐year higher education. The main aim was to study the effect of integrating a peer feedback template with a varying structuring degree. The present study involved three conditions: a no structure, a basic structure and an elaborate structure condition. Due to a clear hierarchical structure, in which over time (level 1), 168 students (level 2) are nested within 37 groups (level 3), multilevel analysis was performed to examine the effect of time, student and group level influences on students' peer feedback quality and product scores. The results revealed that both peer feedback quality and product scores increase significantly for all conditions over time, after multiple practice occasions. In addition, after several practice occasions, significant differences were found between the conditions in both peer feedback (elaborate higher than no structure) and product scores (elaborate and basic higher than no structure). Building on this, limitations, directions for future research and practical implications are presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1×
“Peer feedback as educational practice Several authors (e.g., Black & William, 1998) have emphasized on the power of assessment for the learning process rather than assessment of learning.”
BackgroundKirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Peer Assessment between Students in Colleges and Universities
Topping, K. (1998) · Review of Educational Research · doi:10.2307/1170598 · Cited by 2,173 · cited 5×
“This is in line with research, which underlines that feedback can have a large impact on performance (Nelson & Schunn, 2008), as it ‘might also reveal the next small steps needed to improve quality’ (Topping, 1998, p. 255).”
BackgroundResultInfluentialBeyond feedback: developing student capability in complex appraisal
Sadler, D. R. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903541015 · Cited by 1,138
Rethinking feedback practices in higher education: a peer review perspective
Nicol, D., Thomson, A., & Breslin, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.795518 · Cited by 966
Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning
van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_2 · Cited by 857 · cited 5×
“Scoring rubric for quality of peer feedback messages Firstly, the rubric to assess the peer feedback quality is based upon the FQI (Prins et al., 2006), which, in turn, is based upon several prior studies (e.g., Sluijsmans, Brand-Gruwel, & Van Merriënboer, 2002).”
BackgroundInfluential
Cited by
Latifi, S., Noroozi, O., & Talaee, E. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13054 · Cited by 163
Guo, K., Pan, M., Li, Y., & Lai, C. (2024) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100962 · Cited by 173
Bauer, E., Greisel, M., Kuznetsov, I., Berndt, M., Kollar, I., Dresel, M., Fischer, M. R., & Fischer, F. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13336 · Cited by 130
“The support measures in prior research addressed the three feedback questions and four content levels by providing instructions and prompts, assessment scripts with structural scaffolds, structural guidelines, and structural templates (Alqassab et al., 2018b; Gielen & De Wever, 2015).”
BackgroundMethodGielen, M., & De Wever, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.06.019 · Cited by 122
Self-citationUsing learning analytics to understand student perceptions of peer feedback
Misiejuk, K., Wasson, B., & Egelandsdal, K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106658 · Cited by 98
Supporting argumentative essay writing through an online supported peer-review script
Latifi, S., & Noroozi, O. (2021) · Innovations in Education and Teaching International · doi:10.1080/14703297.2021.1961097 · Cited by 46
Huisman, B., Admiraal, W., Pilli, O., van de Ven, M., & Saab, N. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12520 · Cited by 42
Peters, O., Körndle, H., & Narciss, S. (2018) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0344-y · Cited by 37
Lahza, H. F., Demartini, G., Noroozi, O., Gašević, D., Sadiq, S., & Khosravi, H. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105260 · Cited by 16
Metadata
- Authors
- Gielen, M., & De Wever, B.
- Venue
- Journal of Computer Assisted Learning
- Publisher
- Wiley
- Published
- 2015-01-30
- Volume
- 31
- Issue
- 5
- Pages
- 435-449
- ISSN
- 0266-4909 (ISSN-L)
- 1365-2729
- OpenAlex
- W2150360844
- Cited by
- 75
- References
- 21
- FWCI
- 24.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.