Structuring the peer assessment process: a multilevel approach for the impact on product improvement and peer feedback quality
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
In order to optimize students' peer feedback processes, this study investigates how an instructional intervention in the peer assessment process can have a beneficial effect on students' performance in a wiki environment in first‐year higher education. The main aim was to study the effect of integrating a peer feedback template with a varying structuring degree. The present study involved three conditions: a no structure, a basic structure and an elaborate structure condition. Due to a clear hierarchical structure, in which over time (level 1), 168 students (level 2) are nested within 37 groups (level 3), multilevel analysis was performed to examine the effect of time, student and group level influences on students' peer feedback quality and product scores. The results revealed that both peer feedback quality and product scores increase significantly for all conditions over time, after multiple practice occasions. In addition, after several practice occasions, significant differences were found between the conditions in both peer feedback (elaborate higher than no structure) and product scores (elaborate and basic higher than no structure). Building on this, limitations, directions for future research and practical implications are presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1×
“Peer feedback as educational practice Several authors (e.g., Black & William, 1998) have emphasized on the power of assessment for the learning process rather than assessment of learning.”
BackgroundKirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Peer Assessment between Students in Colleges and Universities
Topping, K. (1998) · Review of Educational Research · doi:10.2307/1170598 · Cited by 2,173 · cited 5×
“This is in line with research, which underlines that feedback can have a large impact on performance (Nelson & Schunn, 2008), as it ‘might also reveal the next small steps needed to improve quality’ (Topping, 1998, p. 255).”
BackgroundResultInfluentialBeyond feedback: developing student capability in complex appraisal
Sadler, D. R. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903541015 · Cited by 1,138
Rethinking feedback practices in higher education: a peer review perspective
Nicol, D., Thomson, A., & Breslin, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.795518 · Cited by 966
Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning
van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_2 · Cited by 857 · cited 5×
“Scoring rubric for quality of peer feedback messages Firstly, the rubric to assess the peer feedback quality is based upon the FQI (Prins et al., 2006), which, in turn, is based upon several prior studies (e.g., Sluijsmans, Brand-Gruwel, & Van Merriënboer, 2002).”
BackgroundInfluentialThe use of scoring rubrics for formative assessment purposes revisited: A review
Panadero, E., & Jonsson, A. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.002 · Cited by 839
Topping, K. J. (2009) · Theory Into Practice · doi:10.1080/00405840802577569 · Cited by 785 · cited 1×
“Previously, PA is defined as ‘an arrangement for learners to consider and specify the level, value, or quality of a product or performance of other equal-status learners’ (Topping, 2009, p. 20).”
BackgroundImproving the effectiveness of peer feedback for learning
Gielen, S., Peeters, E., Dochy, F., Onghena, P., & Struyven, K. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.007 · Cited by 615
The nature of feedback: How different types of peer feedback affect writing performance
Nelson, M. M., & Schunn, C. D. (2009) · Instructional Science · doi:10.1007/s11251-008-9053-x · Cited by 602 · cited 3×
“Logically, previous research suggested that some types of feedback are more effective than others (Nelson & Schunn, 2008).”
BackgroundMethodResultToward a script theory of guidance in computer-supported collaborative learning
Fischer, F., Kollar, I., Stegmann, K., & Wecker, C. (2013) · Educational Psychologist · doi:10.1080/00461520.2012.748005 · Cited by 525 · cited 2×
“As a script specifies, plans and assigns roles and activities for collaborative learning activities (e.g., Fischer et al., 2013), a script can be seen as an instructional collaboration scenario (O’Donnell & Dansereau, 1992), which concentrates on socio-cognitive structuring (Kollar, Fischer, &…”
BackgroundStructuring Peer Interaction to Promote High-Level Cognitive Processing
King, A. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4101_6 · Cited by 320
On-line peer assessment and the role of the peer feedback: A study of high school computer course
Tseng, S.-C., & Tsai, C.-C. (2007) · Computers & Education · doi:10.1016/j.compedu.2006.01.007 · Cited by 293 · cited 1×
“While the present study showed an effect in the later phase, earlier research (Tseng & Tsai, 2007) showed that suggestive feedback was especially valuable in the initial phase of PA, but that its importance declined in the later phase.”
ResultUnravelling peer assessment: Methodological, functional, and conceptual developments
Strijbos, J.-W., & Sluijsmans, D. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.002 · Cited by 223 · cited 1×
“More particularly, research lacks a rigid approach on how PA practices should be tailored in function of students’ learning (Strijbos & Sluijsmans, 2010).”
BackgroundPanadero, E., Romero, M., & Strijbos, J.-W. (2013) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.005 · Cited by 195
Hovardas, T., Tsivitanidou, O. E., & Zacharia, Z. C. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.09.019 · Cited by 176
Van Steendam, E., Rijlaarsdam, G., Sercu, L., & Van den Bergh, H. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.009 · Cited by 124
Cited by
Latifi, S., Noroozi, O., & Talaee, E. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13054 · Cited by 163
Guo, K., Pan, M., Li, Y., & Lai, C. (2024) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100962 · Cited by 173
Bauer, E., Greisel, M., Kuznetsov, I., Berndt, M., Kollar, I., Dresel, M., Fischer, M. R., & Fischer, F. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13336 · Cited by 130
“The support measures in prior research addressed the three feedback questions and four content levels by providing instructions and prompts, assessment scripts with structural scaffolds, structural guidelines, and structural templates (Alqassab et al., 2018b; Gielen & De Wever, 2015).”
BackgroundMethodGielen, M., & De Wever, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.06.019 · Cited by 122
Self-citationUsing learning analytics to understand student perceptions of peer feedback
Misiejuk, K., Wasson, B., & Egelandsdal, K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106658 · Cited by 98
Metadata
- Authors
- Gielen, M., & De Wever, B.
- Venue
- Journal of Computer Assisted Learning
- Publisher
- Wiley
- Published
- 2015-01-30
- Volume
- 31
- Issue
- 5
- Pages
- 435-449
- ISSN
- 0266-4909 (ISSN-L)
- 1365-2729
- OpenAlex
- W2150360844
- Cited by
- 75
- References
- 21
- FWCI
- 24.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.