An experience with peer assessment in the context of a Computer Systems course
Abstract
In this paper, situated in the Research-to-Practice Category, we describe a Work in Progress on the application of Peer Assessment in the context of a Computer Science course. Peer Assessment has been studied both as way of generating learning experiences and as a way of improving the efficiency and accuracy of the feedback loop. We report on this paper the execution of a Peer Assessment activity on a Computer Systems course. After solving an one-hour quiz containing easy to moderate questions, students received a set of detailed grading instructions and were asked to grade a colleague's quiz. We borrow concepts from rubric design to create informative grading instructions that relate parts of the student's answers to the learning objectives of the quiz. Students received support from the instructor on how to grade but not on their grading. We validated our experience by analysing student perception using a questionnaire and by comparing student assigned grades to instructor assigned ones. Encouraging results were found to support both the learning and the grading aspects, although sample size (N=20) did not allow more complex statistical analysis to be performed. We also analyzed the in-class execution of the activity, listing successes and points of improvement.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Oral presentation, portfolios, articles, test performances, online discussions, and quizzes are the most common products observed during the survey that are assessed using the peer assessment approach.
“Oral presentation, portfolios, articles, test performances, online discussions, quizzes, etc., are the most common products observed during the survey that are assessed using peer assessment approach [53,54].”
From Artificial Intelligence for Assessment and Feedback to Enhance Student Success in Higher Education (2022) · cites this paper as [54]
Cites
Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170 · see citing works
The use of scoring rubrics for formative assessment purposes revisited: A review
Panadero, E., & Jonsson, A. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.002 · Cited by 839 · see citing works
The Impact of Self- and Peer-Grading on Student Learning
Sadler, P., & Good, E. (2006) · Educational Assessment · doi:10.1207/s15326977ea1101_1 · Cited by 535 · cited 1× · see citing works
“Some works [1], [2] focus on the logistical benefits of peer assessment, such as quicker feedback and the possibility of offloading some of the grading to students.”
BackgroundUsing Rubrics To Promote Thinking and Learning.
Andrade, H. G. (2000) · Educational leadership · Cited by 528 · see citing works
Computer Systems A Programmer's Perspective 1
Bryant, R. E., & O’Hallaron, D. R. (1991) · Cited by 342 · see citing works
How to Create and Use Rubrics for Formative Assessment and Grading
สรุปราษฎร์, จ. (2014) · วารสารวิธีวิทยาการวิจัย (Journal of Research Methodology: JRM) · Cited by 264 · see citing works
How to Create and Use Rubrics for Formative Assessment and Grading
Brookhart, S. M. (2013) · Medical Entomology and Zoology · Cited by 225 · see citing works
Reily, K., Finnerty, P. L., & Terveen, L. (2009) · International ACM SIGGROUP Conference on Supporting Group Work (GROUP) · doi:10.1145/1531674.1531692 · Cited by 87 · see citing works
A method of automatic grade calibration in peer assessment
Hamer, J., Kenneth, T. K., & Kwong, H. H. F. (2005) · Cited by 60 · see citing works
A design for team peer code review
Trytten, D. (2005) · ACM SIGCSE Bulletin · doi:10.1145/1047124.1047492 · Cited by 54 · see citing works
Wright, J. R., Thornton, C., & Leyton‐Brown, K. (2015) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2676723.2677278 · Cited by 47 · see citing works
Electronic peer review and peer grading in computer-science courses
Gehringer, E. F. (2001) · ACM SIGCSE Bulletin · doi:10.1145/366413.364564 · Cited by 46 · see citing works
A design for team peer code review
Trytten, D. (2005) · ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/1047344.1047492 · Cited by 34 · see citing works
Søndergaard, H. (2009) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/1562877.1562893 · Cited by 33 · see citing works
The Effects of Peer- and Self-assessment on the Assessors
Park, J., & Williams, K. A. (2016) · doi:10.1145/2839509.2844602 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Artificial Intelligence for Assessment and Feedback to Enhance Student Success in Higher Education
Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/5215722 · Cited by 444 · see citing works
Shivshankar, S., & Acharya, N. K. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-7220-3.ch006 · Cited by 11 · see citing works
Design of peer assessment rubrics for ICT topics
Bowen-Mendoza, L. E., Pinargote-Ortega, M., Meza, J., & Ventura, S. (2021) · Journal of Computing in Higher Education · doi:10.1007/s12528-021-09297-9 · Cited by 5 · see citing works
Matejić, J. (2025) · Journal of Educational Studies in Mathematics and Computer Science · doi:10.5937/jesmac2501056m
- Authors
- Montagner, I. S.
- Venue
- 2019 IEEE Frontiers in Education Conference (FIE)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 1-5
- ISSN
- 0190-5848 (ISSN-L)
- OpenAlex
- W3011608076
- Cited by
- 4
- References
- 15
- Citations by year
- 2025: 1 · 2024: 1 · 2022: 1 · 2021: 1
- FWCI
- 2.68
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Frontiers in Education Conference (FIE) (publishedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- peer assessment, peer grading, computer systems course, computer science education, rubric development, feedback loops, student perceptions, instructor support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review