Reciprocity as a Source of Bias in Multiple Peer Assessment of Group Work
The DOI matches its Crossref record.
Abstract
Concerns about the use of peer ratings for assessment purposes are manifold. The issues which are raised by practitioners and researchers, and findings based on recent studies addressing these issues, are outlined. One of the most persistent criticisms is that peer ratings in group settings are prone to bias, resulting in unfairness of mark outcomes. The bias is seen to arise as a result of friendships and social interactions accompanying group task activities. Support for the belief that the validity and fairness of peer ratings are vitiated by 'relational effects' is found in the literature on small group behaviour and interactionist theory. Empirical studies in these two areas operationalise relational effects in what is termed 'reciprocation' - the tendency for two people who are involved in rating each other to be influenced in their rating behaviour by social interactions between the two. The effect of this on rating outcomes, referred to as 'reciprocity effects', is seen to be a major source of bias. The study reported here analyses a data set of multiple peer ratings which had been used as part of the assessment for a subject in community medicine. The analysis is based on cell-by-cell correlation analysis of reciprocal (rater/ratee) pairs, enabling an estimate of the proportion of the variance in scores accounted for by 'reciprocity effects'. The effect was found to be negligible, accounting for only 1% of the variance. Implications for practitioners and for small group behaviour research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The empirical work that has been carried out (a) finds little evidence of collusive behaviour, (b) analyses data from group work activities that are unusual in numerous ways and (c) is rather dated (Magin 2001;Montgomery 1986).”
From Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work? (2026) · cites this paper as Magin 2001
In the citing paper
“The empirical work that has been carried out (a) finds little evidence of collusive behaviour, (b) analyses data from group work activities that are unusual in numerous ways and (c) is rather dated (Magin 2001;Montgomery 1986).”
From Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work? (2026) · cites this paper as Magin 2001
In the citing paper
“Therefore, studies that have investigated the issue tend to quantify the extent to which they jointly occur (see Edgerton and McKechnie 2002;Magin 2001;Montgomery 1986) and so place an upper limit of collusion.”
From Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work? (2026) · cites this paper as Magin 2001
In the citing paper
“The empirical work that has been carried out (a) finds little evidence of collusive behaviour, (b) analyses data from group work activities that are unusual in numerous ways and (c) is rather dated (Magin 2001;Montgomery 1986).”
From Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work? (2026) · cites this paper as Magin 2001
In the citing paper
“The findings mirror those of Montgomery (1986) with the combination of relational effects and collusion only able to explain one percent of the variation in the peer scores.”
From Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work? (2026) · cites this paper as Magin 2001
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 33
- ARCHER J., 1992, The Psychologist, 5, 200
- 10.1080/03075079712331381034 · DOI · Paper page
- BELSEY C., 1988, AUT Women: a newsletter published by the Association of University Teachers, 15, 1
- 10.1080/00219266.1997.9655566 · DOI
- 10.1037/0021-9010.80.1.168 · doi:10.1037/0021-9010.80.1.168 · Paper page
- BOUD D., 1986, Implementing Student Self-assessment
- 10.1080/0260293930180101 · doi:10.1080/0260293930180101
- 10.1037/0033-2909.88.1.78 · doi:10.1037/0033-2909.88.1.78
- 10.1080/1356215980030106 · DOI · Paper page
- 10.1080/0260293800050305 · DOI
- 10.1080/08832323.1992.10117564 · DOI · Paper page
- 10.1002/1520-6629(197304)1:2<177::AID-JCOP2290010206>3.0.CO;2-5 · DOI
- 10.1080/0260293940190105 · DOI
- FALCHIKOV N., 1994, Group and Interactive Learning, 411
- 10.1080/0260293970220403 · DOI
- FERGUSON G., 1971, Statistical Analysis in Psychology and Education,
- HELMORE P., Proceedings of the Ist UICEE Conference on Engineering Education, 284
- HOUNSELL D., 1996, The ASSHE Inventory: changing assessment practices in Scottish higher education
- 10.1177/014662169101500411 · doi:10.1177/014662169101500411
- 10.1037/0022-006X.46.6.1171 · doi:10.1037/0022-006x.46.6.1171
- KLEINKE C., 1979, Self Disclosure, 59
- 10.1080/0260293970220106 · doi:10.1080/0260293970220106
- MAGIN D., Proceedings of the International Conference on Improving University Learning and Teaching, 547
- 10.1111/j.1467-8535.1994.tb00086.x · DOI
- MILLAR F., 1976, Explorations in Interpersonal Communication, 87
- 10.1177/104649648601700102 · DOI · Paper page
- 10.1080/1355800950320404 · DOI
- 10.1080/0260293900150204 · DOI · Paper page
- 10.1080/0260293960210106 · DOI
- 10.1080/03075079412331382153 · DOI · Paper page
- SWANSON D., 1991, The Challenge of Problem Based Learning, 260
- 10.1037/0022-3514.37.10.1742 · doi:10.1037/0022-3514.37.10.1742 · Paper page
- 10.1177/001316448804800109 · doi:10.1177/001316448804800109
Cited by
Effective peer assessment processes: Research findings and future directions
van Zundert, M., Sluijsmans, D., & van Merriënboer, J. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.08.004 · Cited by 536
Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system
Cho, K., & Schunn, C. D. (2007) · Computers & Education · doi:10.1016/j.compedu.2005.02.004 · Cited by 521
Cho, K., Schunn, C. D., & Wilson, R. W. (2006) · Journal of Educational Psychology · doi:10.1037/0022-0663.98.4.891 · Cited by 355
“However, students and instructors are leery of peer grading schemes (Boud, 1989; Cho & Schunn, in press; Lynch & Golen, 1992; Magin, 2001; Rushton et al., 1993; Stefani, 1994; Swanson, Case, & van der Vlueten, 1991).”
BackgroundSelf and Peer Assessment in School and University: Reliability, Validity and Utility
Topping, K. (2006) · Innovation and Change in Professional Education · doi:10.1007/0-306-48125-1_4 · Cited by 346
Panadero, E., Romero, M., & Strijbos, J.-W. (2013) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.005 · Cited by 195
Metadata
- Authors
- Magin, D.
- Venue
- Studies in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2001-03
- Volume
- 26
- Issue
- 1
- Pages
- 53-63
- ISSN
- 0307-5079
- 1470-174X
- Cited by
- 71
- References
- 0
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reciprocity as a Source of Bias in Multiple Peer Assessment of Group Work. https://app.cochat.ai/papers/10.1080/03075070020030715
- The paper
- Magin, D. (2001). Reciprocity as a Source of Bias in Multiple Peer Assessment of Group Work. Studies in Higher Education. https://doi.org/10.1080/03075070020030715
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.