The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index; none of the 38 sources its claims cite is checked for support yet.
Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work?
Open accessAbstract
Peer assessment is one way of adjusting assessed group work grades into individual marks that may better reflect the different contributions of each student. However, people question the extent to which the peer-assessment scores reflect the actual contribution of each team member. One factor that might cause them to diverge is the presence of collusive behaviour. This paper develops a method to formally quantify the extent of this problem: Firstly, we identify student pairs in groups that award each other high peer-assessment scores (mutual high scoring – MHS). Secondly, we exclude cases where MHS appear to reflect higher actual contributions by these two students. Applying this method to peer-assessment data from an assessed group work assignment of an 1st year applied economics module, we find evidence of potential collusion in only 4–7 percent of all student pairs. However, the share of groups that contain at least one pair of students that were potentially colluding was quite high at 35–55 percent. This suggests that although collusion was not widespread across the cohort, it did occur between two team members in a relatively large number of the groups. Therefore, when implementing peer-assessment schemes in assessed group work, the potential issue of collusion needs to be considered by tutors.
Overview
CoChat Summary
TL;DR
The paper develops a two-step method to estimate potential collusion in summative peer assessment of assessed group work, using mutual high scoring (MHS) and then excluding cases where MHS reflects genuinely higher contributions. In a first-year applied economics module, potential collusion appears in a small share of student pairs but affects a substantial minority of groups, so tutors should consider collusion when designing peer-assessment schemes.
Key findings
- Stage 1 identified mutual high scoring in 16.8% of student-pair evaluations (69 of 411 pairs).
- After Stage 2 controls, the abstract reports evidence of potential collusion in only 4–7% of all student pairs; the results/conclusion report threshold-dependent estimates of 3–9% of pairs (e.g., 9.0% at threshold a = 1, 7.3% at a = 2, 4.1% at a = 3, 3.6% at a = 4, 2.7% at a = 5).
- At group level, the abstract reports 35–55% of groups contained at least one potentially colluding pair; the conclusion reports 19–55% depending on threshold, with 45–81% of groups having no potential collusion cases.
- Using a broader definition of collusion increased potential cases only slightly (e.g., 11.7% vs 9.0% of all pairs at a = 1).
Methods
- Design: a two-step dyadic method. Stage 1 identifies student pairs who award each other above-average peer-assessment scores (MHS). Stage 2 compares those mutual scores with the average scores the same students receive from other group members, using thresholds a = 1, 2, 3, 4, 5 to classify potential collusion.
- Data/sample: peer-assessment data from a mandatory first-year applied economics module with assessed group work; 175 students, 31 groups, average group size 5.8, and 411 unique student pairs. Students used a fixed-point scheme allocating 100 effort points, with 25% of the group mark adjusted by peer-assessment scores.
- Analysis: pair-level and group-level analysis of potential collusion, plus a robustness check using a broader definition that includes equal-scoring cases where pairs may still exceed actual contributions.
Limitations
- The paper states the measure identifies only potential cases, not actual collusion, and cannot differentiate collusion from subconscious relational effects or differing levels of asymmetric information; all estimates are therefore upper limits.
- The paper notes future research should triangulate the quantitative measure with qualitative data such as research logs, questionnaires, and written peer-score justifications.
- Evident from the text: the empirical application is from a single first-year applied economics module/cohort, and results are sensitive to the chosen threshold, so generalisability and threshold dependence should be treated cautiously.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 4 Not valid · 24 Not checked · 46 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the share of groups that contain at least one pair of students that were potentially colluding was quite high at 35-55 percent.”
- Also stated in: § 1 Introduction · plain
“However, the share of groups that contain at least one pair of students that were potentially colluding was quite high at 35-55 per cent.”
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 Introduction · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Applying this method to peer-assessment data from an assessed group work assignment of an 1st year applied economics module, we find evidence of potential collusion in only 4-7 percent of all student pairs.”
- Also stated in: § 1 Introduction · plain
“We find evidence of potential collusion in only 4-7 per cent of all student pairs in our data.”
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 Introduction · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Depending on the threshold chosen, between 19 and 55 per cent of the groups include at least one pair of students who awarded each other scores that appear to exceed their actual contribution to the work.”
- Also stated in: § 4.2. Group-level analysis · hedged
“Dependent on a, between 19% to 55% of all groups appear to be affected by at least one pair of students potentially colluding with one another.”
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > 5. Conclusions and recommendations
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4.2. Group-level analysis · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In 16.8% of student-pair evaluations mutual-high scoring was identified, meaning that students gave each other scores above the average contribution level.”
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > 4.1. Pair-level analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In our study, 55% of students scored all their team members equally so the z-score approach was unsuitable because of the resulting loss of data.”
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > 3.3. Measuring collusion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
27 more claims
Create a free account to see all 74 claims and to verify the 32 references still open.
- Probably not a substantial claim. 34
- It may state two separate claims as one. 12
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Number of Students | 175 | | --- | --- | | Number of Groups | 31 | | Av. Size | 5.8 |”
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > Notes
Reported 5.8 · recomputed 5.645161
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > 3.2. Illustrating potential cases of collusion
“Collusion has resulted in two students increasing their marks by 4 percentage points while reducing the marks of the other three students in the group by 2 percentage points.”
§ Does widespread collusion undermine the case for using peerassessment schemes with assessed group work? > 3.2. Illustrating potential cases of collusion
“while students 'A', 'C' 'D' and 'F' would each receive 68 per cent.”
Citations
Cites
Topping, K. J. (2009) · Theory Into Practice · doi:10.1080/00405840802577569 · Cited by 785 · cited 2×
“However, there is consensus in the literature that peer assessment is both complex and difficult (Topping 2009; Sridharan, Tai, and Boud 2019), making it a challenging task for students.”
Jehn, K. A., & Shah, P. P. (1997) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.72.4.775 · Cited by 561
Social Loafing on Group Projects: Structural Antecedents and Effect on Student Satisfaction
Aggarwal, P., & O'Brien, C. L. (2008) · Journal of Marketing Education · doi:10.1177/0273475308322283 · Cited by 327
Brooks, C. M., & Ammons, J. L. (2003) · Journal of Education for Business · doi:10.1080/08832320309598613 · Cited by 312
A new round robin analysis of variance for social interaction data.
Warner, R. M., Kenny, D. A., & Stoto, M. (1979) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.37.10.1742 · Cited by 312
Having second thoughts: Student perceptions before and after a peer assessment exercise
Cheng, W., & Warren, M. (1997) · Studies in Higher Education · doi:10.1080/03075079712331381064 · Cited by 219
Panadero, E., Romero, M., & Strijbos, J.-W. (2013) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.10.005 · Cited by 195
A social relations variance partitioning of dyadic behavior.
Kenny, D. A., Mohr, C. D., & Levesque, M. J. (2001) · Psychological Bulletin · doi:10.1037//0033-2909.127.1.128 · Cited by 182
Peer Assessment in Problem-Based Learning: A Qualitative Study
Papinczak, T., Young, L., & Groves, M. (2007) · Advances in Health Sciences Education · doi:10.1007/s10459-005-5046-6 · Cited by 164
Free-Riding in Group Projects: Control Mechanisms and Preliminary Data
Strong, J. T., & Anderson, R. E. (1990) · Journal of Marketing Education · doi:10.1177/027347539001200208 · Cited by 163
Cited by
Singgalen, Y. A., Efendi, & Abrahamsz, J. G. (2026) · Journal of Information Systems and Informatics · doi:10.63158/journalisi.v8i5.1836
Metadata
- Authors
- Riegler, R., & Guest, J.
- Affiliations
- Aston University (GB)
- Corresponding author
- Riegler, Robert
- Venue
- Studies in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2025-02-24
- Volume
- 51
- Issue
- 2
- Pages
- 295-308
- ISSN
- 0307-5079 (ISSN-L)
- 1470-174X
- OpenAlex
- W4407900960
- Semantic Scholar
- e2d24167ad76ea6342cf364a9707b3e02923f391
- Cited by
- 1
- References
- 33
- Citations by year
- 2026: 1
- FWCI
- 0.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Studies in Higher Education (publishedVersion, cc-by)
- Aston Publications Explorer (Aston University) (submittedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- peer assessment, collusion, academic dishonesty, student contributions, grading fairness, team-based assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work? https://app.cochat.ai/papers/10.1080/03075079.2025.2465687
- The paper
- Riegler, R., & Guest, J. (2026). Does widespread collusion undermine the case for using peer-assessment schemes with assessed group work? Studies in Higher Education. https://doi.org/10.1080/03075079.2025.2465687
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


