Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index; 4 of the 15 sources its claims cite were checked for support.

Comparing Student Preferences for AI-Generated and Peer-Generated Feedback in AI-driven Formative Peer Assessment

Open access
Shin, Insub, Hwang, Su Bhin, Yoo, Yun Joo, Bae, Sooan, Kim, Rae Yeong · 2025 · Proceedings of the 15th International Learning Analytics and Knowledge Conference

Abstract

Formative assessment can enhance student learning and improve teaching practices by identifying areas for growth and providing feedback. However, practical obstacles remain, such as time constraints and students’ passive participation and the low quality of peer feedback. Artificial intelligence (AI) has been explored for its potential to automate grading and provide timely feedback, making it a valuable tool in formative assessment. Nevertheless, there is still limited research on how AI can be used effectively in the context of formative peer assessment. In this study, we conducted an AI-driven formative peer assessment with 108 secondary school students. During the peer assessment process, students not only evaluated peers’ responses and received peer-generated feedback, but also evaluated AI-generated responses and received AI-generated feedback. This research focused on analyzing the differences in preference between AI-generated and peer-generated feedback using trace data and dispositional data. In scenarios where student participation was low or the quality of peer feedback was insufficient, students showed a higher preference for AI-generated feedback, demonstrating its potential utility. However, students with high Math Confidence and AI Interest preferred peer-generated feedback. Based on these findings, we will propose practical strategies for implementing AI-driven formative peer assessment.

Overview

CoChat Summary

TL;DR

In an AI-driven formative peer assessment with 108 South Korean secondary school sophomores, students in lower-achievement classes preferred AI-generated feedback, while a high-achievement/high-interest class preferred peer-generated feedback. Dispositional factors and trace data predicted feedback preferences and informed implementation recommendations.

Key findings

  • Class A and Class C preferred AI-generated feedback over peer-generated feedback (ANOVA significant at p<0.0001 and p<0.05, respectively); Class D preferred peer-generated over AI-generated feedback (p<0.01); Class B showed no statistically significant preference for peer-generated over AI-generated feedback.
  • Disposition-level comparisons found that low Math Confidence, low Math Value, low AI Relevance, and low AI Interest groups preferred AI-generated feedback over feedback from peers who answered incorrectly on their first attempt (Group 3) at p<0.1, p<0.01, p<0.1, and p<0.1, respectively; Math Anxiety and Math Interest showed no statistically significant differences.
  • AI-generated feedback preference model predictors: Math Confidence −0.277 (p<0.01), Math Value −0.165 (p<0.1), PeerPreferences 0.855 (p<0.001), CorrectRatio −0.205 (p<0.05). Peer-generated feedback preference model predictors: Math Anxiety −0.133 (p<0.10), Math Value −0.176 (p<0.10), AI Relevance −0.160 (p<0.05), Math Interest 0.252 (p<0.01), Feedback Length 0.194 (p<0.01).
  • Recommended practices include using AI-generated feedback in low-participation classes, math-learning difficulties, and low correct-response-rate problems; ensuring validity because high AI Interest students are sensitive to hallucination; and prioritizing human peers for students with high Math Confidence and Math Value.

Methods

  • Participants were 108 secondary school sophomores in four mathematics classes (Class A N=27, Class B N=26, Class C N=29, Class D N=26) in South Korea; the course was face-to-face, with 2–3 AI-driven formative peer assessments per class using the same problems, and AI (GPT-4) participated anonymously as a peer.
  • Students submitted a solution and answer, evaluated peers’ and AI-generated responses, received anonymous AI- and peer-generated feedback, and rated feedback effectiveness on a 5-point Likert scale. Trace data included FirstAttemptCorrect, FirstAttemptTime, Preference, FeedbackLength, PeerPreferences, PeerFeedbackLength, and CorrectRatio; dispositional survey data measured Math Anxiety, Math Confidence, Math Interest, Math Value, AI Relevance, and AI Interest after confirmatory factor analysis item removal (α = 0.84, 0.91, 0.75, 0.85, 0.81, 0.85, respectively).
  • Analysis used ANOVA with Dunnett’s post-hoc test to compare preferences among Group 1 (AI-generated, N=182), Group 2 (peer correct first attempt, N=153), and Group 3 (peer incorrect first attempt, N=154); linear regression predicted feedback preference from trace and dispositional data after a Linear Mixed Model random effect was not statistically significant.

Limitations

  • Stated: the study was conducted face-to-face with 108 students; future work should explore distance learning, higher education, and MOOCs. Dispositional data scope was limited, and future research should include self-regulated learning, goal-setting, help-seeking, and motivation. AI hallucination rate varied across items, and future work could optimize the model. AI facilitated evaluation despite low participation but did not increase participation itself.
  • Evident from text: the sample is limited to secondary school sophomores in one mathematics course in South Korea, so findings may not generalize to other populations or subjects.
  • Evident from text: the provided text omits numeric R² values for the prediction models, so variance explained cannot be assessed from this text.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3706468.3706488

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

3 Valid · 3 Not valid · 10 Not checked · 72 Own results and interpretations

44 more claims

Create a free account to see all 88 claims and to verify the 3 references still open.

See all claims — free account
  • Probably not a substantial claim. 20
  • It may state two separate claims as one. 26

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 43 references

Research works printed but not linked: 3

  1. Jacqueline Bichsel. 2012. Analytics in higher education: Benefits, barriers, progress, and recommendations. EDUCAUSE Center for Applied Research.
  2. Murat Kahveci. 2010. Students’ Perceptions to Use Technology for Learning: Measurement Integrity of the Modified Fennema-Sherman Attitudes Scales. Turkish Online Journal of Educational Technology-TOJET 9 1 (2010) 185–201.
  3. Archie Zariski. 1996. Student peer assessment in tertiary education: Promise, perils and practice. In Teaching and Learning Within and Across Disciplines, p189-200. Proceedings of the 5th Annual Teaching and Learning Forum, Murdoch University.

Cited by

See all 16

Metadata

Authors
Shin, I., Hwang, S. B., Yoo, Y. J., Bae, S., & Kim, R. Y.
Affiliations
Seoul National University (KR)
Venue
Proceedings of the 15th International Learning Analytics and Knowledge Conference
Publisher
ACM
Published
2025-03-03
Pages
159-169
OpenAlex
W4407841864
Cited by
16
References
43
Citations by year
2026: 8 · 2025: 8
FWCI
183.23
Type
conference paper
Language
en
Open access
Locations
International Conference on Learning Analytics and Knowledge (LAK) (publishedVersion, cc-by)
Topics
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Education › Artificial Intelligence in Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
AI-generated feedback, peer assessment, formative assessment, student preferences, peer feedback, artificial intelligence in education, student perceptions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Comparing Student Preferences for AI-Generated and Peer-Generated Feedback in AI-driven Formative Peer Assessment. https://app.cochat.ai/papers/10.1145/3706468.3706488
The paper
Shin, I., Hwang, S. B., Yoo, Y. J., Bae, S., & Kim, R. Y. (2025). Comparing Student Preferences for AI-Generated and Peer-Generated Feedback in AI-driven Formative Peer Assessment. Proceedings of the 15th International Learning Analytics and Knowledge Conference. https://doi.org/10.1145/3706468.3706488

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.