Generative AI vs. instructor vs. peer assessments: a comparison of grading and feedback in higher education
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
The integration of Generative Artificial Intelligence (GenAI) in education has introduced innovative approaches to assessment. One such approach is AI chatbot-based assessment, which utilizes large language models to provide students with timely and consistent feedback. However, the effectiveness of AI chatbots in generating assessments comparable to human evaluators in educational contexts remains underexplored. This study compared the grades and feedback provided by AI chatbots, peers, and the course instructor for student projects in a higher education course. The participants were 76 undergraduate students who engaged in a group project involving three phases: questionnaire development, peer assessment, and chatbot-based assessment. Employing a mixed-methods approach, this study quantitatively compared project grades and qualitatively analyzed feedback quality. Results indicated that AI chatbots consistently assigned higher grades than human assessors, while peer and instructor grades were notably lower and closely aligned. Content analysis revealed that chatbots generally provided higher-quality feedback compared to peers, offering detailed insights and specific guidance for improvement, though they occasionally included irrelevant or contradictory information requiring student intervention. Conversely, peer feedback was more personalized and context-sensitive. These findings highlight the importance of human judgment, suggesting that integrating chatbot-based assessments with traditional methods can leverage their complementary strengths to enrich student learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1×
“Foundational assessment theories distinguish between formative and summative assessment, with formative assessment guiding students during the learning process and summative assessment evaluating their performance at the end of instruction (Black and Wiliam 1998; Hattie and Timperley 2007).”
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242 · cited 4×
“AI chat-bots can analyze student submissions against predefined criteria, offering consistent and objec-tive evaluations (Zawacki-Richter et al. 2019; Hennekeuser et al. 2024).”
InfluentialStudents' voices on generative ai: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · arXiv · doi:10.48550/arxiv.2305.00290 · Cited by 2,504 · cited 11×
“This key limitation was identified by other researchers, who have noted that AI systems may sometimes misunderstand or misinter-pret student inputs, leading to inaccuracies or incomprehensible feedback (Chan and Hu 2023; Lu et al. 2024).”
InfluentialStudents’ voices on generative AI: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00411-8 · Cited by 2,301 · cited 11×
“This key limitation was identified by other researchers, who have noted that AI systems may sometimes misunderstand or misinter-pret student inputs, leading to inaccuracies or incomprehensible feedback (Chan and Hu 2023; Lu et al. 2024).”
InfluentialStudent Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks
Falchikov, N., & Goldfinch, J. (2000) · Review of Educational Research · doi:10.3102/00346543070003287 · Cited by 1,170 · cited 6×
“A primary concern shared by both educators and researchers is whether peer assessments are as reliable as those conducted by instructors (double, McGrane, and Hopfenbeck 2020; Falchikov and Goldfinch 2000).”
InfluentialWalter, Y. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00448-3 · Cited by 1,113 · cited 4×
“They are perceived as providing students with timely, immediate, and consistent feedback that can guide their learning by highlighting areas of improvement and offering suggestions for further learning (Labadze, Grigolia, and Machaidze 2023; Walter 2024).”
InfluentialRole of AI chatbots in education: systematic literature review
Labadze, L., Grigolia, M., & Machaidze, L. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00426-1 · Cited by 1,043 · cited 5×
“These tools are capable of tailoring content to individual learning styles and paces, automating routine tasks, and offering innovative methods for assessing student work (Okonkwo and Ade-Ibijola 2021; Labadze, Grigolia, and Machaidze 2023).”
InfluentialRethinking feedback practices in higher education: a peer review perspective
Nicol, D., Thomson, A., & Breslin, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.795518 · Cited by 966
Chatbot learning partners: connecting learning experiences, interest and competence
Fryer, L. K., Nakao, K., & Thompson, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.023 · Cited by 470
Cited by
Kohen-Vacs, D., Usher, M., & Jansen, M. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00496-4 · Cited by 39
“While GenAI tools have streamlined many aspects of learning in higher education, human oversight remains essential for ensuring the correctness, efficiency, and secu - rity of AI-generated outputs (Usher, 2025).”
InfluentialSelf-citationTeacher, peer, or AI? Comparing effects of feedback sources in higher education
Weidlich, J., Gotsch, F., Schudel, K., Marusic-Würscher, C., Mazzarella, J., Bolten, H., Bütler, D., Luger, S., Wohlfender, B., & Merki, K. M. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100300 · Cited by 36
Usher, M., Barak, M., & Erduran, S. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00567-x · Cited by 21
“In higher education, AI-driven technologies have enhanced personalized learning systems, providing tailored content and adaptive feedback to meet the diverse needs of learners (Chan & Hu, 2023; Usher, 2025; Zawacki-Richter et al., 2019).”
Self-citationMartin, A. F., Tubaltseva, S., Harrison, A., & Rubin, G. J. (2025) · Behavioral Sciences · doi:10.3390/bs15060808 · Cited by 16
“Interest in the role of AI in education has accelerated rapidly in recent years (Strielkowski et al., 2025), with growing attention being paid to its implications for assessment and feedback practices (e.g., Henderson et al., 2025; Usher, 2025).”
AI assistance in peer feedback provision: Pedagogically sound, but minimally adopted
Pozdniakov, S., Brazil, J., Banihashem, S. K., Noroozi, O., Gašević, D., Sadiq, S., & Khosravi, H. (2026) · Computers & Education · doi:10.1016/j.compedu.2026.105591 · Cited by 11
Metadata
- Authors
- Usher, M.
- Venue
- Assessment & Evaluation in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2025-04-09
- Volume
- 50
- Issue
- 6
- Pages
- 912-927
- ISSN
- 0260-2938 (ISSN-L)
- 1469-297X
- OpenAlex
- W4409307175
- Cited by
- 75
- References
- 17
- FWCI
- 81.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Generative AI vs. instructor vs. peer assessments: a comparison of grading and feedback in higher education. https://app.cochat.ai/papers/10.1080/02602938.2025.2487495
- The paper
- Usher, M. (2025). Generative AI vs. instructor vs. peer assessments: a comparison of grading and feedback in higher education. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2025.2487495
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.