CoChat

How university students work on assessment tasks with generative artificial intelligence: matters of judgement

Open access
Walton, Jack, Bearman, Margaret, Crawford, Nicole, Tai, Joanna, Boud, David · 2026 · Assessment & Evaluation in Higher Education

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index; 5 of the 6 sources its claims cite were checked for support.

Abstract

Despite concerns about students’ use of generative AI (GenAI) in assessment, the technology has become embedded into students’ everyday assessment practices. It is unclear how students are making judgements about their ways of working with GenAI and what impact this has upon their learning. This qualitative multimodal study examines students exercising judgement as they work with GenAI to complete assessment tasks. Twenty-six interviews were conducted with Australian university students, primarily using a scroll-back approach, which revisits traces of students’ historical interactions with GenAI in the interviews. Employing a holistic definition of judgement and a narrative approach to analysis, we interpreted six distinct categories of judgement events. These are: 1) making judgements about knowledge when working with GenAI; 2) learning to judge GenAI through its limitations; 3) relying on GenAI for things they could not otherwise do; 4) adopting ideas with low levels of criticality; 5) misjudging GenAI contributions as their own; and 6) submitting GenAI content in an assignment without judging it. This study suggests GenAI use strongly shapes student learning in complex ways when undertaking assessment tasks, and that making judgements about GenAI entails a student making judgements about their own knowledge, deficits, and quality of contributions.

Overview

CoChat Summary

TL;DR

This qualitative multimodal study of 26 Australian university students used scroll-back interviews to examine how students exercise judgement when using generative AI (GenAI) in assessment. It identifies six categories of judgement events and argues that GenAI use strongly shapes learning in complex ways, with judgements about GenAI entangled with judgements about students’ own knowledge, deficits, and contributions.

Key findings

  • The analysis identified six distinct categories of judgement events: (1) making judgements about knowledge when working with GenAI; (2) learning to judge GenAI through its limitations; (3) relying on GenAI for things they could not otherwise do; (4) adopting ideas with low levels of criticality; (5) misjudging GenAI contributions as their own; and (6) submitting GenAI content in an assignment without judging it.
  • Of 52 judgement events identified, 30 related to assessment; these were clustered into the six categories.
  • Judgements about GenAI were strongly intertwined with judgements about self: students judged their own knowledge, deficits, and contributions, and some misjudged GenAI contributions as their own even when traces showed little change between generated and submitted text.
  • GenAI use both supported and hindered learning: some students learned about writing or became less reliant over time, while others adopted ideas uncritically or copy-pasted GenAI outputs without judging them, with some calling this “cheating.”

Methods

  • Qualitative multimodal design with 26 online Zoom interviews of undergraduate students at one large Australian university, recruited via the institution’s disability/accessibility unit (11 students) and subject convenors across faculties (15 students); participants self-identified as motivated GenAI users.
  • Scroll-back interview approach: participants shared historical GenAI interactions via screen sharing, with screen recording and artefacts; 7 interviewees did not bring historical interactions, so interviews used completed artefacts, recreations, or joint review of settings/comments.
  • Holistic narrative analysis: researchers wrote narrative accounts of judgement events, then focused on the 30 of 52 events related to assessment and clustered them into six thematically similar categories.

Limitations

  • The paper states the analytic approach was “highly interpretive,” and researchers sometimes experienced unease when participant accounts and artefacts contradicted each other.
  • No formal limitations section is included; evident from the text, the study is qualitative, based at a single large Australian university, and uses 26 self-identified motivated GenAI users, so findings are context-bound and not statistically generalizable.
  • Evident from the text, 7 of 26 interviewees did not bring historical interactions, and some GenAI tools did not leave traces amenable to scrolling back, so some data relied on completed artefacts, recreations, or joint review of software settings or unresolved comments.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/02602938.2025.2570328

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

5 Valid · 1 Not valid · 1 Not checked · 56 Own results and interpretations

29 more claims

Create a free account to see all 63 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 15
  • It may state two separate claims as one. 18
  • Borderline: one of the tests for a substantial claim is unclear. 1

Create a free account to see these claims.

Citations

Cites

Show all 24 references

Cited by

See all 28

Metadata

Authors
Walton, J., Bearman, M., Crawford, N., Tai, J., & Boud, D.
Affiliations
Deakin University (AU)
Corresponding author
Walton, Jack
Venue
Assessment & Evaluation in Higher Education
Published
2025-10-13
Volume
51
Issue
6
Pages
1066-1082
ISSN
  • 0260-2938 (ISSN-L)
  • 1469-297X
OpenAlex
W4415139151
Cited by
28
References
23
Citations by year
2026: 26 · 2025: 2
FWCI
28.86
Type
journal article
Language
en
Open access
Licence
Locations
  • Assessment & Evaluation in Higher Education (publishedVersion, cc-by-nc-nd)
  • Figshare (submittedVersion)
  • OPUS - Open Publications of UTS Scholars (University of Technology Sydney) (submittedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Education › Student Assessment and Feedback
Keywords
generative AI, judgment, university students, assessment tasks, AI-generated content, academic integrity, criticality, student learning, AI limitations, student self-assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How university students work on assessment tasks with generative artificial intelligence: matters of judgement. https://app.cochat.ai/papers/10.1080/02602938.2025.2570328
The paper
Walton, J., Bearman, M., Crawford, N., Tai, J., & Boud, D. (2026). How university students work on assessment tasks with generative artificial intelligence: matters of judgement. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2025.2570328

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.