Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; 2 of the 36 sources its claims cite were checked for support.

Developing evaluative judgement for a time of generative artificial intelligence

Open access
Bearman, Margaret, Tai, Joanna, Dawson, Phillip, Boud, David, Ajjawi, Rola · 2024 · Assessment & Evaluation in Higher Education

Abstract

Generative artificial intelligence (AI) has rapidly increased capacity for producing textual, visual and auditory outputs, yet there are ongoing concerns regarding the quality of those outputs. There is an urgent need to develop students’ evaluative judgement – the capability to judge the quality of work of self and others – in recognition of this new reality. In this conceptual paper, we describe the intersection between evaluative judgement and generative AI with a view to articulating how assessment practices can help students learn to work productively with generative AI. We propose three foci: (1) developing evaluative judgement of generative AI outputs; (2) developing evaluative judgement of generative AI processes; and (3) generative AI assessment of student evaluative judgements. We argue for developing students’ capabilities to identify and calibrate quality of work – uniquely human capabilities at a time of technological acceleration – through existing formative assessment strategies. These approaches circumvent and interrupt students’ uncritical usage of generative AI. The relationship between evaluative judgement and generative AI is more than just the application of human judgement to machine outputs. We have a collective responsibility, as educators and learners, to ensure that humans do not relinquish their roles as arbiters of quality.

Overview

CoChat Summary

## TL;DR

This conceptual paper argues that generative AI makes evaluative judgement more important, because students need to judge the quality not only of AI outputs but also of their own AI use and of AI-based appraisals. The authors propose that existing assessment practices can be adapted to build these capabilities and to prevent uncritical reliance on generative AI.

## Key findings

  • The paper identifies three foci for evaluative judgement in relation to generative AI: (1) judging the quality of generative AI outputs, (2) judging the quality of generative AI processes, and (3) using generative AI to assess students’ evaluative judgements.
  • The authors argue that generative AI can produce outputs that are plausible but unsuitable, not only through “hallucinations” but also through outputs that are too generic, biased, or based on outdated assumptions and texts.
  • They state that assessment practices can develop evaluative judgement through self-assessment, peer assessment/review, feedback, rubrics, and exemplars; these are presented as strategies from Tai et al. (2018) that can be adapted for a generative AI context.
  • The paper reports early survey findings showing substantial student use of generative AI: 17% of an unspecified minority in a March 2023 survey of 1,000 US college students reported generating an assignment text without edits; by November 2023, 56% of 1,000 US college students said they used AI tools to complete assignments or examinations, and 53% said their coursework required AI tools; about one third of 1,250 UK students reported using generative AI as a “personal tutor.”

## Methods

  • This is a conceptual paper, not an empirical study.
  • It develops its argument by synthesising prior literature on evaluative judgement, assessment, feedback, and generative AI.
  • The paper organizes the discussion around three intersections between evaluative judgement and generative AI, and around assessment-related pedagogical strategies for building evaluative judgement.

## Limitations

  • The paper does not report original empirical data or test its proposed framework; this is implied by the text and by the paper’s identification as a conceptual paper.
  • The authors note that the cited survey findings on student AI use are early findings and “must be read with caveats about their generalisability.”
  • The text says the future relationship between students and generative AI is unknown, and it also states that the nature of generative AI corpora is obscure and likely biased toward a Global North perspective; this is discussed as an unresolved issue, not a measured result.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/02602938.2024.2335321

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

2 Valid · 0 Not valid · 28 Not checked · 69 Own results and interpretations

12 more claims

Create a free account to see all 99 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 80
  • It may state two separate claims as one. 21

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 32 references

Research works printed but not linked: 1

  1. De Mello Heredia, J., M. Henderson, and M. Phillips. 2023. “Using Video Feedback to Support Students.” Evaluative Judgement Society for Information Technology & Teacher Education International Conference 2023, New Orleans, LA. https://www.learntechlib.org/p/222090

Cited by

See all 312

Metadata

Authors
Bearman, M., Tai, J., Dawson, P., Boud, D., & Ajjawi, R.
Affiliations
  • Deakin University (AU)
  • University of Technology Sydney (AU)
Corresponding author
Bearman, Margaret
Venue
Assessment & Evaluation in Higher Education
Published
2024-04-10
Volume
49
Issue
6
Pages
893-905
ISSN
  • 0260-2938 (ISSN-L)
  • 1469-297X
OpenAlex
W4394675615
Cited by
312
References
32
Citations by year
2026: 213 · 2025: 90 · 2024: 9
FWCI
389.35
Type
journal article
Language
en
Open access
Locations
  • Assessment & Evaluation in Higher Education (publishedVersion, cc-by-nc-nd)
  • Figshare (submittedVersion, cc-by)
Topics
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Education › Digital Education and Society
Keywords
generative AI, evaluative judgments, formative assessment, AI evaluation, critical use of AI, higher education assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Developing evaluative judgement for a time of generative artificial intelligence. https://app.cochat.ai/papers/10.1080/02602938.2024.2335321
The paper
Bearman, M., Tai, J., Dawson, P., Boud, D., & Ajjawi, R. (2024). Developing evaluative judgement for a time of generative artificial intelligence. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2024.2335321

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.