Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index; 18 of the 41 sources its claims cite were checked for support.

Designing AI-resilient assessment in higher education: a four-pillar conceptual framework

Open access
Nikolić, Dragan, Basta Nikolić, Marijana · 2026 · Frontiers in Artificial Intelligence

Abstract

Generative AI tools can produce polished academic text on demand, undermining the validity of assessments that treat written submissions as evidence of individual learning. Detection-based countermeasures have demonstrated variable accuracy and equity concerns. This paper does not report empirical outcomes or validation data. It proposes a framework for AI-resilient assessment that shifts evaluation from product quality to demonstrable reasoning, decision-making, and ownership of learning.

Overview

CoChat Summary

TL;DR

This conceptual paper proposes a four-pillar framework for AI-resilient higher education assessment—process-based documentation, oral defense integration, authentic task design, and transparent AI-use policies—to shift evaluation from product quality to demonstrable reasoning and ownership of learning. It offers design tools (rubric, oral-defense protocol, AI-use taxonomy, vulnerability audit) but reports no empirical outcomes or validation data.

Key findings

  • The framework derives four pillars from Messick’s unified validity framework and constructive alignment, mapping each generative-AI threat to a design response: invisible process → process documentation; pre-prepared output → oral defense; generic task → authentic task design; ambiguous expectations → AI-use policy.
  • Operational tools include a rubric with weight ranges (reasoning 25–35%, oral defense 25–35%, process engagement 20–30%, product quality 10–20%; worked example total 3.45/4.00), an oral-defense protocol of 8–12 min per student (warm-up 2–3 min, probing 4–6 min, extension 2–3 min), and a graduated AI-use taxonomy (Prohibited, Guided, Permitted).
  • Workload estimates: 100 students at 10 min each ≈17 h direct assessment time, with a realistic range of 25–35 h including preparation and moderation; random sampling of 30–40% reduces workload but introduces a validity trade-off; a large cohort (n = 300) is estimated at ~50 additional faculty hours per assessment cycle.
  • Cited detection evidence: Weber-Wulff et al. evaluated 14 tools, with GPTZero and ZeroGPT producing false-positive rates exceeding 20% on specific samples; Liang et al. demonstrated systematic misclassification of non-native English writing.

Methods

  • Conceptual analysis, not an empirical study or systematic review; a focused synthesis across five domains using Scopus, Web of Science, and Google Scholar (January 2020–March 2026), with search strings combining “generative AI” or “large language model” with assessment, academic integrity, oral defense, and authentic assessment, plus backward citation tracking.
  • Sources were included if they addressed assessment design, validity, or integrity in the context of generative AI or automated text production; Table 1 frameworks were selected if published 2024–2026, explicitly addressed assessment redesign, and described at least one focal dimension with operational detail.
  • Table 1 components were coded present, partial, or absent by both authors independently; initial agreement was 14/16 decisions (87.5%), disagreements resolved through discussion, and the present framework was self-coded.

Limitations

  • Stated: the framework has not been empirically validated; the proposed tools have not been evaluated for reliability, inter-rater consistency, or transferability; illustrative examples are drawn primarily from health sciences and engineering, so cross-disciplinary validation is needed.
  • Stated: oral defense creates accessibility and equity concerns for students with speech or hearing impairments, severe anxiety or autism spectrum conditions, non-native speakers, and fully online programmes; it may introduce linguistic biases, and the “equity paradox” cannot be fully resolved within the framework alone.
  • Stated and evident: the framework is AI-resilient, not AI-proof, and each pillar may be circumvented as AI capabilities evolve; random sampling has an acknowledged validity trade-off; vulnerability levels and thresholds are heuristic, not validated; Table 1 self-coding represents a potential bias; institutional, pedagogical, and cultural barriers may limit adoption.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/frai.2026.1841682

Cites

18 of 19 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Four-pillar framework for AI-resilient assessment. Solid arrows: each pillar contributes a distinct type of evidence supporting competence inference. Dashed arrows: inter-pillar reinforcement (e.g., process documentation generates questions for oral defence). This diagram represents conceptual relationships, not empirically tested causal pathways.
Figure 1 Four-pillar framework for AI-resilient assessment. Solid arrows: each pillar contributes a distinct type of evidence supporting competence inference. Dashed arrows: inter-pillar reinforcement (e.g., process documentation generates questions for oral defence). This diagram represents conceptual relationships, not empirically tested causal pathways.CC BY · PubMed Central

Verification

Claims the paper makes

12 Valid · 7 Not valid · 16 Not checked · 70 Own results and interpretations

27 more claims · 5 with their cited sources checked

Create a free account to see all 105 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 27
  • Probably not a substantial claim. 63

Create a free account to see these claims.

Citations

Cites

Show all 16 references

Research works printed but not linked: 6

  1. Biggs, 2011, Teaching for Quality Learning at University
  2. 2025, Generative AI in Higher Education Teaching & Learning: Policy Framewor. Dublin
  3. Joughin, 2010, A Short Guide to Oral Assessment
  4. Messick, 1989, Educational Measurement, 13
  5. Vygotsky, 1978, Mind in Society
  6. Winne, 2018, Handbook of Self-Regulation, 36

Cited by

See all 1

Metadata

Authors
Nikolić, D., & Basta Nikolić, M.
Affiliations
  • University of Novi Sad (RS)
  • Faculty of Medicine, University of Novi Sad
Corresponding author
Nikolić, Dragan
Venue
Frontiers in Artificial Intelligence
Published
2026-07-16
Volume
9
Pages
1841682-1841682
ISSN
2624-8212 (ISSN-L)
OpenAlex
W7168776378
Cited by
1
References
16
Citations by year
2026: 1
FWCI
5.63
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Artificial Intelligence (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Education › Student Assessment and Feedback
Keywords
generative AI, higher education assessment, academic integrity, AI detection, assessment design, oral defense, AI use policies, health sciences education, ownership of learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Designing AI-resilient assessment in higher education: a four-pillar conceptual framework. https://app.cochat.ai/papers/10.3389/frai.2026.1841682
The paper
Nikolić, D., & Basta Nikolić, M. (2026). Designing AI-resilient assessment in higher education: a four-pillar conceptual framework. Frontiers in Artificial Intelligence. https://doi.org/10.3389/frai.2026.1841682

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.