Cited by 7Academic integrity and plagiarismArtificial Intelligence in EducationStudent Assessment and Feedback

Appraising higher education assessment validity: Development of the PANDORA GenAI Susceptibility Rubric

Open access
Peter Bannister, Alexandra Santamaría Urbieta, Nuria Brufau Alvira·2025·Journal of Applied Learning & Teaching

Abstract

This paper presents the development and application of the PANDORA GenAI Susceptibility Rubric, a novel tool designed to assess the susceptibility of higher education assessments to the undeclared use of generative artificial intelligence (GenAI) tools. In response to growing concerns about academic integrity and the rising sophistication of GenAI technologies, the rubric provides educators with a structured framework to critically evaluate the validity of their assessments across key criteria, including collaborative authorship, intellectual task complexity, and the opportunity for creativity. Through a mixed-methods design, the rubric was refined to include expert-informed modifications and validated through end-user application across various arts and humanities courses. Results highlight how assessment design can either mitigate or exacerbate GenAI susceptibility, revealing that tasks requiring genuine collaboration, creative thinking, and process-oriented evaluation offer greater resistance to AI manipulation. The rubric also emphasises balancing detailed guidance with student autonomy to avoid facilitating GenAI prompt formulation. This study contributes to the field by offering a practical instrument that promotes more robust, ethically sound, and future-proofed assessment practices. It serves as a critical response to the pressing challenges posed by GenAI in higher education and informs ongoing discourse on academic integrity.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.37074/jalt.2025.8.1.20

Cites

79 of 97 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 9

  1. In M. Bearman, P. Dawson, R. Ajjawi, J. Tai, & D. Boud (Eds.), Re-imagining university assessment in a digital world (pp. 49-63). Springer.
  2. Boyd, P., & Hill, J. (2024). Working with rubrics. In N. Reiman, I. Sadler, & J. Hill (Eds.), Academic standards in higher education. Critical perspectives and practical strategies (pp. 157-170). Routledge.
  3. Chapelle, C. A., & Lee, H. (2021). Conceptions of validity. In G. Fulcher, & L. Harding (Eds.), The Routledge handbook of language testing (pp. 21-34). Routledge.
  4. De Maio, C. (2024). Institutional responses to ChatGPT: Analysing the academic integrity policies of four public and private institutions of higher education in Australia. Journal of Academic Language and Learning, 18(1), T1-T8. https:// journal.aall.org.au/index.php/jall/article/view/917
  5. DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). SAGE Publications.
  6. Ehlers, U. D., & Eigbrecht, L. (2024). Creating the university of the future. A global view on future skills and future higher education. Springer.
  7. McGraw, A., & Mason, M. (2021). The formulaic essay and its power to de-fuse reading responses. Literacy Learning: The Middle Years, 29(3), 8-15. https://search.informit.org/ doi/10.3316/informit.069867974654568 · DOI
  8. Tight, M. (2024). Challenging cheating in higher education: A review of research and practice. Assessment & Evaluation in Higher Education, 1-13. https://doi.org/10.1080/0260293 8.2023.2300104 UNESCO. (2023). Guidance for generative AI in education and research. https://unesdoc.unesco.org/ark:/48223/ · DOI
  9. West, H., Malcolm, G., Keywood, S., & Hill, J. (2019). Writing a successful essay. Journal of Geography in Higher Education, 43(4), 609-617. https://doi.org/10.1080/03098265.2019.165 5720 · DOI

Cited by

Sorted by citations

Authors
Bannister, P., Urbieta, A. S., & Alvira, N. B.
Affiliations
Universidad Internacional de La Rioja (ES)
Venue
Journal of Applied Learning & Teaching
Published
2025-01-23
Volume
8
Issue
1
ISSN
2591-801X (ISSN-L)
OpenAlex
W4406774315
Cited by
7
References
83
Citations by year
2026: 6 · 2025: 1
FWCI
5.08
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Applied Learning & Teaching (publishedVersion, cc-by)
  • Re-Unir (International University of La Rioja) (submittedVersion, cc-by)
Funders
Universidad Internacional de La Rioja
Topics
  • Social Sciences › Safety Research › Academic integrity and plagiarism
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Social Sciences › Education › Student Assessment and Feedback
Keywords
generative AI, assessment validity, academic integrity, assessment design, collaborative authorship, student independence, prompt formulation, arts and humanities education, higher education assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review