Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index; none of the 5 sources its claims cite is checked for support yet.

Replacing written assessment with an oral ISBAR assessment in a 700‑student cohort: cohort‑level outcomes for performance, integrity, and staff experience

Open access
Ogle, Theodora, Jarrett, Paul · 2026 · Assessment & Evaluation in Higher Education

Abstract

Generative artificial intelligence (GenAI) has intensified concerns about the authenticity and integrity of written assessment in higher education. These challenges are particularly relevant in nursing, where safe practice requires clinical reasoning and real‑time decision‑making. This practice‑based evaluation examined the redesign of a written case study into an authentic, oral ISBAR (Identify, Situation, Background, Assessment, Recommendation) assessment in a second‑year undergraduate nursing unit (n = 740). Drawing on routine institutional data including cohort‑level performance outcomes, implementation records, and student and educator feedback, the evaluation assessed whether the oral assessment maintained academic standards while strengthening academic integrity and improving staff experience. Findings demonstrated comparable cohort‑level performance across written (2024) and oral (2025) formats, with stable overall unit means and improved end‑of‑semester examination results. No breaches of academic integrity were identified under the oral format, which incorporated verified identity conditions, invigilated perusal, multiple case variants, and real‑time performance. Educators reported greater confidence in authorship, stronger alignment between assessment evidence and clinical judgement, and a more engaging marking experience; the redesign reduced marking time and cost per student. These results indicate that oral, performance‑based assessment offers a feasible, scalable, and pedagogically aligned response to integrity challenges in GenAI‑mediated learning environments while preserving academic standards.

Overview

CoChat Summary

TL;DR

Replacing a written case study with an oral ISBAR assessment in a 740-student second-year nursing cohort maintained overall unit performance while improving examination scores and reducing below-pass proportions, with no integrity breaches reported. Staff reported greater confidence in authorship and more engaging marking, but the evaluation is a single-unit, descriptive, context-specific practice-based study.

Key findings

  • Overall unit mean was stable from 2024 to 2025: 64.33 to 64.52 (+0.19 pp), with no significant difference, t(1228) = 0.31, p = .758, d = −0.02. Assessment component mean rose from 65.21 to 67.70 (+2.49 pp), not significant, t(959) = −1.66, p = .097, d = 0.10; examination mean rose from 57.66 to 61.92 (+4.26 pp), significant, t(1204) = −3.60, p < .001, d = 0.21.
  • The proportion scoring below 49.5% decreased for the assessment component (15.3% to 10.1%, χ²(1) = 6.80, p = .009) and examination (30.3% to 24.4%, χ²(1) = 4.77, p = .029), with no significant change overall (8.0% vs 10.4%, χ²(1) = 1.79, p = .181).
  • No attempted or achieved academic-integrity breaches were reported or identified across the cohort under the oral format, which used verified identity checks, an invigilated 30-minute perusal period, real-time performance, 40 unique case variants, randomised allocation, secure bag storage, and retention of student notes. Staff reported improved confidence in authorship, closer alignment with clinical judgement, and a more engaging marking experience.
  • Workload changed from 340 to 215 sessional marking hours, 40 to 60 unit coordinator hours, and 0 to 40 marshal hours; total staff hours fell from 380 to 315, hours per student from 0.51 to 0.43, a 65-hour or 17.1% reduction per student, with an 18.7% cost-weighted reduction per student. Student Voice Survey participation was 58/740 (7.8%); of 21 comments referencing the new format, 16 were positive and 5 less favourable.

Methods

  • Practice-based, descriptive design-based evaluation of an assessment redesign in a second-year, second-semester undergraduate nursing unit (July–November 2025), replacing a written case study with an oral ISBAR assessment alongside an unchanged end-of-semester examination; no experimental manipulation, randomisation, or prospective data collection.
  • Data came from existing institutional sources: aggregated performance data for 2024 and 2025 (740 students in 2025; n = 490 for 2024 overall unit outcomes), implementation records, routine Student Voice Survey and informal feedback, and informal staff feedback; no individual-level student data were analysed or reported.
  • Quantitative data were analysed in Microsoft Excel using descriptive statistics, independent-samples t tests with Welch’s correction where required, and chi-square analyses for the proportion below the pass threshold (≥49.5%); feedback was summarised descriptively and not formally coded or thematically analysed.

Limitations

  • Stated in the paper: as a practice-based evaluation in a single unit at one institution, findings are context-specific and not intended to be generalisable; the absence of prospectively designed data collection and formal qualitative analysis limits causal inference about student experience and learning processes; student and staff feedback contextualises implementation rather than serving as systematically analysed evaluative evidence.
  • Evident from the text: the Student Voice Survey response rate was low (58/740; 7.8%), so student experience findings are indicative only; the 2024 and 2025 cohorts also differed in assessment weighting (2024: online quiz 10%, written essay 40%, examination 50%; 2025: oral ISBAR 45%, examination 55%; quiz removed), which may confound component and examination comparisons.
  • Evident from the text: actual dollar amounts for cost savings are not reported, and the evaluation relies on aggregated institutional records and informal staff feedback rather than a controlled or longitudinal design.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/02602938.2026.2684284

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Figures

Image 1
CC-BY · From the PDF
Image 2
CC-BY · From the PDF
Image 3
CC-BY · From the PDF
Figure 1 Distribution of assessment and overall unit scores by cohort (2024 vs 2025).
Figure 1 Distribution of assessment and overall unit scores by cohort (2024 vs 2025).CC-BY · From the PDF

Verification

Claims the paper makes

0 Valid · 0 Not valid · 5 Not checked · 92 Own results and interpretations

41 more claims

Create a free account to see all 97 claims and to verify the 3 references still open.

See all claims — free account
  • It may state two separate claims as one. 34
  • Probably not a substantial claim. 31

Create a free account to see these claims.

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentt(1204) = -3.6reported p < .001 · recomputed p < .001

    “t(1204) = -3.60,p < .001”

  • Consistentt(959) = -1.66reported p = .097 · recomputed p = .097

    “t(959) = -1.66,p = .097”

  • Consistentt(1228) = 0.31reported p = .758 · recomputed p = .757

    “t(1228) = 0.31, p = .758”

  • Consistentχ²(1) = 6.8reported p = .009 · recomputed p = .009

    “χ 2 (1) = 6.80, p = .009”

  • Consistentχ²(1) = 4.77reported p = .029 · recomputed p = .029

    “χ 2 (1) = 4.77, p = .029”

5 of 6 · the rest aren’t loaded

1 more recomputed test

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Citations

Cites

Show all 27 references

Research works printed but not linked: 2

  1. Nallaya, S., S. Gentili, S. Weeks, and K. Baldock. 2024. “The Validity, Reliability, Academic Integrity and Integration of Oral Assessments in Higher Education: A Systematic Review.” Issues in Educational Research, 34 (2): 629–646. http://www.iier.org.au/iier34/nallaya.pdf.
  2. 10.4103/jnspp.jnspp_6_24 · doi:10.4103/jnspp.jnspp_6_24

Metadata

Authors
Ogle, T., & Jarrett, P.
Affiliations
Queensland University of Technology (AU)
Corresponding author
Ogle, Theodora
Venue
Assessment & Evaluation in Higher Education
Published
2026-06-10
Pages
1-17
ISSN
  • 0260-2938 (ISSN-L)
  • 1469-297X
OpenAlex
W7164419157
Cited by
1
References
27
Citations by year
2026: 1
FWCI
4.94
Type
journal article
Language
en
Open access
Locations
Assessment & Evaluation in Higher Education (publishedVersion, cc-by)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Education › Innovations in Medical Education
  • Social Sciences › Education › Student Assessment and Feedback
Keywords
oral assessment, ISBAR, written assessment, academic integrity, generative AI, nursing education, performance-based assessment, assessment redesign, case study assessment, student performance outcomes, employee experience

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Replacing written assessment with an oral ISBAR assessment in a 700‑student cohort: cohort‑level outcomes for performance, integrity, and staff experience. https://app.cochat.ai/papers/10.1080/02602938.2026.2684284
The paper
Ogle, T., & Jarrett, P. (2026). Replacing written assessment with an oral ISBAR assessment in a 700‑student cohort: cohort‑level outcomes for performance, integrity, and staff experience. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2026.2684284

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.