The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index; none of the 5 sources its claims cite is checked for support yet.
Replacing written assessment with an oral ISBAR assessment in a 700‑student cohort: cohort‑level outcomes for performance, integrity, and staff experience
Open accessAbstract
Generative artificial intelligence (GenAI) has intensified concerns about the authenticity and integrity of written assessment in higher education. These challenges are particularly relevant in nursing, where safe practice requires clinical reasoning and real‑time decision‑making. This practice‑based evaluation examined the redesign of a written case study into an authentic, oral ISBAR (Identify, Situation, Background, Assessment, Recommendation) assessment in a second‑year undergraduate nursing unit (n = 740). Drawing on routine institutional data including cohort‑level performance outcomes, implementation records, and student and educator feedback, the evaluation assessed whether the oral assessment maintained academic standards while strengthening academic integrity and improving staff experience. Findings demonstrated comparable cohort‑level performance across written (2024) and oral (2025) formats, with stable overall unit means and improved end‑of‑semester examination results. No breaches of academic integrity were identified under the oral format, which incorporated verified identity conditions, invigilated perusal, multiple case variants, and real‑time performance. Educators reported greater confidence in authorship, stronger alignment between assessment evidence and clinical judgement, and a more engaging marking experience; the redesign reduced marking time and cost per student. These results indicate that oral, performance‑based assessment offers a feasible, scalable, and pedagogically aligned response to integrity challenges in GenAI‑mediated learning environments while preserving academic standards.
Overview
CoChat Summary
TL;DR
Replacing a written case study with an oral ISBAR assessment in a 740-student second-year nursing cohort maintained overall unit performance while improving examination scores and reducing below-pass proportions, with no integrity breaches reported. Staff reported greater confidence in authorship and more engaging marking, but the evaluation is a single-unit, descriptive, context-specific practice-based study.
Key findings
- Overall unit mean was stable from 2024 to 2025: 64.33 to 64.52 (+0.19 pp), with no significant difference, t(1228) = 0.31, p = .758, d = −0.02. Assessment component mean rose from 65.21 to 67.70 (+2.49 pp), not significant, t(959) = −1.66, p = .097, d = 0.10; examination mean rose from 57.66 to 61.92 (+4.26 pp), significant, t(1204) = −3.60, p < .001, d = 0.21.
- The proportion scoring below 49.5% decreased for the assessment component (15.3% to 10.1%, χ²(1) = 6.80, p = .009) and examination (30.3% to 24.4%, χ²(1) = 4.77, p = .029), with no significant change overall (8.0% vs 10.4%, χ²(1) = 1.79, p = .181).
- No attempted or achieved academic-integrity breaches were reported or identified across the cohort under the oral format, which used verified identity checks, an invigilated 30-minute perusal period, real-time performance, 40 unique case variants, randomised allocation, secure bag storage, and retention of student notes. Staff reported improved confidence in authorship, closer alignment with clinical judgement, and a more engaging marking experience.
- Workload changed from 340 to 215 sessional marking hours, 40 to 60 unit coordinator hours, and 0 to 40 marshal hours; total staff hours fell from 380 to 315, hours per student from 0.51 to 0.43, a 65-hour or 17.1% reduction per student, with an 18.7% cost-weighted reduction per student. Student Voice Survey participation was 58/740 (7.8%); of 21 comments referencing the new format, 16 were positive and 5 less favourable.
Methods
- Practice-based, descriptive design-based evaluation of an assessment redesign in a second-year, second-semester undergraduate nursing unit (July–November 2025), replacing a written case study with an oral ISBAR assessment alongside an unchanged end-of-semester examination; no experimental manipulation, randomisation, or prospective data collection.
- Data came from existing institutional sources: aggregated performance data for 2024 and 2025 (740 students in 2025; n = 490 for 2024 overall unit outcomes), implementation records, routine Student Voice Survey and informal feedback, and informal staff feedback; no individual-level student data were analysed or reported.
- Quantitative data were analysed in Microsoft Excel using descriptive statistics, independent-samples t tests with Welch’s correction where required, and chi-square analyses for the proportion below the pass threshold (≥49.5%); feedback was summarised descriptively and not formally coded or thematically analysed.
Limitations
- Stated in the paper: as a practice-based evaluation in a single unit at one institution, findings are context-specific and not intended to be generalisable; the absence of prospectively designed data collection and formal qualitative analysis limits causal inference about student experience and learning processes; student and staff feedback contextualises implementation rather than serving as systematically analysed evaluative evidence.
- Evident from the text: the Student Voice Survey response rate was low (58/740; 7.8%), so student experience findings are indicative only; the 2024 and 2025 cohorts also differed in assessment weighting (2024: online quiz 10%, written essay 40%, examination 50%; 2025: oral ISBAR 45%, examination 55%; quiz removed), which may confound component and examination comparisons.
- Evident from the text: actual dollar amounts for cost savings are not reported, and the evaluation relies on aggregated institutional records and informal staff feedback rather than a controlled or longitudinal design.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 0 Not valid · 5 Not checked · 92 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It incorporated verified identity checks, an invigilated 30-minute perusal period, real-time performance, and 40 unique case variants, and no attempted or achieved breaches were reported or identified across the cohort.”
§ Replacing written assessment with an oral ISBAR assessment in a 700-student cohort: cohort-level outcomes for performance, integrity, and staff experience > Research question 2: academic integrity outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When the task was framed as preparation for clinical handover rather than as an abstract academic exercise, students perceived it as relevant to their emerging professional role.”
§ Replacing written assessment with an oral ISBAR assessment in a 700-student cohort: cohort-level outcomes for performance, integrity, and staff experience > Discussion
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall unit performance remained stable between 2024 (essay) and 2025 (oral ISBAR), while assessment component scores were comparable and end-of-semester examination performance improved.”
§ Replacing written assessment with an oral ISBAR assessment in a 700-student cohort: cohort-level outcomes for performance, integrity, and staff experience > Research question 1: student performance outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall unit performance remained stable between 2024 (essay) and 2025 (oral ISBAR), while assessment component scores were comparable and end-of-semester examination performance improved.”
§ Replacing written assessment with an oral ISBAR assessment in a 700-student cohort: cohort-level outcomes for performance, integrity, and staff experience > Research question 1: student performance outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall unit performance remained stable between 2024 (essay) and 2025 (oral ISBAR), while assessment component scores were comparable and end-of-semester examination performance improved.”
§ Replacing written assessment with an oral ISBAR assessment in a 700-student cohort: cohort-level outcomes for performance, integrity, and staff experience > Research question 1: student performance outcomes
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
41 more claims
Create a free account to see all 97 claims and to verify the 3 references still open.
- It may state two separate claims as one. 34
- Probably not a substantial claim. 31
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(1204) = -3.6reported p < .001 · recomputed p < .001
“t(1204) = -3.60,p < .001”
- Consistentt(959) = -1.66reported p = .097 · recomputed p = .097
“t(959) = -1.66,p = .097”
- Consistentt(1228) = 0.31reported p = .758 · recomputed p = .757
“t(1228) = 0.31, p = .758”
- Consistentχ²(1) = 6.8reported p = .009 · recomputed p = .009
“χ 2 (1) = 6.80, p = .009”
- Consistentχ²(1) = 4.77reported p = .029 · recomputed p = .029
“χ 2 (1) = 4.77, p = .029”
1 more recomputed test
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Authentic assessment: creating a blueprint for course design
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1412396 · Cited by 560
Establishing the critical elements that determine authentic assessment
Ashford-Rowe, K., Herrington, J., & Brown, C. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.819566 · Cited by 390
Wang, H., Dang, A., Wu, Z., & Mac, S. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100326 · Cited by 272
Kofinas, A. K., Tsay, C. H., & Pike, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13585 · Cited by 207
Lavoie, P., Michaud, C., Bélisle, M., Boyer, L., Gosselin, É., Grondin, M., Larue, C., Lavoie, S., & Pepin, J. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13416 · Cited by 152
Solutions to bridge the theory-practice gap in nursing education in the UAE: a qualitative study
Saifan, A. R., Devadas, B. R., Daradkeh, F., Fattah, H. A. A., Aljabery, M. A., & Michael, L. M. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02919-x · Cited by 151
Vlachopoulos, D., & Makri, A. (2024) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2024.101425 · Cited by 144
Undergraduate nursing students’ experiences of becoming a professional nurse: a longitudinal study
Rudberg, S. L., Westerbotn, M., Sormunen, T., Scheja, M., & Lachmann, H. (2022) · BMC Nursing · doi:10.1186/s12912-022-01002-0 · Cited by 118
Teaching clinical handover with ISBAR
Burgess, A., van Diggele, C., Roberts, C., & Mellis, C. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02285-0 · Cited by 100
Research works printed but not linked: 2
- Nallaya, S., S. Gentili, S. Weeks, and K. Baldock. 2024. “The Validity, Reliability, Academic Integrity and Integration of Oral Assessments in Higher Education: A Systematic Review.” Issues in Educational Research, 34 (2): 629–646. http://www.iier.org.au/iier34/nallaya.pdf.
- 10.4103/jnspp.jnspp_6_24 · doi:10.4103/jnspp.jnspp_6_24
Cited by
Brenner, A., & Müller, A. (2026) · Nurse Education in Practice · doi:10.1016/j.nepr.2026.104969
Suhardin, S., Nubatonis, J. R., & Setu, Y. T. (2026) · Prosiding Seminar Nasional Sanata Dharma Berbagi · doi:10.24071/usdb.v4.586
Metadata
- Authors
- Ogle, T., & Jarrett, P.
- Affiliations
- Queensland University of Technology (AU)
- Corresponding author
- Ogle, Theodora
- Venue
- Assessment & Evaluation in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2026-06-10
- Pages
- 1-17
- ISSN
- 0260-2938 (ISSN-L)
- 1469-297X
- OpenAlex
- W7164419157
- Semantic Scholar
- f1faa8b1ef2255c39f9530ff71d789ea30e2fd67
- Cited by
- 1
- References
- 27
- Citations by year
- 2026: 1
- FWCI
- 4.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Assessment & Evaluation in Higher Education (publishedVersion, cc-by)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- oral assessment, ISBAR, written assessment, academic integrity, generative AI, nursing education, performance-based assessment, assessment redesign, case study assessment, student performance outcomes, employee experience
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Replacing written assessment with an oral ISBAR assessment in a 700‑student cohort: cohort‑level outcomes for performance, integrity, and staff experience. https://app.cochat.ai/papers/10.1080/02602938.2026.2684284
- The paper
- Ogle, T., & Jarrett, P. (2026). Replacing written assessment with an oral ISBAR assessment in a 700‑student cohort: cohort‑level outcomes for performance, integrity, and staff experience. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2026.2684284
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.



