Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index; 6 of the 39 sources its claims cite were checked for support.

Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI

Open access
Mann, Ruchira, Tosi, Sabrina, Tree, David · 2025 · Emerging Topics in Life Sciences

Abstract

The proliferation of generative artificial intelligence (AI) tools has fundamentally challenged traditional written assessments across higher education, with particular implications for laboratory-based disciplines where written work may substitute for demonstration of practical competence, necessitating approaches that prioritise direct performance. This study presents the adaptation of objective structured clinical examination (OSCE) methodology from medical education to laboratory biosciences, demonstrating a practical framework for authentic assessment in the AI era. We describe and evaluate the transformation of a microscopy assessment in FHEQ Level 4 Biomedical Sciences from a traditional laboratory report to a 20-minute OSCE-style practical evaluation. The redesigned assessment maintained grade distributions while eliminating AI vulnerability through real-time performance demonstration and conversational examination. The implementation achieved close alignment between learning outcomes and assessment methods while providing inherent resistance to generative AI exploitation through direct performance requirements. Equity implications are complex and context-dependent, with potential barriers for students with communication differences alongside potential benefits for others, such as those with written communication difficulties, emphasising the importance of balanced assessment portfolios and appropriate reasonable adjustments. The cross-disciplinary adaptation demonstrates that OSCE methodology offers a scalable solution to AI-era assessment challenges, with performance-focused design maintaining academic integrity more effectively than restrictive policies while enhancing authenticity and equity outcomes.

Overview

CoChat Summary

TL;DR

This case study adapts OSCE methodology from medical education to a FHEQ Level 4 Biomedical Sciences microscopy assessment, replacing a traditional laboratory report with a 20-minute in-person practical evaluation. The redesign maintained comparable grade distributions while eliminating recorded academic misconduct referrals and reducing vulnerability to generative AI.

Key findings

  • Grade distributions did not differ significantly between the old written format (2021–22 and 2022–23, n = 429) and the new OSCE-style format (2023–24 and 2024–25, n = 280): χ² = 11.81, df = 6, P = 0.066, with a small association by Cramer’s V = 0.13.
  • Prior to the new format, between five and ten students were referred each year for academic misconduct; after the change to in-person assessment, there were none.
  • Failure rates and non-attendance remained consistent across both formats.
  • The assessment used a standardised 20-minute individual session (15 minutes assessment, 5 minutes examiner deliberation and feedback), six parallel stations, two markers per station, and 25–30 equivalent specimen sets to reduce information sharing.

Methods

  • Design: a case study and practical assessment intervention transforming a microscopy assessment in an FHEQ Level 4 Biomedical Sciences programme at Brunel University of London from a traditional laboratory report to an adapted OSCE-style practical evaluation.
  • Data: anonymised institutional student performance records across four academic years, comparing old format years 2021–22 (n = 235) and 2022–23 (n = 194) with new format years 2023–24 (n = 142) and 2024–25 (n = 138).
  • Analysis: Chi-squared test of independence on grade categories (A, B, C, D, E, F, Other) by assessment format, with Cramer’s V calculated manually; grades were compiled in Microsoft Excel.

Limitations

  • The paper states that equity implications are complex and context-dependent, that aggregate measures cannot capture barriers for individual students with diverse needs, and that no single assessment mode can address the full range of learner variability.
  • The paper states resource implications include increased direct contact time, double-marking, and laboratory space requirements, though reduced written marking and moderation made overall workload comparable.
  • Evident from the text: this is a single-institution, single-module case study without a controlled comparison; the old-format years included a small but statistically significant year-to-year difference likely reflecting Covid-related disruption in 2021–22, and future work is needed on station design and long-term knowledge retention.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1042/etls20253021

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Shift in grade profiles with assessment redesign. Proportions of students achieving grades in the years before and after the introduction of the OSCE-style microscopy assessment. A grades are 71% and above, B grades 61%–68%, C grades 51%–58%, D grades 41%–48%, E grades 31%–38%, and F grades are 25% and below. The ‘Other’ category includes non-submissions and students on abeyance. Student cohort sizes are as follows: 2021–22 = 235 students, 2022–23 = 194 students, 2023–24 = 142 students and 2024–25 = 138 students.
Figure 1 Shift in grade profiles with assessment redesign. Proportions of students achieving grades in the years before and after the introduction of the OSCE-style microscopy assessment. A grades are 71% and above, B grades 61%–68%, C grades 51%–58%, D grades 41%–48%, E grades 31%–38%, and F grades are 25% and below. The ‘Other’ category includes non-submissions and students on abeyance. Student cohort sizes are as follows: 2021–22 = 235 students, 2022–23 = 194 students, 2023–24 = 142 students and 2024–25 = 138 students.CC BY · PubMed Central

Verification

Claims the paper makes

6 Valid · 0 Not valid · 19 Not checked · 51 Own results and interpretations

28 more claims

Create a free account to see all 76 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 31
  • Probably not a substantial claim. 23

Create a free account to see these claims.

Citations

Cites

Show all 23 references

Research works printed but not linked: 4

  1. Ferns, 2014, Work Integrated Learning in the Curriculum, 1
  2. Biggs, 2011, Teaching for Quality Learning at University
  3. Royal College of Anaesthetists, 2023, Guidance on Reasonable Adjustments for Trainees with Disabilities
  4. Singleton, 1999, Report of the National Working Party on Dyslexia in Higher Education

Metadata

Authors
Mann, R., Tosi, S., & Tree, D.
Affiliations
Brunel University of London (GB)
Corresponding author
Tree, David
Venue
Emerging Topics in Life Sciences
Published
2025-12
Volume
9
Issue
3
ISSN
  • 2397-8554 (ISSN-L)
  • 2397-8562
OpenAlex
W7140205452
Cited by
3
References
23
Citations by year
2026: 2 · 2025: 1
FWCI
2.71
Type
journal article
Language
en
Open access
Locations
  • Emerging Topics in Life Sciences (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion, cc-by)
Topics
  • Social Sciences › Education › Innovations in Medical Education
  • Social Sciences › Education › Student Assessment and Feedback
  • Social Sciences › Education › Educational Assessment and Pedagogy
Keywords
OSCE, generative AI in assessment, laboratory-based assessment, assessment equity, reasonable accommodation, academic integrity, assessment design, biomedical education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI. https://app.cochat.ai/papers/10.1042/etls20253021
The paper
Mann, R., Tosi, S., & Tree, D. (2025). Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI. Emerging Topics in Life Sciences. https://doi.org/10.1042/etls20253021

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.