The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index; 6 of the 39 sources its claims cite were checked for support.
Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI
Open accessAbstract
The proliferation of generative artificial intelligence (AI) tools has fundamentally challenged traditional written assessments across higher education, with particular implications for laboratory-based disciplines where written work may substitute for demonstration of practical competence, necessitating approaches that prioritise direct performance. This study presents the adaptation of objective structured clinical examination (OSCE) methodology from medical education to laboratory biosciences, demonstrating a practical framework for authentic assessment in the AI era. We describe and evaluate the transformation of a microscopy assessment in FHEQ Level 4 Biomedical Sciences from a traditional laboratory report to a 20-minute OSCE-style practical evaluation. The redesigned assessment maintained grade distributions while eliminating AI vulnerability through real-time performance demonstration and conversational examination. The implementation achieved close alignment between learning outcomes and assessment methods while providing inherent resistance to generative AI exploitation through direct performance requirements. Equity implications are complex and context-dependent, with potential barriers for students with communication differences alongside potential benefits for others, such as those with written communication difficulties, emphasising the importance of balanced assessment portfolios and appropriate reasonable adjustments. The cross-disciplinary adaptation demonstrates that OSCE methodology offers a scalable solution to AI-era assessment challenges, with performance-focused design maintaining academic integrity more effectively than restrictive policies while enhancing authenticity and equity outcomes.
Overview
CoChat Summary
TL;DR
This case study adapts OSCE methodology from medical education to a FHEQ Level 4 Biomedical Sciences microscopy assessment, replacing a traditional laboratory report with a 20-minute in-person practical evaluation. The redesign maintained comparable grade distributions while eliminating recorded academic misconduct referrals and reducing vulnerability to generative AI.
Key findings
- Grade distributions did not differ significantly between the old written format (2021–22 and 2022–23, n = 429) and the new OSCE-style format (2023–24 and 2024–25, n = 280): χ² = 11.81, df = 6, P = 0.066, with a small association by Cramer’s V = 0.13.
- Prior to the new format, between five and ten students were referred each year for academic misconduct; after the change to in-person assessment, there were none.
- Failure rates and non-attendance remained consistent across both formats.
- The assessment used a standardised 20-minute individual session (15 minutes assessment, 5 minutes examiner deliberation and feedback), six parallel stations, two markers per station, and 25–30 equivalent specimen sets to reduce information sharing.
Methods
- Design: a case study and practical assessment intervention transforming a microscopy assessment in an FHEQ Level 4 Biomedical Sciences programme at Brunel University of London from a traditional laboratory report to an adapted OSCE-style practical evaluation.
- Data: anonymised institutional student performance records across four academic years, comparing old format years 2021–22 (n = 235) and 2022–23 (n = 194) with new format years 2023–24 (n = 142) and 2024–25 (n = 138).
- Analysis: Chi-squared test of independence on grade categories (A, B, C, D, E, F, Other) by assessment format, with Cramer’s V calculated manually; grades were compiled in Microsoft Excel.
Limitations
- The paper states that equity implications are complex and context-dependent, that aggregate measures cannot capture barriers for individual students with diverse needs, and that no single assessment mode can address the full range of learner variability.
- The paper states resource implications include increased direct contact time, double-marking, and laboratory space requirements, though reduced written marking and moderation made overall workload comparable.
- Evident from the text: this is a single-institution, single-module case study without a controlled comparison; the old-format years included a small but statistically significant year-to-year difference likely reflecting Covid-related disruption in 2021–22, and future work is needed on station design and long-term knowledge retention.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
6 Valid · 0 Not valid · 19 Not checked · 51 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“OSCE-style assessments introduce distinctive equity challenges, particularly for students with autism and communication differences who may find formats relying on rapid interpersonal exchanges and performance under time pressure disproportionately demanding [19,20].”
§ Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI > Discussion > OSCE assessment and equity challenges
What the sources say
- Not checked — no full text of the sourcecites [19] Gibson, 2011, How do students with dyslexia perform in extended matching questions, short answer questions and observed structured clinical examinations?, Adv. Health Sci. Educ. Theory Pract. source
- Partly supportedcites [20] Hull, 2017, “Putting on My Best Normal”: Social Camouflaging in Adults with Autism Spectrum Conditions, J. Autism Dev. Disord. sourceExperimental — accuracy not yet measured
In “Compensation: ‘To Exceed What Nature has Given’” (page unavailable), autistic adults describe preparing conversational scripts rather than having to chat spontaneously, which supports the concern about rapid interpersonal exchanges. The paper does not study students, OSCE-style assessments, time-pressured performance, or assessment equity, so it does not establish that those formats are disproportionately demanding. (LLM, conf=0.84)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“However, written laboratory reports have significant vulnerabilities in the AI era [6].”
§ Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI > Introduction > Traditional assessment in laboratory sciences
What the sources say
- Supportedcites [6] West, 2023, An Analysis of AI-generated laboratory reports across the chemistry curriculum and student perceptions of ChatGPT, J. Chem. Educ. source
The Report Analyses section says ChatGPT produced generally correct background, typical procedures, and typical results for common chemistry labs. The Mitigation of Generative AI Use section proposes changes to assignments and grading to discourage students from submitting AI-generated reports, supporting the broad claim that written reports are vulnerable to AI use. The Conclusions qualify the extent of that vulnerability: the tested ChatGPT version could not produce top-scoring reports and struggled with experimental specifics. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“While universities have developed policies on generative AI use, the generic nature of institutional guidelines creates a significant gap between policy and practice, leaving educators and students in specific disciplines with insufficient guidance on acceptable AI integration versus academic misconduct in their academic contexts [1].”
§ Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI > Introduction > The generative artificial intelligence challenge to assessment integrity
What the sources say
- Partly supportedcites [1] Cotton, 2024, Chatting and cheating: ensuring academic integrity in the era of ChatGPT, Innovations in Education and Teaching International sourceExperimental — accuracy not yet measured
The section on preventing plagiarism recommends clear course-level guidelines explaining when and how GPT-3 may be used and how its output should be attributed. The Conclusion also recommends university policies and training. Neither passage says that existing institutional guidelines are generic or have created a significant policy–practice gap that leaves particular disciplines without sufficient guidance; no page numbers are available in our copy. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“The implementation of OSCE-style assessment demonstrates strong alignment with competency-based education (CBE) frameworks, which emphasise demonstration of specific, measurable skills rather than written articulation [29,30].”
§ Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI > Discussion > Competency-based learning outcomes and OSCE methodology
What the sources say
- Not checked — no full text of the sourcecites [29] Frank, 2010, Toward a definition of competency-based education in medicine: a systematic review of published definitions, Med. Teach. source
- Supportedcites [30] Gruppen, 2012, The promise of competency-based education in the health professions for improving global health, Hum. Resour. Health source
The sections ‘A competency is expressible in terms of measurable behavior’ and ‘Assessing learners for competence’ say that CBE emphasizes observable performance and that higher-order skills require direct observation or skills-based evaluation, rather than a knowledge examination alone. Table 1 also lists standardized-patient examinations and structured direct observation as assessment methods. Although the paper does not name OSCEs, these passages support the claimed alignment of OSCE-style assessment with CBE. (LLM, conf=0.87)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the effect size, measured by Cramer’s V (0.13), suggests a small association between assessment format and grade distribution”
§ Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI > Results > Outcomes and performance analysis
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
28 more claims
Create a free account to see all 76 claims and every source verdict.
- It may state two separate claims as one. 31
- Probably not a substantial claim. 23
Citations
Cites
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883 · cited 1×
“Assessment authenticity is strengthened by requiring students to demonstrate practical skills in laboratory scenarios mirroring professional practice, while direct observation provides higher validity by evaluating actual competencies rather than written communication abilities [15–17].”
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · cited 1×
“…on generative AI use, the generic nature of institutional guidelines creates a significant gap between policy and practice, leaving educators and students in specific disciplines with insufficient guidance on acceptable AI integration versus academic misconduct in their academic contexts [1].”
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110 · cited 2×
“Improved alignment between assessment tasks and intended competencies supports stronger assessment with clearer differentiation between theoretical knowledge and practical competence, demonstrating how improved alignment yields more accurate evaluation of student capabilities [17,32].”
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806 · cited 1×
“…disciplines, where practical skills and scientific reasoning are fundamental learning outcomes, the potential for AI to complete data analysis and written assessments/reports undermines the validity of these methods as evaluative tools, unless conducted under supervised conditions [2].”
Assessment of clinical competence using an objective structured clinical examination (OSCE)
HARDEN, R. M., & GLEESON, F. A. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb00918.x · Cited by 1,509
“Putting on My Best Normal”: Social Camouflaging in Adults with Autism Spectrum Conditions
Hull, L., Petrides, K. V., Allison, C., Smith, P., Baron-Cohen, S., Lai, M.-C., & Mandy, W. (2017) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3166-5 · Cited by 1,365 · cited 1×
“OSCE-style assessments introduce distinctive equity challenges, particularly for students with autism and communication differences who may find formats relying on rapid interpersonal exchanges and performance under time pressure disproportionately demanding [19,20].”
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247 · cited 1×
“Improved alignment between assessment tasks and intended competencies supports stronger assessment with clearer differentiation between theoretical knowledge and practical competence, demonstrating how improved alignment yields more accurate evaluation of student capabilities [17,32].”
A five-dimensional framework for authentic assessment
Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004) · Educational Technology Research and Development · doi:10.1007/bf02504676 · Cited by 916
Frank, J. R., Mungroo, R., Ahmad, Y., Wang, M., De Rossi, S., & Horsley, T. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.500898 · Cited by 781
Authentic assessment: creating a blueprint for course design
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1412396 · Cited by 560 · cited 2×
“The successful cross-disciplinary transfer from medical to laboratory education suggests that assessment design strategies focusing on authentic performance demonstration may be more effective than blanket AI restrictions for maintaining academic integrity [4,29].”
Research works printed but not linked: 4
- Ferns, 2014, Work Integrated Learning in the Curriculum, 1
- Biggs, 2011, Teaching for Quality Learning at University
- Royal College of Anaesthetists, 2023, Guidance on Reasonable Adjustments for Trainees with Disabilities
- Singleton, 1999, Report of the National Working Party on Dyslexia in Higher Education
Cited by
Shaping the future of bioscience education: trends, challenges and community insights
Watson, H., Smith, D. P., & Mello, L. V. (2025) · Emerging Topics in Life Sciences · doi:10.1042/etls20260001
Zahid, K. (2026) · Research Square · doi:10.21203/rs.3.rs-10581991/v1
Zahid, K., & Riaz, M. S. (2026) · doi:10.2196/preprints.111382
Metadata
- Authors
- Mann, R., Tosi, S., & Tree, D.
- Affiliations
- Brunel University of London (GB)
- Corresponding author
- Tree, David
- Venue
- Emerging Topics in Life Sciences
- Publisher
- Portland Press Ltd.
- Published
- 2025-12
- Volume
- 9
- Issue
- 3
- ISSN
- 2397-8554 (ISSN-L)
- 2397-8562
- PMC
- PMC13085831
- OpenAlex
- W7140205452
- Cited by
- 3
- References
- 23
- Citations by year
- 2026: 2 · 2025: 1
- FWCI
- 2.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Emerging Topics in Life Sciences (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- OSCE, generative AI in assessment, laboratory-based assessment, assessment equity, reasonable accommodation, academic integrity, assessment design, biomedical education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI. https://app.cochat.ai/papers/10.1042/etls20253021
- The paper
- Mann, R., Tosi, S., & Tree, D. (2025). Clinical assessment meets laboratory science: adapting OSCE methodology for authentic biosciences evaluation in the age of generative AI. Emerging Topics in Life Sciences. https://doi.org/10.1042/etls20253021
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.