GPT-4: the future of artificial intelligence in medical school assessments
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
In recent years, artificial intelligence (AI) has been rapidly advancing in many fields, including medicine. One AI tool that has gained particular attention in the medical community is Chat-GPT, a large language model developed by OpenAI, which was first launched in November 2022, and its updated version, GPT-4, which was launched in March and which promises to be even more powerful and accurate in its capabilities. GPT-4 is a powerful tool that can generate human-like responses to a wide range of questions, prompts and images, and create academic articles, such as the one you are reading now. Using Chat-GPT to develop early iterations of this article and its title, some of which are shared in Appendix 1, highlights its potential to shift how we assess and prompt a careful reconsideration of the potential role of AI in medical education. Medical school assessments are crucial to ensuring that newly graduated doctors are competent to provide safe and effective care and at an appropriate level to pursue postgraduate medical training. Traditionally, medical school examinations have been packaged into programmes and systems of assessment of written, practical and workplacebased assessments, overseen and graded by human examiners. However, the use of AI tools like ChatGPT can provide new opportunities for medical school assessments. The disruption caused by COVID-19 caused a shift in the delivery of medical education, with a review of how teaching is delivered, and many assessments being adapted to online versions. This led to increased innovation in assessments and sparked discussion about the potential impact of cheating and the ethics surrounding the increased use of technology in assessment. The idea of cheating forces greater interrogation of the purposes of assessment in a professional education programme like medicine and how students view their high-stakes exams. Although workplace-based assessments have received great attention and priority in recent years because of their authenticity to ‘real-world’ clinical practice, students often focus on their performance on written and practical assessments. This may reflect that these occur less frequently than workplace-based assessments, and therefore there is less opportunity to view written and practical exams as assessments for learning, rather than assessments of learning. This view may influence how students behave in their assessments, as they perform to satisfy their assessor, rather than patient-centred care being the focus. With GPT-4’s ability to analyse diverse data, we must consider its potential to become an assessor, and how this could radically shift how students view and interact with assessment. While AI may not have all the answers, it can be utilised as a tool to enhance current assessment models. If we consider the breadth of output that the current GPT-4 prototype offers, we can begin to imagine the potential it could bring to medical school assessments. Below are some examples of how it can be utilised in current assessment models:
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Core principles of assessment in competency-based medical education.
Lockyer, J., Carraccio, C., Chan, M.-K., Hart, D., Smee, S., Touchie, C., Holmboe, E. S., Frank, J. R., & Collaborators, O. B. O. T. I. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1315082 · Cited by 493
Cited by
A scoping review of artificial intelligence in medical education: BEME Guide No. 84
Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M., Grafton-Clarke, C., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2314198 · Cited by 679
The application of large language models in medicine: A scoping review
Meng, X., Yan, X., Zhang, K., Liu, D., Cui, X., Yang, Y., Zhang, M., Cao, C., Wang, J., Wang, X., et al. (2024) · iScience · doi:10.1016/j.isci.2024.109713 · Cited by 414
Generative AI in Undergraduate Medical Education: A Rapid Review
Hale, J., Alexander, S., Wright, S. T., & Gilliland, K. (2024) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205241266697 · Cited by 46
Weisman, D., Sugarman, A., Huang, Y. M., Gelberg, L., Ganz, P. A., & Comulada, W. S. (2025) · JMIR Formative Research · doi:10.2196/65670 · Cited by 37
Metadata
- Authors
- Haruna-Cooper, L., & Rashid, M. A.
- Venue
- Journal of the Royal Society of Medicine
- Publisher
- SAGE Publications
- Published
- 2023-06
- Volume
- 116
- Issue
- 6
- Pages
- 218-219
- ISSN
- 0141-0768 (ISSN-L)
- 1758-1095
- OpenAlex
- W4380786362
- Cited by
- 23
- References
- 1
- FWCI
- 0.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: GPT-4: the future of artificial intelligence in medical school assessments. https://app.cochat.ai/papers/10.1177/01410768231181251
- The paper
- Haruna-Cooper, L., & Rashid, M. A. (2023). GPT-4: the future of artificial intelligence in medical school assessments. Journal of the Royal Society of Medicine. https://doi.org/10.1177/01410768231181251
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.