The impact of artificial intelligence on clinical education: perceptions of postgraduate trainee doctors in London (UK) and recommendations for trainers
Open accessThe DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
BACKGROUND: Artificial intelligence (AI) technologies are increasingly used in clinical practice. Although there is robust evidence that AI innovations can improve patient care, reduce clinicians' workload and increase efficiency, their impact on medical training and education remains unclear. METHODS: A survey of trainee doctors' perceived impact of AI technologies on clinical training and education was conducted at UK NHS postgraduate centers in London between October and December 2020. Impact assessment mirrored domains in training curricula such as 'clinical judgement', 'practical skills' and 'research and quality improvement skills'. Significance between Likert-type data was analysed using Fisher's exact test. Response variations between clinical specialities were analysed using k-modes clustering. Free-text responses were analysed by thematic analysis. RESULTS: Two hundred ten doctors responded to the survey (response rate 72%). The majority (58%) perceived an overall positive impact of AI technologies on their training and education. Respondents agreed that AI would reduce clinical workload (62%) and improve research and audit training (68%). Trainees were skeptical that it would improve clinical judgement (46% agree, p = 0.12) and practical skills training (32% agree, p < 0.01). The majority reported insufficient AI training in their current curricula (92%), and supported having more formal AI training (81%). CONCLUSIONS: Trainee doctors have an overall positive perception of AI technologies' impact on clinical training. There is optimism that it will improve 'research and quality improvement' skills and facilitate 'curriculum mapping'. There is skepticism that it may reduce educational opportunities to develop 'clinical judgement' and 'practical skills'. Medical educators should be mindful that these domains are protected as AI develops. We recommend that 'Applied AI' topics are formalized in curricula and digital technologies leveraged to deliver clinical education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Surveys indicate strong backing for AI literacy training, with 81% of UK physicians4 and 63% of Canadian medical students recognizing its importance12, while an overwhelming 93.8% of students in Turkey support structured AI education, particularly in the domains of knowledge, applications, and ethics13.”
From Developing a Canadian artificial intelligence medical curriculum using a Delphi study (2024) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies show that students support this idea [40, 41].”
From Medical, dental, and nursing students’ attitudes and knowledge towards artificial intelligence: a systematic review and meta-analysis (2024) · cites this paper as [40]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Few structured programs thoroughly address both the practical and ethical dimensions of AI in medicine3–10.”
From Developing a Canadian artificial intelligence medical curriculum using a Delphi study (2024) · cites this paper as [4]
The cited source says what the claim attributes to it.
In the citing paper
“However, despite these advancements, the adoption of AI curricular elements in medical education has lagged4.”
From Developing a Canadian artificial intelligence medical curriculum using a Delphi study (2024) · cites this paper as [4]
The cited source says what the claim attributes to it.
In the citing paper
“Banerjee et al. and Teng et al., reporting that 81% of physicians and 63·36% of medical students, respectively, support fundamental AI literacy training [7,8].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [7]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 1×
“Free-text responses were analysed using thematic analysis [22].”
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · cited 1×
“Although there is an abundance of evidence supporting the safety, accuracy, cost and workflow benefits of AI technologies in healthcare [5 – 7], there is limited research investigating the impact of AI on medical education [8, 9], the new skills required, and in particular the perceptions of…”
BackgroundHigh-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“The healthcare sector is undergoing a digital revolution [1], with a wide range of artificial intelligence (AI) innovations increasingly encountered in routine clinical practice [2].”
BackgroundA guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · cited 1×
“Computer vision algorithms can detect lesions from radiological scans, make measurements, and pick-up incidental findings, saving time and reducing error [13, 14].”
BackgroundExtensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical Values
Huang, Z. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009769707641 · Cited by 2,505 · cited 1×
“K-modes clustering was used to identify key groups of responses to the Likert-type statements [21].”
MethodArdila, D., Kiraly, A. P., Bharadwaj, S., Choi, B., Reicher, J. J., Peng, L., Tse, D., Etemadi, M., Ye, W., Corrado, G., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0447-x · Cited by 2,167 · cited 1×
“Radiology has experienced the most AI advances in clinical practice already [27, 28] so Radiology trainees are most likely to already first-hand experience of AI ’ s impact on their training.”
BackgroundRajpurkar, P., Irvin, J., Ball, R. L., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., Langlotz, C. P., et al. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002686 · Cited by 1,449 · cited 1×
“Radiology has experienced the most AI advances in clinical practice already [27, 28] so Radiology trainees are most likely to already first-hand experience of AI ’ s impact on their training.”
BackgroundEthical and legal challenges of artificial intelligence-driven healthcare
Gerke, S., Minssen, T., & Cohen, G. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00012-5 · Cited by 1,170
Nagendran, M., Chen, Y., Lovejoy, C. A., Gordon, A. C., Komorowski, M., Harvey, H., Topol, E. J., Ioannidis, J. P. A., Collins, G. S., & Maruthappu, M. (2020) · BMJ · doi:10.1136/bmj.m689 · Cited by 1,152 · cited 1×
“Common pitfalls include over-optimistic conclusions from ‘ human versus clinician ’ studies that are usually retrospective and prone to bias [32], lack of standardized benchmarks and no universally accepted AI evaluation metrics [33].”
BackgroundA clinically applicable approach to continuous prediction of future acute kidney injury
Tomašev, N., Glorot, X., Rae, J. W., Zielinski, M., Askham, H., Saraiva, A., Mottram, A., Meyer, C., Ravuri, S., Protsyuk, I., et al. (2019) · Nature · doi:10.1038/s41586-019-1390-1 · Cited by 1,086 · cited 1×
“For example, decision support systems can triage patients, suggest diagnoses and alert test re-sults by analysing data faster and more accurately than clinicians [6, 10].”
BackgroundArtificial Intelligence and Human Trust in Healthcare: Focus on Clinicians
Asan, O., Bayrak, A. E., & Choudhury, A. (2020) · Journal of Medical Internet Research · doi:10.2196/15154 · Cited by 825 · cited 1×
“Although these technologies undoubtedly offer considerable benefits to patients, clinicians, and healthcare systems, there are concerns that they could come at a cost such as lack of trust in the algorithmic output due to the black-box effect [17, 18].”
BackgroundIntroducing artificial intelligence training in medical education
Paranjape, K., Schinkel, M., Nannan Panday, R., Car, J., & Nanayakkara, P. (2019) · JMIR Medical Education · doi:10.2196/16048 · Cited by 634 · cited 3×
“Although there is an abundance of evidence supporting the safety, accuracy, cost and workflow benefits of AI technologies in healthcare [5–7], there is limited research investigating the impact of AI on medical education [8, 9], the new skills required, and in particular the perceptions of trainee doctors who will be…”
BackgroundInfluentialMedical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585 · cited 2×
“Although this has been considered as a priority for the future health workforce [2, 3], ‘ Applied AI ’ topics remain widely absent from clinical training curricula [9, 19].”
BackgroundHashimoto, D. A., Witkowski, E., Gao, L., Meireles, O., & Rosman, G. (2020) · Anesthesiology · doi:10.1097/aln.0000000000002960 · Cited by 536 · cited 1×
“These skills are notoriously hard to model for AI development [25].”
BackgroundRole of artificial intelligence in patient safety outcomes: systematic literature review
Choudhury, A., & Asan, O. (2020) · JMIR Medical Informatics · doi:10.2196/18599 · Cited by 440 · cited 1×
“Common pitfalls include over-optimistic conclusions from ‘ human versus clinician ’ studies that are usually retrospective and prone to bias [32], lack of standardized benchmarks and no universally accepted AI evaluation metrics [33].”
BackgroundFernandes, M., Vieira, S. M., Leite, F., Palos, C., Finkelstein, S., & Sousa, J. M. C. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101762 · Cited by 312 · cited 1×
“For example, decision support systems can triage patients, suggest diagnoses and alert test re-sults by analysing data faster and more accurately than clinicians [6, 10].”
BackgroundWinkler-Schwartz, A., Bissonnette, V., Mirchi, N., Ponnudurai, N., Yilmaz, R., Ledwos, N., Siyar, S., Azarnoush, H., Karlik, B., & Del Maestro, R. F. (2019) · Journal of Surgical Education · doi:10.1016/j.jsurg.2019.05.015 · Cited by 295 · cited 1×
“%) of respondents in our survey were yet to regularly encounter AI systems in their training and education, it is an area of active research ranging from assisted radiology teaching [29] to virtual reality for surgical skills development [30] and automated assessment of procedural performance [31].”
BackgroundReimagining Medical Education in the Age of AI
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.146 · Cited by 263 · cited 2×
“Traditionally, medical education is centred around knowledge assimilation (by didactic teaching) and vocational training to develop practical, interpersonal and professional skills [19].”
BackgroundPredicting scheduled hospital attendance with artificial intelligence
Nelson, A., Herron, D., Rees, G., & Nachev, P. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0103-3 · Cited by 142 · cited 1×
“Although there is an abundance of evidence supporting the safety, accuracy, cost and workflow benefits of AI technologies in healthcare [5 – 7], there is limited research investigating the impact of AI on medical education [8, 9], the new skills required, and in particular the perceptions of…”
BackgroundHow AI technology can tame the scientific literature
Extance, A. (2018) · Nature · doi:10.1038/d41586-018-06617-5 · Cited by 102 · cited 1×
“%) report [23].”
Artificial intelligence-based education assists medical students’ interpretation of hip fracture
Cheng, C.-T., Chen, C.-C., Fu, C.-Y., Chaou, C.-H., Wu, Y.-T., Hsu, C.-P., Chang, C.-C., Chung, I.-F., Hsieh, C.-H., Hsieh, M.-J., et al. (2020) · Insights into Imaging · doi:10.1186/s13244-020-00932-0 · Cited by 87
Bressem, K. K., Adams, L. C., Gaudin, R. A., Tröltzsch, D., Hamm, B., Makowski, M. R., Schüle, C.-Y., Vahldiek, J. L., & Niehues, S. M. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa668 · Cited by 69
Why we cannot trust artificial intelligence in medicine
DeCamp, M., & Tilburt, J. C. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30197-9 · Cited by 66 · cited 1×
“Although these technologies undoubtedly offer considerable benefits to patients, clinicians, and healthcare systems, there are concerns that they could come at a cost such as lack of trust in the algorithmic output due to the black-box effect [17, 18].”
BackgroundPrice, W. (2017) · Michigan Law Review · doi:10.36644/mlr.116.3.regulating · Cited by 64
Dumić-Čule, I., Orešković, T., Brkljačić, B., Kujundžić Tiljak, M., & Orešković, S. (2020) · Croatian Medical Journal · doi:10.3325/cmj.2020.61.457 · Cited by 61 · cited 1×
“This echoes positive attitudes reported previously [26].”
Aeckersberg, G., Gkremoutis, A., Schmitz‐Rixen, T., & Kaiser, E. (2018) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2018.10.047 · Cited by 54 · cited 1×
“%) of respondents in our survey were yet to regularly encounter AI systems in their training and education, it is an area of active research ranging from assisted radiology teaching [29] to virtual reality for surgical skills development [30] and automated assessment of procedural performance [31].”
BackgroundGoldstein, A., & D, Y. S. M. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.03.022 · Cited by 48 · cited 1×
“Natural language processing can auto-mate clinical documentation by text summarization [11] and detect diagnoses from scan reports [12].”
BackgroundBlaivas, M., Blaivas, L. N., Philips, G. S., Merchant, R. C., Levy, M. M., Abbasi, A. A., Eickhoff, C., Shapiro, N., & Corl, K. A. (2020) · Journal of Ultrasound in Medicine · doi:10.1002/jum.15527 · Cited by 31 · cited 1×
“Robots trained by human operators could perform procedures such as venepuncture, and ultrasound [15, 16].”
A new robotic assistance system for percutaneous CT-guided punctures: Initial experience
Grötz, S., Wilhelm, K., Willinek, W. A., Pieper, C. C., Schild, H. H., & Thomas, D. (2015) · Minimally Invasive Therapy & Allied Technologies · doi:10.3109/13645706.2015.1110825 · Cited by 27 · cited 1×
“Robots trained by human operators could perform procedures such as venepuncture, and ultrasound [15, 16].”
MethodHoward, J. P., Zaman, S., Ragavan, A., Hall, K., Leonard, G., Sutanto, S. A., Ramadoss, V., Razvi, Y., Linton, N., Bharath, A. A., et al. (2020) · International journal of cardiac imaging · doi:10.1007/s10554-020-02050-w · Cited by 18 · cited 1×
“Computer vision algorithms can detect lesions from radiological scans, make measurements, and pick-up incidental findings, saving time and reducing error [13, 14].”
BackgroundSelf-citationIntroducing Artificial Intelligence Training in Medical Education (Preprint)Preprint
Paranjape, K., Schinkel, M., Panday, R. S. N., et al. (2019) · doi:10.2196/preprints.16048 · Cited by 5
Research works printed but not linked: 2
- (2) [cited 2021 Jan 10] Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6918207/.
- (6) [cited 2021 May 26] Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7334754/.
Cited by
Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100118 · Cited by 1,181
Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging
Najjar, R. (2023) · Diagnostics · doi:10.3390/diagnostics13172760 · Cited by 886
A scoping review of artificial intelligence in medical education: BEME Guide No. 84
Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M., Grafton-Clarke, C., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2314198 · Cited by 679
Wang, C., Chen, X., Yu, T., Liu, Y., & Jing, Y. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-02717-y · Cited by 255
AI-Driven Clinical Decision Support Systems: An Ongoing Pursuit of Potential
Elhaddad, M., & Hamam, S. (2024) · Cureus · doi:10.7759/cureus.57728 · Cited by 301
“This aligns with the need for continuous learning programs, hands-on workshops, and interdisciplinary collaborations to empower clinicians to harness the full capabilities of AI-CDSS and leverage them to improve patient care outcomes [30].”
Background
Metadata
- Authors
- Banerjee, M., Chiew, D., Patel, K. T., Johns, I., Chappell, D., Linton, N., Cole, G. D., Francis, D. P., Szram, J., Ross, J., & Zaman, S.
- Affiliations
- University College London (GB)
- Imperial College London (GB)
- Guy's and St Thomas' NHS Foundation Trust (GB)
- Imperial College Healthcare NHS Trust (GB)
- Royal College of Physicians (GB)
- Corresponding author
- Zaman, Sameer
- Venue
- BMC Medical Education
- Published
- 2021-08-14
- Volume
- 21
- Issue
- 1
- Pages
- 429-429
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC8364021
- OpenAlex
- W3193637582
- Cited by
- 168
- References
- 30
- Citations by year
- 2026: 38 · 2025: 49 · 2024: 48 · 2023: 22 · 2022: 10 · 2021: 1
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Funders
- National Institute for Health and Care Research (ACF-2018-21-001)
- Engineering and Physical Sciences Research Council (2281183, 2281165)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Keywords
- artificial intelligence, clinical teaching, graduate medical education, clinical judgment, practical skills training, clinical workload, medical curriculum
- MeSH terms
- Artificial Intelligence, United Kingdom, Humans, London, Perception, Physicians, Surveys and Questionnaires
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.