Physicians’ required competencies in AI-assisted clinical settings: a systematic review
Open accessThe DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Utilizing Artificial Intelligence (AI) in clinical settings may offer significant benefits. A roadblock to the responsible implementation of medical AI is the remaining uncertainty regarding requirements for AI users at the bedside. An overview of the academic literature on human requirements for the adequate use of AI in clinical settings is therefore of significant value. SOURCES OF DATA: A systematic review of the potential implications of medical AI for the required competencies of physicians as mentioned in the academic literature. AREAS OF AGREEMENT: Our findings emphasize the importance of physicians' critical human skills, alongside the growing demand for technical and digital competencies. AREAS OF CONTROVERSY: Concrete guidance on physicians' required competencies in AI-assisted clinical settings remains ambiguous and requires further clarification and specification. Dissensus remains over whether physicians are adequately equipped to use and monitor AI in clinical settings in terms of competencies, skills and expertise, issues of ownership regarding normative guidance, and training of physicians' skills. GROWING POINTS: Our review offers a basis for subsequent further research and normative analysis on the responsible use of AI in clinical settings. AREAS TIMELY FOR DEVELOPING RESEARCH: Future research should clearly outline (i) how physicians must be(come) competent in working with AI in clinical settings, (ii) who or what should take ownership of embedding these competencies in a normative and regulatory framework, (iii) investigate conditions for achieving a reasonable amount of trust in AI, and (iv) assess the connection between trust and efficiency in patient care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Despite the growing integration of AI into clinical practice, concrete guidance remains limited regarding which competencies physicians using AI should develop, what levels of proficiency are required, and which educational approaches are most appropriate [51].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“…findings of other ethicists in the field, who stress that inter-stakeholder cooperation at a policy level is needed to fit multiple AI-ethics agendas together, and to aim for procedural consensus on both ethical principles as the implementation of these principles in clinical settings [73].”
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · cited 2×
“Relatedly, these potential developments raise concerns about the influence of AI on patient autonomy,the need for transparent reporting on the use of AI, and overreliance on AI [10,11].”
Revolutionizing healthcare: the role of artificial intelligence in clinical practice
Alowais, S. A., Alghamdi, S. S., Alsuhebany, N., Alqahtani, T., Alshaya, A. I., Almohareb, S. N., Aldairem, A., Alrashed, M., Bin Saleh, K., Badreldin, H. A., et al. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04698-z · Cited by 3,146 · cited 1×
“Nevertheless, for the responsible implementation of AI in clinical settings, it is equally important to gain insight into the requirements of human users [13].”
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136 · cited 1×
“This is illustrated by the fact that, so far, the design and performance of the AI model are often key subjects of interest [12].”
Unintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066
Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging
Najjar, R. (2023) · Diagnostics · doi:10.3390/diagnostics13172760 · Cited by 886 · cited 6×
“Yet, the irreplaceability of the human physician was strongly emphasized [3,19,21, 25,26,29,32,35,43,45–47,55 Insofar as authors elaborated why human-AI combinations are desirable, it was firstly argued that the physician’s relief in workload due to AI is one of the main reasons for the increased…”
InfluentialArtificial Intelligence and Black‐Box Medical Decisions: Accuracy versus Explainability
London, A. J. (2019) · Hastings Center Report · doi:10.1002/hast.973 · Cited by 801 · cited 4×
“…workings varied, which was illustrated by studies mentioning that it may not be strictly necessary to fully understand every aspect of the black box underlying AI in decision-making, as long as the outcomes of such decision-making processes can be validated and, therefore, relied upon [34–36].”
InfluentialThe impact of artificial intelligence in medicine on the future role of the physician
Ahuja, A. S. (2019) · PeerJ · doi:10.7717/peerj.7702 · Cited by 789 · cited 4×
“Furthermore, questions remain about AI’s impact on the patient-physician relationship [2,11].”
InfluentialArtificial Intelligence in Health Care: A Report From the National Academy of Medicine
Matheny, M. E., Whicher, D., & Thadaney Israni, S. (2020) · JAMA · doi:10.1001/jama.2019.21579 · Cited by 628 · cited 3×
“It is argued that AI can reduce costs, increase efficiency, and improve clinical decision-making and patient outcomes [1,2].”
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585 · cited 2×
“Many authors underlined the relevance of non-technical skills in the age of digital health technologies and AI [18,19,24–26, 30, 37, Moreover, it was argued that AI will never be able to fully master,and therefore replace,the so-called ‘critical human skills’ that are needed to adequately perform…”
Cited by
Blanco, M. A., Nelson, S. W., Ramesh, S., Callahan, C. E., Josephs, K. A., Jacque, B., & Baecher-Lind, L. E. (2025) · Medical Education Online · doi:10.1080/10872981.2025.2531177 · Cited by 49
“The rapid infiltration of AI throughout healthcare – from diagnosis to documentation – has been accompanied by a surge in literature as clinicians and educators adapt to this evolving environment [1].”
Heudel, P., Crochet, H., Filori, Q., Bachelot, T., & Blay, J. (2026) · ESMO Real World Data and Digital Oncology · doi:10.1016/j.esmorw.2026.100693 · Cited by 51
Flight rules for clinical AI: lessons from aviation for human-AI collaboration in medicine
Ong, A. Y., Merle, D. A., Pollreisz, A., Wagner, S. K., Sevgi, M., Keane, P. A., Huemer, R., Oehling, J., Jäger, M., & Huemer, J. C. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02410-1 · Cited by 22
“In order to achieve this, there is a clear need for consensus around the minimum digital and technical competencies necessary for clinicians operating in AI-assisted clinical settings 39 .”
Potential risks of GenAI on medical education
Hough, J., Culley, N., Erganian, C., & Alahdab, F. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2025-114339 · Cited by 25
From Agents to Governance: Essential AI Skills for Clinicians in the Large Language Model Era
Cao, W., Zhang, Q., Liu, J., & Liu, S. (2026) · Journal of Medical Internet Research · doi:10.2196/86550 · Cited by 29
Enhancing skin lesion classification: a CNN approach with human baseline comparison
Ajabani, D., Shaikh, Z. A., Yousef, A., Ali, K., & Albahar, M. A. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2795 · Cited by 18
Xie, G., Liao, J., Tang, X., Yang, Y., Han, F., Liu, D., Li, D., Jin, Y., & Wang, T. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08903-7 · Cited by 15
“Additionally, interdisciplinary/cross-professional collaboration and the integration of cutting-edge technologies (e.g., cross-professional courses [32, 90, 92, 122, 123], AI medical application modules [68, 105, 121, 122, 124, 125]), further strengthen digital literacy.”
Lammers, A. F., & Bassil, K. C. (2026) · AJOB Neuroscience · doi:10.1080/21507740.2026.2649181 · Cited by 12
“These responses reflect theoretical concerns about the loss of the therapeutic alliance, long considered central to treatment effectiveness (Schuitmaker et al. 2025).”
AI and shared decision-making: a systematic review
Giorgetti, C., Giorgetti, A., Pelotti, S., & Contissa, G. (2026) · AI & Society · doi:10.1007/s00146-026-02955-5 · Cited by 15
“…since their lack of interpretability and/or explainability was found to be a major obstacle to proper communication (Tarantini et al. 2025; Schuitmaker et al. 2025; Samhammer et al. 2022; Ranjbari and Abbasgholizadeh Rahimi 2024), as well as to time efficiency (Abbasgholizadeh Rahimi et…”
Generative artificial intelligence for general practice; new potential ahead, but are we ready?
Geersing, G., de Wit, N. J., & Thompson, M. J. (2025) · European Journal of General Practice · doi:10.1080/13814788.2025.2511645 · Cited by 10
“Consequently, its clinical use raises questions about accountability, expertise and responsibility for the clinical actions recommended [24].”
Comprehensive Evaluation of AI-Driven Systems in Modern Hospital Environments
Ravikumar, R. N., Aarthi, S., Atamuratova, Z., Ashirova, A. I., Atamuratovich, J. K., & Hayitova, M. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2787-7.ch003 · Cited by 14
Chen, M., Wu, Y., Ma, J., Jia, X., Gao, C., Zhao, F., & Qiao, Y. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02409-8 · Cited by 21
“Furthermore, automation bias poses risks as physicians may uncritically accept LLM outputs, potentially leading to skill degradation 99,100 .”
Iyamu, I. O., Wheelans, C., Haag, D., Roe, I., Chang, H.-J., Donelle, L., Ellis, U. M., McKee, G., Bartlett, S., & Gilbert, M. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1802392 · Cited by 10
“Health workers are also expected to use AI-enabled systems, interpret, validate, and explain AI-generated and algorithmically mediated health information to patients, communities, and decision-makers in ways that uphold professional judgment, trust, and accountability (7, 8).”
Quo Vadis, AI-Empowered Doctor?
Takahashi, G., von Liechti, L., & Tarshizi, E. (2025) · JMIR Medical Education · doi:10.2196/70079 · Cited by 5
Ahn, S. (2025) · Korean journal of medical education · doi:10.3946/kjme.2025.351 · Cited by 3
Bella, S. L., Rebollo-Giménez, A. I., Aouad, K., Gupta, L., Kragstrup, T. W., Bayraktar, D., Davergne, T., Cangelosi, D., Hügle, T., Knitza, J., et al. (2026) · EULAR Rheumatology Open · doi:10.1016/j.ero.2026.03.001 · Cited by 5
“In this direction, a systematic review has recently highlighted the growing demand for digital and technical skills, although ambiguity persists regarding how these skills should be integrated into medical training [43].”
Syeda, A. F., Alriyami, F., Alshebli, A., Alketbi, M., Rahma, A., & Al-Houqani, M. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1799061 · Cited by 3
“Learners report greater acceptance of AI for low-stakes academic tasks such as studying, summarization, and exam preparation, while expressing reservations about its use in high-stakes clinical decision-making (6).”
InfluentialMénard, T., & Bramstedt, K. A. (2025) · Pharmaceutical Medicine · doi:10.1007/s40290-025-00589-4 · Cited by 2
“For a physician to trust and act upon an AI-generated recommendation—for instance, the identification of a potential drug candidate or the stratification of patients for a clinical trial—they need to understand the basis of that recommendation [17].”
Luo, C., Xie, S., Yuan, R., Li, P., Yang, C., Cao, J., & He, Y. D. (2026) · Teaching and Learning in Medicine · doi:10.1080/10401334.2026.2627455 · Cited by 2
AI literacy in healthcare organisations: implementing article 4 of the EU AI Act with M-SHALF
Palmieri, S., Declerck, J., Priou, S., Lea, N., & Kalra, D. (2026) · npj Health Systems · doi:10.1038/s44401-026-00104-0 · Cited by 4
“They also re fl ect regulatory alignment, assessing whether organisations are compliant with not only Article 4 (literacy), but also technical requirements related to CE-marking (the European conformity certi fi cation indicating that medical devices and software comply with EU safety, quality, and performance standards…”
InfluentialFeng, S., Zhang, Z., Maffulli, N., Oliva, F., Xue, C., & Ma, C. (2025) · British Medical Bulletin · doi:10.1093/bmb/ldaf012 · Cited by 1
The Impact of AI-Powered Customer Service on Customer Loyalty
Hossain, M. Z., & Faraque, M. O. (2026) · European Journal of Applied Science Engineering and Technology · doi:10.59324/ejaset.2026.4(1).08 · Cited by 1
Zaher, A., Prikshat, V., Vinot, D., Malik, A., & el aziz, J. A. (2026) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2026.124645 · Cited by 3
Inteligencia artificial en medicina interna: conocimiento, uso clínico y necesidades formativas
Alegría, J. G., Tortosa, C. G., Martín-Escalante, M. D., Miralles-Linares, F., de Arellano, R. P.-R., & Viñas, M. M. C. (2025) · Revista Clínica Española · doi:10.1016/j.rce.2025.502421 · Cited by 1
Artificial intelligence in internal medicine: knowledge, clinical use and training needs
Alegría, J. G., Tortosa, C. G., Escalante, M. D. M., Miralles-Linares, F., de Arellano, R. P.-R., & Viñas, M. M. C. (2025) · Revista Clínica Española (English Edition) · doi:10.1016/j.rceng.2025.502421 · Cited by 2
Miao, Y., Zhang, Y., Zhao, C., Ma, S., & Wang, J. (2025) · Research Square · doi:10.21203/rs.3.rs-7327894/v1 · Cited by 2
Recruitment, restraint, and the surgeon's own body: three currents in our articles-in-press
Maffulli, N. (2026) · The Surgeon · doi:10.1016/j.surge.2026.08.003 · Cited by 1
Park, Y., Han, Y., Kim, H., Ahn, S., Kron, F. W., & Lee, J. (2026) · JMIR Medical Education · doi:10.2196/97608
Varughese, E., de Burg, J. E. V., Borgman, G., Seyidov, T., & Fletcher, R. (2026) · Medical Science Educator · doi:10.1007/s40670-025-02630-2 · Cited by 1
Physician AI literacy: A key to unlocking AI's clinical potential
Michaeli, O., Nayot, D., Tyrrell, P. N., Shapiro, H. M., & Michaeli, J. (2026) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2026.105640
Lamberts, M., Brinkman, W., van Goor, H., Tebbes, M., & Smits, M. (2026) · doi:10.2196/preprints.93854
Ardenghi, S., Bani, M., Russo, S., Cremona, N., Zorzi, F., Sarnè, G. M. L., & Strepparava, M. G. (2026) · Research Square · doi:10.21203/rs.3.rs-9254457/v1
Роль искусственного интеллекта в оптимизации учебного процесса в медицинском вузе
Хуррамов, Ф., & Рахматуллаев, А. (2026) · Центральноазиатский журнал образования и инноваций · doi:10.70413/cajei-v05-i04-p2-054
A Behavioral Health Practitioner’s Primer for the Use of Artificial Intelligence (AI)
Perle, J. G. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00636-0
Wondrasek, T., Boucher, E., Dundee, J., Ryniec, J. A., & Esfandiari, N. (2026) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-026-03883-5
“Physicians will need to develop new competencies in information management, digital literacy, and the critical evaluation of AI-generated recommendations [95, 96].”
Shiukashvili, N., Rochikashvili, M., Kupradze, V., Gonjilashvili, N., Gvajaia, N., Kutchava, L., Janikashvili, N., Tevzadze, N., Undilashvili, A., & Ekaladze, E. (2026) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205261442106 · Cited by 3
“17 his urgency is re fl ected in emerging competency guidance for medical training, including the Digital Health Competencies in Medical Education (DECODE) framework, which identi fi es AI-relevant competencies expected of medical graduates, with particular emphasis on understanding AI limitations…”
Shen, T., Zhang, R., Wang, H., Li, D., & Han, J. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1825465 · Cited by 3
Reimagining Continuous Professional Development for Physicians in the Age of Artificial Intelligence
Barry, J. S., & McAdams, R. M. (2026) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000644 · Cited by 2
Human–AI collaboration: Preserving the human touch in a digital age
Garibyan, L., Monnier, J., & Haykal, D. (2026) · La Presse Médicale · doi:10.1016/j.lpm.2026.104357 · Cited by 1
Χαλλουμής, C. C. Κ. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8944-8.ch002
Morgan, C. T., Windram, J., Kim, M. E., Neal, A. E., & McMahon, C. J. (2026) · CJC Pediatric and Congenital Heart Disease · doi:10.1016/j.cjcpc.2026.06.001
Lamberts, M., Brinkman, W., van Goor, H., Tebbes, M., & Smits, M. (2026) · JMIR AI · doi:10.2196/93854
“Our results resemble recent literature, showing that changing working conditions require attention to ethical, organizational, and educational challenges [1,2,6,29,30].”
InfluentialZhu, J., Wu, X., Zhang, C., Wang, L., Zhang, H., Li, Z., Zhang, Y., Ying, M., & Bian, X. (2026) · Health Policy and Technology · doi:10.1016/j.hlpt.2026.101286
Yin, Z., & Ho, J. W. K. (2026) · Computational and Structural Biotechnology Journal · doi:10.34133/csbj.0197
“To prevent deskilling, it is essential to strengthen continuing education and skills training for healthcare professionals to ensure that they maintain the necessary clinical competencies while using AI [ 132 , 136 ].”
InfluentialClinical Documentation as Clinical Practice: Beyond the Novel Risks of AI Summarization Tools
Schuitmaker, L., & Loosman, I. (2026) · The American Journal of Bioethics · doi:10.1080/15265161.2026.2690960
“A recent review of the literature has identified recurring concerns that increasing reliance on AI systems may contribute to erosion of clinical expertise, overreliance on automated outputs, and diminished engagement in reflective and practical aspects of care (Schuitmaker et al. 2025).”
Self-citationFrutuoso, J., Maria, A. R. J., Donato, H., & Carneiro, A. V. (2026) · Acta Médica Portuguesa · doi:10.20344/amp.25177
Artificial Intelligence in Prehospital Tele-Emergency Medicine: A Survey of Acceptance and Attitudes
Durdova, N., Schmidt, M., Schröder, H., Thoma, P., Groß, D., & Wilhelmy, S. (2026) · Healthcare · doi:10.3390/healthcare14172753
“Therefore, continuing education is recommended to prepare tele-emergency physicians to appropriately use AI systems and critically evaluate their recommendations [97].”
Villacèque, M., & Lafitte, S. (2026) · Archives of cardiovascular diseases · doi:10.1016/j.acvd.2026.07.003
Radiologists’ Trust in AI-Based Systems
Hussain, J., Koutsikouri, D., Ljungberg, J. C., Johnsson, Å. A., & Båth, M. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02176-8
Singh, A. K., & Datta, R. (2026) · Medical Journal Armed Forces India · doi:10.1016/j.mjafi.2026.08.001
Perle, J. G. (2026) · Mental Health and Digital Technologies · doi:10.1108/mhdt-04-2026-0024
Synthesising Generative Artificial Intelligence Competency Domains for Medical Education Faculty
Meyers, P., & Miller, C. (2026) · The Clinical Teacher · doi:10.1111/tct.70532 · Cited by 1
Zaher, A., Prikshat, V., el aziz, J. A., & Vinot, D. (2026) · Journal of Health Organization and Management · doi:10.1108/jhom-03-2026-0364
“At the workforce level, AI adoption depends on clinicians’ skills, awareness, and engagement, which are developed through training, literacy initiatives, and exposure to AI technologies (Hassan et al. , 2024; Schuitmaker et al. , 2025).”
Métaireau, H., & Schuers, M. (2026) · doi:10.2196/preprints.114323
Metadata
- Authors
- Schuitmaker, L., Drogt, J., Benders, M., & Jongsma, K.
- Affiliations
- Utrecht University (NL)
- Corresponding author
- Schuitmaker, Lotte
- Venue
- British Medical Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2025-01-16
- Volume
- 153
- Issue
- 1
- ISSN
- 0007-1420 (ISSN-L)
- 1471-8391
- PMC
- PMC11738171
- OpenAlex
- W4406497713
- Cited by
- 54
- References
- 77
- Citations by year
- 2026: 42 · 2025: 12
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- British Medical Bulletin (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Funders
- Universiteit Utrecht
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- artificial intelligence in healthcare, physician competence, AI-assisted clinical decision-making, human-AI collaboration, critical thinking skills, digital skills, trust in AI, responsible AI deployment
- MeSH terms
- Artificial Intelligence, Clinical Competence, Humans, Physicians
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
