The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Physicians’ required competencies in AI-assisted clinical settings: a systematic review
Open accessAbstract
BACKGROUND: Utilizing Artificial Intelligence (AI) in clinical settings may offer significant benefits. A roadblock to the responsible implementation of medical AI is the remaining uncertainty regarding requirements for AI users at the bedside. An overview of the academic literature on human requirements for the adequate use of AI in clinical settings is therefore of significant value. SOURCES OF DATA: A systematic review of the potential implications of medical AI for the required competencies of physicians as mentioned in the academic literature. AREAS OF AGREEMENT: Our findings emphasize the importance of physicians' critical human skills, alongside the growing demand for technical and digital competencies. AREAS OF CONTROVERSY: Concrete guidance on physicians' required competencies in AI-assisted clinical settings remains ambiguous and requires further clarification and specification. Dissensus remains over whether physicians are adequately equipped to use and monitor AI in clinical settings in terms of competencies, skills and expertise, issues of ownership regarding normative guidance, and training of physicians' skills. GROWING POINTS: Our review offers a basis for subsequent further research and normative analysis on the responsible use of AI in clinical settings. AREAS TIMELY FOR DEVELOPING RESEARCH: Future research should clearly outline (i) how physicians must be(come) competent in working with AI in clinical settings, (ii) who or what should take ownership of embedding these competencies in a normative and regulatory framework, (iii) investigate conditions for achieving a reasonable amount of trust in AI, and (iv) assess the connection between trust and efficiency in patient care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Despite the growing integration of AI into clinical practice, concrete guidance remains limited regarding which competencies physicians using AI should develop, what levels of proficiency are required, and which educational approaches are most appropriate [51].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“…findings of other ethicists in the field, who stress that inter-stakeholder cooperation at a policy level is needed to fit multiple AI-ethics agendas together, and to aim for procedural consensus on both ethical principles as the implementation of these principles in clinical settings [73].”
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · cited 2×
“Relatedly, these potential developments raise concerns about the influence of AI on patient autonomy,the need for transparent reporting on the use of AI, and overreliance on AI [10,11].”
Revolutionizing healthcare: the role of artificial intelligence in clinical practice
Alowais, S. A., Alghamdi, S. S., Alsuhebany, N., Alqahtani, T., Alshaya, A. I., Almohareb, S. N., Aldairem, A., Alrashed, M., Bin Saleh, K., Badreldin, H. A., et al. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04698-z · Cited by 3,146 · cited 1×
“Nevertheless, for the responsible implementation of AI in clinical settings, it is equally important to gain insight into the requirements of human users [13].”
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136 · cited 1×
“This is illustrated by the fact that, so far, the design and performance of the AI model are often key subjects of interest [12].”
Unintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066
Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging
Najjar, R. (2023) · Diagnostics · doi:10.3390/diagnostics13172760 · Cited by 886 · cited 6×
“Yet, the irreplaceability of the human physician was strongly emphasized [3,19,21, 25,26,29,32,35,43,45–47,55 Insofar as authors elaborated why human-AI combinations are desirable, it was firstly argued that the physician’s relief in workload due to AI is one of the main reasons for the increased…”
InfluentialArtificial Intelligence and Black‐Box Medical Decisions: Accuracy versus Explainability
London, A. J. (2019) · Hastings Center Report · doi:10.1002/hast.973 · Cited by 801 · cited 4×
“…workings varied, which was illustrated by studies mentioning that it may not be strictly necessary to fully understand every aspect of the black box underlying AI in decision-making, as long as the outcomes of such decision-making processes can be validated and, therefore, relied upon [34–36].”
InfluentialThe impact of artificial intelligence in medicine on the future role of the physician
Ahuja, A. S. (2019) · PeerJ · doi:10.7717/peerj.7702 · Cited by 789 · cited 4×
“Furthermore, questions remain about AI’s impact on the patient-physician relationship [2,11].”
InfluentialArtificial Intelligence in Health Care: A Report From the National Academy of Medicine
Matheny, M. E., Whicher, D., & Thadaney Israni, S. (2020) · JAMA · doi:10.1001/jama.2019.21579 · Cited by 628 · cited 3×
“It is argued that AI can reduce costs, increase efficiency, and improve clinical decision-making and patient outcomes [1,2].”
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585 · cited 2×
“Many authors underlined the relevance of non-technical skills in the age of digital health technologies and AI [18,19,24–26, 30, 37, Moreover, it was argued that AI will never be able to fully master,and therefore replace,the so-called ‘critical human skills’ that are needed to adequately perform…”
Cited by
Blanco, M. A., Nelson, S. W., Ramesh, S., Callahan, C. E., Josephs, K. A., Jacque, B., & Baecher-Lind, L. E. (2025) · Medical Education Online · doi:10.1080/10872981.2025.2531177 · Cited by 49
“The rapid infiltration of AI throughout healthcare – from diagnosis to documentation – has been accompanied by a surge in literature as clinicians and educators adapt to this evolving environment [1].”
Heudel, P., Crochet, H., Filori, Q., Bachelot, T., & Blay, J. (2026) · ESMO Real World Data and Digital Oncology · doi:10.1016/j.esmorw.2026.100693 · Cited by 33
Flight rules for clinical AI: lessons from aviation for human-AI collaboration in medicine
Ong, A. Y., Merle, D. A., Pollreisz, A., Wagner, S. K., Sevgi, M., Keane, P. A., Huemer, R., Oehling, J., Jäger, M., & Huemer, J. C. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02410-1 · Cited by 21
“In order to achieve this, there is a clear need for consensus around the minimum digital and technical competencies necessary for clinicians operating in AI-assisted clinical settings 39 .”
Potential risks of GenAI on medical education
Hough, J., Culley, N., Erganian, C., & Alahdab, F. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2025-114339 · Cited by 25
From Agents to Governance: Essential AI Skills for Clinicians in the Large Language Model Era
Cao, W., Zhang, Q., Liu, J., & Liu, S. (2026) · Journal of Medical Internet Research · doi:10.2196/86550 · Cited by 27
Metadata
- Authors
- Schuitmaker, L., Drogt, J., Benders, M., & Jongsma, K.
- Affiliations
- Utrecht University (NL)
- Corresponding author
- Schuitmaker, Lotte
- Venue
- British Medical Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2025-01-16
- Volume
- 153
- Issue
- 1
- ISSN
- 0007-1420 (ISSN-L)
- 1471-8391
- PMC
- PMC11738171
- OpenAlex
- W4406497713
- Cited by
- 54
- References
- 77
- Citations by year
- 2026: 42 · 2025: 12
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- British Medical Bulletin (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Funders
- Universiteit Utrecht
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- artificial intelligence in healthcare, physician competence, AI-assisted clinical decision-making, human-AI collaboration, critical thinking skills, digital skills, trust in AI, responsible AI deployment
- MeSH terms
- Artificial Intelligence, Clinical Competence, Humans, Physicians
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Physicians’ required competencies in AI-assisted clinical settings: a systematic review. https://app.cochat.ai/papers/10.1093/bmb/ldae025
- The paper
- Schuitmaker, L., Drogt, J., Benders, M., & Jongsma, K. (2025). Physicians’ required competencies in AI-assisted clinical settings: a systematic review. British Medical Bulletin. https://doi.org/10.1093/bmb/ldae025
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
