Artificial Intelligence Education and Tools for Medical and Health Informatics Students: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.
Abstract
Background: The use of artificial intelligence (AI) in medicine will generate numerous application possibilities to improve patient care, provide real-time data analytics, and enable continuous patient monitoring. Clinicians and health informaticians should become familiar with machine learning and deep learning. Additionally, they should have a strong background in data analytics and data visualization to use, evaluate, and develop AI applications in clinical practice. Objective: The main objective of this study was to evaluate the current state of AI training and the use of AI tools to enhance the learning experience. Methods: A comprehensive systematic review was conducted to analyze the use of AI in medical and health informatics education, and to evaluate existing AI training practices. PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols) guidelines were followed. The studies that focused on the use of AI tools to enhance medical education and the studies that investigated teaching AI as a new competency were categorized separately to evaluate recent developments. Results: This systematic review revealed that recent publications recommend the integration of AI training into medical and health informatics curricula. Conclusions: To the best of our knowledge, this is the first systematic review exploring the current state of AI education in both medicine and health informatics. Since AI curricula have not been standardized and competencies have not been determined, a framework for specialized AI training in medical and health informatics education is proposed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“While numerous authors have called for structured and intentional learning programs, to date, there has been no published framework to guide teaching, learning, and assessing health care students and practitioners in this emerging and transformative domain [7,9-12].”
From Considering Clinician Competencies for the Implementation of Artificial Intelligence–Based Tools in Health Care: Findings From a Scoping Review (2022) · cites this paper as [11]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Overall, this includes learning the AI terminology [13,37,45], strengths and limitations of AI [12,13,16,37,42], risks of AI [12,13,17,37,39,42], controlling for bias [42], critical appraisal AI literature and tools [12,13,34,37,39,45,46], and shared decision-making [12,13,37,41,45].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Eleven studies suggest that physicians should understand the role of data science in AI [12,13,16,37,39,41,42,45].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In particular, knowledge related to data stewardship [12,13,37,41], data preprocessing and acquisition [13], standardization [13], data analytics [13,17,39], health data infrastructure [45], programming [39,41], and big data [13,45], may help physicians appreciate the obstacles faced by data scientists and improve the multidisciplinary collaboration [13,39].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nine studies discuss the need for a fundamental understanding of AI ethics to improve the adoption of AI in medicine and ensure its safe use [12,13,16,37,39,45].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [39]
Experimental — accuracy not yet measured
20 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Exploring the impact of artificial intelligence on teaching and learning in higher education
Popenici, S. A. D., & Kerr, S. (2017) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-017-0062-8 · Cited by 2,019 · cited 1×
“Even though there are several studies that explored how AI algorithms were helping enhance education [8-12], the number of peer-reviewed publications that focused on artificial intelligence education in medicine is limited (Figure 1).”
BackgroundImplementing Machine Learning in Health Care — Addressing Ethical Challenges
Char, D. S., Shah, N. H., & Magnus, D. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1714229 · Cited by 1,857 · cited 1×
“The implementation of ML in health care could result in unintended challenges and biased decisions, depending on the algorithms, data sources, and methodologies used [7].”
MethodUnintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066
Chan, K. S., & Zary, N. (2019) · JMIR Medical Education · doi:10.2196/13930 · Cited by 877 · cited 4×
“For example, Chan and Zary [15] evaluated existing AI applications in medicine, determined that the primary reason to use AI in medical education was to provide feedback, and identified that significant challenges included the assessment of effectiveness and management of technical difficulties.”
BackgroundInfluentialMedical students' attitude towards artificial intelligence: a multicentre survey
Pinto dos Santos, D., Giese, D., Brodehl, S., Chon, S. H., Staab, W., Kleinert, R., Maintz, D., & Baeßler, B. (2019) · European Radiology · doi:10.1007/s00330-018-5601-1 · Cited by 754
Computational intelligence: a logical approach
(1998) · Choice Reviews Online · doi:10.5860/choice.35-5701 · Cited by 723 · cited 1×
“In other words, computers can mimic human intelligence using AI techniques [4].”
BackgroundIntroducing artificial intelligence training in medical education
Paranjape, K., Schinkel, M., Nannan Panday, R., Car, J., & Nanayakkara, P. (2019) · JMIR Medical Education · doi:10.2196/16048 · Cited by 634 · cited 4×
“IV 2 Introducing Artificial Intelligence Training in Medical Education Netherlands Paranjape et al, 2019 [39]”
BackgroundMethodInfluentialMedical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585 · cited 1×
“V2Medical Education Must Move From the Information Age to the Age of Artificial Intelligence United States Wartman and Combs, 2018 [32] JMIR Med Educ 2020 | vol. 6 | iss.”
Background
Research works printed but not linked: 6
- Mayor, A, 2018, Princeton: Princeton University Press
- 10.1609/aimag.v27i4.1911 · doi:10.1609/aimag.v27i4.1911
- Artificial intelligenceOxford Reference2020-06-22https://www.oxfordreference.com/view/10.1093/oi/authority.20110803095426960 · doi:10.1093/oi/authority.20110803095426960
- Clinical Informatics Becomes a Board-certified Medical Subspecialty Following ABMS Vote20112020-03-01https://www.amia.org/news-and-publications/press-release/ci-is-subspecialty
- HowickJChalmersIGlasziouPGreenhalghTHeneghanCLiberatiAMoschettiIPhillipsBThorntonHGoddardOHodgkinsonMOCEBM Levels of Evidence Working GroupThe Oxford 2011 Levels of EvidenceOxford Centre of Evidence-Based Medicine20142020-03-15https://www.cebm.net/wp-content/uploads/2014/06/CEBM-Levels-of-Evidence-2.1.pdf
- Souze, A, 2018, ATD Public Policy Advisory Group, 1
Cited by
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00436-z · Cited by 852
Karaca, O., Çalışkan, S. A., & Demir, K. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02546-6 · Cited by 377
Artificial intelligence in medical education: a cross-sectional needs assessment
Civaner, M. M., Uncu, Y., Bulut, F., Chalil, E. G., & Tatli, A. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03852-3 · Cited by 363
“As Sapci and Sapci revealed in their systematic review, the integration of AI training into medical and health informatics curricula is an important need for future physicians [32].”
BackgroundHow the nursing profession should adapt for a digital future
Booth, R. G., Strudwick, G., McBride, S., O’Connor, S., & Solano López, A. L. (2021) · BMJ · doi:10.1136/bmj.n1190 · Cited by 330
Artificial Intelligence in Undergraduate Medical Education: A Scoping Review
Lee, J., Wu, A. S., Li, D., & Kulasegaram, K. (. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004291 · Cited by 324
Metadata
- Authors
- Sapci, A. H., & Sapci, H. A.
- Affiliations
- Adelphi University (US)
- Corresponding author
- Sapci, A Hasan
- Sapci, H Aylin
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2020-06-30
- Volume
- 6
- Issue
- 1
- Pages
- e19285
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC7367541
- OpenAlex
- W3039746272
- Cited by
- 377
- References
- 46
- Citations by year
- 2026: 68 · 2025: 103 · 2024: 85 · 2023: 56 · 2022: 30 · 2021: 34 · 2020: 1
- FWCI
- 2.30
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- artificial intelligence in education, medical education, health informatics education, AI training, AI tools in learning, machine learning, deep learning, data analytics, data visualization, AI competencies, curriculum integration, training framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.