CoChat
Sign Up
PreprintCited by 16Artificial Intelligence in Healthcare and EducationInnovations in Medical EducationArtificial Intelligence in Education

Promoting AI Competencies for Medical Students: A Scoping Review on Frameworks, Programs, and Tools

Open access
Ma, Yingbo, Song, Yukyeong, Balch, Jeremy A., Ren, Yuanfang, Vellanki, Divya, Hu, Zhenhong, Brennan, Meghan, Kolla, Suraj +7 more·2024·arXiv
DOI 10.48550/arxiv.2407.18939arXiv 2407.18939
Open this paper in CoChat — free accountOpen PDF

Abstract

As more clinical workflows continue to be augmented by artificial intelligence (AI), AI literacy among physicians will become a critical requirement for ensuring safe and ethical AI-enabled patient care. Despite the evolving importance of AI in healthcare, the extent to which it has been adopted into traditional and often-overloaded medical curricula is currently unknown. In a scoping review of 1,699 articles published between January 2016 and June 2024, we identified 18 studies which propose guiding frameworks, and 11 studies documenting real-world instruction, centered around the integration of AI into medical education. We found that comprehensive guidelines will require greater clinical relevance and personalization to suit medical student interests and career trajectories. Current efforts highlight discrepancies in the teaching guidelines, emphasizing AI evaluation and ethics over technical topics such as data science and coding. Additionally, we identified several challenges associated with integrating AI training into the medical education program, including a lack of guidelines to define medical students AI literacy, a perceived lack of proven clinical value, and a scarcity of qualified instructors. With this knowledge, we propose an AI literacy framework to define competencies for medical students. To prioritize relevant and personalized AI education, we categorize literacy into four dimensions: Foundational, Practical, Experimental, and Ethical, with tailored learning objectives to the pre-clinical, clinical, and clinical research stages of medical education. This review provides a road map for developing practical and relevant education strategies for building an AI-competent healthcare workforce.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2407.18939

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

Cited by 16

Research works printed but not linked: 44

  1. S. A. Alowais, S. S. Alghamdi, N. Alsuhebany, T. Alqahtani, A. I. Alshaya, S. N. Almohareb, A. Aldairem, M. Alrashed, K. Bin Saleh, H. A. Badreldin, et al. Revolutionizing healthcare: the role of artificial intelligence in clinical practice. BMC medical education, 23(1):689, 2023.
  2. B. S. Bloom, M. D. Engelhart, E. Furst, W. H. Hill, and D. R. Krathwohl. Handbook i: cognitive domain. New York: David McKay, pages 483-498, 1956.
  3. T. Boillat, F. A. Nawaz, and H. Rivas. Readiness to embrace artificial intelligence among medical doctors and students: questionnaire-based study. JMIR medical education, 8(2):e34973, 2022.
  4. R. Brydges, H. Carnahan, O. Safir, and A. Dubrowski. How effective is self-guided learning of clinical technical skills? it's all about process. Medical education, 43(6):507-515, 2009.
  5. S. Cussat-Blanc, C. Castets-Renard, and P. Monsarrat. Doctors in medical data sciences: a new curriculum. International Journal of Environmental Research and Public Health, 20(1):675, 2022.
  6. J. J. Darrow, J. Avorn, and A. S. Kesselheim. Fda regulation and approval of medical devices: 1976-2020. Jama, 326(5):420-432, 2021.
  7. S. Ellahham, N. Ellahham, and M. C. E. Simsekler. Application of artificial intelligence in the health care safety context: opportunities and challenges. American Journal of Medical Quality, 35(4):341-348, 2020.
  8. G. Eysenbach et al. The role of chatgpt, generative language models, and artificial intelligence in medical education: a conversation with chatgpt and a call for papers. JMIR Medical Education, 9(1):e46885, 2023.
  9. K. Gray, J. Slavotinek, G. L. Dimaguila, D. Choo, et al. Artificial intelligence education for the health workforce: expert survey of approaches and needs. JMIR medical education, 8(2):e35223, 2022.
  10. J. Grunhut, O. Marques, and A. T. Wyatt. Needs, challenges, and applications of artificial intelligence in medical education curriculum. JMIR medical education, 8(2):e35587, 2022.
  11. D. Kalthoff, M. Prien, and N.-A. Götz. "ai4health"-development and conception of a learning programme in higher and continuing education on the fundamentals, applications and perspectives of ai in healthcare. In Challenges of Trustable AI and Added-Value on Health, pages 785-789. IOS Press, 2022.
  12. V. D. Karalis. The integration of artificial intelligence into clinical practice. Applied Biosciences, 3(1):14-44, 2024.
  13. J. Lang and H. Repp. Artificial intelligence in medical education and the meaning of interaction with natural intelligence-an interdisciplinary approach. GMS Journal for Medical Education, 37(6), 2020.
  14. M. C. Laupichler, D. R. Hadizadeh, M. W. Wintergerst, L. Von Der Emde, D. Paech, E. A. Dick, and T. Raupach. Effect of a flipped classroom course to foster medical students' ai literacy with a focus on medical imaging: a single group pre-and post-test study. BMC Medical Education, 22(1):803, 2022.
  15. Y.-M. Lee, K. Cao, M. Leech, and F. De Ponti. Developing medical artificial intelligence leaders: International university consortium approach. Medical Education, 55(11):1321, 2021.
  16. W. Liaw, J. K. Kueper, S. Lin, A. Bazemore, and I. Kakadiaris. Competencies for the use of artificial intelligence in primary care. The Annals of Family Medicine, 20(6):559-563, 2022.
  17. A. Liberati, D. G. Altman, J. Tetzlaff, C. Mulrow, P. C. Gøtzsche, J. P. Ioannidis, M. Clarke, P. J. Devereaux, J. Kleijnen, and D. Moher. The prisma statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Annals of internal medicine, 151(4):W-65, 2009.
  18. D. D. Luxton. Recommendations for the ethical use and design of artificial intelligent care providers. Artificial intelligence in medicine, 62(1):1-10, 2014.
  19. L. G. McCoy, S. Nagaraj, F. Morgado, V. Harish, S. Das, and L. A. Celi. What do medical students actually need to know about artificial intelligence? NPJ digital medicine, 3(1):86, 2020.
  20. C. Mello-Thoms. Teaching artificial intelligence literacy: a challenge in the education of radiology residents. Academic Radiology, 30(7):1488-1490, 2023.
  21. C. J. Messinger, J. Hafler, A. M. Khan, and T. Long. Recent trends in primary care interest and career choices among medical students at an academic medical institution. Teaching and Learning in Medicine, 29(1):42-51, 2017.
  22. M. Nagy, N. Radakovich, and A. Nazha. Why machine learning should be taught in medical schools. Medical Science Educator, 32(2):529-532, 2022.
  23. D. T. K. Ng, J. K. L. Leung, S. K. W. Chu, and M. S. Qiao. Conceptualizing ai literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2:100041, 2021.
  24. F. Y. C. Ng, A. J. Thirunavukarasu, H. Cheng, T. F. Tan, L. Gutierrez, Y. Lan, J. C. L. Ong, Y. S. Chong, K. Y. Ngiam, D. Ho, et al. Artificial intelligence education: an evidence-based medicine approach for consumers, translators, and developers. Cell Reports Medicine, 4(10), 2023.
  25. N. Noorbakhsh-Sabet, R. Zand, Y. Zhang, and V. Abedi. Artificial intelligence transforms the future of health care. The American journal of medicine, 132(7):795-801, 2019.
  26. E. Ötleş, C. A. James, K. D. Lomis, and J. O. Woolliscroft. Teaching artificial intelligence as a fundamental toolset of medicine. Cell Reports Medicine, 3(12), 2022.
  27. K. Paranjape, M. Schinkel, R. N. Panday, J. Car, P. Nanayakkara, et al. Introducing artificial intelligence training in medical education. JMIR medical education, 5(2):e16048, 2019.
  28. S. H. Park, K.-H. Do, S. Kim, J. H. Park, and Y.-S. Lim. What should medical students know about artificial intelligence in medicine? Journal of educational evaluation for health professions, 16, 2019.
  29. S. H. Park, R. Pinto-Powell, T. Thesen, A. Lindqwister, J. Levy, R. Chacko, D. Gonzalez, C. Bridges, A. Schwendt, T. Byrum, et al. Preparing healthcare leaders of the digital age with an integrative artificial intelligence curriculum: a pilot study. Medical Education Online, 29(1):2315684, 2024.
  30. I. Pizzolla, R. Aro, P. Duez, B. De Lièvre, and G. Briganti. Integrating artificial intelligence into medical education: Lessons learned from a belgian initiative. Journal of Interactive Learning Research, 34(2):401-424, 2023.
  31. T. P. Quinn and S. Coghlan. Readying medical students for medical ai: The need to embed ai ethics education. arXiv preprint arXiv:2109.02866, 2021. · arXiv
  32. A. H. Sapci and H. A. Sapci. Artificial intelligence education and tools for medical and health informatics students: systematic review. JMIR Medical Education, 6(1):e19285, 2020.
  33. M. P. Sendak, M. Gao, W. Ratliff, K. Whalen, M. Nichols, J. Futoma, and S. Balu. Preliminary results of a clinical research and innovation scholarship to prepare medical students to lead innovations in health care. In Healthcare, volume 9, page 100555. Elsevier, 2021.
  34. A. S. Tejani, H. Elhalawani, L. Moy, M. Kohli, and C. E. Kahn Jr. Artificial intelligence and radiology education. Radiology: Artificial Intelligence, 5(1):e220084, 2022.
  35. G. E. Thibault. The future of health professions education: emerging trends in the united states. FASEB BioAdvances, 2(12):685, 2020.
  36. R. Tsopra, N. Peiffer-Smadja, C. Charlier, F. Campeotto, C. Lemogne, P. Ruszniewski, B. Vivien, and A. Burgun. Putting undergraduate medical students in ai-cdss designers' shoes: An innovative teaching method to develop digital health critical thinking. International journal of medical informatics, 171:104980, 2023.
  37. C. E. Waldman, M. Hermel, J. A. Hermel, F. Allinson, M. N. Pintea, N. Bransky, E. Udoh, L. Nicholson, A. Robinson, J. Gonzalez, et al. Artificial intelligence in healthcare: a primer for medical education in radiomics. Personalized medicine, 19(5):445-456, 2022.
  38. S. A. Wartman and C. D. Combs. Reimagining medical education in the age of ai. AMA journal of ethics, 21(2):146-152, 2019.
  39. L. Weidener, M. Fischer, et al. Artificial intelligence teaching as part of medical education: qualitative analysis of expert interviews. JMIR Medical Education, 9(1):e46428, 2023.
  40. L. Weidener, M. Fischer, et al. Proposing a principle-based approach for teaching ai ethics in medical education. JMIR Medical Education, 10(1):e55368, 2024.
  41. R. Werner, M. Henningsen, R. Schmitz, A. H. Guse, M. Augustin, and T. Gauer. Digital health meets hamburg integrated medical degree program imed: concept and introduction of the new interdisciplinary 2nd track digital health. GMS Journal for Medical Education, 37(6), 2020.
  42. E. A. Wood, B. L. Ange, and D. D. Miller. Are we ready to integrate artificial intelligence literacy into medical school curriculum: students and faculty survey. Journal of medical education and curricular development, 8:23821205211024078, 2021.
  43. J. Yin, K. Y. Ngiam, and H. H. Teo. Role of artificial intelligence applications in real-life clinical practice: systematic review. Journal of medical Internet research, 23(4):e25759, 2021.
  44. J. Zhang and Z.-m. Zhang. Ethics and governance of trustworthy medical artificial intelligence. BMC medical informatics and decision making, 23(1):7, 2023.

Authors
Ma, Y., Song, Y., Balch, J. A., Ren, Y., Vellanki, D., Hu, Z., Brennan, M., Kolla, S., Guan, Z., Armfield, B., Ozrazgat-Baslanti, T., Rashidi, P., Loftus, T. J., Bihorac, A., & Shickel, B.
Affiliations
  • University of Florida (US)
  • University of Florida Health (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2407.18939
arXiv
2407.18939
OpenAlex
W4401200997
Cited by
16
References
0
Citations by year
2026: 8 · 2025: 7 · 2024: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
Keywords
AI literacy, medical students, artificial intelligence in education, medical curriculum, AI competencies, AI literacy framework, AI ethics, AI evaluation, AI workforce development, teaching guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review