The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index, and 1 are not checked yet.
Defining Medical AI Competencies for Medical School Graduates: Outcomes of a Delphi Survey and Medical Student/Educator Questionnaire of South Korean Medical Schools
Open accessAbstract
Purpose: Given the increasing significance and potential impact of artificial intelligence (AI) technology on health care delivery, there is an increasing demand to integrate AI into medical school curricula. This study aimed to define medical AI competencies and identify the essential competencies for medical graduates in South Korea. Method: An initial Delphi survey conducted in 2022 involving 4 groups of medical AI experts (n = 28) yielded 42 competency items. Subsequently, an online questionnaire survey was carried out with 1,955 participants (1,174 students and 781 professors) from medical schools across South Korea, utilizing the list of 42 competencies developed from the first Delphi round. A subsequent Delphi survey was conducted with 33 medical educators from 21 medical schools to differentiate the essential AI competencies from the optional ones. Results: The study identified 6 domains encompassing 36 AI competencies essential for medical graduates: (1) understanding digital health and changes driven by AI; (2) fundamental knowledge and skills in medical AI; (3) ethics and legal aspects in the use of medical AI; (4) medical AI application in clinical practice; (5) processing, analyzing, and evaluating medical data; and (6) research and development of medical AI, as well as subcompetencies within each domain. While numerous competencies within the first 4 domains were deemed essential, a higher percentage of experts indicated responses in the last 2 domains, data science and medical AI research and development, were optional. Conclusions: This medical AI framework of 6 competencies and their subcompetencies for medical graduates exhibits promising potential for guiding the integration of AI into medical curricula. Further studies conducted in diverse contexts and countries are necessary to validate and confirm the applicability of these findings. Additional research is imperative for developing specific and feasible educational models to integrate these proposed competencies into pre-existing curricula.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, the importance of equipping future doctors with key AI skills has increased, leading to efforts to incorporate AI literacy into undergraduate medical education (UGME) [2–4].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [4]
In the citing paper
“The second one identified six domains and 36 AI competencies, including understanding digital health and changes driven by AI, fundamental knowledge and skills in medical AI, ethics and legal aspects of medical AI use, medical AI applications in clinical practice, and processing, analyzing, and evaluating medical data related to AI research and medical use [4].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [4]
In the citing paper
“Online training programs, such as the Radiology AI Literacy curriculum, now adopted by over 500 practicing radiologists, demonstrate strong demand for such education433.”
From Artificial intelligence-driven multi-omics approaches in Alzheimer's disease: Progress, challenges, and future directions (2025) · cites this paper as [433]
In the citing paper
“Medical education has not kept pace with these rapid advancements.”
From What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education (2026) · cites this paper as [21]
In the citing paper
“yet AI curricula and competency recommendations for undergraduate medical education (UME) remain fragmented”
From What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education (2026) · cites this paper as [21]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Likert scales, levels of measurement, and the “laws” of statistics
Norman, G. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9222-y · Cited by 4,850
Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.12.002 · Cited by 3,740
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Analyzing and Interpreting Data From Likert-Type Scales
Sullivan, G. M., & Artino, A. R. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-5-4-18 · Cited by 3,044
Competency-based medical education: Theory to practice.
Frank, J. R., Snell, L. S., Cate, O. T., Holmboe, E. S., Carraccio, C., Swing, S. R., Harris, P., Glasgow, N. J., Campbell, C., Dath, D., et al. (2010) · Medical Teacher · doi:10.3109/0142159x.2010.501190 · Cited by 2,883
Exploratory Factor Analysis: A Guide to Best Practice
Watkins, M. W. (2018) · Journal of Black Psychology · doi:10.1177/0095798418771807 · Cited by 2,218
Cited by
Ren, F., Wei, J., Chen, Q., Hu, M., Yu, L., Mi, J., Zhou, X., Qin, D., Wu, J., & Wu, A. (2025) · Acta Pharmaceutica Sinica B · doi:10.1016/j.apsb.2025.07.030 · Cited by 97
Triola, M. M., & Rodman, A. (2025) · Academic Medicine · doi:10.1097/acm.0000000000005963 · Cited by 92
Artificial intelligence in undergraduate medical education: an updated scoping review
Simoni, J., Urtubia-Fernandez, J., Mengual, E., Simoni, D. A., Royo, M., Egaña-Yin, D., Hertog, O. L. A., López-Ortiz, L., Muñoz-Tomás, A., Santiago-Martínez, P., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08188-2 · Cited by 62
“Moreover, the importance of equipping future doctors with key AI skills has increased, leading to efforts to incorporate AI literacy into undergraduate medical education (UGME) [2–4].”
Arvai, N., Katonai, G., & Mesko, B. (2025) · Journal of Medical Internet Research · doi:10.2196/66986 · Cited by 57
“Due to physician shortages and the existing burden on HCPs, the amount of effort, time, and skills needed to adopt these innovations is particularly important [4-6].”
McCoy, L., Ganesan, N., Rajagopalan, V., McKell, D., Niño, D. F., & Swaim, M. C. (2025) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205251339226 · Cited by 40
Metadata
- Authors
- Lee, Y.-M., Kim, S., Lee, Y.-H., Kim, H.-S., Seo, S. W., Kim, H., & Kim, K. J.
- Affiliations
- Korea University (KR)
- Yonsei University (KR)
- Samsung Medical Center (KR)
- Corresponding author
- Lee, Young-Mee
- Lee, Young-Hee
- Seo, Sung Wook
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-12-28
- Volume
- 99
- Issue
- 5
- Pages
- 524-533
- ISSN
- 1040-2446 (ISSN-L)
- 1938-808X
- OpenAlex
- W4390793541
- Cited by
- 60
- References
- 35
- Citations by year
- 2026: 31 · 2025: 21 · 2024: 8
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Academic Medicine (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Health Professions › General Health Professions › Health and Medical Education
- Keywords
- artificial intelligence in healthcare, competency framework, medical education, AI integration in curriculum, medical graduates, digital health, medical data analysis
- MeSH terms
- Adult, Artificial Intelligence, Clinical Competence, Curriculum, Delphi Technique, Faculty, Medical, Female, Humans, Male, Surveys and Questionnaires, Schools, Medical, Students, Medical, Republic of Korea
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Defining Medical AI Competencies for Medical School Graduates: Outcomes of a Delphi Survey and Medical Student/Educator Questionnaire of South Korean Medical Schools. https://app.cochat.ai/papers/10.1097/acm.0000000000005618
- The paper
- Lee, Y.-M., Kim, S., Lee, Y.-H., Kim, H.-S., Seo, S. W., Kim, H., & Kim, K. J. (2024). Defining Medical AI Competencies for Medical School Graduates: Outcomes of a Delphi Survey and Medical Student/Educator Questionnaire of South Korean Medical Schools. Academic Medicine. https://doi.org/10.1097/acm.0000000000005618
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.