The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index; 8 of the 29 sources its claims cite were checked for support.
Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review
Open accessPublished version of a preprint
Abstract
BACKGROUND: Since the advent of artificial intelligence (AI) in 1955, the applications of AI have increased over the years within a rapidly changing digital landscape where public expectations are on the rise, fed by social media, industry leaders, and medical practitioners. However, there has been little interest in AI in medical education until the last two decades, with only a recent increase in the number of publications and citations in the field. To our knowledge, thus far, a limited number of articles have discussed or reviewed the current use of AI in medical education. OBJECTIVE: This study aims to review the current applications of AI in medical education as well as the challenges of implementing AI in medical education. METHODS: Medline (Ovid), EBSCOhost Education Resources Information Center (ERIC) and Education Source, and Web of Science were searched with explicit inclusion and exclusion criteria. Full text of the selected articles was analyzed using the Extension of Technology Acceptance Model and the Diffusions of Innovations theory. Data were subsequently pooled together and analyzed quantitatively. RESULTS: A total of 37 articles were identified. Three primary uses of AI in medical education were identified: learning support (n=32), assessment of students' learning (n=4), and curriculum review (n=1). The main reasons for use of AI are its ability to provide feedback and a guided learning pathway and to decrease costs. Subgroup analysis revealed that medical undergraduates are the primary target audience for AI use. In addition, 34 articles described the challenges of AI implementation in medical education; two main reasons were identified: difficulty in assessing the effectiveness of AI in medical education and technical challenges while developing AI applications. CONCLUSIONS: The primary use of AI in medical education was for learning support mainly due to its ability to provide individualized feedback. Little emphasis was placed on curriculum review and assessment of students' learning due to the lack of digitalization and sensitive nature of examinations, respectively. Big data manipulation also warrants the need to ensure data integrity. Methodological improvements are required to increase AI adoption by addressing the technical difficulties of creating an AI application and using novel methods to assess the effectiveness of AI. To better integrate AI into the medical profession, measures should be taken to introduce AI into the medical school curriculum for medical professionals to better understand AI algorithms and maximize its use.
Overview
CoChat Summary
TL;DR
This integrative review of 37 articles found that AI in medical education was used mainly for learning support, with assessment and curriculum review much less represented. The main implementation challenges were difficulty assessing AI effectiveness and technical difficulties in developing AI applications.
Key findings
- Among 37 included articles, three primary uses were identified: learning support (n=32), assessment of students’ learning (n=4), and curriculum review (n=1).
- For learning, the most commonly reported advantages were feedback for learning (21 articles), guided learning pathway/evaluation of learning process (18), decreased costs (8), no harm to patients (6), and less teacher supervision required (3).
- Target audiences were medical undergraduates (n=25), postgraduates (n=14), and continuing medical education (n=8); 6 articles did not identify a specific target group. In the learning subgroup, medical undergraduates were the primary target audience (21/32).
- Of 34 articles describing implementation challenges, the most common were difficulty assessing effectiveness (n=14), limited scalability (n=6), need for large sample size to develop the model (n=16), need for qualified content specialists (n=10), and physician-engineer communication gaps (n=4). One cited study reported a 22% posttraining improvement in diagnostic accuracy with an AI-driven simulator versus a nonstatistical 8% improvement with multimedia-based expert-led training.
Methods
- Integrative review of peer-reviewed literature on AI in medical education, searching Medline (Ovid; 1954 to March 2019), EBSCOhost ERIC and Education Source (1983 to March 2019), and Web of Science (1986 to March 2019).
- Inclusion focused on AI in doctors’ professional development across undergraduate, postgraduate, specialty training, and continuing medical education; exclusions included non-medical education, technology without AI, reviews/letters/commentaries, non-English full texts, and pre-1954 articles.
- The search yielded 679 articles; after removing 185 duplicates, 494 were screened, 416 excluded, 78 assessed for eligibility, and 37 found relevant. Data were extracted and analyzed using the Extension of Technology Acceptance Model and Diffusion of Innovations theory, with quantitative pooling in SPSS where relevant.
Limitations
- The authors state it may be too early to make an overarching statement about AI’s benefits in medical education because practices vary across subspecialties.
- The authors note the high proportion of articles on AI as learning support compared with curriculum development/review and summative assessment, and state that conclusions about curriculum and assessment may be inconsequential due to the low number of studies reviewed.
- Evident from the text: the search ended in March 2019, so later publications are not captured; the review also does not describe a formal quality appraisal or risk-of-bias assessment of included studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
7 Valid · 3 Not valid · 18 Not checked · 65 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“To our knowledge, thus far, a limited number of articles have discussed or reviewed the current use of AI in medical education.”
- Also stated in: § Introduction · plain
“Currently, there are limited articles [9,10] discussing or reviewing the current applications of AI in medical education.”
§ Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review > Abstract > Background
What the sources say
- Supportedcites [9] Lillehaug, S, 1998, Artif Intell Med source
The Introduction (page not provided) says that AI applications for medical education had received little interest and identifies only a few notable projects. The paper also reviews educational applications and prior research, so it is itself an example of an article discussing the field. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites [10] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Introduction · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The digitalization of the curriculum is not possible across all institutions, mainly due to financial constraints [49].”
§ Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review > Discussion > Current Use of Artificial Intelligence in Medical Education
What the sources say
- Partly supportedcites [49] sourceExperimental — accuracy not yet measured
The Discussion (Institutional support; page not provided) says initial financial investments in e-learning are substantial, and the Findings identify implementation and maintenance costs as challenges. But the paper does not say curriculum digitalization is impossible across institutions or that financial constraints are the main reason; it also identifies infrastructure, staffing, and local needs as challenges. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Three articles assessed the use of AI in automated scoring of assignments, and one article [38] assessed the use of machine learning algorithms in predicting the correctness of students’ answers based on their viewing behaviors.”
§ Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review > Results > Current Use of Artificial Intelligence in Medical Education
What the sources say
- Supportedcites [38] source
The Methods describe using viewing-behavior metrics as features and answer correctness as the label in a binary classification task, then training decision trees and random forests. The claim says the article assessed this use of machine learning, not that its predictions were successful; the Conclusions note that results were unsatisfactory in most cases. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In a study conducted by Hewson et al [52], 80% of the residents surveyed reported never having or infrequently receiving corrective feedback on their performance.”
§ Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review > Discussion > Current Use of Artificial Intelligence in Medical Education
What the sources say
- Partly supportedcites [52] sourceExperimental — accuracy not yet measured
The introductory passage reports that 80% of residents never or infrequently received corrective feedback from attending physicians. But it attributes the residents’ survey to reference 2, Isaacson et al.; Hewson and Little did not conduct that survey. The Results section instead describes responses from participants in their own feedback study. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Due to the nonlinear nature of deep learning, there is often no explanation of how the AI system arrives at the answer or prediction [60].”
§ Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review > Discussion > Challenges of Implementation of Artificial Intelligence in Medical Education
What the sources say
- Supportedcites [60] SamekWWiegandTMüllerK-RarXiv Preprint201708282019-06-07Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models https://arxiv.org/abs/1708.08296 source
The Introduction (p. 1) says deep-learning models’ nested non-linear structure makes them highly non-transparent: it is unclear what input information leads to their decisions. This supports the claim that such systems often do not provide an explanation for an answer or prediction. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
57 more claims · 1 with their cited sources checked
Create a free account to see all 93 claims and to verify the 3 references still open.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 20
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Presently, GenAI has enabled the creation of personalized, adaptive learning materials that cater to individual student needs, allowing instructors to provide tailored content for diverse learning styles and backgrounds [23][24][25][26].”
From Integrating Generative Artificial Intelligence Tools and Competencies in Biomedical Engineering Education (2025) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Regulatory challenges include integrating AI into clinical settings and workflow, data sharing between institutions, and the translation and interpretation of AI models in a health- care setting [3,13,43].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [43]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI can influence the student learning process in three ways: direct teaching (imparting knowledge to the student while playing the role of a teacher), support teaching (playing a supporting role and collaborating with students as they learn), and empowering the learner (multiple students can collaborate to solve a complex problem upon feedback provided by the teacher) [2,3,6].”
From Artificial Intelligence Revolutionizing the Field of Medical Education (2023) · cites this paper as [2]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Currently, the state of AI in medical education is in its infancy and speculative stages [13-16].”
From Needs, Challenges, and Applications of Artificial Intelligence in Medical Education Curriculum (2022) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“Currently, AI in medical education primarily supports learning assistance, student assessment, and course optimization [25].”
From Exploring the integration of AI and national quality courses in China: a study on teaching practices in nursing smart education (2025) · cites this paper as [25]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review > Discussion > Challenges of Implementation of Artificial Intelligence in Medical Education
“Difficulty in assessing the effectiveness of the AI application was the most commonly reported challenge (14/34).”
§ Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review > Results > Challenges in Implementing Artificial Intelligence in Medical Education
“This includes the technological difficulties in acquiring a large sample size needed for the development of the model (n=16)”
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 1×
“As highlighted by Hattie et al [51], feedback is critical for identifying learning goals and knowledge gaps.”
Artificial intelligence in medicine
Hamet, P., & Tremblay, J. (2017) · Metabolism · doi:10.1016/j.metabol.2017.01.011 · Cited by 2,334
Problem-Based Learning: An Approach to Medical Education
Engle, K. K. (1981) · The American Journal of Occupational Therapy · doi:10.5014/ajot.35.8.539b · Cited by 2,140 · cited 1×
“It was initially described by Barrows [61] as “the cognitive process that is necessary to evaluate and manage a patient's medical problem.””
Assessment in medical education
Epstein, R. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmra054784 · Cited by 1,872
Evolution and Revolution in Artificial Intelligence in Education
Roll, I., & Wylie, R. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0110-3 · Cited by 1,229 · cited 1×
“Over the past 25 years, there have been significant developments of AI in education [5], with advances such as “teacher bots,” a teaching assistant tasked to deliver content, provide feedback, and supervise progress [6,7].”
Artificial Intelligence: A New Synthesis
(1998) · Elsevier eBooks · doi:10.1016/c2009-0-27773-7 · Cited by 1,163
A review of technology acceptance and adoption models and theories
Taherdoost, H. (2018) · Procedia Manufacturing · doi:10.1016/j.promfg.2018.03.137 · Cited by 1,162
Samek, W., Wiegand, T., & Müller, K.-R. (2017) · arXiv · doi:10.48550/arxiv.1708.08296 · Cited by 1,080
International Journal of Computer Science Issues
(2018) · International Journal of Computer Science Issues · doi:10.20943/01 · Cited by 748
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585 · cited 1×
“Currently, there are limited articles [9,10] discussing or reviewing the current applications of AI in medical education.”
E-learning in medical education in resource constrained low- and middle-income countries
Frehywot, S., Vovides, Y., Talib, Z., Mikhail, N., Ross, H., Wohltjen, H., Bedada, S., Korhumel, K., Koumare, A. K., & Scott, J. (2013) · Human Resources for Health · doi:10.1186/1478-4491-11-4 · Cited by 559
Giving feedback in medical education: Verification of recommended techniques
Hewson, M. G., & Little, M. L. (1998) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1998.00027.x · Cited by 409 · cited 1×
“In a study conducted by Hewson et al [52], 80% of the residents surveyed reported never having or infrequently receiving corrective feedback on their performance.”
Continuing medical education and continuing professional development: international comparisons
Peck, C. (2000) · BMJ · doi:10.1136/bmj.320.7232.432 · Cited by 339 · cited 1×
“A plausible reason for this finding is the lack of a structured curriculum for CME, with a strong emphasis on professional self-regulation [54].”
Twelve Tips for programmatic assessment
Van Der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Govaerts, M. J. B., & Heeneman, S. (2015) · Medical Teacher · doi:10.3109/0142159x.2014.973388 · Cited by 333 · cited 1×
“Programmatic assessment involves the use of an AI system to design an assessment program tailored to optimize learning outcomes and ensure curriculum quality at a systemic level [59].”
Machine learning and medical education
Kolachalama, V. B., & Garg, P. S. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0061-1 · Cited by 320 · cited 3×
“Lack of content specialist in AI to teach students the application of AI knowledge in clinical settings Uses machine learning content in the curriculum to focus on population health and improve patient care UG N/A Kolachalama and Garg, 2018 [47]”
InfluentialCommunication and information technology in medical education
Ward, J. P., Gordon, J., Field, M. J., & Lehmann, H. P. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04173-8 · Cited by 300 · cited 1×
“In adaptive assessments, the selection of the questions to follow depends on the user’s answer to the previous questions, such that the difficulty of the questions is tailored to each individual [58].”
Reimagining Medical Education in the Age of AI
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.146 · Cited by 263 · cited 1×
“For example, an intrinsic limitation underlying the use of AI is the inability to show concern [67].”
Effect of problem-based, self-directed undergraduate education on life-long learning.
(1993) · Europe PMC (PubMed Central) · Cited by 259
Teacherbot: interventions in automated teaching
Bayne, S. (2015) · Teaching in Higher Education · doi:10.1080/13562517.2015.1020783 · Cited by 202 · cited 1×
“Over the past 25 years, there have been significant developments of AI in education [5], with advances such as “teacher bots,” a teaching assistant tasked to deliver content, provide feedback, and supervise progress [6,7].”
Resolving Ethical Dilemmas: A Guide for Clinicians
Adelson, B. H. (2001) · JAMA · doi:10.1001/jama.285.16.2134 · Cited by 112
Current status of curriculum mapping in Canada and the UK
Willett, T. G. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03093.x · Cited by 83 · cited 2×
“This is seen in the rise of statutory laws such as the Data Protection Act 2018 (United Kingdom) [62] and the Personal Data Protection Act 2012 (Singapore) [63].”
Continuing medical education: Recertification and the maintenance of competence
Bashook, P. G., & Parboosingh, J. T. (1998) · BMJ · doi:10.1136/bmj.316.7130.545 · Cited by 80 · cited 1×
“Medical education encompasses a lifelong learning continuum ranging from undergraduate to postgraduate and specialization training and beyond, also known as “continuing medical education” [8].”
AI in medical education—another grand challenge for medical informatics
Lillehaug, S.-I., & Lajoie, S. P. (1998) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(97)00054-7 · Cited by 78 · cited 3×
“Currently, there are limited articles [9,10] discussing or reviewing the current applications of AI in medical education.”
Alonso-Silverio, G. A., Escamirosa, F. P., Bruno-Sanchez, R., Ortiz-Simón, J. L., Muñoz, R., Minor‐Martínez, A., & Alarcón-Paredes, A. (2018) · Surgical Innovation · doi:10.1177/1553350618777045 · Cited by 73 · cited 2×
“…al, 2017 [42] Lack of sensitivity to identify trainees who outperform those who are less experienced Evaluation of basic laparoscopic skills UG, PG N/A Alonso-Silverio et al, 2018 [43] Difficulty in rating certain scores due to the lack of participation of individuals at the same level of…”
Botrel, L., Holz, E. M., & Kübler, A. (2015) · Brain-Computer Interfaces · doi:10.1080/2326263x.2015.1100038 · Cited by 72 · cited 1×
“Over the past 25 years, there have been significant developments of AI in education [5], with advances such as “teacher bots,” a teaching assistant tasked to deliver content, provide feedback, and supervise progress [6,7].”
Woo, C. W., Evens, M. W., Freedman, R., Glass, M., Shim, L. S., Zhang, Y., Zhou, Y., & MICHAEL, J. A. (2005) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2005.10.004 · Cited by 71 · cited 3×
“Allows students to practice qualitative causal reasoning in physiology when solving a problem UG CIRCSIM-Tutor Woo et al, 2006 [26] The need for capture and analysis of requirements and multidisciplinary input Develops an adaptive electronic learning system on atheromatosis UG, PG, CME N/A Kabassi et al, 2008 [27] fro…”
Suebnukarn, S., & Haddawy, P. (2006) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2005.04.003 · Cited by 67 · cited 2×
“As discussed by Suebnukarn et al [25], the ideal method of assessing the effectiveness of the system is to conduct a study comparing the use of the AI system with traditional methods of teaching.”
Automatically rating trainee skill at a pediatric laparoscopic suturing task
Oquendo, Y. A., Riddle, E. W., Hiller, D. F., Blinman, T. A., & Kuchenbecker, K. J. (2017) · Surgical Endoscopy · doi:10.1007/s00464-017-5873-6 · Cited by 63 · cited 1×
“Difficulty in rating certain scores due to the lack of participation of individuals at the same level of performance Performance evaluation of a pediatric laparoscopic suturing task UG, PG, CME N/A Oquendo et al, 2018 [44]”
What and who are clinical ethics committees for?
McLean, S. A. M. (2007) · Journal of Medical Ethics · doi:10.1136/jme.2007.021394 · Cited by 62 · cited 1×
“This calls for the development of clinical ethics committees [66] that aim at addressing ethical issues that arise within patient care scenarios.”
Institutionalizing healthcare hackathons to promote diversity in collaboration in medicine
Wang, J. K., Roy, S., Barry, M., Chang, R. T., & Bhatt, A. S. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1385-x · Cited by 62 · cited 1×
“Interfaculty collaborations and competitions can also be held in universities to promote interaction between students and peers and allow the sharing of expertise across different fields such as health care hackathons, which have been increasing in recent years [68].”
Virtual patient simulator for distributed collaborative medical education
Caudell, T. P., Summers, K. L., Holten, J., Hakamata, T., Mowafi, M., Jacobs, J., Lozanoff, B. K., Lozanoff, S., Wilks, D., Keep, M. F., et al. (2003) · The Anatomical Record Part B: The New Anatomist · doi:10.1002/ar.b.10007 · Cited by 61 · cited 2×
“These systems provide added benefits of a virtual environment alongside the benefits of an intelligent tutoring system, including immersive, interactive, and safe environments in a VR simulation, as described by Caudell et al [20].”
The potential of latent semantic analysis for machine grading of clinical case summaries
Kintsch, W. (2002) · Journal of Biomedical Informatics · doi:10.1016/s1532-0464(02)00004-7 · Cited by 46 · cited 1×
“Monetary investments required to develop the algorithm and evaluate the effectiveness of a program Assessment of clinical case summaries for medical students UG Usage of Latent Semantic Analysis Kintsch, 2002 [19]”
Data, Big and Small: Emerging Challenges to Medical Education Scholarship
Ellaway, R., Topps, D., & Pusic, M. V. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002465 · Cited by 46 · cited 1×
“Concurrently, there is a need to develop novel models that allow access to educational data for the development of AI applications [64].”
Chieu, V. M., Luengo, V., Vadcard, L., & Tonetti, J. (2010) · International Journal of Artificial Intelligence in Education · doi:10.3233/jai-2010-0009 · Cited by 34 · cited 2×
“N/A Teaching the concept of sacroiliac screw fixation in orthopedic surgery PG TELEOS project Chieu et al, 2010 [31]”
Learning from a Computer Tutor with Natural Language Capabilities
MICHAEL, J. A., Rovick, A. A., Glass, M., Zhou, Y., & Evens, M. W. (2003) · Interactive Learning Environments · doi:10.1076/ilee.11.3.233.16543 · Cited by 34 · cited 1×
“Lack of quality explanations for wrong answers Develops problem-solving skills on the baroreceptor reflex UG CIRCSIM-Tutor Michael et al, 2003 [22]”
The expert surgical assistant. An intelligent virtual environment with multimodal input.
Billinghurst, M., Savage, J., Oppenheimer, P., et al. (1996) · PubMed · Cited by 33
A general architecture for intelligent tutoring of diagnostic classification problem solving.
Crowley, R. S., & Medvedeva, O. (2003) · Europe PMC (PubMed Central) · Cited by 33
An adaptive Student Centered Curriculum for an intelligent training system
Eliot, C., & Woolf, B. P. (1995) · User Modeling and User-Adapted Interaction · doi:10.1007/bf01101802 · Cited by 32 · cited 3×
“The need for a structured set of production rules Guides students to solve problems on infectious diseases using a diagnostic problem-solving approach UG b GUIDON Clancey and Stanford Univ, 1983 [11] Need to create algorithms for different symptom approach Assess medical students’ diagnostic capabilities UG KBIT c Pap…”
Piyapong, K., Anna, R., Terry, J., & Karin, V. (2017) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-830-3-447 · Cited by 31 · cited 2×
“…for each student Provides guided learning pathway and personalized feedback for students’ approach to patients presenting with abdominal pain UG N/A Khumrin et al, 2017 [42] Lack of sensitivity to identify trainees who outperform those who are less experienced Evaluation of basic laparoscopic…”
(2000) · PubMed · Cited by 28
LAHYSTOTRAIN intelligent training system for laparoscopy and hysteroscopy.
Voss, G., Bockholt, U., Jl, L. A., et al. (2000) · PubMed · Cited by 28
Latifi, S., Gierl, M. J., Boulais, A.-P., & Champlain, A. F. D. (2015) · Evaluation & the Health Professions · doi:10.1177/0163278715605358 · Cited by 26 · cited 1×
“questions PG N/A Latifi et al, 2016 [39]”
McFadden, P., & Crim, A. (2016) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000061 · Cited by 26 · cited 4×
“As a result, limited studies [40] have been conducted to assess the effectiveness of AI in medical education.”
InfluentialIntelligent training system integrated in an echocardiography simulator
Weidenbach, M., Trochim, S., Kreutter, S., Richter, C., Berlage, T., & Grunst, G. (2003) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(03)00084-2 · Cited by 25
Implementing tutoring strategies into a patient simulator for clinical reasoning learning
Kabanza, F., Bisson, G., Charneau, A., & Jang, T.-S. (2006) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2006.01.003 · Cited by 23
Chen, Y., Wrenn, J. O., Xu, H., Spickard, A., Habermann, R., Powers, J. S., & Denny, J. C. (2014) · PubMed · Cited by 23
Wearable Sensors in Medical Education: Supporting Hand Hygiene Training with a Forearm EMG
Kutafina, E. V., Laukamp, D., & Jonas, S. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-516-6-286 · Cited by 19 · cited 2×
“…evaluate the effectiveness of the system in comparison with traditional methods of learning Training and evaluation of hand-washing techniques N/A N/A Kutafina et al, 2015 [37] Technical difficulties in development of the machine learning model due to the usage of a different decision trees for…”
Virtual patients in problem‐based learning
Hamdy, H., Al-Moslih, A., Tavarnesi, G., & Laus, A. (2017) · Medical Education · doi:10.1111/medu.13293 · Cited by 19 · cited 3×
“Allows students to practice qualitative causal reasoning in physiology when solving a problem UG CIRCSIM-Tutor Woo et al, 2006 [26] The need for capture and analysis of requirements and multidisciplinary input Develops an adaptive electronic learning system on atheromatosis UG, PG, CME N/A Kabassi et al, 2008 [27] fro…”
Developing a More Responsive Radiology Resident Dashboard
Chen, H., Gangaram, V., & Shih, G. (2018) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-018-0123-6 · Cited by 15 · cited 2×
“The rule-based approach had a lack of scalability Automates ICDj/CPTk classification to provide a more up-to-date dashboard for radiology residents PG Trove radiology resident dashboard Chen et al, 2018 [45]”
T-cell-mediated control of autoimmunity.
(2001) · Arthritis Research · doi:10.1186/ar289 · Cited by 13
Leveraging the learning process in health through clinical cases simulator
Flores, C. D., Barros, P. R. M., Cazella, S. C., & Bez, M. R. (2013) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah.2013.6665303 · Cited by 12 · cited 3×
“Allows students to practice qualitative causal reasoning in physiology when solving a problem UG CIRCSIM-Tutor Woo et al, 2006 [26] The need for capture and analysis of requirements and multidisciplinary input Develops an adaptive electronic learning system on atheromatosis UG, PG, CME N/A Kabassi et al, 2008 [27] fro…”
Expanding the Space of Plausible Solutions in a Medical Tutoring System for Problem-Based Learning
Kazi, H., Haddawy, P., & Suebnukarn, S. (2009) · International Journal of Artificial Intelligence in Education · doi:10.3233/irg-2009-19(3)04 · Cited by 12 · cited 3×
“Allows students to practice qualitative causal reasoning in physiology when solving a problem UG CIRCSIM-Tutor Woo et al, 2006 [26] The need for capture and analysis of requirements and multidisciplinary input Develops an adaptive electronic learning system on atheromatosis UG, PG, CME N/A Kabassi et al, 2008 [27] fro…”
Hayasaka, Y., Fujikura, T., & Kashimura, M. (2018) · Journal of Nippon Medical School · doi:10.1272/jnms.jnms.2018_85-57 · Cited by 9 · cited 1×
“Worry that usage of robots may result in the training of standardized doctors Use of AI-equipped robots as simulated patients N/A N/A Hayasaka et al, 2018 [46]”
Kabassi, K., Virvou, M. K., Tsihrintzis, G. A., Vlachos, Y., & Perrea, D. N. (2008) · Intelligent Decision Technologies · doi:10.3233/idt-2008-2304 · Cited by 8 · cited 3×
“Allows students to practice qualitative causal reasoning in physiology when solving a problem UG CIRCSIM-Tutor Woo et al, 2006 [26] The need for capture and analysis of requirements and multidisciplinary input Develops an adaptive electronic learning system on atheromatosis UG, PG, CME N/A Kabassi et al, 2008 [27] fro…”
Walkowski, S., Lundin, M., Szymas, J., & Lundin, J. (2015) · Journal of Pathology Informatics · doi:10.4103/2153-3539.158057 · Cited by 8 · cited 3×
“Technical difficulties in development of the machine learning model due to the usage of a different decision trees for each question Correlation of students’viewing behaviors of whole-slide images with their test performances UG N/A Walkowski et al, 2015 [38]”
InfluentialThe CARDIO-LOGOS system for ECG training and diagnosis
Bourlas, P., Giakoumakis, E. A., Koutsouris, D., Papakonstantinou, G., & Tsanakas, P. D. (1996) · Technology and Health Care · doi:10.3233/thc-1996-3409 · Cited by 5 · cited 1×
“Variability in diagnostic criteria of ECG amongst different groups of specialists Assists learners in the recognition and diagnosis of ECGg patterns UG, PGe, CMEf CARDIO-LOGOS Bourlas et al, 1996 [15]”
Informatics Approach to Improving Surgical Skills Training.
Islam, G. (2013) · ProQuest LLC eBooks · Cited by 2
Building Computational Virtual Reality Environment for Anesthesia
Cao, X., Zhang, P., He, J., & Huang, G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24474-7_21 · Cited by 2 · cited 3×
“Allows students to practice qualitative causal reasoning in physiology when solving a problem UG CIRCSIM-Tutor Woo et al, 2006 [26] The need for capture and analysis of requirements and multidisciplinary input Develops an adaptive electronic learning system on atheromatosis UG, PG, CME N/A Kabassi et al, 2008 [27] fro…”
Clancey, W. J. (1983) · Cited by 1
Research works printed but not linked: 14
- McCarthyJMinskyMLRochesterNShannonCEAI magazine200612152019-06-07A proposal for the dartmouth summer research project on artificial intelligence, August 31, 1955 https://aaai.org/ojs/index.php/aimagazine/index
- Russell, S, 2018, Artificial intelligence: a modern approach, global edition
- Papa, F, 1992, Reports
- Billinghurst, M, 1996, Stud Health Technol Inform, 29, 590
- Frize, M, 2000, Clin Invest Med, 23, 266
- Voss, G, 2000, Stud Health Technol Inform, 70, 359
- StasiuRKDe BrittoJDa Silva DiasJScalabrinETeaching of electrocardiogram interpretation guided by a tutorial expertProceedings 14th IEEE Symposium on Computer-Based Medical Systems20010714th IEEE Symposium on Computer-Based Medical SystemsJuly 26-27, 2001Bethesda, MD48792
- Vicari, R, 2008, International Journal of Artificial Intelligence in Education, 18, A
- Kazi, H, 2009, International Journal of Artificial Intelligence in Education, 19, 309
- Chen, CK, 2010, IR Applications
- LemmonCSiuMLCVincentHVHamiltonJThe Importance of Humans in Simulation: Allowing the Lure of Technology to Drive DevelopmentProceedings of the European Conference on Games Based Learning2011105th European Conference on Games Based LearningOctober 20-21, 2011Athens, Greece
- Kutafina, E, 2015, Stud Health Technol Inform, 211, 286
- Khumrin, P, 2017, Stud Health Technol Inform, 245, 447
- Shin, J, 1993, CMAJ, 148, 969
Cited by
Grassini, S. (2023) · Education Sciences · doi:10.3390/educsci13070692 · Cited by 1,048
Application and theory gaps during the rise of artificial intelligence in education
Chen, X., Xie, H., Zou, D., & Hwang, G.-J. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100002 · Cited by 1,003
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975
“AI technologies have had a significant impact on the way we learn (Chen et al., 2020) particularly due to the rapid development with the emergence of deep learning technologies (Chan & Zary, 2019).”
BackgroundArtificial intelligence innovation in education: A twenty-year data-driven historical analysis
Guan, C., Mou, J., & Jiang, Z. (2020) · International Journal of Innovation Studies · doi:10.1016/j.ijis.2020.09.001 · Cited by 665
The rise of ChatGPT : Exploring its potential in medical education
Lee, H. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2270 · Cited by 596
Metadata
- Authors
- Chan, K. S., & Zary, N.
- Affiliations
- Nanyang Technological University (SG)
- Corresponding author
- Zary, Nabil
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2019-06-15
- Volume
- 5
- Issue
- 1
- Pages
- e13930
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC6598417
- OpenAlex
- W2939970150
- Cited by
- 877
- References
- 58
- Citations by year
- 2026: 228 · 2025: 248 · 2024: 181 · 2023: 101 · 2022: 52 · 2021: 39 · 2020: 24 · 2019: 3
- FWCI
- 1.57
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
- Funders
- Lee Kong Chian School of Medicine, Nanyang Technological University
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- artificial intelligence, medical education, AI implementation challenges, learning support, automated feedback, student assessment, curriculum review, medical undergraduates, technology acceptance, diffusion of innovations, artificial intelligence adoption, data integrity, big data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-15, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-15 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.