Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index; 119 of the 161 sources its claims cite were checked for support.
Abstract
Background: Generative artificial intelligence (AI) technologies are increasingly being utilized across various fields, with considerable interest and concern regarding their potential application in medical education. These technologies, such as Chat GPT and Bard, can generate new content and have a wide range of possible applications. Objective: This study aimed to synthesize the potential opportunities and limitations of generative AI in medical education. It sought to identify prevalent themes within recent literature regarding potential applications and challenges of generative AI in medical education and use these to guide future areas for exploration. Methods: We conducted a scoping review, following the framework by Arksey and O'Malley, of English language articles published from 2022 onward that discussed generative AI in the context of medical education. A literature search was performed using PubMed, Web of Science, and Google Scholar databases. We screened articles for inclusion, extracted data from relevant studies, and completed a quantitative and qualitative synthesis of the data. Results: Thematic analysis revealed diverse potential applications for generative AI in medical education, including self-directed learning, simulation scenarios, and writing assistance. However, the literature also highlighted significant challenges, such as issues with academic integrity, data accuracy, and potential detriments to learning. Based on these themes and the current state of the literature, we propose the following 3 key areas for investigation: developing learners’ skills to evaluate AI critically, rethinking assessment methodology, and studying human-AI interactions. Conclusions: The integration of generative AI in medical education presents exciting opportunities, alongside considerable challenges. There is a need to develop new skills and competencies related to AI as well as thoughtful, nuanced approaches to examine the growing use of generative AI in medical education.
Overview
CoChat Summary
TL;DR
This scoping review synthesizes 41 articles published in 2023 on generative AI in medical education, identifying opportunities such as self-directed learning, simulation, and writing assistance alongside challenges including academic integrity, accuracy/hallucination, and potential learning harms. It proposes three future investigation areas: learners’ critical AI evaluation skills, rethinking assessment, and studying human-AI interaction.
Key findings
- From 2761 unique titles, after removing 168 duplicates, 2593 studies were screened; 2425 were unrelated and 127 were excluded, yielding 41 included articles. Of these, 21/41 (51.2%) were opinion pieces and 20/41 (48.8%) were original research; 16 original research articles reported generative AI performance on standardized assessments. All included studies were published in 2023.
- Thematic analysis identified potential benefits in test performance/preparation, novel learning strategies (personalized learning plans/materials, feedback, communication skills training, clinical image generation, medical humanities exercises), and writing/research assistance (assisting non-native speakers, translations, literature review/summarization).
- Challenges included academic integrity concerns (cheating, technological plagiarism, need for policy and disclosure guidance), accuracy/dependability issues (reliance on training data, lack of up-to-date information, hallucination, unwarranted confidence, misinformation propagation, limited accuracy in specific areas), and potential detriments to learning (overdependence, assessment challenges, propagating inaccurate information, inequities in access).
- The authors propose three key areas for investigation: developing learners’ AI literacy/critical appraisal and navigating uncertainty, considering implications for assessment, and exploring human-AI interaction.
Methods
- Scoping review following the Arksey and O’Malley framework; searched PubMed, Web of Science, and Google Scholar for English-language articles published from January 1, 2022, to June 21, 2023, discussing generative AI in medical education.
- The first 100 articles were independently screened by both authors based on titles and abstracts, yielding substantial agreement (Cohen kappa=0.76); one author screened the remaining studies, and a random subset of full-text articles was independently reviewed by the second author. Conflicts were resolved through discussion and consensus.
- Data abstraction used a structured form; descriptive statistics summarized study demographics, and qualitative data underwent thematic analysis guided by Braun and Clarke, with themes and subthemes reported in Table 2.
Limitations
- Stated: the search was restricted to English-language articles and to publications from 2022 onward, excluding earlier related literature such as natural language processing in medical education; thematic analysis has inherent subjectivity; the literature is rapidly evolving; and the lack of empirical studies limits definitive conclusions, with most benefits and challenges remaining speculative.
- Evident: only 1 study examined learner attitudes toward generative AI in medical education, and no curricula specifically focusing on generative AI were found; most included articles were opinion pieces or speculative, limiting empirical grounding.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
33 Valid · 2 Not valid · 10 Not checked · 48 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“For instance, Webb [16] discussed the potential for generative AI to enhance communication skills for emergency medicine physicians, particularly for delivering difficult news. This was achieved by simulating patient reactions and dialogues during the disclosure of a new cancer diagnosis [16].”
§ Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review > Results > Potential Benefits of Generative AI in Medical Education
What the sources say
- Supportedcites [16] source
Split into 2 atoms — 2 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Numerous studies underscored the potential of these AI models to adapt to individual learners' requirements, offering a customized learning experience [1,14,15,20,22,34].”
§ Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review > Results > Potential Benefits of Generative AI in Medical Education
What the sources say
- Partly supportedcites [1] sourceExperimental — accuracy not yet measured
In The Interview, ChatGPT says language models can analyze individual students’ performance and generate materials addressing their weaknesses, supporting the claimed potential for customized learning. This paper presents that point as a possibility in a conversation, not as a finding established by numerous studies. (LLM, conf=0.86)
- Supportedcites [14] source
The Potential Benefits section says generative AI can analyze each student's strengths and weaknesses to create personalized assessments and help educators develop learning plans addressing individual needs. The Conclusions likewise describe GLMs generating individualized content for students. These passages support the attributed potential for customized learning. (LLM, conf=0.92)
- Supportedcites [15] source
In “Potential Applications and Benefits of ChatGPT in Medical Education” (page not provided), the paper explicitly describes ChatGPT’s potential for personalized education. It says ChatGPT can respond at an appropriate level and explain difficult concepts in ways that adapt to a struggling student’s level. The paper notes that tracking progress and adjusting teaching style are not yet developed; the citing sentence claims potential, not an established capability. (LLM, conf=0.91)
- Supportedcites [20] source
The ‘ChatGPT Role in Medical education’ section says ChatGPT can provide personalized study plans and learning materials suited to students’ different learning styles and abilities. This supports the cited claim about its potential to offer customized learning. (LLM, conf=0.93)
- Supportedcites [22] source
The Opportunities section, under “Personalized Study Plans and Learning Materials” (page not provided), says students can use LLMs to generate study plans tailored to their strengths, weaknesses, goals, and preferences. It also describes personalized materials targeting areas where a student needs improvement, supporting the attributed potential for customized learning. (LLM, conf=0.92)
- Supportedcites [34] source
The Discussion says ChatGPT’s major advantage for medical students is personalized learning suited to their individual needs. That supports this source’s contribution to the citing sentence’s claim about customized learning. (LLM, conf=0.90)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“As touched upon in the preceding paragraph, a significant worry cited by numerous authors is the potential threat to academic integrity and the possible misuse of this technology [12,14,15,19,20,22,23,25,40-43].”
§ Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review > Results > Potential Limitations of Generative AI in Medical Education
What the sources say
- Supportedcites [12] source
The “ChatGPT in medical education” section warns that students could exploit ChatGPT to write entire assignments rather than use it to refine their work. This supports citing the paper as one of the authors raising concerns about misuse and academic integrity; the supplied copy gives no page number. (LLM, conf=0.91)
- Supportedcites [14] source
The Introduction identifies misuse of AI-generated content and academic integrity as concerns in medical education. The Challenges and Ethical Considerations section calls AI-enabled academic dishonesty a critical issue and gives examples of how generative AI tools could be misused. (LLM, conf=0.94)
- Supportedcites [15] source
In “ChatGPT’s responses,” Lee identifies student reliance on ChatGPT as a concern that may lead to academic dishonesty or cheating, including using it to complete assignments. The Figure 1 discussion also says that ChatGPT’s use for academic misconduct calls traditional assessments into question. (LLM, conf=0.92)
- Supportedcites [19] source
In “Ethics and Integrity in Academic Work,” the authors explicitly discuss the risk that AI technologies could be misused and ask how their use affects professional integrity and accountability. The abstract likewise identifies ethical concerns about LLMs in health professions education scholarship. This supports the concern attributed to this source, without requiring it alone to establish what numerous authors say. (LLM, conf=0.92)
- Supportedcites [20] source
The “ChatGPT Role in Medical education” section explicitly says ChatGPT has raised concerns about plagiarism and cheating. These are the academic-integrity risks the citing sentence describes; the claim that numerous authors raise the concern refers to its collection of citations, not to this source alone. (LLM, conf=0.91)
- Supportedcites [22] source
The Introduction identifies plagiarism among the serious challenges of adopting LLMs in medical education. The Academic Dishonesty section explains how LLMs could be misused for cheating and plagiarism, directly supporting the concern attributed to this source. (LLM, conf=0.94)
- Not checked — no full text of the sourcecites [23] source
- Not checked yetcites [25] doi:10.6145/jme.202303_27(1).0005
- Supportedcites [40] source
The paper’s main text warns that students may use ChatGPT to cheat and calls for surveillance to prevent its use in medical assignments. It also identifies ethical concerns and the potential for misuse, supporting the concern attributed to this source. (LLM, conf=0.92)
- Partly supportedcites [41] sourceExperimental — accuracy not yet measured
The Abstract warns that plagiarism remains a concern when ChatGPT is used for academic writing, and the Academic writing section reports plagiarism matches in a generated literature review. These passages support a concern about academic integrity, but the paper’s medical education section does not discuss misuse or academic-integrity threats in that setting. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Several studies focused on the role of generative AI models in tests of medical knowledge [8-11,13,26,27,31-39].”
§ Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review > Results > Potential Benefits of Generative AI in Medical Education
What the sources say
- Supportedcites [8] source
The Introduction (page unavailable) says the study evaluates ChatGPT, a large language model, using questions from the USMLE. The Results report its accuracy on those exam questions, confirming that this paper is an example of a study testing a generative AI model on medical knowledge. (LLM, conf=0.94)
- Supportedcites [9] source
The section on ChatGPT’s performance on exams describes the European Exam in Core Cardiology as a knowledge-based assessment and states that the authors evaluated ChatGPT on it. This paper is therefore an example of a study testing a generative AI model on medical knowledge. (LLM, conf=0.94)
- Supportedcites [10] source
The Conclusions report that this study tested ChatGPT on higher-order medical biochemistry questions, including multiple-choice questions. It is therefore an example of a study examining a generative AI model on a test of medical knowledge. (LLM, conf=0.92)
- Supportedcites [11] source
This paper is one of the studies described in the citing sentence. Its Results section evaluates GPT-3.5 and GPT-4 on 280 Korean general surgery board-exam questions, a test of medical knowledge. (LLM, conf=0.94)
- Supportedcites [13] source
The Discussion states that this study tested ChatGPT on Taiwan’s Family Medicine Board Exam, making it an example of a study evaluating a generative AI model on medical knowledge. The Introduction also describes other studies testing ChatGPT on medical examinations. (LLM, conf=0.93)
- Supportedcites [26] source
The Abstract states that the study assessed ChatGPT’s accuracy on the Plastic Surgery Inservice Training Examination using questions from the 2022 exam. This paper therefore exemplifies a study of a generative AI model on a test of medical knowledge. (LLM, conf=0.94)
- Not checked — no full text of the sourcecites [27] source
- Supportedcites [31] source
The Abstract describes the authors testing ChatGPT on a clinical toxicology vignette and evaluating its answers to medical questions. That case-based assessment supports citing this paper as a study of a generative AI model's medical knowledge; the paper does not claim to have administered a standardized examination. (LLM, conf=0.86)
- Supportedcites [32] source
The Background identifies ChatGPT as an AI chatbot and says the study examines how accurately it can answer medical-examination questions. The Conclusion reports its performance on a parasitology examination, so this paper is an example of a study of generative AI in a medical-knowledge test. Page numbers are not provided in our copy. (LLM, conf=0.92)
- Supportedcites [33] source
The Introduction states that the study aimed to assess ChatGPT’s performance on examinations of medical knowledge, including USMLE Step 1 and Step 2. This paper is therefore an example of the studies described in the citing sentence. Page numbers were not supplied in our copy. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Several authors underscore that the knowledge base of these models is constrained by their training data, given that most models lack internet access to retrieve the most current information [10,22,34,37,44].”
§ Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review > Results > Potential Limitations of Generative AI in Medical Education
What the sources say
- Partly supportedcites [10] sourceExperimental — accuracy not yet measured
The Discussion (page not available) says ChatGPT’s information dataset ended in 2021 and that its answers may omit recent advances; the Conclusions likewise link weaker performance on recent topics to training-database limitations. The paper does not say that most generative AI models lack internet access, so it does not support that explanation or its extension to most models. (LLM, conf=0.86)
- Partly supportedcites [22] sourceExperimental — accuracy not yet measured
The “Challenges > Limited Knowledge” section says LLMs depend on training data that may omit the latest medical knowledge and that most LLMs have a static knowledge base. It does not say that most models lack internet access or identify that as the reason they cannot retrieve current information. (LLM, conf=0.87)
- Partly supportedcites [34] sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) suggests that limitations in ChatGPT’s training may contribute to its uneven performance across microbiology topics. It does not say that most generative AI models lack internet access or that this prevents them from retrieving current information. (LLM, conf=0.81)
- Partly supportedcites [37] sourceExperimental — accuracy not yet measured
The Methods section ('ChatGPT Is an LLM'; page unavailable) describes ChatGPT as trained on internet text, and the Discussion links its performance to the availability and quality of training data. The paper does not say that most models lack internet access or cannot retrieve current information, so that explanation is unsupported by this source. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [44] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
30 more claims · 9 with their cited sources checked
Create a free account to see all 93 claims and to verify the 11 references still open.
- Probably not a substantial claim. 39
- It may state two separate claims as one. 25
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“studies before 2023 were constrained by the technology’s maturity, missing the recent shift from theoretical exploration to operational implementation [1]”
From Applications, Challenges, and Prospects of Generative Artificial Intelligence Empowering Medical Education: Scoping Review (2025) · cites this paper as [1]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GAI rapidly expands into diverse applications, enabling content generation across text, images, and audio through the analysis of extensive datasets [1].”
From Applications, Challenges, and Prospects of Generative Artificial Intelligence Empowering Medical Education: Scoping Review (2025) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additional factors might include insufficient training data for the LLM [17,35,36], context misinterpretation, lack of external validation, and overreliance on pattern recognition, all of which could contribute to variable degrees of hallucination, depending on the specific LLM and prompt structure.”
From Reference Hallucination Score for Medical Artificial Intelligence Chatbots: Development and Usability Study (2024) · cites this paper as [36]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Several scoping reviews have examined AI within medical education23–28”
From What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education (2026) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“but these syntheses largely describe broad “AI literacy” themes or program-level content rather than systematically extracting and organizing competency- and learning-objective-level outcomes for undergraduate medical education (UME).”
From What the AI era doctor should know: a scoping review of proposed artificial intelligence competencies for medical education (2026) · cites this paper as [28]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review > Results > Study Characteristics
“Our initial search identified 2761 unique titles (Figure 1).”
§ Opportunities, Challenges, and Future Directions of Generative Artificial Intelligence in Medical Education: Scoping Review > Results > Study Characteristics
“After removing 168 duplicates, 2593 studies were available for screening.”
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“The tensions of navigating information provided by technology and other sources are fertile ground for exploration and discussion among learners, particularly as AI begins to drive more clinical decisions [4].”
BackgroundWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Considering the primary medical literature, most published research findings are suggested to be false [55].”
BackgroundKung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · cited 8×
“Only a handful of these studies delved into the potential implications of generative AI's performance on these tests [8,33].”
BackgroundInfluentialKung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
The answer is 17 years, what is the question: understanding time lags in translational research
Morris, Z. S., Wooding, S., & Grant, J. (2011) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2011.110180 · Cited by 3,340 · cited 1×
“Medical textbooks, often considered the gold standard in medical knowledge, are perpetually outdated, are limited in scope, and may contain inaccuracies [52-54].”
BackgroundMorgan, D. L. (2007) · Journal of Mixed Methods Research · doi:10.1177/2345678906292462 · Cited by 2,503 · cited 1×
“Data uncertainty can be viewed from a positivist perspective with error margins and reliability estimates or from a pragmatic perspective, which focuses on the data’s utility [50].”
BackgroundGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Research works printed but not linked: 3
- 10.6145/jme.202303_27(1).0005 · doi:10.6145/jme.202303_27(1).0005
- OpenAIGPT-4 Technical ReportarXiv202303272023-06-01https://arxiv.org/abs/2303.08774v3
- Bloom, BS, 1956, Taxonomy of Educational Objectives: The Classification of Educational Goals
Cited by
Items 201–300 of 460
Influence of Generative AI on Healthcare Industries Enhanced by the Metaverse
Kumari, R., & Singh, R. K. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-1515-6.ch006 · Cited by 6
Bianchi, M. G., D'addario, A. M. V., Junior, P. F. G.-B., Machado, B. S., Agondi, R. C., Almeida, S. K. A., Junior, W. X. A., Armelin, L. M., Aun, M. V., Bordignon, N., et al. (2024) · Journal of Allergy and Clinical Immunology Global · doi:10.1016/j.jacig.2024.100373 · Cited by 9
Bianco, G. L., Cascella, M., Natoli, S., D’Angelo, F., Sinagra, E., Marchesini, M., Piraccini, E., Tinnirello, A., Occhigrossi, F., Gregoretti, C., et al. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14196814 · Cited by 4
“…investigations on spinal cord stimulation (SCS) and opioid therapy suggest that although ChatGPT provides reliable, user-friendly responses on basic aspects, it may omit recent clinical developments and important details essential for effective patient education on said interventions [14,19].”
InfluentialECGTwinMentor: A digital twin-based system for personalized ECG learning and support
Flores-Martin, D., Díaz‐Barrancas, F., Pardo, P. J., Berrocal, J., & Murillo, J. M. (2025) · SoftwareX · doi:10.1016/j.softx.2025.102398 · Cited by 6
Luo, Z., Kam, S. C., Kim, J. Y., Hu, W., Lin, C., Park, H. J., & Shin, Y. S. (2025) · The World Journal of Men s Health · doi:10.5534/wjmh.240331 · Cited by 3
“Recently, artificial intelligence-based conversational systems leveraging large language models, such as Chat-Generative Pretrained Transformer 4.0 (ChatGPT 4.0) have garnered widespread attention [5].”
InfluentialBianchi, J., & Zheng, M. S. (2025) · Orthodontics and Craniofacial Research · doi:10.1111/ocr.12949 · Cited by 7
“A recent literature review [11] concluded that genAI offers several exciting opportunities in medical education, including promoting self-directed learning, creating simulated scenarios and assisting with writing.”
Generative-AI-Powered TA BOT for Enhanced Personalized Support in Software Engineering Education
Rohanadeera, S. L., & Hewagamage, K. P. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6291-3_16 · Cited by 3
Khamis, N., & Ungaretti, T. (2025) · Medical Science Educator · doi:10.1007/s40670-025-02573-8 · Cited by 5
“whether such tools can be integrated without compromising educational integrity and cognitive skills [8–10].”
MIRAGE: Retrieval and Generation of Multimodal Images and Texts for Medical Education
Benito, M. D., Diana-Albelda, C., García‐Martín, Á., Bescós, J., Escudero-Viñolo, M., & SanMiguel, J. C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-09569-5_11 · Cited by 3
“Prior work has applied AI to self-directed learning and tutoring [13,14,15,16,17,18], but remains largely text-centric.”
Tan, T. M., & Fischer, K. (2025) · Academic Medicine · doi:10.1093/acamed/wvaf082 · Cited by 5
The Evolving Role of AI in Simulation-Based Medical Education: A Narrative Review
Hasan, S. H., Ahmed, A., & Ismail, F. (2026) · Advances in Medical Education and Practice · doi:10.2147/amep.s581691 · Cited by 7
“14,16 Realism of Simulation AI has also transformed the realism and visualization of educational content, particularly for foundational disciplines like anatomy.”
Miranda, J. P. P., Bansil, J. A., Fernando, E. Q., Gamboa, A. B., Hernandez, H. E., Cruz, M., Dianelo, R. F. B., Gonzales, D., & Penecilla, E. (2024) · International Conference on Technology Innovation and Its Applications (ICTIIA) · doi:10.1109/ictiia61827.2024.10761175 · Cited by 8
“Additionally, Gemini, previously known as Bard, generates new content and is used in design, education, and healthcare [22]–[25].”
Artificial intelligence in medical problem-based learning: opportunities and challenges
Chen, Y., Qi, H. Y., Qiu, Y. L., Li, J., Zhu, L. W., Gao, X., Wang, H., & Jiang, G. (2024) · Global Medical Education · doi:10.1515/gme-2024-0015 · Cited by 9
“In addition, AI can generate learning materials and plans, as well as tailored feedback [17].”
Mehta, S., Haddad, E. N., Bhavsar‐Burke, I., Majors, A. K., Maeda, R. K., Burke, S. M., Deshpande, A., Nowacki, A. S., Lindenmeyer, C. C., & Mehta, N. (2025) · JMIR Medical Education · doi:10.2196/72034 · Cited by 4
“…passing scores on the United States Medical Licensing Examination (USMLE), raising questions about their impact on assessment frameworks [1], including whether artificial intelligence (AI) can successfully answer essay-style, reasoning-based questions and whether assessors can…”
ChatGPT sitting for FRCS Urology examination: Will artificial intelligence get certified?
Desouky, E., Jallad, S., Bhardwa, J. M., Sharma, H., & KALSI, J. S. (2024) · Journal of Clinical Urology · doi:10.1177/20514158241262081 · Cited by 3
“5 In addition, generative AI shows promise in offering personalised learning experiences tailored to individual learner needs, with potential applications including the development of customised learning plans, materials and feedback mechanisms.”
Harnessing the Power of Language Models for Intelligent Digital Health Services
Garima, S., Morandé, S., & Shashank, S. (2024) · ITU Kaleidoscope Academic Conference (ITU K) · doi:10.23919/ituk62727.2024.10772761 · Cited by 3
“However, realizing the full potential of generative AI in digital health also presents significant research challenges [6].”
Alqahtani, A., Al-Garni, A. M., & Al-Mohaya, A. Y. (2024) · Research Square · doi:10.21203/rs.3.rs-4150369/v1 · Cited by 4
Wei, S., Wei, W., & Zou, G. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1832598 · Cited by 2
Enhancing Medical Education with AI-Generated Visual Art: Benefits and Challenges.
Negahdaripour, M., Keshavarzi, M. H., & Amini, M. (2025) · PubMed Central · doi:10.30476/ijms.2024.104198.3777 · Cited by 3
Dal, İ. (2025) · Journal of Health Sciences and Medicine · doi:10.32322/jhsm.1660603 · Cited by 2
Wang, Z., Zhang, Y., Gu, J., Chen, Y., Long, Y., Xia, X., Zhang, P., Zhu, C., Wang, Z., Dou, Q., et al. (2025) · Computer Assisted Surgery · doi:10.1080/24699322.2025.2536643 · Cited by 2
Panmei, B. (2025) · International Journal of Multicultural Education · doi:10.18251/ijme.v27i2.5165 · Cited by 10
Hamidi, C., Badiy, M., Gaou, S., Amounas, F., Azrour, M., Tribak, H., Alnajim, A. M., & Alabdulatif, A. (2025) · Journal of Advances in Information Technology · doi:10.12720/jait.16.10.1430-1441 · Cited by 5
“In education, RAG systems are particularly beneficial for addressing the limitations of traditional LLMs, which struggle to align generated content with standardized curricula and subject-specific knowledge [12].”
Hierarchical RAG enhances a pharmacogenomic AI assistant in guideline related queries
Jeon, Y., Youn, M. S., Kang, S., Park, J., Kim, E. S., Kim, J., & Kim, J. H. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.111323 · Cited by 4
Artificial Intelligence in Medicine With Emphasis on Orthopedic Practice
Bartkowski, J., Żerdka, J., Brasse, P., Piszka, M., Kwapień, E., Staszkiewicz, K., Kubicka, M., Staszkiewicz, K. K., & Czarnecki, F. (2025) · Cureus · doi:10.7759/cureus.98306 · Cited by 4
Actualidad en la educación médica con la inteligencia artificial generativa.
Berlanga, A. C., Giralt, J. A. S., & Santamaría, B. A. (2025) · Revista Española de Educación Médica · doi:10.6018/edumed.684461 · Cited by 6
Brzeziński, J., Watros, K., Mańczak, M., Owoc, J., Jeziorski, K., & Olszewski, R. (2025) · Journal of Public Health · doi:10.1007/s10389-025-02643-6 · Cited by 4
Çoşkun, Ü., & Tayşi, A. E. (2025) · Clinical and Experimental Health Sciences · doi:10.33808/clinexphealthsci.1736170 · Cited by 2
融合AI的医学英语教学模式构建研究:理论基础、模式特征与实践路径
Yang, M., & Liang, L. (2026) · 香港文理研究院学报 · doi:10.71290/jas01020008 · Cited by 2
Zilundu, P. L. M., Mazengenya, P., Jayaraj, K. N., & Zhou, L. (2026) · JMIR Medical Education · doi:10.2196/87418 · Cited by 4
“Recent scoping reviews and analyses emphasize that generative artificial intelligence (GenAI) adoption in formal medical curricula remains early and often unstructured [12-14].”
Liu, T., Pang, P., Luo, Y. T., McKay, D., Buchanan, G. R., & Chang, S. (2026) · JMIR Aging · doi:10.2196/88005 · Cited by 3
“The emergence of GenAI has opened new avenues for efficient health knowledge dissemination and precision personalized education [13].”
Frisone, F., Pupillo, C., Rossi, C., & Riva, G. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1603238 · Cited by 4
McGee, R. (2026) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.70386 · Cited by 2
Application of an iterative generative AI-augmented teaching model in medical immunology education
Niu, Y., Xu, J., Yang, W., Yuan, H., Liu, Z., Zhang, W., & Liu, L. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1788369 · Cited by 4
“While recent studies have explored generative AI in medical education, many focus on its role as an information repository or for generating basic quizzes (Karabacak et al., 2023; Preiksaitis and Rose, 2023).”
Educating health professionals in evidence-based practice in 2026
Innocenti, T., Guyatt, G. H., Cartabellotta, N., Glasziou, P., Ilić, D., & Nunan, D. (2026) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2025-114184 · Cited by 2
“These challenges affect what educators should prioritise 20 and underscore the importance of equipping learners to elicit and evaluate trustworthy, current evidence.”
Generative AI Research in Health Professions Education: A Scoping Review
Edara, S. R., Highum, B., Damania, R. C., Hakimzadeh, N., Awasthi, R., Mishra, S., Kashyap, R., Ramachandran, S. P., Bhattacharyya, A., Khare, A., et al. (2026) · Medical Science Educator · doi:10.1007/s40670-026-02810-8 · Cited by 2
Albadawi, E. A., Embaby, E. M., AlQumaizi, K. I., Elsaid, M. A. E., Dawood, A. F., & Eldesoqui, M. B. (2026) · Clinical Anatomy · doi:10.1002/ca.70177 · Cited by 3
Morbitzer, K. A., McLaughlin, J. E., Fuller, K. A., Li, X., Noel, Z. R., Rodgers, P. T., Ruby, C. M., Stepanovic, M., & Kane‐Gill, S. L. (2026) · JACCP JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · doi:10.1002/jac5.70257 · Cited by 3
Tutorial: guidance on the use of large language models for medical research
Jin, Q., Wan, N., Leaman, R., Tian, S., Wang, Z., Yang, Y., Wang, Z., Xiong, G., Lai, P.-T., Zhu, Q. L., et al. (2026) · Nature Protocols · doi:10.1038/s41596-026-01408-z · Cited by 16
Park, M. S., Jeon, J. H., Hur, J., Yoo, H.-R., & Lee, J.-Y. (2025) · 대한한의학회지 · doi:10.13048/jkm.25007 · Cited by 2
Bajwa, M., LeMoine, J. E., Morris, M., & Bajwa, N. (2025) · Cureus Journal of Computer Science. · doi:10.7759/s44389-025-04125-y · Cited by 2
Sehmi, A., Sarfraz, I., & Hussain, M. (2025) · Journal of Advanced Academics · doi:10.1177/1932202x251365312 · Cited by 5
Using of AI as standardized patients in Pediatric Surgeon Training Program: A tentative explorationPreprint
Shen, W., Liang, X., & Xiang, X. (2024) · Research Square · doi:10.21203/rs.3.rs-4135064/v1 · Cited by 2
Lin, Y., Wang, Y., Deng, Y., Xu, D., & Wang, M. (2024) · doi:10.2196/preprints.60412 · Cited by 1
Majumder, M. A. A., & Haque, M. (2025) · Advances in Human Biology · doi:10.4103/aihb.aihb_84_25 · Cited by 3
Árvai, N., Meskó, B., & Katonai, G. (2025) · doi:10.2196/preprints.85373 · Cited by 3
Artificial intelligence in health professions education: A state-of-the-art meta-reviewPreprint
Hossain, M. M., Hossain, P., Roy, T. J., Das, J., Tasnim, S., Ma, P., & Liaw, W. R. (2025) · medRxiv · doi:10.1101/2025.10.20.25338371 · Cited by 3
The Hidden Preceptor: How AI Is Already Teaching Our Learners
Heslin, S. M. (2026) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205261449662 · Cited by 2
Ndacyayisenga, J. C. Y., Kidega, C., & Aciro Can, L. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09303-7 · Cited by 1
“There are currently very serious concerns related to the potential for academic dishonesty, the mis-use of AI in assignments, bias in the data upon which AI is trained, and the reliability of the AI-generated outputs, including hallucinations of false or inaccurate information [4, 6, 7].”
Yadav, S. (2024) · Advances in business strategy and competitive advantage book series · doi:10.4018/979-8-3693-9586-8.ch016 · Cited by 3
Usage of Gen AI in Employee Training and Development: A Human Resources Development Perspective
Bapat, O. J., Prakash, C., & Paliwal, M. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-7693-5.ch004 · Cited by 3
Recent Trends in Medical Education to Sustain an Effective Practice - A Systematic Review
Leela, S. P. J. K., Zehra, A., & Mukthar, A. S. (2024) · International Journal of Health & Allied Sciences · doi:10.55691/2278-344x.1107 · Cited by 2
Radó, N., Németh, O., & Békási, S. (2025) · JMIR Formative Research · doi:10.2196/68316 · Cited by 2
“…as writing discharge summaries [44], medical notes based on transcripts of physician-patient encounters, summaries of laboratory test results [45], medical education [46], medical research [47], providing a communication platform for patients, and facilitating health information dissemination [47].”
Opportunities and Challenges of AI-Driven Transformation in Medical Education
Hoti, F., Mouloudj, K., Kabashi, D., Terziqi, H. A. B., & Ukehaxhaj, A. D. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-1519-5.ch003 · Cited by 1
Sebastián, M. G. D. B., Díaz-Marcos, L., AGUADO-TEVAR, O., & de Vicente, A. (2025) · Revista Latina de Comunicación Social · doi:10.4185/rlcs-2025-2466 · Cited by 8
“Sin embargo, persisten desafíos éticos, como la privacidad de los datos y el riesgo de sesgos, además de brechas digitales (Ning et al. , 2024; Preiksaitis y Rose, 2023).”
The use of artificial intelligence in paediatric postgraduate medical education: A scoping review
Nadarajah, A., Malekzadeh, G., & Ratnapalan, S. (2025) · Paediatrics & Child Health · doi:10.1093/pch/pxaf054 · Cited by 2
Generative AI literacy and lifelong learning: A literature overview
Abubakari, M. S. (2025) · Forum for education studies. · doi:10.59400/fes2621 · Cited by 6
Salvi, P. S., Healy, J. M., Merianos, D. J., & Cowles, R. A. (2025) · Journal of Surgical Research · doi:10.1016/j.jss.2025.07.022 · Cited by 1
Kuribayashi, T., Chinen, T., Nagai, S., Shigeta, K., Fujirai, Y., & Uda, H. (2025) · Cureus · doi:10.7759/cureus.91443 · Cited by 2
“ChatGPT is applicable in research, clinical practice, and medical education [2,3].”
The Role of Artificial Intelligence in Scientific Writing: A Higher Education Review
Almryad, A., & Musa, H. (2025) · Academic Platform Journal of Engineering and Smart Systems · doi:10.21541/apjess.1676506 · Cited by 6
McGaughey, S., Wackett, J., & Silbermann, E. (2025) · AEM Education and Training · doi:10.1002/aet2.70114 · Cited by 1
de Sousa, I. F., de Sousa, V. F., & Júnior, A. R. D. S. (2026) · Research Society and Development · doi:10.33448/rsd-v15i1.50071 · Cited by 2
Rios-García, W., Silva-Jiménez, S., Galvez-Rodriguez, E. B., Alberca-Naira, Y., Via-y-Rada-Torres, A. D., & Rios-Garcia, A. A. (2026) · Journal of Medical Systems · doi:10.1007/s10916-025-02334-5 · Cited by 2
马兴铭 (2026) · Vocational Education · doi:10.12677/ve.2026.151043 · Cited by 1
Enhancing dental clinical education through AI: insights into post-clinical summaries
Luo, F., Li, J., Zhang, T., Huang, B., Jiang, L., Hua, C., & Hu, P. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08774-y · Cited by 2
“Some hesitation among students and instructors to fully embrace AI can likely be attributed to a lack of familiarity with the technology, concerns about the reliability of AI-generated feedback, and resistance to change from traditional educational methodologies [26, 27].”
The new wave of generative artificial intelligence in medical education
Jung, E., & Samuel, A. (2026) · Korean journal of medical education · doi:10.3946/kjme.2025.139 · Cited by 2
“Research has focused on the ability of LLMs to generate standardized exam questions, assess student work, and also assess medical school curricula [6,9,10].”
Zhao, L., Han, Q., Li, P., Dai, H., & Ju, X. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08947-9 · Cited by 2
“This aligns with findings from other studies indicating that while generative AI tools can enhance performance in tasks like writing and diagnosis simulation, skepticism remains, particularly around over-reliance and the erosion of critical thinking [39].”
Mohamad, A. H. H., Ab-Rahim, R., Omoregie, A. I., & Hisham, M. H. M. (2026) · Multidisciplinary Reviews · doi:10.31893/multirev.2026488 · Cited by 5
Ma, X., Liu, X., & Sun, H. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1813108 · Cited by 3
Ma, S., Lu, Y., Wu, H., Zhou, Q., Huang, H., & Song, J. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09318-0 · Cited by 1
AI-Assisted Formative Assessment in Clinical Education: From Algorithms to Agency
Nguyen, Q. T., Ha, T. M., & Mai, T. (2026) · JMIR Medical Education · doi:10.2196/93710 · Cited by 4
“This preparation is particularly important for LLMs because they can produce fluent and confident responses even when outputs are incomplete, inaccurate, or unsupported [4,11].”
InfluentialPeng, Y., Ma, M., Yang, Y., Wu, J., & Peng, Y. (2026) · Anatomical Sciences Education · doi:10.1002/ase.70297 · Cited by 1
“14 In anatomy education, ChatGPT has been described as a potentially useful complementary tool, but limitations in accuracy, completeness, and educator replacement have also been noted.”
Bardakçı, T., Barış, M., Dabbagh, H., Savulescu, J., Saraçoğlu, M., & Razai, M. S. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-111721 · Cited by 2
“…reflects rapid advances in AI technologies, the acceleration of digital learning following the COVID-19 pandemic 34 and the increasing use of generative AI tools in recent years, 26 27 alongside the growing prominence of ethical concerns such as algorithmic bias, data privacy and accountability.”
Liu, W., Cao, L., Chen, X. W., & Pan, H. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09918-w · Cited by 1
“Medicine requires extreme precision, which conflicts with the known “hallucination” issues in AI-generated content and the field’s low tolerance for error [35].”
Luo, Y., Ge, T., Luo, X., Lin, Z., Li, M., & Ke, B. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1868565 · Cited by 1
Che, X., & Liu, Y. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1910543 · Cited by 4
Diagnostic Dilemma: ChatGPT Can’t Tell You What You Don’t Already Know
Preiksaitis, C. M., & Rose, C. C. (2024) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2023.09.024 · Cited by 1
Self-citationShaping Tomorrow's Minds: The Future of Education in an AI (Artificial Intelligence)-Augmented World
Chaudhry, M., & Goswami, N. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-2440-0.ch022 · Cited by 3
A Narrative Review of Utilizing Generative Artificial Intelligence in Classroom Instructions
Shi, Y., Huang, W. J., & Sang, Y. (2024) · International Conference on Educational Technology (ICET) · doi:10.1109/icet62460.2024.10868958 · Cited by 1
Bibliometric Top Ten Healthcare-Related ChatGPT Publications in the First ChatGPT AnniversaryPreprint
Sallam, M. (2024) · Research Square · doi:10.21203/rs.3.rs-4241528/v1 · Cited by 1
Haidar, R., & Tassis, A. (2025) · Research Square · doi:10.21203/rs.3.rs-7014667/v1
Introduction to Generative Artificial Intelligence
Ramesh, C. R., Muralidhar, P., Kumar, K. M. V. M., Srinu, B., Vikram, G. R., & Nayak, R. (2026) · Wiley eBooks · doi:10.1002/9781394305698.ch1 · Cited by 1
Taheri, R., Foroughi, M., & Parang, K. (2026) · Research Square · doi:10.21203/rs.3.rs-9819693/v1 · Cited by 1
AI-powered chatbots reshaping dentistry: Opportunities, challenges, and future directions
Pawar, V. V., & Vanjare, C. (2024) · Oral Oncology Reports · doi:10.1016/j.oor.2024.100156
García-Zamora, S., López-Santi, R., Liprandi, Á. S., et al. (2024) · Archivos Peruanos de Cardiología y Cirugía Cardiovascular · doi:10.47487/apcyccv.v5i1.341
Obstetrician-Gynecologist Hospitalists as Educators
Hill, S., Carranco, S., Morales, A. L., & Rayburn, W. F. (2024) · Obstetrics and Gynecology Clinics of North America · doi:10.1016/j.ogc.2024.06.001
Radó, N., Németh, O., & Békási, S. (2024) · doi:10.2196/preprints.68316
Hlede, V., Valanci, S., D’Antuono, G., Dow, H., Wiggins, R. H., Dorman, T., & O'Beirne, R. (2024) · doi:10.2196/preprints.69156
Arjmand, Kolivand, P., Namdar, P., & RamezanianLangeroodi, M. (2024) · Research Square · doi:10.21203/rs.3.rs-5466390/v1 · Cited by 1
Mudenda, S., Mufwambi, W., Mwale, R. S., Kathewera, B. S., & Lubanga, A. F. (2024) · Research Square · doi:10.21203/rs.3.rs-5648361/v1
Embracing Large Language Models for Adult Life Support Learning
Patel, S., & Patel, R. B. (2024) · Cureus · doi:10.7759/cureus.75961
“A systematic review showed the impressive performance of generative AI models on standardised tests [17], including in the United States Medical Licensing Examination [18] and in specialised tests ranging from cardiology [19] to biochemistry [20] and general surgery [21].”
Marco, E. D., Virga, M., Torresi, M., Catellani, S., Pingani, L., & Ferrazzi, G. (2024) · RIVISTA SPERIMENTALE DI FRENIATRIA · doi:10.3280/rsf2024-003004
Necessity of artificial intelligence in medical education and teaching
Wang, X., & Chen, Z. (2024) · International Symposium on Artificial Intelligence for Education (ISAIE) · doi:10.1145/3700297.3700325 · Cited by 1
Overview of AI technologies and their impact on healthcare
Khan, S. M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-33584-6.00003-7 · Cited by 1
Rheumatology Medical Education Year in Review, 2023–2024
Barr, A. C., & Leverenz, D. L. (2025) · Arthritis Care & Research · doi:10.1002/acr.25517
Scope Review of the Use of Generative Artificial Intelligence in Nursing Education
陈, 冲. (2025) · Nursing Science · doi:10.12677/ns.2025.143046
Zhang, D., Zhao, X., & Zhou, G. (2024) · International Conference on Information Technology in Medicine and Education · doi:10.1109/itme63426.2024.00149 · Cited by 2
Huang, R., Xu, E., Huang, L., Pu, Y., & Li, J. (2025) · Research Square · doi:10.21203/rs.3.rs-6040109/v1
Pasarica, M., Plochocki, J. H., Dvorak, R. D., & Rodríguez, N. (2025) · Medical Science Educator · doi:10.1007/s40670-025-02398-5
“Recent advancements in medical education offer opportunities to streamline this process by using artificial intelligence (AI) [1] to perform what was described as “sentiment analysis” [2].”
Metadata
- Authors
- Preiksaitis, C., & Rose, C.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Preiksaitis, Carl
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2023-10-20
- Volume
- 9
- Pages
- e48785
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC10625095
- OpenAlex
- W4387144847
- Cited by
- 552
- References
- 68
- Citations by year
- 2026: 238 · 2025: 204 · 2024: 104 · 2023: 5
- FWCI
- 5.54
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- generative AI, medical education, ChatGPT, academic integrity, self-directed learning, simulation-based training, writing support, critical evaluation of AI, assessment methods, human-AI interaction, AI competencies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-15, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-15 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.