The DOI matches its Crossref record; 123 of the 123 references it cites were found in a registry or an index.
Generative Artificial Intelligence: Implications for Biomedical and Health Professions Education
Open accessAbstract
Generative artificial intelligence (AI) has had a profound impact on biomedicine and health, both in professional work and in education. Based on large language models (LLMs), generative AI has been found to perform as well as humans in simulated situations taking medical board exams, answering clinical questions, solving clinical cases, applying clinical reasoning, and summarizing information. Generative AI is also being used widely in education, performing well in academic courses and their assessments. This review summarizes the successes of LLMs and highlights some of their challenges in the context of education, most notably aspects that may undermine the acquisition of knowledge and skills for professional work. It then provides recommendations for best practices to overcome the shortcomings of LLM use in education. Although there are challenges for the use of generative AI in education, all students and faculty, in biomedicine and health and beyond, must have understanding of it and be competent in its use.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The advent and adoption of generative artificial intelligence tools, particularly large-language model-driven chatbots and image generation applications, are revolutionizing the way instructors create activities and even changing the purpose of education (31–33).”
From Global Health Trade Summit: an AI-enhanced simulation of international trade and global health for undergraduate public health education (2025) · cites this paper as [33]
Citations
Cites
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Experimental evidence on the productivity effects of generative artificial intelligence
Noy, S., & Zhang, W. (2023) · Science · doi:10.1126/science.adh2586 · Cited by 2,150
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526
Leakage and the reproducibility crisis in machine-learning-based science
Kapoor, S., & Narayanan, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100804 · Cited by 1,387
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day
Li, C., Wong, C., Zhang, S., Usuyama, N., Liu, H., Yang, J., Naumann, T., Poon, H., & Gao, J. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1240 · Cited by 986
The Clinician and Dataset Shift in Artificial Intelligence
Finlayson, S. G., Subbaswamy, A., Singh, K., Bowers, J., Kupke, A., Zittrain, J., Kohane, I. S., & Saria, S. (2021) · New England Journal of Medicine · doi:10.1056/nejmc2104626 · Cited by 855
Can AI-Generated Text be Reliably Detected?
Sadasivan, V. S., Kumar, A., Balasubramanian, S., Wang, W., & Feizi, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11156 · Cited by 810
Evaluation and mitigation of the limitations of large language models in clinical decision-making
Hager, P., Jungmann, F., Holland, R., Bhagat, K., Hubrecht, I., Knauer, M., Vielhauer, J., Makowski, M., Braren, R., Kaissis, G., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03097-1 · Cited by 798
Research works printed but not linked: 36
- 2024, Encyclopedia Britannica
- 2023, Generative AI versus predictive AI: What is the difference?, Analytics Vidhya
- 1990, In memoriam: Arthur Samuel: pioneer in machine learning, AI Mag, 11, 10
- 2022, A Hands-On Introduction to Machine Learning
- 2022, Illustrating reinforcement learning from human feedback (RLHF), Hugging Face.
- 2024, Generative AI in Action. Shelter Island
- 2023, 56% of college students have used AI on assignments or exams, BestColleges
- 2024, AI chatbots in schools: findings from a poll of K-12 teachers, students, parents, and college undergraduates
- 2024, The rapid adoption of generative AI
- 2024, KFF health misinformation tracking poll: artificial intelligence and health information, KFF
- 2024, Advancing medical AI with Med-Gemini, Google Research
- 2024, Advances in run-time strategies in foundation models, Microsoft Research Blog
- 2023, Evaluation of GPT-4 for 10-year cardiovascular risk prediction: insights from the UK Biobank and KoGES data
- 2023, Lawyering in the age of artificial intelligence
- 2023, Is GPT-4 a good data analyst?, 9496
- 2024, Financial statement analysis with large language models
- 2024, Scaling core earnings measurement with large language models
- 2024, The effects of generative AI on high skilled work: evidence from three field experiments with software developers
- 2023, Navigating the jagged technological frontier: field experimental evidence of the effects of AI on knowledge worker productivity and quality
- 2023, The Dictionary.com word of the year is hallucinate, Dictionary.com
- 2024, Translational AI: a necessity and opportunity for biomedical informatics and data science, NLM Musings from the Mezzanine
- 2024, Some doctors are using ChatGPT to assist with clinical decisions. Is it safe?, Fierce Healthcare
- 2023, ChatGPT is going to change education, not destroy it, MIT Technology Review
- 2024, Professors ask: Are we just grading robots?, The Chronicle of Higher Education
- 2023, Physician and medical student competence in AI must include broader competence in clinical informatics, Informatics Professor
- 2023, Guide for healthcare prompt engineering with ChatGPT, LinkedIn
- 2024, AI meets the classroom: When does ChatGPT harm learning?
- 2024, Generative AI can harm learning
- 2023, We use ChatGPT in medical practice – and you can too, MedPageToday
- Assigning AI: seven approaches for students, with prompts
- 2024, Co-Intelligence: Living and Working with AI
- 2024, Prompt library, More Useful Things: AI Resources
- 2024, How to use AI to create role-play scenarios for your students, Harvard Business Publishing Education
- 2024, Teaching with AI: A Practical Guide to a New Era of Human Learning
- 2024, Getting in sync with students about AI, The Chronicle of Higher Education
- 2024, How higher ed can adapt to the challenges of AI, The Chronicle of Higher Education
Cited by
Assessing ChatGPT’s capability as a new age standardized patient: qualitative study
Cross, J., Kayalackakom, T., Robinson, R. E., Vaughans, A., Sebastian, R., Hood, R., Lewis, C., Devaraju, S., Honnavar, P., Naik, S., et al. (2025) · JMIR Medical Education · doi:10.2196/63353 · Cited by 33
LLM-Based Generative AI in Medicine: Analysis of Current Research Trends With BERTopic
Kılınç, M., Gürcan, F., & Soylu, A. (2025) · IEEE Access · doi:10.1109/access.2025.3606335 · Cited by 21
ChatGPT as a Virtual Peer: Enhancing Critical Thinking in Flipped Veterinary Anatomy Education
Martín‐Alguacil, N., Avedillo, L., Mota-Blanco, R. A., Marañón-Almendros, M., & Gallego-Agúndez, M. (2025) · International Medical Education · doi:10.3390/ime4030034 · Cited by 12
Patil, U., Terada, M., & Nelson-Hurwitz, D. C. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1681199 · Cited by 3
Ng, O., Lim, S. Y., Goh, N., Ho, B., Cleland, J., Samuel, A., & Han, S. P. (2026) · Medical Teacher · doi:10.1080/0142159x.2026.2667280 · Cited by 5
Metadata
- Authors
- Hersh, W.
- Affiliations
- Oregon Health & Science University (US)
- Corresponding author
- Hersh, William
- ORCID
- Hersh, William
- Venue
- Annual Review of Biomedical Data Science
- Publisher
- Annual Reviews
- Published
- 2025-08-11
- Volume
- 8
- Issue
- 1
- Pages
- 355-380
- ISSN
- 2574-3414 (ISSN-L)
- OpenAlex
- W4409285340
- Cited by
- 28
- References
- 116
- Citations by year
- 2026: 18 · 2025: 10
- FWCI
- 1.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Annual Review of Biomedical Data Science (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- generative AI, large language models, biomedical education, health professions education, clinical reasoning, clinical case solving, academic assessment, knowledge acquisition
- MeSH terms
- Generative Artificial Intelligence, Artificial Intelligence, Education, Medical, Health Occupations, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Generative Artificial Intelligence: Implications for Biomedical and Health Professions Education. https://app.cochat.ai/papers/10.1146/annurev-biodatasci-103123-094756
- The paper
- Hersh, W. (2025). Generative Artificial Intelligence: Implications for Biomedical and Health Professions Education. Annual Review of Biomedical Data Science. https://doi.org/10.1146/annurev-biodatasci-103123-094756
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.