Incorporating ChatGPT in Medical Informatics Education: Mixed Methods Study on Student Perceptions and Experiential Integration Proposals
Open accessPublished version of a preprint
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Background: The integration of artificial intelligence (AI) technologies, such as ChatGPT, in the educational landscape has the potential to enhance the learning experience of medical informatics students and prepare them for using AI in professional settings. The incorporation of AI in classes aims to develop critical thinking by encouraging students to interact with ChatGPT and critically analyze the responses generated by the chatbot. This approach also helps students develop important skills in the field of biomedical and health informatics to enhance their interaction with AI tools. Objective: The aim of the study is to explore the perceptions of students regarding the use of ChatGPT as a learning tool in their educational context and provide professors with examples of prompts for incorporating ChatGPT into their teaching and learning activities, thereby enhancing the educational experience for students in medical informatics courses. Methods: This study used a mixed methods approach to gain insights from students regarding the use of ChatGPT in education. To accomplish this, a structured questionnaire was applied to evaluate students’ familiarity with ChatGPT, gauge their perceptions of its use, and understand their attitudes toward its use in academic and learning tasks. Learning outcomes of 2 courses were analyzed to propose ChatGPT’s incorporation in master’s programs in medicine and medical informatics. Results: The majority of students expressed satisfaction with the use of ChatGPT in education, finding it beneficial for various purposes, including generating academic content, brainstorming ideas, and rewriting text. While some participants raised concerns about potential biases and the need for informed use, the overall perception was positive. Additionally, the study proposed integrating ChatGPT into 2 specific courses in the master’s programs in medicine and medical informatics. The incorporation of ChatGPT was envisioned to enhance student learning experiences and assist in project planning, programming code generation, examination preparation, workflow exploration, and technical interview preparation, thus advancing medical informatics education. In medical teaching, it will be used as an assistant for simplifying the explanation of concepts and solving complex problems, as well as for generating clinical narratives and patient simulators. Conclusions: The study’s valuable insights into medical faculty students’ perspectives and integration proposals for ChatGPT serve as an informative guide for professors aiming to enhance medical informatics education. The research delves into the potential of ChatGPT, emphasizes the necessity of collaboration in academic environments, identifies subject areas with discernible benefits, and underscores its transformative role in fostering innovative and engaging learning experiences. The envisaged proposals hold promise in empowering future health care professionals to work in the rapidly evolving era of digital health care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These studies involved faculty and mostly medical students, but also other health-related students from countries worldwide, including Europe, the Middle East, northern and sub-Saharan Africa, North America, Asia, Australia, and New Zealand [24–29].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [27]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Eight studies examined the knowledge, attitudes, and skills of medical students and educators regarding LLMs, specifically ChatGPT [24, 26–29, 79–81]. Students generally expressed a more positive attitude toward LLMs than practicing physicians, showing optimism about their potential to support learners and educators [81]. Those who were more knowledgeable about LLMs tended to hold a more positive”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [27]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The content produced by GAI maintains consistency in language and includes appropriate academic terminology and logical structure, helping students present themselves more professionally in their academic writing [55].”
From Applications, Challenges, and Prospects of Generative Artificial Intelligence Empowering Medical Education: Scoping Review (2025) · cites this paper as [55]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · cited 1×
“…AI into medical programs to prepare students for their future use of such tools in professional contexts [5,8,28,29], the implementation of ChatGPT has emerged as a potentially transformative force in medical education [30,31], offering support to students in their learning journey [30,32].”
BackgroundKung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126 · cited 3×
“The integration of these artificial intelligence (AI) technologies, including ChatGPT, into the educational environment has the potential to improve the student learning experience [1-6].”
BackgroundGilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
Dave, T., Athaluri, S. A., & Singh, S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1169595 · Cited by 1,204
Chan, K. S., & Zary, N. (2019) · JMIR Medical Education · doi:10.2196/13930 · Cited by 877 · cited 1×
“Additionally, existing references that offer a plethora of ideas for ChatGPT’s incorporation into medical education were also considered, ranging from personalized learning opportunities [33,34] to problem-based learning and clinical problem-solving approaches [35].”
BackgroundExplainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863 · cited 1×
“It is crucial for faculty, professors, and students to be cognizant of both the potential and limitations of ChatGPT while also addressing ethical concerns [1,4,7,23,24] and ensuring accessibility in its implementation within academic settings.”
BackgroundChatGPT in higher education: considerations for academic integrity and student learning
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.17 · Cited by 853 · cited 5×
“Encouraging the integration of ChatGPT in education requires the formulation of policies that promote best practices, nurturing students’critical thinking and equipping them with the necessary skills to effectively use AI tools [4,7,25].”
BackgroundInfluentialEysenbach, G. (2023) · JMIR Medical Education · doi:10.2196/46885 · Cited by 840 · cited 1×
“It is essential to be mindful that AI systems may engage in “hallucination,” a phenomenon where they fabricate facts and produce confident-sounding statements and seemingly legitimate citations that are, in reality, false, and not necessarily supported by their training data [2,36,37].”
BackgroundLarge Language Models in Medical Education: Opportunities, Challenges, and Future Directions
Abd-alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alabed Alrazak, S., & Sheikh, J. (2023) · JMIR Medical Education · doi:10.2196/48291 · Cited by 722
Introducing artificial intelligence training in medical education
Paranjape, K., Schinkel, M., Nannan Panday, R., Car, J., & Nanayakkara, P. (2019) · JMIR Medical Education · doi:10.2196/16048 · Cited by 634
ChatGPT - Reshaping medical education and clinical management
Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.39.2.7653 · Cited by 628
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585
Sapci, A. H., & Sapci, H. A. (2020) · JMIR Medical Education · doi:10.2196/19285 · Cited by 377 · cited 4×
“For students pursuing computer science, the focus lies on developing programming languages tailored to address complex medical challenges [9].”
BackgroundMethodInfluentialAmmenwerth, E., Demiris, G., Hasman, A., Haux, R., Hersh, W., Hovenga, E., Lun, K. C., Marin, H., Martin-Sanchez, F., Wright, G., et al. (2010) · Methods of Information in Medicine · doi:10.3414/me5119 · Cited by 319
Ethical use of Artificial Intelligence in Health Professions Education: AMEE Guide No. 158
Masters, K. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2186203 · Cited by 302
Kulikowski, C. A., Shortliffe, E. H., Currie, L. M., Elkin, P. L., Hunter, L. E., Johnson, T. R., Kalet, I. J., Lenert, L. A., Musen, M. A., Ozbolt, J. G., et al. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001053 · Cited by 243
What do medical students actually need to know about artificial intelligence?
McCoy, L. G., Nagaraj, S., Morgado, F., Harish, V., Das, S., & Celi, L. A. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0294-7 · Cited by 240 · cited 2×
“Building on the proposal to integrate AI into medical programs to prepare students for their future use of such tools in professional contexts [5,8,28,29], the implementation of ChatGPT has emerged as a potentially transformative force in medical education [30,31], offering support to students in…”
BackgroundAn exploratory survey about using ChatGPT in education, healthcare, and research
Hosseini, M., Gao, C. A., Liebovitz, D. M., Carvalho, A. M., Ahmad, F. S., Luo, Y., MacDonald, N., Holmes, K. L., & Kho, A. (2023) · PLOS ONE · doi:10.1371/journal.pone.0292216 · Cited by 238
An exploratory survey about using ChatGPT in education, healthcare, and research
Hosseini, M., Gao, C. A., Liebovitz, D. M., Carvalho, A. M., Ahmad, F. S., Luo, Y., MacDonald, N., Holmes, K. L., & Kho, A. (2023) · doi:10.1101/2023.03.31.23287979 · Cited by 238
The Advent of Generative Language Models in Medical Education
Karabacak, M., Ozkara, B. B., Margetis, K., Wintermark, M., & Bisdas, S. (2023) · JMIR Medical Education · doi:10.2196/48163 · Cited by 208 · cited 1×
“The integration of these artificial intelligence (AI) technologies, including ChatGPT, into the educational environment has the potential to improve the student learning experience [1-6].”
BackgroundWhy and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · Royal Society Open Science · doi:10.1098/rsos.230658 · Cited by 202
Why and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · doi:10.31234/osf.io/sdx3j · Cited by 202
Hübner, U., Shaw, T., Thye, J., Egbert, N., Marin, H. F., Chang, P., O’Connor, S., Day, K., Honey, M. L. L., Blake, R., et al. (2018) · Methods of Information in Medicine · doi:10.3414/me17-01-0155 · Cited by 177
Early applications of ChatGPT in medical practice, education and research
Sedaghat, S. (2023) · Clinical Medicine · doi:10.7861/clinmed.2023-0078 · Cited by 163
Practical Applications of ChatGPT in Undergraduate Medical Education
Tsang, R. (2023) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205231178449 · Cited by 104
Bichel-Findlay, J., Koch, S., Mantas, J., Abdul, S. S., Al-Shorbaji, N., Ammenwerth, E., Baum, A., Borycki, E. M., Demiris, G., Hasman, A., et al. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104908 · Cited by 97
Empowering beginners in bioinformatics with ChatGPT
Shue, E., Liu, L., Li, B., Feng, Z., Li, X., & Hu, G. (2023) · Quantitative Biology · doi:10.15302/j-qb-023-0327 · Cited by 75
Impact of ChatGPT on Interdisciplinary Nursing Education and Research
Miao, H., & Ahn, H. (2023) · Asian/Pacific Island Nursing Journal · doi:10.2196/48136 · Cited by 74
ChatGPT and the future of medical education
Feng, S., & Shen, Y. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005242 · Cited by 61
Sapci, A. H., & Sapci, H. A. (2020) · JMIR Medical Informatics · doi:10.2196/15748 · Cited by 47
Will ChatGPT Match to Your Program?
Zumsteg, J. M., & Junn, C. (2023) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000002238 · Cited by 35
Biomedical and Health Informatics Education – the IMIA Years
Mantas, J. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-032 · Cited by 26
IMIA Accreditation of Health Informatics Programs
Hasman, A., & Mantas, J. (2013) · Healthcare Informatics Research · doi:10.4258/hir.2013.19.3.154 · Cited by 25
Biomedical Informatics – A Confluence of Disciplines?
Ammenwerth, E., Dickhaus, H., Knaup, P., Lovis, C., Mantas, J., Maojo, V., Martin-Sanchez, F. J., Musen, M. A., Patel, V. L., Surján, G., et al. (2011) · Methods of Information in Medicine · doi:10.3414/me11-06-0003 · Cited by 21
Jaspers, M., Mantas, J., Borycki, E. M., & Hasman, A. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-011 · Cited by 19
Assessment of the IMIA Educational Accreditation Process
Mantas, J., Hasman, A., & Shortliffe, E. H. (2013) · Studies in health technology and informatics · doi:10.3233/978-1-61499-289-9-702 · Cited by 12
How may ChatGPT impact medical teaching?
Júnior, G. H. Y., & Vitorino, L. M. (2023) · Revista da Associação Médica Brasileira · doi:10.1590/1806-9282.20230282 · Cited by 10
Kulikowski, C. A. (2022) · Studies in health technology and informatics · doi:10.3233/shti220936 · Cited by 6
Research works printed but not linked: 1
- Mantas, J, 2013, Stud Health Technol Inform, 192, 702
Cited by
Vrdoljak, J., Boban, Z., Vilović, M., Kumrić, M., & Božić, J. (2025) · Healthcare · doi:10.3390/healthcare13060603 · Cited by 163
Exploring student and teacher perceptions of ChatGPT use in higher education: A Q-Methodology study
Espartinez, A. S. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100264 · Cited by 138
Abouammoh, N., Alhasan, K., Aljamaan, F., Raina, R., Malki, K. H., Altamimi, I., Muaygil, R., Wahabi, H., Jamal, A., Alhaboob, A., et al. (2025) · JMIR Medical Education · doi:10.2196/63400 · Cited by 47
Artificial Intelligence in Medical Education: Transforming Learning and Practice
Sriram, A., Ramachandran, K., & Krishnamoorthy, S. (2025) · Cureus · doi:10.7759/cureus.80852 · Cited by 168
Luo, X., Tham, Y. C., Giuffrè, M., Ranisch, R., Daher, M., Lam, K., Eriksen, A. V., Hsu, C.-W., Ozaki, A., Moraes, F. Y. D., et al. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2025-113825 · Cited by 97
Metadata
- Authors
- Magalhães Araujo, S., & Cruz-Correia, R.
- Affiliations
- Universidade do Porto (PT)
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2024-03-20
- Volume
- 10
- Pages
- e51151
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC10993110
- OpenAlex
- W4388557469
- Cited by
- 72
- References
- 36
- Citations by year
- 2026: 25 · 2025: 31 · 2024: 16
- FWCI
- 2.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- ChatGPT, medical informatics education, student perceptions, artificial intelligence in education, prompt engineering, critical thinking, AI-generated content, health informatics, code generation, patient simulator, digital health
- MeSH terms
- Artificial Intelligence, Educational Status, Faculty, Medical, Humans, Medical Informatics, Students, Medical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
