Perceptions and Earliest Experiences of Medical Students and Faculty With ChatGPT in Medical Education: Qualitative Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Background: With the rapid development of artificial intelligence technologies, there is a growing interest in the potential use of artificial intelligence–based tools like ChatGPT in medical education. However, there is limited research on the initial perceptions and experiences of faculty and students with ChatGPT, particularly in Saudi Arabia. Objective: This study aimed to explore the earliest knowledge, perceived benefits, concerns, and limitations of using ChatGPT in medical education among faculty and students at a leading Saudi Arabian university. Methods: A qualitative exploratory study was conducted in April 2023, involving focused meetings with medical faculty and students with varying levels of ChatGPT experience. A thematic analysis was used to identify key themes and subthemes emerging from the discussions. Results: Participants demonstrated good knowledge of ChatGPT and its functions. The main themes were perceptions of ChatGPT use, potential benefits, and concerns about ChatGPT in research and medical education. The perceived benefits included collecting and summarizing information and saving time and effort. However, concerns and limitations centered around the potential lack of critical thinking in the information provided, the ambiguity of references, limitations of access, trust in the output of ChatGPT, and ethical concerns. Conclusions: This study provides valuable insights into the perceptions and experiences of medical faculty and students regarding the use of newly introduced large language models like ChatGPT in medical education. While the benefits of ChatGPT were recognized, participants also expressed concerns and limitations requiring further studies for effective integration into medical education, exploring the impact of ChatGPT on learning outcomes, student and faculty satisfaction, and the development of critical thinking skills.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative data analysis for applied policy research
(2002) · Analyzing Qualitative Data · doi:10.4324/9780203413081-14 · Cited by 4,964 · cited 2×
“Themes were identified and refined through an iterative process of coding, reviewing, and discussing the data among the research team until a consensus was reached [24].”
Qualitative data analysis for applied policy research
Ritchie, J., & Spencer, L. (2010) · Analyzing qualitative data · doi:10.4324/9780203413081_chapter_9 · Cited by 4,800
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540 · cited 1×
“The participants’concerns about ChatGPT output also stemmed partly from the observed phenomenon of references’ hallucinations, which raised serious concerns about its reliability and validity [32-34].”
Dave, T., Athaluri, S. A., & Singh, S. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1169595 · Cited by 1,204
ChatGPT - Reshaping medical education and clinical management
Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.39.2.7653 · Cited by 628
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585
Exploring Students’ Perceptions of ChatGPT: Thematic Analysis and Follow-Up Survey
Shoufan, A. (2023) · IEEE Access · doi:10.1109/access.2023.3268224 · Cited by 499
Han, E.-R., Yeo, S., Kim, M.-J., Lee, Y.-H., Park, K.-H., & Roh, H. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1891-5 · Cited by 393 · cited 2×
“All these changes of AI integration into the medical practice need to be accompanied by evolution in the medical teaching and training curricula [8,9], facing significant interest among educators and researchers recently on AI’s rapid involvement in medical education [10-13].”
Shahsavar, Y., & Choudhury, A. (2023) · JMIR Human Factors · doi:10.2196/47564 · Cited by 341 · cited 1×
“Additionally, since the study’s focus was on understanding the perception of faculty and students, the perspectives of other stakeholders, such as administrators and policy makers, were not captured, and this could be explored in future research [51-53].”
Artificial Intelligence in Undergraduate Medical Education: A Scoping Review
Lee, J., Wu, A. S., Li, D., & Kulasegaram, K. (. (2021) · Academic Medicine · doi:10.1097/acm.0000000000004291 · Cited by 324
Ethical use of Artificial Intelligence in Health Professions Education: AMEE Guide No. 158
Masters, K. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2186203 · Cited by 302
Fazlollahi, A. M., Bakhaidar, M., Alsayegh, A., Yilmaz, R., Winkler-Schwartz, A., Mirchi, N., Langleben, I., Ledwos, N., Sabbagh, A. J., Bajunaid, K., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.49008 · Cited by 285
Aljamaan, F., Temsah, M.-H., Altamimi, I., Al-Eyadhy, A., Jamal, A., Alhasan, K., Mesallam, T. A., Farahat, M., & Malki, K. H. (2024) · JMIR Medical Informatics · doi:10.2196/54345 · Cited by 211
Self-citationChatGPT and antimicrobial advice: the end of the consulting infection doctor?
Howard, A., Hope, W., & Gerada, A. (2023) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(23)00113-5 · Cited by 202 · cited 1×
“For example, a study showed that there were concerns about ChatGPT advice regarding antimicrobial stewardship, general course lengths were accurate but the duration varied, and source control was either incorrectly cited as justification for prolonging therapy or ignored entirely [29].”
Oh, N., Choi, G.-S., & Lee, W. Y. (2023) · Annals of Surgical Treatment and Research · doi:10.4174/astr.2023.104.5.269 · Cited by 201 · cited 2×
“All these changes of AI integration into the medical practice need to be accompanied by evolution in the medical teaching and training curricula [8,9], facing significant interest among educators and researchers recently on AI’s rapid involvement in medical education [10-13].”
Temsah, M.-H., Aljamaan, F., Malki, K. H., Alhasan, K., Altamimi, I., Aljarbou, R., Bazuhair, F., Alsubaihin, A., Abdulmajeed, N., Alshahrani, F. S., et al. (2023) · Healthcare · doi:10.3390/healthcare11131812 · Cited by 179
Self-citationEXPLORING TEACHERS’ ATTITUDES TOWARDS USING CHATGPT
Iqbal, N., Ahmed, H., & Azhar, K. A. (2022) · Global Journal for Management and Administrative Sciences · doi:10.46568/gjmas.v3i4.163 · Cited by 169 · cited 1×
“A qualitative methodology was chosen, as it is well suited to exploring experiences, meanings, and perspectives from participants’ viewpoints [20-22].”
Banerjee, M., Chiew, D., Patel, K. T., Johns, I., Chappell, D., Linton, N., Cole, G. D., Francis, D. P., Szram, J., Ross, J., et al. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02870-x · Cited by 168 · cited 1×
“Banerjee et al [11] reported that postgraduate trainee doctors have an overall positive perception of the impact of AI on clinical training; however, they found that AI will eventually reduce the trainees’ clinical judgment and practical skills.”
Early applications of ChatGPT in medical practice, education and research
Sedaghat, S. (2023) · Clinical Medicine · doi:10.7861/clinmed.2023-0078 · Cited by 163
Das, D., Kumar, N., Longjam, L. A., Sinha, R., Deb Roy, A., Mondal, H., & Gupta, P. (2023) · Cureus · doi:10.7759/cureus.36034 · Cited by 116
The Pros and Cons of Using ChatGPT in Medical Education: A Scoping Review
Mohammad, B., Supti, T., Alzubaidi, M., Shah, H., Alam, T., Shah, Z., & Househ, M. (2023) · Studies in Health Technology and Informatics · doi:10.3233/shti230580 · Cited by 114 · cited 1×
“Implementing measures such as third-party audits, strict guidelines, data transparency, and continuous monitoring of ChatGPT’s information sources can help ensure the unmanipulated ethical use of ChatGPT in medical education [43-45].”
ChatGPT failed Taiwan’s Family Medicine Board Exam
Weng, T.-L., Wang, Y.-M., Chang, S., Chen, T.-J., & Hwang, S.-J. (2023) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000000946 · Cited by 100
Fazlollahi, A. M., Yilmaz, R., Winkler-Schwartz, A., Mirchi, N., Ledwos, N., Bakhaidar, M., Alsayegh, A., & Del Maestro, R. F. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.34658 · Cited by 85 · cited 1×
“As an example, the integration of AI in simulated surgical skills learning showed comparable results compared to remote expert instructions [1], but it led to unintended outcomes in another study, which affected trainees’ efficiency metrics on the cost of safer skills development [2].”
Masters, K. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2208731 · Cited by 76
Magalhães Araujo, S., & Cruz-Correia, R. (2024) · JMIR Medical Education · doi:10.2196/51151 · Cited by 72
Simsek-Cetinkaya, S., & Cakir, S. K. (2023) · Nurse Education Today · doi:10.1016/j.nedt.2023.105857 · Cited by 65
Beware of references when using ChatGPT as a source of information to write scientific articles
Sanchez-Ramos, L., Lin, L., & Romero, R. (2023) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2023.04.004 · Cited by 60 · cited 1×
“A previous study had cautioned authors regarding references generated by ChatGPT [35].”
Kamoun, F., El Ayeb, W., Jabri, I., Sifi, S., & Iqbal, F. (2024) · Journal of Information Technology Education: Research · doi:10.28945/5239 · Cited by 54 · cited 1×
“Previous literature has shown that in comparison with Google, the majority of the participants tend to doubtfully trust ChatGPT output for reasons related to the novelty of AI and users, lack of understanding of its algorithm, and information sources as studied previously [14,30].”
Meo, S. A., Al-Khlaiwi, T., AbuKhalaf, A. A., Meo, A. S., & Klonoff, D. C. (2025) · Journal of Diabetes Science and Technology · doi:10.1177/19322968231203987 · Cited by 49 · cited 1×
“Other research highlighted that generated output in that regard is not highly different among different AI platforms, as the multiple-choice question–based examination performance of ChatGPT was marginally better than that of Google’s Bard [39].”
Abouammoh, N., Alhasan, K., Raina, R., Malki, K. A., Aljamaan, F., Tamimi, I., Muaygil, R., Wahabi, H., Jamal, A., Al-Tawfiq, J. A., et al. (2023) · doi:10.1101/2023.07.13.23292624 · Cited by 44
Self-citation
Research works printed but not linked: 25
- 10.1016/j.ijmedinf.2023.105117 · DOI
- 10.3389/fpubh.2022.971943 · DOI · Paper page
- 10.1007/s10396-023-01301-2 · DOI
- 10.1016/j.ucl.2021.07.008 · DOI
- 10.1038/s41390-022-02422-z · DOI
- 10.2196/16048 · DOI · Paper page
- 10.7759/cureus.37281 · DOI · Paper page
- 10.1007/s10916-023-01925-4 · DOI · Paper page
- 10.1002/hpm.2861 · DOI
- 10.1186/s42466-020-00059-z · DOI · Paper page
- 10.17576/jkmjc-2023-3904-16 · DOI
- Bryman, A, 2016, Social Research Methods, 0199689458
- Ritchie, J, 2002, Analyzing Qualitative Data, 173
- 10.5195/jmla.2022.1271 · DOI · Paper page
- 10.1080/0142159X.2024.2413425 · DOI
- 10.1093/eurjcn/zvad038 · DOI · Paper page
- 10.2196/preprints.54345 · doi:10.2196/preprints.54345
- 10.1016/j.resuscitation.2023.109783 · DOI · Paper page
- 10.1097/UPJ.0000000000000406 · DOI · Paper page
- 10.1016/j.heliyon.2024.e28962 · DOI
- 10.12688/f1000research.133019.1 · DOI · Paper page
- 10.7759/cureus.43036 · DOI · Paper page
- 10.1093/asj/sjad042 · DOI · Paper page
- 10.3390/ejihpe13110181 · DOI · Paper page
- 10.7759/cureus.44769 · DOI · Paper page
Cited by
Arillotta, D., Floresta, G., Guirguis, A., Corkery, J. M., Catalani, V., Martinotti, G., Sensi, S. L., & Schifano, F. (2023) · Brain Sciences · doi:10.3390/brainsci13111503 · Cited by 104
A scoping review of ChatGPT's role in healthcare education and research
Shorey, S., Mattar, C., Pereira, T. L.-B., & Choolani, M. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106121 · Cited by 96
Moskovich, L., & Rozani, V. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06702-0 · Cited by 73
An automated framework for assessing how well LLMs cite relevant medical references
Wu, K., Wu, E., Wei, K., Zhang, A., Casasola, A., Nguyen, T., Riantawan, S., Shi, P., Ho, D., & Zou, J. (2025) · Nature Communications · doi:10.1038/s41467-025-58551-6 · Cited by 72
“Lack of trust is commonly cited as the number one deterrent against clinicians adopting LLMs in their clinical practice 16,17 , and in particular, the inability of LLMs to generate supporting sources for medical statements in their responses 18 .”
Cherrez-Ojeda, I., Gallardo-Bastidas, J. C., Robles-Velasco, K., Osorio, M. F., Velez Leon, E. M., Leon Velastegui, M., Pauletto, P., Aguilar-Díaz, F. C., Squassi, A., González Eras, S. P., et al. (2024) · JMIR Medical Education · doi:10.2196/51757 · Cited by 46
Metadata
- Authors
- Abouammoh, N., Alhasan, K., Aljamaan, F., Raina, R., Malki, K. H., Altamimi, I., Muaygil, R., Wahabi, H., Jamal, A., Alhaboob, A., Assiri, R. A., Al-Tawfiq, J. A., Al-Eyadhy, A., Soliman, M., & Temsah, M.-H.
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2025-02-20
- Volume
- 11
- Pages
- e63400
- ISSN
- 2369-3762 (ISSN-L)
- OpenAlex
- W4407772451
- Cited by
- 47
- References
- 30
- FWCI
- 9.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.