The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations
Open accessPreprint — published as 10.3390/healthcare11060887 · Paper page
The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Abstract
An artificial intelligence (AI)-based conversational large language model (LLM) was launched in November 2022 namely, “ChatGPT”. Despite the wide array of potential applications of LLMs in healthcare education, research and practice, several valid concerns were raised. The current systematic review aimed to investigate the possible utility of ChatGPT and to highlight its limitations in healthcare education, research and practice. Using the PRIMSA guidelines, a systematic search was conducted to retrieve English records in PubMed/MEDLINE and Google Scholar under the term “ChatGPT”. Eligibility criteria included the published research or preprints of any type that discussed ChatGPT in the context of healthcare education, research and practice. A total of 280 records were identified, and following full screening, a total of 60 records were eligible for inclusion. Benefits/applications of ChatGPT were cited in 51/60 (85.0%) records with the most common being the utility in scientific writing followed by benefits in healthcare research (efficient analysis of massive datasets, code generation and rapid concise literature reviews besides utility in drug discovery and development). Benefits in healthcare practice included cost saving, documentation, personalized medicine and improved health literacy. Concerns/possible risks of ChatGPT use were expressed in 58/60 (96.7%) records with the most common being the ethical issues including the risk of bias, plagiarism, copyright issues, transparency issues, legal issues, lack of originality, incorrect responses, limited knowledge, and inaccurate citations. Despite the promising applications of ChatGPT which can result in paradigm shifts in healthcare education, research and practice, the embrace of this application should be done with extreme caution. Specific applications of ChatGPT in health education include the promising utility in personalized learning tools and shift towards more focus on critical thinking and problem-based learning. In healthcare practice, ChatGPT can be valuable for streamlining the workflow and refining personalized medicine. Saving time for the focus on experimental design and enhancing research equity and versatility are the benefits in scientific research. Regarding authorship in scientific articles, as it currently stands, ChatGPT does not qualify to be listed as an author unless the ICMJE/COPE guidelines are revised and amended. An initiative involving all stakeholders involved in healthcare education, research and practice is urgently needed to set a code of ethics and conduct on the responsible practices involving ChatGPT among other LLMs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In this exploratory study, we observed a high level of ease of use among the small group of participants who reported using ChatGPT, likely due to its user-friendly nature and free accessibility [17,71,90].”
From Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study (2023) · cites this paper as [71]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With regard to transparency, two sources suggest that LLM-supported diagnoses hamper the process of providing adequate justification due to their opacity36,74.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [74]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Unintended negative consequences, such as inappropriate or inaccurate content, pose significant risks in health care settings, necessitating careful consideration before its adoption in health care education [9,69-71].”
From Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study (2023) · cites this paper as [71]
The cited source says what the claim attributes to it.
In the citing paper
“LLMs have many potentially beneficial applications in healthcare practice and research, including diagnostic (e.g., prediction of disease risk and outcomes) and procedural (e.g., streamlining of clinical workflows, documentation, cost-effectiveness) tasks59.”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [59]
The cited source says what the claim attributes to it.
In the citing paper
“Consequently, there is a noticeable demand for ethical guidelines, as evidenced within the literature surrounding healthcare applications of LLMs46,60,64,70,71,74,75,78.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [74]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“The current systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRIMSA) guidelines [20].”
MethodLanguage Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 2×
“, San Francisco, CA, USA), ChatGPT etymology is related to being a chatbot (a program able to understand and generate responses using a text-based interface) and being based on the Generative Pre-trained Transformer (GPT) architecture [6,7].”
BackgroundKaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 1×
“This was followed by the development of machine learning (ML) algorithms that allow decision making or predictions based on the patterns in large datasets [4].”
BackgroundKung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · cited 2×
“The need to rethink and revise the current assessment tools in healthcare education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE), and possibility of ChatGPT misuse that would result in increased academic dishonesty [28,34,64,66,68,72].”
BackgroundRajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · cited 1×
“The utility of AI in healthcare appears promising with possible applications in personalized medicine, drug discovery, and analysis of large datasets has been outlined previously besides the potential benefits in improving diagnosis and clinical decisions [17,18].”
BackgroundChatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · cited 1×
“The need to rethink and revise the current assessment tools in healthcare education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE), and possibility of ChatGPT misuse that would result in increased academic dishonesty [28,34,64,66,68,72].”
BackgroundChatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955
McCarthy, J., Minsky, M., Rochester, N., et al. (2006) · The AI Magazine · doi:10.1609/aimag.v27i4.1904 · Cited by 2,029 · cited 1×
“The history of AI as a scientific discipline can be traced back to the mid-XX century at the Dartmouth Summer Research Project on AI [3].”
Background
Research works printed but not linked: 2
- 2. Commentary on ChatGPT in academic writing Assist in literature review saving time; ability to summarize papers; improving language Inaccurate content; bias; may lead to decreased critical thinking and creativity in science; ethical concerns; plagiarism ChatGPT can be credited as an author based on its significant contribution Abbreviations: arXiv: a free distribution service and an open-access archive for scholarly articles in the fields of physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering and systems science, and economics, materials on arXiv are not peer-reviewed by arXiv, available from: https://arxiv.org/, accessed on 18 February 2023; MeSH: Medical Subject Headings; WAME: World Association of Medical Editors; ICMJE: International Committee of Medical Journal Editors; AI: Artificial intelligence; COPE AI in decision making: Committee on Publication Ethics, Artificial intelligence (AI) in decision making, available from: https://publicationethics.org/node/50766, accessed on 18 February 2023; LLM: Large-scale language model; ChemRxiv is a free submission, distribution, and archive service for unpublished preprints in chemistry and related areas, available from: https://chemrxiv.org/engage/chemrxiv/public-dashboard, accessed on 18 February 2023; medRxiv: Free online archive and distribution server for complete but unpublished manuscripts (preprints) in the medical, clinical, and related health sciences, available from: https://www.medrxiv.org/, accessed on 18 February 2023; MCQ: Multiple choice exam; CPR: cardiopulmonary resuscitation; STROBE: Strengthening the reporting of observational studies in epidemiology; * ChatGPT Generative Pre-trained Transformer was listed as an author; AHA: American Heart Association; USMLE: United States Medical Licensing Examination; JEEHP: Journal of Educational Evaluation for Health Professions; PsyArXiv: psychology archive for preprints, available from: https://psyarxiv.com/, accessed on 18 February 2023; CAD: Computer-aided diagnosis; SSRN: Social Science Research Network repository for preprints, available from: https://www.ssrn.com/index.cfm/en/, accessed on 19 February 2023; EdArXiv: A preprint server for the education research community, available from: https://edarxiv.org/, accessed on 19 February 2023; bioRxiv: a free online archive and distribution service for unpublished preprints in the life sciences, available from: https://www.biorxiv.org/, accessed on 19 February 2023; RG: Researchgate: A commercial social networking site for scientists and researchers, available from: https://www.researchgate.net/about, accessed on 19 February 2023.
- 7. Domingos, P. The master algorithm: how the quest for the ultimate learning machine will remake our world, First paperback edition ed.; Basic Books, a member of the Perseus Books Group: New York, 2018; p. 329 pages.
Cited by
Items 101–200 of 263
ChatGPT in early childhood STEM education: Can it be an innovative tool to overcome challenges?
Uğraş, H., & Uğraş, M. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12960-0 · Cited by 32
“In particular, the challenges related to accuracy and reliability that arise with the use of ChatGPT in education should be taken into account (Sallam, 2023).”
ChatGPT in pharmacometrics? Potential opportunities and limitations
Cloesmeijer, M. E., Janßen, A., Koopman, S. F., Cnossen, M. H., & Mathôt, R. A. A. (2023) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.15895 · Cited by 35
ChatGPT-generated versus human direct corrective feedback on L2 writing
Muñoz Muñoz, B. C., Nassaji, H., & Bello Carrillo, F. I. (2025) · System · doi:10.1016/j.system.2025.103805 · Cited by 22
Chauhan, A., Khaliq, F., & Nayak, K. R. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00471-z · Cited by 32
“These shortcomings are particularly concerning in a field like medicine, where addressing the needs of diverse patient populations is crucial to improving outcomes(Sallam, 2023).”
Large Language Models in Healthcare
Al-Garadi, M., Mungle, T., Ahmed, A., Sarker, A., Miao, Z., & Matheny, M. E. (2025) · arXiv · doi:10.48550/arxiv.2503.04748
“26-28 The transformation continues into more specific areas of healthcare delivery and research.”
Widen the debate: What is the academic community’s perception on ChatGPT?
Jiang, Y., Xie, L., Lin, G., & Mo, F. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12677-0 · Cited by 21
“We acknowledge that over the past year, diverse research fields have explored Chat - GPT including Environmental Research (Zhu et al., 2023), Physics Education (Kieser et al., 2023); Psychiatry (Cheng et al., 2023); Healthcare Education (Sallam, 2023) and more.”
Amer, M. I. B., Rababah, L. M., & Rababah, M. A. (2025) · Journal of Language Teaching and Research · doi:10.17507/jltr.1601.04 · Cited by 20
Temel, M. H., Erden, Y., & Bağcıer, F. (2025) · The Knee · doi:10.1016/j.knee.2025.04.008 · Cited by 25
Can large language models be sensitive to culture suicide risk assessment?
Levkovich, I., Shinan‐Altman, S., & Elyoseph, Z. (2024) · Journal of Cultural Cognitive Science · doi:10.1007/s41809-024-00151-9 · Cited by 26
“Nevertheless, adoption of ChatGPT requires careful evaluation due to limitations and costs (Sallam, 2023; Tal et al., 2023a, b).”
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review
Yuan, M.-Z., Bao, P., Yuan, J.-J., Shen, Y., Chen, Z., Xie, Y., Zhao, J., Chen, Y., Zhang, L., Shen, L., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2311.01918 · Cited by 21
“This lack of transparency hinders the ability to decipher how specific outputs are generated, leading to potential trust and accountability issues [190, 191].”
Mosleh, S. M., Alsaadi, F. A., Alnaqbi, F. K., Alkhzaimi, M. A., Alnaqbi, S. W., & Alsereidi, W. M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e31952 · Cited by 43
“Similarly, S.M. Mosleh et al. a systematic review investigated the potential utility of ChatGPT in healthcare education, research, and practice [24].”
BackgroundChatGPT between opportunities and challenges: an empirical study in Italy
Pasca, M. G., & Arcese, G. (2024) · The TQM Journal · doi:10.1108/tqm-08-2023-0268 · Cited by 32
Chun, J., & Elkins, K. (2023) · International Journal of Digital Humanities · doi:10.1007/s42803-023-00069-8 · Cited by 34
“Depending on the length of the conversation and how it evolves over time, early statements, facts or other context may be lost, misremembered or hal-lucinated (Sallam, 2023).”
A survey on biomedical automatic text summarization with large language models
Huang, Z., Chen, X., Wang, Y., Huang, J., & Zhao, X. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104216 · Cited by 27
Systematic exploration and in-depth analysis of ChatGPT architectures progression
Banik, D., Pati, N., & Sharma, A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10832-0 · Cited by 24
“• ChatGPT can occasionally generate false or biased information since it learns from data that contains errors or biases (Sallam 2023).”
Xie, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.05093 · Cited by 32
“Their powerful generative and reasoning abilities have enabled wide adoption across domains such as education (Kasneci et al., 2023), healthcare (Sallam, 2023), and finance (Wu et al., 2023).”
ChatGPT and Its Role in Academic Libraries: A Discussion
Panda, S. K., Bhatt, A., & Satapathy, A. (2024) · New Review of Academic Librarianship · doi:10.1080/13614533.2024.2381510 · Cited by 24
“ChatGPT is a member of the GPT family of large language models (Sallam, 2023b), which is more powerful and capable of understanding and generating human-like language in a fraction of a second (Lund et al., 2023).”
Akhondi‐Asl, A., Yang, Y., Luchette, M., Burns, J. P., Mehta, N. M., & Geva, A. (2024) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000003468 · Cited by 22
“Thus, the generation of a differential diagnosis based on a clinical history may be an ideal application for LMs, which have shown promise in various fields, including law, finance, programming, and biomedicine (5–13).”
BackgroundLLM Serving Optimization with Variable Prefill and Decode LengthsPreprint
Wang, M., Ye, Y., & Zhou, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.06133 · Cited by 20
“…2023, Google 2023, Komo 2023, Perplexity 2022, You.com 2020), programming aids (Amazon 2023, GitHub 2021, Replit 2018), and even clinical decision support tools (Cascella et al. 2023, Peng et al. 2023, Sallam 2023), demonstrating remarkable versatility in professional and consumer domains alike.”
Multi-UAV Placement for Integrated Access and Backhauling Using LLM-Driven Optimization
Wang, Y., Farooq, J., Ghazzai, H., & Setti, G. (2025) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc61545.2025.10978733 · Cited by 13
“In recent years, large language models (LLMs), such as generative pre-trained transformers (GPT), have emerged as promising tools for solving optimization tasks through natural language interfaces [13], [14].”
MedLM: Exploring Language Models for Medical Question Answering SystemsPreprint
Yagnik, N., Jhaveri, J., Sharma, V., & Pila, G. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.11389 · Cited by 37
Sentiment Analysis of Using ChatGPT in Education
Tubishat, M., Al-Obeidat, F. N., & Shuhaiber, A. (2023) · International Conference on Smart Applications, Communications and Networking (SmartNets) · doi:10.1109/smartnets58706.2023.10215977 · Cited by 37
Evaluation of AI Chatbots for Patient-Specific EHR Questions
Hamidi, A., & Roberts, K. E. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.02549 · Cited by 8
A Systematic Review for the Implication of Generative AI in Higher Education
Al-Shabandar, R., Jaddoad, A., Elwi, T. A., Mohammed, A. H., & Hussain, A. J. (2024) · Híradástechnika/Infocommunications journal · doi:10.36244/icj.2024.3.3 · Cited by 33
Generative AI in Programming Education: Evaluating ChatGPT’s Effect on Computational Thinking
Sivasakthi, M., & Meenakshi, A. (2025) · SN Computer Science · doi:10.1007/s42979-025-04051-9 · Cited by 16
“As shown in [ 19 ] and [20], it is also helpful for doing extensive literature reviews and polls of the field, so it helps scientists generate material for recommendations for research proposals [21] and [22]., respectively.”
Roshani, M. A., Zhou, X., Qiang, Y., Suresh, S., Hicks, S. D., Sethuraman, U., & Zhu, D. (2025) · JMIR AI · doi:10.2196/67363 · Cited by 28
“Sallam [16] discussed how LLMs could assist in systematic reviews and meta-analyses, reducing the effort required in literature search and data extraction.”
The Past, Present, and Future Use of Artificial Intelligence in Teacher Education
Mosher, M., Dieker, L., & Hines, R. (2024) · Journal of Special Education Preparation · doi:10.33043/8aa9855b · Cited by 18
“…(f) over-reliance on technology negating preparing students with disabilities to think on their own; (g) reduced problem-solving and critical thinking; (h) decreased privacy and data security; and (i) potential copyright infringements (Arif et al., 2023; Hosseini et al., 2023; Sallam, 2023).”
BackgroundKétyi, A., Géring, Z., & Dén‐Nagy, I. (2024) · Society and Economy · doi:10.1556/204.2024.00007 · Cited by 21
IllusionX: An LLM-powered mixed reality personal companion
Yousri, R., Essam, Z., Kareem, Y., et al. (2024) · arXiv.org · doi:10.48550/arxiv.2402.07924 · Cited by 15
“Large Language Models have been used in healthcare education [36], [37], [38], engineering education [39], [40] and language learning [41].”
MethodKang, D., Wu, H., Yuan, L., Shen, W., Feng, J. H., Zhan, J., Grzybowski, A. E., Sun, W., & Jin, K. (2025) · Ophthalmology and Therapy · doi:10.1007/s40123-025-01105-2 · Cited by 15
“5 and ChatGPT-4o have demonstrated proficiency in processing complex inputs, interpreting clinical parameters, and generating contextually accurate responses [15, 16].”
Nikoçeviq-Kurti, E., & Syla, L. B. (2024) · Educational Process International Journal · doi:10.22521/edupij.2024.133.2 · Cited by 13
“Issues related to bias, the generation of inappropriate content, and the production of inaccurate information highlight the need to develop effective strategies in order to mitigate these areas of risk (Borji, 2023; Deng & Lin, 2022; Sallam, 2023).”
Adaptively Robust LLM Inference Optimization under Prediction UncertaintyPreprint
Chen, Z., Ye, Y., & Zhou, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.14544 · Cited by 24
“…technologies (Microsoft 2023, Google 2023, Perplexity 2022), intelligent programming assistants (Amazon 2023, GitHub 2021), and operations service management (Huang et al. 2025, Cascella et al. 2023, Sallam 2023), highlighting their adaptability across both specialized and everyday use cases.”
MedEthicEval: Evaluating Large Language Models Based on Chinese Medical Ethics
Jin, H., Shi, J.-C., Xu, H.-H., et al. (2025) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2503.02374 · Cited by 13
“LLMs are now being used in clinical decision support (Hager et al., 2024), medical education (Sallam, 2023), and patient communication (Subramanian et al., 2024).”
Krapp, E., Neuhaus, R., Hassenzahl, M., & Laschke, M. (2024) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3679318.3685501 · Cited by 19
“Particularly conversational interfaces for Large Language Models (LLMs) [73] like OpenAI’s ChatGPT have emerged as powerful and popular applications which are utilized for a wide range of use cases from co-authoring code [20] to supporting medical diagnostics [64, 68].”
Borna, S., Gomez-Cabello, C. A., Pressman, S. M., Haider, S. A., & Forte, A. J. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14060612 · Cited by 17
“Recent advancements have increasingly highlighted the potential of LLMs in enhancing patient management, mainly due to their user-friendly nature and ability to overcome language barriers [25,26].”
BackgroundKharitonova, K., Pérez‐Fernández, D., Gutiérrez-Hernando, J., Gutiérrez-Fandiño, A., Callejas, Z., & Griol, D. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2321959 · Cited by 22
“…explored recently for a myriad of applications in the healthcare domains, such as medical education (Arif, Munaf, and Ul-Haque 2023; Eysenbach 2023; Sallam 2023), diagnosis (Arif, Munaf, and Ul-Haque 2023), treatment and patient care (Garg et al. 2023), clinical decision support (Liu et al. 2023a,…”
ChatGPT: Implications for Faculty, Students, and Patients: May 19, 2023
Shay, A. (2023) · Clinical Nurse Specialist · doi:10.1097/nur.0000000000000770 · Cited by 12
Jiang, L., Wei, B., Qiu, N., & Huang, L. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2479166 · Cited by 15
“The current research landscape surrounding ChatGPT ’ application in education remains sparse, often focusing on specific aspects rather than providing a comprehensive overview (Li et al., 2019; Sallam, 2023).”
Assessing the possibility of using large language models in ocular surface diseases
Ling, Q., Zeng, Y.-M., Qi, H., Qian, X.-Z., Hu, J., Pei, C.-G., Wei, H., Zou, J., Chen, C., Wang, X., et al. (2024) · International Journal of Ophthalmology · doi:10.18240/ijo.2025.01.01 · Cited by 18
“LLMs are also widely used to improve scientific writing, increase research equity, streamline healthcare workflows, save costs, and improve personalized learning in medical education [13-14] .”
Yiğit, S., Berşe, S., Dіrgar, E., & Güner, S. G. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2024.2391044 · Cited by 13
“Studies conducted in the fields of healthcare services, medical education, and academia pointed out to a number of ChatGPT-related issues, such as plagiarism, incorrect answers, and faulty citations (Sallam, 2023).”
Al-Alami, S. (2024) · Journal of Language Teaching and Research · doi:10.17507/jltr.1504.01 · Cited by 17
“Moreover, the texts ChatGPT generates may sometimes include inappropriate content, biased information, or misleading ideas (Borji, 2023; Hacker et al., 2023; Sallam, 2023).”
BackgroundThe potential of ChatGPT technology in education: advantages, obstacles and future growth
Al-Ghonmein, A. M., & Al-Moghrabi, K. G. (2024) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v13.i2.pp1206-1213 · Cited by 18
“It can likewise aid in generating educational resources (e.g. quizzes, tests, and assignments), leading to more time savings [30], [31].”
BackgroundMedQA-SWE - a Clinical Question & Answer Dataset for Swedish
Hertzberg, N., & Lokrantz, A. (2024) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4ckcc2pepdd3 · Cited by 13
Generative AI Integration in K-12 Settings: Teachers’ Perceptions and Levels of Integration
An, Y., & James, S. (2025) · TechTrends · doi:10.1007/s11528-025-01114-9 · Cited by 29
“Also, GenAI lacks higher-order thinking skills, such as critical and analytical thinking, and it is unable to evaluate the accuracy and quality of the data used to train it or the information it generates (Farrokhnia et al., 2023; Lecler et al., 2023; Sallam, 2023).”
Alhusban, M. I., Khatatbeh, I. N., & Alshurafat, H. (2025) · Competitiveness Review An International Business Journal incorporating Journal of Global Competitiveness · doi:10.1108/cr-06-2024-0121 · Cited by 32
Verma, S. R., Kashive, N., & Gupta, A. K. (2025) · Benchmarking An International Journal · doi:10.1108/bij-07-2024-0564 · Cited by 23
Saleem, S., Asim, M. N., van Elst, L., & Dengel, A. R. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01707-6 · Cited by 21
“Contrarily, language models in second category such as ChatGPT and Gemini are being extensively utilized for text re-phrasing [46, 47], data generation, healthcare [48–50], finance [51–53], education [54] and opinion mining [55] Fig.”
Protected group bias and stereotypes in Large Language ModelsPreprint
Kotek, H., Sun, D. Q., Xiu, Z., Bowler, M., & Klein, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.14727 · Cited by 22
“This is so because LLMs are now used as the basis for real-world applications in many domains, including medicine (Sallam, 2023; Nov et al., 2023; Blanco-Gonzalez et al., 2022; Jeblick et al., 2022), law (Perlman et al., 2022; Choi et al., 2023; Petti-nato Oltz, 2023; Armstrong, 2023), finance (Xie…”
BackgroundLeveraging Generative AI for Public Service Innovation: A Path to Smart Government in Indonesia
Alamsyah, A., & Aryfiyanto, H. (2025) · Digital Government Research and Practice · doi:10.1145/3761820 · Cited by 21
“Formulating mapping questions was crucial for creating effective search queries [Mengist et al. 2020 ] and identifying fundamental concepts tied to generative AI [Cascella et al. 2023 ; Cheng et al. 2023 ; Gao et al. 2023 ; Pavlik 2023 ; Qadir 2023 ; Sallam 2023 ; Temsah et al. 2023 ].”
Geosystems risk and uncertainty: The application of ChatGPT with targeted prompting
Mahjour, S. K., Soltanmohammadi, R., Heidaryan, E., & Faroughi, S. A. (2024) · Geoenergy Science and Engineering · doi:10.1016/j.geoen.2024.212889 · Cited by 11
Understanding the concerns and choices of public when using large language models for healthcarePreprint
Xiao, Y., Zhou, K. Z., Liang, Y., & Shu, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.09090 · Cited by 13
“Some studies discuss the application of LLMs in the field of medical education [41, 42].”
BackgroundChatGPT no auxílio da aprendizagem de programação: Um estudo de caso
da Silva, S. M., de Freitas, R. A. B., de Morais, M. A. C., & Costa, D. L. V. (2023) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/sbie.2023.234873 · Cited by 17
“Como a ferramenta é alimentada com uma grande quantidade de dados, ele pode ser tendencioso ou conter imprecisões e acabar gerando informações incorretas ou mesmo falsas (Sallam, 2023).”
BackgroundMoon, H., Chung, Y.-J., & Randolph, A. W. (2025) · IJELTAL (Indonesian Journal of English Language Teaching and Applied Linguistics) · doi:10.21093/ijeltal.v10i1.1991 · Cited by 23
“First, ChatGPT can provide biased or inappropriate content (Atlas, 2023; Qadir, 2023; Sallam, 2023; Zhuo et al., 2023).”
Task-Circuit Quantization: Leveraging Knowledge Localization and Interpretability for CompressionPreprint
Xiao, H., Sung, Y.-L., Stengel-Eskin, E., & Bansal, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.07389 · Cited by 17
“Despite the broad range of applications for large language models (LLMs) (Yang et al., 2024; Sallam, 2023), their adoption is often hindered by their computational cost and memory footprint.”
Obed, K., Anangisye, W. A. L., & Sanga, P. L. (2025) · Quality Assurance in Education · doi:10.1108/qae-06-2024-0100 · Cited by 23
Jairoun, A. A., Al‐Hemyari, S. S., Shahwan, M. J., Alnuaimi, G. R. H., Ibrahim, N. A., & Jaber, A. A. S. (2024) · Exploratory Research in Clinical and Social Pharmacy · doi:10.1016/j.rcsop.2024.100518 · Cited by 13
“46,56 Therefore, subjecting ChatGPT to comprehensive appropriate regulation that offers patients full data privacy and confidentiality and prevents any harmful implications of breaching data privacy (e.g., insurance, job opportunities, and personal relationships) is essential.”
InfluentialA Global Outlook on AI-Predicted Impacts of ChatGPT on Contemporary Education
Kanbul, S., Adamu, I., & Mohammed, Y. B. (2024) · SAGE Open · doi:10.1177/21582440241266370 · Cited by 13
“For instance, in healthcare education, Sallam (2023) conducted a systematic review to explore the potential utilizations of ChatGPT in both research and practical contexts.”
Wu, Q., Xu, Y., Xiao, T., Xiao, Y., Li, Y., Wang, T., Zhang, Y., Zhong, S., Zhang, Y., Lu, W., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.13885 · Cited by 25
“Nevertheless, biased training data and reliance on current sources of medical knowledge pose challenges, potentially resulting in inaccuracies and misinformation [67, 68, 69, 70, 71, 72].”
BackgroundRethinking Text-based Protein Understanding: Retrieval or LLM?
Wu, J.-T., Liu, Z.-J., Cao, H., et al. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2505.20354 · Cited by 8
“In recent years, large language models (LLMs) have achieved remarkable success across diverse domains (Brown et al., 2020; Touvron et al., 2023; Wei et al., 2022; Sallam, 2023; Li et al., 2025).”
The ethical use of generative AI in the Nigerian higher education sector
Izevbigie, H. I., Olajide, O., Olaniran, K., & Akintayo, T. A. (2025) · World Journal of Advanced Research and Reviews · doi:10.30574/wjarr.2025.25.3.0789 · Cited by 19
“There is the need to explore both human intelligence and AI — which parts of human intelligence can be supplanted by AI, and which cannot (Frye, 2022) although Sallam (2023) contends that HI-AI collaboration can yield significant benefits if AI output is accurate and reliable.”
Alhazmi, A. A., & Muftah, M. Y. A. (2025) · The Electronic Journal of e-Learning · doi:10.34190/ejel.23.1.3762 · Cited by 12
“To enhance their performance, these AI models require training on high-quality datasets (Huallpa et al., 2023; Liu et al., 2023; Sallam, 2023; Ray, 2023).”
Large language models (LLMs) in radiology exams for medical students: Performance and consequences
Gotta, J., Hong, Q. A. L., Koch, V., Gruenewald, L. D., Geyer, T., Martin, S. S., Scholtz, J., Booz, C., dos Santos, D. P., Mahmoudi, S., et al. (2024) · RöFo - Fortschritte auf dem Gebiet der Röntgenstrahlen und der bildgebenden Verfahren · doi:10.1055/a-2437-2067 · Cited by 17
“One such technological innovation that has garnered significant attention in recent years is the integration of large language models (LLMs) [1].”
Guidelines for Effective Use of ChatGPT in Introductory Programming Education
Ramabu, T. J., & Malebane, T. (2024) · IST-Africa Conference (IST-Africa) · doi:10.23919/ist-africa63983.2024.10569684 · Cited by 15
“ChatGPT can also be used to aid in software development tasks that are in a prototype stage [17], [18].”
MethodAwal, M. R., & Asaduzzaman (2024) · Higher Education Skills and Work-based Learning · doi:10.1108/heswbl-09-2023-0249 · Cited by 23
THE USE OF ARTIFICIAL INTELLIGENCE APPLICATIONS FOR EDUCATION AND SCIENTIFIC RESEARCH
Segovia-Juarez, J. L., & Baumgartner, R. (2023) · Hatun Yachay Wasi · doi:10.57107/hyw.v3i1.61 · Cited by 23
Sivasubramanian, J., Hussain, S. M. S., Muthuprakash, S. V., Periadurai, N. D., Mohanram, K., & Surapaneni, K. M. (2023) · Indian Journal of Medical Microbiology · doi:10.1016/j.ijmmb.2023.100380 · Cited by 8
ChatGPT: Information Retrieval from Image using Robotic Process Automation and OCR
Shidaganti, G. I., Sanjana, R., Shubeeksh, K., Raman, V. R. M., & Thakshith, V. (2023) · International Conference on Intelligent Computing and Control Systems (ICICCS) · doi:10.1109/iciccs56967.2023.10142461 · Cited by 15
Ragab, M., Ashary, E. B., Kateb, F., Hakeem, A., Mosli, R., Albogami, N., & Nooh, S. A. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2025.04.071 · Cited by 7
Probing Large Language Model Hidden States for Adverse Drug Reaction KnowledgePreprint
Berkowitz, J. S., Weissenbacher, D., Srinivasan, A., et al. (2025) · medRxiv · doi:10.1101/2025.02.09.25321620 · Cited by 2
ANALISIS SWOT PENGGUNAAN CHAT GPT DALAM DUNIA PENDIDIKAN ISLAM
Yasmar, R., & Amalia, D. R. (2024) · Fitrah Jurnal Studi Pendidikan · doi:10.47625/fitrah.v15i1.668 · Cited by 29
Adarkwah, M. A., Islam, A. Y. M. A., Schneider, K., Luckin, R., Thomas, M., & Spector, J. M. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2364140 · Cited by 6
Albahri, O. S., Alsalem, M. A., Albahri, A. S., Mahmoud, M. A., Alzubaidi, L., Alamoodi, A. H., & Sharaf, I. M. (2025) · International Journal of Intelligent Systems · doi:10.1155/int/2376097 · Cited by 7
“…changes such as the feld, instructional activity rather than learning practice, medicine treatment process instead of health from the spotlight on the body’s physical state, along with production setting where individual or individuals develops some sort value which then products are made from [6].”
Automated detection of ChatGPT-generated text vs. human text using gannet-optimized deep learning
Alshareef, A. M., Alsobhi, A. Y., Khadidos, A. O., Alyoubi, K. H., Khadidos, A. O., & Ragab, M. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2025.03.139 · Cited by 8
Gao, Y., Kumar, A., Li, Y.-C., & Snyder, J. W. (2024) · International Journal on Cybernetics & Informatics · doi:10.5121/ijci.2024.130202 · Cited by 6
“ChatGPT was shown to be useful in healthcare education, research, and practice, specifically in scientific writing, efficient analysis of massive datasets, and improved health literacy [36].”
BackgroundIlma, A., & Sampurna, R. A. (2024) · Peradaban Journal of Interdisciplinary Educational Research · doi:10.59001/pjier.v2i1.152 · Cited by 11
“…et al., 2024; Meyer et al., 2023) , the influence of language models on tertiary education and research ( Alqahtani et al., 2023; Cacciuttolo et al., 2023; Sallam, 2023; Zekaj, 2023), and the role of AI including language models in teaching and learning (Chauncey, et al., 2023; Tayan et al., 2023).”
BackgroundAssessing ChatGPT's use of person-first language in healthcare conversations
Hackl, E. V. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-023-00099-9 · Cited by 10
“Author of [5] found that benefits of ChatGPT were cited in 85.0% of works cited in PubMed/MEDLINE and Google Scholar.”
InfluentialChatGPT utilization within the building blocks of the healthcare services: A mixed-methods study
Shojaei, P., Khosravi, M., Jafari, Y., Mahmoudi, A. H., & Hassanipourmahani, H. (2024) · Digital Health · doi:10.1177/20552076241297059 · Cited by 9
“9,17,18 Conversely, other publications have underscored the limitations and challenges associated with the use of ChatGPT.”
Flathmann, C., McNeese, N. J., Sengupta, S., & Johnson, E. (2025) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3764591 · Cited by 12
“These domains perceive LLMs as highly capable technologies that can enhance the quality, accuracy, and speed of generative tasks, such as writing or the creation of lessons/health plans [73].”
Charming or chilling? A comprehensive review of ChatGPT’s in education sector
Bhaskar, P., & Tiwari, C. K. (2025) · International Journal of Information and Learning Technology · doi:10.1108/ijilt-05-2024-0097 · Cited by 9
Khan, M. M. R. R., Habib, S. B., Tasnim, S. T., & Islam, M. A. (2023) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit60459.2023.10441564 · Cited by 13
“In the context of university education, it is customary for students engaged in the study and analysis of training and testing data to conduct preliminary simulations as a necessary step prior to executing the primary code [12].”
BackgroundChances and Challenges of ChatGPT and Similar Models for Education in M&S
Tolk, A., Barry, P., Loper, M. L., Rabadi, G., Scherer, W. T., & Yılmaz, L. (2023) · Winter Simulation Conference · doi:10.1109/wsc60868.2023.10408241 · Cited by 4
“• Ensuring Ethical and Responsible Use of LLMs: Addressing potential biases in the training data, providing transparency in the decision-making process, and ensuring data privacy are key ethical considerations when using LLMs (Sallam 2023).”
BackgroundBraga, V. (2023) · Journal of Engineering Science · doi:10.52326/jes.utm.2023.30(3).07 · Cited by 7
ChatGPT in Research and Education: A SWOT Analysis of Its Academic Impact
Miah, A. S. M., Tusher, M. M. R., Hossain, M. M., Hossain, M. M., Rahim, M. A., Hamid, M. E., Islam, M. S., & Shin, J. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.064168 · Cited by 11
Chen, Z., Jiang, Z., Yang, F., He, Z., Hou, Y., Cho, E., McAuley, J., Galstyan, A., Hu, X., & Yang, J. (2023) · Proceedings of the 32nd ACM International Conference on Information and Knowledge Management · doi:10.1145/3583780.3615314 · Cited by 5
“• Cross-Field LLM applications : Showcasing successful applications of LLMs in various domains for personalization, such as personalized medicine [40], personalized education [24], personalized finance advisory [51], computational social science [56] etc. • Ethical and privacy concerns : There has…”
BackgroundPatientSafeBench: Evaluating the Safety of Medical LLMs for Patient Use
Kim, M., Park, H., Kim, W., Choi, S. H., Kim, H. E., Sohn, H., Park, J., Kim, S., Yu, S.-C., & Oh, Y. (2025) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi67747.2025.11269553 · Cited by 7
“Bias and ethical concerns are challenges [28], as LLMs may amplify biases from training data, worsening disparities among vulnerable groups [29]–[31].”
Lin, S., Jiang, C., Law, K.-M., Yeh, P.-C., Tsai, M., Chou, C., Wang, I., Ting, I., Chen, Y., Chou, C., et al. (2025) · Digital Health · doi:10.1177/20552076251342067 · Cited by 5
Oshodi, A. N. (2024) · World Journal of Advanced Research and Reviews · doi:10.30574/wjarr.2024.23.3.2767 · Cited by 14
“It has been noted that Chat GPT poses challenges in the educational sector, particularly in terms of the accuracy and reliability of the bot (Sallam, 2023), as well as the difficulty in detecting plagiarism (Ventayen, 2023).”
Towards Training A Chinese Large Language Model for AnesthesiologyPreprint
Wang, Z., Jiang, J., Zhan, Y., Zhou, B., Li, Y., Zhang, C., Ding, L., Jin, H., Peng, J. L., Xu, L., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.02742 · Cited by 4
Shekhar, S., Tiwari, S., Rensink, T. C., Eskander, R., & Salloum, W. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.03360 · Cited by 5
Letter to the Editor: Could ChatGPT Improve Knowledge in Surgery?
Tel, A., Parodi, P. C., Robiony, M., Zanotti, B., & Zingaretti, N. (2023) · Annals of Surgical Oncology · doi:10.1245/s10434-023-13518-z · Cited by 5
Rojas, N. P., Calderon-Ramirez, S., Solís, M., Romero-Sandoval, M., Arias-Monge, M., & Saggion, H. (2025) · IEEE Access · doi:10.1109/access.2025.3568693 · Cited by 8
“GPT-3 represents a state-of-the-art generative approach that produces fluent and contextually coherent simplifications [36].”
Stošić, L. V., & Janković, A. V. (2023) · Pravo - teorija i praksa · doi:10.5937/ptp2304058s · Cited by 13
“Another study revealed that the usage of ChatGPT in education presented various issues in studies, ranging from plagiarism to inaccurate answers and citations (Sallam, 2023).”
BackgroundZhao, H., & Dang, T. N. Y. (2026) · Education and Information Technologies · doi:10.1007/s10639-025-13870-5 · Cited by 4
The potential of AI-generated feedback from the students’ perspective: a systematic review
Öztürk, Y., & Çebi, A. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2588385 · Cited by 9
“Sallam (2023) examined ChatGPT in health education, highlighting benefits in personalisation and automation.”
ChatGPT: how to use it and the pitfalls/cautions in academia
Lee, J. (2025) · Annals of Pediatric Endocrinology & Metabolism · doi:10.6065/apem.2550028.014 · Cited by 5
MERA: Medical Electronic Records Assistant
Ibrahim, A., Khalili, A., Arabi, M., Sattar, A. H. M. S., Hosseini, A., & Serag, A. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7030073 · Cited by 7
“While LLMs have shown impressive capabilities, their limitations become more pronounced in specialized areas such as healthcare [2–4].”
Mind Companion: How ChatGPT Shapes Teaching and Research in Higher Education
Taktak, M. (2025) · International Journal of Technology in Education · doi:10.46328/ijte.1170 · Cited by 3
“Some researchers suggest that artificial intelligence based applications such as ChatGPT have the potential to create a paradigmatic transformation in education (Khan, 2023; Sallam, 2023).”
Weicken, E., Mittermaier, M., Hoeren, T., Kliesch, J., Wiegand, T., Witzenrath, M., Ballhausen, M., Karagiannidis, C., Sander, L. E., & Gröschel, M. I. (2025) · Die Innere Medizin · doi:10.1007/s00108-025-01861-0 · Cited by 4
Wickramarathna, E. A. A. M., Kumara, S. S., Buddhasinghe, R. U., & Wijayasekara, A. (2025) · South-East Asian Journal of Medical Education · doi:10.4038/seajme.v18i2.584 · Cited by 3
Nzobonimpa, S., Savard, J., Caron, I., & Lawarée, J. (2024) · AI & Society · doi:10.1007/s00146-024-02103-x · Cited by 8
“In a systematic literature review on the use of Chat-GPT in the context of healthcare education, research and practice, Sallam (2023) found that among the 280 records identified, 96.7% had expressed concerns and risks, and only 85.0% had cited benefits.”
Influential
Metadata
- Authors
- Sallam, M.
- Affiliations
- University of Jordan (JO)
- Corresponding author
- Sallam, Malik
- ORCID
- Sallam, Malik
- Venue
- Healthcare
- Publisher
- openRxiv
- Published
- 2023-02-21
- Volume
- 11
- Issue
- 6
- Pages
- 887-887
- ISSN
- 2227-9032 (ISSN-L)
- PMC
- PMC10048148
- OpenAlex
- W4327946446
- Semantic Scholar
- 3bbb397ea3b09a10de198f167fba045da680b4e8
- Cited by
- 3,123
- References
- 78
- Citations by year
- 2026: 558 · 2025: 839 · 2024: 1052 · 2023: 669
- FWCI
- 36.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Healthcare (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- Preprints.org (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- ChatGPT, large language models, artificial intelligence in healthcare, healthcare education, health care research, clinical practice, scientific writing, research equity, drug discovery, personalized medicine, health literacy, plagiarism, hallucinations, authorship criteria, AI ethics, infodemic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.