The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations
Open accessPreprint — published as 10.3390/healthcare11060887 · Paper page
The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.
Abstract
An artificial intelligence (AI)-based conversational large language model (LLM) was launched in November 2022 namely, “ChatGPT”. Despite the wide array of potential applications of LLMs in healthcare education, research and practice, several valid concerns were raised. The current systematic review aimed to investigate the possible utility of ChatGPT and to highlight its limitations in healthcare education, research and practice. Using the PRIMSA guidelines, a systematic search was conducted to retrieve English records in PubMed/MEDLINE and Google Scholar under the term “ChatGPT”. Eligibility criteria included the published research or preprints of any type that discussed ChatGPT in the context of healthcare education, research and practice. A total of 280 records were identified, and following full screening, a total of 60 records were eligible for inclusion. Benefits/applications of ChatGPT were cited in 51/60 (85.0%) records with the most common being the utility in scientific writing followed by benefits in healthcare research (efficient analysis of massive datasets, code generation and rapid concise literature reviews besides utility in drug discovery and development). Benefits in healthcare practice included cost saving, documentation, personalized medicine and improved health literacy. Concerns/possible risks of ChatGPT use were expressed in 58/60 (96.7%) records with the most common being the ethical issues including the risk of bias, plagiarism, copyright issues, transparency issues, legal issues, lack of originality, incorrect responses, limited knowledge, and inaccurate citations. Despite the promising applications of ChatGPT which can result in paradigm shifts in healthcare education, research and practice, the embrace of this application should be done with extreme caution. Specific applications of ChatGPT in health education include the promising utility in personalized learning tools and shift towards more focus on critical thinking and problem-based learning. In healthcare practice, ChatGPT can be valuable for streamlining the workflow and refining personalized medicine. Saving time for the focus on experimental design and enhancing research equity and versatility are the benefits in scientific research. Regarding authorship in scientific articles, as it currently stands, ChatGPT does not qualify to be listed as an author unless the ICMJE/COPE guidelines are revised and amended. An initiative involving all stakeholders involved in healthcare education, research and practice is urgently needed to set a code of ethics and conduct on the responsible practices involving ChatGPT among other LLMs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In this exploratory study, we observed a high level of ease of use among the small group of participants who reported using ChatGPT, likely due to its user-friendly nature and free accessibility [17,71,90].”
From Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study (2023) · cites this paper as [71]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With regard to transparency, two sources suggest that LLM-supported diagnoses hamper the process of providing adequate justification due to their opacity36,74.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [74]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Unintended negative consequences, such as inappropriate or inaccurate content, pose significant risks in health care settings, necessitating careful consideration before its adoption in health care education [9,69-71].”
From Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study (2023) · cites this paper as [71]
The cited source says what the claim attributes to it.
In the citing paper
“LLMs have many potentially beneficial applications in healthcare practice and research, including diagnostic (e.g., prediction of disease risk and outcomes) and procedural (e.g., streamlining of clinical workflows, documentation, cost-effectiveness) tasks59.”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [59]
The cited source says what the claim attributes to it.
In the citing paper
“Consequently, there is a noticeable demand for ethical guidelines, as evidenced within the literature surrounding healthcare applications of LLMs46,60,64,70,71,74,75,78.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [74]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“The current systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRIMSA) guidelines [20].”
MethodLanguage Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 2×
“, San Francisco, CA, USA), ChatGPT etymology is related to being a chatbot (a program able to understand and generate responses using a text-based interface) and being based on the Generative Pre-trained Transformer (GPT) architecture [6,7].”
BackgroundKaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 1×
“This was followed by the development of machine learning (ML) algorithms that allow decision making or predictions based on the patterns in large datasets [4].”
BackgroundKung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · cited 2×
“The need to rethink and revise the current assessment tools in healthcare education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE), and possibility of ChatGPT misuse that would result in increased academic dishonesty [28,34,64,66,68,72].”
BackgroundRajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · cited 1×
“The utility of AI in healthcare appears promising with possible applications in personalized medicine, drug discovery, and analysis of large datasets has been outlined previously besides the potential benefits in improving diagnosis and clinical decisions [17,18].”
BackgroundChatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · cited 1×
“The need to rethink and revise the current assessment tools in healthcare education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE), and possibility of ChatGPT misuse that would result in increased academic dishonesty [28,34,64,66,68,72].”
BackgroundChatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955
McCarthy, J., Minsky, M., Rochester, N., et al. (2006) · The AI Magazine · doi:10.1609/aimag.v27i4.1904 · Cited by 2,029 · cited 1×
“The history of AI as a scientific discipline can be traced back to the mid-XX century at the Dartmouth Summer Research Project on AI [3].”
Background
Research works printed but not linked: 4
- Domingos, P. The master algorithm: how the quest for the ultimate learning machine will remake our world, First paperback edition ed.; Basic Books, a member of the Perseus Books Group: New York, 2018; p. 329 pages.
- 10.13140/RG.2.2.31280.23043/1 · DOI
- 10.52866/IJCSM.2023.01.01.0018 · doi:10.52866/ijcsm.2023.01.01.0018 · Paper page
- 10.1258/jrsm.99.4.178 · doi:10.1258/jrsm.99.4.178 · Paper page
Cited by
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024
“Immediate action must be taken to mitigate the impact of ChatGPT on education.”
BackgroundA SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384
The imperative for regulatory oversight of large language models (or generative AI) in healthcare
Meskó, B., & Topol, E. J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00873-0 · Cited by 1,047
“Systematic reviews highlighted other potential bene fi ts too such as improved scienti fi c writing, enhancing research equity, streamlining the healthcare work fl ow, cost saving, and improved personalized learning in medical education 3,4 .”
Practical and ethical challenges of large language models in education: A systematic scoping review
Yan, L., Sha, L., Zhao, L., Li, Y., Martinez‐Maldonado, R., Chen, G., Li, X., Jin, Y., & Gašević, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13370 · Cited by 1,435
“%) focused on using LLMs to automate classification tasks, there could be more future studies that aimed to tackle the automation of prediction and generation tasks with the more capable LLMs (Sallam, 2023).”
BackgroundMethodInfluentialLarge language models in healthcare and medical domain: A reviewPreprint
Nazi, Z. A., & Peng, W. (2023) · Informatics · doi:10.48550/arxiv.2401.06775 · Cited by 562
“It is therefore crucial for medical professionals to exercise caution and thoroughly review and validate the recommendations provided by large language models before integrating them into their clinical decision-making processes [127].”
BackgroundMedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data
Han, T., Adams, L. C., Papaioannou, J.-M., Grundmann, P., Oberhauser, T., Figueroa, A., Löser, A., Truhn, D., & Bressem, K. K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.08247 · Cited by 103
“Potential applications include aiding medical professionals in note-taking, composing discharge letters, retrieving information from extensive documents, summarizing content, and converting free-form texts into structured formats [2, 3].”
Large language models in healthcare and medical domain: A review
Nazi, Z. A., & Peng, W. (2024) · Informatics · doi:10.3390/informatics11030057 · Cited by 415
Haltaufderheide, J., & Ranisch, R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01157-x · Cited by 396
“…there is a noticeable demand for ethical guidelines, evidenced within the literature surrounding healthcare applications of LLMs. 49,63,67,73,74,77,78,81 While we concur with the need for such guidance, our analysis suggests that the real challenge lies not in the articulation of such a need…”
BackgroundLarge language models (LLMs): survey, technical frameworks, and future challenges
Kumar, P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10888-y · Cited by 395
Gender bias and stereotypes in Large Language Models
Kotek, H., Dockum, R., & Sun, D. (2023) · Proceedings of The ACM Collective Intelligence Conference · doi:10.1145/3582269.3615599 · Cited by 381
“…in which LLM-based applications have been either proposed or developed for real-world applications in the domains of medicine [12, 38, 68, 79], law [3, 23, 73, 74], finance [15, 26, 99], education [17, 62, 79], and many others, the potential repercussions of reproducing and amplifying…”
BackgroundShahsavar, Y., & Choudhury, A. (2023) · JMIR Human Factors · doi:10.2196/47564 · Cited by 341
“A recent review examined the advantages of ChatGPT and other large language models in augmenting medical education, streamlining clinical decision-making, and promoting better patient outcomes [9].”
BackgroundSallam, M., Salim, N., Barakat, M., & Al-Tammemi, A. (2023) · Narra J · doi:10.52225/narra.v3i1.103 · Cited by 331
“Third, ChatGPT utility is highly valuable in prompt language translation generating a translated text while preserving the meaning and context of the translated text [1, 2].”
BackgroundInfluentialSelf-citationDomain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey
Ling, C., Zhao, X., Lu, J., Deng, C., Zheng, C., Wang, J., Chowdhury, T., Li, Y., Cui, H., Zhang, X., et al. (2026) · ACM Computing Surveys · doi:10.1145/3764579 · Cited by 141
Use of ChatGPT at University as a Tool for Complex Thinking: Students’ Perceived Usefulness
Romero-Rodríguez, J.-M., Ramírez-Montoya, M.-S., Buenestado-Fernández, M., & Lara-Lara, F. (2023) · Journal of New Approaches in Educational Research · doi:10.7821/naer.2023.7.1458 · Cited by 277
“However, most studies so far argue in favor of AI’s responsible use (Anderson et al., 2023; Carrasco et al., 2023; Crawford et al., 2023; Dwivedi et al., 2023; Kung et al., 2023; O’Connor, 2022; Sallam, 2023).”
BackgroundLarge language models in medical and healthcare fields: applications, advances, and challenges
Wang, D., & Zhang, S. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10921-0 · Cited by 246
“For instance, (Wang et al. 2023a) examined the clinical language understanding capabilities of LLMs in healthcare, Tian et al. (Tian et al. 2023) explored the potential and challenges of ChatGPT in the biomedical and health sectors, Liu et al. (Liu et al. 2023a) provided an examination of ChatGPT and GPT-4 across dive…”
InfluentialExploring the Implications of ChatGPT for Language Learning in Higher Education
Baskara, R., & Mukarto, M. (2023) · IJELTAL (Indonesian Journal of English Language Teaching and Applied Linguistics) · doi:10.21093/ijeltal.v7i2.1387 · Cited by 164
“ChatGPT is a robust large language model developed by OpenAI (Baidoo-Anu & Owusu Ansah, 2023; Kasneci et al., 2023; Lund & Wang, 2023; Sallam, 2023).”
ChatGPT in education: global reactions to AI innovations
Fütterer, T., Fischer, C., Alekseeva, A., Chen, X., Tate, T., Warschauer, M., & Gerjets, P. (2023) · Scientific Reports · doi:10.1038/s41598-023-42227-6 · Cited by 242
Combating Misinformation in the Age of LLMs: Opportunities and Challenges
Chen, C., & Shu, K. (2023) · arXiv · doi:10.48550/arxiv.2311.05656
“Recent works have pointed out the rise of adoption of LLMs in healthcare applications [167, 221, 266, 299, 357, 423, 426], however, they can also inadvertently be a tool for the generation and propagation of health mis-information [96].”
BackgroundAssessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study
Sallam, M., Salim, N. A., Barakat, M., Al-Mahzoum, K., Al-Tammemi, A. B., Malaeb, D., Hallit, R., & Hallit, S. (2023) · JMIR Medical Education · doi:10.2196/48254 · Cited by 234
“Unintended negative consequences, such as inappropriate or inaccurate content, pose significant risks in health care settings, necessitating careful consideration before its adoption in health care education [9,69-71].”
Self-citationThe use of ChatGPT in teaching and learning: a systematic review through SWOT analysis approach
Mai, D. T. T., Da, C. V., & Hanh, N. V. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1328769 · Cited by 213
Sohail, S. S., Farhat, F., Himeur, Y., Nadeem, M., Madsen, D. Ø., Singh, Y., Atalla, S., & Mansoor, W. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101675 · Cited by 192
“Despite the limitations of ChatGPT, its application has extended to various fields, including healthcare (Abdel-Messih and Kamel Boulos, 2023; Sallam, 2023), cyber security (Mijwil et al., 2023), environmental studies (Rillig et al., 2023), scientific writing (Salvagno et al., 2023; Lee, 2023b),…”
Garg, R. K., Urs, V. L., Agrawal, A. A., Chaudhary, S. K., Paliwal, V., & Kar, S. K. (2023) · Health Promotion Perspectives · doi:10.34172/hpp.2023.22 · Cited by 202
ChatGPT: Vision and challenges
Gill, S. S., & Kaur, R. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.05.004 · Cited by 224
“Moreover, ChatGPT can be leveraged to create tools that help doctors diagnose patients and provide care [16].”
BackgroundMarketing with ChatGPT: Navigating the Ethical Terrain of GPT-Based Chatbot Technology
Rivas, P., & Zhao, L. (2023) · AI · doi:10.3390/ai4020019 · Cited by 191
Assessing the research landscape and clinical utility of large language models: a scoping review
Park, Y.-J., Pillai, A., Deng, J., Guo, E., Gupta, M., Paget, M., & Naugler, C. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02459-6 · Cited by 187
ChatGPT in physics education: A pilot study on easy-to-implement activities
Bitzenbauer, P. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13176 · Cited by 181
Impact of ChatGPT on medical chatbots as a disruptive technology
Chow, J. C. L., Sanders, L., & Li, K. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1166014 · Cited by 188
“Unlike a specific medical chatbot, ChatGPT has not been trained on a finely-tuned dataset created by medical professionals (Sallam, 2023).”
BackgroundXu, X., Chen, Y., & Miao, J. (2024) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2024.21.6 · Cited by 169
“Given ChatGPT’s interactive capabilities, its enormous potential is foreseeable in assisting medical students in improving doctor-patient communication skills, helping to improve communication skills [26].”
BackgroundAl-Mughairi, H., & Bhaskar, P. (2025) · Journal of Research in Innovative Teaching & Learning · doi:10.1108/jrit-09-2023-0129 · Cited by 178
“Additionally, there is a concern that ChatGPT may diminish collaboration and teamwork among teachers (Arif et al ., 2023; Sallam et al ., 2023).”
BackgroundCombating misinformation in the age of LLMs: Opportunities and challenges
Chen, C., & Shu, K. (2024) · AI Magazine · doi:10.1002/aaai.12188 · Cited by 148
Mesko, B. (2023) · Journal of Medical Internet Research · doi:10.2196/48392 · Cited by 154
“Examples include education and research [3], analyzing electronic health records [4], oncology [5], cardiology [6], writing discharge summaries [7], and medical journalism [8].”
Investigating Students’ Perceptions towards Artificial Intelligence in Medical Education
Buabbas, A. J., Miskin, B., Alnaqi, A. A., Ayed, A. K., Shehab, A. A., Syed-Abdul, S., & Uddin, M. (2023) · Healthcare · doi:10.3390/healthcare11091298 · Cited by 152
“Moreover, ethical issues, bias, and limited knowledge are some concerns regarding ChatGPT [18].”
BackgroundInfluentialWang, M., Wang, M., Xu, X., Yang, L., Cai, D., & Yin, M. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3324714 · Cited by 218
“Furthermore, in a comprehensive review of 60 articles encompassing various academic disciplines, Sallam [74] identified the challenges linked to the use of ChatGPT in education, specifically in relation to accuracy and reliability.”
BackgroundHarnessing ChatGPT for Thematic Analysis: Are We Ready?
Lee, V. V., van der Lubbe, S. C. C., Goh, L. H., & Valderas, J. M. (2024) · Journal of Medical Internet Research · doi:10.2196/54974 · Cited by 178
“Due to its availability to the public and free-to-use model, there has been a proliferation of discussion in the scientific community about incorporating GPT and ChatGPT into various aspects of research, including literature review, data processing, and manuscript writing [11, 12].”
MethodGemini Versus ChatGPT: Applications, Performance, Architecture, Capabilities, and ImplementationPreprint
Rane, N., Choudhary, S., & Rane, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4723687 · Cited by 42
Enhancing Uncertainty-Based Hallucination Detection with Stronger FocusPreprint
Zhang, T., Qiu, L., Guo, Q., Deng, C., Zhang, Y., Zhang, Z., Zhou, C., Wang, X., & Fu, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.13230
Unveiling Students’ Experiences and Perceptions of Artificial Intelligence Usage in Higher Education
Zhou, X., Zhang, J., & Chan, C. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/xzjprb23 · Cited by 120
“The AIEd literature has discussed the drawbacks of generative AI in students’ learning (Sallam, 2023; Choi et al., 2023).”
BackgroundHow understanding large language models can inform the use of ChatGPT in physics education
Polverini, G., & Gregorcic, B. (2023) · European Journal of Physics · doi:10.1088/1361-6404/ad1420 · Cited by 200
Nguyen, T. T. H. (2023) · International Journal of Language Instruction · doi:10.54855/ijli.23231 · Cited by 203
“According to Shawar and Atwell (2007), a chatbot is software driven by artificial intelligence that can engage in natural language interactions with people.”
BackgroundChatGPT in thematic analysis: Can AI become a research assistant in qualitative research?
Nguyen‐Trung, K. (2025) · Quality & Quantity · doi:10.1007/s11135-025-02165-z · Cited by 171
Radiology-GPT: A Large Language Model for Radiology
Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.08666 · Cited by 59
An analysis of large language models: their impact and potential applications
Bharathi Mohan, G., Prasanna Kumar, R., Vishal Krishh, P., Keerthinathan, A., Lavanya, G., Meghana, M. K. U., Sulthana, S., & Doss, S. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-024-02120-8 · Cited by 99
“Concerning ChatGPT and similar LLMs’ potential to improve clinical operations, healthcare professionals have expressed cautious optimism [35].”
ChatGPT: perspectives from human–computer interaction and psychology
Liu, J. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1418869 · Cited by 99
“Sallam (2023) found that research with ChatGPT in fields such as healthcare, education, and academic research presents various issues, from plagiarism to incorrect answers and inaccurate citations.”
BackgroundAdapting to the Future: ChatGPT as a Means for Supporting Constructivist Learning Environments
Kim, M., & Adlof, L. (2024) · TechTrends · doi:10.1007/s11528-023-00899-x · Cited by 97
“Another limitation is that ChatGPT lacks real-time internet access, so its responses are limited to the dataset it was trained on, which delimits its scope of information up to the year 2021 (Sallam, 2023).”
The Security of Using Large Language Models: A Survey with Emphasis on ChatGPT
Zhou, W., Zhu, X., Han, Q.-L., Li, L., Chen, X., Wen, S., & Xiang, Y. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.124983 · Cited by 95
Exploring student perspectives on generative artificial intelligence in higher education learning
Baidoo-Anu, D., Asamoah, D., Amoako, I., & Mahama, I. (2024) · Discover Education · doi:10.1007/s44217-024-00173-z · Cited by 174
“Despite the advantages, concerns exist about AI-assisted cheating among students [7, 8].”
Chien, C.-C., Chan, H.-Y., & Hou, H.-T. (2025) · Journal of Research on Technology in Education · doi:10.1080/15391523.2024.2338085 · Cited by 90
“As for generative AI as scaffolding, Sallam (2023) pointed out that the use of ChatGPT in the educational domain may generate doubts related to its accuracy and reliability due to its limitations.”
Pahud de Mortanges, A., Luo, H., Shu, S. Z., Kamath, A., Suter, Y., Shelan, M., Pöllinger, A., & Reyes, M. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01190-w · Cited by 93
“LLMs have many potentially bene fi cial applications in healthcare practice and research, including diagnostic (e.g., prediction of disease risk and outcomes) and procedural (e.g., streamlining of clinical work fl ows, documentation, cost-effectiveness) tasks 59 .”
ChatGPT and Clinical Decision Support: Scope, Application, and Limitations
Ferdush, J., Begum, M., & Hossain, S. T. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03329-4 · Cited by 98
Thüs, D., Malone, S., & Brünken, R. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1474892 · Cited by 118
“5 and GPT-4 (Cooper, 2023; Herft, 2023; Kasneci et al., 2023; Pavlik, 2023; Qadir, 2023; Sallam, 2023; Zhai, 2022).”
Karakose, T., Demirkol, M., Yirci, R., Polat, H., Ozdemir, T. Y., & Tülübaş, T. (2023) · Administrative Sciences · doi:10.3390/admsci13070157 · Cited by 86
“Another significant concern is about the reliability and accuracy of the responses, which are generated based on the corpus data on which it is trained (Lecler et al. 2023; Sallam 2023; Stokel-Walker and Van Noorden 2023).”
BackgroundGeoGPT: Understanding and Processing Geospatial Tasks through An Autonomous GPT
Zhang, Y.-F., Wei, C., Wu, S., He, Z., & Yu, W. (2023) · arXiv.org · doi:10.48550/arxiv.2307.07930 · Cited by 73
“In the past years, artificial intelligence especially large language models (LLMs) develop rapidly, which shows a strong potential to solve challenges in different fields [12], [13], [14].”
BackgroundExploring the Role of ChatGPT in Education: Applications and Challenges
Mosaiyebzadeh, F., Pouriyeh, S., Parizi, R., Dehbozorgi, N., Dorodchi, M., & Macêdo Batista, D. (2023) · The 24th Annual Conference on Information Technology Education · doi:10.1145/3585059.3611445 · Cited by 63
“A major difference between ChatGPT and other AI-based LLMs is that it is able to generate and present entirely new content as the user converses with it in real-time [29].”
BackgroundBhat, M. A., Tiwari, C. K., Bhaskar, P., & Khan, S. T. (2024) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-03-2024-0033 · Cited by 111
Duah, J. E., & McGivern, P. (2024) · The International Journal of Information and Learning Technology · doi:10.1108/ijilt-11-2023-0213 · Cited by 67
ChatGPT: A brief narrative review
Gupta, B., Mufti, T., Sohail, S. S., & Madsen, D. Ø. (2023) · Cogent Business & Management · doi:10.1080/23311975.2023.2275851 · Cited by 107
“Much research has looked at the prospects of ChatGPT in the healthcare context (Cascella et al., 2023; Javaid et al., 2023; Li et al., 2023; Sallam, 2023; Vaishya et al., 2023).”
BackgroundInfluentialThe Impact of ChatGPT on Learning Motivation: A Study Based on Self-Determination Theory
Zhou, L., & Li, J. (2023) · Education Science and Management · doi:10.56578/esm010103 · Cited by 116
“At the same time, ensuring data privacy and security, as well as proper ethical and legal guidance, are crucial factors that must be considered (Sallam, 2023).”
BackgroundThe Role and Potential Contributions of the Artificial Intelligence Language Model ChatGPT
Berşe, S., Akça, K., Dirgar, E., & Kaplan Serin, E. (2024) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03296-w · Cited by 63
“Despite not being accountable for their actions or decisions, nurses will continue to be responsible for the clinical decisions they make based on the chatbot’s responses [17].”
Nia, M. F., Ahmadi, M., & Irankhah, E. (2025) · Frontiers in Dental Medicine · doi:10.3389/fdmed.2024.1456208 · Cited by 82
Beyond One-Model-Fits-All: A Survey of Domain Specialization for Large Language ModelsPreprint
Ling, C., Zhao, X.-J., Lu, J., Deng, C.-Y., Zheng, C., Wang, J., Chowdhury, T., Li, Y.-Q., Cui, H., Zhang, X.-C., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2305.18703 · Cited by 54
ChatGPT and Other Large Language Models in Medical Education — Scoping Literature Review
Aster, A., Laupichler, M. C., Rockwell-Kollmann, T., Masala, G., Bala, E., & Raupach, T. (2024) · Medical Science Educator · doi:10.1007/s40670-024-02206-6 · Cited by 75
Hu, J.-M., Liu, F.-C., Chu, C.-M., & Chang, Y.-T. (2023) · Journal of Medical Internet Research · doi:10.2196/49385 · Cited by 50
“ChatGPT was trained on diverse online texts, including books, articles, and websites, on topics ranging from news to Wikipedia to fiction, and it received reinforcement learning from human feedback [3,4].”
InfluentialHow trustworthy is ChatGPT? The case of bibliometric analyses
Farhat, F., Sohail, S. S., & Madsen, D. Ø. (2023) · Cogent Engineering · doi:10.1080/23311916.2023.2222988 · Cited by 56
“There is already a considerable body of research on the use of ChatGPT in different areas, as illustrated by several recent review articles (e.g., Dwivedi et al., 2023; Sohail et al., 2023; Khosravi et al., 2023; Lo, 2023; Sallam, 2023).”
BackgroundGenerative AI as source of change of knowledge management paradigm
Kaczorowska–Spychalska, D., Kotula, N., Mazurek, G., & Sułkowski, Ł. (2024) · Human Technology · doi:10.14254/1795-6889.2024.20-1.7 · Cited by 95
“This is because it does not have the typical ability to assess the reliability of the data (Sallam, 2023), as well as not always understand the meaning and essence of the words it processes (Gao et al., 2023), which further affects the credibility and reliability of the content and materials…”
BackgroundXu, R., & Wang, Z. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e32364 · Cited by 64
“Newly emerging studies begin to discuss the utility of ChatGPT [46,47], the accuracy and reliability of ChatGPT responses [48], the feasibility of ChatGPT [19], applicability of ChatGPT [49], the robustness of ChatGPT [50], when applied ChatGPT to healthcare.”
BackgroundInfluentialLong, C., Lowe, K., Zhang, J., Santos, A. D., Alanazi, A., O'Brien, D., Wright, E. D., & Cote, D. (2024) · JMIR Medical Education · doi:10.2196/49970 · Cited by 46
“Reviews on the application of ChatGPT in health care have been hopeful that it enhances efficiency, enables personalized learning, and encourages critical thinking skills among users, but concerns persist with the current limitations of ChatGPT’s knowledge, accuracy, and biases [4,5].”
BackgroundSurviving ChatGPT in healthcare
Liu, Z., Zhang, L., Wu, Z., Yu, X., Cao, C., Dai, H., Liu, N., Liu, J., Liu, W., Li, Q., et al. (2024) · Frontiers in Radiology · doi:10.3389/fradi.2023.1224682 · Cited by 63
A guide to prompt design: foundations and applications for healthcare simulationists
Maaz, S., Palaganas, J. C., Palaganas, G., & Bajwa, M. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2024.1504532 · Cited by 84
“Additional issues include bias, inequity, ethical concerns, acceptance of AI in healthcare education, and the long-term impact of integrating generative AI into teaching practices, including balancing overreliance, work efficiency, and originality (71, 72).”
Ethical Aspects of ChatGPT in Software Engineering Research
Akbar, M. A., Khan, A. A., & Liang, P. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3318183 · Cited by 49
“The research aims to comprehensively understand the ethical implications and potential threats associated with using ChatGPT in SE research and develop guidelines and recommendations for responsible research practices to mitigate these issues and threats [17].”
Salah, M., Abdelfattah, F., & Halbusi, H. A. (2024) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2024.101872 · Cited by 64
(2023) · Journal of Pharmaceutical Policy and Practice · doi:10.1186/s40545-023-00624-2 · Cited by 42
Li, H., Fu, J., & Python, A. (2025) · Journal of Medical Internet Research · doi:10.2196/71916 · Cited by 68
ChatGPT: Artificial Intelligence as a Potential Tool for Parents Seeking Information About Autism
McFayden, T. C., Bristol, S. K., Putnam, O. C., & Harrop, C. (2024) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2023.0202 · Cited by 61
“10 Thus, it has the potential to be a valuable resource about autism; and also another contributor to misinformation.”
Kufel, J., Paszkiewicz, I., Bielówka, M., Bartnikowska, W., Janik, M., Stencel, M., Czogalik, Ł., Gruszczyńska, K., & Mielcarska, S. (2023) · Polish Journal of Radiology · doi:10.5114/pjr.2023.131215 · Cited by 50
“This model was built upon the foundation of a large language model (LLM), and was trained on a huge amount of text data, exceeding 45 terabytes [2].”
MethodYan, L.-X., Sha, L., Zhao, L.-X., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2303.13379 · Cited by 42
“%) focused on using LLMs to automate classification tasks, there could be more future studies that aimed to tackle the automation of prediction and generation tasks with the more capable LLMs (Sallam, 2023).”
BackgroundMethodInfluentialThe Landscape and Challenges of HPC Research and LLMsPreprint
Chen, L., Ahmed, N. K., Dutta, A., Bhattacharjee, A., Yu, S., Mahmud, Q. I., Abebe, W. M., Phan, H., Sarkar, A., Butler, B., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.02018 · Cited by 49
Guo, J., Wang, M., Yin, H., Song, B., Chi, Y., Yu, F. R., & Yuen, C. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3496491 · Cited by 51
“Moreover, extensive explorations have been undertaken to apply LLMs and AIGC technologies in diverse application fields, including medical [19], [20], finance [21], [22], education [23], [24], software engineering [25], [26], and so on.”
BackgroundLong, C., Subburam, D., Lowe, K., dos Santos, A., Zhang, J., Hwang, S., Saduka, N., Horev, Y., Su, T., Côté, D. W. J., et al. (2024) · Otolaryngology–Head and Neck Surgery · doi:10.1002/ohn.864 · Cited by 46
“26,27 Some attempts have been made to address these issues, including developing LLMs that focus on speci fi c areas.”
The Value of Generative AI for Qualitative Research: A Pilot Study
Pattyn, F. (2024) · Journal of Data Science and Intelligent Systems · doi:10.47852/bonviewjdsis42022964 · Cited by 42
“Notably, we detected instances of 'hallucination' within this study—where the GAI generated superficial, inaccurate, or erroneous content [32].”
BackgroundKatib, I., Assiri, F. Y., Abdushkour, H. A., Hamed, D., & Ragab, M. (2023) · Mathematics · doi:10.3390/math11153400 · Cited by 38
Defending against Indirect Prompt Injection by Instruction Detection
Wen, T., Wang, C., Yang, X., Tang, H., Xie, Y., Lyu, L., Dou, Z., & Wu, F. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.1060 · Cited by 49
“These vulnerabilities pose significant security and ethical risks, particularly in sensitive domains like healthcare (Sallam, 2023; Harrer, 2023; Yang et al., 2023), finance (Wu et al., 2023; Li et al., 2023), and legal systems (Cui et al., 2023; Lai et al., 2024).”
Rane, N. L., Choudhary, S., & Rane, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4645601 · Cited by 78
Performance of ChatGPT and Bard in self-assessment questions for nephrology board renewal
Noda, R., Izaki, Y., Kitano, F., Komatsu, J., Ichikawa, D., & Shibagaki, Y. (2024) · Clinical and Experimental Nephrology · doi:10.1007/s10157-023-02451-w · Cited by 38
“Comparing the performance of LLMs in medical tasks with that of human experts serves as an important metric for verifying the potential use of AI in medical practice, with particular interest in evaluating the performance of AI in medical examinations [3,4].”
Liu, F., Chang, X., Zhu, Q., Huang, Y., Li, Y., & Wang, H. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06232-1 · Cited by 35
Rau, S., Rau, A., Nattenmüller, J., Fink, A., Bamberg, F., Reisert, M., & Russe, M. F. (2024) · European Radiology Experimental · doi:10.1186/s41747-024-00457-x · Cited by 33
“However, the transition into routine is hampered by the need for high-quality training data and the lack of transparency in the decision-making of LLMs [11, 14].”
BackgroundMethodThe Influence of AI ChatGPT on Improving Teachers' Creative Thinking
Liu, Z., Vobolevich, A., & Oparin, A. (2023) · International Journal of Learning, Teaching and Educational Research · doi:10.26803/ijlter.22.12.7 · Cited by 33
“The utilization of ChatGPT to unleash the creative potential of future teachers presents several potential advantages (Mhlanga, 2023; Sallam, 2023): 1.”
BackgroundUnraveling the landscape of large language models: a systematic review and future perspectives
Ding, Q., Ding, D., Wang, Y., Guan, C., & Ding, B. (2023) · Journal of Electronic Business & Digital Economics · doi:10.1108/jebde-08-2023-0015 · Cited by 58
Interpretable Medical Diagnostics with Structured Data Extraction by Large Language ModelsPreprint
Bisercic, A., Nikolić, M., van der Schaar, M., Delibašić, B., Lió, P., & Petrović, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.05052 · Cited by 38
Ren, Y., Ye, H., Fang, H., Zhang, X., & Song, G.-J. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2406.04214 · Cited by 28
“They are increasingly integrated into diverse human-AI systems, including critical domains such as education (Kasneci et al., 2023) and healthcare (Sallam, 2023), potentially influencing human decisions and cognition (Nguyen, 2023).”
Cloutier, N. A., & Japkowicz, N. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386772 · Cited by 42
“…advances in resampling have been occurring, similar advances have been made in generative LLMs, such as the GPT series of models from OpenAI, which have the ability to generate human-like text [16] and have been applied to fields such as patent claim generation [22] and healthcare education [27].”
BackgroundLiterature Review on the Integration of Generative AI in Programming Education
Nathaniel, J., Oyelere, S. S., Suhonen, J. T., & Tedre, M. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00524-3 · Cited by 66
“Although GenAI has aided code management and production (Sallam, 2023) and has been used for programming tutoring (Zambrano et al., 2023), significant challenges remain in effectively embedding these tools into programming curricula.”
Valentini, M., Szkandera, J., Smolle, M. A., Scheipl, S., Leithner, A., & Andreou, D. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1303319 · Cited by 36
Agharia, S., Szatkowski, J., Fraval, A., Stevens, J. M., & Zhou, Y. (2023) · Journal of Orthopaedics · doi:10.1016/j.jor.2023.11.063 · Cited by 33
Evade ChatGPT Detectors via A Single Space
Cai, S., & Cui, W. (2023) · arXiv · doi:10.48550/arxiv.2307.02599 · Cited by 7
“The advent of large language models like ChatGPT has undeniably created substantial social value (Felten et al., 2023; Zhai, 2022; Sallam, 2023b).”
BackgroundSiu, A. H. Y., Gibson, D., Chiu, C., Kwok, A. M. F., Irwin, M., Christie, A., Koh, C., Keshava, A., Reece, M. M., Suen, M., et al. (2024) · Colorectal Disease · doi:10.1111/codi.17267 · Cited by 33
Bogoslov, I. A., Corman, S., & Lungu, A. E. (2024) · Sustainability · doi:10.3390/su16114579 · Cited by 45
“Specifically, AI encompasses technologies such as machine learning, natural language understanding, computer vision, and natural language processing that enable machines to learn, adapt, reason, and interact with humans and their environments in a human-like manner [14,15].”
BackgroundSurapaneni, K. M., Rajajagadeesan, A., Goudhaman, L., Lakshmanan, S., Sundaramoorthi, S., Ravi, D., Rajendiran, K. S., & Swaminathan, P. (2023) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21808 · Cited by 29
“15,16 While ChatGPT's performance has been examined across various medical subjects, the specific field of medical biochemistry has remained relatively uncharted.”
BackgroundLegal and ethical considerations regarding the use of ChatGPT in education
Panagopoulou, F., Parpoula, C., & Karpouzis, K. (2023) · arXiv.org · doi:10.48550/arxiv.2306.10037 · Cited by 24
“Recently, in a systematic review preprint examining 60 ChatGPT-related articles, the potential limitations and future perspectives as regards ChatGPT’s use in healthcare education were investigated by Sallam (2023).”
BackgroundSun, L., & Zhou, L. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13236-3 · Cited by 37
“Sallam (2023) emphasizes the crucial role of AI in accelerating knowledge discovery and dissemination, which is particularly important in higher education.”
Artificial Intelligence Chatbot as Perceived by Nursing Students: A Qualitative Study
Gunawan, J., Aungsuroch, Y., Marzilli, C., Nazliansyah, N., Chaerani, E., & Montayre, J. (2024) · SAGE Open · doi:10.1177/21582440241303453 · Cited by 31
“The existing literature primarily comprises editorials, commentaries, opinions, letters to editors, and case studies on ChatGPT (Gunawan, 2023b; O’Connor, 2023; Sallam, 2023; Shay, 2023; Vitorino & Ju´nior, 2023).”
Metadata
- Authors
- Sallam, M.
- Affiliations
- University of Jordan (JO)
- Corresponding author
- Sallam, Malik
- ORCID
- Sallam, Malik
- Venue
- Healthcare
- Publisher
- openRxiv
- Published
- 2023-02-21
- Volume
- 11
- Issue
- 6
- Pages
- 887-887
- ISSN
- 2227-9032 (ISSN-L)
- PMC
- PMC10048148
- OpenAlex
- W4327946446
- Semantic Scholar
- 3bbb397ea3b09a10de198f167fba045da680b4e8
- Cited by
- 3,123
- References
- 78
- Citations by year
- 2026: 558 · 2025: 839 · 2024: 1052 · 2023: 669
- FWCI
- 36.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Healthcare (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- Preprints.org (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- ChatGPT, large language models, artificial intelligence in healthcare, healthcare education, health care research, clinical practice, scientific writing, research equity, drug discovery, personalized medicine, health literacy, plagiarism, hallucinations, authorship criteria, AI ethics, infodemic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.