The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.
The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations
Open accessPreprint — published as 10.3390/healthcare11060887 · Paper page
Abstract
An artificial intelligence (AI)-based conversational large language model (LLM) was launched in November 2022 namely, “ChatGPT”. Despite the wide array of potential applications of LLMs in healthcare education, research and practice, several valid concerns were raised. The current systematic review aimed to investigate the possible utility of ChatGPT and to highlight its limitations in healthcare education, research and practice. Using the PRIMSA guidelines, a systematic search was conducted to retrieve English records in PubMed/MEDLINE and Google Scholar under the term “ChatGPT”. Eligibility criteria included the published research or preprints of any type that discussed ChatGPT in the context of healthcare education, research and practice. A total of 280 records were identified, and following full screening, a total of 60 records were eligible for inclusion. Benefits/applications of ChatGPT were cited in 51/60 (85.0%) records with the most common being the utility in scientific writing followed by benefits in healthcare research (efficient analysis of massive datasets, code generation and rapid concise literature reviews besides utility in drug discovery and development). Benefits in healthcare practice included cost saving, documentation, personalized medicine and improved health literacy. Concerns/possible risks of ChatGPT use were expressed in 58/60 (96.7%) records with the most common being the ethical issues including the risk of bias, plagiarism, copyright issues, transparency issues, legal issues, lack of originality, incorrect responses, limited knowledge, and inaccurate citations. Despite the promising applications of ChatGPT which can result in paradigm shifts in healthcare education, research and practice, the embrace of this application should be done with extreme caution. Specific applications of ChatGPT in health education include the promising utility in personalized learning tools and shift towards more focus on critical thinking and problem-based learning. In healthcare practice, ChatGPT can be valuable for streamlining the workflow and refining personalized medicine. Saving time for the focus on experimental design and enhancing research equity and versatility are the benefits in scientific research. Regarding authorship in scientific articles, as it currently stands, ChatGPT does not qualify to be listed as an author unless the ICMJE/COPE guidelines are revised and amended. An initiative involving all stakeholders involved in healthcare education, research and practice is urgently needed to set a code of ethics and conduct on the responsible practices involving ChatGPT among other LLMs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In this exploratory study, we observed a high level of ease of use among the small group of participants who reported using ChatGPT, likely due to its user-friendly nature and free accessibility [17,71,90].”
From Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study (2023) · cites this paper as [71]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With regard to transparency, two sources suggest that LLM-supported diagnoses hamper the process of providing adequate justification due to their opacity36,74.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [74]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Unintended negative consequences, such as inappropriate or inaccurate content, pose significant risks in health care settings, necessitating careful consideration before its adoption in health care education [9,69-71].”
From Assessing Health Students' Attitudes and Usage of ChatGPT in Jordan: Validation Study (2023) · cites this paper as [71]
The cited source says what the claim attributes to it.
In the citing paper
“LLMs have many potentially beneficial applications in healthcare practice and research, including diagnostic (e.g., prediction of disease risk and outcomes) and procedural (e.g., streamlining of clinical workflows, documentation, cost-effectiveness) tasks59.”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [59]
The cited source says what the claim attributes to it.
In the citing paper
“Consequently, there is a noticeable demand for ethical guidelines, as evidenced within the literature surrounding healthcare applications of LLMs46,60,64,70,71,74,75,78.”
From The ethics of ChatGPT in medicine and healthcare: a systematic review on large language models (LLMs) (2024) · cites this paper as [74]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“The current systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRIMSA) guidelines [20].”
MethodLanguage Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 2×
“, San Francisco, CA, USA), ChatGPT etymology is related to being a chatbot (a program able to understand and generate responses using a text-based interface) and being based on the Generative Pre-trained Transformer (GPT) architecture [6,7].”
BackgroundKaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955 · cited 1×
“This was followed by the development of machine learning (ML) algorithms that allow decision making or predictions based on the patterns in large datasets [4].”
BackgroundKung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · cited 2×
“The need to rethink and revise the current assessment tools in healthcare education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE), and possibility of ChatGPT misuse that would result in increased academic dishonesty [28,34,64,66,68,72].”
BackgroundRajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · cited 1×
“The utility of AI in healthcare appears promising with possible applications in personalized medicine, drug discovery, and analysis of large datasets has been outlined previously besides the potential benefits in improving diagnosis and clinical decisions [17,18].”
BackgroundChatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · cited 1×
“The need to rethink and revise the current assessment tools in healthcare education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE), and possibility of ChatGPT misuse that would result in increased academic dishonesty [28,34,64,66,68,72].”
BackgroundChatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955
McCarthy, J., Minsky, M., Rochester, N., et al. (2006) · The AI Magazine · doi:10.1609/aimag.v27i4.1904 · Cited by 2,029 · cited 1×
“The history of AI as a scientific discipline can be traced back to the mid-XX century at the Dartmouth Summer Research Project on AI [3].”
BackgroundPrecision medicine, AI, and the future of personalized health care
Johnson, K. B., Wei, W., Weeraratne, D., Frisse, M. E., Misulis, K., Rhee, K., Zhao, J., & Snowdon, J. L. (2021) · Clinical and Translational Science · doi:10.1111/cts.12884 · Cited by 1,854 · cited 1×
“The utility of AI in healthcare appears promising with possible applications in personalized medicine, drug discovery, and analysis of large datasets has been outlined previously besides the potential benefits in improving diagnosis and clinical decisions [17,18].”
BackgroundChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842 · cited 5×
“integrity, transparency and honesty [32].”
BackgroundInfluentialChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437 · cited 3×
“The need to rethink and revise the current assessment tools in healthcare education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE), and possibility of ChatGPT misuse that would result in increased academic dishonesty [28,34,64,66,68,72].”
BackgroundChatting about ChatGPT: how may AI and GPT impact academia and libraries?
Lund, B. D., & Wang, T. (2023) · Library Hi Tech News · doi:10.1108/lhtn-01-2023-0009 · Cited by 1,355
Sarker, I. H. (2022) · SN Computer Science · doi:10.1007/s42979-022-01043-x · Cited by 1,208 · cited 1×
“and linguistics that aspires to create machines capable of performing tasks that normally require human intelligence [1].”
BackgroundGao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022) · doi:10.1101/2022.12.23.521610 · Cited by 1,099 · cited 4×
“Moreover, the utility of ChatGPT extends to involve the improvement in language and better ability to express and communicate the research ideas and results, ultimately speeding up the publication process with faster availability of research results [26,29,35,36,44,49,77].”
BackgroundMethodInfluentialChatting about ChatGPT: How May AI and GPT Impact Academia and Libraries?Preprint
Lund, B. D., & Wang, T. (2023) · Social Science Research Network · doi:10.2139/ssrn.4333415 · Cited by 1,093 · cited 4×
“, the focus on experimental design) [14,27,32,33,38,47,55,58,78,79].”
BackgroundInfluentialChatGPT and other large language models are double-edged swords
Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023) · Radiology · doi:10.1148/radiol.230163 · Cited by 1,008 · cited 1×
“The utility of ChatGPT to streamline the clinical workflow appears promising with expected increased efficiency in healthcare delivery and saving costs [53,65,74,76].”
BackgroundPeer Review: A Flawed Process at the Heart of Science and Journals
Smith, R. (2006) · Journal of the Royal Society of Medicine · doi:10.1177/014107680609900414 · Cited by 880 · cited 1×
“In academic writing, a question would arise if the authors would prefer an AI-editor and an AI-reviewer considering the previous flaws in the editorial and peer review processes [80-82].”
BackgroundChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868 · cited 2×
“The disapproval of including ChatGPT or any other LLM in the list of authors was clearly explained in Science, Nature, and the Lancet editorials referring to its use as a scientific misconduct, and this view was echoed by many scientists [28,30,38,70,77].”
BackgroundWhat ChatGPT and generative AI mean for science
Stokel-Walker, C., & Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-00340-6 · Cited by 828 · cited 6×
“Third, the generation of non-original, over-detailed or excessive content can be an additional burden for the researchers who should carefully supervise ChatGPT-generated content [14,28,29,31,39,55].”
BackgroundMethodInfluentialChatGPT: the future of discharge summaries?
Patel, S. B., & Lam, K. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00021-3 · Cited by 728
ChatGPT and the Rise of Large Language Models: The New AI-Driven Infodemic Threat in Public Health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · doi:10.2139/ssrn.4352931 · Cited by 708
ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health
De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1166120 · Cited by 708 · cited 4×
“Moreover, the utility of ChatGPT extends to involve the improvement in language and better ability to express and communicate the research ideas and results, ultimately speeding up the publication process with faster availability of research results [26,29,35,36,44,49,77].”
BackgroundInfluentialYeo, Y. H., Samaan, J. S., Ng, W. H., Ting, P.-S., Trivedi, H., Vipani, A., Ayoub, W., Yang, J. D., Liran, O., Spiegel, B., et al. (2023) · doi:10.1101/2023.02.06.23285449 · Cited by 666
Yeo, Y. H., Samaan, J. S., Ng, W. H., Ting, P.-S., Trivedi, H., Vipani, A., Ayoub, W., Yang, J. D., Liran, O., Spiegel, B., et al. (2023) · Clinical and Molecular Hepatology · doi:10.3350/cmh.2023.0089 · Cited by 662 · cited 3×
“However, ChatGPT emulation of empathetic responses was reported in a preprint in the context of hepatic disease [61].”
BackgroundIntroducing artificial intelligence training in medical education
Paranjape, K., Schinkel, M., Nannan Panday, R., Car, J., & Nanayakkara, P. (2019) · JMIR Medical Education · doi:10.2196/16048 · Cited by 634 · cited 1×
“Additionally, an interesting area to probe is the utility of AI in healthcare education considering the massive information and various concepts that healthcare students have to grasp [19].”
BackgroundChatGPT - Reshaping medical education and clinical management
Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.39.2.7653 · Cited by 628 · cited 3×
“…in bias and inaccurate information limited to the period prior to the year 2021, and current inability to handle images, as well as the low performance in some topics (e.g., failure to pass a parasitology exam for Korean medical students) and the issue of possible plagiarism [51,60,62,63,67,68].”
BackgroundHuman- versus Artificial Intelligence
Korteling, J. E. (., van de Boer-Visschedijk, G. C., Blankendaal, R. A. M., Boonekamp, R. C., & Eikelboom, A. R. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.622364 · Cited by 619
The benefits and challenges of chatgpt: An overview
Deng, J., & Lin, Y. (2023) · Frontiers in Computing and Intelligent Systems · doi:10.54097/fcis.v2i2.4465 · Cited by 611 · cited 3×
“Additionally, security concerns and the potential of cyber-attacks with spread of misinformation utilizing LLMs should be considered as well [11].”
BackgroundInfluentialTools such as ChatGPT threaten transparent science; here are our ground rules for their use
(2023) · Nature · doi:10.1038/d41586-023-00191-1 · Cited by 605
Generating scholarly content with ChatGPT: Ethical challenges for medical publishing
Liebrenz, M., Schleifer, R., Buadze, A., Bhugra, D., & Smith, A. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00019-5 · Cited by 594 · cited 5×
“Finally, the issue of listing ChatGPT as an author does not appear acceptable based on the current ICMJE and COPE guidelines for determining authorship as illustrated by Zielinski et al. and Liebrenz et al. [25,36].”
BackgroundMethodInfluentialOpen artificial intelligence platforms in nursing education: Tools for academic progress or abuse?
O’Connor, S., & ChatGPT (2023) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103537 · Cited by 585 · cited 3×
“Additionally, ChatGPT availability can be considered as a motivation in healthcare education based on the personalized interaction it provides, enabling powerful self-learning as well as its utility as an adjunct in group learning [52,63,67,68,71].”
BackgroundChatGPT and the future of medical writing
Biswas, S. (2023) · Radiology · doi:10.1148/radiol.223312 · Cited by 571 · cited 4×
“Medico-legal issues and accountability in case of medical errors caused by ChatGPT application should be carefully considered [27].”
BackgroundMethodInfluentialAntaki, F., Touma, S., Milad, D., El-Khoury, J., & Duval, R. (2023) · doi:10.1101/2023.01.22.23284882 · Cited by 563
Evaluating the Performance of ChatGPT in Ophthalmology
Antaki, F., Touma, S., Milad, D., El-Khoury, J., & Duval, R. (2023) · Ophthalmology Science · doi:10.1016/j.xops.2023.100324 · Cited by 563 · cited 2×
“…in bias and inaccurate information limited to the period prior to the year 2021, and current inability to handle images, as well as the low performance in some topics (e.g., failure to pass a parasitology exam for Korean medical students) and the issue of possible plagiarism [51,60,62,63,67,68].”
BackgroundChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B. O., Ricke, J., et al. (2023) · European Radiology · doi:10.1007/s00330-023-10213-1 · Cited by 549 · cited 3×
“[65] arXiv preprint on ChatGPT utility to simplify and summarize radiology reports Generation of medical information relevant for the patients; moving towards patient-centered care; cost efficiency Bias and fairness issues; misinterpretation of medical terms; imprecise responses; odd language; hallucination (plausible…”
BackgroundAI bot ChatGPT writes smart essays — should professors worry?
Stokel-Walker, C. (2022) · Nature · doi:10.1038/d41586-022-04397-7 · Cited by 543
Artificial intelligence: Implications for the future of work
Howard, J. (2019) · American Journal of Industrial Medicine · doi:10.1002/ajim.23037 · Cited by 522 · cited 2×
“In the scientific community and academia, ChatGPT received mixed responses reflecting the history of controversy regarding the benefits vs. risks of advanced AI-technologies [8-10].”
A Categorical Archive of ChatGPT Failures
Borji, A. (2023) · arXiv · doi:10.48550/arxiv.2302.03494 · Cited by 514 · cited 1×
“A noteworthy and comprehensive record by Borji can be used as a categorical guide for the issues and concerns of ChatGPT use especially in scientific writing [24].”
BackgroundAI for life: Trends in artificial intelligence for biotechnology
Holzinger, A., Keiblinger, K., Holub, P., Zatloukal, K., & Müller, H. (2023) · New Biotechnology · doi:10.1016/j.nbt.2023.02.001 · Cited by 438 · cited 3×
“The issue of reproducibility between prompt runs is of particular importance in healthcare practice [42].”
BackgroundOpenAI ChatGPT Generated Literature Review: Digital Twin in Healthcare
Aydın, Ö., & Karaarslan, E. (2022) · doi:10.2139/ssrn.4308687 · Cited by 391 · cited 2×
“…in several sources as an efficient and promising tool for conducting comprehensive literature reviews and generating computer codes, thereby saving time for the research steps that require more efforts from human intelligence (e.g., the focus on experimental design) [14,27,32,33,38,47,55,58,78,79].”
BackgroundMethodChatGPT: Evolution or revolution?
Gordijn, B., & Have, H. T. (2023) · Medicine, Health Care and Philosophy · doi:10.1007/s11019-023-10136-0 · Cited by 317 · cited 3×
“Sixth, legal issues were raised by several records as well, including copyright issues [14,27,57,73,75].”
BackgroundChatGPT is shaping the future of medical writing but still requires human judgment
Kitamura, F. C. (2023) · Radiology · doi:10.1148/radiol.230171 · Cited by 317 · cited 4×
“Moreover, the utility of ChatGPT extends to involve the improvement in language and better ability to express and communicate the research ideas and results, ultimately speeding up the publication process with faster availability of research results [26,29,35,36,44,49,77].”
BackgroundInfluentialThe impact of artificial intelligence on human society and bioethics
Tai, M.-T. (2020) · Tzu Chi Medical Journal · doi:10.4103/tcmj.tcmj_71_20 · Cited by 293 · cited 1×
“In the scientific community and academia, ChatGPT received mixed responses reflecting the history of controversy regarding the benefits vs. risks of advanced AI-technologies [8-10].”
BackgroundHuh, S. (2023) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2023.20.1 · Cited by 278 · cited 1×
“…in bias and inaccurate information limited to the period prior to the year 2021, and current inability to handle images, as well as the low performance in some topics (e.g., failure to pass a parasitology exam for Korean medical students) and the issue of possible plagiarism [51,60,62,63,67,68].”
BackgroundCan ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591703 · Cited by 275
ChatGPT passing USMLE shines a spotlight on the flaws of medical education
Mbakwe, A. B., Lourentzou, I., Celi, L. A., Mechanic, O. J., & Dagan, A. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000205 · Cited by 273 · cited 2×
“The focus on questions involving the assessment of critical and problem-based thinking appears of utmost value [66].”
BackgroundChatterjee, J., & Dethlefs, N. (2023) · Patterns · doi:10.1016/j.patter.2022.100676 · Cited by 263
Health, T. L. D. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00023-7 · Cited by 257
Evaluating ChatGPT as an Adjunct for Radiologic Decision-Making
Rao, A., Kim, J., Kamineni, M., Pang, M., Lie, W., & Succi, M. D. (2023) · doi:10.1101/2023.02.02.23285399 · Cited by 257 · cited 4×
“Moreover, ChatGPT showed moderate accuracy to determine the imaging steps needed in breast cancer screening and evaluation of breast pain which can be a promising application in decision making in radiology [50].”
BackgroundInfluentialChatGPT and other artificial intelligence applications speed up scientific writing
Chen, T.-J. (2023) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000000900 · Cited by 240 · cited 4×
“Moreover, the utility of ChatGPT extends to involve the improvement in language and better ability to express and communicate the research ideas and results, ultimately speeding up the publication process with faster availability of research results [26,29,35,36,44,49,77].”
BackgroundInfluentialCan ChatGPT pass the life support exams without entering the American heart association course?
Fijačko, N., Gosak, L., Štiglic, G., Picard, C. T., & John Douma, M. (2023) · Resuscitation · doi:10.1016/j.resuscitation.2023.109732 · Cited by 206 · cited 3×
“[63] Letter to the editor to report the accuracy of ChatGPT responses to life support exam questions by the AHA Relevant, accurate responses on occasions Referencing issues; over-detailed ChatGPT did not pass any of the exams; however, it can be a powerful self-learning tool to prepare for the life support exams”
BackgroundMethodRapamycin in the context of Pascal's Wager: generative pre-trained transformer perspective
Generative Pre-trained Transformer, C., & Zhavoronkov, A. (2022) · Oncoscience · doi:10.18632/oncoscience.571 · Cited by 203 · cited 2×
“This utility was demonstrated by ChatGPT responses highlighting the need to consult healthcare providers among other reliable sources on specific situations [16,56].”
BackgroundWhy and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · doi:10.31234/osf.io/sdx3j · Cited by 202
Why and how to embrace AI such as ChatGPT in your academic life
Lin, Z. (2023) · Royal Society Open Science · doi:10.1098/rsos.230658 · Cited by 202 · cited 3×
“Sixth, legal issues were raised by several records as well, including copyright issues [14,27,57,73,75].”
BackgroundHS Kumar, A. (2023) · Biology, Engineering, Medicine and Science Reports · doi:10.5530/bems.9.1.5 · Cited by 165 · cited 1×
“Thus, ChatGPT can be useful in healthcare education including enhanced communication skills given proper academic mentoring [22,45,67].”
BackgroundAnalysis of large-language model versus human performance for genetics questions
Duong, D., & Solomon, B. D. (2023) · doi:10.1101/2023.01.27.23285115 · Cited by 159 · cited 2×
“Issues of interpretability, reproducibility and handling of uncertainty were raised as well, which can have harmful consequences in healthcare settings including research [46,58,59].”
BackgroundChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information
Mijwil, M., Aljanabi, M., & Ali, A. H. (2023) · Mesopotamian Journal of CyberSecurity · doi:10.58496/mjcs/2023/004 · Cited by 155
AI in the hands of imperfect users
Kostick, K. M., & Gerke, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00737-z · Cited by 137
ChatGPT, An Artificial Intelligence Chatbot, Is Impacting Medical Literature
Lubowitz, J. H. (2023) · Arthroscopy · doi:10.1016/j.arthro.2023.01.015 · Cited by 132
Sallam, M., Salim, N. A., Al-Tammemi, A. B., Barakat, M., Fayyad, D., Hallit, S., Harapan, H., Hallit, R., & Mahafzah, A. (2023) · Cureus · doi:10.7759/cureus.35029 · Cited by 130 · cited 2×
“In healthcare practice and academic writing, factual inaccuracies, ethical issues and fear of misuse including the spread of misinformation should be considered [14-16].”
BackgroundSelf-citationA conversation with ChatGPT on the role of computational systems biology in stem cell research
Cahan, P., & Treutlein, B. (2023) · Stem Cell Reports · doi:10.1016/j.stemcr.2022.12.009 · Cited by 125
Moons, P., & Van Bulck, L. (2023) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvad022 · Cited by 118 · cited 3×
“…hand, the use of ChatGPT in academic writing and scientific research should be done in light of the following current limitations that could compromise the quality of research: First, superficial, inaccurate or incorrect content was frequently cited as a shortcoming of ChatGPT use [14,47,49,77,79].”
BackgroundMethodD'Amico, R. S., White, T. G., Shah, H. A., & Langer, D. J. (2023) · Neurosurgery · doi:10.1227/neu.0000000000002414 · Cited by 118 · cited 3×
“The concerns regarding data governance, cybersecurity of medical information and data privacy should draw specific attention in the discussion regarding the utility of LLMs in healthcare [48,54,76].”
BackgroundExploring the future of nursing: Insights from the ChatGPT model
Gunawan, J. (2023) · Belitung Nursing Journal · doi:10.33546/bnj.2551 · Cited by 117 · cited 1×
“The utility of ChatGPT to streamline the clinical workflow appears promising with expected increased efficiency in healthcare delivery and saving costs [53,65,74,76].”
BackgroundExploring ChatGPT for information of cardiopulmonary resuscitation
Ahn, C. (2023) · Resuscitation · doi:10.1016/j.resuscitation.2023.109729 · Cited by 112
Marchandot, B., Matsushita, K., Carmona, A., Trimaille, A., & Morel, O. (2023) · European Heart Journal Open · doi:10.1093/ehjopen/oead007 · Cited by 99
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B., Ricke, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.14882 · Cited by 97 · cited 3×
“[65] arXiv preprint on ChatGPT utility to simplify and summarize radiology reports Generation of medical information relevant for the patients; moving towards patient-centered care; cost efficiency Bias and fairness issues; misinterpretation of medical terms; imprecise responses; odd language; hallucination (plausible…”
BackgroundArtificial Intelligence Discusses the Role of Artificial Intelligence in Translational Medicine
Mann, D. L. (2023) · JACC: Basic to Translational Science · doi:10.1016/j.jacbts.2023.01.001 · Cited by 93 · cited 2×
“Importantly, the current LLMs including ChatGPT does not appear to be able to comprehend the complexity of biologic systems needed in healthcare decisions and research [43,46].”
Background(2023) · Iraqi Journal for Computer Science and Mathematics · doi:10.52866/20ijcsm.2023.01.01.0018 · Cited by 91 · cited 1×
“…in several sources as an efficient and promising tool for conducting comprehensive literature reviews and generating computer codes, thereby saving time for the research steps that require more efforts from human intelligence (e.g., the focus on experimental design) [14,27,32,33,38,47,55,58,78,79].”
MethodThe good, the bad and the rude peer-review
Mavrogenis, A. F., Quaile, A., & Scarlat, M. M. (2020) · International Orthopaedics · doi:10.1007/s00264-020-04504-1 · Cited by 85 · cited 1×
“flaws in the editorial and peer review processes [80-82].”
BackgroundZielinski, C., Winker, M. A., Aggarwal, R., Ferris, L. E., Heinemann, M., Lapeña, J. F. F., Pai, S. A., Ing, E. B., & Citrome, L. (2023) · Afro-Egyptian Journal of Infectious and Endemic Diseases · doi:10.21608/aeji.2023.282936 · Cited by 76
Sanmarchi, F., Bucci, A., Nuzzolese, A. G., Carullo, G., Toscano, F., Nante, N., & Golinelli, D. (2023) · Journal of Public Health · doi:10.1007/s10389-023-01936-y · Cited by 76 · cited 5×
“Issues of interpretability, reproducibility and handling of uncertainty were raised as well, which can have harmful consequences in healthcare settings including research [46,58,59].”
BackgroundMethodInfluentialChatGPT for Clinical Vignette Generation, Revision, and Evaluation
Benoit, J. R. A. (2023) · doi:10.1101/2023.02.04.23285478 · Cited by 74 · cited 3×
“Thus, ChatGPT can be useful in healthcare education including enhanced communication skills given proper academic mentoring [22,45,67].”
BackgroundSanmarchi, F., Bucci, A., & Golinelli, D. (2023) · doi:10.1101/2023.02.06.23285514 · Cited by 70
Manohar, N., & Prasad, S. S. (2023) · Cureus · doi:10.7759/cureus.34616 · Cited by 63 · cited 2×
“This was clearly shown in two recently published case studies with ChatGPT use in a journal contest [40,41,49].”
BackgroundResultChatGPT and medical education: a double-edged sword
Khairatun Hisan, U., & Miftahul Amri, M. (2023) · Journal of Pedagogy and Education Science · doi:10.56741/jpes.v2i01.302 · Cited by 63 · cited 2×
“Hisan and Amri [64] RG preprint on ChatGPT use medical education Generation of educational content; useful to learn languages Ethical concerns; scientific fraud (papermills); inaccurate responses; declining quality of educations with the issues of cheating Appropriate medical exam design, especially for practical skil…”
BackgroundScientific novelty beyond the experiment
Hallsworth, J. E., Udaondo, Z., Pedrós‐Alió, C., Höfer, J., Benison, K. C., Lloyd, K. G., Cordero, R. J. B., de Campos, C. B. L., Yakimov, M. M., & Amils, R. (2023) · Microbial Biotechnology · doi:10.1111/1751-7915.14222 · Cited by 62 · cited 3×
“Subsequently, this can help to promote equity and diversity in research [32,57].”
BackgroundIs ChatGPT a Good Tool for T&CM Students in Studying Pharmacology?
Nisar, S., & Aslam, M. S. (2023) · doi:10.2139/ssrn.4324310 · Cited by 60 · cited 2×
“16 Nisar and Aslam [69] SSRN preprint on the assessment of ChatGPT usefulness to study pharmacology Good accuracy Content not sufficient for research purposes Can be a helpful self-learning tool”
BackgroundShould Artificial Intelligent Agents be Your Co-author? Arguments in Favour, Informed by ChatGPT
Polonsky, M. J., & Rotman, J. D. (2023) · Australasian Marketing Journal · doi:10.1177/14413582231167882 · Cited by 59 · cited 1×
“However, other researchers suggested the possibility of inclusion of ChatGPT as an author in some specified instances [37,79].”
BackgroundSharma, G., & Thakur, A. (2023) · doi:10.26434/chemrxiv-2023-qgs3k · Cited by 48
Wogu, I. A. P., Olu-Owolabi, F. E., Assibong, P. A., Agoha, B. E., Sholarin, M. A., Elegbeleye, A., Igbokwe, D. O., & Apeh, H. A. (2017) · International Conference on Computing Networking and Informatics (ICCNI) · doi:10.1109/iccni.2017.8123792 · Cited by 42 · cited 2×
“In the scientific community and academia, ChatGPT received mixed responses reflecting the history of controversy regarding the benefits vs. risks of advanced AI-technologies [8-10].”
Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023) · arXiv · doi:10.48550/arxiv.2302.03495 · Cited by 40
Better by you, better than me, chatgpt3 as writing assistance in students essaysPreprint
Bašić, Ž., Banovac, A., Kružić, I., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.04536 · Cited by 35
Neuro-mesodermal assembloids recapitulate aspects of peripheral nervous system development in vitro
Rockel, A. F., Wagner, N., Spenger, P., Ergün, S., & Wörsdörfer, P. (2023) · Stem Cell Reports · doi:10.1016/j.stemcr.2023.03.012 · Cited by 34 · cited 3×
“…hand, the use of ChatGPT in academic writing and scientific research should be done in light of the following current limitations that could compromise the quality of research: First, superficial, inaccurate or incorrect content was frequently cited as a shortcoming of ChatGPT use [14,47,49,77,79].”
BackgroundResultMargalida, A., & Colomer, M. À. (2016) · PeerJ · doi:10.7717/peerj.1670 · Cited by 31 · cited 1×
“In academic writing, a question would arise if the authors would prefer an AI-editor and an AI-reviewer considering the previous flaws in the editorial and peer review processes [80-82].”
BackgroundAkhter, H. M., & Cooper, J. S. (2023) · Cureus · doi:10.7759/cureus.34752 · Cited by 29 · cited 2×
“This was clearly shown in two recently published case studies with ChatGPT use in a journal contest [40,41,49].”
BackgroundResultZielinski, C., Winker, M., Aggarwal, R., Ferris, L., Heinemann, M., Lapeña, Jr., Pai, S., Ing, E., & Citrome, L. (2023) · Open Access Macedonian Journal of Medical Sciences · doi:10.3889/oamjms.2023.11502 · Cited by 29
Transparency Guidance for ChatGPT Usage in Scientific Writing
Aczel, B., & Wagenmakers, E.-J. (2023) · doi:10.31234/osf.io/b58ex · Cited by 28
Epstein, R. H., & Dexter, F. (2023) · JMIR Medical Education · doi:10.2196/48305 · Cited by 26 · cited 3×
“…in bias and inaccurate information limited to the period prior to the year 2021, and current inability to handle images, as well as the low performance in some topics (e.g., failure to pass a parasitology exam for Korean medical students) and the issue of possible plagiarism [51,60,62,63,67,68].”
BackgroundHuh, S. (2023) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2023.20.5 · Cited by 25 · cited 2×
“In case of ChatGPT use in the research process, several records advocated the need for proper and concise disclosure and documentation of ChatGPT or LLM use in the methodology or acknowledgement sections [35,39,70].”
BackgroundMethodTobore, T. O. (2018) · Psychological Reports · doi:10.1177/0033294118792670 · Cited by 13 · cited 1×
“The innate resistance of the human mind to any change is a well-described phenomenon and can be understandable from evolutionary and social psychology perspectives [12].”
BackgroundPolonsky, M. J., & Rotman, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4349524 · Cited by 13
Mackay, A. (1974) · Nature · doi:10.1038/250698c0 · Cited by 5
Research works printed but not linked: 4
- Domingos, P. The master algorithm: how the quest for the ultimate learning machine will remake our world, First paperback edition ed.; Basic Books, a member of the Perseus Books Group: New York, 2018; p. 329 pages.
- 10.13140/RG.2.2.31280.23043/1 · DOI
- 10.52866/IJCSM.2023.01.01.0018 · doi:10.52866/ijcsm.2023.01.01.0018 · Paper page
- 10.1258/jrsm.99.4.178 · doi:10.1258/jrsm.99.4.178 · Paper page
Cited by
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024
“Immediate action must be taken to mitigate the impact of ChatGPT on education.”
BackgroundA SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384
The imperative for regulatory oversight of large language models (or generative AI) in healthcare
Meskó, B., & Topol, E. J. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00873-0 · Cited by 1,047
“Systematic reviews highlighted other potential bene fi ts too such as improved scienti fi c writing, enhancing research equity, streamlining the healthcare work fl ow, cost saving, and improved personalized learning in medical education 3,4 .”
Practical and ethical challenges of large language models in education: A systematic scoping review
Yan, L., Sha, L., Zhao, L., Li, Y., Martinez‐Maldonado, R., Chen, G., Li, X., Jin, Y., & Gašević, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13370 · Cited by 1,435
“%) focused on using LLMs to automate classification tasks, there could be more future studies that aimed to tackle the automation of prediction and generation tasks with the more capable LLMs (Sallam, 2023).”
BackgroundMethodInfluentialLarge language models in healthcare and medical domain: A reviewPreprint
Nazi, Z. A., & Peng, W. (2023) · Informatics · doi:10.48550/arxiv.2401.06775 · Cited by 562
“It is therefore crucial for medical professionals to exercise caution and thoroughly review and validate the recommendations provided by large language models before integrating them into their clinical decision-making processes [127].”
Background
Metadata
- Authors
- Sallam, M.
- Affiliations
- University of Jordan (JO)
- Corresponding author
- Sallam, Malik
- ORCID
- Sallam, Malik
- Venue
- Healthcare
- Publisher
- openRxiv
- Published
- 2023-02-21
- Volume
- 11
- Issue
- 6
- Pages
- 887-887
- ISSN
- 2227-9032 (ISSN-L)
- PMC
- PMC10048148
- OpenAlex
- W4327946446
- Semantic Scholar
- 3bbb397ea3b09a10de198f167fba045da680b4e8
- Cited by
- 3,123
- References
- 78
- Citations by year
- 2026: 558 · 2025: 839 · 2024: 1052 · 2023: 669
- FWCI
- 36.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Healthcare (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- Preprints.org (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- ChatGPT, large language models, artificial intelligence in healthcare, healthcare education, health care research, clinical practice, scientific writing, research equity, drug discovery, personalized medicine, health literacy, plagiarism, hallucinations, authorship criteria, AI ethics, infodemic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.