CoChat
Sign Up
Cited by 242Artificial Intelligence in Healthcare and EducationArtificial Intelligence ApplicationsArtificial Intelligence in Healthcare

A Systematic Review and Meta-Analysis of Artificial Intelligence Tools in Medicine and Healthcare: Applications, Considerations, Limitations, Motivation and Challenges

Open access
Younis, Hussain A., Eisa, Taiseer Abdalla Elfadil, Nasser, Maged, Sahib, Thaeer Mueen, Noor, Ameen A., Alyasiri, Osamah Mohammed, Salisu, Sani, Hayder, Israa M. +1 more·2024·Diagnostics
DOI 10.3390/diagnostics14010109PMC PMC10802884
Open this paper in CoChat — free accountOpen PDF

Abstract

Artificial intelligence (AI) has emerged as a transformative force in various sectors, including medicine and healthcare. Large language models like ChatGPT showcase AI’s potential by generating human-like text through prompts. ChatGPT’s adaptability holds promise for reshaping medical practices, improving patient care, and enhancing interactions among healthcare professionals, patients, and data. In pandemic management, ChatGPT rapidly disseminates vital information. It serves as a virtual assistant in surgical consultations, aids dental practices, simplifies medical education, and aids in disease diagnosis. A total of 82 papers were categorised into eight major areas, which are G1: treatment and medicine, G2: buildings and equipment, G3: parts of the human body and areas of the disease, G4: patients, G5: citizens, G6: cellular imaging, radiology, pulse and medical images, G7: doctors and nurses, and G8: tools, devices and administration. Balancing AI’s role with human judgment remains a challenge. A systematic literature review using the PRISMA approach explored AI’s transformative potential in healthcare, highlighting ChatGPT’s versatile applications, limitations, motivation, and challenges. In conclusion, ChatGPT’s diverse medical applications demonstrate its potential for innovation, serving as a valuable resource for students, academics, and researchers in healthcare. Additionally, this study serves as a guide, assisting students, academics, and researchers in the field of medicine and healthcare alike.

AI snapshot

Written from the paper’s full text.

TL;DR

This PRISMA-based systematic review screened literature from November 2022 to August 2023 and included 82 papers on ChatGPT/AI in medicine and healthcare, grouping them into eight application domains. It reports broad potential across pandemic communication, dental and surgical consultation, education, diagnosis, imaging, and pharmaceutical research, while emphasizing ethical, accuracy, privacy, accountability, and human-oversight challenges.

Key findings

  • The final corpus comprised 82 papers: G1 treatment/medicine 27 (32.93%), G2 buildings/equipment 2 (2.44%), G3 body parts/disease areas 14 (17.07%), G4 patients 8 (9.76%), G5 citizens 3 (3.66%), G6 cellular imaging/radiology/pulse/medical images 4 (4.88%), G7 doctors/nurses 17 (20.73%), and G8 tools/devices/administration 7 (8.54%).
  • Reported ChatGPT applications include pandemic management and rapid dissemination of critical information, virtual assistance in cosmetic orthognathic surgery consultations, dental practice support, medical education, disease diagnosis, radiology/sonar image description, and pharmaceutical research.
  • Challenges and ethical considerations include responses based on training data that may be biased or inaccurate, AI-generated content mistaken for human expertise, the need to balance AI with human judgment, privacy and security, accountability, regulation, human oversight, and patient empowerment.
  • The stated motivation is to improve patient care, medical research, clinical decision-making, patient engagement, literature analysis, medical documentation, education, remote consultations, and clinical workflows.

Methods

  • A PRISMA-based systematic literature review searched Taylor and Francis (31), Google Scholar (179), Scopus (412), Web of Science (239), Elsevier (127), Springer (218), MDPI (41), IEEE Xplore (18), and Wiley (7); the initial query yielded 1273 articles, and the final set was 82 papers.
  • Inclusion criteria required English-language articles with specified ChatGPT/medicine/healthcare keywords, published or in press between November 2022 and August 2023, covering objectives, design, applications, benefits, risks, concerns, limitations, conclusions, and recommended actions; all article types were included.
  • Data gathering involved full-text review, classification, tabulation, and summarization; no quantitative meta-analytic pooling is described in the provided text.

Limitations

  • Stated: included studies tend to focus on theoretical potential rather than practical implementation; ethical and legal concerns persist about AI roles, accuracy, and originality; more comprehensive evaluations of AI-generated content are needed; overreliance may reduce human critical thinking; broader implications are often not thoroughly explored.
  • Stated: ChatGPT may provide inaccurate medical information, lacks full comprehension of complex medical contexts, may introduce training-data biases, raises privacy/consent/accountability issues, lacks real-time updates and dynamic learning, and may diminish the role of healthcare professionals through overdependence.
  • Evident: despite the title, no meta-analysis methods or results are reported; the search is restricted to English-language studies and a narrow November 2022–August 2023 window, and the focus is specifically on ChatGPT/AI tools, limiting generalizability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/diagnostics14010109

Cites

96 of 96 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 146 cited sources checked · 0 supported · 0 flagged

  • Findingcitation

    ChatGPT plays a crucial role in pandemic management by aiding in the swift and accurate dissemination of critical information.

    “ChatGPT plays a crucial role in pandemic management by aiding in the swift and accurate dissemination of critical information.”
    Quote in the paperNot a substantial claim0 of 7 sources checked
    • cites [5] Younis, 2023, ChatGPT in Waste Management: Is it a Profitable, Mesopotamian J. Big Data

      Not checked in the free run.

    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [7] Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., and Ricke, J. (Eur. Radiol., 2022). ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports, Eur. Radiol., ahead of print. source

      Not checked in the free run.

    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [42] Kaarre, 2023, Exploring the Potential of ChatGPT as a Supplementary Tool for Providing Orthopaedic Information, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

    • cites [43] Ollivier, 2023, A Deeper Dive into ChatGPT: History, Use and Future Perspectives for Orthopaedic Research, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

  • Interpretationcitation

    The integration of ChatGPT into medical practices and healthcare settings presents challenges and ethical considerations.

    “The integration of ChatGPT into medical practices and healthcare settings presents challenges and ethical considerations.”
    Quote in the paperSubstantial claim0 of 9 sources checked
    • cites [18] Busch, 2023, Biomedical Ethical Aspects Towards the Implementation of Artificial Intelligence in Medical Education in Medical Education, Med. Sci. Educ. source

      Not checked in the free run.

    • cites [19] Friederichs, 2023, ChatGPT in Medical School: How Successful Is AI in Progress Testing? ChatGPT in Medical School: How Successful Is AI in Progress Testing?, Med. Educ. Online source

      Not checked in the free run.

    • cites [27] Mohammed, 2023, ChatGPT Evaluation: Can It Replace Grammarly and Quillbot Tools?, Br. J. Appl. Linguistics source

      Not checked in the free run.

    • cites [31] Corsello, A., and Santangelo, A. (2023). May Artificial Intelligence Influence Future Pediatric Research?—The Case of ChatGPT. Children, 10. source

      Not checked in the free run.

    • cites [35] Pratim, 2023, AI Tackles Pandemics: ChatGPT’s Game–Changing Impact on Infectious Disease Control, Ann. Biomed. Eng. source

      Not checked in the free run.

    • cites [38] Kavian, J.A., Wilkey, H.L., Parth, A., and Boyd, C.J. (2023). Harvesting the Power of Arti Fi Cial Intelligence for Surgery: Uses, Implications, and Ethical Considerations. Am. Surg., 2–4. source

      Not checked in the free run.

    • cites [39] Dave, 2023, ChatGPT in Medicine: An Overview of Its Applications, Advantages, Limitations, Future Prospects, and Ethical Considerations, Front. Artif. Intell. source

      Not checked in the free run.

    • cites [40] Ruksakulpiwat, 2023, Using ChatGPT in Medical Research: Current Status and Future Directions, J. Multidiscip. Healthc. source

      Not checked in the free run.

    • cites [41] Tustumi, 2023, Future of the Language Models in Healthcare: The Role of Chatgpt, ABCD. Arq. Bras. Cir. Dig. source

      Not checked in the free run.

  • Premisecitation

    One challenge is that ChatGPT's responses are based on the data on which it was trained, which may result in biased or inaccurate information.

    “One challenge is that the responses of ChatGPT are based on the data on which it was trained, which may result in biased or inaccurate information.”
    • Also stated in: § 1.6. Navigating Limitations and Ethical Considerations · hedged
      “The responses are based on the data on which it was trained, potentially resulting in biased or inaccurate information.”
    Quote in the paperNot a substantial claim0 of 9 sources checked
    • cites [18] Busch, 2023, Biomedical Ethical Aspects Towards the Implementation of Artificial Intelligence in Medical Education in Medical Education, Med. Sci. Educ. source

      Not checked in the free run.

    • cites [19] Friederichs, 2023, ChatGPT in Medical School: How Successful Is AI in Progress Testing? ChatGPT in Medical School: How Successful Is AI in Progress Testing?, Med. Educ. Online source

      Not checked in the free run.

    • cites [27] Mohammed, 2023, ChatGPT Evaluation: Can It Replace Grammarly and Quillbot Tools?, Br. J. Appl. Linguistics source

      Not checked in the free run.

    • cites [31] Corsello, A., and Santangelo, A. (2023). May Artificial Intelligence Influence Future Pediatric Research?—The Case of ChatGPT. Children, 10. source

      Not checked in the free run.

    • cites [35] Pratim, 2023, AI Tackles Pandemics: ChatGPT’s Game–Changing Impact on Infectious Disease Control, Ann. Biomed. Eng. source

      Not checked in the free run.

    • cites [38] Kavian, J.A., Wilkey, H.L., Parth, A., and Boyd, C.J. (2023). Harvesting the Power of Arti Fi Cial Intelligence for Surgery: Uses, Implications, and Ethical Considerations. Am. Surg., 2–4. source

      Not checked in the free run.

    • cites [39] Dave, 2023, ChatGPT in Medicine: An Overview of Its Applications, Advantages, Limitations, Future Prospects, and Ethical Considerations, Front. Artif. Intell. source

      Not checked in the free run.

    • cites [40] Ruksakulpiwat, 2023, Using ChatGPT in Medical Research: Current Status and Future Directions, J. Multidiscip. Healthc. source

      Not checked in the free run.

    • cites [41] Tustumi, 2023, Future of the Language Models in Healthcare: The Role of Chatgpt, ABCD. Arq. Bras. Cir. Dig. source

      Not checked in the free run.

  • Premisecitation

    ChatGPT can function as a virtual assistant, offering patients crucial preoperative information for cosmetic orthognathic surgery.

    “Within the realm of surgical procedures, such as cosmetic orthognathic surgery, ChatGPT can function as a virtual assistant, offering patients crucial preoperative information.”
    Quote in the paperNot a substantial claim0 of 8 sources checked
    • cites [5] Younis, 2023, ChatGPT in Waste Management: Is it a Profitable, Mesopotamian J. Big Data

      Not checked in the free run.

    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [7] Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., and Ricke, J. (Eur. Radiol., 2022). ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports, Eur. Radiol., ahead of print. source

      Not checked in the free run.

    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [10] Xie, 2023, Aesthetic Surgery Advice and Counseling from Artificial Intelligence: A Rhinoplasty Consultation with ChatGPT, Aesthetic Plast. Surg. source

      Not checked in the free run.

    • cites [42] Kaarre, 2023, Exploring the Potential of ChatGPT as a Supplementary Tool for Providing Orthopaedic Information, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

    • cites [43] Ollivier, 2023, A Deeper Dive into ChatGPT: History, Use and Future Perspectives for Orthopaedic Research, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

  • Interpretationcitation

    Medical education can benefit significantly from AI-driven tools like ChatGPT.

    “Medical education can benefit significantly from AI-driven tools like ChatGPT.”
    Quote in the paperNot a substantial claim0 of 10 sources checked
    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [13] Hosseini, M., Gao, C.A., Liebovitz, D., Carvalho, A., Ahmad, F.S., Luo, Y., MacDonald, N., and Holmes, A.K. (2023). An Exploratory Survey about Using ChatGPT in Education, Healthcare, and Research. PLoS ONE, 18. source

      Not checked in the free run.

    • cites [14] Mohammed, A.O., Salisu, S.A., Younis, H., Salman, A.M., Sahib, T.M., Akhtom, D., and Hayder, I.M. (2023, November 18). ChatGPT Revisited: Using ChatGPT-4 for Finding References and Editing Language in Medical Scientific Articles. Available online: https://ssrn.com/abstract=4621581.

      Not checked in the free run.

    • cites [15] Khairatun, 2023, ChatGPT and Medical Education: A Double-Edged Sword, J. Pedagog. Educ. Sci. source

      Not checked in the free run.

    • cites [16] Abouammoh, N., Alhasan, K.A., Raina, R., Children, A., and Aljamaan, F. (Cold Spring Harb. Lab., 2023). Exploring Perceptions and Experiences of ChatGPT in Medical Education: A Qualitative Study Among Medical College Faculty and Students in Saudi Arabia Original Research: Exploring Perceptions and Experiences of ChatGPT in Medical Education: A Qualitativ, Cold Spring Harb. Lab., preprint. source

      Not checked in the free run.

    • cites [17] Gilson, 2023, How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment, JMIR Med. Educ. source

      Not checked in the free run.

    • cites [18] Busch, 2023, Biomedical Ethical Aspects Towards the Implementation of Artificial Intelligence in Medical Education in Medical Education, Med. Sci. Educ. source

      Not checked in the free run.

    • cites [19] Friederichs, 2023, ChatGPT in Medical School: How Successful Is AI in Progress Testing? ChatGPT in Medical School: How Successful Is AI in Progress Testing?, Med. Educ. Online source

      Not checked in the free run.

    • cites [20] Grabb, 2023, ChatGPT in Medical Education: A Paradigm Shift or a Dangerous Tool?, Acad. Psychiatry source

      Not checked in the free run.

  • Classified as probably not a substantial claim. 38
  • May combine two claims. 29

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The search and filtering process resulted in a total of 1547 papers before exclusions.

    “The papers were filtered according to the sequence that was adopted in this research and were divided into two categories: 1273 articles were published in the last eight months (November 2022 to August 2023) and 392 papers appeared in all nine databases or publishers, resulting in a total of 1547 papers.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    After title/abstract screening and full-text reading, 92 papers were excluded, leaving 82 papers.

    “Following a comprehensive scan of the titles and abstracts of the papers, an additional 1273 papers were excluded. After the final full-text reading, 92 papers were excluded. The final set consisted of 82 papers,”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The included articles comprised various types: 39 original research articles, 12 review articles, 5 meta-analysis and systematic reviews, 2 case studies, 1 editorial and opinion article, 6 letters to the editor, 1 perspective or commentary article, 4 short communications or brief reports, 1 technical note, 1 research protocol, 3 book reviews, 2 clinical trials and observational studies, and 5短报告.

    “We included all types of articles: original research articles, review articles, meta-analysis and systematic reviews, case studies, editorials and opinion articles, letters to the editor, perspective or commentary articles, short communications or brief reports, technical notes, research protocols, book reviews, clinical trials and observational studies, and short reports; the numbers included the”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The initial query search yielded 1273 articles.

    “The results of the initial query search, which yielded 1273 articles, are as follows: there are 31 articles from Taylor and Francis, 179 articles from Google Scholar, 412 articles from Scopus, 239 articles from Web of Science, 127 articles from Elsevier, 218 articles from Springer, 41 articles from MDPI, 18 articles from IEEE Xplore digital, and 7 articles from Wiley from between November 2022 and”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingcitation

    ChatGPT is integrated into dental practices to empower dental assistants and improve the overall patient experience.

    “ChatGPT is integrated into dental practices in order to empower dental assistants and improve the overall patient experience.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [11] Surovkov, J., Strunga, M., Lifkov, M., and Thurzo, A. (2023). The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci., 13. source

      Not checked in the free run.

    • cites [12] Mijwil, 2023, ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information, Mesopotamian J. Cyber Secur. source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Findingnone given

    The reviewed studies tend to focus on theoretical potential rather than practical implementation, leaving some real-world challenges unaddressed.

    “The limitations of these studies include a tendency to focus on theoretical potential rather than practical implementation, which leaves some real-world challenges unaddressed.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Findingreasoning

    Current studies frequently lack a thorough exploration of the broader implications of integrating AI, such as ChatGPT, into diverse fields.

    “Current studies frequently lack a thorough exploration of the broader implications, which necessitates adopting a more holistic approach to comprehending the complete scope and consequences of integrating AI, such as ChatGPT, into diverse fields.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    Significant concerns persist regarding the ethical and legal issues surrounding the roles, accuracy, and originality of AI.

    “Furthermore, significant concerns persist regarding the ethical and legal issues surrounding the roles, accuracy, and originality of AI.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingcitation

    ChatGPT can be used in pandemic management, surgical consultations, dental practices, medical education, disease diagnosis, cellular imaging, sonar imaging, radiology, and pharmaceutical research.

    “It was used in all areas: healthcare and management [5,6,7,8,9], aiding cosmetic orthognathic surgery consultation [10], revolutionising dental practices [8,11,12], medical scientific articles and education fields [6,9,13,14,15,16,17,18,19,20,21,22,23], support in disease diagnosis [24], revolutionising radiology, sonar imaging and writing assessment [13,25,26,27,28,29,30,31,32,33], pharmaceutical”
    Quote in the paperNot a substantial claim0 of 8 sources checked
    • cites [5] Younis, 2023, ChatGPT in Waste Management: Is it a Profitable, Mesopotamian J. Big Data

      Not checked in the free run.

    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [7] Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., and Ricke, J. (Eur. Radiol., 2022). ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports, Eur. Radiol., ahead of print. source

      Not checked in the free run.

    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [10] Xie, 2023, Aesthetic Surgery Advice and Counseling from Artificial Intelligence: A Rhinoplasty Consultation with ChatGPT, Aesthetic Plast. Surg. source

      Not checked in the free run.

    • cites [11] Surovkov, J., Strunga, M., Lifkov, M., and Thurzo, A. (2023). The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci., 13. source

      Not checked in the free run.

    • cites [12] Mijwil, 2023, ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information, Mesopotamian J. Cyber Secur. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Findingnone given

    ChatGPT's ability to simplify complex medical concepts has enhanced medical education, leading to improved knowledge acquisition.

    “The ability of ChatGPT to simplify complex medical concepts has enhanced medical education, leading to improved knowledge acquisition.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingreasoning

    ChatGPT expedited pharmaceutical research by sifting through scientific literature and suggesting research directions.

    “It accomplished this by sifting through scientific literature and suggesting research directions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    The integration of AI into dental practices has enhanced patient experiences by efficiently addressing inquiries and providing guidance.

    “The integration of AI into dental practices has enhanced patient experiences by efficiently addressing inquiries and providing guidance.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    Pharmaceutical research benefiting from ChatGPT was a realm that expedited research processes.

    “Pharmaceutical research, benefiting from ChatGPT, was another realm that expedited research processes.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Findingreasoning

    ChatGPT provided standardised information and facilitated informed patient decisions in cosmetic orthognathic surgery consultations.

    “It provided standardised information and facilitated informed patient decisions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    ChatGPT displayed potential in disease diagnosis by offering differential diagnoses based on patient-reported symptoms and medical history.

    “It also displayed potential in disease diagnosis by offering differential diagnoses based on patient-reported symptoms and medical history.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    ChatGPT demonstrated its role as a virtual assistant in the context of cosmetic orthognathic surgery consultations.

    “Furthermore, ChatGPT demonstrated its role as a virtual assistant in the context of cosmetic orthognathic surgery consultations.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    The use of ChatGPT in disseminating critical information during pandemics and infectious diseases has showcased its ability to efficiently communicate essential updates and guidelines to the public.

    “The use of ChatGPT in disseminating critical information during pandemics and infectious diseases has showcased its ability to efficiently communicate essential updates and guidelines to the public.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Study design and conductcitation

    A systematic literature review was conducted using the PRISMA methodology.

    “As part of this investigation, a systematic literature review was conducted using the PRISMA methodology (Supplementary Materials) [40,45,46,47,48,49,50].”
    Quote in the paperSubstantial claim0 of 7 sources checked
    • cites [40] Ruksakulpiwat, 2023, Using ChatGPT in Medical Research: Current Status and Future Directions, J. Multidiscip. Healthc. source

      Not checked in the free run.

    • cites [45] Liberati, A., Altman, D.G., Tetzlaff, J., Mulrow, C., Gøtzsche, P.C., Ioannidis, J.P.A., Clarke, M., Devereaux, P.J., Kleijnen, J., and Moher, D. (2009). The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. PLoS Med., 6. source

      Not checked in the free run.

    • cites [46] Page, 2021, The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews, BMJ source

      Not checked in the free run.

    • cites [47] Younis, H.A., Ruhaiyem, N.I.R., Badr, A.A., Abdul-Hassan, A.K., Alfadli, I.M., Binjumah, W.M., Altuwaijri, E.A., and Nasser, M. (2023). Multimodal Age and Gender Estimation for Adaptive Human-Robot Interaction: A Systematic Literature Review. Processes, 11. source

      Not checked in the free run.

    • cites [48] Salisu, S., Ruhaiyem, N.I.R., Eisa, T.A.E., Nasser, M., Saeed, F., and Younis, H.A. (2023). Motion Capture Technologies for Ergonomics: A Systematic Literature Review. Diagnostics, 13. source

      Not checked in the free run.

    • cites [49] Younis, H.A., Ruhaiyem, N.I.R., Ghaban, W., Gazem, N.A., and Nasser, M. (2023). A Systematic Literature Review on the Applications of Robots and Natural Language Processing in Education. Electronics, 12. source

      Not checked in the free run.

    • cites [50] Götz, S. (2018, January 14–19). Supporting Systematic Literature Reviews in Computer Science: The Systematic Literature Review Toolkit. Proceedings of the 21th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems, MODELS 2018, Copenhagen, Denmark. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT's natural language processing capabilities enable it to generate coherent responses, making it a valuable tool for healthcare organisations.

    “Its natural language processing capabilities enable it to generate coherent responses, making it a valuable tool for healthcare organisations.”
    Quote in the paperSubstantial claim0 of 7 sources checked
    • cites [5] Younis, 2023, ChatGPT in Waste Management: Is it a Profitable, Mesopotamian J. Big Data

      Not checked in the free run.

    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [7] Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., and Ricke, J. (Eur. Radiol., 2022). ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports, Eur. Radiol., ahead of print. source

      Not checked in the free run.

    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [42] Kaarre, 2023, Exploring the Potential of ChatGPT as a Supplementary Tool for Providing Orthopaedic Information, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

    • cites [43] Ollivier, 2023, A Deeper Dive into ChatGPT: History, Use and Future Perspectives for Orthopaedic Research, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT ensures standardised and accurate responses, thereby assisting patients in making informed decisions regarding their dental care.

    “ChatGPT ensures standardised and accurate responses, thereby assisting patients in making informed decisions regarding their dental care.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [11] Surovkov, J., Strunga, M., Lifkov, M., and Thurzo, A. (2023). The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci., 13. source

      Not checked in the free run.

    • cites [12] Mijwil, 2023, ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information, Mesopotamian J. Cyber Secur. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT assists in handling patient inquiries, providing oral health tips, and guiding patients through postoperative care instructions.

    “It assists in the handling of patient inquiries, the provision of oral health tips, and the guidance of patients through postoperative care instructions.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [11] Surovkov, J., Strunga, M., Lifkov, M., and Thurzo, A. (2023). The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci., 13. source

      Not checked in the free run.

    • cites [12] Mijwil, 2023, ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information, Mesopotamian J. Cyber Secur. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT provides rapid updates, preventive measures, and medical guidelines to the public during health crises.

    “Specific advantages include its ability to provide rapid updates, preventive measures, and medical guidelines to the public.”
    Quote in the paperSubstantial claim0 of 7 sources checked
    • cites [5] Younis, 2023, ChatGPT in Waste Management: Is it a Profitable, Mesopotamian J. Big Data

      Not checked in the free run.

    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [7] Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., and Ricke, J. (Eur. Radiol., 2022). ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports, Eur. Radiol., ahead of print. source

      Not checked in the free run.

    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [42] Kaarre, 2023, Exploring the Potential of ChatGPT as a Supplementary Tool for Providing Orthopaedic Information, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

    • cites [43] Ollivier, 2023, A Deeper Dive into ChatGPT: History, Use and Future Perspectives for Orthopaedic Research, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT can offer standardised and accurate responses that prepare patients for consultations and help them make informed decisions.

    “ChatGPT can offer standardised and accurate responses, which prepare patients for their consultations and help them make informed decisions [5,6,7,8,9,10,42,43].”
    Quote in the paperNot a substantial claim0 of 8 sources checked
    • cites [5] Younis, 2023, ChatGPT in Waste Management: Is it a Profitable, Mesopotamian J. Big Data

      Not checked in the free run.

    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [7] Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A.T., Topalis, J., Weber, T., Wesp, P., Sabel, B., and Ricke, J. (Eur. Radiol., 2022). ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports, Eur. Radiol., ahead of print. source

      Not checked in the free run.

    • cites [8] Fatani, 2023, ChatGPT for Future Medical and Dental Research, Cureus

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [10] Xie, 2023, Aesthetic Surgery Advice and Counseling from Artificial Intelligence: A Rhinoplasty Consultation with ChatGPT, Aesthetic Plast. Surg. source

      Not checked in the free run.

    • cites [42] Kaarre, 2023, Exploring the Potential of ChatGPT as a Supplementary Tool for Providing Orthopaedic Information, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

    • cites [43] Ollivier, 2023, A Deeper Dive into ChatGPT: History, Use and Future Perspectives for Orthopaedic Research, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    The integration of ChatGPT into medicine and healthcare holds significant potential to transform various aspects of patient care, education, diagnosis, and research.

    “In conclusion, the integration of ChatGPT into medicine and healthcare holds significant potential to transform various aspects of patient care, education, diagnosis, and research.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In pharmaceutical research, ChatGPT can contribute by sifting through vast volumes of scientific literature, identifying potential drug candidates, and suggesting innovative research directions.

    “In the realm of pharmaceutical research, ChatGPT can contribute by sifting through vast volumes of scientific literature, identifying potential drug candidates, and suggesting innovative research directions.”
    Quote in the paperNot a substantial claim0 of 7 sources checked
    • cites [11] Surovkov, J., Strunga, M., Lifkov, M., and Thurzo, A. (2023). The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci., 13. source

      Not checked in the free run.

    • cites [24] Huh, 2023, Can We Trust AI Chatbots’ Answers about Disease Diagnosis and Patient Care?, J. Korean Med. Assoc. source

      Not checked in the free run.

    • cites [34] Strunga, 2023, AI-Assisted CBCT Data Management in Modern Dental Practice: Benefits, Limitations and Innovations, Electronics source

      Not checked in the free run.

    • cites [35] Pratim, 2023, AI Tackles Pandemics: ChatGPT’s Game–Changing Impact on Infectious Disease Control, Ann. Biomed. Eng. source

      Not checked in the free run.

    • cites [36] Temsah, M., Aljamaan, F., Malki, K.H., and Alhasan, K. (2023). ChatGPT and the Future of Digital Health: A Study on Healthcare Workers’ Perceptions and Expectations. Healthcare, 11. source

      Not checked in the free run.

    • cites [37] Lukac, 2023, Evaluating ChatGPT as an Adjunct for the Multidisciplinary Tumor Board Decision–Making in Primary Breast Cancer Cases, Arch. Gynecol. Obstet. source

      Not checked in the free run.

    • cites [38] Kavian, J.A., Wilkey, H.L., Parth, A., and Boyd, C.J. (2023). Harvesting the Power of Arti Fi Cial Intelligence for Surgery: Uses, Implications, and Ethical Considerations. Am. Surg., 2–4. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT can generate potential differential diagnoses by analysing patient-reported symptoms and medical history, thereby aiding healthcare providers in narrowing down diagnostic possibilities.

    “ChatGPT can generate potential differential diagnoses by analysing patient-reported symptoms and medical history, thereby aiding healthcare providers in narrowing down diagnostic possibilities.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [24] Huh, 2023, Can We Trust AI Chatbots’ Answers about Disease Diagnosis and Patient Care?, J. Korean Med. Assoc. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT has the ability to analyse and generate descriptions for medical images, which can enhance the workflow of radiologists.

    “The potential of ChatGPT lies in its ability to analyse and generate descriptions for medical images, which can enhance the workflow of radiologists.”
    Quote in the paperNot a substantial claim0 of 10 sources checked
    • cites [13] Hosseini, M., Gao, C.A., Liebovitz, D., Carvalho, A., Ahmad, F.S., Luo, Y., MacDonald, N., and Holmes, A.K. (2023). An Exploratory Survey about Using ChatGPT in Education, Healthcare, and Research. PLoS ONE, 18. source

      Not checked in the free run.

    • cites [25] Currie, 2023, ChatGPT in Medical Imaging Higher Education, Radiography source

      Not checked in the free run.

    • cites [26] Dahmen, 2023, Artificial Intelligence Bot ChatGPT in Medical Research: The Potential Game Changer as a Double-Edged Sword, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

    • cites [27] Mohammed, 2023, ChatGPT Evaluation: Can It Replace Grammarly and Quillbot Tools?, Br. J. Appl. Linguistics source

      Not checked in the free run.

    • cites [28] Yang, J., Li, H.B., and Wei, D. (2023). The Impact of ChatGPT and LLMs on Medical Imaging Stakeholders: Perspectives and Use Cases. arXiv. source

      Not checked in the free run.

    • cites [29] Zhu, 2023, ChatGPT’s Potential Role in Non-English-Speaking Outpatient Clinic Settings, Digit. Health

      Not checked in the free run.

    • cites [30] Verhoeven, 2023, ChatGPT: When Artificial Intelligence Replaces the Rheumatologist in Medical Writing, Ann. Rheum. Dis. source

      Not checked in the free run.

    • cites [31] Corsello, A., and Santangelo, A. (2023). May Artificial Intelligence Influence Future Pediatric Research?—The Case of ChatGPT. Children, 10. source

      Not checked in the free run.

    • cites [32] Pozzessere, 2023, Optimizing Communication of Radiation Exposure in Medical Imaging, the Radiologist Challenge, Tomography source

      Not checked in the free run.

    • cites [33] Ning, 2023, The Potential of “Segment Anything” (SAM) for Universal Intelligent Ultrasound Image Guidance, Biosci. Trends source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT can provide initial observations that highlight regions of interest and assist radiologists in their analyses.

    “It has the ability to provide initial observations, which can highlight regions of interest and assist radiologists in their analyses [13,25,26,27,28,29,30,31,32,33].”
    Quote in the paperNot a substantial claim0 of 10 sources checked
    • cites [13] Hosseini, M., Gao, C.A., Liebovitz, D., Carvalho, A., Ahmad, F.S., Luo, Y., MacDonald, N., and Holmes, A.K. (2023). An Exploratory Survey about Using ChatGPT in Education, Healthcare, and Research. PLoS ONE, 18. source

      Not checked in the free run.

    • cites [25] Currie, 2023, ChatGPT in Medical Imaging Higher Education, Radiography source

      Not checked in the free run.

    • cites [26] Dahmen, 2023, Artificial Intelligence Bot ChatGPT in Medical Research: The Potential Game Changer as a Double-Edged Sword, Knee Surg. Sports Traumatol. Arthrosc. source

      Not checked in the free run.

    • cites [27] Mohammed, 2023, ChatGPT Evaluation: Can It Replace Grammarly and Quillbot Tools?, Br. J. Appl. Linguistics source

      Not checked in the free run.

    • cites [28] Yang, J., Li, H.B., and Wei, D. (2023). The Impact of ChatGPT and LLMs on Medical Imaging Stakeholders: Perspectives and Use Cases. arXiv. source

      Not checked in the free run.

    • cites [29] Zhu, 2023, ChatGPT’s Potential Role in Non-English-Speaking Outpatient Clinic Settings, Digit. Health

      Not checked in the free run.

    • cites [30] Verhoeven, 2023, ChatGPT: When Artificial Intelligence Replaces the Rheumatologist in Medical Writing, Ann. Rheum. Dis. source

      Not checked in the free run.

    • cites [31] Corsello, A., and Santangelo, A. (2023). May Artificial Intelligence Influence Future Pediatric Research?—The Case of ChatGPT. Children, 10. source

      Not checked in the free run.

    • cites [32] Pozzessere, 2023, Optimizing Communication of Radiation Exposure in Medical Imaging, the Radiologist Challenge, Tomography source

      Not checked in the free run.

    • cites [33] Ning, 2023, The Potential of “Segment Anything” (SAM) for Universal Intelligent Ultrasound Image Guidance, Biosci. Trends source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT's ability to explain intricate medical terminology in a comprehensible manner aids in knowledge acquisition, fostering continuous learning and improving medical literacy.

    “Its ability to explain intricate medical terminology in a comprehensible manner aids in knowledge acquisition, fostering continuous learning and improving medical literacy [6,9,13,14,15,16,17,18,19,20,21,22,23].”
    Quote in the paperNot a substantial claim0 of 10 sources checked
    • cites [6] Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11. source

      Not checked in the free run.

    • cites [9] Temsah, 2023, Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts, Cureus

      Not checked in the free run.

    • cites [13] Hosseini, M., Gao, C.A., Liebovitz, D., Carvalho, A., Ahmad, F.S., Luo, Y., MacDonald, N., and Holmes, A.K. (2023). An Exploratory Survey about Using ChatGPT in Education, Healthcare, and Research. PLoS ONE, 18. source

      Not checked in the free run.

    • cites [14] Mohammed, A.O., Salisu, S.A., Younis, H., Salman, A.M., Sahib, T.M., Akhtom, D., and Hayder, I.M. (2023, November 18). ChatGPT Revisited: Using ChatGPT-4 for Finding References and Editing Language in Medical Scientific Articles. Available online: https://ssrn.com/abstract=4621581.

      Not checked in the free run.

    • cites [15] Khairatun, 2023, ChatGPT and Medical Education: A Double-Edged Sword, J. Pedagog. Educ. Sci. source

      Not checked in the free run.

    • cites [16] Abouammoh, N., Alhasan, K.A., Raina, R., Children, A., and Aljamaan, F. (Cold Spring Harb. Lab., 2023). Exploring Perceptions and Experiences of ChatGPT in Medical Education: A Qualitative Study Among Medical College Faculty and Students in Saudi Arabia Original Research: Exploring Perceptions and Experiences of ChatGPT in Medical Education: A Qualitativ, Cold Spring Harb. Lab., preprint. source

      Not checked in the free run.

    • cites [17] Gilson, 2023, How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment, JMIR Med. Educ. source

      Not checked in the free run.

    • cites [18] Busch, 2023, Biomedical Ethical Aspects Towards the Implementation of Artificial Intelligence in Medical Education in Medical Education, Med. Sci. Educ. source

      Not checked in the free run.

    • cites [19] Friederichs, 2023, ChatGPT in Medical School: How Successful Is AI in Progress Testing? ChatGPT in Medical School: How Successful Is AI in Progress Testing?, Med. Educ. Online source

      Not checked in the free run.

    • cites [20] Grabb, 2023, ChatGPT in Medical Education: A Paradigm Shift or a Dangerous Tool?, Acad. Psychiatry source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    ChatGPT holds promise in facilitating medical education, supporting remote consultations, and optimising clinical workflows.

    “In addition, it holds promise in facilitating medical education, supporting remote consultations, and optimising clinical workflows.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Sallam et al. [44] assessed that ChatGPT is beneficial for learning but lacks emotional interaction and poses plagiarism risks in healthcare education.

    “Sallam et al. [44] assessed the advantages and disadvantages of ChatGPT in healthcare education. While it is beneficial for learning, it lacks emotional interaction and poses plagiarism risks.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [44] Sallam, 2023, ChatGPT Applications in Medical, Dental, Pharmacy, and Public Health Education: A Descriptive Study Highlighting the Advantages and Limitations, Narra J source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Serious medical errors could occur if ChatGPT misinterprets patient queries or generates incorrect diagnoses.

    “Serious medical errors could occur if patient queries are misinterpreted or incorrect diagnoses are generated.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    ChatGPT's reliance on training data may introduce biases that could impact the quality and fairness of the information it provides.

    “Furthermore, the reliance of ChatGPT on training data may introduce biases, which could potentially impact the quality and fairness of the provided information.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    ChatGPT can assist in drug discovery, research proposal writing, and summarising complex medical research, expediting the research process.

    “It can assist in drug discovery, research proposal writing, and summarising complex medical research, expediting the research process [11,24,34,35,36,37,38].”
    Quote in the paperNot a substantial claim0 of 7 sources checked
    • cites [11] Surovkov, J., Strunga, M., Lifkov, M., and Thurzo, A. (2023). The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci., 13. source

      Not checked in the free run.

    • cites [24] Huh, 2023, Can We Trust AI Chatbots’ Answers about Disease Diagnosis and Patient Care?, J. Korean Med. Assoc. source

      Not checked in the free run.

    • cites [34] Strunga, 2023, AI-Assisted CBCT Data Management in Modern Dental Practice: Benefits, Limitations and Innovations, Electronics source

      Not checked in the free run.

    • cites [35] Pratim, 2023, AI Tackles Pandemics: ChatGPT’s Game–Changing Impact on Infectious Disease Control, Ann. Biomed. Eng. source

      Not checked in the free run.

    • cites [36] Temsah, M., Aljamaan, F., Malki, K.H., and Alhasan, K. (2023). ChatGPT and the Future of Digital Health: A Study on Healthcare Workers’ Perceptions and Expectations. Healthcare, 11. source

      Not checked in the free run.

    • cites [37] Lukac, 2023, Evaluating ChatGPT as an Adjunct for the Multidisciplinary Tumor Board Decision–Making in Primary Breast Cancer Cases, Arch. Gynecol. Obstet. source

      Not checked in the free run.

    • cites [38] Kavian, J.A., Wilkey, H.L., Parth, A., and Boyd, C.J. (2023). Harvesting the Power of Arti Fi Cial Intelligence for Surgery: Uses, Implications, and Ethical Considerations. Am. Surg., 2–4. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    There is a risk of overdependence on AI, which may diminish the role of healthcare professionals and reduce critical thinking and human interaction in medical care.

    “Lastly, there is a risk of overdependence on AI, which may diminish the role of healthcare professionals, thereby reducing critical thinking and human interaction in medical care.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    ChatGPT's natural language processing capabilities provide a user-friendly interface for patients to seek medical information, resulting in increased patient engagement and empowerment.

    “ChatGPT’s natural language processing capabilities provide a user-friendly interface for patients to seek medical information, resulting in increased patient engagement and empowerment.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Johnson, D et al. [5] found that ChatGPT's answers to medical queries by academic physician specialists were generally accurate but with limitations, suggesting a need for further research and model development.

    “Johnson, D et al. [5] utilised the accuracy and completeness of ChatGPT in answering medical queries by academic physician specialists. The results generally show accurate information with limitations, which suggests a need for further research and model development.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [5] Younis, 2023, ChatGPT in Waste Management: Is it a Profitable, Mesopotamian J. Big Data

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    ChatGPT's ability to analyse large amounts of medical literature assists healthcare professionals in staying up to date on the latest research and treatment options.

    “Its ability to analyse large amounts of medical literature assists healthcare professionals in staying up to date on the latest research and treatment options.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    ChatGPT has the potential to provide inaccurate medical information because it lacks the ability to fully comprehend complex medical contexts.

    “One key concern is the potential for inaccuracies in medical information provided by ChatGPT, as it lacks the ability to fully comprehend complex medical contexts.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The motivation for integrating ChatGPT with medicine and healthcare stems from the potential to improve patient care, medical research, and clinical decision-making processes.

    “The motivation for integrating ChatGPT with medicine and healthcare stems from the potential to improve patient care, medical research, and clinical decision-making processes.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Ethical challenges arise regarding patient data privacy and consent, as well as accountability for AI-generated medical content.

    “Ethical challenges arise regarding patient data privacy and consent, as well as accountability for AI-generated medical content.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    A PRISMA-based systematic literature review was conducted as part of this investigation.

    “As part of this investigation, a PRISMA-based systematic literature review was conducted.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The lack of real-time updates and dynamic learning in ChatGPT could lead to the sharing of outdated or obsolete medical information.

    “The sharing of outdated or obsolete medical information could be a potential consequence of the lack of real-time updates and dynamic learning in ChatGPT.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    ChatGPT can assist in the generation of accurate and concise medical documentation, thereby streamlining administrative tasks for healthcare providers.

    “ChatGPT can assist in the generation of accurate and concise medical documentation, thereby streamlining administrative tasks for healthcare providers.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    AI has the potential to transform many industries, including medicine and healthcare.

    “AI has the potential to transform many industries, including medicine and healthcare.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In a hybrid panel discussion, approximately 40% of participants had utilised ChatGPT, with a higher number of trainees compared to faculty members having experimented with it.

    “According to the study, approximately 40% of the participants had utilised ChatGPT, with a higher number of trainees compared to faculty members having experimented with it.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] Hosseini, M., Gao, C.A., Liebovitz, D., Carvalho, A., Ahmad, F.S., Luo, Y., MacDonald, N., and Holmes, A.K. (2023). An Exploratory Survey about Using ChatGPT in Education, Healthcare, and Research. PLoS ONE, 18. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Large language models, such as ChatGPT, have attracted attention for their ability to generate human-like text, revolutionising the healthcare landscape.

    “Large language models, such as ChatGPT, have attracted attention for their ability to generate human-like text, revolutionising the healthcare landscape.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    ChatGPT acts as a catalyst for innovation, advancement, and improved patient care within the medical landscape.

    “The role of ChatGPT as a catalyst for innovation, advancement, and improved patient care within the medical landscape is underscored by this exploration.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    In cellular imaging, radiology, and sonar imaging, the descriptive capabilities of ChatGPT could be helpful for radiologists in the analysis of medical images and cellular imaging.

    “In the fields of cellular imaging, radiology, and sonar imaging, the descriptive capabilities of ChatGPT could be helpful for radiologists in the analysis of medical images and cellular imaging.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    ChatGPT offers immense potential.

    “However, ChatGPT offers immense potential; however, it also has limitations that stem from its training data and ethical concerns that are related to its output.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The integration of ChatGPT into medicine and healthcare holds vast transformative potential.

    “In conclusion, the integration of ChatGPT into medicine and healthcare holds vast transformative potential.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    ChatGPT has limitations that stem from its training data and ethical concerns related to its output.

    “However, ChatGPT offers immense potential; however, it also has limitations that stem from its training data and ethical concerns that are related to its output.”
    Quote in the paperSubstantial claim
52 of 52

  • The paper relies on this without support.

    Medical professionals frequently use specialised terminology and jargon that may be difficult for a general-purpose chatbot to understand.

    “Medical professionals frequently use specialised terminology and jargon that may be difficult for a general-purpose chatbot to understand.”

  • The paper relies on this without support.

    Ensuring that the information provided by the chatbot is accurate and reliable is of utmost importance in healthcare.

    “Of utmost importance in healthcare is ensuring that the information provided by the chatbot is accurate and reliable.”

  • The paper relies on this without support.

    Healthcare data are highly sensitive and subject to strict privacy regulations (like HIPAA in the United States).

    “Healthcare data are highly sensitive and subject to strict privacy regulations (like HIPAA in the United States).”

  • The paper relies on this without support.

    Decisions made by chatbots in healthcare settings can have real-life consequences.

    “Decisions made by chatbots in healthcare settings can indeed have real-life consequences.”

  • The paper relies on this without support.

    Determining who is accountable for incorrect advice or recommendations provided by a chatbot can be a complex matter.

    “Determining who is accountable for incorrect advice or recommendations provided by a chatbot can be a complex matter.”

  • The paper relies on this without support.

    There is a requirement for human oversight and intervention, particularly in critical situations, when chatbots assist in healthcare tasks.

    “Although chatbots can assist in various healthcare tasks, there is a requirement for human oversight and intervention, particularly in critical situations.”

  • The paper relies on this without support.

    Chatbots that provide medical advice may unintentionally bypass the regulatory frameworks established for traditional healthcare providers.

    “Chatbots that provide medical advice may unintentionally bypass the regulatory frameworks established for traditional healthcare providers.”
7 of 7

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Several ethical concerns regarding the use of AI in UGME are described, including algorithmic bias and safeguarding the privacy of students and patients.

    “Several ethical concerns regarding the use of AI in UGME are described [183]. There are concerns related to algorithmic bias [159] and safeguarding the privacy of students and patients [185, 186].”

    From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [185]

    Section 1.6, “Navigating Limitations and Ethical Considerations” (page unavailable), discusses ethical concerns about ChatGPT and reports plagiarism risks in healthcare education. Section 1.2 discusses its use by medical students, but the paper does not specifically frame those concerns as arising in undergraduate medical education. The citing sentence assigns algorithmic bias and privacy to other references, so those examples are not assessed against this source. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Reported paper counts do not yield the stated total

    Major

    Adding the two counts that the paper says result in 1547 papers gives 1665 instead.

    Reported 1547 · recomputed 1665

  • Citation [5] is attributed to an author absent from reference [5]

    Minor

    The text attributes citation [5] to Johnson, D et al., but reference [5] lists Mueen Sahib T. et al. and has a different subject.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Almisreb, 2023, Exploring Medical Breakthroughs: A Systematic Review of ChatGPT Applications in Healthcare, Southeast Eur. J. Soft Comput., 12, 13

Cited by

Sorted by citations

Related

Authors
Younis, H. A., Eisa, T. A. E., Nasser, M., Sahib, T. M., Noor, A. A., Alyasiri, O. M., Salisu, S., Hayder, I. M., & Younis, H. A.
Affiliations
  • University of Basrah (IQ)
  • King Khalid University (SA)
  • Universiti Teknologi Petronas (MY)
  • Al-Furat Al-Awsat Technical University (IQ)
  • Mustansiriyah University (IQ)
  • Federal University Dutse (NG)
  • Southern Technical University (IQ)
Corresponding author
Younis, Hussain A.
ORCID
Venue
Diagnostics
Publisher
MDPI AG
Published
2024-01-04
Volume
14
Issue
1
Pages
109
ISSN
2075-4418 (ISSN-L)
DOI
10.3390/diagnostics14010109
PMC
PMC10802884
OpenAlex
W4390587679
Semantic Scholar
5062b5b11fa9a528a3ae31da099c51555b8c6a0f
Cited by
242
References
91
Citations by year
2026: 73 · 2025: 94 · 2024: 72 · 2023: 2 · 2022: 1
FWCI
5.39
Type
journal article
Language
en
Open access
Licence
Locations
  • Diagnostics (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Deanship of Scientific Research at King Khalid University (RGP2/52/44)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
artificial intelligence in healthcare, ChatGPT, large language models, diagnosis, medical education, radiology, cell imaging, pandemic response, virtual assistants

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review