Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.

The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations

Open access
Sallam, Malik·2023·Healthcare

Preprint — published as 10.3390/healthcare11060887 · Paper page

Abstract

An artificial intelligence (AI)-based conversational large language model (LLM) was launched in November 2022 namely, “ChatGPT”. Despite the wide array of potential applications of LLMs in healthcare education, research and practice, several valid concerns were raised. The current systematic review aimed to investigate the possible utility of ChatGPT and to highlight its limitations in healthcare education, research and practice. Using the PRIMSA guidelines, a systematic search was conducted to retrieve English records in PubMed/MEDLINE and Google Scholar under the term “ChatGPT”. Eligibility criteria included the published research or preprints of any type that discussed ChatGPT in the context of healthcare education, research and practice. A total of 280 records were identified, and following full screening, a total of 60 records were eligible for inclusion. Benefits/applications of ChatGPT were cited in 51/60 (85.0%) records with the most common being the utility in scientific writing followed by benefits in healthcare research (efficient analysis of massive datasets, code generation and rapid concise literature reviews besides utility in drug discovery and development). Benefits in healthcare practice included cost saving, documentation, personalized medicine and improved health literacy. Concerns/possible risks of ChatGPT use were expressed in 58/60 (96.7%) records with the most common being the ethical issues including the risk of bias, plagiarism, copyright issues, transparency issues, legal issues, lack of originality, incorrect responses, limited knowledge, and inaccurate citations. Despite the promising applications of ChatGPT which can result in paradigm shifts in healthcare education, research and practice, the embrace of this application should be done with extreme caution. Specific applications of ChatGPT in health education include the promising utility in personalized learning tools and shift towards more focus on critical thinking and problem-based learning. In healthcare practice, ChatGPT can be valuable for streamlining the workflow and refining personalized medicine. Saving time for the focus on experimental design and enhancing research equity and versatility are the benefits in scientific research. Regarding authorship in scientific articles, as it currently stands, ChatGPT does not qualify to be listed as an author unless the ICMJE/COPE guidelines are revised and amended. An initiative involving all stakeholders involved in healthcare education, research and practice is urgently needed to set a code of ethics and conduct on the responsible practices involving ChatGPT among other LLMs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2023.02.19.23286155

Cites

95 of 95 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Flowchart of the record selection process based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRIMSA) guidelines.
Figure 1 Flowchart of the record selection process based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRIMSA) guidelines.CC BY · PubMed Central
Figure 2 Summary of the types of included records (n = 60). Preprints (not peer reviewed) are highlighted in grey while published records are highlighted in blue.
Figure 2 Summary of the types of included records (n = 60). Preprints (not peer reviewed) are highlighted in grey while published records are highlighted in blue.CC BY · PubMed Central
Figure 3 Summary of benefits/applications of ChatGPT in health care education, research, and practice based on the included records.
Figure 3 Summary of benefits/applications of ChatGPT in health care education, research, and practice based on the included records.CC BY · PubMed Central
Figure 4 Summary of risks/concerns of ChatGPT use in health care education, research, and practice based on the included records.
Figure 4 Summary of risks/concerns of ChatGPT use in health care education, research, and practice based on the included records.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 78 references

Research works printed but not linked: 4

  1. Domingos, P. The master algorithm: how the quest for the ultimate learning machine will remake our world, First paperback edition ed.; Basic Books, a member of the Perseus Books Group: New York, 2018; p. 329 pages.
  2. 10.13140/RG.2.2.31280.23043/1 · DOI
  3. 10.52866/IJCSM.2023.01.01.0018 · doi:10.52866/ijcsm.2023.01.01.0018 · Paper page
  4. 10.1258/jrsm.99.4.178 · doi:10.1258/jrsm.99.4.178 · Paper page

Cited by

See all 3,123

Metadata

Authors
Sallam, M.
Affiliations
University of Jordan (JO)
Corresponding author
Sallam, Malik
Venue
Healthcare
Publisher
openRxiv
Published
2023-02-21
Volume
11
Issue
6
Pages
887-887
ISSN
2227-9032 (ISSN-L)
OpenAlex
W4327946446
Cited by
3,123
References
78
Citations by year
2026: 558 · 2025: 839 · 2024: 1052 · 2023: 669
FWCI
36.63
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Healthcare (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, cc-by-nc-nd)
  • Preprints.org (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Social Sciences › Education › Artificial Intelligence in Education
Keywords
ChatGPT, large language models, artificial intelligence in healthcare, healthcare education, health care research, clinical practice, scientific writing, research equity, drug discovery, personalized medicine, health literacy, plagiarism, hallucinations, authorship criteria, AI ethics, infodemic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations. https://app.cochat.ai/papers/10.1101/2023.02.19.23286155
The paper
Sallam, M. (2023). The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations. Healthcare. https://doi.org/10.1101/2023.02.19.23286155

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.