The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios
Open accessAbstract
This paper aims to highlight the potential applications and limits of a large language model (LLM) in healthcare. ChatGPT is a recently developed LLM that was trained on a massive dataset of text for dialogue with users. Although AI-based language models like ChatGPT have demonstrated impressive capabilities, it is uncertain how well they will perform in real-world scenarios, particularly in fields such as medicine where high-level and complex thinking is necessary. Furthermore, while the use of ChatGPT in writing scientific articles and other scientific outputs may have potential benefits, important ethical concerns must also be addressed. Consequently, we investigated the feasibility of ChatGPT in clinical and research scenarios: (1) support of the clinical practice, (2) scientific production, (3) misuse in medicine and research, and (4) reasoning about public health topics. Results indicated that it is important to recognize and promote education on the appropriate use and potential pitfalls of AI-based LLMs in medicine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In recent years, generative pre-trained transformer (GPT)-based models, AI tools generating large language models (LLMs), have been extensively testing and developing in healthcare at several levels, such as research, education, clinical decisions and patient communication [11,12,13].”
From Optimizing Communication of Radiation Exposure in Medical Imaging, the Radiologist Challenge (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This comes in light of the ability of ChatGPT to generate incorrect content that appears plausible from a scientific point of view [81].”
From ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns (2023) · cites this paper as [81]
The cited source says what the claim attributes to it.
In the citing paper
“Biased training data can lead to biased output”
From Ethical Considerations of Using ChatGPT in Health Care (2023) · cites this paper as [72]
The cited source says what the claim attributes to it.
In the citing paper
“If the training data used for ChatGPT are biased, the bot may inadvertently perpetuate this bias [72].”
From Ethical Considerations of Using ChatGPT in Health Care (2023) · cites this paper as [72]
The cited source says what the claim attributes to it.
In the citing paper
“Data bias can lead to skewed outcomes and predictions, as the model learns from the biased data and perpetuates the same biases in its results [72].”
From Ethical Considerations of Using ChatGPT in Health Care (2023) · cites this paper as [72]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
GPT-3: Its Nature, Scope, Limits, and Consequences
Floridi, L., & Chiriatti, M. (2020) · Minds and Machines · doi:10.1007/s11023-020-09548-1 · Cited by 2,519
ChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868
Abstracts written by ChatGPT fool scientists
Else, H. (2023) · Nature · doi:10.1038/d41586-023-00056-7 · Cited by 611
Differences in youngest-old, middle-old, and oldest-old patients who visit the emergency department
Lee, S. B., Oh, J. H., Park, J. H., Choi, S. P., & Wee, J. H. (2018) · Clinical and Experimental Emergency Medicine · doi:10.15441/ceem.17.261 · Cited by 426
Prostate Cancer Screening with PSA and MRI Followed by Targeted Biopsy Only
Hugosson, J., Månsson, M., Wallström, J., Axcrona, U., Carlsson, S. V., Egevad, L., Geterud, K., Khatami, A., Kohestani, K., Pihl, C.-G., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2209454 · Cited by 381
Can large language models reason about medical questions?
Liévin, V., Hother, C. E., Motzfeldt, A. G., & Winther, O. (2022) · arXiv · doi:10.48550/arxiv.2207.08143 · Cited by 343
Cited by
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
“This comes in light of the ability of ChatGPT to generate incorrect content that appears plausible from a scientific point of view [81].”
BackgroundA Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
“In the field of medical assistance, LLMs demonstrate potential applications, including research on identifying gastrointestinal diseases [92], dementia diagnosis [205], accelerating the evaluation of COVID-19 literature [86], and their overall potential in healthcare [15].”
BackgroundRay, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
Metadata
- Authors
- Cascella, M., Montomoli, J., Bellini, V., & Bignami, E.
- Affiliations
- Istituto Nazionale Tumori IRCCS "Fondazione G. Pascale" (IT)
- Ospedale Infermi di Rimini (IT)
- University of Parma (IT)
- Corresponding author
- Bignami, Elena
- Venue
- Journal of Medical Systems
- Published
- 2023-03-04
- Volume
- 47
- Issue
- 1
- Pages
- 33-33
- ISSN
- 0148-5598 (ISSN-L)
- 1573-689X
- PMC
- PMC9985086
- OpenAlex
- W4323050332
- Cited by
- 1,120
- References
- 17
- Citations by year
- 2026: 173 · 2025: 286 · 2024: 409 · 2023: 251
- FWCI
- 44.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Journal of Medical Systems (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Università degli Studi di Parma
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- ChatGPT, large language models, medical applications, clinical practice support, scientific writing, AI ethics, artificial intelligence in education
- MeSH terms
- Delivery of Health Care, Educational Status, Feasibility Studies, Humans, Language
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios. https://app.cochat.ai/papers/10.1007/s10916-023-01925-4
- The paper
- Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023). Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios. Journal of Medical Systems. https://doi.org/10.1007/s10916-023-01925-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.