Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 7 of the 8 references it cites were found in a registry or an index.

ChatGPT and artificial hallucinations in stem cell research: assessing the accuracy of generated references – a preliminary study

Open access

Abstract

Stem cell research has the transformative potential to revolutionize medicine. Language models like ChatGPT, which use artificial intelligence (AI) and natural language processing, generate human-like text that can aid researchers. However, it is vital to ensure the accuracy and reliability of AI-generated references. This study assesses Chat Generative Pre-Trained Transformer (ChatGPT)’s utility in stem cell research and evaluates the accuracy of its references. Of the 86 references analyzed, 15.12% were fabricated and 9.30% were erroneous. These errors were due to limitations such as no real-time internet access and reliance on preexisting data. Artificial hallucinations were also observed, where the text seems plausible but deviates from fact. Monitoring, diverse training, and expanding knowledge cut-off can help to reduce fabricated references and hallucinations. Researchers must verify references and consider the limitations of AI models. Further research is needed to enhance the accuracy of such language models. Despite these challenges, ChatGPT has the potential to be a valuable tool for stem cell research. It can help researchers to stay up-to-date on the latest developments in the field and to find relevant information.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1097/ms9.0000000000001228

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 The most important 20 MeSH keywords identified by ChatGPT in the field of stem cell research.
Figure 1 The most important 20 MeSH keywords identified by ChatGPT in the field of stem cell research.CC BY · PubMed Central
Figure 2 Examples of fabricated references (arrows) while generating an essay on the MeSH keyword ‘stem cell research.’
Figure 2 Examples of fabricated references (arrows) while generating an essay on the MeSH keyword ‘stem cell research.’CC BY · PubMed Central
Figure 3 In-depth analysis of the 86 journal references linked to stem cell research. The references were divided into fabricated/fictitious references (15.12%, 13/86), erroneous references (9.30%, 8/86), and accurate references (75.58%, 65/86).
Figure 3 In-depth analysis of the 86 journal references linked to stem cell research. The references were divided into fabricated/fictitious references (15.12%, 13/86), erroneous references (9.30%, 8/86), and accurate references (75.58%, 65/86).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Cited by

See all 38

Metadata

Authors
Sharun, K., Banu, S. A., Pawde, A. M., Kumar, R., Akash, S., Dhama, K., & Pal, A.
Affiliations
  • Division of Surgery
  • Daffodil International University (BD)
  • Indian Veterinary Research Institute (IN)
Corresponding author
  • Sharun, Khan
  • Akash, Shopnil
Venue
Annals of Medicine & Surgery
Published
2023-09-01
Volume
85
Issue
10
Pages
5275-5278
ISSN
2049-0801 (ISSN-L)
OpenAlex
W4386351210
Cited by
38
References
8
Citations by year
2026: 10 · 2025: 11 · 2024: 16 · 2023: 1
FWCI
1.51
Type
journal article
Language
en
Open access
Locations
  • Annals of Medicine and Surgery (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • Indian Council of Agricultural Research
  • ICAR-Indian Veterinary Research Institute
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Education › Academic integrity and plagiarism
Keywords
ChatGPT, AI-generated references, stem cell research, citation accuracy, large language models, citation verification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ChatGPT and artificial hallucinations in stem cell research: assessing the accuracy of generated references – a preliminary study. https://app.cochat.ai/papers/10.1097/ms9.0000000000001228
The paper
Sharun, K., Banu, S. A., Pawde, A. M., Kumar, R., Akash, S., Dhama, K., & Pal, A. (2023). ChatGPT and artificial hallucinations in stem cell research: assessing the accuracy of generated references – a preliminary study. Annals of Medicine & Surgery. https://doi.org/10.1097/ms9.0000000000001228

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.