The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
ChatGPT: these are not hallucinations – they’re fabrications and falsifications
Open accessAbstract
The artificial intelligence (AI) system, Chat Generative Pre-trained Transformer (ChatGPT), is considered a promising, even revolutionary tool and its widespread use in health care education, research, and practice is predicted to be inevitable 1 . Like so many others I was keen to test the capabilities of ChatGPT as an aid to scientific writing. An opportunity arose with a study I was planning on an existing dataset (structural MRI brain changes associated with antipsychotic treatment). After registering with OpenAI online, I provided basic information on the dataset and planned study and requested suggestions for the study methodology. These were promptly provided as broad stroke proposals about identifying a research question, hypotheses, suitable outcomes etc. The interaction felt eerily interpersonal and the chatbot’s demeanour was cordial and helpful, even eager. My questions relating to overall methodology produced mostly sensible suggestions, although largely predictable and somewhat mundane. I had difficulty in getting beyond the general responses that were provided for the statistical analysis plan. Specific questions were deflected with generalisations and recommendations to consult a statistician. At that stage I was unimpressed, but there were no concerns.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“to contextualize and weigh the outputs of text synthesis models such as ChatGPT that are particularly prone to 'fabrications and falsifications' [25].”
From Responding to Generative AI Technologies with Research-through-Design: The Ryelands AI Lab as an Exploratory Study (2024) · cites this paper as [25]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“One common case of factual errors reported in academic writing is inaccurate or fabricated references (Athaluri et al., 2023;Emsley, 2023).”
From College students' credibility assessments of GenAI‐generated information for academic tasks: An interview study (2025) · cites this paper as Emsley, 2023
In the citing paper
“A potential risk with any generative AI tool is that the AI may produce hallucinated or confabulated content [21,45,79,85].”
From ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models (2024) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Abstracts written by ChatGPT fool scientists
Else, H. (2023) · Nature · doi:10.1038/d41586-023-00056-7 · Cited by 611
Athaluri, S. A., Manthena, S. V., Kesapragada, V. S. R. K. M., Yarlagadda, V., Dave, T., & Duddumpudi, R. T. S. (2023) · Cureus · doi:10.7759/cureus.37432 · Cited by 403
High Rates of Fabricated and Inaccurate References in ChatGPT-Generated Medical Content
Bhattacharyya, M., Miller, V. M., Bhattacharyya, D., & Miller, L. E. (2023) · Cureus · doi:10.7759/cureus.39238 · Cited by 294
ChatGPT and Bard exhibit spontaneous citation fabrication during psychiatry literature search
McGowan, A., Gui, Y., Dobbs, M., Shuster, S., Cotter, M., Selloni, A., Goodman, M., Srivastava, A., Cecchi, G. A., & Corcoran, C. M. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115334 · Cited by 140
Hallucinations in ChatGPT: A Cautionary Tale for Biomedical Researchers
Goddard, J. (2023) · The American Journal of Medicine · doi:10.1016/j.amjmed.2023.06.012 · Cited by 94
Cited by
Bozkurt, A. (2024) · Open Praxis · doi:10.55982/openpraxis.16.1.654 · Cited by 215
AI Hallucinations: A Misnomer Worth Clarifying
Maleki, N., Padmanabhan, B., & Dutta, K. (2024) · 2024 IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00033 · Cited by 194
The ethical implications of using generative chatbots in higher education
Williams, R. T. (2024) · Frontiers in Education · doi:10.3389/feduc.2023.1331607 · Cited by 183
Large language models for generating medical examinations: systematic review
Artsi, Y., Sorin, V., Konen, E., Glicksberg, B. S., Nadkarni, G., & Klang, E. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05239-y · Cited by 128
“This occurs in a wide variety of scenarios, resulting in outputs that lack logical consistency or completely unfactual information [49].”
BackgroundArillotta, D., Floresta, G., Guirguis, A., Corkery, J. M., Catalani, V., Martinotti, G., Sensi, S. L., & Schifano, F. (2023) · Brain Sciences · doi:10.3390/brainsci13111503 · Cited by 104
Metadata
- Authors
- Emsley, R.
- Corresponding author
- Emsley, Robin
- Venue
- Schizophrenia
- Published
- 2023-08-19
- Volume
- 9
- Issue
- 1
- Pages
- 52-52
- ISSN
- 2754-6993 (ISSN-L)
- PMC
- PMC10439949
- OpenAlex
- W4386001316
- Cited by
- 258
- References
- 6
- Citations by year
- 2026: 59 · 2025: 90 · 2024: 89 · 2023: 20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Schizophrenia (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- ChatGPT, large language models, AI hallucination, scientific writing, research methodology, statistical analysis planning, antipsychotic drugs, structural MRI, research integrity, artificial intelligence in healthcare
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ChatGPT: these are not hallucinations – they’re fabrications and falsifications. https://app.cochat.ai/papers/10.1038/s41537-023-00379-4
- The paper
- Emsley, R. (2023). ChatGPT: these are not hallucinations – they’re fabrications and falsifications. Schizophrenia. https://doi.org/10.1038/s41537-023-00379-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.