Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

ChatGPT References Unveiled: Distinguishing the Reliable from the Fake

Giray, Louie · 2024 · Internet Reference Services Quarterly

Abstract

This study explored the potential of ChatGPT in the search for reliable references. Results showed that the reliability of ChatGPT's references vary across different source types. For journal articles, they were all fabricated and not compliant with APA 7 format. Webpages did not match actual existing sites. However, for books, the generated references correctly corresponded to real, existing ones. In the case of journal websites, the links within the responses were functional. Although this exploration gained interesting insights, researchers are strongly recommended not to depend on ChatGPT for references due to accuracy issues and must undertake manual, scholarly searches.

Overview

Integrity signals

Registry

Crossref · 10.1080/10875301.2023.2265369

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 10 references

Research works printed but not linked: 1

  1. 10.1177/0846537123117112 · doi:10.1177/0846537123117112

Cited by

See all 36

Metadata

Authors
Giray, L.
Affiliations
Colegio de Muntinlupa (PH)
Corresponding author
Giray, Louie
Venue
Internet Reference Services Quarterly
Published
2023-10-05
Volume
28
Issue
1
Pages
9-18
ISSN
  • 1087-5301 (ISSN-L)
  • 1540-4749
OpenAlex
W4387363411
Cited by
26
References
10
Citations by year
2026: 7 · 2025: 13 · 2024: 6
FWCI
20.41
Type
journal article
Language
en
Open access
closed
Locations
Internet Reference Services Quarterly (publishedVersion)
Topics
  • Social Sciences › Library and Information Sciences › Library Science and Information Literacy
  • Social Sciences › Library and Information Sciences › Library Science and Information
  • Social Sciences › Library and Information Sciences › Academic Writing and Publishing
Keywords
ChatGPT, reference generation, citation reliability, source verification, journal articles, web pages, books

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ChatGPT References Unveiled: Distinguishing the Reliable from the Fake. https://app.cochat.ai/papers/10.1080/10875301.2023.2265369
The paper
Giray, L. (2024). ChatGPT References Unveiled: Distinguishing the Reliable from the Fake. Internet Reference Services Quarterly. https://doi.org/10.1080/10875301.2023.2265369

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.