Cited by 84Philosophy and Theoretical ScienceSyntax, Semantics, Linguistic VariationCybernetics and Technology in Society

Does ChatGPT have semantic understanding? A problem with the statistics-of-occurrence strategy

Titus, Lisa Miracchi·2024·Cognitive Systems Research

Integrity signals

Registry

Crossref · 10.1016/j.cogsys.2023.101174

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • XAI does not address the core limitation: LLMs depend on statistical patterns, not genuine reasoning or evidence evaluation.

    “However, XAI does not address the core limitation: LLMs depend on statistical patterns, not genuine reasoning or evidence evaluation (23).”

    From Why we need to be careful with LLMs in medicine (2024) · cites this paper as [23]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Titus, L. M.
Affiliations
University of Denver (US)
Corresponding author
Titus, Lisa Miracchi
Venue
Cognitive Systems Research
Publisher
Elsevier BV
Published
2024-01
Volume
83
Pages
101174
ISSN
1389-0417 (ISSN-L)
OpenAlex
W4386898865
Cited by
82
References
59
Citations by year
2026: 20 · 2025: 33 · 2024: 28 · 2023: 1
FWCI
21.20
Type
journal article
Language
en
Open access
closed
Locations
Cognitive Systems Research (publishedVersion)
Funders
National Endowment for the Humanities (FEL-282501-22)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Philosophy and Theoretical Science
  • Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
Keywords
ChatGPT, semantic understanding, word meaning, word embeddings, Word2Vec, BERT, GPT-3, statistical hypothesis, causal explanation, word co-occurrence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review