Cited by 1,122Topic ModelingNatural Language Processing TechniquesNeurobiology of Language and Bilingualism

Topics in semantic representation

Griffiths, Thomas L., Steyvers, Mark, Tenenbaum, Joshua B.·2007·Psychological Review

Abstract

Processing language requires the retrieval of concepts from memory in response to an ongoing stream of information. This retrieval is facilitated if one can infer the gist of a sentence, conversation, or document and use that gist to predict related concepts and disambiguate words. This article analyzes the abstract computational problem underlying the extraction and use of gist, formulating this problem as a rational statistical inference. This leads to a novel approach to semantic representation in which word meanings are represented in terms of a set of probabilistic topics. The topic model performs well in predicting word association and the effects of semantic association and ambiguity on a variety of language-processing and memory tasks. It also provides a foundation for developing more richly structured statistical models of language, as the generative process assumed in the topic model can easily be extended to incorporate other kinds of semantic and syntactic structure.

Integrity signals

Registry

Crossref · 10.1037/0033-295x.114.2.211

Cites

119 of 119 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Language interpretation is a high-level cognitive task which shows a good correspondence to Bayesian models.

    “Language interpretation is a high-level cognitive task which shows a good correspondence to Bayesian models [5,6].”

    From Bayesian Brains without Probabilities (2016) · cites this paper as [5]

  • Bayesian models of cognition have primarily flourished as explanations of the complex dependency of behavior on the environment in domains including intuitive physics, causal learning, perception, motor control, and language.

    “Bayesian models of cognition have primarily flourished as explanations of the complex dependency of behavior on the environment in domains including intuitive physics, causal learning, perception, motor control, and language [1-10]”

    From Bayesian Brains without Probabilities (2016) · cites this paper as [5]

  • Temporal links between words produced in a specific sequence may inform that those words are probably conceptually related, as suggested by semantic association models.

    “These temporal links may inform that words produced in a specific temporal sequence are probably conceptually related, as suggested by the semantic association models (McClelland and Rogers, 2003; Griffiths et al., 2007).”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B.
Affiliations
  • University of California, Berkeley (US)
  • University of California, Irvine (US)
  • Massachusetts Institute of Technology (US)
Venue
Psychological Review
Published
2007
Volume
114
Issue
2
Pages
211-244
ISSN
  • 0033-295X (ISSN-L)
  • 1939-1471
OpenAlex
W1984251878
Cited by
1,122
References
119
Citations by year
2026: 27 · 2025: 24 · 2024: 28 · 2023: 46 · 2022: 50 · 2021: 106 · 2020: 68 · 2019: 67 · 2018: 87 · 2017: 66 · 2016: 66 · 2015: 69 · 2014: 73 · 2013: 65 · 2012: 79
FWCI
56.03
Type
journal article
Language
en
Open access
closed
Locations
  • Psychological Review (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • NTT Communication Sciences Laboratory
  • Defense Advanced Research Projects Agency
  • Stanford Graduate Fellowship
  • National Science Foundation (BCS 0631518)
  • Sponsor name not included
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
Keywords
semantic representation, topic modeling, word association, word disambiguation, semantic memory, statistical inference
MeSH terms
Bayes Theorem, Humans, Language, Semantics, Speech Perception, Models, Statistical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review