Simplicity and informativeness in semantic category systems
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Recent research has shown that semantic category systems, such as color and kinship terms, find an optimal balance between simplicity and informativeness. We argue that this situation arises through pressure for simplicity from learning and pressure for informativeness from communicative interaction, two distinct pressures that often (but not always) pull in opposite directions. Another account argues that learning might also act as a pressure for informativeness, that learners might be biased toward inferring informative systems. This results in two competing hypotheses about the human inductive bias. We formalize these competing hypotheses in a Bayesian iterated learning model in order to simulate what kinds of languages are expected to emerge under each. We then test this model experimentally to investigate whether learners' biases, isolated from any communicative task, are better characterized as favoring simplicity or informativeness. We find strong evidence to support the simplicity account. Furthermore, we show how the application of a simplicity principle in learning can give the impression of a bias for informativeness, even when no such bias is present. Our findings suggest that semantic categories are learned through domain-general principles, negating the need to posit a domain-specific mechanism.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A formal theory of inductive inference. Part II
Solomonoff, R. J. (1964) · Information and Control · doi:10.1016/s0019-9958(64)90131-7 · Cited by 1,758
The Minimum Description Length Principle
Grünwald, P. D. (2007) · doi:10.7551/mitpress/4643.001.0001 · Cited by 1,644
A formal theory of inductive inference. Part I
Solomonoff, R. J. (1964) · Information and Control · doi:10.1016/s0019-9958(64)90223-2 · Cited by 1,192
Kirby, S., Cornish, H., & Smith, K. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0707835105 · Cited by 941
Self-citationCompression and communication in the cultural evolution of linguistic structure
Kirby, S., Tamariz, M., Cornish, H., & Smith, K. (2015) · Cognition · doi:10.1016/j.cognition.2015.03.016 · Cited by 557
Self-citationSimplicity: a unifying principle in cognitive science?
Chater, N., & Vitányi, P. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(02)00005-0 · Cited by 494 · cited 1×
“For our description method, we adopt Fass and Feldman’s (2002) rectangle code, which provides a set of rectangle “symbols” that may be used to describe an arbitrary region (i.”
MethodIterated learning and the evolution of language
Kirby, S., Griffiths, T., & Smith, K. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.07.014 · Cited by 313
Self-citationscikit-optimize/scikit-optimize
Head, T., Kumar, M., Nahrstaedt, H., Louppe, G., & Shcherbatyi, I. (2021) · Zenodo · doi:10.5281/zenodo.1157319 · Cited by 302
Kinship Categories Across Languages Reflect General Communicative Principles
Kemp, C., & Regier, T. (2012) · Science · doi:10.1126/science.1218811 · Cited by 284
Word meanings across languages support efficient communication
Regier, T., Kemp, C., & Kay, P. (2015) · The Handbook of Language Emergence · doi:10.1002/9781118346136.ch11 · Cited by 196
Cited by
The forms and meanings of grammatical markers support efficient communication
Mollica, F., Bacon, G., Zaslavsky, N., Xu, Y., Regier, T., & Kemp, C. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2025993118 · Cited by 42
Communicating artificial neural networks develop efficient color-naming systems
Chaabouni, R., Kharitonov, E., Dupoux, E., & Baroni, M. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016569118 · Cited by 39
“…categorization of colors (and possiblyothersemanticdomains)innaturallanguagesdoesnotdependonspecificbiologicalconstraintsofhumans,butitis insteadageneralpropertyofdiscretecommunicationsystems. applied by Carr et al. (24) to the study of complexity/accuracy trade-offs in semantic categorization.”
The evolution of color naming reflects pressure for efficiency: Evidence from the recent past
Zaslavsky, N., Garvin, K., Kemp, C., Tishby, N., & Regier, T. (2022) · Journal of Language Evolution · doi:10.1093/jole/lzac001 · Cited by 23
A reinforcement-learning approach to efficient communication
Kågebäck, M., Carlsson, E., Dubhashi, D., & Sayeed, A. (2020) · PLOS ONE · doi:10.1371/journal.pone.0234894 · Cited by 13
“One such increasingly influential proposal is that language is shaped by the need for efficient communication [3–7], which by its nature involves a trade-off [8, 9] between simplicity, which minimizes cognitive load, and informativeness which maximizes communication effectiveness.”
BackgroundCultural evolution via iterated learning and communication explains efficient color naming systems
Carlsson, E., Dubhashi, D., & Regier, T. (2023) · arXiv · doi:10.48550/arxiv.2305.10154 · Cited by 6
Metadata
- Authors
- Carr, J. W., Smith, K., Culbertson, J., & Kirby, S.
- Venue
- Cognition
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 202
- Pages
- 104289
- ISSN
- 0010-0277 (ISSN-L)
- OpenAlex
- W2811510758
- Cited by
- 58
- References
- 12
- FWCI
- 6.71
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Simplicity and informativeness in semantic category systems. https://app.cochat.ai/papers/10.1016/j.cognition.2020.104289
- The paper
- Carr, J. W., Smith, K., Culbertson, J., & Kirby, S. (2020). Simplicity and informativeness in semantic category systems. Cognition. https://doi.org/10.1016/j.cognition.2020.104289
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.