Least effort and the origins of scaling in human language
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
The emergence of a complex language is one of the fundamental events of human evolution, and several remarkable features suggest the presence of fundamental principles of organization. These principles seem to be common to all languages. The best known is the so-called Zipf's law, which states that the frequency of a word decays as a (universal) power law of its rank. The possible origins of this law have been controversial, and its meaningfulness is still an open question. In this article, the early hypothesis of Zipf of a principle of least effort for explaining the law is shown to be sound. Simultaneous minimization in the effort of both hearer and speaker is formalized with a simple optimization process operating on a binary matrix of signal–object associations. Zipf's law is found in the transition between referentially useless systems and indexical reference systems. Our finding strongly suggests that Zipf's law is a hallmark of symbolic reference and not a meaningless feature. The implications for the evolution of language are discussed. We explain how language evolution can take advantage of a communicative phase transition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We investigate the following two relationships proposed by Zipf’s law [17,75] which seem to be a common principle of natural languages on the lexicon level [90–92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
In the citing paper
“First, when ordering messages according to their frequency, i.e., their rank in a lexicon, it has been shown that the relative frequency of a word in a corpus decays exponentially with each rank. This means that few messages are used very frequently [92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
Citations
Cites
ASH, R. B. (1966) · Cited by 3,990
ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
SIMON, H. A. (1955) · Biometrika · doi:10.1093/biomet/42.3-4.425 · Cited by 2,771
Language and the mind: (400082009-004)
Chomsky, N. (1968) · PsycEXTRA Dataset · doi:10.1037/e400082009-004 · Cited by 2,504
The symbolic species: the co-evolution of language and the brain
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1500 · Cited by 2,434
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
Handbook Of Mathematical Psychology
Galanter, & Eugène (1963) · Cited by 1,956
Cairns, H. S., & Gernsbacher, M. A. (1996) · Language · doi:10.2307/416113 · Cited by 1,920
Bickerton, D. (1990) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226220949.001.0001 · Cited by 1,587
The Handbook of Psycholinguistics
(2017) · Wiley eBooks · doi:10.1002/9781118829516 · Cited by 1,583
Natural language and natural selection
Pinker, S., & Bloom, P. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081061 · Cited by 1,330
Research works printed but not linked: 3
- N Chomsky Language and Mind (Harcourt, Brace, and World, New York, 1968).
- G Miller Language and Speech (Freeman, San Francisco, 1981).
- L Steels Proceedings of the 5th Artificial Life Conference, ed C Langton (Addison–Wesley, Redwood, CA, 1996).
Cited by
Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117
“For example, Rosch (1999) attributed the categorical structure of human semantic memory to a principle of “cognitive economy,” and Zipf (1949) applied a similar interpretation to regularities in the frequency distributions of words (see also Ferrer i Cancho & Sole, 2003).”
MethodZipf’s word frequency law in natural language: A critical review and future directions
Piantadosi, S. T. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0585-6 · Cited by 889
“…scales (Kawamura & Hatano, 2002), semantic organization (Guiraud, 1968; D. Manin, 2008), communicative optimization (Ferrer i Cancho, 2005a, b; Ferrer i Cancho & Solé, 2003; Mandelbrot, 1962; Salge, Ay, Polani, & Prokopenko, 2013; Zipf, 1936, 1949), random division of elements into groups…”
BackgroundInfluentialThe communicative function of ambiguity in language
Piantadosi, S. T., Tily, H., & Gibson, E. (2012) · Cognition · doi:10.1016/j.cognition.2011.10.004 · Cited by 628
“…back into favor to explain both the online behavior of language users (e.g. Genzel & Charniak, 2002; Aylett & Turk, 2004; Jaeger, 2006; Levy & Jaeger, 2007, i.a.) and the structure of languages themselves (e.g. Ferrer i Cancho & Sol´e, 2003; Ferrer i Cancho, 2006; Piantadosi, Tily, & Gibson, 2011).”
The complex dynamics of collaborative tagging
Halpin, H., Robu, V., & Shepherd, H. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242602 · Cited by 603
The Matthew effect in empirical data
Perc, M. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.0378 · Cited by 456
“The original proposal made by Zipf, on the other hand, was that there is tension between the efforts of the speaker and the listener, and it has been shown by means of mathematical modelling that this may indeed explain the origins of scaling in the usage of words [135].”
Background
Metadata
- Authors
- Cancho, R. F. I., & Solé, R. V.
- Affiliations
- Complex Systems Lab, Universitat Pompeu Fabra, Doctor Aiguader 80, 08003 Barcelona, Spain; and Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501
- Santa Fe Institute (US)
- ORCID
- Solé, Ricard V.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-01-22
- Volume
- 100
- Issue
- 3
- Pages
- 788-791
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC298679
- OpenAlex
- W2009047999
- Cited by
- 588
- References
- 35
- Citations by year
- 2026: 42 · 2025: 12 · 2024: 14 · 2023: 24 · 2022: 56 · 2021: 38 · 2020: 27 · 2019: 33 · 2018: 33 · 2017: 33 · 2016: 23 · 2015: 36 · 2014: 21 · 2013: 24 · 2012: 39
- FWCI
- 335.49
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UPCommons institutional repository (Universitat Politècnica de Catalunya) (acceptedVersion, other-oa)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, public-domain)
- Topics
- Social Sciences › Cultural Studies › Language and cultural evolution
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- Zipf's law, principle of least effort, language evolution, word frequency distribution, power law, symbolic references, indexical reference, language emergence
- MeSH terms
- Communication, Hearing, Humans, Language, Models, Theoretical, Speech, Verbal Behavior, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Least effort and the origins of scaling in human language. https://app.cochat.ai/papers/10.1073/pnas.0335980100
- The paper
- Cancho, R. F. I., & Solé, R. V. (2003). Least effort and the origins of scaling in human language. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.0335980100
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.