Least effort and the origins of scaling in human language
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
The emergence of a complex language is one of the fundamental events of human evolution, and several remarkable features suggest the presence of fundamental principles of organization. These principles seem to be common to all languages. The best known is the so-called Zipf's law, which states that the frequency of a word decays as a (universal) power law of its rank. The possible origins of this law have been controversial, and its meaningfulness is still an open question. In this article, the early hypothesis of Zipf of a principle of least effort for explaining the law is shown to be sound. Simultaneous minimization in the effort of both hearer and speaker is formalized with a simple optimization process operating on a binary matrix of signal–object associations. Zipf's law is found in the transition between referentially useless systems and indexical reference systems. Our finding strongly suggests that Zipf's law is a hallmark of symbolic reference and not a meaningless feature. The implications for the evolution of language are discussed. We explain how language evolution can take advantage of a communicative phase transition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We investigate the following two relationships proposed by Zipf’s law [17,75] which seem to be a common principle of natural languages on the lexicon level [90–92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
In the citing paper
“First, when ordering messages according to their frequency, i.e., their rank in a lexicon, it has been shown that the relative frequency of a word in a corpus decays exponentially with each rank. This means that few messages are used very frequently [92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
Citations
Cites
ASH, R. B. (1966) · Cited by 3,990
ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
SIMON, H. A. (1955) · Biometrika · doi:10.1093/biomet/42.3-4.425 · Cited by 2,771
Language and the mind: (400082009-004)
Chomsky, N. (1968) · PsycEXTRA Dataset · doi:10.1037/e400082009-004 · Cited by 2,504
The symbolic species: the co-evolution of language and the brain
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1500 · Cited by 2,434
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
Handbook Of Mathematical Psychology
Galanter, & Eugène (1963) · Cited by 1,956
Cairns, H. S., & Gernsbacher, M. A. (1996) · Language · doi:10.2307/416113 · Cited by 1,920
Bickerton, D. (1990) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226220949.001.0001 · Cited by 1,587
The Handbook of Psycholinguistics
(2017) · Wiley eBooks · doi:10.1002/9781118829516 · Cited by 1,583
Natural language and natural selection
Pinker, S., & Bloom, P. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081061 · Cited by 1,330
The Theory of Critical Phenomena: An Introduction to the Renormalization Group
Binney, J. J., Dowrick, N. J., Fisher, A. J., & Newman, M. E. J. (1992) · doi:10.1093/oso/9780198513940.001.0001 · Cited by 1,243
The Evolution of Communication
(2016) · Creating Media for Learning: Student-Centered Projects Across the Curriculum · doi:10.4135/9781483395203.n2 · Cited by 1,173
Social intelligence, innovation, and enhanced brain size in primates
Reader, S. M., & Laland, K. N. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.062041299 · Cited by 1,126
The Evolution of Communication
Hauser, M. D. (1996) · doi:10.7551/mitpress/2867.001.0001 · Cited by 771
The Symbolic Species: The Co-Evolution of Language and the Human Brain
Knight, C., & Deacon, T. (1999) · The Journal of the Royal Anthropological Institute · doi:10.2307/2660971 · Cited by 550
The Theory of Critical Phenomena: An Introduction to the Renormalization Group
Binney, J. J., Dowrick, N. J., Fisher, A., & Newman, M. E. J. (1992) · CERN Document Server (European Organization for Nuclear Research) · Cited by 515
Random texts exhibit Zipf's-law-like word frequency distribution
Li, W. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.165464 · Cited by 490
Nowak, M. A., & Krakauer, D. C. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.14.8028 · Cited by 474
The evolution of syntactic communication
Nowak, M. A., Plotkin, J. B., & Jansen, V. A. A. (2000) · Nature · doi:10.1038/35006635 · Cited by 358
Some Effects of Intermittent Silence
Miller, G. A. (1957) · The American Journal of Psychology · doi:10.2307/1419346 · Cited by 330
Explaining the uneven distribution of numbers in nature: the laws of Benford and Zipf
Pietronero, L., Tosatti, E., Tosatti, V., & Vespignani, A. (2001) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/s0378-4371(00)00633-6 · Cited by 244
The Evolutionary Language Game
NOWAK, M. A., PLOTKIN, J. B., & KRAKAUER, D. C. (1999) · Journal of Theoretical Biology · doi:10.1006/jtbi.1999.0981 · Cited by 201
Zur linguistischen Synergetik : Struktur und Dynamik der Lexik
Köhler, R. (1986) · Studienverlag Brockmeyer eBooks · Cited by 170
Readings in Mathematical Social Science
Künzi, H. P., Lazarsfeld, P. F., & Henry, N. W. (1968) · Econometrica · doi:10.2307/1909535 · Cited by 144
Solé, R. V., Manrubia, S. C., Luque, B., Delgado, J., & Bascompte, J. (1996) · Complexity · doi:10.1002/cplx.6130010405 · Cited by 111
Self-citationChaos and Information Processing: A Heuristic Outline
Nicolis, J. S. (1991) · WORLD SCIENTIFIC eBooks · doi:10.1142/0984 · Cited by 99
Ferrer‐i‐Cancho, R., & Solé, R. V. (2002) · Advances in Complex Systems · doi:10.1142/s0219525902000468 · Cited by 90
Self-citationModels for power law relations in linguistics and information science
Naranan, S., & Balasubrahmanyan, V. K. (1998) · Journal of Quantitative Linguistics · doi:10.1080/09296179808590110 · Cited by 49
Numerical Analysis of Word Frequencies in Artificial and Natural Language Texts
Cohen, A., Mantegna, R. N., & Havlin, S. (1997) · Fractals · doi:10.1142/s0218348x97000103 · Cited by 47
Quantitative linguistics and complex system studies*
Balasubrahmanyan, V. K., & Naranan, S. (1996) · Journal of Quantitative Linguistics · doi:10.1080/09296179608599629 · Cited by 41
SYSTEM THEORETICAL LINGUISTICS
Köhler, R. (1987) · Theoretical Linguistics · doi:10.1515/thli.1987.14.2-3.241 · Cited by 41
The Emergence of Zipf's Law: Spontaneous Encoding Optimization by Users of a Command Language
Ellis, S. R., & Hitchcock, R. J. (1986) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1986.4308973 · Cited by 38
Readings in Mathematical Social Sciences.
Baker, F. B., Lazerfeld, P. F., & Henry, N. W. (1969) · Journal of the American Statistical Association · doi:10.2307/2283664 · Cited by 34
Is There Any Intermediate Stage Between Animal Communication and Language?
Ujhelyi, M. (1996) · Journal of Theoretical Biology · doi:10.1006/jtbi.1996.0079 · Cited by 22
Research works printed but not linked: 3
- N Chomsky Language and Mind (Harcourt, Brace, and World, New York, 1968).
- G Miller Language and Speech (Freeman, San Francisco, 1981).
- L Steels Proceedings of the 5th Artificial Life Conference, ed C Langton (Addison–Wesley, Redwood, CA, 1996).
Cited by
Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117
“For example, Rosch (1999) attributed the categorical structure of human semantic memory to a principle of “cognitive economy,” and Zipf (1949) applied a similar interpretation to regularities in the frequency distributions of words (see also Ferrer i Cancho & Sole, 2003).”
MethodZipf’s word frequency law in natural language: A critical review and future directions
Piantadosi, S. T. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0585-6 · Cited by 889
“…scales (Kawamura & Hatano, 2002), semantic organization (Guiraud, 1968; D. Manin, 2008), communicative optimization (Ferrer i Cancho, 2005a, b; Ferrer i Cancho & Solé, 2003; Mandelbrot, 1962; Salge, Ay, Polani, & Prokopenko, 2013; Zipf, 1936, 1949), random division of elements into groups…”
BackgroundInfluentialThe communicative function of ambiguity in language
Piantadosi, S. T., Tily, H., & Gibson, E. (2012) · Cognition · doi:10.1016/j.cognition.2011.10.004 · Cited by 628
“…back into favor to explain both the online behavior of language users (e.g. Genzel & Charniak, 2002; Aylett & Turk, 2004; Jaeger, 2006; Levy & Jaeger, 2007, i.a.) and the structure of languages themselves (e.g. Ferrer i Cancho & Sol´e, 2003; Ferrer i Cancho, 2006; Piantadosi, Tily, & Gibson, 2011).”
The complex dynamics of collaborative tagging
Halpin, H., Robu, V., & Shepherd, H. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242602 · Cited by 603
The Matthew effect in empirical data
Perc, M. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.0378 · Cited by 456
“The original proposal made by Zipf, on the other hand, was that there is tension between the efforts of the speaker and the listener, and it has been shown by means of mathematical modelling that this may indeed explain the origins of scaling in the usage of words [135].”
Background
Metadata
- Authors
- Cancho, R. F. I., & Solé, R. V.
- Affiliations
- Complex Systems Lab, Universitat Pompeu Fabra, Doctor Aiguader 80, 08003 Barcelona, Spain; and Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501
- Santa Fe Institute (US)
- ORCID
- Solé, Ricard V.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-01-22
- Volume
- 100
- Issue
- 3
- Pages
- 788-791
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC298679
- OpenAlex
- W2009047999
- Cited by
- 588
- References
- 35
- Citations by year
- 2026: 42 · 2025: 12 · 2024: 14 · 2023: 24 · 2022: 56 · 2021: 38 · 2020: 27 · 2019: 33 · 2018: 33 · 2017: 33 · 2016: 23 · 2015: 36 · 2014: 21 · 2013: 24 · 2012: 39
- FWCI
- 335.49
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UPCommons institutional repository (Universitat Politècnica de Catalunya) (acceptedVersion, other-oa)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, public-domain)
- Topics
- Social Sciences › Cultural Studies › Language and cultural evolution
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- Zipf's law, principle of least effort, language evolution, word frequency distribution, power law, symbolic references, indexical reference, language emergence
- MeSH terms
- Communication, Hearing, Humans, Language, Models, Theoretical, Speech, Verbal Behavior, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.