Least effort and the origins of scaling in human language
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
The emergence of a complex language is one of the fundamental events of human evolution, and several remarkable features suggest the presence of fundamental principles of organization. These principles seem to be common to all languages. The best known is the so-called Zipf's law, which states that the frequency of a word decays as a (universal) power law of its rank. The possible origins of this law have been controversial, and its meaningfulness is still an open question. In this article, the early hypothesis of Zipf of a principle of least effort for explaining the law is shown to be sound. Simultaneous minimization in the effort of both hearer and speaker is formalized with a simple optimization process operating on a binary matrix of signal–object associations. Zipf's law is found in the transition between referentially useless systems and indexical reference systems. Our finding strongly suggests that Zipf's law is a hallmark of symbolic reference and not a meaningless feature. The implications for the evolution of language are discussed. We explain how language evolution can take advantage of a communicative phase transition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We investigate the following two relationships proposed by Zipf’s law [17,75] which seem to be a common principle of natural languages on the lexicon level [90–92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
In the citing paper
“First, when ordering messages according to their frequency, i.e., their rank in a lexicon, it has been shown that the relative frequency of a word in a corpus decays exponentially with each rank. This means that few messages are used very frequently [92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
Citations
Cites
ASH, R. B. (1966) · Cited by 3,990
ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
SIMON, H. A. (1955) · Biometrika · doi:10.1093/biomet/42.3-4.425 · Cited by 2,771
Language and the mind: (400082009-004)
Chomsky, N. (1968) · PsycEXTRA Dataset · doi:10.1037/e400082009-004 · Cited by 2,504
The symbolic species: the co-evolution of language and the brain
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1500 · Cited by 2,434
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
Handbook Of Mathematical Psychology
Galanter, & Eugène (1963) · Cited by 1,956
Cairns, H. S., & Gernsbacher, M. A. (1996) · Language · doi:10.2307/416113 · Cited by 1,920
Bickerton, D. (1990) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226220949.001.0001 · Cited by 1,587
The Handbook of Psycholinguistics
(2017) · Wiley eBooks · doi:10.1002/9781118829516 · Cited by 1,583
Natural language and natural selection
Pinker, S., & Bloom, P. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081061 · Cited by 1,330
Research works printed but not linked: 3
- N Chomsky Language and Mind (Harcourt, Brace, and World, New York, 1968).
- G Miller Language and Speech (Freeman, San Francisco, 1981).
- L Steels Proceedings of the 5th Artificial Life Conference, ed C Langton (Addison–Wesley, Redwood, CA, 1996).
Cited by
Items 101–200 of 606
Optimization Models of Natural Communication
Ferrer‐i‐Cancho, R. (2017) · Journal of Quantitative Linguistics · doi:10.1080/09296174.2017.1366095 · Cited by 48
“Indeed, if the minimization of H(S) is replaced by the minimization of the vocabulary size in optimization models of word frequencies, Zipf’s law disappears (Ferrer-i-Cancho & Solé, 2003; Ferrer-iCancho, 2005a).”
BackgroundMethodInfluentialSTRUCTURAL CHANGES CAUSED BY ERROR AND ATTACK TOLERANCE IN US AIRPORT NETWORK
CHI, L. P., & Cai, X. (2004) · International Journal of Modern Physics B · doi:10.1142/s0217979204025427 · Cited by 51
Analysis of Extremes in Management Studies
Baum, J. A. C., & McKelvey, B. (2006) · Research methodology in strategy and management · doi:10.1016/s1479-8387(06)03007-4 · Cited by 51
“…& Wiesenfeld, 1987; Drossel & Schwabl, 1992) Least effort Language: Word frequency in language is a function of ease of usage by both speaker/writer and listener/reader (Cancho & Solé, 2003) aAdditional power law causes are mentioned in West and Deering (1995), Sornette (2004), and Newman (2005).”
BackgroundThe Self, the symbolic and synchronicity: virtual realities and the emergence of the psyche
Hogenson, G. B. (2005) · Journal of Analytical Psychology · doi:10.1111/j.0021-8774.2005.00531.x · Cited by 45
A Law of Word Meaning in Dolphin Whistle Types
Ferrer‐i‐Cancho, R., & McCowan, B. (2009) · Entropy · doi:10.3390/e11040688 · Cited by 45
“Besides, this inverse relationship has implications for the scope of information theoretic models of Zipf‟s law [24-26] departing from the assumption that the frequency of a signal (e.”
BackgroundSynthetic transitions: towards a new synthesis
Solé, R. (2016) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2015.0438 · Cited by 46
Self-citationChen, H., Chen, X., & Liu, H. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192545 · Cited by 47
Hahn, M., & Xu, Y. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2122604119 · Cited by 55
Identification of literary movements using complex networks to represent texts
Amancio, D. R., Oliveira, O. N., & Costa, L. D. F. (2012) · New Journal of Physics · doi:10.1088/1367-2630/14/4/043029 · Cited by 46
Zipf and Heaps laws from dependency structures in component systems
Mazzolini, A., Grilli, J., de Lazzari, E., Osella, M., Lagomarsino, M. C., & Gherardi, M. (2018) · Physical review. E · doi:10.1103/physreve.98.012315 · Cited by 48
Paragraph-based representation of texts: A complex networks approach
de Arruda, H. F., Marinho, V. Q., Costa, L. D. F., & Amancio, D. R. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2018.12.008 · Cited by 47
Phase transitions in Pareto optimal complex networks
Seoane, L. F., & Solé, R. V. (2015) · Physical Review E · doi:10.1103/physreve.92.032807 · Cited by 49
Self-citationTrue reason for Zipf's law in language
Dahui, W., Li, M., & Di, Z. (2005) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2005.04.021 · Cited by 43
Information structure and efficiency in speech production
van Son, R. J. J. H., & Pols, L. C. W. (2003) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2003-63 · Cited by 43
“The word frequencies were estimated using a Katz smoothing on counts from 1-5 and an extrapolation based on Zipf's law [ 9 ].”
MethodThe forms and meanings of grammatical markers support efficient communication
Mollica, F., Bacon, G., Zaslavsky, N., Xu, Y., Regier, T., & Kemp, C. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2025993118 · Cited by 42
The global minima of the communicative energy of natural communication systems
Ferrer‐i‐Cancho, R., & Díaz-Guilera, A. (2007) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2007/06/p06009 · Cited by 42
“p(rj) = 1/m is chosen for various reasons: (a) simplicity (b) it is a sort of worst case for the occurrence of stimuli (the uncertainty about the stimulus that could appear next is maximum) and (c) as far as we know, this is the only assumption made by models assuming that p(rj) is fixed a priori (equally likely stimu…”
BackgroundMethodInfluentialAdamic, L. A. (2011) · Nature · doi:10.1038/474164a · Cited by 49
Ferrer‐i‐Cancho, R. (2006) · Biosystems · doi:10.1016/j.biosystems.2005.12.001 · Cited by 44
Functionalism in the lexicon: Where is it, and how did it get there?
Richie, R. (2016) · The Mental Lexicon · doi:10.1075/ml.11.3.05ric · Cited by 43
Sense and Reference on the Web
Halpin, H. (2011) · Minds and Machines · doi:10.1007/s11023-011-9230-6 · Cited by 45
“’ This sort of distribution seems to be apparent in many evolved systems (Cancho and Sole, 2003), from the link structure of the hypertext Web (Barabasi et al.”
BackgroundUnveiling the relationship between complex networks metrics and word senses
Amancio, D. R., Oliveira, O. N., & Costa, L. D. F. (2012) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/98/18002 · Cited by 41
Lestrade, S. (2017) · PLoS ONE · doi:10.1371/journal.pone.0181987 · Cited by 41
DeGiuli, E. (2019) · Physical Review Letters · doi:10.1103/physrevlett.122.128301 · Cited by 40
Decoding least effort and scaling in signal frequency distributions
Ferrer‐i‐Cancho, R. (2004) · Physica A Statistical Mechanics and its Applications · doi:10.1016/s0378-4371(04)00861-1 · Cited by 40
Lazy User Model: Solution Selection and Discussion about Switching Costs
Collan, M., & Tétard, F. (2011) · Lecture notes in business information processing · doi:10.1007/978-3-642-22766-0_7 · Cited by 39
“His theory has received support by other researchers, such as Ferrer i Cancho [ 9 ], studying Zipf’s theory of least effort in the scaling of human language, and Zanette [24] in studying the creation of musical context.”
BackgroundResultThe mathematical relationship between Zipf’s law and the hierarchical scaling law
Chen, Y. (2011) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2011.12.031 · Cited by 44
“There have been varied and interesting explanations and interpretations regarding Zipf’s law and related scaling laws (Bettencourt et al , 2007; Cancho and Solé, 2003; Carlson and Doyle, 1999; Ebeling and Pöschel, 1994; Ferrer i Cancho and Solé, 2003; Ferrer i Cancho et al , 2005; Kanter and…”
BackgroundKosmidis, K., Kalampokis, A., & Argyrakis, P. (2006) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2006.02.042 · Cited by 39
Santis, E. D., Martino, A., & Rizzi, A. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3358168 · Cited by 41
Modeling Fractal Structure of City-Size Distributions Using Correlation Functions
Chen, Y. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024791 · Cited by 41
“for the rank-size regularity has been published [26,27,28, 29,30,31,32].”
BackgroundEvolving complexity: how tinkering shapes cells, software and ecological networks.
Solé, R., & Valverde, S. (2020) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2019.0325 · Cited by 37
Self-citationThe principle of least effort and Zipf distribution
Zhu, Y., Zhang, B., Wang, Q. A., Li, W., & Cai, X. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1113/1/012007 · Cited by 37
Statistics of Shared Components in Complex Component Systems
Mazzolini, A., Gherardi, M., Caselle, M., Lagomarsino, M. C., & Osella, M. (2018) · Physical Review X · doi:10.1103/physrevx.8.021023 · Cited by 36
“On the other hand, specific communication optimization principles [14,15] and stochastic models for text generation [5,16,17] have been invoked to explain the emergence of”
BackgroundInformation-theoretic locality properties of natural language
Futrell, R. (2019) · doi:10.18653/v1/w19-7902 · Cited by 51
“At the same time, there have been attempts to derive the properties of human language formally from information-theoretic models of efficiency (Ferrer-i-Cancho and Solé, 2003; Ferrer-i-Cancho and DíazGuilera, 2007).”
BackgroundThe placement of the head that maximizes predictability. An information theoretic approachPreprint
Ferrer‐Cancho, R. (2017) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.48550/arxiv.1705.09932 · Cited by 53
“A spin-off of Zipf’s view are model of Zipf’s law for word frequencies that are based on the conflict between the minimization of the entropy of a vocabulary and the maximization of the mutual information between words and meanings (Ferrer-i-Cancho 2005, Ferrer-i-Cancho & Solé 2003).”
MethodPhase transitions in least-effort communications
Prokopenko, M., Ay, N., Obst, O., & Polani, D. (2010) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2010/11/p11025 · Cited by 35
Log-Log Convexity of Type-Token Growth in Zipf’s Systems
Font-Clos, F., & Corral, Á. J. (2015) · Physical Review Letters · doi:10.1103/physrevlett.114.238701 · Cited by 35
“[12] R.”
BackgroundPatterns in the English language: phonological networks, percolation and assembly models
Stella, M., & Brede, M. (2015) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2015/05/p05006 · Cited by 37
Synchronicity and moments of meeting
Hogenson, G. B. (2009) · Journal of Analytical Psychology · doi:10.1111/j.1468-5922.2009.01769.x · Cited by 34
The statistical signature of morphosyntax: A study of Hungarian and Italian infant-directed speech
Gervain, J., & Erra, R. G. (2012) · Cognition · doi:10.1016/j.cognition.2012.06.010 · Cited by 39
Statistical mechanical approach to human language
Kosmidis, K., Kalampokis, A., & Argyrakis, P. (2005) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2005.10.039 · Cited by 34
From human-computer interaction to cognitive infocommunications: A cognitive science perspective
Török, Á. (2016) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2016.7804588 · Cited by 33
“In communication this is believed to result from the actors’ effort to balance the goal of communication (information transferring) and the cost of communication (words used) [49], [50].”
BackgroundThoughts About Disordered Thinking: Measuring and Quantifying the Laws of Order and Disorder
Elvevåg, B., Foltz, P. W., Rosenstein, M., Ferrer‐i‐Cancho, R., Deyne, S. D., Mizraji, E., & Cohen, A. S. (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx040 · Cited by 34
Resolution and relevance trade-offs in deep learning
Song, J., Matteo Marsili, A., & Jo, J. (2018) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/aaf10f · Cited by 32
“This suggests a further explanation for the ubiquitously observation of Zipf’s law in nature [13], which is in line with arguments related to information processing in language and communication evolutions [26, 27], but which we believe is of a more fundamental nature.”
Complex intermittency blurred by noise: Theory and application to neural dynamics
Allegrini, P., Menicucci, D., Bedini, R., Gemignani, A., & Paradisi, P. (2010) · Physical Review E · doi:10.1103/physreve.82.015103 · Cited by 32
Ficcadenti, V., Cerqueti, R., & Ausloos, M. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.12.049 · Cited by 32
“[37] Information theory; Zipf’s law; Shannon entropy Questioning language evolution and Zipf’s law principle”
BackgroundUnderstanding Zipf's law of word frequencies through sample-space collapse in sentence formation
Stefan Thurner, A., Hanel, R., Liu, B., & Corominas‐Murtra, B. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2015.0330 · Cited by 31
Zipf’s Law: Balancing Signal Usage Cost and Communication Efficiency
Salge, C., Ay, N., Polani, D., & Prokopenko, M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0139475 · Cited by 31
Information theory, animal communication, and the search for extraterrestrial intelligence
Doyle, L. R., McCowan, B., Johnston, S., & Hanser, S. F. (2009) · Acta Astronautica · doi:10.1016/j.actaastro.2009.11.018 · Cited by 31
“Nevertheless Zipf plots can be potentially useful indicators of higher-order complexity and even appear to be a necessary characteristic of signal distribution in order to have a symbolic communication system (according to the mathematical development of [9]).”
BackgroundEmergence of linguistic laws in human voice
Torre, I. G., Luque, B., Lacasa, L., Luque, J., & Hernández-Fernändez, A. (2017) · Scientific Reports · doi:10.1038/srep43862 · Cited by 35
“Trends in cognitive sciences, 14(5):223-232 [33] Ferrer i Cancho, R.”
BackgroundProtein information content resides in rare peptide segments
Kanduc, D. (2010) · Peptides · doi:10.1016/j.peptides.2010.02.003 · Cited by 30
Jing, L., Schiffer, J. T., Chong, T. M., Bruckner, J. J., Davies, D. H., Felgner, P. L., Haas, J., Wald, A., Verjans, G. M. G. M., & Koelle, D. M. (2012) · Journal of Virology · doi:10.1128/jvi.03047-12 · Cited by 32
“95) and fit Zipfian distributions (25) with slopes equaling 0.”
BackgroundBérubé, N., Sainte‐Marie, M. H., Mongeon, P., & Larivière, V. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197775 · Cited by 32
Stability of Random Networks under Evolution of Attack and Repair
Li-Ping, C., Chun-Bin, Y., & Xu, C. (2006) · Chinese Physics Letters · doi:10.1088/0256-307x/23/1/076 · Cited by 28
Ambiguity in language networks
Solé, R. V., & Seoane, L. F. (2015) · The Linguistic Review · doi:10.1515/tlr-2014-0014 · Cited by 32
Self-citationWord Decoding of Protein Amino Acid Sequences with Availability Analysis: A Linguistic Approach
Motomura, K., Fujita, T., Tsutsumi, M., Kikuzato, S., Nakamura, M., & Otaki, J. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0050039 · Cited by 27
“The communication tradeoffs are known as the principle of least effort [23,24], which drives the evolution of natural languages.”
BackgroundZipf’s law, 1/f noise, and fractal hierarchy
Chen, Y. (2011) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2011.10.001 · Cited by 36
“…et al, 2004; Batty, 2005; Batty, 2006; Batty, 2008; Blasius and Tönjes, 2009; Chen, 2008; Eliazar and Klafter, 2009a; Eliazar and Klafter, 2009b; Ferrer i Cancho and Solé, 2003; Ferrer i Cancho et al, 2005; Jiang, 2009; Jiang and Jia, 2011), but little study tries to combine or unify them.”
BackgroundThe controversy around the concept of archetypes
Hogenson, G. B. (2019) · Journal of Analytical Psychology · doi:10.1111/1468-5922.12541 · Cited by 27
The networks of syllables and characters in Chinese∗
Peng, G., Minett, J. W., & Wang, W. Y. (2008) · Journal of Quantitative Linguistics · doi:10.1080/09296170802159488 · Cited by 27
“Such networks may imply certain mechanisms by which humans organize concepts while choosing them for communication (Ferrer i Cancho & Sole, 2001 , 2003 ).”
BackgroundThe morphospace of language networks
Seoane, L. F., & Solé, R. V. (2018) · Scientific Reports · doi:10.1038/s41598-018-28820-0 · Cited by 34
Self-citationPinto, G., Vieira, K. C., Carvalho, E. G., & Sugano, J. Y. (2019) · Sustainable Production and Consumption · doi:10.1016/j.spc.2019.07.002 · Cited by 26
Maximal Diversity and Zipf’s Law
Mazzarisi, O., de Azevedo-Lopes, A., Arenzon, J. J., & Corberi, F. (2021) · Physical Review Letters · doi:10.1103/physrevlett.127.128301 · Cited by 26
Understanding the Odour Spaces: A Step towards Solving Olfactory Stimulus-Percept Problem
Kumar, R., Kaur, R., Auffarth, B., & Bhondekar, A. P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0141263 · Cited by 26
“As discussed earlier, it could confirm the "theory of least action" which suggests people tend to speak those words which they think will convey the broadest of information on a given topic, which is true for expert or a layman [40,41].”
BackgroundStatistical Patterns in Written Language
Zanette, D. H. (2014) · arXiv · doi:10.48550/arxiv.1412.3336 · Cited by 25
“…as for an explanation of the empirical data, much more recently a mathematical model was put forward to quantify the process by which a vocabulary diversifies as communication evolves under the pressure of the principle of least effort on both speaker and hearer (Ferrer i Cancho and Solé, 2003).”
BackgroundInfluentialCan Menzerath’s law be a criterion of complexity in communication?
Torre, I. G., Dębowski, Ł., & Hernández-Fernändez, A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256133 · Cited by 25
Topics modeling based on selective Zipf distribution
Zeng, J., Duan, J., Cao, W., & Wu, C. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.12.051 · Cited by 25
“The main reason lies in the statistical analysis of randomly-generated texts, or approximately equal distribution of effort in understanding language (Ramon & Ricard, 2003).”
BackgroundLiang, J., Lv, Q., & Liu, Y. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00285 · Cited by 25
Scale-free networks in phonological and orthographic wordform lexicons
Kello, C. T., & Beltz, B. (2009) · De Gruyter eBooks · doi:10.1515/9783110223958.171 · Cited by 25
“In their parallel analysis, Ferrer i Cancho and Solé (2003) created matrices Aλthat minimizedΩ(λ) at numerous sampled values of 0 ≤λ≤1 (see also Ferrer i Cancho, 2006).”
BackgroundMethodInfluentialDo dependency lengths explain constraints on crossing dependencies?
Yadav, H., Husain, S., & Futrell, R. (2021) · Linguistics Vanguard · doi:10.1515/lingvan-2019-0070 · Cited by 24
Demartsev, V., Gordon, N., Barocas, A., Bar‐Ziv, E., Ilany, T., Goll, Y., Ilany, A., & Geffen, E. (2019) · Evolution Letters · doi:10.1002/evl3.147 · Cited by 25
“A related “principle of least effort” (Hailman et al. 1985) predicts an approximately monotonic relationship between word probability of occurrence and its rank of use (the frequency of a word decays as a power law of its rank; Cancho and Solé 2003).”
BackgroundShannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires
Kershenbaum, A., Demartsev, V., Gammon, D. E., Geffen, E., Gustison, M. L., Ilany, A., & Lameira, A. R. (2020) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13536 · Cited by 24
“Entropy, 11, 688–701. https://doi.org/10.3390/ e1104 0688 Ferrer-i-Cancho, R., & Solé, R. V. (2003).”
BackgroundInfluentialPlant–insect chemical communication in ecological communities: An information theory perspective
Zu, P., García‐García, R., Schuman, M. C., Saavedra, S., & Melián, C. J. (2022) · Journal of Systematics and Evolution · doi:10.1111/jse.12841 · Cited by 25
Self-organizing systems: what, how, and why?
Gershenson, C. (2025) · npj Complexity · doi:10.1038/s44260-025-00031-5 · Cited by 31
Chinese lexical networks: The structure, function and formation
Li, J., Zhou, J., Luo, X., & Yang, Z. (2012) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2012.05.058 · Cited by 23
Zipfian Distributions in Child-Directed Speech
Lavi‐Rotbain, O., & Arnon, I. (2022) · Open Mind · doi:10.1162/opmi_a_00070 · Cited by 26
“…of language being a communication system under cognitive pressures, and suggest that Zipfian distributions emerge spontaneously under the pressure to minimize listener and speaker efforts (Ferrer-i-Cancho & Sole, 2003), or from the need for easy and fast communication (Ferrer-i-cancho, 2016).”
BackgroundDas, S. (2017) · Journal of Modern Physics · doi:10.4236/jmp.2017.812120 · Cited by 23
Visual statistical learning is facilitated in Zipfian distributions
Lavi‐Rotbain, O., & Arnon, I. (2020) · Cognition · doi:10.1016/j.cognition.2020.104492 · Cited by 23
“…(Piantadosi, 2014), with explanations ranging from purely mathematical (e.g., Chater & Brown, 1999) to more communicatively-oriented (e.g., Ferrer i Cancho & Sole, 2003; Ferrer-i-Cancho, Bentz, & Seguin, 2020), their presence and propensity in the environment may nevertheless have implications for…”
BackgroundRank-frequency relation for Chinese characters
Deng, W., ALLAHVERDYAN, A. E., Li, B., & Wang, Q. A. (2014) · The European Physical Journal B · doi:10.1140/epjb/e2014-40805-2 · Cited by 25
Zipf's Law in Short-Time Timbral Codings of Speech, Music, and Environmental Sound Signals
Haro, M., Serrà, J., Herrera, P., & Corral, Á. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033993 · Cited by 22
Recursive subdivision of urban space and Zipf’s law
Chen, Y., & Wang, J. (2013) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2013.10.022 · Cited by 23
Ambiguity and language evolution: Evolution of homophones and syllable number of words
Ogura, M., & Wang, W. Y. (2006) · Repozytorium Uniwersytetu im. Adama Mickiewicza (Adam Mickiewicz University in Poznań) · Cited by 22
A Query-Driven Characterization of Linked Data
Halpin, H. (2009) · Cited by 21
The Functionality of Social Tagging as a Communication System
Oh, P., & Monge, P. R. (2013) · International journal of communication · Cited by 21
Information Theory as a Bridge Between Language Function and Language Form
Futrell, R., & Hahn, M. (2022) · Frontiers in Communication · doi:10.3389/fcomm.2022.657725 · Cited by 35
“…has a long scientific pedigree (Gabelentz, 1891; Zipf, 1935; Mandelbrot, 1953), and recent years have seen major advances based on ideas from information theory (for example, Ferrer i Cancho and Solé, 2003; Zaslavsky et al., 2018; Mollica et al., 2021) (see Gibson et al., 2019, for a recent review).”
BackgroundExcess entropy in natural language: Present state and perspectives
Dębowski, Ł. (2011) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3630929 · Cited by 25
Quantifiers in Natural Language: Efficient Communication and Degrees of Semantic Universals
Steinert‐Threlkeld, S. (2021) · Entropy · doi:10.3390/e23101335 · Cited by 33
“For example, Reference [9] finds that optimal form-meaning mappings around λ ≈ .41 exhibit frequencies that pattern according to Zipf’s law.”
BackgroundMethodInfluentialNetwork analysis of named entity co-occurrences in written texts
Amancio, D. R. (2016) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/114/58005 · Cited by 22
Evolution of vocabulary on scale-free and random networks
Kalampokis, A., Kosmidis, K., & Argyrakis, P. (2007) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2006.12.048 · Cited by 21
Statistical properties of Chinese phonemic networks
Yu, S., Liu, H., & Xu, C. (2010) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2010.12.019 · Cited by 20
Explaining Zipf's law via a mental lexicon
ALLAHVERDYAN, A. E., Deng, W., & Wang, Q. A. (2013) · Physical Review E · doi:10.1103/physreve.88.062804 · Cited by 20
Minimum cost and the emergence of the Zipf-Mandelbrot law
Pollack, J. B., Bedau, M. A., Husbands, P., Watson, R. A. R., & Ikegami, T. (2004) · Cited by 20
Information-theoretic principles in incremental language production
Futrell, R. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2220593120 · Cited by 38
Ubiquitous Power Law Scaling in Nonlinear Self-Excited Hawkes Processes
Kanazawa, K., & Sornette, D. (2021) · Physical Review Letters · doi:10.1103/physrevlett.127.188301 · Cited by 19
Principle of least effort vs. maximum efficiency: deriving Zipf-Pareto's laws
Wang, Q. A. (2021) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2021.111489 · Cited by 19
Using Complex Networks to Quantify Consistency in the Use of WordsPreprint
Amancio, D. R., Oliveira, O. N., & Costa, L. D. F. (2016) · Cited by 19
Investigating the role of in-situ user expectations in Web search
Wang, B., & Liu, J. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103300 · Cited by 21
Quantification of Information in a One-Way Plant-to-Animal Communication System
Doyle, L. R. (2009) · Entropy · doi:10.3390/e110300431 · Cited by 18
Thermodynamic Efficiency of Interactions in Self-Organizing Systems
Nigmatullin, R., & Prokopenko, M. (2021) · Entropy · doi:10.3390/e23060757 · Cited by 21
“In the future, it would be interesting to examine models exhibiting other types of phase transitions in a broad class of dynamical systems, including econo- and sociocomputation [49–54], and determine whether they also maximally efficient at criticality.”
BackgroundOn the emergence of Zipf ’s law in music
Perotti, J. I., & Billoni, O. V. (2020) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2020.124309 · Cited by 18
A comparative analysis of knowledge acquisition performance in complex networks
Guerreiro, L., Silva, F. N., & Amancio, D. R. (2020) · Information Sciences · doi:10.1016/j.ins.2020.12.060 · Cited by 18
Indefinite Pronouns Optimize the Simplicity/Informativeness Trade‐Off
Denić, M., Steinert‐Threlkeld, S., & Szymanik, J. (2022) · Cognitive Science · doi:10.1111/cogs.13142 · Cited by 27
“We first explain the space of possible meanings expressed by indefinites: what are the meanings that interlocutors may want to communicate by an indefinite pronoun? Haspelmath (2001) describes each indefinite pronoun in each language in his dataset in terms of which functions it can take.”
BackgroundMethod
Metadata
- Authors
- Cancho, R. F. I., & Solé, R. V.
- Affiliations
- Complex Systems Lab, Universitat Pompeu Fabra, Doctor Aiguader 80, 08003 Barcelona, Spain; and Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501
- Santa Fe Institute (US)
- ORCID
- Solé, Ricard V.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-01-22
- Volume
- 100
- Issue
- 3
- Pages
- 788-791
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC298679
- OpenAlex
- W2009047999
- Cited by
- 588
- References
- 35
- Citations by year
- 2026: 42 · 2025: 12 · 2024: 14 · 2023: 24 · 2022: 56 · 2021: 38 · 2020: 27 · 2019: 33 · 2018: 33 · 2017: 33 · 2016: 23 · 2015: 36 · 2014: 21 · 2013: 24 · 2012: 39
- FWCI
- 335.49
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UPCommons institutional repository (Universitat Politècnica de Catalunya) (acceptedVersion, other-oa)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, public-domain)
- Topics
- Social Sciences › Cultural Studies › Language and cultural evolution
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- Zipf's law, principle of least effort, language evolution, word frequency distribution, power law, symbolic references, indexical reference, language emergence
- MeSH terms
- Communication, Hearing, Humans, Language, Models, Theoretical, Speech, Verbal Behavior, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.