Least effort and the origins of scaling in human language
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
The emergence of a complex language is one of the fundamental events of human evolution, and several remarkable features suggest the presence of fundamental principles of organization. These principles seem to be common to all languages. The best known is the so-called Zipf's law, which states that the frequency of a word decays as a (universal) power law of its rank. The possible origins of this law have been controversial, and its meaningfulness is still an open question. In this article, the early hypothesis of Zipf of a principle of least effort for explaining the law is shown to be sound. Simultaneous minimization in the effort of both hearer and speaker is formalized with a simple optimization process operating on a binary matrix of signal–object associations. Zipf's law is found in the transition between referentially useless systems and indexical reference systems. Our finding strongly suggests that Zipf's law is a hallmark of symbolic reference and not a meaningless feature. The implications for the evolution of language are discussed. We explain how language evolution can take advantage of a communicative phase transition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We investigate the following two relationships proposed by Zipf’s law [17,75] which seem to be a common principle of natural languages on the lexicon level [90–92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
In the citing paper
“First, when ordering messages according to their frequency, i.e., their rank in a lexicon, it has been shown that the relative frequency of a word in a corpus decays exponentially with each rank. This means that few messages are used very frequently [92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
Citations
Cites
ASH, R. B. (1966) · Cited by 3,990
ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
SIMON, H. A. (1955) · Biometrika · doi:10.1093/biomet/42.3-4.425 · Cited by 2,771
Language and the mind: (400082009-004)
Chomsky, N. (1968) · PsycEXTRA Dataset · doi:10.1037/e400082009-004 · Cited by 2,504
The symbolic species: the co-evolution of language and the brain
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1500 · Cited by 2,434
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
Handbook Of Mathematical Psychology
Galanter, & Eugène (1963) · Cited by 1,956
Cairns, H. S., & Gernsbacher, M. A. (1996) · Language · doi:10.2307/416113 · Cited by 1,920
Bickerton, D. (1990) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226220949.001.0001 · Cited by 1,587
The Handbook of Psycholinguistics
(2017) · Wiley eBooks · doi:10.1002/9781118829516 · Cited by 1,583
Natural language and natural selection
Pinker, S., & Bloom, P. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081061 · Cited by 1,330
Research works printed but not linked: 3
- N Chomsky Language and Mind (Harcourt, Brace, and World, New York, 1968).
- G Miller Language and Speech (Freeman, San Francisco, 1981).
- L Steels Proceedings of the 5th Artificial Life Conference, ed C Langton (Addison–Wesley, Redwood, CA, 1996).
Cited by
Items 201–300 of 606
Modeling Metropolis Public Transport
von Ferber, C., Holovatch, T., Holovatch, Y. V., & Palchykov, V. (2009) · Springer eBooks · doi:10.1007/978-3-540-77074-9_80 · Cited by 18
Toward a social capital theory of technology‐based new ventures as complex adaptive systems
Han, M., & McKelvey, B. (2008) · International Journal of Accounting and Information Management · doi:10.1108/18347640810887753 · Cited by 23
“Least effort theory is now confirmed ( Ferrer i Cancho and Sole, 2003”
BackgroundIs Modern English becoming less inflectionally diversified? Evidence from entropy-based algorithm
Zhu, H., & Lei, L. (2018) · Lingua · doi:10.1016/j.lingua.2018.10.006 · Cited by 19
Simple models of distributed co-ordination
Kaplan, F. (2005) · Connection Science · doi:10.1080/09540090500177596 · Cited by 18
“Based on this formulation, Ferrer and Sole (1998) studied the conditions for spontaneous consensus in the case of the max and id urn functions.”
BackgroundMethodInfluentialDomain-based Latent Personal Analysis and its use for impersonation detection in social media
Mokryn, O., & Shoshan, H. B. (2021) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-021-09295-7 · Cited by 17
A multifaceted framework to establish the presence of meaning in non‐human communication
Amphaeris, J., Blumstein, D. T., Shannon, G., Tenbrink, T., & Kershenbaum, A. (2023) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12989 · Cited by 19
“Evolutionary biologists also consider the nature of the locutionary speech act as being subject to constraints driven by the trade-off between information content and cognitive simplicity (Ferrer-i-Cancho & Solé, 2003; Kershenbaum et al ., 2021).”
BackgroundScale-invariant transition probabilities in free word association trajectories
Costa, M. E., Bonomo, F., & Sigman, M. (2009) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.019.2009 · Cited by 21
“…in semantic space where the high-dimensional neighborhood surrounding each word is something akin to a semantic fi eld (Collins and Loftus, 1975; McClelland and Jenkins, 1991; Burgess and Lund, 1994; Cancho, 2001; Sigman and Cecchi, 2002; Cancho and Sole, 2003; Steyvers and Tenenbaum, 2005).”
Motomura, K., Nakamura, M., & Otaki, J. M. (2013) · Computational and Structural Biotechnology Journal · doi:10.5936/csbj.201302010 · Cited by 17
The polysemy of the words that children learn over time
Casas, B., Català, N., Ferrer‐i‐Cancho, R., Hernández-Fernändez, A., & Baixeries, J. (2018) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.16036.cas · Cited by 17
Rank Dynamics of Word Usage at Multiple Scales
Morales, J. A., Colman, E. R., Sánchez, S., Sánchez-Puig, F., Pineda, C., Íñiguez, G., Cocho, G., Flores, J., & Gershenson, C. (2018) · Frontiers in Physics · doi:10.3389/fphy.2018.00045 · Cited by 17
Characterizing the complexity of brain and mind networks
Zamora‐López, G., Russo, E., Gleiser, P. M., Zhou, C., & Kurths, J. (2011) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2011.0121 · Cited by 17
Applying network theory to fables: complexity in Slovene belles-lettres for different age groups
Markovič, R., Gosak, M., Perc, M., Marhl, M., & Grubelnik, V. (2018) · Journal of Complex Networks · doi:10.1093/comnet/cny018 · Cited by 19
“Many different competing explanations have been proposed, from the later dismissed ideas of random processes [9–11], to preferential repetitions or proportional growth [12, 13] and the principle of least effort of information transmission between the speaker and listener [8, 14].”
BackgroundEquilibrium and dynamic methods when comparing an English text and its Esperanto translation
Ausloos, M. (2008) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2008.07.016 · Cited by 17
Scaffolding Language Emergence Using the Autotelic Principle
Steels, L., & Wellens, P. (2007) · IEEE Symposium on Artificial Life (ALIFE) · doi:10.1109/alife.2007.367813 · Cited by 17
“These results have been reported in more detail in [23].”
ResultOn the universality of Zipf’s law for word frequencies
Ferrer‐i‐Cancho, R. (2007) · De Gruyter eBooks · doi:10.1515/9783110894219.131 · Cited by 16
Nawn, D., Pratiher, S., Chattoraj, S., Chakraborty, D., Pal, M., Paul, R. R., Dutta, S., & Chatterjee, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2997875 · Cited by 16
“Nature being abundant in multi-fractal structures as found in the diverse areas ranging from molecular interactions [9], spatial distribution of earthquakes [10], stock market [11], human language [12], uterine electromyography signals [13], human heart-”
BackgroundLinguistic Complexity: English vs. Polish, Text vs. Corpus
Kwapień, J., Drożdż, S., & Orczyk, A. (2010) · Acta Physica Polonica A · doi:10.12693/aphyspola.117.716 · Cited by 16
Gender bias at scale: Evidence from the usage of personal names
Johns, B. T., & Dye, M. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01234-0 · Cited by 21
Identifying Trends in Word Frequency Dynamics
Altmann, E. G., Whichard, Z. L., & Motter, A. E. (2013) · Journal of Statistical Physics · doi:10.1007/s10955-013-0699-7 · Cited by 16
“Such studies have considered properties on scales ranging from individual letters [13] to thousands [14] or even millions [5] of words, and often benefit from concepts such as phase transitions [15, 16] and techniques such as network representation [17–20].”
BackgroundFractal immunology and immune patterning: Potential tools for immune protection and optimization
Dietert, R. R. (2011) · Journal of Immunotoxicology · doi:10.3109/1547691x.2011.559951 · Cited by 16
Rêgo, H. H. A., Braunstein, L. A., D’Agostino, G., Stanley, E., & Miyazima, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110213 · Cited by 16
“By examining the word frequency in a given corpus of a natural language Zipf found that a word’s frequency is inversely proportional to its rank f (r) in the frequency table [17,23], i.”
BackgroundAnalysis of an information-theoretic model for communication
Dickman, R., Moloney, N. R., & Altmann, E. G. (2012) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2012/12/p12022 · Cited by 15
Scale and time dependence of serial correlations in word-length time series of written texts
Rodríguez, E., Aguilar-Cornejo, M., Femat, R., & Alvarez-Ramirez, J. (2014) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2014.07.063 · Cited by 15
Using complex networks to quantify consistency in the use of words
Amancio, D. R., Oliveira, O. N., Jr., & Costa, L. D. F. (2012) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2012/01/p01004 · Cited by 19
“For instance, physicists have used dynamical systems [19, 20] and complex networks [21, 22, 23, 24, 25, 26, 27, 28] to study various aspects of language.”
BackgroundCrompton, A. (2012) · Environment and Planning B Planning and Design · doi:10.1068/b37063 · Cited by 15
van Son, R. J. J. H., & Pols, L. C. W. (2003) · UvA-DARE (University of Amsterdam) · Cited by 15
Dynamics of analyst forecasts and emergence of complexity: Role of information disparity
Kim, C., Kim, D. S., Ahn, K., & Choi, M. Y. (2017) · PLoS ONE · doi:10.1371/journal.pone.0177071 · Cited by 15
The language of gene ontology: a Zipf’s law analysis
Kalankesh, L. R., Stevens, R., & Brass, A. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-127 · Cited by 16
“The principle of “least effort” examines the work required from the speaker and the listener in communicating a message [12,24].”
BackgroundEvolution of Brains and Computers: The Roads Not Taken
Solé, R., & Seoane, L. F. (2022) · Entropy · doi:10.3390/e24050665 · Cited by 14
“A minimal model of communication codes that simultaneously optimizes conflicting features suggests that ambiguity enables large expressive power with smaller vocabularies [126,127].”
BackgroundSelf-citationChiu, P.-H., Hsieh, H.-Y., & Wang, S. C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031648 · Cited by 14
“Zipf’s distribution of words [30].”
Training deep nets with imbalanced and unlabeled data
Berry, J., Fasel, I., Fadiga, L., & Archangeli, D. B. (2012) · Interspeech (USB) · doi:10.21437/interspeech.2012-479 · Cited by 14
“[7] argue that Zipf’s law [8], which states that a word’s frequency decays as a power-law of its rank, is a consequence of a fundamental organizing principle in language.”
BackgroundMeasuring information-based energy and temperature of literary texts
Chang, M.-C., Yang, A. C., Stanley, E., & Peng, C. (2016) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2016.11.106 · Cited by 14
On the Power Laws of Language: Word Frequency Distributions
Chierichetti, F., Kumar, R., & Pang, B. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080821 · Cited by 14
Hunt, A. G. (2009) · Complexity · doi:10.1002/cplx.20267 · Cited by 14
Chen, Q., Guo, J., & Liu, Y. (2012) · Journal of Quantitative Linguistics · doi:10.1080/09296174.2012.685305 · Cited by 14
Multiobjective Optimization and Phase Transitions
Seoane, L. F., & Solé, R. V. (2016) · Springer proceedings in complexity · doi:10.1007/978-3-319-29228-1_22 · Cited by 14
“In [8], languages a ∈ A are modeled through a set of signals S and objects R whose associations are encoded in a matrix a = {aij} with aij = 1 if signal si ∈ S names object rj ∈ R and 0 otherwise.”
BackgroundInfluentialSelf-citationLinguistic structure from a bottleneck on sequential information processing
Futrell, R., & Hahn, M. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02336-w · Cited by 18
Approximate Entropy in Canonical and Non-Canonical Fiction
Mohseni, M., Redies, C., & Gast, V. (2022) · Entropy · doi:10.3390/e24020278 · Cited by 17
“Zipf [34] distinguished between the two antagonistic forces of ‘unification’ of the vocabulary, an economy principle from the speaker’s point of view of minimizing the number of word types used, and ‘diversification’, maximizing the fit between words and meanings and thus benefiting the listener (see also [35]).”
BackgroundShufaniya, A., & Arnon, I. (2022) · Journal of Language Evolution · doi:10.1093/jole/lzac005 · Cited by 15
Carpena, P., Bernaola‐Galván, P., Carretero-Campos, C., & Coronado, A. V. (2016) · Physical review. E · doi:10.1103/physreve.94.052302 · Cited by 13
Can simple models explain Zipf’s law for all exponents?
Ferrer‐i‐Cancho, R., & Servedio, V. D. P. (2005) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 13
Memory and locality in natural language
Futrell, R. (2017) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 18
On The Dynamics of Lexical Access In Two or More Languages
Kroll, J. F., Bice, K., Botezatu, M. R., & Zirnstein, M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.26 · Cited by 15
Development of deontic modality in Chinese civil laws: A corpus study
Gong, M., Cheng, W., & Cheng, L. (2020) · Pragmatics and Society · doi:10.1075/ps.16058.gon · Cited by 12
The rising entropy of English in the attention economy
Pilgrim, C., Guo, W., & Hills, T. T. (2024) · Communications Psychology · doi:10.1038/s44271-024-00117-1 · Cited by 18
“By assuming there is some cost to media of producing more informative messages — a standard assumption underlying Zipf’s principle of least effort [39, 1] — we conclude that an abundance of information creates an adaptive pressure that drives media producers to create information with a higher…”
Long-range sequential dependencies precede complex syntactic production in language acquisition
Sainburg, T., Mai, A., & Gentner, T. Q. (2022) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2021.2657 · Cited by 14
“[35] Ramon Ferrer i Cancho and Ricard V Solé.”
BackgroundAvoiding extreme risk before it occurs: A complexity science approach to incubation
McKelvey, B., & Andriani, P. (2010) · Risk Management · doi:10.1057/rm.2009.14 · Cited by 16
“Ferrer i Cancho and Sol é (2003) use a computational model to confi rm this.”
BackgroundUniversal Features in Phonological Neighbor Networks
Brown, K., Allopenna, P. D., Hunt, W., Steiner, R., Saltzman, E. L., McRae, K., & Magnuson, J. S. (2018) · Entropy · doi:10.3390/e20070526 · Cited by 12
Recent progress in understanding the origins of color universals in language
Lindsey, D. T., & Brown, A. M. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.05.007 · Cited by 14
The meaning-frequency law in Zipfian optimization models of communicationPreprint
Ferrer‐i‐Cancho, R. (2014) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.48550/arxiv.1409.7275 · Cited by 12
“If one wishes to determine if a theoretical model (e.g., Ferrer-i-Cancho & Solé 2003; Ferrer-iCancho 2005) agrees with the weak version of the law, frequencies must be replaced by probabilities.”
BackgroundMethodInfluentialThe neural basis of word production
Nozari, N. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.12 · Cited by 15
Breakdown of random matrix universality in Markov models
Mosam, F., Vidaurre, D., & DeGiuli, E. (2021) · Physical review. E · doi:10.1103/physreve.104.024305 · Cited by 14
“Finally, often discussed in the context of sequence complexity is Zipf’s law [11, 12, 27, 41, 51].”
BackgroundTachimori, Y., Iwanaga, H., & Tahara, T. (2013) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2013.07.047 · Cited by 12
Measuring acoustic complexity in continuously varying signals: how complex is a wolf howl?
Kershenbaum, A., Déaux, É. C., Habib, B., Mitchell, B., Palacios, V., Root‐Gutteridge, H., & Waller, S. S. (2017) · Bioacoustics · doi:10.1080/09524622.2017.1317287 · Cited by 11
“…et al. 2014; Gustison & Bergman 2016; Schlenker et al. 2017) and cetaceans (Doyle et al. 2008; Ferrer-i-Cancho & McCowan 2009; Nash & Bowles 2011; Garland et al. 2013), and also human language (Ferrer-i-Cancho & Sole 2003; Ferreri-Cancho 2005; Kershenbaum et al. 2014; Montemurro & Zanette 2015).”
BackgroundReducing the impact of speed dispersion on subway corridor flow
Qiao, J., Sun, L., Liu, X., & Rong, J. (2017) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.008 · Cited by 11
A computational model for measuring discourse complexity
Sun, K., & Xiong, W. (2019) · Discourse Studies · doi:10.1177/1461445619866985 · Cited by 11
“Natural languages tend to reduce the syntactic (dependency) distance so as to allow easy processing (Ferrer i Cancho and Solé, 2003).”
BackgroundAlduais, A. M. S., Almaghlouth, S., Alfadda, H. A., & Qasem, F. A. A. (2022) · Children · doi:10.3390/children9091300 · Cited by 11
“9 Least effort and the origins of scaling in human language [116] 338 301 ×”
BackgroundEmergence of Scale-Free Syntax Networks
Corominas‐Murtra, B., Valverde, S., & Solé, R. V. (2009) · Springer eBooks · doi:10.1007/978-3-642-01250-1_6 · Cited by 23
“In this context, it has been suggested that Zipf’s law might be the optimal distribution compatible with efficient communication (Ferrer-i-Cancho and Solé, 2003; Ferrer-i-Cancho et al., 2005; Harremoës and Topsoe, 2001; Solé, 2005).”
BackgroundInfluentialSelf-citationOn the Origin of Ambiguity in Efficient Communication
Fortuny, J., & Corominas‐Murtra, B. (2013) · Journal of Logic Language and Information · doi:10.1007/s10849-013-9179-3 · Cited by 11
“6 Equations of this kind have been obtained in the past through different approaches; cfr. Harremoës and Topsœ (2001) and Ferrer-i-Cancho and Solé (2003).”
BackgroundAn empirical comparison of latent sematic models for applications in industry
Contreras-Piña, C., & Ríos, S. A. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.11.080 · Cited by 13
“According to Ferrer and Solé [18] people make the least effort when they have to think of words to express what they want.”
BackgroundSystems poised to criticality through Pareto selective forcesPreprint
Seoane, L. F., & Solé, R. V. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.08697 · Cited by 11
“[39] Ferrer i Cancho R, Solé R, Least effort and the origins of scaling in human language.”
BackgroundSelf-citationWang, B., & Liu, J. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24935 · Cited by 15
“Instead, they frequently seek satisficing or “ good enough ” options without continuing to explore the best options (Azzopardi, 2021; Cancho & Solé, 2003; Kahneman, 2003).”
Functional shortcuts in language co-occurrence networks
Goh, W. P., Luke, K. K., & Cheong, S. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203025 · Cited by 10
Thermodynamics of firms' growth
Zambrano, E., Hernando, A., Bariviera, A. F., Hernando, R., & Plastino, A. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2015.0789 · Cited by 12
Noise resistance in communication: Quantifying uniformity and optimality
Cuskley, C. F., Bailes, R., & Wallenberg, J. C. (2021) · Cognition · doi:10.1016/j.cognition.2021.104754 · Cited by 10
Morphosyntactic Linguistic Wavelets for Knowledge Management
Luise, D. L. D. (2012) · Intelligent Systems · doi:10.5772/35438 · Cited by 10
The Iterated Classification Game: A New Model of the Cultural Transmission of Language
Swarup, S., & Gasser, L. (2009) · Adaptive Behavior · doi:10.1177/1059712309105818 · Cited by 10
“This trade-off is reminiscent of the joint least effort model of Ferrer i Cancho and Solé (2003).”
MethodDavis, E., Danforth, C. M., Mieder, W., & Dodds, P. S. (2023) · Digital humanities quarterly · doi:10.63744/x22v6vsyx8cm · Cited by 10
Discriminating word senses with tourist walks in complex networks
Silva, T. C., & Amancio, D. R. (2013) · The European Physical Journal B · doi:10.1140/epjb/e2013-40025-4 · Cited by 10
Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word DeathPreprint
Petersen, A. M., Tenenbaum, J., Havlin, S., & Stanley, E. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1890569 · Cited by 13
Magnuson, J. S., & Crinnion, A. M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.23 · Cited by 12
Randomness versus specifics for word-frequency distributions
Yan, X.-Y., & Minnhagen, P. (2015) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2015.10.082 · Cited by 9
Near-optimal estimation of the unseen under regularly varying tail populations
Favaro, S., & Naulet, Z. (2023) · Bernoulli · doi:10.3150/23-bej1589 · Cited by 9
Learning word order: early beginnings
de la Cruz‐Pavía, I., Marino, C., & Gervain, J. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.04.011 · Cited by 9
Do bats’ social vocalizations conform to Zipf’s law and the Menzerath-Altmann law?
Zhang, C., Zheng, Z., Lucas, J. R., Wang, Y., Fan, X., Zhao, X., Feng, J., Sun, C., & Jiang, T. (2024) · iScience · doi:10.1016/j.isci.2024.110401 · Cited by 9
Directed Networks of Online Chats: Content-Based Linking and Social Structure
Gligorijević, V., Skowron, M., & Tadić, B. (2012) · International Conference on Signal-Image Technology & Internet-Based Systems (SITIS) · doi:10.1109/sitis.2012.117 · Cited by 12
“Such hysteresis phenomena are familiar to the phase transitions on complex graphs [5].”
BackgroundXu, C., & Liu, H. (2015) · Poznań Studies in Contemporary Linguistics · doi:10.1515/psicl-2015-0018 · Cited by 9
“Researches based on real language corpora have repeatedly reported a tendency in various languages to minimize the number of intervening words between two syntactically related words (Lohse et al. 2004; Hawkins 2001; Ferrer i Cancho 2006; Jiang and Liu 2015; Liu 2007a, 2007b, 2008; Temperley 2007, 2008).”
BackgroundZipf’s Law in Non-Fluent Aphasia
van Egmond, M., van Ewijk, L., & Avrutin, S. (2015) · Journal of Quantitative Linguistics · doi:10.1080/09296174.2015.1037158 · Cited by 9
“vided by Ferrer i Cancho and Solé (2003), who mathematically showed that Fig.”
BackgroundMethodA Common Construction Pattern of English Words and Chinese Characters
Huang, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074515 · Cited by 9
“However, although many rankings can be described by Zipfian type power laws [2–25], many others can not, e.”
InfluentialOxford Handbooks in Linguistics
(2022) · Oxford University Press eBooks · doi:10.1093/9780191954481.003.0108 · Cited by 9
Viva, M. M. D., Castellotti, S., & Paramei, G. V. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02393-4 · Cited by 8
“According to Ferrer i Cancho and Solé (2003), in large language corpora the Zipf-function is expected to have two segments, whereby two exponents divide words that form a kernel lexicon from a less popular lexicon used for speci fi c communication.”
BackgroundThe feasibility principle in community ecology
Saavedra, S. (2026) · Oikos · doi:10.1002/oik.11355 · Cited by 8
“This postulate is reminiscent of the least action principle [56].”
Maximum Entropy, Word-Frequency, Chinese Characters, and Multiple Meanings
Yan, X.-Y., & Minnhagen, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0125592 · Cited by 8
Spatio-Temporal Variation of Conversational Utterances on Twitter
Alis, C., & Lim, M. T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077793 · Cited by 8
Pow law in random symbolic sequences
Cao, Y., Xiong, F., Zhao, Y., Sun, Y., Yue, X., He, X., & Wang, L. (2016) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqw046 · Cited by 8
Principle of Least Effort and Sentence Length in Public Speaking
Tsizhmovska, N. L., & Martyushev, L. M. (2021) · Entropy · doi:10.3390/e23081023 · Cited by 11
Kaabouchi, A. E., Machu, F.-X., Cocks, J., Wang, R., Zhu, Y., & Wang, Q. A. (2021) · Advances in Complex Systems · doi:10.1142/s0219525921500132 · Cited by 8
Syntactic Complex Networks and Their Applications
Čech, R., Mačutek, J., & Liu, H. (2015) · Understanding complex systems · doi:10.1007/978-3-662-47238-5_8 · Cited by 13
Origins of Scaling in Genetic Code
Obst, O., Polani, D., & Prokopenko, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21314-4_11 · Cited by 10
MAXIMAL NON-SYMMETRIC ENTROPY LEADS NATURALLY TO ZIPF'S LAW
Liu, C.-S. (2008) · Fractals · doi:10.1142/s0218348x08003788 · Cited by 8
From Boltzmann to Zipf through Shannon and Jaynes
Corral, Á. J., & del Muro, M. G. (2020) · Entropy · doi:10.3390/e22020179 · Cited by 8
“[23] R.”
MethodThe Effect of Efficient Messaging and Input Variability on Neural-Agent Iterated Language Learning
Lian, Y., Bisazza, A., & Verhoef, T. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.794 · Cited by 16
“A bias towards efficient messaging has been proposed as explaining factor for several tendencies observed in natural languages (i Cancho and Solé, 2003; Kanwal et al., 2017; Fedzechkina et al., 2017).”
Memory and Selectivity in Evolving Scale-Free Immune Networks
Tieri, P., Valensin, S., Franceschi, C., Morandi, C., & Castellani, G. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45192-1_9 · Cited by 8
“... theory has already been successfully exploited for studies of the topological and connective features of existing real world networks [27,28], like for example citations of scientific papers and networks of collaborations [29], WWW and Internet [30,32], biological networks as neural networks, metabolic reactions n…”
BackgroundLanguage: universals, principles and origins
Ferrer‐i‐Cancho, R. (2003) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-346650 · Cited by 14
Evidence of Zipfian distributions in three sign languages
Kimchi, I., Wolters, L., Stamp, R., & Arnon, I. (2023) · Gesture · doi:10.1075/gest.23014.kim · Cited by 7
He, G., Kang, Y., Gao, Z., Jiang, Z., Sun, C., Liu, X., Lu, W. P., Zhang, Q., & Si, L. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331197 · Cited by 7
“…of information behavior theories, which seek to understand the process that surround information seeking, such as Zipf’s Principle of Least Effort [17], Brenda Dervin’s Sense Making [9], and Elfreda Chatman’s Life in the Round [6], from other disciplines have been applied in investigating an…”
BackgroundZipf's Law in Human-Machine Dialog
Linders, G. M., & Louwerse, M. M. (2020) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3383652.3423878 · Cited by 8
Ordinal analysis of lexical patterns
Sánchez, D., Zunino, L., Gregorio, J. D., Toral, R., & Mirasso, C. R. (2023) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0139852 · Cited by 7
Aldrich, P. R., Horsley, R. K., & Turcic, S. M. (2011) · Symmetry · doi:10.3390/sym3040750 · Cited by 8
Cross-linguistic regularities and learner biases reflect “core” mechanics
Strickland, B., & Chemla, E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0184132 · Cited by 7
Metadata
- Authors
- Cancho, R. F. I., & Solé, R. V.
- Affiliations
- Complex Systems Lab, Universitat Pompeu Fabra, Doctor Aiguader 80, 08003 Barcelona, Spain; and Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501
- Santa Fe Institute (US)
- ORCID
- Solé, Ricard V.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-01-22
- Volume
- 100
- Issue
- 3
- Pages
- 788-791
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC298679
- OpenAlex
- W2009047999
- Cited by
- 588
- References
- 35
- Citations by year
- 2026: 42 · 2025: 12 · 2024: 14 · 2023: 24 · 2022: 56 · 2021: 38 · 2020: 27 · 2019: 33 · 2018: 33 · 2017: 33 · 2016: 23 · 2015: 36 · 2014: 21 · 2013: 24 · 2012: 39
- FWCI
- 335.49
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UPCommons institutional repository (Universitat Politècnica de Catalunya) (acceptedVersion, other-oa)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, public-domain)
- Topics
- Social Sciences › Cultural Studies › Language and cultural evolution
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- Zipf's law, principle of least effort, language evolution, word frequency distribution, power law, symbolic references, indexical reference, language emergence
- MeSH terms
- Communication, Hearing, Humans, Language, Models, Theoretical, Speech, Verbal Behavior, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.