Least effort and the origins of scaling in human language
Open accessThe DOI matches its Crossref record; 34 of the 35 references it cites were found in a registry or an index.
Abstract
The emergence of a complex language is one of the fundamental events of human evolution, and several remarkable features suggest the presence of fundamental principles of organization. These principles seem to be common to all languages. The best known is the so-called Zipf's law, which states that the frequency of a word decays as a (universal) power law of its rank. The possible origins of this law have been controversial, and its meaningfulness is still an open question. In this article, the early hypothesis of Zipf of a principle of least effort for explaining the law is shown to be sound. Simultaneous minimization in the effort of both hearer and speaker is formalized with a simple optimization process operating on a binary matrix of signal–object associations. Zipf's law is found in the transition between referentially useless systems and indexical reference systems. Our finding strongly suggests that Zipf's law is a hallmark of symbolic reference and not a meaningless feature. The implications for the evolution of language are discussed. We explain how language evolution can take advantage of a communicative phase transition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We investigate the following two relationships proposed by Zipf’s law [17,75] which seem to be a common principle of natural languages on the lexicon level [90–92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
In the citing paper
“First, when ordering messages according to their frequency, i.e., their rank in a lexicon, it has been shown that the relative frequency of a word in a corpus decays exponentially with each rank. This means that few messages are used very frequently [92].”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [92]
Citations
Cites
ASH, R. B. (1966) · Cited by 3,990
ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
SIMON, H. A. (1955) · Biometrika · doi:10.1093/biomet/42.3-4.425 · Cited by 2,771
Language and the mind: (400082009-004)
Chomsky, N. (1968) · PsycEXTRA Dataset · doi:10.1037/e400082009-004 · Cited by 2,504
The symbolic species: the co-evolution of language and the brain
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1500 · Cited by 2,434
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
Handbook Of Mathematical Psychology
Galanter, & Eugène (1963) · Cited by 1,956
Cairns, H. S., & Gernsbacher, M. A. (1996) · Language · doi:10.2307/416113 · Cited by 1,920
Bickerton, D. (1990) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226220949.001.0001 · Cited by 1,587
The Handbook of Psycholinguistics
(2017) · Wiley eBooks · doi:10.1002/9781118829516 · Cited by 1,583
Natural language and natural selection
Pinker, S., & Bloom, P. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081061 · Cited by 1,330
Research works printed but not linked: 3
- N Chomsky Language and Mind (Harcourt, Brace, and World, New York, 1968).
- G Miller Language and Speech (Freeman, San Francisco, 1981).
- L Steels Proceedings of the 5th Artificial Life Conference, ed C Langton (Addison–Wesley, Redwood, CA, 1996).
Cited by
Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117
“For example, Rosch (1999) attributed the categorical structure of human semantic memory to a principle of “cognitive economy,” and Zipf (1949) applied a similar interpretation to regularities in the frequency distributions of words (see also Ferrer i Cancho & Sole, 2003).”
MethodZipf’s word frequency law in natural language: A critical review and future directions
Piantadosi, S. T. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0585-6 · Cited by 889
“…scales (Kawamura & Hatano, 2002), semantic organization (Guiraud, 1968; D. Manin, 2008), communicative optimization (Ferrer i Cancho, 2005a, b; Ferrer i Cancho & Solé, 2003; Mandelbrot, 1962; Salge, Ay, Polani, & Prokopenko, 2013; Zipf, 1936, 1949), random division of elements into groups…”
BackgroundInfluentialThe communicative function of ambiguity in language
Piantadosi, S. T., Tily, H., & Gibson, E. (2012) · Cognition · doi:10.1016/j.cognition.2011.10.004 · Cited by 628
“…back into favor to explain both the online behavior of language users (e.g. Genzel & Charniak, 2002; Aylett & Turk, 2004; Jaeger, 2006; Levy & Jaeger, 2007, i.a.) and the structure of languages themselves (e.g. Ferrer i Cancho & Sol´e, 2003; Ferrer i Cancho, 2006; Piantadosi, Tily, & Gibson, 2011).”
The complex dynamics of collaborative tagging
Halpin, H., Robu, V., & Shepherd, H. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242602 · Cited by 603
The Matthew effect in empirical data
Perc, M. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.0378 · Cited by 456
“The original proposal made by Zipf, on the other hand, was that there is tension between the efforts of the speaker and the listener, and it has been shown by means of mathematical modelling that this may indeed explain the origins of scaling in the usage of words [135].”
BackgroundCompression and communication in the cultural evolution of linguistic structure
Kirby, S., Tamariz, M., Cornish, H., & Smith, K. (2015) · Cognition · doi:10.1016/j.cognition.2015.03.016 · Cited by 557
“Competing motivations of speaker and hearer, for instance, have been a rich explanatory tool for cognitive scientists (e.g. Zipf, 1949; Ferrer i Cancho & Solé, 2003; Piantadosi, Tily, & Gibson, 2012) and linguists seeking explanations for typological universals of language (e.g. Givón, 1979;…”
Physical approach to complex systems
Kwapień, J., & Drożdż, S. (2012) · Physics Reports · doi:10.1016/j.physrep.2012.01.007 · Cited by 517
Analyzing proteome topology and function by automated multidimensional fluorescence microscopy
Schubert, W., Bonnekoh, B., Pommer, A. J., Philipsen, L., Böckelmann, R., Malykh, Y., Gollnick, H., Friedenberger, M., Bode, M., & Dress, A. W. M. (2006) · Nature Biotechnology · doi:10.1038/nbt1250 · Cited by 479
Scaling laws in cognitive sciences
Kello, C. T., Brown, G. D. A., Ferrer-i-Cancho, R., Holden, J. G., Linkenkaer-Hansen, K., Rhodes, T., & Van Orden, G. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.005 · Cited by 384
Self-citationPublic transport networks: empirical analysis and modeling
von Ferber, C., Holovatch, T., Holovatch, Y., & Palchykov, V. (2009) · The European Physical Journal B · doi:10.1140/epjb/e2009-00090-x · Cited by 302
A cross-language perspective on speech information rate
Pellegrino, F., Coupe, C., & Marsico, E. (2011) · Language · doi:10.1353/lan.2011.0057 · Cited by 281
“More recently, several theoretical models have been proposed to account for this regularity and to reanalyze Zipf’s assumption in terms of emergent properties (e.g. Ferrer i Cancho 2005, Ferrer i Cancho & Solé 2003, Kuperman et al. 2008).”
BackgroundDependency distance: A new perspective on syntactic patterns in natural languages
Liu, H., Xu, C., & Liang, J. (2017) · Physics of Life Reviews · doi:10.1016/j.plrev.2017.03.002 · Cited by 300
ELLIS, N. C. (2008) · The Modern Language Journal · doi:10.1111/j.1540-4781.2008.00716.x · Cited by 295
“As these forces play out in symbolic usage, languages evolve to have scaling properties that follow Zipf’s (1935) law (Ferrer i Cancho & Solé, 2003).”
BackgroundUsing Coevolutionary and Complexity Theories to Improve IS Alignment: A multi–Level Approach
Benbya, H., & McKelvey, B. (2006) · Journal of Information Technology · doi:10.1057/palgrave.jit.2000080 · Cited by 289
“The least-effort rule leads to efficient use of language words, as Zipf (1949) theorized and as recently confirmed by Ferrer i Cancho and Sole´ (2003).”
Hills, T. T., Maouene, M., Maouene, J., Sheya, A., & Smith, L. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02365.x · Cited by 258
“For example, the moregets-more organization of links in adult semantic networks may reflect processes of retrieval, accessibility, and use, as well as the evolution of language (e.g., Ferrer i Cancho & Solé, 2003; Griffiths, Steyvers, & Firl, 2007; Steyvers & Tenenbaum, 2005; Zipf, 1949).”
Kinship Categories Across Languages Reflect General Communicative Principles
Kemp, C., & Regier, T. (2012) · Science · doi:10.1126/science.1218811 · Cited by 284
“For example, Zipf suggests that word-frequency distributions achieve a tradeoff between simplicity and communicative precision (20, 21), Hawkins (22) suggests that grammars are shaped by a tradeoff between simplicity and communicative efficiency, and Rosch (23) suggests that category systems “provide maximum informati…”
Semantic Networks: Structure and Dynamics
Borge-Holthoefer, J., & Arenas, A. (2010) · Entropy · doi:10.3390/e12051264 · Cited by 237
Language networks: Their structure, function, and evolution
Solé, R. V., Corominas‐Murtra, B., Valverde, S., & Steels, L. (2010) · Complexity · doi:10.1002/cplx.20305 · Cited by 251
Self-citationOn language ‘utility’: processing complexity and communicative efficiency
Jaeger, T. F., & Tily, H. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.126 · Cited by 243
Languages cool as they expand: Allometric scaling and the decreasing need for new words
Petersen, A. M., Tenenbaum, J. N., Havlin, S., Stanley, H. E., & Perc, M. (2012) · Scientific Reports · doi:10.1038/srep00943 · Cited by 190
“The Zipf law can be derived through the “principle of least effort,” which minimizes the communication noise between speakers (writers) and listeners (readers) [14].”
BackgroundInfluentialStatistical Measures for Usage‐Based Linguistics
Gries, S. T., & Ellis, N. C. (2015) · Language Learning · doi:10.1111/lang.12119 · Cited by 224
“Subsequent research has shown that many language events (e.g., frequencies of phoneme and letter strings, of words, of grammatical constructs, of formulaic phrases, etc.) across scales of analysis follow this law (Ferrer i Cancho & Solé, 2001, 2003).”
BackgroundIs Google enough? Comparison of an internet search engine with academic library resources
Brophy, J., & Bawden, D. (2005) · Aslib Proceedings · doi:10.1108/00012530510634235 · Cited by 213
“This is a natural human impulse, codified by Zipf into his principle of least effort (Sole and Cancho, 2003) and by Simon in his concept of “satisficing” (Tennant, 2001; Agusto, 2002), not to mention the complaint of some in the library/information area that we live in a society “fuelled by a culture of instant gratif…”
BackgroundEuclidean distance between syntactically linked words
Ferrer i Cancho, R. (2004) · Physical Review E · doi:10.1103/physreve.70.056135 · Cited by 212
Self-citationWord meanings across languages support efficient communication
Regier, T., Kemp, C., & Kay, P. (2015) · The Handbook of Language Emergence · doi:10.1002/9781118346136.ch11 · Cited by 196
“Other examples—often formalized in information-theoretic terms—include the suggestions that word frequency distributions (Zipf 1949; Ferrer i Cancho & Solé, 2003), syllable durations (Aylett & Turk, 2004), word lengths (Piantadosi, Tily, & Gibson, 2011), syntactic structures and processing…”
BackgroundSemantic typology and efficient communication
Kemp, C., Xu, Y., & Regier, T. (2018) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011817-045406 · Cited by 180
“…in information-theoretic terms— has been invoked to explain several aspects of language, including word frequency distributions (Zipf, 1949; Ferrer i Cancho and Sol´e, 2003), word lengths (Piantadosi et al., 2011), syllable duration (Aylett and Turk, 2004), syntactic structures and…”
BackgroundThe emergence of simple languages in an experimental coordination game
Selten, R., & Warglien, M. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0702077104 · Cited by 177
Efficient compression in color naming and its evolution
Zaslavsky, N., Kemp, C., Regier, T., & Tishby, N. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800521115 · Cited by 178
Usage‐Based Language: Investigating the Latent Structures That Underpin Acquisition
Ellis, N. C., O'Donnell, M. B., & Römer, U. (2013) · Language Learning · doi:10.1111/j.1467-9922.2012.00736.x · Cited by 161
“…suspect them to be fundamental, and are beginning to investigate how they might underlie language processing, learnability, acquisition, usage and change (Beckner et al., 2009; Ellis & Larsen-Freeman, 2009b; Ferrer i Cancho & Solé, 2001, 2003; Ferrer i Cancho et al., 2004; Solé et al., 2010).”
BackgroundRandom Texts Do Not Exhibit the Real Zipf's Law-Like Rank Distribution
Ferrer-i-Cancho, R., & Elvevåg, B. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009411 · Cited by 163
Zipf's Law Leads to Heaps' Law: Analyzing Their Relation in Finite-Size Systems
Lü, L., Zhang, Z., & Zhou, T. (2010) · PLoS ONE · doi:10.1371/journal.pone.0014139 · Cited by 182
“Accordingly, many mechanisms are put forward to explain the emergence of the Zipf’s law [14,15], such as the rich gets richer [16,17], the self-organized criticality [18], Markov Processes [19], aggregation of interacting individuals [20], optimization designs [21] and the least effort principle [22].”
BackgroundSpontaneous brain activity as a source of ideal 1/f noise
Allegrini, P., Menicucci, D., Bedini, R., Fronzoni, L., Gemignani, A., Grigolini, P., West, B. J., & Paradisi, P. (2009) · Physical Review E · doi:10.1103/physreve.80.061914 · Cited by 165
Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death
Petersen, A. M., Tenenbaum, J., Havlin, S., & Stanley, H. E. (2012) · Scientific Reports · doi:10.1038/srep00313 · Cited by 137
“Interestingly, it has been shown that The Zipf law emerges as the result of the “principle of least effort” which minimizes the communication noise between speakers (writers) and hearers (readers) [24].”
BackgroundYu, S., Xu, C., & Liu, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01855 · Cited by 146
“ed in the observed deviation from expected curves (28-29). Some other scholars have tried twosegment piecewise - fitting in English and obtained results that are capable of linguistic interpretations (13, 30). But their two-segment piecewise fittings are all based on one language sample, and hence cannot universally r…”
BackgroundMultiplex lexical networks reveal patterns in early word acquisition in children
Stella, M., Beckage, N., & Brede, M. (2017) · Scientific Reports · doi:10.1038/srep46730 · Cited by 155
“Instead we focus on intra-layer relationships that have previously been shown to influence children’s lexical learning in single-layer network studies: (1) free-associations15,24, (2) shared features16,25, (3) co-occurrence in child directed speech17,26 and (4) phonological similarity20,27.”
Languages Support Efficient Communication about the Environment: Words for Snow Revisited
Regier, T., Carstensen, A., & Kemp, C. (2016) · PLOS ONE · doi:10.1371/journal.pone.0151138 · Cited by 136
The Entropy of Words—Learnability and Expressivity across More than 1000 Languages
Bentz, C., Alikaniotis, D., Cysouw, M., & Ferrer‐i‐Cancho, R. (2017) · Entropy · doi:10.3390/e19060275 · Cited by 170
“These models shed light on the origins of Zipf’s law for word frequencies [38,39] and a vocabulary learning bias [40].”
BackgroundLarge-Scale Analysis of Zipf’s Law in English Texts
Moreno-Sánchez, I., Font-Clos, F., & Corral, Á. J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0147073 · Cited by 152
Structural Properties of US Flight Network
Li-Ping, C., Wang, R., Su, H., Xinping, X., Jin-Song, Z., Li, W., & Xu, C. (2003) · Chinese Physics Letters · doi:10.1088/0256-307x/20/8/362 · Cited by 136
Positive words carry less information than negative words
Garcia, D., Garas, A., & Schweitzer, F. (2012) · EPJ Data Science · doi:10.1140/epjds3 · Cited by 118
Steels, L. (2005) · Connection Science · doi:10.1080/09540090500269088 · Cited by 123
“This argument has been made by several researchers [41], [19] using mathematical proofs and computer simulations.”
MethodThe variation of Zipf?s law in human language
Ferrer‐i‐Cancho, R. (2005) · The European Physical Journal B · doi:10.1140/epjb/e2005-00121-8 · Cited by 123
Zipf's Law, Music Classification, and Aesthetics
Manaris, B., Romero, J., Machado, P., Krehbiel, D., Hirzel, T. D., Pharr, W. M., & Davis, R. B. (2005) · Computer Music Journal · doi:10.1162/comj.2005.29.1.55 · Cited by 143
“However, when studied in depth, one realizes that Zipf’s Law captures the scaling properties of a phenomenon (Mandelbrot 1977, p. 345; Ferrer Cancho and Solé 2003).”
BackgroundA World Unto Itself: Human Communication as Active Inference
Vasil, J., Badcock, P. B., Constant, A., Friston, K., & Ramstead, M. J. D. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00417 · Cited by 94
The color lexicon of American English
Lindsey, D. T., & Brown, A. M. (2014) · Journal of Vision · doi:10.1167/14.2.17 · Cited by 107
“…the speaker to spend the least effort necessary in communication, at the risk of reduced clarity (producing a small vocabulary), and the need of the hearer for conciseness and clarity in the received message (requiring a larger vocabulary; see Ferrer i Cancho & Solé, 2003, for further discussion).”
BackgroundZipf's law from a communicative phase transition
Ferrer‐i‐Cancho, R. (2005) · The European Physical Journal B · doi:10.1140/epjb/e2005-00340-y · Cited by 111
Evolution of the most common English words and phrases over the centuries
Perc, M. (2012) · Journal of The Royal Society Interface · doi:10.1098/rsif.2012.0491 · Cited by 120
The consequences of Zipf's law for syntax and symbolic reference
Ferrer i Cancho, R., Riordan, O., & Bollobás, B. (2005) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2004.2957 · Cited by 114
“A communication system maximizing the information transfer (i.e. minimizing the effort for the hearer) by mapping every object to a distinctive signal (Ferrer i Cancho & Solé 2003) implies that two signals in Gn,m never share the same object, so Gn (and G 0 n) have no links at all.”
BackgroundInfluentialInformation arms race explains plant-herbivore chemical communication in ecological communities
Zu, P., Boege, K., del‐Val, E., Schuman, M. C., Stevenson, P. C., Zaldívar‐Riverón, A., & Saavedra, S. (2020) · Science · doi:10.1126/science.aba2965 · Cited by 103
Corominas‐Murtra, B., & Solé, R. V. (2010) · Physical Review E · doi:10.1103/physreve.82.011102 · Cited by 136
Self-citationZipf’s Law Arises Naturally When There Are Underlying, Unobserved Variables
Aitchison, L., Corradi, N., & Latham, P. E. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005110 · Cited by 115
Gerlach, M., & Font-Clos, F. (2020) · Entropy · doi:10.3390/e22010126 · Cited by 168
The Evolution of the Exponent of Zipf's Law in Language Ontogeny
Baixeries, J., Elvevåg, B., & Ferrer‐i‐Cancho, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053227 · Cited by 97
“, [3,4]).”
BackgroundWhat can we count in language, and what counts in language acquisition, cognition, and use?
Ellis, N. C. (2012) · De Gruyter eBooks · doi:10.1515/9783110274059.7 · Cited by 111
Petersen, A. M., Rotolo, D., & Leydesdorff, L. (2016) · Research Policy · doi:10.1016/j.respol.2015.12.004 · Cited by 103
“Zipf’s law, Heaps’ law, and other emergent features such as category schemes, can be used as empirical benchmarks to compare language models (e.g., Ferrer i Cancho and Sole, 2003; Puglisi et al., 2008; Serrano et al., 2009).”
BackgroundBrevity is not always a virtue in primate communication
Bezerra, B. M., Souto, A., Radford, A. N., & Jones, G. (2010) · Biology Letters · doi:10.1098/rsbl.2010.0455 · Cited by 91
A Complex Network Approach to Stylometry
Amancio, D. R. (2015) · PLoS ONE · doi:10.1371/journal.pone.0136076 · Cited by 98
“Language networks have been increasingly employed to understand theoretical linguistic aspects, such as the origins of fundamental properties [16] and the underlying mechanisms behind language acquisition in early years [17].”
BackgroundCommunity structure in the phonological network
Siew, C. S. Q. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00553 · Cited by 98
Smith, K. (2004) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2003.12.016 · Cited by 101
Universals of word order reflect optimization of grammars for efficient communication
Hahn, M., Jurafsky, D., & Futrell, R. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910923117 · Cited by 73
Why do syntactic links not cross?
Ferrer‐i‐Cancho, R. (2006) · Europhysics Letters (EPL) · doi:10.1209/epl/i2006-10406-0 · Cited by 83
The Oxford Handbook of the Mental Lexicon
Papafragou, A., Trueswell, J. C., & Gleitman, L. R. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.001.0001 · Cited by 88
Alternative Explanations of Hierarchical Differentiation in Urban Systems
Pumain, D. (2006) · Springer eBooks · doi:10.1007/1-4020-4127-6_8 · Cited by 82
The use of Zipf's law in animal communication analysis
Suzuki, R., Buck, J. R., & Tyack, P. L. (2004) · Animal Behaviour · doi:10.1016/j.anbehav.2004.08.004 · Cited by 80
“The studies of Zipf (1949), Mandelbrot (1952) and Ferrer i Cancho & Solé (2003) all belong to this context.”
BackgroundWord Forms Are Structured for Efficient Use
Mahowald, K., Dautriche, I., Gibson, E. A. F., & Piantadosi, S. T. (2018) · Cognitive Science · doi:10.1111/cogs.12689 · Cited by 91
“…accuracy (Lindblom, 1990; Piantadosi et al., 2011b; Zipf, 1949) and even with accounts that focus only on transmission accuracy (Ferrer-i-Cancho & Solé, 2003; Pate & Goldwater, 2015) as the same words that are easy to use by speakers may also be easy to process by listeners (Brown,…”
Mapping the landscape of Internet Studies: Text mining of social science journal articles 2000–2009
Peng, T., Zhang, L., Zhong, Z., & Zhu, J. J. H. (2012) · New Media & Society · doi:10.1177/1461444812462846 · Cited by 91
“This skewed distribution reflects a pattern (known as power-law distribution or Zipf’s law) similar to that in the use of language in daily life (Cancho and Sole, 2003; Zipf, 1949) and other academic writings (Chen et al., 2009; Zhang et al., 2010).”
MethodHow disgust facilitates avoidance: an ERP study on attention modulation by threats
Liu, Y., Zhang, D., & Luo, Y. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu094 · Cited by 81
The origins of Zipf's meaning‐frequency law
Ferrer‐i‐Cancho, R., & Vitevitch, M. S. (2018) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24057 · Cited by 81
Semantic imitation in social tagging
Fu, W., Kannampallil, T., Kang, R., & Hu, J. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1806923.1806926 · Cited by 79
Communicative need in colour naming
Zaslavsky, N., Kemp, C., Tishby, N., & Regier, T. (2020) · Cognitive Neuropsychology · doi:10.1080/02643294.2019.1604502 · Cited by 70
Lazy User Theory: A Dynamic Model to Understand User Selection of Products and Services
Tetard, F., & Collan, M. (2009) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2009.287 · Cited by 72
Íñiguez, G., Pineda, C., Gershenson, C., & Barabási, A.-Ĺ. (2022) · Nature Communications · doi:10.1038/s41467-022-29256-x · Cited by 88
The Dynamics and Semantics of Collaborative Tagging.
Halpin, H., Robu, V., & Shepherd, H. R. (2006) · Data Archiving and Networked Services (DANS) · Cited by 67
Deviation of Zipf's and Heaps' Laws in Human Languages with Limited Dictionary Sizes
Lü, L., Zhang, Z., & Zhou, T. (2013) · Scientific Reports · doi:10.1038/srep01082 · Cited by 66
van Son, R. J. J. H., & Pols, L. C. W. (2003) · Cited by 66
Chinese character structure analysis based on complex networks
Li, J.-Y., & Zhou, J. (2007) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2007.02.059 · Cited by 69
“The above features agree with the principle of least effort [39].”
BackgroundCarron-Arthur, B., Cunningham, J. A., & Griffiths, K. M. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.09.003 · Cited by 64
“Arangeofexplanationshasbeenproposedtoexplaintheoccurrence of Zip fi an distributions including, for example, the principle of least effort (Ferrer i Cancho and Sole, 2003), proportional growth processes (Gabaix, 1999) or a simple stochastic process (Miller et al., 1958).”
BackgroundA scaling law beyond Zipf's law and its relation to Heaps' law
Font-Clos, F., Boleda, G., & Corral, Á. J. (2013) · New Journal of Physics · doi:10.1088/1367-2630/15/9/093033 · Cited by 83
“At a theoretical level, many different competing explanations of Zipf’s law have arisen [38], as random (monkey) typing [27, 24], preferential repetitions or proportional growth [35, 29, 32], the least effort principle [41, 18, 8, 15], and, beyond linguistics, Boltzmann-type approaches [13], or even avalanche dynamics…”
BackgroundPredictability of meaning in grammatical encoding: Optional plural marking
Kurumada, C., & Grimm, S. (2019) · Cognition · doi:10.1016/j.cognition.2019.04.022 · Cited by 62
Complexity/informativeness trade-off in the domain of indefinite pronouns
Denić, M., Steinert-Threlkeld, S., & Szymanik, J. (2021) · Semantics and Linguistic Theory · doi:10.3765/salt.v30i0.4811 · Cited by 56
King, A., & Wedel, A. B. (2020) · Open Mind · doi:10.1162/opmi_a_00030 · Cited by 62
“…of these studies conclude that patterns in the lexicon support the hypothesis that communicative efficiency is a driving pressure in the evolution of word to form mappings (Ferrer i Cancho & Solé, 2003; Kanwal, Smith, Culbertson, & Kirby, 2017; Piantadosi, Tily, & Gibson, 2009, 2012; Zipf, 1949).”
BackgroundMethodInfluentialThe learnability consequences of Zipfian distributions in language
Lavi‐Rotbain, O., & Arnon, I. (2022) · Cognition · doi:10.1016/j.cognition.2022.105038 · Cited by 67
Ellis, N. C., O’Donnell, M. B., & Römer, U. (2015) · Wiley eBooks · doi:10.1002/9781118346136.ch7 · Cited by 75
Entropy rate as a measure of animal vocal complexity
Kershenbaum, A. (2014) · Bioacoustics · doi:10.1080/09524622.2013.850040 · Cited by 51
Word sense disambiguation via high order of learning in complex networks
Silva, T. C., & Amancio, D. R. (2012) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/98/58001 · Cited by 57
High plasticity in marmoset monkey vocal development from infancy to adulthood
Gultekin, Y. B., Hildebrand, D. G. C., Hammerschmidt, K., & Hage, S. R. (2021) · Science Advances · doi:10.1126/sciadv.abf2938 · Cited by 56
TOWARDS THE QUANTIFICATION OF THE SEMANTIC INFORMATION ENCODED IN WRITTEN LANGUAGE
Montemurro, M. A., & Zanette, D. H. (2010) · Advances in Complex Systems · doi:10.1142/s0219525910002530 · Cited by 62
“In recent years the use of tools drawn from statistical physics has quantitatively revealed rich linguistic structures at many scales, ranging from the domain of syntax to the organisation of whole lexicons and literary corpora [5, 4, 6, 9, 10, 16, 24, 25].”
BackgroundAllen, J., Garland, E. C., Dunlop, R. A., & Noad, M. J. (2019) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2019.2014 · Cited by 54
“Evidence suggests that small-world structure results from the need for language to have ‘optimal navigation’, in which word arrangement can express an intended message efficiently using the smallest number of steps [39,40].”
BackgroundComparing intermittency and network measurements of words and their dependence on authorship
Amancio, D. R., Altmann, E. G., Oliveira, O. N., & Costa, L. D. F. (2011) · New Journal of Physics · doi:10.1088/1367-2630/13/12/123024 · Cited by 56
Feltgen, Q., Fagard, B., & Nadal, J. (2017) · Royal Society Open Science · doi:10.1098/rsos.170830 · Cited by 51
“[36] Ramon Ferrer i Cancho and Ricard V Solé.”
BackgroundWhale song shows language-like statistical structure
Arnon, I., Kirby, S., Allen, J., Garrigue, C., Carroll, E. L., & Garland, E. C. (2025) · Science · doi:10.1126/science.adq7055 · Cited by 57
The orthographic similarity structure of English words: Insights from network science
Siew, C. S. Q. (2018) · Applied Network Science · doi:10.1007/s41109-018-0068-1 · Cited by 51
“Previous work examining Zipf ’ s law of word frequencies (which states that word frequencies decays as a power law of its rank; Zipf 1935) and other statistical properties of language (Ferrer i Cancho and Solé 2003) may offer an explanation.”
BackgroundEmergence of Zipf’s law in the evolution of communication
Corominas‐Murtra, B., Fortuny, J., & Solé, R. V. (2011) · Physical Review E · doi:10.1103/physreve.83.036115 · Cited by 54
Self-citationStatistical Analysis of Bus Networks in India
Chatterjee, A., Manjalavil, M. M., & Ramadurai, G. (2016) · PLoS ONE · doi:10.1371/journal.pone.0168478 · Cited by 53
“Both BA and WS models advocate the smallworld phenomenon, which is a characteristic feature of real-world networks, such as electric power grids, WWW, Internet, social-networks, protein-yeast (metabolite) interaction networks, citation networks, and movie-actors collaboration networks [1, 2, 3, 5, 6, 19, 20, 21, 22, 2…”
BackgroundEvo Devo Universe? A Framework for Speculations on Cosmic Culture
Smart, J. M. (2009) · Cited by 61
The optimality of attaching unlinked labels to unlinked meaningsPreprint
Ferrer‐i‐Cancho, R. (2013) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.48550/arxiv.1310.5884 · Cited by 51
The appropriate use of Zipf's law in animal communication studies
McCowan, B., Doyle, L. R., Jenkins, J. M., & Hanser, S. F. (2004) · Animal Behaviour · doi:10.1016/j.anbehav.2004.09.002 · Cited by 48
“…law is not an appropriate route to conclude anything about the linguistic nature or potential capacity for communication transfer’ (page 11), while Cancho & Solé (2003) state ‘Our finding strongly suggests that Zipf’s law is a hallmark of symbolic reference and not a meaningless feature’…”
BackgroundMethodInfluentialUsing virtual edges to improve the discriminability of co-occurrence text networks
Quispe, L. V. C., Tohalino, J. A. V., & Amancio, D. R. (2020) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2020.125344 · Cited by 48
The rank-size scaling law and entropy-maximizing principle
Chen, Y. (2011) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2011.07.010 · Cited by 47
“This suggests the principle of least effort of human behavior (Ferrer i Cancho and Solé, 2003; Zipf, 1949), which seems to be associated with the principle of least action in physics.”
BackgroundAuthorship recognition via fluctuation analysis of network topology and word intermittency
Amancio, D. R. (2015) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2015/03/p03005 · Cited by 55
Taler, V., Johns, B. T., & Jones, M. N. (2019) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbz003 · Cited by 51
Metadata
- Authors
- Cancho, R. F. I., & Solé, R. V.
- Affiliations
- Complex Systems Lab, Universitat Pompeu Fabra, Doctor Aiguader 80, 08003 Barcelona, Spain; and Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501
- Santa Fe Institute (US)
- ORCID
- Solé, Ricard V.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2003-01-22
- Volume
- 100
- Issue
- 3
- Pages
- 788-791
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC298679
- OpenAlex
- W2009047999
- Cited by
- 588
- References
- 35
- Citations by year
- 2026: 42 · 2025: 12 · 2024: 14 · 2023: 24 · 2022: 56 · 2021: 38 · 2020: 27 · 2019: 33 · 2018: 33 · 2017: 33 · 2016: 23 · 2015: 36 · 2014: 21 · 2013: 24 · 2012: 39
- FWCI
- 335.49
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UPCommons institutional repository (Universitat Politècnica de Catalunya) (acceptedVersion, other-oa)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, public-domain)
- Topics
- Social Sciences › Cultural Studies › Language and cultural evolution
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Keywords
- Zipf's law, principle of least effort, language evolution, word frequency distribution, power law, symbolic references, indexical reference, language emergence
- MeSH terms
- Communication, Hearing, Humans, Language, Models, Theoretical, Speech, Verbal Behavior, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.