The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Info/information theory: Speakers choose shorter words in predictive contexts
Abstract
A major open question in natural language research is the role of communicative efficiency in the origin and on-line processing of language structures. Here, we use word pairs like chimp/chimpanzee, which differ in length but have nearly identical meanings, to investigate the communicative properties of lexical systems and the communicative pressures on language users.If language is designed to be information-theoretically optimal, then shorter words should convey less information than their longer counterparts, when controlling for meaning. Consistent with this prediction, a corpus analysis revealed that the short form of our meaning-matched pairs occurs in more predictive contexts than the longer form. Second, a behavioral study showed that language users choose the short form more often in predictive contexts, suggesting that tendencies to be information-theoretically efficient manifest in explicit behavioral choices. Our findings, which demonstrate the prominent role of communicative efficiency in the structure of the lexicon, complement and extend the results of Piantadosi, Tily, and Gibson (2011), who showed that word length is better correlated with Shannon information content than with frequency. Crucially, we show that this effect arises at least in part from active speaker choice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
WordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540
Jurafsky, D. S., & Martin, J. (2000) · Cited by 4,132
Expectation-based syntactic comprehension
Levy, R. (2008) · Cognition · doi:10.1016/j.cognition.2007.05.006 · Cited by 2,202
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
(1975) · Medical Entomology and Zoology · Cited by 2,045
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology.
Hollingshead, A. B., & Zipf, G. K. (1949) · American Sociological Review · doi:10.2307/2086695 · Cited by 1,355
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150
Aylett, M., & Turk, A. (2004) · Language and Speech · doi:10.1177/00238309040470010201 · Cited by 781
Probabilistic relations between words: Evidence from reduction in lexical production
Jurafsky, D., Bell, A., Gregory, M., & Raymond, W. D. (2001) · Typological Studies in Language · doi:10.1075/tsl.45.13jur · Cited by 762
Redundancy and reduction: Speakers manage syntactic information density
Florian Jaeger, T. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2010.02.002 · Cited by 733
Word lengths are optimized for efficient communication
Piantadosi, S. T., Tily, H., & Gibson, E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012551108 · Cited by 695
Self-citationSpeakers optimize information density through syntactic reduction
Levy, R., & Jaeger, T. F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0111 · Cited by 503
Bell, A., Jurafsky, D., Fosler-Lussier, E., Girand, C., Gregory, M., & Gildea, D. (2003) · The Journal of the Acoustical Society of America · doi:10.1121/1.1534836 · Cited by 460
Massive Reduction In Conversational American English
Johnson, K. (2026) · Pronunciation · doi:10.4324/9781003763826-9 · Cited by 337
Knowledge of Grammar, Knowledge of Usage: Syntactic Probabilities Affect Pronunciation Variation
Gahl, S., & Garnsey, S. M. (2004) · Language · doi:10.1353/lan.2004.0185 · Cited by 287
Lexical frequency and acoustic reduction in spoken Dutch
Pluymaekers, M., Ernestus, M., & Baayen, R. H. (2005) · The Journal of the Acoustical Society of America · doi:10.1121/1.2011150 · Cited by 272
Using Mechanical Turk to Obtain and Analyze English Acceptability Judgments
Gibson, E., Piantadosi, S., & Fedorenko, K. (2011) · Language and Linguistics Compass · doi:10.1111/j.1749-818x.2011.00295.x · Cited by 206
Self-citationSpeaking Rationally: Uniform Information Density as an Optimal Strategy for Language Production
Frank, A. F., & Jaeger, T. F. (2008) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 176
Entropy rate constancy in text
Genzel, D., & Charniak, E. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073117 · Cited by 167
van Son, R. J. J. H., & Pols, L. C. W. (2003) · Cited by 66
Information content versus word length in random typing
Ferrer‐i‐Cancho, R., & Martín, F. M. D. P. (2011) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2011/12/l12002 · Cited by 62
Functional Biases in Language Learning: Evidence from Word Order and Case-Marking Interaction.
Fedzechkina, M., Jaeger, T. F., & Newport, E. L. (2011) · eScholarship (California Digital Library) · Cited by 11
Cited by
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892
How Efficiency Shapes Human Language
Gibson, E., Futrell, R., Piantadosi, S. P., Dautriche, I., Mahowald, K., Bergen, L., & Levy, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.02.003 · Cited by 485
Self-citationPrediction during natural language comprehension
Willems, R. M., Frank, S. L., Nijhof, A. D., Hagoort, P., & van den Bosch, A. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv075 · Cited by 288
The length of words reflects their conceptual complexity
Lewis, M. L., & Frank, M. C. (2016) · Cognition · doi:10.1016/j.cognition.2016.04.003 · Cited by 153
The forms and meanings of grammatical markers support efficient communication
Mollica, F., Bacon, G., Zaslavsky, N., Xu, Y., Regier, T., & Kemp, C. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2025993118 · Cited by 42
Metadata
- Authors
- Mahowald, K., Fedorenko, E., Piantadosi, S. T., & Gibson, E.
- Venue
- Cognition
- Publisher
- Elsevier BV
- Published
- 2013-02
- Volume
- 126
- Issue
- 2
- Pages
- 313-318
- ISSN
- 0010-0277 (ISSN-L)
- OpenAlex
- W2127516329
- Cited by
- 259
- References
- 25
- FWCI
- 46.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.