The DOI matches its Crossref record; 114 of the 114 references it cites were found in a registry or an index.
Dependency distance: A new perspective on syntactic patterns in natural languages
Abstract
Dependency distance, measured by the linear distance between two syntactically related words in a sentence, is generally held as an important index of memory burden and an indicator of syntactic difficulty. Since this constraint of memory is common for all human beings, there may well be a universal preference for dependency distance minimization (DDM) for the sake of reducing memory burden. This human-driven language universal is supported by big data analyses of various corpora that consistently report shorter overall dependency distance in natural languages than in artificial random languages and long-tailed distributions featuring a majority of short dependencies and a minority of long ones. Human languages, as complex systems, seem to have evolved to come up with diverse syntactic patterns under the universal pressure for dependency distance minimization. However, there always exist a small number of long-distance dependencies in natural languages, which may reflect some other biological or functional constraints. Language system may adapt itself to these sporadic long-distance dependencies. It is these universal constraints that have shaped such a rich diversity of syntactic patterns in human languages.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The origins of order; self organization and selection in evolution
(1994) · International Journal of Biochemistry · doi:10.1016/0020-711x(94)90119-8 · Cited by 6,649
Big data: a revolution that will transform how we live, work, and think
(2013) · Choice Reviews Online · doi:10.5860/choice.50-6804 · Cited by 3,630
de Saussure, F., Bally, C., Sechehaye, A., Reidlinger, A., & Baskin, W. (1960) · The Journal of American Folklore · doi:10.2307/538001 · Cited by 3,557
Hoenigswald, H. M., Sechehay, A., Saussure, F. D., Bally, C., Reidlinger, A., & Baskin, W. (1960) · The Classical World · doi:10.2307/4344381 · Cited by 3,023
Linguistic complexity: locality of syntactic dependencies
Gibson, E. (1998) · Cognition · doi:10.1016/s0010-0277(98)00034-1 · Cited by 2,537
Expectation-based syntactic comprehension
Levy, R. (2008) · Cognition · doi:10.1016/j.cognition.2007.05.006 · Cited by 2,202
Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology
Chao, Y. R., & Zipf, G. K. (1950) · Language · doi:10.2307/409735 · Cited by 2,193
A grammar of contemporary English
Zandvoort, R. W. (1974) · Lingua · doi:10.1016/0024-3841(74)90042-4 · Cited by 1,899
Efficiency and Complexity in Grammars
Hawkins, J. A. (2004) · doi:10.1093/acprof:oso/9780199252695.001.0001 · Cited by 1,743
A Grammar of Contemporary English
Rensky, M., Quirk, R., Greenbaum, S., Leech, G., & Svartvik, J. (1974) · The Modern Language Journal · doi:10.2307/323848 · Cited by 1,565
Some Tests of the Decay Theory of Immediate Memory
Brown, J. (1958) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215808416249 · Cited by 1,442
Haken, H. (1983) · Springer Series in Synergetics · doi:10.1007/978-3-642-88338-5 · Cited by 1,431
Croft, W. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511840579 · Cited by 1,368
(1992) · Journal of Pragmatics · doi:10.1016/0378-2166(92)90042-a · Cited by 1,198
A Performance Theory of Order and Constituency
Hawkins, J. A. (1995) · Cambridge University Press eBooks · doi:10.1017/cbo9780511554285 · Cited by 1,180
An Activation‐Based Model of Sentence Processing as Skilled Memory Retrieval
Lewis, R. L., & Vasishth, S. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_25 · Cited by 1,035
Jespersen, O. (2013) · Routledge eBooks · doi:10.4324/9780203716045 · Cited by 1,020
The Dependency Locality Theory: A Distance-Based Theory of Linguistic Complexity
Gibson, E. (2001) · Image, Language, Brain · doi:10.7551/mitpress/3654.003.0008 · Cited by 937
(1963) · Cited by 855
Potter, S., & Greenberg, J. H. (1964) · The Modern Language Review · doi:10.2307/3721182 · Cited by 847
Arnold, J. E., Losongco, A., Wasow, T., & Ginstrom, R. (2000) · Language · doi:10.1353/lan.2000.0045 · Cited by 798
A Performance Theory of Order and Constituency
Covington, M. A., & Hawkins, J. A. (1999) · Language · doi:10.2307/417736 · Cited by 761
The Now-or-Never bottleneck: A fundamental constraint on language
Christiansen, M. H., & Chater, N. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1500031x · Cited by 733
Redundancy and reduction: Speakers manage syntactic information density
Florian Jaeger, T. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2010.02.002 · Cited by 733
Predicting the dative alternation
Bresnan, J. W., Cueni, A., Nikitina, T. V., & Baayen, R. H. (2007) · Max Planck Institute for Plasma Physics · Cited by 694
A Short History of Linguistics
Robins, R. H. (2013) · Routledge eBooks · doi:10.4324/9781315843186 · Cited by 619
Least effort and the origins of scaling in human language
Cancho, R. F. I., & Solé, R. V. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0335980100 · Cited by 588
Cognitive Foundations of Interpretation
Bouma, G., Krämer, I. M., & Zwarts, J. (2007) · Radboud Repository (Radboud University) · Cited by 580
Data from eye-tracking corpora as evidence for theories of syntactic processing complexity
Demberg, V., & Keller, F. (2008) · Cognition · doi:10.1016/j.cognition.2008.07.008 · Cited by 570
A model and an hypothesis for language structure
Yngve, V. H. (1960) · Cited by 522
Silberer, C., & Lapata, M. (2012) · The Association for Computational Linguistics · Cited by 520
Language Networks: The New Word Grammar
Hudson, R. (2007) · Cited by 507
Cognitive Constraints and Island Effects
Hofmeister, P., & Sag, I. A. (2010) · Language · doi:10.1353/lan.0.0223 · Cited by 505
Dependency Distance as a Metric of Language Comprehension Difficulty
Liu, H. (2008) · Journal of Cognitive Science · doi:10.17791/jcs.2008.9.2.159 · Cited by 466
Self-citationLarge-scale evidence of dependency length minimization in 37 languages
Futrell, R., Mahowald, K., & Gibson, E. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1502134112 · Cited by 455
Consequences of the Serial Nature of Linguistic Input for Sentenial Complexity
Grodner, D., & Gibson, E. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_7 · Cited by 455
Signal-Driven Computations in Speech Processing
Peña, M., Bonatti, L. L., Nespor, M., & Mehler, J. (2002) · Science · doi:10.1126/science.1072901 · Cited by 451
Agreement Processes in Sentence Comprehension
Pearlmutter, N. J., Garnsey, S. M., & Bock, K. (1999) · Journal of Memory and Language · doi:10.1006/jmla.1999.2653 · Cited by 403
An Introduction to Word Grammar
Hudson, R. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511781964 · Cited by 400
A structural principle of language and its implications
Lehmann, W. P. (1973) · Language · doi:10.2307/412102 · Cited by 376
Kaplan, K. W. (1980) · Zeitschrift für allgemeine Mikrobiologie · doi:10.1002/jobm.19800200923 · Cited by 374
Beziehungen zwischen Umfang und Reihenfolge von Satzgliedern.
(1909) · Indogermanische Forschungen · doi:10.1515/9783110242652.110 · Cited by 374
A short history of linguistics
Mounin, G. (1969) · Lingua · doi:10.1016/0024-3841(69)90082-5 · Cited by 368
Processing relative clauses in Chinese
Hsiao, F., & Gibson, E. (2003) · Cognition · doi:10.1016/s0010-0277(03)00124-0 · Cited by 329
Van Dyke, J. (2003) · Journal of Memory and Language · doi:10.1016/s0749-596x(03)00081-0 · Cited by 319
“Long before short” preference in the production of a head-final language
Yamashita, H., & Chang, F. (2001) · Cognition · doi:10.1016/s0010-0277(01)00121-4 · Cited by 315
The fan effect: New results and new theories.
Anderson, J. R., & Reder, L. M. (1999) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.128.2.186 · Cited by 305
Stallings, L. M., MacDonald, M. C., & O'Seaghdha, P. G. (1998) · Journal of Memory and Language · doi:10.1006/jmla.1998.2586 · Cited by 301
The Genesis of Syntactic Complexity: Diachrony, ontogeny, neuro-cognition, evolution
Givon, T. (2009) · Cited by 283
Argument-head distance and processing complexity: Explaining both locality and antilocality effects
Vasishth, S., & Lewis, R. L. (2006) · Language · doi:10.1353/lan.2006.0236 · Cited by 279
A computational theory of human linguistic processing: memory limitations and processing breakdown
Gibson, E. A. F. (1991) · Cited by 249
A Noisy-Channel Account of Crosslinguistic Word-Order Variation
Gibson, E., Piantadosi, S. T., Brink, K., Bergen, L., Lim, E., & Saxe, R. (2013) · Psychological Science · doi:10.1177/0956797612463705 · Cited by 248
Locality and Parsing Complexity
Konieczny, L. (2000) · Journal of Psycholinguistic Research · doi:10.1023/a:1026528912821 · Cited by 245
Interference effects from grammatically unavailable constituents during sentence processing.
Van Dyke, J. A. (2007) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.33.2.407 · Cited by 238
Mari Ostendorf, E., Collins, M., Narayanan, S. R., & Oard, D. W. (2009) · Cited by 224
Euclidean distance between syntactically linked words
Ferrer i Cancho, R. (2004) · Physical Review E · doi:10.1103/physreve.70.056135 · Cited by 212
The origin and evolution of word order
Gell-Mann, M., & Ruhlen, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1113716108 · Cited by 202
Resolution of syntactic category ambiguities: Eye movements in parsing lexically ambiguous sentences
Frazier, L., & Rayner, K. (1987) · Journal of Memory and Language · doi:10.1016/0749-596x(87)90137-9 · Cited by 193
Processing Chinese relative clauses in context
Gibson, E., & Wu, H.-H. I. (2013) · Language and Cognitive Processes · doi:10.1080/01690965.2010.536656 · Cited by 182
Do Grammars Minimize Dependency Length?
Gildea, D., & Temperley, D. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01073.x · Cited by 173
Minimization of dependency length in written English
Temperley, D. (2007) · Cognition · doi:10.1016/j.cognition.2006.09.011 · Cited by 166
Expectation and locality effects in German verb-final structures
Levy, R. P., & Keller, F. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.02.005 · Cited by 164
The processing of extraposed structures in English
Lévy, R., Fedorenko, E. G., Breen, M. E., & Gibson, E. A. F. (2011) · Cognition · doi:10.1016/j.cognition.2011.07.012 · Cited by 161
Processing Chinese Relative Clauses: Evidence for the Subject-Relative Advantage
Vasishth, S., Chen, Z., Qiang, L., & Gueilan, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077006 · Cited by 157
The syntactic complexity of Russian relative clauses
Lévy, R., Fedorenko, E. G., & Gibson, E. A. F. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.10.005 · Cited by 150
Jiang, J., & Liu, H. (2015) · Language Sciences · doi:10.1016/j.langsci.2015.04.002 · Cited by 145
Self-citationParra, G. (2015) · Realidad, datos y espacio. Revista internacional de estadística y geografía · Cited by 130
Evidence against decay in verbal working memory.
Oberauer, K., & Lewandowsky, S. (2012) · Journal of Experimental Psychology General · doi:10.1037/a0029588 · Cited by 117
In search of on-line locality effects in sentence comprehension.
Bartek, B., Lewis, R. L., Vasishth, S., & Smith, M. R. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0024194 · Cited by 117
The subject-relative advantage in Chinese: Evidence for expectation-based processing
Jäger, L. A., Chen, Z., Qiang, L., Lin, C.-J. C., & Vasishth, S. (2015) · Journal of Memory and Language · doi:10.1016/j.jml.2014.10.005 · Cited by 109
Perceptual constraints and the learnability of simple grammars
Endress, A. D., Dehaene‐Lambertz, G., & Mehler, J. (2007) · Cognition · doi:10.1016/j.cognition.2006.12.014 · Cited by 108
Strong Expectations Cancel Locality Effects: Evidence from Hindi
Husain, S., Vasishth, S., & Srinivasan, N. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100986 · Cited by 105
End-Weight from the Speaker's Perspective
Wasow, T. (1997) · Journal of Psycholinguistic Research · doi:10.1023/a:1025080709112 · Cited by 101
Köhler, R. (2012) · De Gruyter eBooks · doi:10.1515/9783110272925 · Cited by 95
Cognitive systems struggling for word order
Langus, A., & Nespor, M. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2010.01.004 · Cited by 95
Locality and accessibility in wh-questions
Hofmeister, P., Jaeger, T. F., Sag, I. A., Arnon, I., & Snider, N. (2007) · doi:10.1515/9783110198621.185 · Cited by 93
Chinese subject-relative clauses are more difficult to process than the object-relative clauses
Chen, B., Ning, A., Bi, H., & Dunlap, S. (2008) · Acta Psychologica · doi:10.1016/j.actpsy.2008.04.005 · Cited by 87
Word chunk frequencies affect the processing of pronominal object-relative clauses
Reali, F., & Christiansen, M. H. (2006) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210600971469 · Cited by 87
Why do syntactic links not cross?
Ferrer‐i‐Cancho, R. (2006) · Europhysics Letters (EPL) · doi:10.1209/epl/i2006-10406-0 · Cited by 83
Processing Relative Clauses in Supportive Contexts
Fedorenko, E. G., Piantadosi, S., & Gibson, E. A. F. (2012) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01217.x · Cited by 83
The effects of genre on dependency distance and dependency direction
Wang, Y., & Liu, H. (2016) · Language Sciences · doi:10.1016/j.langsci.2016.09.006 · Cited by 80
Self-citationVasishth, S., & Drenhaus, H. (2011) · Dialogue & Discourse · doi:10.5087/dad.2011.104 · Cited by 78
Working memory differences in long-distance dependency resolution
Nicenboim, B., Vasishth, S., Gattei, C., Sigman, M., & Kliegl, R. M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00312 · Cited by 78
Dependency-length minimization in natural and artificial languages∗
Temperley, D. (2008) · Journal of Quantitative Linguistics · doi:10.1080/09296170802159512 · Cited by 66
Syntactic variations in Chinese–English code-switching
Wang, L., & Liu, H. (2012) · Lingua · doi:10.1016/j.lingua.2012.10.003 · Cited by 61
Self-citationDoes headedness affect processing? A new look at the VO–OV contrast
Ueno, M., & Polinsky, M. (2009) · Journal of Linguistics · doi:10.1017/s0022226709990065 · Cited by 61
Memory and surprisal in human sentence comprehension
Lévy, R. (2013) · Cited by 61
Nakatani, K., & Gibson, E. A. F. (2008) · Linguistics · doi:10.1515/ling.2008.003 · Cited by 58
The risks of mixing dependency lengths from sequences of different length
Ferrer‐i‐Cancho, R., & Liu, H. (2014) · Glottotheory · doi:10.1515/glot-2014-0014 · Cited by 57
Self-citationThe Placement of the Head that Minimizes Online Memory: A Complex Systems Approach
Ferrer‐i‐Cancho, R. (2015) · Language Dynamics and Change · doi:10.1163/22105832-00501007 · Cited by 57
Primitive computations in speech processing
Endress, A. D., & Mehler, J. (2009) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210902783646 · Cited by 56
Probability distribution of dependency distance
Liu, H. (2007) · Cited by 51
Self-citationAnimacy and the Resolution of Temporary Ambiguity in Relative Clause Comprehension in Mandarin
Lin, Y., & Garnsey, S. M. (2010) · Studies in theoretical psycholinguistics · doi:10.1007/978-90-481-9213-7_12 · Cited by 50
Quantitative typological analysis of Romance languages
Liu, H., & Xu, C. (2012) · Poznań Studies in Contemporary Linguistics · doi:10.1515/psicl-2012-0027 · Cited by 48
Self-citationDirect Evidence of Memory Retrieval as a Source of Difficulty in Non‐Local Dependencies in Language
Fedorenko, E. G., Woodbury, R., & Gibson, E. A. F. (2013) · Cognitive Science · doi:10.1111/cogs.12021 · Cited by 44
Can chunking reduce syntactic complexity of natural languages?
Lu, Q., Xu, C., & Liu, H. (2016) · Complexity · doi:10.1002/cplx.21779 · Cited by 44
Self-citationReali, F., & Christiansen, M. H. (2009) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.10.1.02rea · Cited by 43
Investigating locality effects and surprisal in written English syntactic choice phenomena
Rajkumar, R. P., van Schijndel, M., White, M., & Schuler, W. (2016) · Cognition · doi:10.1016/j.cognition.2016.06.008 · Cited by 34
Minimal-length linearizations for mildly context-sensitive dependency trees
Park, Y. A., & Lévy, R. (2009) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1620754.1620803 · Cited by 33
Scarcity of crossing dependencies: A direct outcome of a specific constraint?
Gómez‐Rodríguez, C., & Ferrer‐i‐Cancho, R. (2017) · Physical review. E · doi:10.1103/physreve.96.062304 · Cited by 32
Gulordava, K., Merlo, P., & Crabbé, B. (2015) · doi:10.3115/v1/p15-2078 · Cited by 32
Crossings as a side effect of dependency lengths
Ferrer‐i‐Cancho, R., & Gómez‐Rodríguez, C. (2016) · Complexity · doi:10.1002/cplx.21810 · Cited by 30
Minimal Dependency Length in Realization Ranking
White, M., & Rajkumar, R. P. (2012) · Cited by 29
Favor Short Dependencies: Parsing with Soft and Hard Constraints on Dependency Length
Eisner, J. M., & Smith, N. A. (2010) · Text, speech and language technology · doi:10.1007/978-90-481-9352-3_8 · Cited by 24
Dissociation of short-term forgetting from the passage of time.
White, K. G. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0025197 · Cited by 18
The influence of Chunking on Dependency Crossing and DistancePreprint
Lu, Q., Xu, C., & Liu, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01310 · Cited by 17
Self-citationMean Hierarchical Distance Augmenting Mean Dependency Distance
Jing, Y., & Liu, H. (2015) · Cited by 17
Self-citationThe scaling of the minimum sum of edge lengths in uniformly random trees
Esteban, J. L., Ferrer‐i‐Cancho, R., & Gómez‐Rodríguez, C. (2016) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/2016/06/063401 · Cited by 14
Xu, C., & Liu, H. (2015) · Poznań Studies in Contemporary Linguistics · doi:10.1515/psicl-2015-0018 · Cited by 9
Self-citationMisyak, J. B., & Christiansen, M. H. (2010) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 7
Eppler, E. M. D. (2013) · Cited by 7
Ferrer‐i‐Cancho, R. (2014) · Physics of Life Reviews · doi:10.1016/j.plrev.2014.07.014 · Cited by 6
A computational model of cognitive constraints in syntactic locality
Hale, J., & Boston, M. F. (2012) · eCommons (Cornell University) · Cited by 5
Beyond description. Comment on "Approaching human language with complex networks" by Cong & LiuPreprint
Ferrer‐i‐Cancho, R. (2014) · arXiv (Cornell University) · Cited by 4
Cited by
Machine learning in materials science
Wei, J., Chu, X., Sun, X., Xu, K., Deng, H., Chen, J., Wei, Z., & Lei, M. (2019) · InfoMat · doi:10.1002/inf2.12028 · Cited by 1,069
How Efficiency Shapes Human Language
Gibson, E., Futrell, R., Piantadosi, S. P., Dautriche, I., Mahowald, K., Bergen, L., & Levy, R. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.02.003 · Cited by 485
Osman, A. I., Nasr, M., Eltaweil, A. S., Hosny, M., Farghali, M., Al-Fatesh, A. S., Rooney, D. W., & Abd El-Monaem, E. M. (2024) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2024.03.223 · Cited by 270
Jiang, J., Bi, P., & Liu, H. (2019) · Journal of Second Language Writing · doi:10.1016/j.jslw.2019.100666 · Cited by 109
Self-citationContrasting Linguistic Patterns in Human and LLM-Generated News Text
Muñoz-Ortiz, A., Gómez-Rodríguez, C., & Vilares, D. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10903-2 · Cited by 94
Metadata
- Authors
- Liu, H., Xu, C., & Liang, J.
- Venue
- Physics of Life Reviews
- Publisher
- Elsevier BV
- Published
- 2017-07
- Volume
- 21
- Pages
- 171-193
- ISSN
- 1571-0645 (ISSN-L)
- OpenAlex
- W2601979355
- Cited by
- 300
- References
- 114
- FWCI
- 151.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.