Linguistic complexity as the predictor of EFL independent and integrated writing quality

Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.

Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349 · see citing works

Towards an Organic Approach to Investigating CAF in Instructed SLA: The Case of Complexity

Norris, J. M., & Ortega, L. (2009) · Applied Linguistics · doi:10.1093/applin/amp044 · Cited by 1,258 · see citing works

Automatic analysis of syntactic complexity in second language writing

Lu, X. (2010) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.15.4.02lu · Cited by 1,053 · see citing works

Second Language Development in Writing: Measures of Fluency, Accuracy and Complexity

Broussard, K. M., Wolfe-Quintero, K., Inagaki, S., & Kim, H.-Y. (2001) · TESOL Quarterly · doi:10.2307/3587656 · Cited by 913 · see citing works

MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment

McCarthy, P. M., & Jarvis, S. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.381 · Cited by 905 · see citing works

Should we use characteristics of conversation to measure grammatical complexity in L2 writing development?

BIBER, D., GRAY, B., & POONPON, K. (2011) · TESOL Quarterly · doi:10.5054/tq.2011.244483 · Cited by 804 · see citing works

Challenging stereotypes about academic writing: Complexity, elaboration, explicitness

Biber, D., & Gray, B. (2010) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2010.01.001 · Cited by 668 · see citing works

Writing Expertise and Second‐Language Proficiency*

Cumming, A. (1989) · Language Learning · doi:10.1111/j.1467-1770.1989.tb00592.x · Cited by 641 · see citing works

Automatically Assessing Lexical Sophistication: Indices, Tools, Findings, and Application

Kyle, K. D., & Crossley, S. A. (2014) · TESOL Quarterly · doi:10.1002/tesq.194 · Cited by 562 · see citing works

Cutting the Gordian Knot: The Moving-Average Type–Token Ratio (MATTR)

Covington, M. A., & McFall, J. D. (2010) · Journal of Quantitative Linguistics · doi:10.1080/09296171003643098 · Cited by 493 · see citing works

CAF: Defining, Refining and Differentiating Constructs

Pallotti, G. (2009) · Applied Linguistics · doi:10.1093/applin/amp045 · Cited by 469 · see citing works

THE EFFECTS OF PLANNING ON FLUENCY, COMPLEXITY, AND ACCURACY IN SECOND LANGUAGE NARRATIVE WRITING

Ellis, R., & Yuan, F. (2004) · Studies in Second Language Acquisition · doi:10.1017/s0272263104261034 · Cited by 453 · see citing works

Formulaic Language and the Lexicon

Terkourafi, M. (2003) · Journal of Pragmatics · doi:10.1016/s0378-2166(03)00079-1 · Cited by 421 · see citing works

Measuring Syntactic Complexity in L2 Writing Using Fine‐Grained Clausal and Phrasal Indices

KYLE, K., & CROSSLEY, S. A. (2018) · The Modern Language Journal · doi:10.1111/modl.12468 · Cited by 405 · see citing works

The tool for the automatic analysis of lexical sophistication (TAALES): version 2.0

Kyle, K. D., Crossley, S. A., & Berger, C. M. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0924-4 · Cited by 349 · see citing works

Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality.

Yang, W., Lu, X., & Weigle, S. C. (2015) · Journal of Second Language Writing · doi:10.1016/j.jslw.2015.02.002 · Cited by 349 · see citing works

Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL

Cumming, A. H., Kantor, R. N., Baba, K., Erdősy, M. U., Eouanzoui, K., & James, M. X. (2005) · Assessing Writing · doi:10.1016/j.asw.2005.02.001 · Cited by 345 · see citing works

Complexity: A Philosophical Overview

Rescher, N. (1998) · Cited by 337 · see citing works

Predicting second language writing proficiency: the roles of cohesion and linguistic sophistication

Crossley, S. A., & McNamara, D. S. (2012) · Journal of Research in Reading · doi:10.1111/j.1467-9817.2010.01449.x · Cited by 331 · see citing works

Lexical Diversity in Writing and Speaking Task Performances

Yu, G. (2009) · Applied Linguistics · doi:10.1093/applin/amp024 · Cited by 324 · see citing works

The Linguistic Development of Students of English as a Second Language in Two Written Genres

Yoon, H., & Polio, C. G. (2016) · TESOL Quarterly · doi:10.1002/tesq.296 · Cited by 321 · see citing works

Predicting patterns of grammatical complexity across language exam task types and proficiency levels

Biber, D., Gray, B., & Staples, S. (2016) · Applied Linguistics · doi:10.1093/applin/amu059 · Cited by 297 · see citing works

Predicting human judgments of essay quality in both integrated and independent second language writing samples: A comparison study

Guo, L., Crossley, S. A., & McNamara, D. S. (2013) · Assessing Writing · doi:10.1016/j.asw.2013.05.002 · Cited by 279 · see citing works

Task complexity and linguistic and discourse features of narrative writing performance

Kormos, J. (2011) · Journal of Second Language Writing · doi:10.1016/j.jslw.2011.02.001 · Cited by 271 · see citing works

Cognitive task complexity and L2 written syntactic complexity, accuracy, lexical complexity, and fluency: A research synthesis and meta-analysis

Johnson, M. D. (2017) · Journal of Second Language Writing · doi:10.1016/j.jslw.2017.06.001 · Cited by 251 · see citing works

The relationship between lexical sophistication and independent and source-based writing

Kyle, K., & Crossley, S. A. (2016) · Journal of Second Language Writing · doi:10.1016/j.jslw.2016.10.003 · Cited by 232 · see citing works

Formulaic Language and Second Language Acquisition: Zipf and the Phrasal Teddy Bear

Ellis, N. (2012) · Annual Review of Applied Linguistics · doi:10.1017/s0267190512000025 · Cited by 227 · see citing works

Comparing composing processes in writing-only and reading-to-write test tasks

Plakans, L. (2008) · Assessing Writing · doi:10.1016/j.asw.2008.07.001 · Cited by 218 · see citing works

The Idiom Principle Revisited

Siyanova‐Chanturia, A., & Martínez, R. (2014) · Applied Linguistics · doi:10.1093/applin/amt054 · Cited by 210 · see citing works

A close investigation into source use in integrated second language writing tasks

Plakans, L., & Gebril, A. (2012) · Assessing Writing · doi:10.1016/j.asw.2011.09.002 · Cited by 196 · see citing works

Investigating the reading-to-write construct

Asención‐Delaney, Y. (2008) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2008.04.001 · Cited by 195 · see citing works

Assessing the Validity of Lexical Diversity Indices Using Direct Judgements

Kyle, K. D., Crossley, S. A., & Jarvis, S. (2020) · Language Assessment Quarterly · doi:10.1080/15434303.2020.1844205 · Cited by 193 · see citing works

Using multiple texts in an integrated writing assessment: Source text use as a predictor of score

Plakans, L., & Gebril, A. (2013) · Journal of Second Language Writing · doi:10.1016/j.jslw.2013.02.003 · Cited by 184 · see citing works

Lexical Sophistication as a Multidimensional Phenomenon: Relations to Second Language Lexical Proficiency, Development, and Writing Quality

Kim, M., Crossley, S. A., & Kyle, K. D. (2017) · Modern Language Journal · doi:10.1111/modl.12447 · Cited by 180 · see citing works

Assessing syntactic sophistication in L2 writing: A usage-based approach

Kyle, K., & Crossley, S. A. (2017) · Language Testing · doi:10.1177/0265532217712554 · Cited by 177 · see citing works

The phraseological dimension in interlanguage complexity research

Paquot, M. (2019) · Second Language Research · doi:10.1177/0267658317694221 · Cited by 175 · see citing works

Discourse synthesis in integrated second language writing assessment

Plakans, L. (2009) · Language Testing · doi:10.1177/0265532209340192 · Cited by 167 · see citing works

Integrating reading and writing in a competency test for non-native speakers of English

Weigle, S. C. (2004) · Assessing Writing · doi:10.1016/j.asw.2004.01.002 · Cited by 165 · see citing works

Modeling second language writing quality: A structural equation investigation of lexical, syntactic, and cohesive features in source-based and independent writing

Kim, M., & Crossley, S. A. (2018) · Assessing Writing · doi:10.1016/j.asw.2018.03.002 · Cited by 144 · see citing works

Effect of Alignment on L2 Written Production

Wang, C., & Wang, M. (2014) · Applied Linguistics · doi:10.1093/applin/amt051 · Cited by 140 · see citing works

A closer look at integrated writing tasks: Towards a more focussed definition for assessment purposes

Knoch, U., & Sitajalabhorn, W. (2013) · Assessing Writing · doi:10.1016/j.asw.2013.09.003 · Cited by 121 · see citing works

Interlanguage complexity

Ortega, L. (2012) · De Gruyter eBooks · doi:10.1515/9783110229226.127 · Cited by 115 · see citing works

Phraseological Competence: A Missing Component in University Entrance Language Tests? Insights From a Study of EFL Learners’ Use of Statistical Collocations

Paquot, M. (2018) · Language Assessment Quarterly · doi:10.1080/15434303.2017.1405421 · Cited by 114 · see citing works

Exploring the relationship of organization and connection with scores in integrated writing assessment

Plakans, L., & Gebril, A. (2016) · Assessing Writing · doi:10.1016/j.asw.2016.08.005 · Cited by 108 · see citing works

Multiple approaches to complexity in second language research

Housen, A., Clercq, B. D., Kuiken, F., & Vedder, I. (2018) · Second language Research · doi:10.1177/0267658318809765 · Cited by 98 · see citing works

Shaping a score: Complexity, accuracy, and fluency in integrated writing performances

Plakans, L., Gebril, A., & Bilki, Z. (2016) · Language Testing · doi:10.1177/0265532216669537 · Cited by 96 · see citing works

Revisiting the predictive power of traditional vs. fine-grained syntactic complexity indices for L2 writing quality: The case of two genres

Zhang, X., & Lu, X. (2021) · Assessing Writing · doi:10.1016/j.asw.2021.100597 · Cited by 77 · see citing works

Source-based tasks in academic writing assessment: Lexical diversity, textual borrowing and proficiency

Gebril, A., & Plakans, L. (2016) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2016.10.001 · Cited by 74 · see citing works

N-gram measures and L2 writing proficiency

Garner, J., Crossley, S. A., & Kyle, K. D. (2018) · System · doi:10.1016/j.system.2018.12.001 · Cited by 73 · see citing works

Investigating Source Use, Discourse Features, and Process in Integrated Writing Tests

Gebril, A. (2009) · Cited by 72 · see citing works

What accounts for integrated reading-to-write task scores?

Shin, S., & Ewert, D. E. (2014) · Language Testing · doi:10.1177/0265532214560257 · Cited by 66 · see citing works

The effects of integrated writing on linguistic complexity in L2 writing and task-complexity

Abrams, Z. I. (2019) · System · doi:10.1016/j.system.2019.01.009 · Cited by 63 · see citing works

The effect of task complexity on integrated writing performance: The case of multiple-text source-based writing

Golparvar, S. E., & Rashidi, F. (2021) · System · doi:10.1016/j.system.2021.102524 · Cited by 53 · see citing works

The relationship between features of source text use and integrated writing quality

Kyle, K. D. (2020) · Assessing Writing · doi:10.1016/j.asw.2020.100467 · Cited by 49 · see citing works

Beyond Differences: Assessing Effects of Shared Linguistic Features on L2 Writing Quality of Two Genres

Zhang, X., Lu, X., & Li, W. (2021) · Applied Linguistics · doi:10.1093/applin/amab007 · Cited by 44 · see citing works

Effects of a xu-argument based iterative continuation task on an EFL learner’s linguistic and affective development: Evidence from errors, self-initiated error corrections, and foreign language learning attitude

Zhang, S., & Zhang, L. J. (2021) · System · doi:10.1016/j.system.2021.102481 · Cited by 40 · see citing works

Phraseological complexity and low- and intermediate-level L2 learners’ writing quality

Jiang, J., Bi, P., Xie, N., & Liu, H. (2021) · IRAL - International Review of Applied Linguistics in Language Teaching · doi:10.1515/iral-2019-0147 · Cited by 28 · see citing works

Effects of n-grams on the rated L2 writing quality of expository essays: A conceptual replication and extension

Zhang, X., & Li, W. (2020) · System · doi:10.1016/j.system.2020.102437 · Cited by 21 · see citing works

Comparison of Chinese Gaokao and Western university undergraduate admission criteria: Australian ATAR as an example

Farley, A., & Yang, H. H. (2019) · Higher Education Research & Development · doi:10.1080/07294360.2019.1684879 · Cited by 20 · see citing works

How syntactic complexity indices predict Chinese L2 writing quality: An analysis of unified dependency syntactically-annotated corpus

Hao, Y., Wang, X., Bin, S., Yang, Q., & Liu, H. (2024) · Assessing Writing · doi:10.1016/j.asw.2024.100847 · Cited by 21 · see citing works

Fairness, justice, and criticality: Reviewing second language writing assessment

Plakans, L., & Lee, K. (2025) · Language Teaching · doi:10.1017/s0261444825100876 · Cited by 8 · see citing works

Phraseological sophistication as a multidimensional construct

Paquot, M., & Naets, H. (2024) · International Journal of Learner Corpus Research · doi:10.1075/ijlcr.23033.paq · Cited by 5 · see citing works

Diachronic change in lexical complexity of research articles (1970–2020): economics vs. medicine

Pan, F., & Yang, Y. (2025) · Scientometrics · doi:10.1007/s11192-025-05258-6 · Cited by 5 · see citing works

A structural equation investigation of linguistic features as indices of writing quality in assessed secondary-level EMI learners’ scientific reports

Pun, J., & Kenneth-Li, W. (2024) · Assessing Writing · doi:10.1016/j.asw.2024.100897 · Cited by 4 · see citing works

Exploring the development of noun phrase complexity in L2 English writings across two genres

Wang, Y., & Jiang, J. (2024) · Assessing Writing · doi:10.1016/j.asw.2024.100892 · Cited by 4 · see citing works

Independent Writing Tasks vs. Integrated Writing Tasks: The Cognitive Demands and Their Impacts on Linguistic Complexity in EFL Writing

Zhao, Z., Nimehchisalem, V., & Chan, M. Y. (2024) · Theory and Practice in Language Studies · doi:10.17507/tpls.1408.33 · Cited by 3 · see citing works

The Contribution of Vocabulary Knowledge to Summary Writing Quality: Vocabulary Size and Lexical Richness.

Allagui, B., & Naqbi, S. A. (2024) · Teaching English as a Second or Foreign Language--TESL-EJ · doi:10.55593/ej.28109a5 · Cited by 3 · see citing works

Use of Dependency‐Annotated Learner Corpora in Measuring Syntactic Complexity for Granularity, Accuracy, Consistency, and Transparency: Implications for Research and Teaching

Zhang, Y., & Zhang, L. J. (2024) · TESOL Quarterly · doi:10.1002/tesq.3370 · Cited by 3 · see citing works

Understanding genre differences in cohesive use of EFL Learners: Insights from systemic functional linguistics

Liu, J., Shi, Z., & Li, W. (2025) · System · doi:10.1016/j.system.2025.103692 · Cited by 3 · see citing works

Echoes of syntax: Exploring the interplay between syntactic complexity in reading and writing

Uzun, K., & Güvendi̇r, E. (2026) · Journal of Second Language Writing · doi:10.1016/j.jslw.2026.101297 · Cited by 2 · see citing works

The measurement of text quality: current methods and open challenges

Toth, Z. (2025) · Open Research Europe · doi:10.12688/openreseurope.19312.1 · Cited by 2 · see citing works

Unraveling the Impact of Linguistic Complexity on L2 German Writing Performance Among Chinese Learners: A Cross‐Genre Comparison

Li, Y., Li, Y., & Teng, L. S. (2025) · International Journal of Applied Linguistics · doi:10.1111/ijal.12817 · Cited by 1 · see citing works

Modeling relationships among frequency, salience, lexical diversity and rated L2 writing quality: An SEM approach

Li, H., & Zheng, R. (2025) · System · doi:10.1016/j.system.2025.103958 · Cited by 1 · see citing works

Phraseology meets information theory: Going beyond the bag-of-words approach in complexity measures

Brasolin, P., & Bienati, A. (2025) · Journal of the European Second Language Association · doi:10.22599/jesla.140 · Cited by 1 · see citing works

ARE AI DETECTORS FAIR TO EFL LEARNERS? A LIBRARY RESEARCH ON DETECTION BIAS AND ACADEMIC INTEGRITY

Patty, J., & Matatula, M. Y. (2026) · J-Shelves of Indragiri (JSI) · doi:10.61672/jsi.v8i1.3557

Exploring Predictive Power of Syntactic Complexity Indices for English Continuation Writing Quality of Chinese Senior High School StudentsPreprint

Guo, M., Zhou, Z., & Ji, J. (2024) · Research Square · doi:10.21203/rs.3.rs-10353890/v1

Comparing the Effects of L1 and L2 Use in Prewriting Discussions on L2 Writing Quality: A Study on Intermediate CFL Learners

Wang, Q. (2025) · International Journal of Applied Linguistics · doi:10.1111/ijal.12782

Cross-linguistic Information Retrieval Between English and Chinese Based on the Neural Network Model

Bai, L., & Zhang, K. (2026) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-025-01062-5

Foreign Language Writing Emotions and Linguistic Complexity in Argumentative Writing: A Latent Profile Analysis

Xiaomeng, Z., & Xiaobao, W. (2026) · International Journal of Applied Linguistics · doi:10.1111/ijal.70125

Corpus-Based Research in Second Language Acquisition

Granger, S. (2026) · Elsevier eBooks · doi:10.1016/b978-0-323-95504-1.01543-x

Exploring the roles of gender, linguistic, and cognitive variables in continuation writing task performance among learners of English

Chen, F., & Zhao, A. (2026) · Assessing Writing · doi:10.1016/j.asw.2026.101043

The Relationship Between Lexical Richness and Holistic Essay Quality in Second Language Writing

Kırsan, G., & Yiğitoğlu, N. (2026) · Springer eBooks · doi:10.1007/978-3-032-08761-4_10

Linguistic complexity of EFL writing with different levels of English proficiency: A stratified study of an application-oriented university

Zhang, J. (2026) · PLoS ONE · doi:10.1371/journal.pone.0349399

Examining the role of linguistic characteristics of task performance in integrated multimodal viewing-to-write tasks

Kormos, J., Brunfaut, T., & Banfalvi, B. (2026) · Studies in Second Language Learning and Teaching · doi:10.14746/ssllt.52990

The Relationship Between Writing Strategies and Writing Performance in Story Continuation Writing Tasks

Bi, P., Qi, L., Ji, S., & Mao, Y. (2026) · Language Teaching Research · doi:10.1177/13621688261472122

From components to system: Unravelling the complex and dynamic linkages among lexical sophistication, syntactic complexity and cohesion in L2 writing via network analysis

Li, J., & Li, J. (2026) · Journal of Second Language Writing · doi:10.1016/j.jslw.2026.101348

Investigating the Predictive Power of Grammatical Metaphor Nominalization as Lexical Complexity Benchmarks for EFL Writing Quality

Zhou, J. (2026) · International Journal of Applied Linguistics · doi:10.1111/ijal.70349

From words to components: Mapping linguistic features in source-based writing

Potter, A. A., Crossley, S. A., Öncel, P., Allen, L. K., Xu, X., Balyan, R., Arner, T., Roscoe, R. D., & McNamara, D. S. (2026) · Assessing Writing · doi:10.1016/j.asw.2026.101108

Predicting Chinese Efl Learners’ Academic Writing Quality Through Indices of Linguistic ComplexityPreprint

Song, K., & Cai, Y. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4644266

Measuring Syntactic Complexity in L2 Writing Using Fine‐Grained Clausal and Phrasal Indices

KYLE, K., & CROSSLEY, S. A. (2018) · The Modern Language Journal · doi:10.1111/modl.12468 · Cited by 405 · see citing works

Reexamining the relationship between syntactic complexity and human judgment of EFL writing quality: the role of genre and rating levels

Zhang, J., & Zhang, L. J. (2025) · Reading and Writing · doi:10.1007/s11145-025-10732-x

Revisiting the predictive power of traditional vs. fine-grained syntactic complexity indices for L2 writing quality: The case of two genres

Zhang, X., & Lu, X. (2021) · Assessing Writing · doi:10.1016/j.asw.2021.100597 · Cited by 77 · see citing works

Corpus-based Development of Syntactic Complexity in EFL Writing

Wang, W., Duan, M., & Zhang, H. (2023) · SHS Web of Conferences · doi:10.1051/shsconf/202315204001 · Cited by 2 · see citing works