The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Predicting lexical proficiency in language learner texts using computational indices
Abstract
The authors present a model of lexical proficiency based on lexical indices related to vocabulary size, depth of lexical knowledge, and accessibility to core lexical items. The lexical indices used in this study come from the computational tool Coh-Metrix and include word length scores, lexical diversity values, word frequency counts, hypernymy values, polysemy values, semantic co-referentiality, word meaningfulness, word concreteness, word imagability, and word familiarity. Human raters evaluated a corpus of 240 written texts using a standardized rubric of lexical proficiency. To ensure a variety of text levels, the corpus comprised 60 texts each from beginning, intermediate, and advanced second language (L2) adult English learners. The L2 texts were collected longitudinally from 10 English learners. In addition, 60 texts from native English speakers were collected. The holistic scores from the trained human raters were then correlated to a variety of lexical indices. The researchers found that lexical diversity, word hypernymy values and content word frequency explain 44% of the variance of the human evaluations of lexical proficiency in the examined writing samples. The findings represent an important step in the development of a model of lexical proficiency that incorporates both vocabulary size and depth of lexical knowledge features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ellis, N. C. (2002) · Studies in Second Language Acquisition · doi:10.1017/s0272263102002024 · Cited by 2,230 · cited 3×
“…and writing proficiency have found that beginning L2 learners are more likely to comprehend, process, and produce higher frequency words (Crossley and Salsbury, 2010; Ellis, 2002) and that beginning L2 learners use higher frequency words than advanced learners (Bell, 2003; Meara and Bell, 2001).”
BackgroundMcCarthy, P. M., & Jarvis, S. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.381 · Cited by 905
Self-citationGender differences in language use: An analysis of 14,000 text samples
Newman, M. L., Groom, C. J., Handelman, L. D., & Pennebaker, J. W. (2008) · Discourse Processes · doi:10.1080/01638530802073712 · Cited by 788 · cited 1×
“A comparison corpus of 60 native speaker free-writings was selected from the Stream of Consciousness Data Set from the Pennebaker Archive Project (Newman et al., 2008).”
MethodAssessing Second Language Vocabulary Knowledge: Depth Versus Breadth
Wesche, M., & Paribakht, T. S. (1996) · The Canadian Modern Language Review · doi:10.3138/cmlr.53.1.13 · Cited by 673
Cited by
Automatically Assessing Lexical Sophistication: Indices, Tools, Findings, and Application
Kyle, K., & Crossley, S. A. (2015) · TESOL Quarterly · doi:10.1002/tesq.194 · Cited by 557
Self-citationThe Linguistic Development of Students of English as a Second Language in Two Written Genres
Yoon, H.-J., & Polio, C. (2017) · TESOL Quarterly · doi:10.1002/tesq.296 · Cited by 317
Guo, L., Crossley, S. A., & McNamara, D. S. (2013) · Assessing Writing · doi:10.1016/j.asw.2013.05.002 · Cited by 278
Self-citationTask complexity and linguistic and discourse features of narrative writing performance
Kormos, J. (2011) · Journal of Second Language Writing · doi:10.1016/j.jslw.2011.02.001 · Cited by 269
Elgort, I., & Warren, P. (2014) · Language Learning · doi:10.1111/lang.12052 · Cited by 240
Metadata
- Authors
- Crossley, S. A., Salsbury, T., McNamara, D. S., & Jarvis, S.
- Venue
- Language Testing
- Publisher
- SAGE Publications
- Published
- 2010-12-05
- Volume
- 28
- Issue
- 4
- Pages
- 561-580
- ISSN
- 0265-5322 (ISSN-L)
- 1477-0946
- OpenAlex
- W2162781370
- Cited by
- 198
- References
- 4
- FWCI
- 7.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predicting lexical proficiency in language learner texts using computational indices. https://app.cochat.ai/papers/10.1177/0265532210378031
- The paper
- Crossley, S. A., Salsbury, T., McNamara, D. S., & Jarvis, S. (2011). Predicting lexical proficiency in language learner texts using computational indices. Language Testing. https://doi.org/10.1177/0265532210378031
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.