The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Predicting the proficiency level of language learners using lexical indices
Abstract
This study explores how second language (L2) texts written by learners at various proficiency levels can be classified using computational indices that characterize lexical competence. For this study, 100 writing samples taken from 100 L2 learners were analyzed using lexical indices reported by the computational tool Coh-Metrix. The L2 writing samples were categorized into beginning, intermediate, and advanced groupings based on the TOEFL and ACT ESL Compass scores of the writer. A discriminant function analysis was used to predict the level categorization of the texts using lexical indices related to breadth of lexical knowledge (word frequency, lexical diversity), depth of lexical knowledge (hypernymy, polysemy, semantic co-referentiality, and word meaningfulness), and access to core lexical items (word concreteness, familiarity, and imagability). The strongest predictors of an individual’s proficiency level were word imagability, word frequency, lexical diversity, and word familiarity. In total, the indices correctly classified 70% of the texts based on proficiency level in both a training and a test set. The authors argue for the applicability of a statistical model as a method to investigate lexical competence across language levels, as a method to assess L2 lexical development, and as a method to classify L2 proficiency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ellis, N. C. (2002) · Studies in Second Language Acquisition · doi:10.1017/s0272263102002024 · Cited by 2,230 · cited 2×
“As a result, beginning L2 learners are more likely to comprehend, process, and produce higher frequency words (Ellis, 2002).”
BackgroundResultVocabulary size and use: Lexical richness in l2 written production
LAUFER, B., & NATION, P. (1995) · Applied Linguistics · doi:10.1093/applin/16.3.307 · Cited by 1,316
Read, J. (2000) · doi:10.1017/cbo9780511732942 · Cited by 1,305
McCarthy, P. M., & Jarvis, S. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.381 · Cited by 905
Assessing Second Language Vocabulary Knowledge: Depth Versus Breadth
Wesche, M., & Paribakht, T. S. (1996) · The Canadian Modern Language Review · doi:10.3138/cmlr.53.1.13 · Cited by 673
Assessing the Roles of Depth and Breadth of Vocabulary Knowledge in Reading Comprehension
Qian, D. (1999) · The Canadian Modern Language Review · doi:10.3138/cmlr.56.2.282 · Cited by 536 · cited 1×
“…distinction between breadth of lexical knowledge (i.e. the number of words a learner knows) and depth of lexical knowledge (i.e. the degree of organization of known words, Crossley, Salsbury, McNamara, & Jarvis, 2011, in press; Meara, 1996, 2005a; Qian, 1999; Read, 1988; Wesche & Paribakht, 1996).”
BackgroundClassroom Interaction, Comprehension, and the Acquisition of L2 Word Meanings
Ellis, R., Tanaka, Y., & Yamazaki, A. (1994) · Language Learning · doi:10.1111/j.1467-1770.1994.tb01114.x · Cited by 432
The Bristol norms for age of acquisition, imageability, and familiarity
Stadthagen-Gonzalez, H., & Davis, C. J. (2006) · Behavior Research Methods · doi:10.3758/bf03193891 · Cited by 315
Cited by
Research Methods in Applied Linguistics
(2021) · Research methods in applied linguistics · doi:10.1075/rmal · Cited by 2,793
Measuring Syntactic Complexity in L2 Writing Using Fine‐Grained Clausal and Phrasal Indices
KYLE, K., & CROSSLEY, S. A. (2018) · The Modern Language Journal · doi:10.1111/modl.12468 · Cited by 405
Self-citationThe tool for the automatic analysis of lexical sophistication (TAALES): version 2.0
Kyle, K., Crossley, S., & Berger, C. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0924-4 · Cited by 335
Self-citationGuo, L., Crossley, S. A., & McNamara, D. S. (2013) · Assessing Writing · doi:10.1016/j.asw.2013.05.002 · Cited by 278
Self-citationElgort, I. (2018) · CALICO Journal · doi:10.1558/cj.34554 · Cited by 37
“…contexts (e.g., VST, by Nation & Beglar, 2007), or by observing and analyzing real linguistic behavior and artifacts produced by language learners, for example, by measuring lexical richness or lexical diversity in writing (Crossley, Salsbury, & McNamara, 2012) or online chat (Sauro & Smith, 2010).”
Background
Metadata
- Authors
- Crossley, S. A., Salsbury, T., & McNamara, D. S.
- Venue
- Language Testing
- Publisher
- SAGE Publications
- Published
- 2011-11-28
- Volume
- 29
- Issue
- 2
- Pages
- 243-263
- ISSN
- 0265-5322 (ISSN-L)
- 1477-0946
- OpenAlex
- W2161765107
- Cited by
- 163
- References
- 8
- FWCI
- 9.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.