The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Automatically Assessing Lexical Sophistication: Indices, Tools, Findings, and Application
Abstract
This study explores the construct of lexical sophistication and its applications for measuring second language lexical and speaking proficiency. In doing so, the study introduces the Tool for the Automatic Analysis of LE xical Sophistication (TAALES), which calculates text scores for 135 classic and newly developed lexical indices related to word frequency, range, bigram and trigram frequency, academic language, and psycholinguistic word information. TAALES is freely available; runs on Windows, Mac, and Linux operating systems; and has a simple graphic user interface that allows for batch processing of .txt files. The tool is fast, reliable, and outputs results to a comma‐separated value file that can be accessed using spreadsheet software. The study examines the ability of TAALES indices to explain the variance in human judgments of lexical proficiency and speaking proficiency for second language (L2) learners. Overall, these indices were able to explain 47.5% of the variance in holistic scores of lexical proficiency and 48.7% of the variance in holistic scores of speaking proficiency. This study has important implications for second language acquisition, for assessing L2 learners' productive skills (writing and speaking), and for L2 pedagogy. Limitations and future directions are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Witten, I. H. (2008) · Cited by 9,143
(1967) · Medical Entomology and Zoology · Cited by 7,532
Learning Vocabulary in Another Language
Nation, I. S. P. (2001) · Cambridge University Press · doi:10.1017/cbo9781139524759 · Cited by 6,608
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Fong, G. T., Cohen, J., & Cohen, P. (1985) · Journal of the American Statistical Association · doi:10.2307/2287930 · Cited by 4,475
Brysbaert, M., & New, B. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.977 · Cited by 2,821
Coxhead, A. (2000) · TESOL Quarterly · doi:10.2307/3587951 · Cited by 2,780
The teacher's word book of 30,000 words.
Witty, P. (1945) · Journal of Consulting Psychology · doi:10.1037/h0050354 · Cited by 2,661
The Teacher's Word Book of 30, 000 Words
Thorndike, E. L., & Lorge, I. D. (2018) · Cited by 2,656
The MRC Psycholinguistic Database
Coltheart, M. (1981) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748108400805 · Cited by 2,437
Ellis, N. C. (2002) · Studies in Second Language Acquisition · doi:10.1017/s0272263102002024 · Cited by 2,230 · cited 1×
“First, current theories of language development (e.g., Ellis, 2002) suggest that as L2 learners develop, they will use less frequent lexical items.”
Background
Cited by
Exploring the potential of using an AI language model for automated essay scoring
Mizumoto, A., & Eguchi, M. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100050 · Cited by 647
Roscoe, R. D., Wilson, J., Johnson, A. C., & Mayra, C. R. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.12.076 · Cited by 98
MEASURING LONGITUDINAL WRITING DEVELOPMENT USING INDICES OF SYNTACTIC COMPLEXITY AND SOPHISTICATION
Kyle, K., Crossley, S., & Verspoor, M. (2021) · Studies in Second Language Acquisition · doi:10.1017/s0272263120000546 · Cited by 83
Self-citationSaito, K. (2020) · Language Learning · doi:10.1111/lang.12387 · Cited by 74
Applying large language models for automated essay scoring for non-native Japanese
Li, W., & Liu, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03209-9 · Cited by 36
Metadata
- Authors
- Kyle, K., & Crossley, S. A.
- Venue
- TESOL Quarterly
- Publisher
- Wiley
- Published
- 2014-09-25
- Volume
- 49
- Issue
- 4
- Pages
- 757-786
- ISSN
- 0039-8322 (ISSN-L)
- 1545-7249
- OpenAlex
- W2034849674
- Cited by
- 557
- References
- 55
- FWCI
- 45.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatically Assessing Lexical Sophistication: Indices, Tools, Findings, and Application. https://app.cochat.ai/papers/10.1002/tesq.194
- The paper
- Kyle, K., & Crossley, S. A. (2015). Automatically Assessing Lexical Sophistication: Indices, Tools, Findings, and Application. TESOL Quarterly. https://doi.org/10.1002/tesq.194
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.