Leveling L2 Texts Through Readability: Combining Multilevel Linguistic Features with the CEFR
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Selecting appropriate texts for L2 (second/foreign language) learners is an important approach to enhancing motivation and, by extension, learning. There is currently no tool for classifying foreign language texts according to a language proficiency framework, which makes it difficult for students and educators to determine the precise difficulty/complexity levels of an unclassified text. Taking the Chinese language as an example, this study aimed to create a readability assessment system, called the Chinese Readability Index Explorer for Chinese as a Foreign Language (CRIE–CFL), in order to level—that is, to sort by proficiency level—texts that will be used for instructional purposes. The framework of choice in this project is the Common European Framework of Reference (CEFR). A team of expert CFL teachers first classified 1,578 CFL texts into their appropriate CEFR levels. A set of 30 CFL readability features was then developed or drawn from previous research, and sorted according to importance using F‐scores. In addition, a support vector machine model was trained by sequentially integrating the features into the model to optimize accuracy. The empirical evaluation of CRIE–CFL revealed average exact‐ and adjacent‐level accuracies of 74.97% and 99.62%, respectively, for predicting the expert classification of a text. The functionalities of CRIE–CFL are introduced and discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
Kroll, J. F., & Stewart, E. (1994) · Journal of Memory and Language · doi:10.1006/jmla.1994.1008 · Cited by 2,656
Lexical access and naming time
Forster, K. I., & Chambers, S. M. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80042-8 · Cited by 1,132
Cited by
How effective are mobile devices for language learning? A meta-analysis
Sung, Y.-T., Chang, K.-E., & Yang, J.-M. (2015) · Educational Research Review · doi:10.1016/j.edurev.2015.09.001 · Cited by 279
Self-citationMachine learning–driven language assessment
Settles, B., T. LaFlair, G., & Hagiwara, M. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00310 · Cited by 106
Mohamed, S. (2021) · Advances in Higher Education and Professional Development · doi:10.4018/978-1-7998-7226-9.ch004 · Cited by 3
Text classification and gradation in Arabic textbooks
Mohamed, S. (2024) · The Language Learning Journal · doi:10.1080/09571736.2023.2213695 · Cited by 2
“This is also con fi rmed by readability studies (Barrot 2015; Sung et al. 2015).”
Influential
Metadata
- Authors
- SUNG, Y., LIN, W., DYSON, S. B., CHANG, K., & CHEN, Y.
- Venue
- The Modern Language Journal
- Publisher
- Wiley
- Published
- 2015-06
- Volume
- 99
- Issue
- 2
- Pages
- 371-391
- ISSN
- 0026-7902 (ISSN-L)
- 1540-4781
- OpenAlex
- W1514242939
- Cited by
- 87
- References
- 4
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.