The DOI matches its Crossref record.
Validating a Test to Measure Depth of Vocabulary Knowledge
Abstract
This chapter reports on the final stage of an investigation into the English for specific purposes (ESP) claim that tertiary level students for whom English is a second language (ESL) should be given reading proficiency tests in their own academic subject areas. A previous report on the research described how reading passages in the International English Language Testing System (IELTS) test, which has modules in three academic subject areas, varied in their subject specificity: Some were suitable for students in the relevant academic field; some were either too general or too specific (Clapham, 1996a). This chapter specifically compares the relative contributions of background knowledge and language proficiency to the students’ test scores, and investigates the extent to which the effect of background knowledge on reading comprehension varies according to students’ level of language proficiency. First, the results of multiple regression analyses showed that language proficiency accounted for more of the test score variance than did background knowledge, but that the comparative effects of the variables differed according to the subject specificity of the tests. When the analysis was based on students’ scores on the complete reading modules, language proficiency accounted for almost half of the variance, but when the students’ scores were based on revised tests from which the nonspecific subtests had been removed, language proficiency had less effect, and background knowledge 142proportionately more. This suggests that the comparative importance of background knowledge and level of language ability in reading comprehension depends on the specificity of the reading passages. Second, analysis of variance was used to compare the effect of background knowledge on the reading performance of students at different levels of language proficiency. Results showed that the reading scores of low-proficiency students were not affected by background knowledge, but that the scores of students at higher levels of proficiency were. There was no steady increase in the effect as the students’ ability levels rose. Instead, there appeared to be a level of proficiency below which students were unable to make use of their background knowledge. This supports Clarke’s (1980) hypothesis that there is a threshold level of language proficiency that must be reached before students can make use of their top-down reading processes. The effect of test specificity on these results and the implications for English for academic purposes (EAP) testing are presented in this chapter.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Modern language testing at the turn of the century: assuring that what we count counts
Bachman, L. F. (2000) · Language Testing · doi:10.1177/026553220001700101 · Cited by 309
Establishment of a Medical Academic Word List
Wang, J., Liang, S.-L., & Ge, G.-C. (2008) · English for Specific Purposes · doi:10.1016/j.esp.2008.05.003 · Cited by 286
7. RESEARCH IN TEACHING VOCABULARY
Read, J. (2004) · Annual Review of Applied Linguistics · doi:10.1017/s0267190504000078 · Cited by 259
Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates
Gyllstad, H., Vilkaitė, L., & Schmitt, N. (2015) · ITL - International Journal of Applied Linguistics · doi:10.1075/itl.166.2.04gyl · Cited by 164
Second language vocabulary assessment: current practices and new directions
(2007) · Digitum: Institutional Repository of the University of Murcia (University of Murcia) · doi:10.6018/ijes.7.2.49021 · Cited by 135
Metadata
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Validating a Test to Measure Depth of Vocabulary Knowledge. https://app.cochat.ai/papers/10.4324/9780203053768-9
- The paper
- Validating a Test to Measure Depth of Vocabulary Knowledge. (2013). Validation in Language Assessment. https://doi.org/10.4324/9780203053768-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.