Examining Language in Context: The Need for New Research and Practice Paradigms in the Testing of English-Language Learners
The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Abstract
Concerns about how to ensure the valid and equitable assessment of English-language learners (ELLs) and other students from culturally non-mainstream backgrounds are longstanding. This article proposes that new paradigms in the research and practice related to ELL testing are needed to address the complexities of language and culture more effectively. Three main areas are identified as key to this paradigm shift: test review, test development, and treatment of language as a source of measurement error. Research examples are provided that illustrate that the proposed paradigm shift is not only necessary but also possible. The authors propose the combined use of generalizability theory and research designs in which ELLs are given the same items in both English and their native languages—an approach that has the potential to reveal more fine-grained understandings of the interactions among first and second language profi-ciency, student content knowledge, and the linguistic and content demands of test items.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1978) · Medical Entomology and Zoology · Cited by 53,488
(1999) · Cited by 12,812
Stereotype threat and the intellectual test performance of African Americans.
Steele, C. M., & Aronson, J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.5.797 · Cited by 9,020 · cited 2×
“…ELLs vary both across and within states (Casanova & Arias, 1993; Council of Chief State School Officers, 1992) and are often based on inaccurate criteria such as ethnicity, immigrant status, or the number of years lived in the United States (see Aguirre-Muñoz & Baker, 1997; Steele & Aronson, 1995).”
BackgroundNational Council of Teachers of Mathematics
(1979) · The Mathematics Teacher · doi:10.5951/mt.72.8.0637 · Cited by 8,499
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
A threat in the air: How stereotypes shape intellectual identity and performance
Steele, C. M. (1997) · American Psychologist · doi:10.1037/0003-066x.52.6.613 · Cited by 6,770 · cited 2×
“Practices in the testing of ELLs are often driven by policies rather than theory (Hakuta & McLaughlin, 1996)—a fact that”
BackgroundWays with Words: Language, life, and work in communities and classrooms
Heath, S. B. (1983) · Cambridge University Press eBooks · doi:10.1017/cbo9780511841057 · Cited by 5,009
Ways with Words: Language, Life and Work in Communities and Classrooms
Paffard, M., & Heath, S. B. (1984) · British Journal of Educational Studies · doi:10.2307/3121112 · Cited by 4,944
Handbook of educational psychology
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3084 · Cited by 4,825
Apprenticeship in Thinking: Cognitive Development in Social Context
Rogoff, B. (1990) · doi:10.1093/oso/9780195059731.001.0001 · Cited by 4,709
Cited by
Suárez-Orozco, M., & Suárez-Orozco, C. (2015) · Phi Delta Kappan · doi:10.1177/0031721715619911 · Cited by 1,443
Educating English Language Learners: A Synthesis of Research Evidence
Genesee, F., Lindholm-Leary, K., Saunders, B., & Christian, D. (2006) · doi:10.1017/cbo9780511499913 · Cited by 743
The No Child Left Behind Act and English Language Learners: Assessment and Accountability Issues
Abedi, J. (2004) · Educational Researcher · doi:10.3102/0013189x033001004 · Cited by 517
Constructing a language assessment knowledge base: A focus on language assessment courses
Inbar-Lourie, O. (2008) · Language Testing · doi:10.1177/0265532208090158 · Cited by 355
Science Education With English Language Learners: Synthesis and Research Agenda
Lee, O. (2005) · Review of Educational Research · doi:10.3102/00346543075004491 · Cited by 336
Menken, K. (2006) · Bilingual Research Journal · doi:10.1080/15235882.2006.10162888 · Cited by 226
“In addition, analyses of existing test instruments point to continued cultural and linguistic complexity in test items that are further sources of measurement errors, and have yet to be properly addressed in the assessments being used for high-stakes decision making (Abedi & Dietal, 2004; Abedi, Hofstetter, & Lord, 20…”
BackgroundHigh Stakes Testing: Issues, Implications, and Remedies for English Language Learners
Solórzano, R. W. (2008) · Review of Educational Research · doi:10.3102/0034654308317845 · Cited by 210
“Solano-Flores and Trumbull (2003) recommend an “item microanalysis,” which includes a “set of reasonings used to examine how the properties of items and students’ linguistic, cultural, and socioeconomic backgrounds operate in combination to shape the ways in which students make sense of test items”…”
BackgroundSolano-Flores, G. (2008) · Educational Researcher · doi:10.3102/0013189x08319569 · Cited by 163
“Dialect variation may take place among monolingual English speakers from different geographical areas and socioeconomic status, and this variation may be important enough to influence how students interpret test items (Solano-Flores & Trumbull, 2003).”
BackgroundSelf-citationThe Effects of Dynamic Strategic Math on English Language Learners’ Word Problem Solving
Orosco, M. J., Swanson, H. L., O’Connor, R., & Lussier, C. (2013) · The Journal of Special Education · doi:10.1177/0022466911416248 · Cited by 65
Dublin, R., Sigman, M., Anderson, A., Barnhardt, R., & Topkok, S. A. (2014) · Journal of Geoscience Education · doi:10.5408/12-411.1 · Cited by 17
Metadata
- Authors
- Solano-Flores, G., & Trumbull, E.
- Venue
- Educational Researcher
- Published
- 2003-03
- Volume
- 32
- Issue
- 2
- Pages
- 3-13
- ISSN
- 0013-189X (ISSN-L)
- 1935-102X
- OpenAlex
- W2140375221
- Cited by
- 261
- References
- 86
- FWCI
- 20.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.