The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Examining Language in Context: The Need for New Research and Practice Paradigms in the Testing of English-Language Learners
Abstract
Concerns about how to ensure the valid and equitable assessment of English-language learners (ELLs) and other students from culturally non-mainstream backgrounds are longstanding. This article proposes that new paradigms in the research and practice related to ELL testing are needed to address the complexities of language and culture more effectively. Three main areas are identified as key to this paradigm shift: test review, test development, and treatment of language as a source of measurement error. Research examples are provided that illustrate that the proposed paradigm shift is not only necessary but also possible. The authors propose the combined use of generalizability theory and research designs in which ELLs are given the same items in both English and their native languages—an approach that has the potential to reveal more fine-grained understandings of the interactions among first and second language profi-ciency, student content knowledge, and the linguistic and content demands of test items.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1978) · Medical Entomology and Zoology · Cited by 53,488
(1999) · Cited by 12,812
Stereotype threat and the intellectual test performance of African Americans.
Steele, C. M., & Aronson, J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.5.797 · Cited by 9,020
National Council of Teachers of Mathematics
(1979) · The Mathematics Teacher · doi:10.5951/mt.72.8.0637 · Cited by 8,499
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
A threat in the air: How stereotypes shape intellectual identity and performance
Steele, C. M. (1997) · American Psychologist · doi:10.1037/0003-066x.52.6.613 · Cited by 6,770 · cited 2×
“Practices in the testing of ELLs are often driven by policies rather than theory (Hakuta & McLaughlin, 1996)—a fact that”
BackgroundWays with Words: Language, life, and work in communities and classrooms
Heath, S. B. (1983) · Cambridge University Press eBooks · doi:10.1017/cbo9780511841057 · Cited by 5,009
Ways with Words: Language, Life and Work in Communities and Classrooms
Paffard, M., & Heath, S. B. (1984) · British Journal of Educational Studies · doi:10.2307/3121112 · Cited by 4,944
Handbook of educational psychology
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3084 · Cited by 4,825
Apprenticeship in Thinking: Cognitive Development in Social Context
Rogoff, B. (1990) · doi:10.1093/oso/9780195059731.001.0001 · Cited by 4,709
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
Practical Assessment, Research & Evaluation, 2000-2001.
Rudner, L. M., & Schafer, W. D. (2001) · Practical assessment, research & evaluation · Cited by 3,905
Perspectives on socially shared cognition.
(1991) · American Psychological Association eBooks · doi:10.1037/10096-000 · Cited by 3,446
Vygotsky and the Social Formation of Mind
Kozulin, A., & Wertsch, J. V. (1987) · The American Journal of Psychology · doi:10.2307/1422646 · Cited by 3,341
Handbook of Educational Psychology
(2013) · Routledge eBooks · doi:10.4324/9780203053874 · Cited by 3,212
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,883
Knowing What Students Know: The Science and Design of Educational Assessment
Pellegrino, J. W., Chudowsky, N., & Glaser, R. A. (2013) · Cited by 2,402
Standards for Educational and Psychological Testing.
García, E. J. (2017) · Revista Española de Pedagogía · doi:10.22550/2174-0909.3051 · Cited by 2,217
Item Response Theory: Principles and Applications
Hambleton, R. K., & Swaminathan, H. (1984) · Medical Entomology and Zoology · Cited by 1,779
Hambleton, R. K., & Swaminathan, H. (1985) · doi:10.1007/978-94-017-1988-9 · Cited by 1,777
Scientific Research in Education
(2002) · National Academies Press eBooks · doi:10.17226/10236 · Cited by 1,723
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661
Adapting Educational and Psychological Tests for Cross-Cultural Assessment
(2004) · Psychology Press eBooks · doi:10.4324/9781410611758 · Cited by 1,627
Brown, G., & Yule, G. (1983) · doi:10.1017/cbo9780511805226 · Cited by 1,537
Generalizability theory: a primer
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4192 · Cited by 1,298
(2013) · Human Behavior · doi:10.1002/9781394260546.ch8 · Cited by 1,215
Bias and equivalence in cross-cultural assessment: an overview
van de Vijver, F., & Tanzer, N. K. (2004) · European Review of Applied Psychology · doi:10.1016/j.erap.2003.12.004 · Cited by 1,097
Geisinger, K. F. (1994) · Psychological Assessment · doi:10.1037//1040-3590.6.4.304 · Cited by 986
Methods for Identifying Biased Test Items
Camilli, G., & Shepard, L. A. (1994) · Rutgers University Community Repository (Rutgers University) · Cited by 823
Gomes, S. S., Oakes, J., Ormseth, T., Bell, R., & Camp, P. (1991) · The Journal of Negro Education · doi:10.2307/2295617 · Cited by 814
Standards of validity and the validity of standards in performance asessment
Messick, S. (1995) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1995.tb00881.x · Cited by 697
Philips, S. U. (1983) · Cited by 667
(1994) · European Journal of Psychological Assessment · Cited by 643
Culture and Cognitive Development: Studies in Mathematical Understanding
Saxe, G. B. (1990) · Cited by 620
Shared cognition: Thinking as social practice.
Resnick, L. B. (2004) · Perspectives on socially shared cognition. · doi:10.1037/10096-018 · Cited by 604
Bilingualism and Testing: A Special Case of Bias
Valdés, G., & Figueroa, R. A. (1994) · Cited by 589
Methods and data analysis of comparative research
van de Vijver, F. J. R., & Leung, K. (1997) · Tilburg University Research Portal · Cited by 559
Koenig, E. L. (1983) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(83)90052-4 · Cited by 543
You can't take it with you: Why ability assessments don't cross cultures.
Greenfield, P. M. (1997) · American Psychologist · doi:10.1037//0003-066x.52.10.1115 · Cited by 495
Science for All, including Students from Non-English-Language Backgrounds
Lee, O., & Fradd, S. H. (1998) · Educational Researcher · doi:10.2307/1176619 · Cited by 477
Diagnostic Monitoring of Skill and Knowledge Acquisition
(2013) · Routledge eBooks · doi:10.4324/9780203056899 · Cited by 468
Towards an Integrated Analysis of Bias in Cross-Cultural Assessment
van de Vijver, F. J. R., & Poortinga, Y. H. (1997) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.13.1.29 · Cited by 378
Sampling Variability of Performance Assessments
Shavelson, R. J., Baxter, G. P., & Gao, X. (1993) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1993.tb00424.x · Cited by 338
On the cultural validity of science assessments
Solano‐Flores, G., & Nelson‐Barber, S. (2001) · Journal of Research in Science Teaching · doi:10.1002/tea.1018 · Cited by 314
Self-citationImplications of cognitive psychology for educational measurement.
Snow, R. E., & Lohman, D. F. (1989) · Cited by 312
Three approaches to the psychology of culture: Where do they come from? Where can they go?
Greenfield, P. M. (2000) · Asian Journal of Social Psychology · doi:10.1111/1467-839x.00066 · Cited by 310
Educating Second Language Children: The Whole Child, the Whole Curriculum, the Whole Community.
Cordasco, F., & Genesee, F. (1995) · International Migration Review · doi:10.2307/2547513 · Cited by 309
UNDER ATTACK/THE CASE AGAINST BILINGUAL EDUCATION
Krashen, S. D. (1997) · Cited by 301
Culture and Cognitive Development
Tomasello, M. (2000) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00056 · Cited by 297
Beyond Language: Social and Cultural Factors in Schooling Language Minority Students
Trueba, H. T. (1986) · Anthropology & Education Quarterly · doi:10.1525/aeq.1986.17.4.04x0619u · Cited by 296
Quality Control in the Development and Use of Performance Assessments
Dunbar, S. B., Koretz, D. M., & Hoover, H. D. (1991) · Applied Measurement in Education · doi:10.1207/s15324818ame0404_3 · Cited by 274
Writing across Languages and Cultures: Issues in Contrastive Rhetoric
Raimes, A., & Purves, A. C. (1989) · College Composition and Communication · doi:10.2307/358253 · Cited by 240
Linguistic and Cultural Influences on Learning Mathematics
Kessler, C., Cocking, R. R., & Mestre, J. P. (1989) · TESOL Quarterly · doi:10.2307/3587339 · Cited by 206
Performance Assessments: Political Rhetoric and Measurement Reality
Shavelson, R. J., Baxter, G. P., & Pine, J. (1992) · Educational Researcher · doi:10.2307/1177207 · Cited by 183
Is It Real for All Kids? A Framework for Equitable Assessment Policies for English Language Learners
Lacelle-Peterson, M., & Rivera, C. (1994) · Harvard Educational Review · doi:10.17763/haer.64.1.k3387733755817j7 · Cited by 176
On the Validity of Cognitive Interpretations of Scores From Alternative Concept-Mapping Techniques
Ruiz‐Primo, M. A., Shavelson, R. J., Li, M., & Schultz, S. E. (2001) · Educational Assessment · doi:10.1207/s15326977ea0702_2 · Cited by 175
Impact of Accommodation Strategies on English Language Learners' Test Performance
Abedi, J., Lord, C., Hofstetter, C., & Baker, E. (2000) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2000.tb00034.x · Cited by 170
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1065 · Cited by 158
Pons, F., & de Rosnay, M. (2000) · Swiss Journal of Psychology · doi:10.1024//1421-0185.59.3.215 · Cited by 157
Teaching American Indian students
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5137 · Cited by 155
Research news and Comment: Performance Assessments
Shavelson, R. J., Baxter, G. P., & Pine, J. (1992) · Educational Researcher · doi:10.3102/0013189x021004022 · Cited by 134
Translation effects in international assessments
Ercikan, K. (1998) · International Journal of Educational Research · doi:10.1016/s0883-0355(98)00047-0 · Cited by 131
Equity Implications Based on the Conceptions of Science Achievement in Major Reform Documents
Lee, O. (1999) · Review of Educational Research · doi:10.2307/1170645 · Cited by 113
Evaluation of Procedure‐Based Scoring for Hands‐On Science Assessment
Baxter, G. P., Shavelson, R. J., Goldman, S. R., & Pine, J. (1992) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1992.tb00364.x · Cited by 113
Assessing science understanding
Mintzes, J. J., & Novak, J. D. (2005) · Elsevier eBooks · doi:10.1016/b978-012498365-6/50005-6 · Cited by 111
Interview Procedures for Validating Science Assessments
Hamilton, L. S., Nussbaum, E. M., & Snow, R. E. (1997) · Applied Measurement in Education · doi:10.1207/s15324818ame1002_5 · Cited by 109
Knowledge-based cognition and performance assessment in the science classroom
Baxter, G. P., Elder, A. D., & Glaser, R. A. (1996) · Educational Psychologist · doi:10.1207/s15326985ep3102_5 · Cited by 100
Pellegrino, J. W., Jones, L. R., & Mitchell, K. (1999) · Cited by 95
Bilingualism and mental measures. A word of caution.
Sánchez, G. I. (1934) · Journal of Applied Psychology · doi:10.1037/h0072798 · Cited by 72
Advances in Applied Psycholinguistics: Vol. 2. Reading, Writing, and Language Learning
Huitema, J. S., Rayner, K., & Rosenberg, S. D. (1990) · The American Journal of Psychology · doi:10.2307/1423328 · Cited by 69
Development of Performance Assessments in Science: Conceptual, Practical, and Logistical Issues
Wested, G. S., & Shavelson, R. J. (1997) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1997.tb00596.x · Cited by 66
Construct Validity and Constructed-Response Tests
Ward, W. C., & Bennett, R. E. (2012) · Routledge eBooks · doi:10.4324/9780203052518-6 · Cited by 59
On the Stability of Performance Assessments
Ruiz‐Primo, M. A., Baxter, G. P., & Shavelson, R. J. (1993) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1993.tb00421.x · Cited by 59
Do we “acquire” culture or vice versa?
Bruner, J. S. (1993) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00031290 · Cited by 55
Impact of Selected Background Variables on Students' NAEP Math Performance
Abedi, J., Lord, C., & Hofstetter, C. H. (1998) · PsycEXTRA Dataset · doi:10.1037/e650572011-001 · Cited by 50
Solano‐Flores, G., Trumbull, E., & Nelson‐Barber, S. (2002) · International Journal of Testing · doi:10.1207/s15327574ijt0202_2 · Cited by 48
Self-citationOn the development and evaluation of a shell for generating science performance assessments
Solano‐Flores, G., Javanovic, J., Shavelson, R. J., & Bachman, M. (1999) · International Journal of Science Education · doi:10.1080/095006999290714 · Cited by 47
Self-citationChapter 2: Promoting Scientific Inquiry With Elementary Students From Diverse Cultures and Languages
Lee, O. (2002) · Review of Research in Education · doi:10.3102/0091732x026001023 · Cited by 43
Butler, F. A., & Stevens, R. (1997) · PsycEXTRA Dataset · doi:10.1037/e651402011-001 · Cited by 34
Test Policy and Test Performance: Education, Language, and Culture
Gifford, B. R. (1989) · Springer eBooks · doi:10.1007/978-94-009-2500-7 · Cited by 31
Taylor, G., & Betebenner, D. W. (1998) · Cited by 31
Rivera, C., Vincent, C., Hafner, A. L., & Lacelle‐Peterson, M. W. (1996) · Practical assessment, research & evaluation · doi:10.7275/gr0y-vh19 · Cited by 27
Black and White Cultural Styles in Pluralistic Perspective
Kochman, T. (1989) · Springer eBooks · doi:10.1007/978-94-009-2500-7_12 · Cited by 24
Bilingualism and Second Language Learning: Seven Tensions that Define the Research
Berliner, D. C., & Calfee, R. C. (2013) · Routledge eBooks · doi:10.4324/9780203053874-26 · Cited by 24
Improving the Equity and Validity of Assessment-based Information Systems
Aguirre‐Muñoz, Z., & Baker, E. L. (1999) · Springer eBooks · doi:10.1007/978-94-011-4399-8_7 · Cited by 14
Informal Assessment of Asian Americans: A Cultural and Linguistic Mismatch?
Tsang, C. L. (1989) · Springer eBooks · doi:10.1007/978-94-009-2500-7_11 · Cited by 4
Cited by
Suárez-Orozco, M., & Suárez-Orozco, C. (2015) · Phi Delta Kappan · doi:10.1177/0031721715619911 · Cited by 1,443
Educating English Language Learners: A Synthesis of Research Evidence
Genesee, F., Lindholm-Leary, K., Saunders, B., & Christian, D. (2006) · doi:10.1017/cbo9780511499913 · Cited by 743
The No Child Left Behind Act and English Language Learners: Assessment and Accountability Issues
Abedi, J. (2004) · Educational Researcher · doi:10.3102/0013189x033001004 · Cited by 517
Constructing a language assessment knowledge base: A focus on language assessment courses
Inbar-Lourie, O. (2008) · Language Testing · doi:10.1177/0265532208090158 · Cited by 355
Science Education With English Language Learners: Synthesis and Research Agenda
Lee, O. (2005) · Review of Educational Research · doi:10.3102/00346543075004491 · Cited by 336
Metadata
- Authors
- Solano-Flores, G., & Trumbull, E.
- Venue
- Educational Researcher
- Published
- 2003-03
- Volume
- 32
- Issue
- 2
- Pages
- 3-13
- ISSN
- 0013-189X (ISSN-L)
- 1935-102X
- OpenAlex
- W2140375221
- Cited by
- 261
- References
- 86
- FWCI
- 20.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.