Assessing Multilingual Competencies: Adopting Construct Valid Assessment Policies
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
All assessment policies and practices are based on monolingual constructs whereby test‐takers are expected to demonstrate their language proficiency in one language at a time. Thus, the construct underlying these assessment approaches and/or scales (e.g., the CEFR) is of language as a closed and finite system that does not enable other languages to “smuggle in.” This view is in stark contrast to the current understanding of multilingual competencies for which various languages and aspects “bleed” into one another in creative ways as manifested by a growing number of users, especially immigrants, who are born into one language and acquire additional language(s), resulting in multilingual competencies. This is manifested in codeswitching and in the simultaneous use of different language functions (e.g., reading in one and speaking in another in the process of academic functioning). Yet, this multilingual functioning receives no attention in language testing practices. Further, multilingual users who rarely reach language proficiency in each of the languages that is identical to that of their monolingual counterparts are always being compared to them and thus receive lower scores. Consequently, they are penalized for their multilingual competencies, sending a message that multilingual knowledge is a liability. Given the current policies of cultivating multilingualism in schools and societies as expressed in the articles in this special issue, I critique the current monolingual assessment approaches within a political and social context. I argue that these approaches are rooted in nation‐state ideologies that are still attempting to promote national collective agendas of “wishful thinking” and ignore the reality of how languages are being used. This is followed by empirical data pointing to the cost of the continued use of monolingual tests for individual students, especially those who are bilingual, as is the case with immigrants. All of these will lead to initial proposals and examples for the adoption of different types of multilingual testing and assessment policies and practices in various contexts. These approaches, I argue, are more construct valid, as they enable the manifestation of fuller knowledge in integrated ways, thus highlighting the advantages, rather than the problems, that multilingual users possess.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Translanguaging in the Bilingual Classroom: A Pedagogy for Learning and Teaching?
CREESE, A., & BLACKLEDGE, A. (2010) · The Modern Language Journal · doi:10.1111/j.1540-4781.2009.00986.x · Cited by 2,206
Language Policy: Hidden Agendas and New Approaches
Shohamy, E. (2006) · Routledge eBooks · doi:10.4324/9780203387962 · Cited by 1,674
Self-citationDisinventing and Reconstituting Languages
(2006) · Multilingual Matters eBooks · doi:10.21832/9781853599255 · Cited by 1,443
An Introduction to Language Policy: Theory and Method
Ricento, T. K. (2006) · Cited by 1,340
Language Policy Hidden Agendas and New Approaches
Shohamy, E. (2006) · Medical Entomology and Zoology · Cited by 1,339
Self-citationThe interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
Shohamy, E. (2001) · Medical Entomology and Zoology · Cited by 798
Self-citationDisinventing and (Re)Constituting Languages
Makoni, S., & Pennycook, A. (2005) · Critical Inquiry in Language Studies · doi:10.1207/s15427595cils0203_1 · Cited by 772
Language testing: the social dimension
Roever, C., & McNamara, T. (2006) · International Journal of Applied Linguistics · doi:10.1111/j.1473-4192.2006.00117.x · Cited by 668
The No Child Left Behind Act and English Language Learners: Assessment and Accountability Issues
Abedi, J. (2004) · Educational Researcher · doi:10.3102/0013189x033001004 · Cited by 517
Encyclopedia of Language and Education: Language Policy and Political Issues in Education
(1997) · Springer eBooks · doi:10.1007/978-94-011-4538-1 · Cited by 431
Canagarajah, S. (2006) · Language Assessment Quarterly · doi:10.1207/s15434311laq0303_1 · Cited by 429
English Learners Left Behind: Standardized Testing as Language Policy
Menken, K. (2008) · Multilingual Matters eBooks · doi:10.21832/9781853599996 · Cited by 398
Poehner, M. E. (2008) · Educational Linguistics · doi:10.1007/978-0-387-75775-9 · Cited by 279
English learners left behind: standardized testing as language policy
(2008) · Choice Reviews Online · doi:10.5860/choice.46-1030 · Cited by 275
A National Study: The Use of Specialty Surgical Teams
Boissoneau, R., Sprengel, A. D., & Snell, W. E. (1999) · Health Marketing Quarterly · doi:10.1300/j026v17n01_05 · Cited by 177
The No Child Left Behind Act: Have Federal Funds Been Left Behind?
Duncombe, W., Lukemeyer, A., & Yinger, J. (2008) · Public Finance Review · doi:10.1177/1091142107305220 · Cited by 130
Levin, T., & Shohamy, E. (2008) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2008.01.001 · Cited by 95
Self-citationHigh-stakes math tests: How No Child Left Behind leaves newcomer English language learners behind
Wright, W. E., & Li, X. (2008) · Language Policy · doi:10.1007/s10993-008-9099-2 · Cited by 64
Language tests for immigrants: Why language? Why tests? Why citizenship?
Shohamy, E. (2009) · Cited by 32
Self-citationEditorial 7.3: Introduction to the thematic issue
Menken, K. (2008) · Language Policy · doi:10.1007/s10993-008-9104-9 · Cited by 12
Research works printed but not linked: 14
- Abedi J., 2009, Encyclopedia of language and education: Vol. 7. Language testing and assessment, 331
- Cheng L., 2009, Encyclopedia of language and education: Vol. 7. Language testing and assessment, 349
- Davies A., 2009, Encyclopedia of language and education: Vol. 7. Language testing and assessment, 429
- Extra G., 2009, Language testing, migration and citizenship: Cross‐national perspectives
- Haim O.(2010).The relationship between Academic Proficiency (AP) in first language and AP in second and third languages.Unpublished doctoral dissertation Tel Aviv University .
- 10.1075/dapsac.33 · doi:10.1075/dapsac.33
- Levi‐Keren M.(2008).Factors explaining biases in Mathematic tests among immigrant students in Israel.Unpublished doctoral dissertation Tel Aviv University . [in Hebrew]
- Li Wei, 2009, Conflicts and tensions in classroom codeswitching [Special issue], Bilingual Education and Bilingualism, 13
- Logan‐Terry A., 2010, Making thinking visible: An analysis of English language learners’ interactions with access‐based science assessment items, AccELLerate!, 2, 11
- Menken K., 2009, Encyclopedia of language and education: Vol. 7. Language testing and assessment, 401
- Shohamy E., 2009, Encyclopedia of language and education: Vol. 7. Language testing and assessment, xiii–xxii
- 10.1075/dapsac.33.07sho · doi:10.1075/dapsac.33.07sho
- Spolsky B., 2009, Encyclopedia of language and education: Vol. 7. Language testing and assessment, 445
- Thomas W., 2002, A national study of school effectiveness for language minority students’ long‐term academic achievement: Final report. Project 1.1
Cited by
The influence of bilingualism on third language acquisition: Focus on multilingualism
Cenoz, J. (2013) · Language Teaching · doi:10.1017/s0261444811000218 · Cited by 334
Cenoz, J., & Gorter, D. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009029384 · Cited by 310
Dynamic Bilingualism as the Norm: Envisioning a Heteroglossic Approach to Standards‐Based Reform
Flores, N., & Schissel, J. L. (2014) · TESOL Quarterly · doi:10.1002/tesq.182 · Cited by 277
Translanguaging: Definitions, Implications, and Further Needs in Burgeoning Inquiry
Poza, L. (2017) · Berkeley Review of Education · doi:10.5070/b86110060 · Cited by 205
“…and researchers who incorporated translanguaging supports for discussions about text, encouraged students to deploy translanguaging in planning writing or oral presentations, and allowed translanguaging in assessment (for specific examples of translanguaging in assessment, see Shohamy, 2011).”
Schissel, J. L., De Korne, H., & López-Gopar, M. (2021) · International Journal of Bilingual Education and Bilingualism · doi:10.1080/13670050.2018.1463965 · Cited by 123
Metadata
- Authors
- SHOHAMY, E.
- Venue
- The Modern Language Journal
- Publisher
- Wiley
- Published
- 2011-09
- Volume
- 95
- Issue
- 3
- Pages
- 418-429
- ISSN
- 0026-7902 (ISSN-L)
- 1540-4781
- OpenAlex
- W2036492407
- Cited by
- 318
- References
- 21
- FWCI
- 31.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.