The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index; none of the 44 sources its claims cite is checked for support yet.
Language choice and students’ performance in mathematics and science: Evidence from Pakistan’s multilingual context
Open accessAbstract
In Pakistan’s post‑colonial multilingual context, language in education remains sensitive and complex. Most learners use their mother tongue at home, Urdu functions as the national lingua franca, and English, an official language, serves widely as the Language of Instruction (LoI) in private schools. These overlapping roles shape classroom interaction and student performance. This paper examines how language practices in Pakistani schools, particularly consistency across textbooks, instruction, and assessment, affect achievement in science and mathematics. Findings draw on a nationally representative sample of 15,391 students and 589 teachers from 153 elementary schools, using student achievement tests and classroom observations. Students exposed to consistent language use performed significantly better than those experiencing inconsistent language use in both subjects (p<0.001). The results show that language consistency, alongside school systems and teaching quality, influences performance, with effects strongest in classrooms with relatively better teaching quality.
Overview
CoChat Summary
TL;DR
In Pakistan’s multilingual elementary schools, students whose textbooks, classroom instruction, and assessments used the same language performed significantly better in mathematics and science than students exposed to inconsistent language use. The study reports significant main and interaction effects for language consistency with school system and teaching practices, though the t-test differences were small in magnitude.
Key findings
- Students with consistent language use outperformed those with inconsistent language use in both subjects (p<0.001): mathematics consistent M=28.1 (SD=15.4) vs inconsistent M=26.5 (SD=15.5), t=-5.493, effect size r=0.05; science consistent M=34.9 (SD=16.1) vs inconsistent M=33.6 (SD=16.2), t=-4.431, effect size r=0.04.
- Language consistency and school system had significant main effects on performance in mathematics and science (p<0.001 for all), with a significant interaction accounting for 7% of variance in mathematics and 12% in science. Private-school students with consistent language use scored higher in mathematics (M=36.4, SD=17.1) than inconsistent counterparts (M=30.1, SD=16.1), and in science private-school students with consistency scored M=45.8 (SD=16.9) vs government-school students with consistency M=38.4 (SD=17.1).
- Language consistency and teaching quality also had significant main effects (p<0.001 for all), with a significant interaction accounting for 2% of variance in both subjects. In mathematics, students with consistent language and moderate teaching practices scored M=35.7 (SD=16.2) vs inconsistent counterparts M=30.9 (SD=16.3); in science, the corresponding scores were M=44.2 (SD=15.8) vs M=36.7 (SD=18.4).
- Most private-school students (75%) experienced inconsistent language use, while 40% of government-school students encountered inconsistency across textbooks, classroom instruction, and assessment.
Methods
- Cross-sectional survey drawn from a nationwide study in 153 schools (78 public, 75 private) across six regions of Pakistan, selected via multistage cluster sampling from 25 districts; all pupils in grades 5, 6, and 8 were invited, yielding 15,391 students, and 589 science and mathematics teachers were observed.
- Instruments included a 3-point Classroom Observation Scale (COS) used to observe one lesson per teacher, grade-specific Science Achievement Tests (SATs) and Mathematics Achievement Tests (MATs) available in English, Urdu, and Sindhi, and demographic questionnaires. Test reliability (Cronbach’s alpha) ranged from 0.60 to 0.78; COS reliability was 0.79 for science and 0.69 for mathematics.
- Analysis used independent t-tests to compare mean percentage scores by language consistency, effect size r, and two-way ANOVA to test interactions between language consistency and school system, and between language consistency and teaching practices. Teaching practices were benchmarked as weak, moderate, or good, but only weak and moderate categories appeared in the analysis.
Limitations
- The paper does not state a formal limitations section.
- Evident from the text: the cross-sectional design cannot establish causality; the authors call for future experimental studies to assess whether consistent language use makes a difference in students’ learning.
- Evident from the text: t-test differences had small effect sizes (r=0.05 in mathematics, r=0.04 in science), and the teaching-practices interaction accounted for only 2% of variance in both subjects.
- Evident from the text: no teachers reached the “good” teaching-practices benchmark, so the teaching-quality analysis is limited to weak and moderate practices.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
0 Valid · 1 Not valid · 24 Not checked · 59 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the frequency analysis demonstrated that most private school students (75%) experienced inconsistent use of language”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > FINDINGS Demographic Characteristics of the Sample
boostedn = 6,121- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“slightly less than half of the government school students (40%) encounter inconsistency in language across textbooks, classroom instruction, and assessment.”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > FINDINGS Demographic Characteristics of the Sample
plainn = 9,270- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the students had difficulty in comprehending classroom instructions in English”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > Students' Performance between Consistent and Inconsistent Use of Language
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Students taught by teachers with moderate practices show greater performance gains when exposed to consistent language use”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > DISCUSSION
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the classroom observations exhibited that teachers commonly used local language for instructions.”
- Also stated in: § Students' Performance between Consistent and Inconsistent Use of Language · plain
“the teachers used local languages instead of English.”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > Students' Performance between Consistent and Inconsistent Use of Language
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Students' Performance between Consistent and Inconsistent Use of Language · plain
36 more claims
Create a free account to see all 84 claims and to verify the 17 references still open.
- It may state two separate claims as one. 25
- Probably not a substantial claim. 21
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > RESEARCH METHOD
“The benchmarking of this threepoint observational scale was conducted across three categories (weak = 1.0-2.0;moderate = 2.01-2.50;good = 2.51-3.0) to classify teachers' teaching practices.”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > RESEARCH METHOD
“The mean score of teachers' classroom observations on a 3-point scale was computed and categorised into three bands as weak practices (1.00 to 1.50), moderate practices (1.51 to 2.50), and good practices (2.51 to 3.00).”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > Separate and Interactive Effects of Language Consistency and School System on Students' Performance in Mathematics and Science
“This interaction effect accounted for 7% and 12% of the variance in students' performance in mathematics and science, respectively.”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > CONCLUSION
“| Language*s | 7124.6 | 1 | 714.6 | 30.9 | 0.001 0.003 | |”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > Separate and Interactive Effects of Language Consistency and School System on Students' Performance in Mathematics and Science
“This interaction effect accounted for 7% and 12% of the variance in students' performance in mathematics and science, respectively.”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > CONCLUSION
“| Language* | 4748.8 | 1 | 1435.5 | 21.3 | 0.001 0.002 | |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Language* | 4748.8 | 1 | 1435.5 | 21.3 | 0.001 0.002 | |”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > CONCLUSION
Reported 1435.5 · recomputed 4748.8
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Language*s | 7124.6 | 1 | 714.6 | 30.9 | 0.001 0.003 | |”
§ Language Choice and Students' Performance in Mathematics and Science: Evidence from Pakistan's Multilingual Context > CONCLUSION
Reported 714.6 · recomputed 7124.6
4 more findings
Create a free account to see every finding of this check.
Citations
Cites
Language, Power and Pedagogy: Bilingual Children in the Crossfire
Cummins, J. (2000) · doi:10.21832/9781853596773 · Cited by 3,185
Translanguaging: origins and development from school to street and beyond
Lewis, G., Jones, B., & Baker, C. (2012) · Educational Research and Evaluation · doi:10.1080/13803611.2012.718488 · Cited by 924
Educating English Language Learners: A Synthesis of Research Evidence
Genesee, F., Lindholm-Leary, K., Saunders, B., & Christian, D. (2006) · doi:10.1017/cbo9780511499913 · Cited by 743
The Returns to English-Language Skills in India
Azam, M., Chin, A., & Prakash, N. (2013) · Economic Development and Cultural Change · doi:10.1086/668277 · Cited by 274
Teaching science as a language: A “content‐first” approach to science teaching
Brown, B. A., & Ryoo, K. (2008) · Journal of Research in Science Teaching · doi:10.1002/tea.20255 · Cited by 249
Kieffer, M. J., Lesaux, N. K., Rivera, M., & Francis, D. J. (2009) · Review of Educational Research · doi:10.3102/0034654309332490 · Cited by 219
Norton, B. (2010) · Sociolinguistics and Language Education · doi:10.21832/9781847692849-015 · Cited by 216
Bilingualism as Ideology and Practice
Heller, M. (2007) · Bilingualism: A Social Approach · doi:10.1057/9780230596047_1 · Cited by 214
Education in Africa: What Are We Learning?
Evans, D. K., & Mendez Acosta, A. (2021) · Journal of African Economies · doi:10.1093/jae/ejaa009 · Cited by 212
Validating the Power of Bilingual Schooling: Thirty-Two Years of Large-Scale, Longitudinal Research
Collier, V. P., & Thomas, W. P. (2017) · Annual Review of Applied Linguistics · doi:10.1017/s0267190517000034 · Cited by 189
English language teaching in Bangladesh today: Issues, outcomes and implications
Rahman, M. M., Islam, M. S., Karim, A., Chowdhury, T. A., Rahman, M. M., Seraj, P. M. I., & Singh, M. K. M. (2019) · Language Testing in Asia · doi:10.1186/s40468-019-0085-8 · Cited by 181
Sah, P. K. (2020) · International Journal of Bilingual Education and Bilingualism · doi:10.1080/13670050.2020.1718591 · Cited by 174
Tai, K. W. H., & Wei, L. (2020) · Language and Education · doi:10.1080/09500782.2020.1837860 · Cited by 142
What can teachers do to raise pupil achievement?
Aslam, M., & Kingdon, G. (2011) · Economics of Education Review · doi:10.1016/j.econedurev.2011.01.001 · Cited by 141
English for Globalisation or for the World's People?
Phillipson, R. (2001) · International Review of Education · doi:10.1023/a:1017937322957 · Cited by 140
Piper, B., Zuilkowski, S. S., & Ong’ele, S. (2016) · Comparative Education Review · doi:10.1086/688493 · Cited by 134
Language policy, multilingualism and language vitality in Pakistan
Rahman, T. (2006) · doi:10.1515/9783110197785.1.73 · Cited by 133
Nag, S., Vagh, S. B., Dulay, K. M., & Snowling, M. J. (2018) · Review of Education · doi:10.1002/rev3.3130 · Cited by 125
Whatever the law says: language policy implementation and early-grade literacy achievement in Kenya
Trudell, B., & Piper, B. (2013) · Current Issues in Language Planning · doi:10.1080/14664208.2013.856985 · Cited by 104
Multilingualism(s) and system-wide assessment: a southern perspective
Heugh, K., Prinsloo, C. H., Makgamatha, M., Diedericks, G., & Winnaar, L. (2016) · Language and Education · doi:10.1080/09500782.2016.1261894 · Cited by 91
Emotional scaffolding for emergent multilingual learners through translanguaging: case stories
Back, M., Han, M., & Weng, S.-C. (. (2020) · Language and Education · doi:10.1080/09500782.2020.1744638 · Cited by 79
On Language and Development in Africa: The Case of Ghana *
Bodomo, A. B. (1996) · Nordic journal of African studies · doi:10.53228/njas.v5i2.665 · Cited by 69
Palmer, D. K., & Lynch, A. W. (2008) · Language Policy · doi:10.1007/s10993-008-9100-0 · Cited by 67
English as a medium of instruction in postcolonial contexts: moving the debate forward
Milligan, L. O., & Tikly, L. P. (2016) · Comparative Education · doi:10.1080/03050068.2016.1185251 · Cited by 64
English Language Teaching in Pakistan: Language Policies, Delusions and Solutions
Manan, S. A., David, M. K., & Dumanig, F. P. (2015) · Language policy · doi:10.1007/978-3-319-22464-0_10 · Cited by 52
Shamim, F., & Rashid, U. (2019) · Journal of Education and Educational Development · doi:10.22555/joeed.v6i1.2235 · Cited by 49
Language policy and science: Could some African countries learn from some Asian countries?
Brock-Utne, B. (2012) · International Review of Education · doi:10.1007/s11159-012-9308-2 · Cited by 38
Teacher Code Switching Consistency and Precision in a Multilingual Mathematics Classroom
Chikiwa, C., & Schäfer, M. (2016) · African Journal of Research in Mathematics Science and Technology Education · doi:10.1080/18117295.2016.1228823 · Cited by 31
English as a Medium of Instruction: My Experience from a Nepali Hinterland
Khati, A. R. (2016) · Journal of NELTA · doi:10.3126/nelta.v21i1-2.20198 · Cited by 31
Prinsloo, C. H., & Harvey, J. (2018) · Research in Science Education · doi:10.1007/s11165-018-9769-9 · Cited by 23
Comparing government and private schools in Pakistan: The way forward for universal education
Siddiqui, N., & Gorard, S. (2017) · International Journal of Educational Research · doi:10.1016/j.ijer.2017.01.007 · Cited by 23
Has English Medium Instruction Failed in Pakistan?
Mahboob, A. (2020) · Multilingual education · doi:10.1007/978-3-030-52225-4_17 · Cited by 20
Issues in Language Policy, Culture, and Identity
Tollefson, J. W., & Tsui, A. Β. M. (2017) · Routledge eBooks · doi:10.4324/9781315092034-14 · Cited by 20
Hansen‐Thomas, H., Langman, J., & Farias-Sokoloski, T. (2019) · Latin American Journal of Content and Language Integrated Learning · doi:10.5294/laclil.2018.11.2.2 · Cited by 17
Pinter, H. H., Merritt, E. G., Berry, R. Q., & Rimm‐Kaufman, S. E. (2017) · Investigations in Mathematics Learning · doi:10.1080/19477503.2017.1375354 · Cited by 15
Khan, F., & Haseeb, M. A. (2017) · Paradigms · doi:10.24312/paradigms110103 · Cited by 15
Mose, P. N. (2016) · International Journal of Bilingual Education and Bilingualism · doi:10.1080/13670050.2016.1268567 · Cited by 11
Skutnabb‐Kangas, T. (2006) · Elsevier eBooks · doi:10.1016/b0-08-044854-2/00407-7 · Cited by 8
Bhutta, S. M., Ahmad, S., & Ansari, A. N. (2025) · Investigations in Mathematics Learning · doi:10.1080/19477503.2025.2475689 · Cited by 3
Self-citationSchool System and Student Performance: Examining Science and Mathematics Achievement in Pakistan
Bhutta, S. M., Ahmad, S., & Ansari, A. N. (2024) · UMT Education Review · doi:10.32350/uer.72.02 · Cited by 3
Self-citation
Research works printed but not linked: 9
- Benson, C., & Kosonen, K. (2013). A critical comparison of language-in-education policy and practice in four Southeast Asian countries and Ethiopia. In Multilingual Education and Sustainable Diversity Work (pp. 111–137). Routledge.
- Coleman, H. (2011). Developing countries and the English language. In H. Coleman (Ed.), Dreams and realities: Developing countries and the English language (pp. 1–14). British Council.
- Fareed, M., Ashraf, A., & Mushtaque, S. (2019). Medium of instruction in education: perceptions of teachers and students from Pakistani school, college and university. FWU Journal of Social Sciences, 13(3), 134–143.
- García, O., & Baker, C. (Eds.). (2007). Bilingual education: An introductory reader (Vol. 61). Multilingual matters.
- Mohanty, A. (2011). MLE and the double divide in multilingual societies: Comparing policy and practice in India and Ethiopia. In K. Kosonen & C. Benson (Eds.), Language issues in comparative education (pp. 138–150). Sense Publishers.
- Mustafa, Z. (2021). Some observations on language. In Reforming School Education in Pakistan & the Language Dilemma (pp. 42–50). Paramount Books (Pvt.) Ltd.
- Mustafaqulova, H. A. (2022). Teaching culture in the ESL classroom. Science and Education, 3(2), 817–820.
- Prah, K. K., & Brock-Utne, B. (2009). Introduction: Multilingualism – an African Advantage. In K. K. Prah & B. Brock-Utne (Eds.), Multilingualism – an African Advantage. A paradigm shift in African languages of instruction policies (pp. 1–17). CASAS.
- Wedikkarage, L. (2009). Science Education and English Medium: The Sri Lankan Experience. In B. Brock-Utne & G. Garbo (Eds.), Language is Power: The implications of Language for Peace and Development. Dar as Salaam.
Cited by
BEMULTILINGUAL EDUCATION AND MOTHER-TONGUE-BASED LITERACY IN INDIA
Ameerushama, M., & Jain, D. P. (2024) · Educational Administration Theory and Practice journal
Ahmad, A., Sultan, A., Ali, F., & Abbas, A. (2026) · Journal of Regional Studies Review · doi:10.62843/jrsr/2026.v.iii.205
Pedagogical patterns in science and mathematics classrooms of Pakistan: an observation-based study
Bhutta, S. M., Ali, S., Ansari, A. N., & Ahmad, S. (2026) · International Journal of Educational Research · doi:10.1016/j.ijer.2026.103134
Self-citation
Metadata
- Authors
- Bhutta, S. M., Ansari, A. N., Ahmad, S., & Ali, B.
- Affiliations
- Aga Khan University (PK)
- Durham University (GB)
- University of Cambridge (GB)
- Karakoram International University (PK)
- Venue
- American Journal of STEM Education
- Publisher
- STAR Scholars Network
- Published
- 2026-05-26
- Volume
- 22
- Pages
- 289-316
- ISSN
- 3065-1190 (ISSN-L)
- OpenAlex
- W7162869869
- Cited by
- 3
- References
- 40
- Citations by year
- 2026: 2
- FWCI
- 16.61
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- American Journal of STEM Education (publishedVersion, cc-by)
- Topics
- Social Sciences › Linguistics and Language › Multilingual Education and Policy
- Social Sciences › Linguistics and Language › Second Language Learning and Teaching
- Social Sciences › Education › School Choice and Performance
- Keywords
- language of instruction, language choice in education, language consistency, mathematics achievement, science achievement, multilingual education, Urdu language, English-medium instruction, private schools, teaching quality, elementary school, Pakistan
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.