Artificial Intelligence Bias on English Language Learners in Automatic Scoring
Open accessThe DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index, and 1 are not checked yet.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Applying contemporary validity theory clarifies that the core issue is not whether GenAI has an accurate aggregate performance but whether it has interpretive fairness across linguistic subgroups [15, 21].”
From The impact of generative artificial intelligence tools on assessment equity for non-native English-speaking medical students: a systematic review (2026) · cites this paper as [21]
In the citing paper
“Four automated scoring studies showed a downward bias of 0.5–1.2 SD of NNES to be systematic for students.”
From The impact of generative artificial intelligence tools on assessment equity for non-native English-speaking medical students: a systematic review (2026) · cites this paper as [21]
In the citing paper
“International governance frameworks have recognized the potential of GenAI technologies to perpetuate dominance in the language used globally unless those technologies are purposely created in an inclusive manner [21].”
From The impact of generative artificial intelligence tools on assessment equity for non-native English-speaking medical students: a systematic review (2026) · cites this paper as [21]
Citations
Cites
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Friedman, M. (1937) · Journal of the American Statistical Association · doi:10.1080/01621459.1937.10503522 · Cited by 7,005
GPT detectors are biased against non-native English writers
Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023) · Patterns · doi:10.1016/j.patter.2023.100779 · Cited by 673
Towards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548
Applying machine learning in science assessment: A systematic review
Zhai, X., Yin, Y., Pellegrino, J. W., Haudek, K. C., & Shi, L. (2020) · Studies in Science Education · doi:10.1080/03057267.2020.1735757 · Cited by 257
Applying large language models and chain-of-thought for automatic scoring
Lee, G.-G., Latif, E., Wu, X., Liu, N., & Zhai, X. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100213 · Cited by 186
Self-citationApplying machine learning to automatically assess scientific models
Zhai, X., He, P., & Krajcik, J. (2022) · Journal of Research in Science Teaching · doi:10.1002/tea.21773 · Cited by 125
AI and formative assessment: The train has left the station
Zhai, X., & Nehm, R. H. (2023) · Journal of Research in Science Teaching · doi:10.1002/tea.21885 · Cited by 125
LeClair, C., Doll, B. J., Osborn, A. Q., & Jones, K. E. (2009) · Psychology in the Schools · doi:10.1002/pits.20398 · Cited by 90
Language challenges in mathematics education for English language learners: A literature review
Jourdain, L., & Sharma, S. (2016) · Waikato journal of education · doi:10.15663/wje.v21i2.269 · Cited by 78
Using fair AI to predict students’ math learning outcomes in an online platform
Li, C., Xing, W., & Leite, W. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2022.2115076 · Cited by 47
Research works printed but not linked: 3
- Cheuk, T.: Can AI be racist? Color-evasiveness in the application of machine learning to science assessments. Sci. Educ. 105(5), 825–836 (2021)
- Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. CoRR abs/1810.04805 (2018). http://arxiv.org/abs/1810.04805 · arXiv
- Lee, H.S., Pallant, A., Pryputniewicz, S., Lord, T., Mulholland, M., Liu, O.L.: Automated text scoring and real-time adjustable feedback: supporting revision of scientific arguments involving uncertainty. Sci. Educ. 103(3), 590–622 (2019)
Cited by
Jang, E. E., & Sawaki, Y. (2025) · Language Testing · doi:10.1177/02655322251348685 · Cited by 31
Oğuz, E. (2025) · Assessing Writing · doi:10.1016/j.asw.2025.100981 · Cited by 13
Wang, Y., Wu, X., Huang, J., Liu, L., Zhaı, X., & Liu, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29773-0_3 · Cited by 3
Self-citationNdacyayisenga, J. C. Y., Kidega, C., & Aciro Can, L. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09303-7 · Cited by 1
Künstliche Intelligenz in der beruflichen Bildung. Rechtliche Anforderungen nach der KI-Verordnung
Straub, S. (2025) · Pedocs (German Institute for International Educational Research) · doi:10.25656/01:33695 · Cited by 1
Metadata
- Authors
- Guo, S., Wang, Y., Yu, J., Wu, X., Ayik, B., Watts, F. M., Latif, E., Liu, N., Liu, L., & Zhai, X.
- Affiliations
- Nanjing Normal University (CN)
- University of Georgia (US)
- George Mason University (US)
- Educational Testing Service (US)
- Corresponding author
- Guo, Shuchen
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer Nature Switzerland
- Published
- 2025
- Pages
- 268-275
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W4412496583
- Cited by
- 14
- References
- 13
- Citations by year
- 2026: 11 · 2025: 3
- FWCI
- 14.22
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
- Keywords
- scoring bias, English language learners, automatic scoring, BERT fine-tuning, imbalanced training data, science assessment, junior high school students, written responses, sample size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial Intelligence Bias on English Language Learners in Automatic Scoring. https://app.cochat.ai/papers/10.1007/978-3-031-98462-4_34
- The paper
- Guo, S., Wang, Y., Yu, J., Wu, X., Ayik, B., Watts, F. M., Latif, E., Liu, N., Liu, L., & Zhai, X. (2025). Artificial Intelligence Bias on English Language Learners in Automatic Scoring. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-031-98462-4_34
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.