AI generates covertly racist decisions about people based on their dialect
Open accessThe DOI matches its Crossref record; 100 of the 100 references it cites were found in a registry or an index.
Abstract
Hundreds of millions of people now interact with language models, with uses ranging from help with writing 1,2 to informing hiring decisions 3 . However, these language models are known to perpetuate systematic racial prejudices, making their judgements biased in problematic ways about groups such as African Americans 4–7 . Although previous research has focused on overt racism in language models, social scientists have argued that racism with a more subtle character has developed over time, particularly in the United States after the civil rights movement 8,9 . It is unknown whether this covert racism manifests in language models. Here, we demonstrate that language models embody covert racism in the form of dialect prejudice, exhibiting raciolinguistic stereotypes about speakers of African American English (AAE) that are more negative than any human stereotypes about African Americans ever experimentally recorded. By contrast, the language models’ overt stereotypes about African Americans are more positive. Dialect prejudice has the potential for harmful consequences: language models are more likely to suggest that speakers of AAE be assigned less-prestigious jobs, be convicted of crimes and be sentenced to death. Finally, we show that current practices of alleviating racial bias in language models, such as human preference alignment, exacerbate the discrepancy between covert and overt stereotypes, by superficially obscuring the racism that language models maintain on a deeper level. Our findings have far-reaching implications for the fair and safe use of language technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Hofmann et al. ( 2024 ) found that models trained with RLHF exhibited weaker overt prejudice (using terms to describe African Americans such as 'passionate' or 'imaginative') but this did not diminish covert prejudice.”
From AI’s Epistemic Harm: Reinforcement Learning, Collective Bias, and the New AI Culture War (2025) · cites this paper as Hofmann et al., 2024
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“AI may also introduce bias, influenced by the data used in training [29].”
From Using artificial intelligence to semi-automate trustworthiness assessment of randomized controlled trials: a case study (2025) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“Notably, subtle biases, such as those related to linguistic connotations, regional dialects, or implicit associations, can be especially insidious and difficult to eliminate through technical safeguards144.”
From Current applications and challenges in large language models for patient care: a systematic review (2025) · cites this paper as [144]
The cited source says what the claim attributes to it.
In the citing paper
“Similarly, as LLMs are systems based on predictive text algo rithms it is perhaps not surprising that they have given sexist (Wan et al., 2023 ) and racist (Hofmann et al., 2024 ) outputs.”
From AI’s Epistemic Harm: Reinforcement Learning, Collective Bias, and the New AI Culture War (2025) · cites this paper as Hofmann et al., 2024
The cited source says what the claim attributes to it.
In the citing paper
“The researchers found that, while these models overtly associate African Americans with positive attributes (such as 'brilliant') they covertly associated African Ameri -cans with exclusively negative attributes, (words such as 'lazy' and 'dirty').”
From AI’s Epistemic Harm: Reinforcement Learning, Collective Bias, and the New AI Culture War (2025) · cites this paper as Hofmann et al., 2024
11 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“It is worth mentioning that the lack of awareness of covert racism also manifests during evaluation, where it is common to test language models for overt racism but not for covert racism 21,63,79,80 .”
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 2×
“The typical pipeline of training language models includes steps such as data filtering 48 and, more recently, HF training 62 that remove overt racial prejudice.”
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 3×
“In the Supplementary Information, we show that this deviation was caused by the base T5 version, and that the larger T5 versions follow the general pattern (Supplementary Table 10).”
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · cited 2×
“As a second potential way to resolve dialect prejudice in language models, we examined training with HF 49,62 .”
Semantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887 · cited 11×
“2 and Supplementary Table 4).”
InfluentialPaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
Unsettling race and language: Toward a raciolinguistic perspective
Rosa, J., & Flores, N. (2017) · Language in Society · doi:10.1017/s0047404517000562 · Cited by 1,675 · cited 1×
“These associations represent raciolinguistic ideologies, demonstrating how AAE is othered through the emphasis on its perceived deviance from standardized norms 44 .”
Research works printed but not linked: 15
- Zhao, W. et al. WildChat: 1M ChatGPT interaction logs in the wild. In Proc. Twelfth International Conference on Learning Representations (OpenReview.net, 2024).
- Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V. & Kalai, A. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. Adv. Neural Inf. Process. Syst. 30, 4356–4364 (2016).
- Li, L. & Bamman, D. Gender and representation bias in GPT-3 generated stories. In Proc. Third Workshop on Narrative Understanding (eds Akoury, N. et al.) 48–55 (Association for Computational Linguistics, 2021).
- Grogger, J. Speech patterns and racial wage inequality. J. Hum. Resour. 46, 1–25 (2011).
- Rodriguez, J. I., Cargile, A. C. & Rich, M. D. Reactions to African-American vernacular English: do more phonological features matter? West. J. Black Stud. 28, 407–414 (2004).
- Surden, H. Artificial intelligence and law: an overview. Ga State Univ. Law Rev. 35, 1305–1337 (2019).
- Schuman, H., Steeh, C., Bobo, L. D. & Krysan, M. (eds) Racial Attitudes in America: Trends and Interpretations (Harvard Univ. Press, 1998).
- Terkel, S. Race: How Blacks and Whites Think and Feel about the American Obsession (New Press, 1992).
- Bonilla-Silva, E. The New Racism: Racial Structure in the United States, 1960s–1990s. In Race, Ethnicity, and Nationality in the United States: Toward the Twenty-First Century 1st edn (ed. Wong, P.) Ch. 4 (Westview Press, 1999).
- Ethayarajh, K., Choi, Y. & Swayamdipta, S. Understanding dataset difficulty with V-usable information. In Proc. 39th International Conference on Machine Learning (eds Chaudhuri, K. et al.) 5988–6008 (Proceedings of Machine Learning Research, 2022).
- Eisenstein, J., O’Connor, B., Smith, N. A. & Xing, E. P. A latent variable model for geographic lexical variation. In Proc. 2010 Conference on Empirical Methods in Natural Language Processing (eds Li, H. & Màrquez, L.) 1277–1287 (Association for Computational Linguistics, 2010).
- Eisenstein, J. What to do about bad language on the internet. In Proc. 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (eds Vanderwende, L. et al.) 359–369 (Association for Computational Linguistics, 2013).
- Zhao, T. Z., Wallace, E., Feng, S., Klein, D. & Singh, S. Calibrate before use: Improving few-shot performance of language models. In Proc. 38th International Conference on Machine Learning (eds Meila, M. & Zhang, T.) 12697–12706 (Proceedings of Machine Learning Research, 2021).
- Jurafsky, D. & Martin, J. H. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition (Prentice Hall, 2000).
- Santurkar, S. et al. Whose opinions do language models reflect? In Proc. 40th International Conference on Machine Learning (eds Krause, A. et al.) 29971–30004 (Proceedings of Machine Learning Research, 2023).
Cited by
Items 301–400 of 476
Bar‐Gill, O., & Sunstein, C. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197778197.003.0004
Bar‐Gill, O., & Sunstein, C. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197778197.003.0015
Bar‐Gill, O., & Sunstein, C. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197778197.002.0004
Bar‐Gill, O., & Sunstein, C. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197778197.002.0005
Bar‐Gill, O., & Sunstein, C. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197778197.003.0008
Bar‐Gill, O., & Sunstein, C. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197778197.002.0003
Autocompleting inequality: Large language models and the “alignment problem”
Zajko, M. (2025) · Journal of Digital Social Research · doi:10.33621/jdsr.v7i154879 · Cited by 1
Adler, J. (2025) · Trillium Krebsmedizin · doi:10.47184/tk.2025.02.10
Comparing ChatGPT with human perceptions of illusory faces
Kramer, R. S. S. (2025) · Visual Cognition · doi:10.1080/13506285.2025.2529875
de Sena, R. L. R., Souza, M., Santana, A. S., & de Melo, J. L. L. (2025) · Anais do Workshop sobre as Implicações da Computação na Sociedade (WICS) · doi:10.5753/wics.2025.9056
AI free from bias and ideology is a fantasy – humans can’t organise data without distorting reality
Humphreys, D. (2025) · The Conversation · doi:10.64628/aa.3wyypwggc
When AI sets wages: biases and labor discrimination in generative pricing
Cohen, M. C., Hage-Youssef, E., & Khern-am-nuai, W. (2026) · AI and Ethics · doi:10.2139/ssrn.5404966 · Cited by 2
Mitigating AI Bias in School Psychology: Toward Equitable and Ethical ImplementationPreprint
Lockwood, A. B., & Brown, J. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/mh4rj_v2 · Cited by 3
Generative AI can influence climate beliefs and actions
Sabherwal, A. C. (2025) · Nature Climate Change · doi:10.1038/s41558-025-02438-3
Cieślak, K., & Rudnicki, S. (2025) · Studia Socjologiczne · doi:10.24425/sts.2025.156479 · Cited by 1
WO: Menschen, Technologie und humane Technologie
Walther, C. C. (2025) · Springer eBooks · doi:10.1007/978-3-031-95463-4_2
From Code to Culture: Aligning Large Language Models with Corporate ValuesPreprint
Kosmas, M., Mayer, A.-S., Feuerriegel, S., & Bodendorf, F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5615933 · Cited by 15
US-China Digital Competition in Africa: The Perspectives of IR Theories
Åberg, J. H. S. (2025) · Studies in digital politics and governance · doi:10.1007/978-3-032-04269-9_11
From words to pixels: Artificial intelligence struggles with world Englishes
Floris, F. D. (2025) · The JALT CALL Journal · doi:10.29140/jaltcall.v21n3.103083
“A large study of language models also found that prompts written in African American English were more likely to be linked with low-status jobs or harsher penalties compared to the same prompts in standard English (Hofmann et al., 2024).”
Understanding Down Syndrome Stereotypes in LLM-Based Personas
Wu, C., Pan, M., Wang, P., Nibras, N., Li, M., Yuan, D., Wang, Z., He, J., Ali, M. A. S., & Prpa, M. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812894
“However, despite this potential for LLM-based personas, research reveals that these systems may risk obscuring the subjective and interpretive processes in persona creation; leading to outputs that reflect patterns learned from training data rather than authentic lived experiences [39, 94].”
Accessibility, efficiency, and fairness in automatic text response scoring
Andersen, N. (2025) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · doi:10.21248/gups.95113
KI-Bilder und die Widerständigkeit der Medienkonvergenz: Von primärer zu sekundärer Intermedialität?Preprint
Wilde, L. R. A. (2024) · arXiv (Cornell University) · doi:10.13140/rg.2.2.10050.80327
Miscalibrated trust hinders effective partner choices in human-AI collectives
Jiang, Y., Brinkmann, L. U. L., Nussberger, A.-M., Soraperra, I., Bonnefon, J., & Rahwan, I. (2025) · eScholarship (California Digital Library)
User Perceptions of Trust in Generative AI for Healthcare Advice
Eliasson, G., & Gullström, T. (2025) · Lund University Publications Student Papers (Lund University) · Cited by 1
GRAIL: Codesigning responsible uses of AI in research funding and evaluation
Woods, H. B., & Newman-Griffis, D. R. (2024) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York)
Saha, S., & Saha, S. (2025) · UA Campus Repository (The University of Arizona)
The Influence of Reinforcement Learning From Human Feedback on Large Language Model Biases
Barnhart, L. D. W. (2024) · CU Scholar (University of Colorado Boulder)
Mozetič, T. (2025) · Repository of the University of Ljubljana (University of Ljubljana)
Bierzyński, T. (2025) · Family Upbringing · doi:10.61905/wwr/211816
Who Gets to Be Biased? How AI Supply Chains Overrepresent the West and Marginalize the Rest
Puutio, A., & Lin, P. K. (2025) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0182
Artificial Intelligence and Greek Philology: An Experiment
Battezzato, B. G. J. H. L., Battezzato, L., Graziosi, B., & Haubold, J. (2025) · doi:10.2422/978-88-7642-815-9
Assessing Smartphone Speech Recognition Across Diverse English Accents: A Preliminary Study
Soria, C., Nodari, R., & Calamai, S. (2025) · Use Siena air (University of Siena) · doi:10.69117/all.2025.3.04
Minds of their own? Decoding free will in large language models
Lavazza, A., Sartori, G., Farina, M., Melis, G., & Orrù, G. (2026) · AI & Society · doi:10.1007/s00146-025-02809-6 · Cited by 3
Official outcome of the UN IGF Data and Artificial Intelligence Governance Coalition
Belli, L., & Gaspar, W. B. (2024) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 1
Zhao, E. (2026) · Advances in Humanities Research · doi:10.54254/2753-7080/2026.31302
McKinney, W. T., Fernholz, D., Pakhomov, S., Kotlyar, M., Dufresne, S. R., THURAS, P. D., Welle, E., & Japuntich, S. J. (2026) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntaf268
“21 Further, they may provide responses that lack evidence and instead perpetuate disparities, causing more harm to the user.”
Dev, N., & Joy, S. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2615218
“Recent studies underscore these dangers: Hofmann et al. (2024) identify covert prejudice against African American Vernacular English in LLMs, while Mire et al. (2025) show reward models systematically penalizing African American Language.”
How Well Do Large Language Models Understand African American Language? Causes and Implications
McKeown, K. R., Grieser, J. A., Deas, N., Kleiner, S., Patton, D. U., Shepard, J., & Vente, B. (2026) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-041824-050629 · Cited by 3
Hussain, S.-A., Jackson, D. I., Thotapalli, S., McClellan, M. B., Stanco, M., Varney, G., Gleeson, S., Nugroho, F., Leever, W. J., Fosler‐Lussier, E., et al. (2026) · medRxiv · doi:10.64898/2026.01.30.26345239 · Cited by 1
“Our use of CBHS with care coordination responsibilities as raters, given their domain expertise and sensitivity to social context, may also provide a more nuanced evaluation than standard crowdsourcing, potentially identifying subtle biases that less informed raters might miss [35].”
Structured Forgetting: The Atrophy of Affect Under Tonal Surveillance
Edmonds, V. (2025) · PhilPapers (PhilPapers Foundation) · doi:10.5281/zenodo.18713985
Equitable Evaluation via ElicitationPreprint
Du, E., Dwork, C., Hu, L., McIlroy-Young, R., Shao, H., & Zhang, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.21327
“For instance, Hofmann et al. [2024] and Guenzel et al. [2025] analyze the role of AI in recruitment and assessment, noting that algorithmic tools can either amplify existing disparities or help to mitigate them if designed carefully.”
DEIA … The Final Frontier? Going Where No One Has Gone Before?
Chancellor, R. L., & Sullivan, D. M. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0065-283020260000060010
AI, Decomputing and the Interregnum
McQuillan, D. (2026) · Goldsmiths (University of London) · doi:10.5281/zenodo.18908529
Satish, S., Teleki, M., Minixhofer, C., Klejch, O., Bell, P., & Székely, É. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742414.3794737
Nothing to See Here: Generative AI, Neoliberal Crisis, and Intensified Counterinsurgency
Richards, G. (2025) · YorkSpace (York University)
Taheri, A., Alaoui, H. E., Carrington, P., & Bigham, J. P. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791078
“At the same time, analyses of LLM behavior reveal embedded biases: models can display uneven empathy by race [34, 55], replicate stereotypes, and exhibit human-like cognitive biases such as framing effects and anchoring [44, 46].”
Digital Democracy and Social Cohesion: From Promise to Practice
Fegert, J., Slivko, O., Stieglitz, S., & Weinhardt, C. (2026) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000191386
'Miña leira!': Videojuego de estrategia con componente de suposición
Azpiazu, R. A. (2026) · O2 - Repositori Institucional (Universitat Oberta de Catalunya)
Sami, K. M. J., Sumit, D., Hossain, A., & Sadeque, F. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.9 · Cited by 2
KI und Gerechtigkeit in der Zivilgesellschaft
Hassler, C., Nikolajevic, N., Obendiek, A. S., Pfleiderer, O., & Stettner, J. (2026) · Springer eBooks · doi:10.1007/978-3-658-50335-2_4
Black LLMirror: User (Self) Perceptions in Black American English Interactions with LLMs
Campbell, M. M., Mire, J., Díaz, M., & Sap, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791111
“…technologies for their shortcomings with BAE over various tasks, including automatic speech recognition [8, 41, 43], speaker characterization [4, 30], reward modeling [51], and toxic language detection [58], the potential consequences of which range from online censorship of BAE to prejudice…”
Writing with AI Can Reduce Gender Bias in Hiring Evaluations
Liu, A. T. H., Lee, M., & Bai, X. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791136 · Cited by 1
“If trained on biased text or not prompt engineered and tested rigorously, they may suggest words or phrases that repeat or reinforce gender stereotypes [5, 32, 102, 152, 162].”
Márquez, F. O. S., & Ortiz, G. E. R. (2026) · Advances in Human-Computer Interaction · doi:10.1155/ahci/8435912
Collectively Reimagining Artificial Intelligence With Marginalized Communities
Oluwatuyi, R. F., Pillay, V., Mazwi, J., Castro, A., Farao, J., Srivatsa, S., Bagalkot, N., & Densmore, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791421 · Cited by 2
“This vision complicates mainstream narratives of AI development, which often prioritize globally dominant languages and standardized cultural references, leaving hyperlocal expressions at the margins [35, 52, 101].”
Introduction to the Minitrack on Digital Democracy and Social Cohesion
Fegert, J., Slivko, O., Stieglitz, S., & Weinhardt, C. (2026) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2026.803
AI and Society: A Social Science Course Model for Undergraduate General Education
Adams, S. T. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-6592-3.ch010
Achieving fair AI in Africa? Ideas from the African charter on human and peoples’ rights
Jimoh, M. A. (2026) · Science and Public Policy · doi:10.1093/scipol/scag008
The epidemiology of artificial intelligence
Parikh, H., McCormick, T. H., Johnson, E. K., Hickey, L., Ranney, M. L., & Mukherjee, B. (2026) · Nature Health · doi:10.1038/s44360-026-00188-w
Natural Language Processing for Surgical Quality Enhancement
Tennakoon, L., Roll, N., Knowlton, L. M., Spain, D. A., & Hawn, M. T. (2026) · Journal of Surgical Research · doi:10.1016/j.jss.2026.03.037
Türkçe Dil Modellerinde Persona Vektörleri: Karakter Özelliklerinin İzlenmesi ve Kontrolü
Akbulut, M. (2026) · Türk Kütüphaneciliği · doi:10.24146/tk.1765562
Large language models as a conduit for value shifts in contemporary China
Cao, L., & Dai, L. (2026) · Chinese Sociological Review · doi:10.1080/21620555.2026.2656193
"Am I a Man or a Muppet": A Rhetorical Analysis of Generative AI’s Representation of Gender
Boaz, J. (2026) · Digital Commons - ACU (Abilene Christian University)
Public Opinion in the Age of AIPreprint
Clinton, J. D., Barari, S., Busby, E. C., Buskirk, T. D., Duch, R. M., Haensch, A., Hillygus, D. S., Kennedy, C., Munger, K., Rivers, D., et al. (2026) · doi:10.33774/apsa-2026-1rg21
Responsible AI for Research: Between Moral Philosophy and Philosophy of Science
Mussgnug, A. M., Leonelli, S., & Vallor, S. (2026) · Springer eBooks · doi:10.1007/978-3-032-15112-4_20
Public Opinion in the Age of AIPreprint
Clinton, J. D., Barari, S., Busby, E. C., Buskirk, T. D., Duch, R. M., Haensch, A., Hillygus, D. S., Kennedy, C., Munger, K., Rivers, D., et al. (2026) · doi:10.33774/apsa-2026-1rg21-v2
Public Opinion in the Age of AIPreprint
Clinton, J. D., Barari, S., Busby, E. C., Buskirk, T. D., Duch, R. M., Haensch, A., Hillygus, D. S., Kennedy, C., Munger, K., Rivers, D., et al. (2026) · doi:10.33774/apsa-2026-1rg21-v3 · Cited by 1
So, You Want to Be an Ally: Respectfully Engaging with CALD Communities and Researchers
McKay, D. (2026) · Springer eBooks · doi:10.1007/978-981-95-5855-1_10
Vectors for Topics: The use of Topical Vector Spaces in Epistemic Logics
Ferenz, N. (2026) · Journal of Logic Language and Information · doi:10.1007/s10849-026-09471-1
Like a Slot Machine: AI, Representation, and the Challenges of Language Diversity
Engelmayr-Hofmann, K., & Leichtfried, M. (2026) · Springer eBooks · doi:10.1007/978-3-032-16520-6_5
(2025) · Bibliothèque et Archives nationales du Québec (Québec government)
Asymmetric sociodemographic disparity in evidence-grounded clinical AIPreprint
Jia, E., Omar, M., Barash, Y., Brook, O. R., Ahmed, M., Kruskal, J. B., Gorenshtein, A., & Klang, E. (2026) · medRxiv · doi:10.64898/2026.05.12.26353061
Reducing Political Manipulation with Consistency TrainingPreprint
Phan, L., Kim, D., Pan, A., Blair, A., Khoja, A., & Hendrycks, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.22771
“Hofmann et al. (15) show that LLMs make covertly racist decisions about speakers based on their dialect, even while explicitly disavowing racial bias; our notion of covert political bias is closely parallel.”
Cheng, P. (2026) · Digital Commons - RISD (Rhode Island School of Design)
Martini, R. H. (2026) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2026.2777.2.36
MacArthur, M. J. (2026) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2026.2777.2.25
Sperber, L. (2026) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2026.2777.2.43
Afterword. Ten Directions for Writing and Learning in the Age of AI
Gardner, T. (2026) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2026.2777.3.2
Harnessing large language models to summarize landmark surgical studies for resident education
Pettigrew, M. F., Tyler, L. A., Gregory, A. L., Nomellini, V., Bhat, S. G., Murphy, J. T., Purcell, L. N., Butler, D. F., Park, C., Clark, A. T., et al. (2026) · Global Surgical Education - Journal of the Association for Surgical Education · doi:10.1007/s44186-026-00537-z
“Prior studies have demonstrated both the educa - tional potential of LLMs as adjunct learning tools as well as the need for systematic validation to ensure reliability and patient safety [ 32–35].”
Automating Censorship: The Constitutional Dangers of Book Banning
Turner, L. M., & Weaver, B. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-4586-4.ch003
What Do People Actually Want From AI? Mapping Preference Plurality
Coelho, J. S., & Hale, S. A. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812398 · Cited by 5
“While accusations of LLMs being racist or sexist [51] are addressed and attempts are made to mitigate them [64, 82], these attempts are not always successful [32].”
Zephaniah, I. (2026) · Jurnal Ilmu Sosial dan Humaniora · doi:10.58540/isihumor.v4i3.1785
“…evaluation also risks directing users toward optimizing technical indicators rather than developing adaptive and reflective communication abilities, as automation bias can reduce individuals ’ tendency to critically evaluate system recommendations (Hofmann et al., 2024; Manzey et al., 2012).”
Żok, A., Wiertlweska-Bielarz, J., & Moskalewicz, M. (2026) · Journal of Academic Ethics · doi:10.1007/s10805-026-09746-z · Cited by 1
“Future AI-generated content may face accusations of racism or xenophobia (Hofmann et al., 2024 ).”
How two AI models depict ageing: a cross-cultural analysis of ChatGPT and Doubao
Zhong, X. (2026) · Social Semiotics · doi:10.1080/10350330.2026.2686256
AI in Advocacy and Social Justice
Alba, C., & McCoy, H. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6_16
Toward human-aligned intelligence : modeling behavior, expression, and connections
Lyu, H., & Luo, J. (2026) · UR Research (University of Rochester)
A Methodology to Assess Polarization on Social Media
Dey, D., Alashhy, M., Bhaumik, D., & Weltevreden, J. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812263
Unearthing implicit biases: a scenario-based evaluation of open-source LLMs
Yao, Y., Hao, L., Rong, H., Dan, W., & Zhao, X. (2026) · Aslib Journal of Information Management · doi:10.1108/ajim-06-2025-0389
Tanksley, T. (2026) · Oxford University Press eBooks · doi:10.1093/9780198945246.003.0174
Can you Help me Also to Write? Using LLMs to Evaluate Essays that Contain Filipino English Features
Ocumpaugh, J. L., Liu, X., Rodrigo, M. M. T., Kai, S., & Andres, J. M. A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-29791-4_14
Teammates for Whom? Linguistic Gatekeeping in LLM-Based Educational Assessment and Feedback
Zheng, C., & Chen, G. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-29791-4_9
The Janus-Faced Nature of AI in STEM Education
Wulff, P. (2026) · Maarif global education series · doi:10.1007/978-981-95-9023-0_4
Park, K., Min, H., Lee, C. B., & Shin, K.-Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29773-0_26
Bias in Generative Outputs: Evidence from Text and Text-to-Image Systems
Spennemann, D. H. R. (2026) · Springer eBooks · doi:10.1007/978-3-031-75316-9_157-1 · Cited by 1
Identifying High-Confidence Social Biases in LLMs for Trustworthy Conversational Tutoring Agents
Alvarez, A. A., & Fincham, N. X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29773-0_22 · Cited by 1
Havens, L., Terras, M., Bach, B., & Alex, B. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812283
“Evidence of ableist, racist, sexist, and otherwise biased behaviors of Machine Learning (ML) models demonstrate harmful consequences that AI systems have had, and have the potential to continue having, on communities of already marginalized people [17, 27, 51, 73, 81].”
Algorithmic Bias vs. Human Bias: Dual Reflections on Social Work in the AI Era
Liu, Y.-H., Chen, Y.-H., & Liu, J. S.-C. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-23104-8_16
An Adversarial-Attack Approach to Assess Bias in Text-to-Image Models
Gangadharan, K., do Nascimento, N. M., Alencar, P., Peixoto, M. D. L. C., Vasconcelos, A. E. R., Baía, D. D. M., & Fonseca, B. (2026) · RAIE · doi:10.1145/3786156.3788575
Metadata
- Authors
- Hofmann, V., Kalluri, P. R., Jurafsky, D., & King, S.
- Affiliations
- University of Oxford (GB)
- Stanford University (US)
- University of Chicago (US)
- Corresponding author
- Hofmann, Valentin
- King, Sharese
- Venue
- Nature
- Published
- 2024-08-28
- Volume
- 633
- Issue
- 8028
- Pages
- 147-154
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- PMC
- PMC11374696
- OpenAlex
- W4401947350
- Cited by
- 233
- References
- 89
- Citations by year
- 2026: 116 · 2025: 111 · 2024: 6
- FWCI
- 96.25
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Knowledge@UChicago (University of Chicago) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- University of Chicago (cc-by)
- Funders
- Stanford Institute for Human-Centered Artificial Intelligence, Stanford University
- Studienstiftung des Deutschen Volkes
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Linguistics and Language › Linguistic Variation and Morphology
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- covert racism, African American English, language models, racial bias in AI, preference alignment, hiring decisions, algorithmic fairness
- MeSH terms
- Artificial Intelligence, Black or African American, Decision Making, Humans, Language, Natural Language Processing, Stereotyping, Racism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.