On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Open accessThe DOI matches its Crossref record; 156 of the 159 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
The past 3 years of work in NLP have been characterized by the development and deployment of ever larger language models, especially for English. BERT, its variants, GPT-2/3, and others, most recently Switch-C, have pushed the boundaries of the possible both through architectural innovations and through sheer size. Using these pretrained models and the methodology of fine-tuning them for specific tasks, researchers have extended the state of the art on a wide array of tasks as measured by leaderboards on specific benchmarks for English. In this paper, we take a step back and ask: How big is too big? What are the possible risks associated with this technology and what paths are available for mitigating those risks? We provide recommendations including weighing the environmental and financial costs first, investing resources into curating and carefully documenting datasets rather than ingesting everything on the web, carrying out pre-development exercises evaluating how the planned approach fits into research and development goals and supports stakeholder values, and encouraging research directions beyond ever larger language models.
Checked 2026-11-22 · 3 references not checked yet
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 5×
“[39] in particular noted that training on a large dataset and fine-tuning for specific tasks leads to strictly increasing results on the GLUE tasks [138] for English as the hyperparameters of the model were increased.”
BackgroundMethodResultInfluentialGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 4×
“documents linked to from Reddit [25], plus Wikipedia and a collection”
BackgroundMethodInfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 1×
“[26, 58], quantization [118, 153], factorized embedding parameterization and cross-layer parameter sharing [70], and progressive module replacing [146].”
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
The Mathematical Theory of Communication
Shannon, C. E., Weaver, W., & Wiener, N. (1950) · Physics Today · doi:10.1063/1.3067010 · Cited by 9,801
Research works printed but not linked: 48
- [4] American Psychological Association. 2019. Discrimination: What it is, and how to cope. https://www.apa.org/topics/discrimination (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [15] Ruha Benjamin. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. Polity Press, Cambridge, UK. Crossref Google Scholar
- [16] Elettra Bietti and Roxana Vatanparast. 2020. Data Waste. Harvard International Law Journal 61 (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.1016/0010-0277(86) · doi:10.1016/0010-0277(86
- [38] Terrance de Vries, Ishan Misra, Changhan Wang, and Laurens van der Maaten. 2019. Does object recognition work for everyone?. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 52--59. Google Scholar
- 10.18653/v1 · DOI
- [42] Ethan Fast, Tina Vachovsky, and Michael Bernstein. 2016. Shirtless and Dangerous: Quantifying Linguistic Signals of Gender Bias in an Online Fiction Writing Community. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 10. Google Scholar
- 10.18653/v1 · DOI
- [45] Darja Fišer, Ruihong Huang, Vinodkumar Prabhakaran, Rob Voigt, Zeerak Waseem, and Jacqueline Wernimont (Eds.). 2018. Proceedings of the 2nd Workshop on Abusive Language Online (ALW2). Association for Computational Linguistics, Brussels, Belgium. https://www.aclweb.org/anthology/W18-5100 Google Scholar
- [50] Batya Friedman, Peter H. Kahn, Jr., and Alan Borning. 2006. Value sensitive design and information systems. In Human-Computer Interaction in Management Information Systems: Foundations, P Zhang and D Galletta (Eds.). M. E. Sharpe, Armonk NY, 348--372. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [67] Brendan Kennedy, Drew Kogon, Kris Coombs, Joseph Hoover, Christina Park, Gwenyth Portillo-Wightman, Aida Mostafazadeh Davani, Mohammad Atari, and Morteza Dehghani. 2018. A typology and coding manual for the study of hate-based rhetoric. PsyArXiv. July 18 (2018). Google Scholar
- [77] Marianna Martindale and Marine Carpuat. 2018. Fluency Over Adequacy: A Pilot Study in Measuring User Trust in Imperfect MT. In Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track). Association for Machine Translation in the Americas, Boston, MA, 13--25. https://www.aclweb.org/anthology/W18-1803 Google Scholar
- [81] Douglas M McLeod. 2007. News coverage and social protest: How the media's protect paradigm exacerbates social conflict. Journal of Dispute Resolution (2007), 185. Google Scholar
- [87] Robert C. Moore and William Lewis. 2010. Intelligent Selection of Language Model Training Data. In Proceedings of the ACL 2010 Conference Short Papers. Association for Computational Linguistics, Uppsala, Sweden, 220--224. https://www.aclweb.org/anthology/P10-2041 Google Scholar
- 10.18653/v1 · DOI
- [92] Maggie Nelson. 2015. The Argonauts. Graywolf Press, Minneapolis. Google Scholar
- 10.18653/v1 · DOI
- [96] David Ortiz, Daniel Myers, Eugene Walls, and Maria-Elena Diaz. 2005. Where do we stand with newspaper data? Mobilization: An International Quarterly 10, 3 (2005), 397--419. Google Scholar
- 10.3115/v1 · doi:10.3115/v1
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [106] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9. Google Scholar
- 10.18653/v1 · DOI
- [109] Sarah T. Roberts, Joel Tetreault, Vinodkumar Prabhakaran, and Zeerak Waseem (Eds.). 2019. Proceedings of the Third Workshop on Abusive Language Online. Association for Computational Linguistics, Florence, Italy. https://www.aclweb.org/anthology/W19-3500 Google Scholar
- [112] Corby Rosset. 2020. Turing-NLG: A 17-billion-parameter language model by Microsoft. Microsoft Blog (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [121] Joonbo Shin, Yoonhyung Lee, and Kyomin Jung. 2019. Effective Sentence Scoring Method Using BERT for Speech Recognition. In Asian Conference on Machine Learning. 1081--1093. Google Scholar
- [124] Karen Spärck Jones. 2004. Language modelling's generative model: Is it rational? Technical Report. Computer Laboratory, University of Cambridge. Google Scholar
- [127] Katrina Srigley and Lorraine Sutherland. 2019. Decolonizing, Indigenizing, and Learning Biskaaybiiyang in the Field: Our Oral History Journey1. The Oral History Review (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [150] Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. In Advances in neural information processing systems. 5753--5763. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
Cited by
Items 6,701–6,800 of 6,931
Amponsah, C., Kyiewu, B., Yiadom, C. B., & Oppong-Asante, A. (2026) · SAP Social AI · doi:10.62486/sai2026101
F lexico : Machine Translation Sustainability via Self-Adaptation
Casimiro, M., Romano, P., de Souza, J. G. C., Khan, A. M., & Garlan, D. (2026) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3843772
The Geopolitics of Artificial Intelligence
Babic, B., & Wong, B. Y. S. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009731904 · Cited by 2
Chincholikar, S., & Chawla, R. (2026) · Research Square · doi:10.21203/rs.3.rs-10721656/v1
Looking back to look ahead: a BERTopic-assisted scoping review of Medical Humanities (2000–2025)
Yin, L. (2026) · Medical Humanities · doi:10.1136/medhum-2025-013682 · Cited by 1
Generative AI in peer review: evolving policies and regulatory pathways for scientific rigour
Jozaghi, E. (2026) · AI and Ethics · doi:10.1007/s43681-026-01394-8
“Manuscripts under review are typically treated as privileged documents, and using external AI platforms may involve uploading proprietary or unpublished content into systems that are not governed by the journal's data protection policies or intellectual property policies (COPE, 2023) [2, 13, 16].”
InfluentialArtificial Intelligence and Women's Inclusion in HRM
Ghosh, A., Mondal, P., & Choudhary, K. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-7370-6.ch002
Ossa, M. S. L., & Ríos, A. C. H. (2026) · Revista Multidisciplinaria Voces de América y el Caribe · doi:10.69821/remuvac.v3i2.332
Ferreira, J. C., & Rosa, I. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1865568 · Cited by 4
“Benchmark studies report substantial performance on examination-style questions (49, 61, 62, 73, 74); however, safety-relevant failure modes include hallucinated references and overconfident incorrect reasoning (5, 6, 43, 44).”
InfluentialSacco, F. (2025) · Fides Ratio et Patria Studia Toruńskie · doi:10.56583/frp.3264
Binary Biases: Detecting Hate Speech in the Era of Artificial Intelligence
Agrawal, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-4642-7.ch005
Tinkering with social tinkering
Chater, N., & Christiansen, M. H. (2026) · Behavioral and Brain Sciences · doi:10.1017/s0140525x26106621 · Cited by 1
Interviewing Silicon Experts: A Persona-Based LLM Interview Pipeline in Automated Driving
Fang, Y., Bazilinskyy, P., & Martens, M. (2026) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3828158.3838221
Akdağ, U., & Kılıç, M. (2026) · Anadolu Journal Of Educational Sciences International · doi:10.18039/ajesi.1705730
Reading data against the training window: A conceptual framework for archival records in AI
Acker, A. (2026) · Cambridge Forum on AI Culture and Society · doi:10.1017/cfc.2026.10032
Jędrzejowicz, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36868-3_1
The paradox of pleasing: therapeutic recognition and the limits of conversational AI
Haber, Y., Refoua, E., Elyoseph, Z., & Yinon, D. (2026) · AI & Society · doi:10.1007/s00146-026-03348-4
Malik, F. S. (2026) · AI and Ethics · doi:10.1007/s43681-026-01396-6
Echoes of Radha in the Machine:
Sharma, J. (2026) · Dia-noesis. · doi:10.12681/dia.46981
Constructing AI power: anthropomorphising imaginaries of generative AI by AI companies
Glawatzki, A. (2026) · AI & Society · doi:10.1007/s00146-026-03367-1
Koutsotasios, C. A., & Vavouras, E. (2026) · Dia-noesis. · doi:10.12681/dia.46970
Mihăluţe, E., & Mititelu, N.-R. (2026) · Buletinul Institutului Politehnic din Iaşi. Secţia Construcţii de maşini/Buletinul Institutului Politehnic din Iaşi, Secţia Construcţii de maşini · doi:10.2478/bipcm-2026-0028
“…impartiality recur across benchmark and human-evaluation studies alike, and the ethical dimension in particular carries an established motivation: Bender et al. (2021) set out the risks of scale in language models, and Weidinger et al. (2021) organised the ethical and social harms into a…”
Lekshmi, R. I. (2026) · Dia-noesis. · doi:10.12681/dia.46973
“Their outputs are derived from training data rather than real-time engagement with the world (Bender et al., 2021).”
Paul, S. (2026) · IEEE International Conference on Instrumentation (INSTCon) · doi:10.1109/instcon69741.2026.11691738
Listening Not Telling: Intentional Interattentionality as the Practice of Human-AI Interaction
Ager, M. A., & Ager, E. O. (2026) · Postdigital Science and Education · doi:10.1007/s42438-026-00694-w
Umgang mit Sprachmodellen (Large Language Models)
Siebertz, K. (2026) · Springer eBooks · doi:10.1007/978-3-662-74590-8_2
CHABI, O. M., Dadjo, S. D.-D. Y., & Hakibou, A. (2026) · Akofena revue scientifique des Sciences du Langage Lettres Langues & de la Communication · doi:10.48734/akofena.n021.vol.5.25.2026
Engineered approval: a critical discourse analysis of sycophancy in RLHF-trained language models
Ahmed, H., & Bhatia, S. (2026) · AI & Society · doi:10.1007/s00146-026-03350-w
Park, T., Kang, J., & Kim, K. (2026) · Education Sciences · doi:10.3390/educsci16091574
Powell, A., Huber-Kralj, N., Ufeoshi, G. I., Proverbio, D., Buscemi, A., Tarzi, C., Han, T. A., Lió, P., & Stefano, A. D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39028-8_19 · Cited by 1
Daudu, B. O., & Usman, S. (2026) · Dia-noesis. · doi:10.12681/dia.46969
CHABI, O. M., Dadjo, S. D.-D. Y., & Hakibou, A. (2026) · Akofena revue scientifique des Sciences du Langage Lettres Langues & de la Communication · doi:10.48734/akofena.n021.vol.6.16.2026
MUHASEBE BİLGİSİNİN ONTOLOJİK DÖNÜŞÜMÜ: YAPAY ZEKÂ ÇAĞINDA FİNANSAL GERÇEĞİN TEMSİLİ
Keskin, M., & Aktaş, M. A. (2026) · Muhasebe ve Denetime Bakış · doi:10.55322/mdbakis.1884401
Ramazan, O., & Lee, D. K. L. (2026) · Psychology International · doi:10.3390/psycholint8030062
Educator AI Literacy as Praxis in GenAI-Supported ESP Materials DevelopmentPreprint
Uwosomah, E. E., & Oseh, A. K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7490579
Akinwumi, P. O., & Qian, M. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1934329
“This hybrid approach allowed for controlled analysis of linguistic quality and pedagogical fairness, in line with emerging best practices in responsible NLP (Bender et al., 2021).”
362Chapter 14 The Question of Creativity After Generative AI
Brossi, L. (2026) · De Gruyter eBooks · doi:10.1515/9783111193991-015
Gómez, G. M., & Torres, A. G. (2026) · Synthese · doi:10.1007/s11229-026-05807-3
“There is a striking gap between their underlying architecture—probabilistic token-prediction mechanisms (Bender et al., 2021)—and their conversational performance, in which they are often experienced as making assertions (Connolly, 2025).”
Zhou, C., Wu, H., Li, G., & CHEN, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1915597
“Critical AI scholarship further shows that large language models may generate fluent but unreliable outputs, reproduce biases, and obscure the social and material conditions under which AI systems are produced (Bender et al., 2021; Crawford, 2021).”
Lagas, N., & Reuter, S. Z. (2026) · Sociology Compass · doi:10.1111/soc4.70251
Artificial intelligence as a tool for increasing the capacity of civil society organizations
Череп, А. В., & Antolik, O. M. (2026) · Journal of management economics and technology · doi:10.69803/3083-6034-2026-3-377
"Even with AI, We Still Have to Work Harder": Black Women’s Use of Generative AI in the Workplace
Rabaan, H., Rankin, Y. A., Sisco, S., Irish, I., & Erete, S. L. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816930
Salman, H., Ahmad, M. A., Ibrahim, R. B., & Mahmood, J. (2026) · IEEE Access · doi:10.1109/access.2026.3736880
“It produces fluent, knowledge-like text by predicting likely word sequences from patterns in training data, not by retrieving evidence from sources that can be checked [2], [3].”
Bhat, M. A. (2026) · Digital studies in language and literature · doi:10.1515/dsll-2026-0021
“Consistent with Bender et al. (2021), the fi ndings demonstrate that AI-driven language systems perpetuate broader social hierarchies because they are trained on historically uneven linguistic and cultural data (Bommasani et al. 2021).”
InfluentialLLMS AND THEIR BENEFIT IN EDUCATION
Oliver, W. (2026) · Journal of ExoTechnology and Education · doi:10.36615/cywsbj56
“Bender et al. (2021) refer to LLMs as systems that generate text which is based on probabilities, without having communicative intent or being able to understand meaning.”
Processes of Learning in Contexts: Reflections from Journal Co-Editors
Ma, J. Y., & Vossoughi, S. (2026) · Cognition and Instruction · doi:10.1080/07370008.2026.2732558
“…tied in part to the flattening or black-boxing of such learning processes, whether through large language models reproducing Western normativity as neutral knowledge (Bender et al., 2021), or through the replacement and undermining of educa-tive practices such as developing first drafts of writing.”
Clever But Not Wise: The Limits of AI and the Space of the Human
Wilby, M. (2026) · Human Affairs · doi:10.1515/humaff-2026-0023
“For instance, thought experiments such as John Searle ’ s ‘ Chinese Room ’ (Searle 1980), or Emily Bender ’ s ‘ Stochastic Parrots ’ (Bender et al. 2021) bring to the fore underlying philosophical doubts about the naturalisation of meaning.”
The Reversed Turing Test: Measuring Superhuman AI Performance Beyond Imitation
León, M. (2026) · WSEAS TRANSACTIONS ON COMPUTER RESEARCH · doi:10.37394/232018.2026.14.53
Quando a máquina se engana: a ambiguidade criativa das “Alucinações” em IA Generativa
de Souza, N. (2026) · Revista Ibero-americana de Criatividade e Inovação · doi:10.68087/recriai.v7.151
Making up with parrots: A critical praise of machine learning agency
Jaton, F., & Lenglet, M. (2026) · Big Data & Society · doi:10.1177/20539517261481720
Balayn, A., Rancourt, F., Casati, F., & Gadiraju, U. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816909
“Socially, they can cause diverse harms if not developed responsibly [17, 130, 150].”
On a Misleading Ethical Fluency in Language Models: Reply to Danagher
Metcalf, T. R. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01201-6 · Cited by 1
Gonçalves, K. P. F. (2026) · Nexus Science Review · doi:10.66104/027mff80
Rustamov, Z., Pashayev, M. A., Jafarov, S., Aslanli, U., Mammadov, A., Valizada, A., & Rustamov, S. (2026) · Journal of Advances in Information Technology · doi:10.12720/jait.17.9.1716-1723
“Prior work has documented risks related to hallucination, inconsistent behavior, and lack of transparency in generative models, particularly when applied to high-stakes decision-making contexts [6, 17].”
Al-Saqaf, W. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9190-8.ch018
Representation Control for Large Language Models: Survey and Research Challenges
Bartoszcze, Ł., Munshi, S., Sukidi, B., Yen, J., Yang, Z., Williams-King, D., Le, L., & Maple, C. R. (2026) · ACM Computing Surveys · doi:10.1145/3846173 · Cited by 1
Resilience in AI-Driven News Ecosystems: The Tunis Afrique Presse and ANSA Partnership
Zayati, N. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9190-8.ch002
Kostihová, M., Makarevitch, I., & Hilk, C. L. (2026) · Digital education and learning · doi:10.1007/978-3-032-32152-7_2
A Framework for Explainable Reasoning, Planning, and Action in LLM-Based Autonomous AI Agents
Rao, T. V. N., Seeta, A., Bhavana, S., & Divyasri, K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9129-8.ch011
Çiftçi, E. N., & YEŞİLYURT, M. (2026) · Dinbilimleri Akademik Araştırma Dergisi · doi:10.33415/daad.1961442 · Cited by 1
Which AI? A Comparative Evaluation of Generative AI and Neuro‐Symbolic AI for Silicon Sampling
Zahradníčková, K., Polišenský, J., Lukeš, M., Hranický, R., & Pouč, P. (2026) · Psychology and Marketing · doi:10.1002/mar.70272 · Cited by 1
Guidance over guidelines? Unpacking the uses and concerns of generative AI in communication science
Ho, J. C., Cools, H., Strycharz, J., Möller, A. M., van Berlo, Z. M. C., Stolwijk, S. B., Trilling, D., & Araujo, T. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2736810 · Cited by 1
Les grands modèles de langue : bilan et perspectives pour la linguistique
Poibeau, T. (2026) · Langages · doi:10.3917/lang.243.0073
Abduction In Silico: Large Language Models Replicate Human Inference to the Best Explanation
Douven, I. (2026) · Minds and Machines · doi:10.1007/s11023-026-09803-x
“…explanations tend to co-occur with acceptance and weak ones with rejection—the contamination check provides some evidence against a “stochastic parrot” (Bender et al., 2021) reading of LLMs: the same qualitative effects emerge on new scenarios that could not have appeared in any training corpus,…”
Metamorphic Tools and Human Creativity: Why AI Cannot Create
Laurent, C. D. S. (2026) · Palgrave studies in creativity and culture · doi:10.1007/978-3-032-34404-5_3
Nelli, A. V., Battur, R., Mangasuli, S. M., Tangod, K. K., Deshpande, S. B., & Abate, J. (2026) · Applied Computational Intelligence and Soft Computing · doi:10.1155/acis/6216386
Mushi, R. T. (2026) · The International Information & Library Review · doi:10.1080/10572317.2026.2735044
Ghaywat, V., Singh, A., Shahade, A. K., Khan, W., & Deshmukh, P. V. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02373-y
Digital mediations and artificial intelligence in the social appropriation of scientific knowledge
Zambrano, G. L. P., & Salazar-Alvarado, A. A. (2025) · Buckingham English Center · doi:10.66836/linguatech.v2n1.hjkf
Maass, W., Liddle, S. W., & Storey, V. C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-40377-3_4
Svítek, M., & Жак, Л. (2026) · Theoretical economics · doi:10.52957/2221-3260-2026-7-46-62
Sblendorio, E., Dentamaro, V., Maria, M. D., Tempesta, S., Barile, E., Napolitano, D., Tallini, M., Nigrelli, D., Cicolini, G., & Piredda, M. (2026) · JMIR Medical Informatics · doi:10.2196/90854
Synthetic Scenario Methodology (SSM): An AI-Driven Approach for Strategic Business Insights
Andoniou, C. (2026) · Studies in big data · doi:10.1007/978-3-032-19498-5_20
Conceição, M. M. (2026) · Coleção Pesquisa em Educação Física · doi:10.47820/cpef.8e0yz594
Technofeminist Human-Centric AI in the Context of Conversational Large Language Models
Balontia, M. J., & Iskandar, I. F. R. (2026) · International Conference on Information Management and Technology (ICIMTech) · doi:10.1109/icimtech202671078.2026.11698952
From the platform society to the AI society
Törnberg, P., & Uitermark, J. (2026) · Dialogues on Digital Society · doi:10.1177/29768640261487931 · Cited by 3
LLMs in Discourse Analysis and Production: A Systematic Review through the Lens of Appraisal Theory
Tzanoulinou, D., Triantafyllopoulos, L., Vorvilas, G., Paxinou, E., Kalles, D., & Verykios, V. S. (2026) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa71656.2026.11705531
Stochasticity-Induced Unreliability in LLM-Based Hiring Systems
Giri, A., Bhat, K., Nehal, G., & H, M. K. (2026) · IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT) · doi:10.1109/conecct68978.2026.11700588
Combinatorial Capture: Generative AI and the Displacement of Transformational Creative Work
Dalsgaard, P. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829905
Zyvaristin, C. F., Elbeelya, D., Rachmadany, H. A., & Rudy (2026) · International Conference on Information Management and Technology (ICIMTech) · doi:10.1109/icimtech202671078.2026.11699059
“Evidence shows that although AI could help improve cognition through providing explanations, users are likely to reduce their critical evaluation behavior due to automation of the cognitive tasks [6].”
InfluentialAlomair, G., & Salem, M. A. (2026) · Algorithms · doi:10.3390/a19100832 · Cited by 1
Selective Extraction: A Hallucination-Free Approach to LLM-Based Document Information Extraction
Rao, V., Saraogi, Y., Reddy, T., & Purohit, M. V. (2026) · IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT) · doi:10.1109/conecct68978.2026.11700668
The architecture of anomaly: agential errancy in human-AI relations
Gruber, D., & Conley, D. S. (2026) · Critical Studies in Media Communication · doi:10.1080/15295036.2026.2733988
ArtiQ: An Artist-in-the-Loop Chatbot for Question Answering in Art Galleries
Liu, J., Law, E. L., & Shum, H. P. H. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829831
Alnajashi, A. A., Tharayil, S. M., & Alghamdi, M. (2026) · SPE Gulf Oil and Gas Technology Conference (GOTECH) · doi:10.2118/232280-ms
When GenAI Negotiates Like Humans: Evidence of the Anchoring Bias in Large Language Models’ Outputs
Maaravi, Y., & Gur, T. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2732484
Missing context: a review of natural language processing for archives
Dunagan, L., Johnston, J., & Card, D. (2026) · Cambridge Forum on AI Culture and Society · doi:10.1017/cfc.2026.10031
Carreras, B. N., Rudaz, D., Due, B. L., Merlino, S., & Hirvonen, M. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829845 · Cited by 1
Generative AI and Classical Chinese Moon Imagery in Translation
Xu, Z. (2026) · Journal of Computer Science and Artificial Intelligence · doi:10.54097/advtk584
“Recent studies have warned that language models are powerful pattern-based systems whose outputs may reproduce fluent but culturally simplified language [1].”
McCabe, S. A., Damas, S. H., & Romero, C. D. P. (2026) · Communication & Society · doi:10.15581/003.39.2.016
Ilomuanya, S. E., Oladosu, M. A., MUSTAPHA, T. O., & Abah, M. A. (2026) · International Journal of Soft Computing and Engineering · doi:10.35940/ijsce.e3728.16051126
StereoSet-PT: The Stereotype Evaluation Framework for Brazilian Portuguese Language Models
Aleixo, D. S., Costa, R. P., Pellicer, L. F. A. O., & de Almeida, R. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39882-6_46
Al-Bayati, Y. S. S. (2026) · Vestnik Volgogradskogo gosudarstvennogo universiteta Serija 2 Jazykoznanije · doi:10.15688/jvolsu2.2026.3.12
“Scholars such as Floridi [Floridi, 2023] and Bender et al. warn that without clear frameworks for attribution and ethical disclosure, AI-mediated discourse may blur the boundaries between fabrication and fact [Bender et al., 2021].”
Vaz, J. C., Kersting, N., Campagnucci, F., et al. (2026) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg70169.2026.11695539
CRISP-ML(QS): Embedding Sustainability in AI-ML Development Lifecycle
Garg, S., & Mittal, G. (2026) · International Journal of Mathematical Engineering and Management Sciences · doi:10.33889/ijmems.2026.11.5.083
Duarte-Martínez, V., Cobo, M. J., & Mendoza, J. N. (2026) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg70169.2026.11695401
Abouzeid, E., & Sallam, M. A. (2026) · Medical Science Educator · doi:10.1007/s40670-026-02909-y
Metadata
- Authors
- Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S.
- Affiliations
- University of Washington (US)
- Black in AI, Palo Alto, CA, USA
- The Aether
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 610-623
- OpenAlex
- W3133702157
- Cited by
- 6,988
- References
- 117
- Citations by year
- 2026: 2484 · 2025: 1887 · 2024: 1153 · 2023: 842 · 2022: 384 · 2021: 229
- FWCI
- 300.72
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- Creighton Digital Repository (CDR) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- large language models, model size, AI risks, financial costs, data curation, dataset documentation, stakeholder value, BERT, GPT, fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.