On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Open accessThe DOI matches its Crossref record; 156 of the 159 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
The past 3 years of work in NLP have been characterized by the development and deployment of ever larger language models, especially for English. BERT, its variants, GPT-2/3, and others, most recently Switch-C, have pushed the boundaries of the possible both through architectural innovations and through sheer size. Using these pretrained models and the methodology of fine-tuning them for specific tasks, researchers have extended the state of the art on a wide array of tasks as measured by leaderboards on specific benchmarks for English. In this paper, we take a step back and ask: How big is too big? What are the possible risks associated with this technology and what paths are available for mitigating those risks? We provide recommendations including weighing the environmental and financial costs first, investing resources into curating and carefully documenting datasets rather than ingesting everything on the web, carrying out pre-development exercises evaluating how the planned approach fits into research and development goals and supports stakeholder values, and encouraging research directions beyond ever larger language models.
Checked 2026-11-22 · 3 references not checked yet
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 5×
“[39] in particular noted that training on a large dataset and fine-tuning for specific tasks leads to strictly increasing results on the GLUE tasks [138] for English as the hyperparameters of the model were increased.”
BackgroundMethodResultInfluentialGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 4×
“documents linked to from Reddit [25], plus Wikipedia and a collection”
BackgroundMethodInfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 1×
“[26, 58], quantization [118, 153], factorized embedding parameterization and cross-layer parameter sharing [70], and progressive module replacing [146].”
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
The Mathematical Theory of Communication
Shannon, C. E., Weaver, W., & Wiener, N. (1950) · Physics Today · doi:10.1063/1.3067010 · Cited by 9,801
Research works printed but not linked: 48
- [4] American Psychological Association. 2019. Discrimination: What it is, and how to cope. https://www.apa.org/topics/discrimination (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [15] Ruha Benjamin. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. Polity Press, Cambridge, UK. Crossref Google Scholar
- [16] Elettra Bietti and Roxana Vatanparast. 2020. Data Waste. Harvard International Law Journal 61 (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.1016/0010-0277(86) · doi:10.1016/0010-0277(86
- [38] Terrance de Vries, Ishan Misra, Changhan Wang, and Laurens van der Maaten. 2019. Does object recognition work for everyone?. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 52--59. Google Scholar
- 10.18653/v1 · DOI
- [42] Ethan Fast, Tina Vachovsky, and Michael Bernstein. 2016. Shirtless and Dangerous: Quantifying Linguistic Signals of Gender Bias in an Online Fiction Writing Community. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 10. Google Scholar
- 10.18653/v1 · DOI
- [45] Darja Fišer, Ruihong Huang, Vinodkumar Prabhakaran, Rob Voigt, Zeerak Waseem, and Jacqueline Wernimont (Eds.). 2018. Proceedings of the 2nd Workshop on Abusive Language Online (ALW2). Association for Computational Linguistics, Brussels, Belgium. https://www.aclweb.org/anthology/W18-5100 Google Scholar
- [50] Batya Friedman, Peter H. Kahn, Jr., and Alan Borning. 2006. Value sensitive design and information systems. In Human-Computer Interaction in Management Information Systems: Foundations, P Zhang and D Galletta (Eds.). M. E. Sharpe, Armonk NY, 348--372. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [67] Brendan Kennedy, Drew Kogon, Kris Coombs, Joseph Hoover, Christina Park, Gwenyth Portillo-Wightman, Aida Mostafazadeh Davani, Mohammad Atari, and Morteza Dehghani. 2018. A typology and coding manual for the study of hate-based rhetoric. PsyArXiv. July 18 (2018). Google Scholar
- [77] Marianna Martindale and Marine Carpuat. 2018. Fluency Over Adequacy: A Pilot Study in Measuring User Trust in Imperfect MT. In Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track). Association for Machine Translation in the Americas, Boston, MA, 13--25. https://www.aclweb.org/anthology/W18-1803 Google Scholar
- [81] Douglas M McLeod. 2007. News coverage and social protest: How the media's protect paradigm exacerbates social conflict. Journal of Dispute Resolution (2007), 185. Google Scholar
- [87] Robert C. Moore and William Lewis. 2010. Intelligent Selection of Language Model Training Data. In Proceedings of the ACL 2010 Conference Short Papers. Association for Computational Linguistics, Uppsala, Sweden, 220--224. https://www.aclweb.org/anthology/P10-2041 Google Scholar
- 10.18653/v1 · DOI
- [92] Maggie Nelson. 2015. The Argonauts. Graywolf Press, Minneapolis. Google Scholar
- 10.18653/v1 · DOI
- [96] David Ortiz, Daniel Myers, Eugene Walls, and Maria-Elena Diaz. 2005. Where do we stand with newspaper data? Mobilization: An International Quarterly 10, 3 (2005), 397--419. Google Scholar
- 10.3115/v1 · doi:10.3115/v1
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [106] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9. Google Scholar
- 10.18653/v1 · DOI
- [109] Sarah T. Roberts, Joel Tetreault, Vinodkumar Prabhakaran, and Zeerak Waseem (Eds.). 2019. Proceedings of the Third Workshop on Abusive Language Online. Association for Computational Linguistics, Florence, Italy. https://www.aclweb.org/anthology/W19-3500 Google Scholar
- [112] Corby Rosset. 2020. Turing-NLG: A 17-billion-parameter language model by Microsoft. Microsoft Blog (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [121] Joonbo Shin, Yoonhyung Lee, and Kyomin Jung. 2019. Effective Sentence Scoring Method Using BERT for Speech Recognition. In Asian Conference on Machine Learning. 1081--1093. Google Scholar
- [124] Karen Spärck Jones. 2004. Language modelling's generative model: Is it rational? Technical Report. Computer Laboratory, University of Cambridge. Google Scholar
- [127] Katrina Srigley and Lorraine Sutherland. 2019. Decolonizing, Indigenizing, and Learning Biskaaybiiyang in the Field: Our Oral History Journey1. The Oral History Review (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [150] Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. In Advances in neural information processing systems. 5753--5763. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
Cited by
Items 6,401–6,500 of 6,931
The Hallucinated Subjects: Gender, Coherence, and the Ontological Politics of Generative AI
Brooke, S., & Pandiani, D. S. M. (2026) · Oxford University Press eBooks · doi:10.1093/9780198960256.003.0045
Adam, A., Georgiou, K., & Angelis, L. (2026) · Businesses · doi:10.3390/businesses6030043 · Cited by 1
“Because the generated content is intended for hiring contexts, bias and fairness are material concerns (Bender et al., 2021).”
The Greater Threat is already Here: Prioritising Present-day Risks in AI Development and DeploymentPreprint
Agadi, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7266440
Practical Implementation of AI Governance and Guardrail Agents for Enterprise Applications
Pham, D. N., Lukose, D., & Shi-Nash, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-12201-8_12 · Cited by 1
李, 凯., & 卿, 琳. (2025) · 嶺南科學工業學報 · doi:10.67298/paper/660001
Decolonizing Writing Instruction in the Age of AI
Gruber, S., & Barrón, N. G. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7837-4.ch006
di Padova, M., Guerriero, M. A., Ruberto, M., Moscatelli, F., Mancini, N., Monda, M., Messina, G., Polito, R., & Colecchia, F. P. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-31853-4_12
Odejide, G. S. (2023) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/ijsrset26132152 · Cited by 6
Cognitive Entanglements: A Postphenomenological Approach to Generative AI in Education
Stefano, L. D. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-31853-4_22 · Cited by 1
Влияние использования систем ИИ на учебную мотивацию студентов: риск снижения самостоятельности
Асманова, П. Д., Быстров, И. А., & Alexeeva, T. V. (2025) · Management of Education · doi:10.25726/j1063-9756-7276-d
Искусственный интеллект в образовании: аспекты регулирования и этики
Анатольевна, Р. О. (2026) · Management of Education · doi:10.25726/b2556-9307-3484-u
Artificial Intelligence in Cyberpsychology
Boch, A., & Cook, D. (2026) · Springer eBooks · doi:10.1007/978-3-031-52643-5_262-1
Zwischen Textproduktion und Urteilskraft
Schmitz, L., & Belting, J. (2026) · merz | medien + erziehung · doi:10.21240/merz/2026.4.17
Buddhist, Yogic, and Vedic Contemplative Principles in AI Model Prompting: A Pilot StudyPreprint
Haberlin, S., Tiwari, S., & Jahani, S. (2026) · Research Square · doi:10.21203/rs.3.rs-10710275/v1
ChatGPT in the literature: A bibliometric analysis
Arık, M. A., Yalman, A., LİVBERBER, T., Aydoğan, H., Şeker, T., & Şeker, M. (2026) · Journal of Information Science · doi:10.1177/01655515261476215
Anthropomorphism as relational infrastructure in human–AI chatbot interaction (HAICI)
Zeriouh, L. (2026) · Human Organization · doi:10.1080/00187259.2026.2712941
Jeong, Y., & Ahn, S. (2026) · The Journal of Korean Association of Computer Education · doi:10.32431/kace.2026.29.7.002
Gupta, S., Gupta, S., Nyamasvisva, T. E., Srivastava, A. P., Tiwari, K., & Sharma, R. (2026) · International Conference on Sustainable Computing and Integrated Communication in Changing Landscape of AI (ICSCAI) · doi:10.1109/icscai68849.2026.11648599
Özergin, B. (2026) · Springer eBooks · doi:10.1007/978-3-658-51525-6_52
AI in Children’s Lives: Critical Questions and Concepts
Siibak, A., & Mascheroni, G. (2026) · Studies in childhood and youth · doi:10.1007/978-981-95-8922-7_1
How Reflection Enhances Task Factuality in the Use of Large Language Models
Tarafdar, M., Adam, M., & Nguyen, L. T. (2026) · Journal of Management Information Systems · doi:10.1080/07421222.2026.2692283 · Cited by 2
“LLMs, underlying applications 1 such as ChatGPT and Gemini respond to human prompts in human-like ways by generating word sequences through word associations learned from vast databases of text [16, 31].”
Al-Humaimeedy, A. S. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1017056
Research on Simplified Design of Interface Interaction Process Based on TRIZ and Generative AI
Li, M., Liu, S., Wu, B., Zhao, X., & Ning, Z. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2705084
Prompt Engineering for Academics: Real-world Application
Sinha, E., Chandra, S., & Waghmare, C. D. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83742-179-420261005
Crafting Effective Prompts: Thinking with Machines Not Just Talking to Them
Sinha, E., Chandra, S., & Waghmare, C. D. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83742-179-420261002
A recognition-based framework for human–robot relationships
Hoshino, J. (2026) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2026.100382
Gupta, S., Gupta, S., Nyamasvisva, T. E., Srivastava, A. P., Sharma, A., & Tiwari, K. (2026) · International Conference on Sustainable Computing and Integrated Communication in Changing Landscape of AI (ICSCAI) · doi:10.1109/icscai68849.2026.11648628
153Künstliche Autorschaft : Modes of AI-Assisted Writing in German-Language Literature
Becker, J. (2026) · De Gruyter eBooks · doi:10.1515/9783112264935-008
Cardozo, J. I. L. (2026) · De Gruyter eBooks · doi:10.1515/9783112237687-002
Agustin, M. C. (2026) · New Directions for Student Leadership · doi:10.1002/yd.70066
“Under these conditions, authority is not transferred to machines but resi-tuated within sociotechnical systems shaping how judgments are produced, interpreted, and defended, often without explicit institutional acknowledgment (Bender et al. 2021 ; Frimpong 2025 ).”
Лукьяненко, Д., Алигейдаровна, Р. А., Мухорина, А. К., Tyukina, T., & Геннадьевич, З. Д. (2026) · The European Physical Journal Special Topics · doi:10.1140/epjs/s11734-026-02571-w · Cited by 1
Nitsche, T., & Rubart, J. (2026) · Mensch und Computer (MuC) · doi:10.1145/3820253.3831386
Acceptable English, Vanishing Voice: AI Polishing and the South- North Politics of Academic Style
Rahmatullah, M. (2026) · Critical Arts · doi:10.1080/02560046.2026.2714805
Pirasteh, S., Hajibagheri, R., Jokar, M., Mohammaddoust, R., Behnamfar, F., Isazade, V., Zarbakhsh, H., Fang, Z., Almazroui, M., Samra, R. M. A., et al. (2026) · Geoscience Frontiers · doi:10.1016/j.gsf.2026.102445
Llm-Based Intelligent Tutor System
Arya, A., Sinha, S., & Makkar, P. (2026) · International Conference on NextGen Data Science and Analytics (ICNDSA) · doi:10.1109/icndsa68777.2026.11652109
“Ethical and design-based approaches deal with responsible implementation of tutors based on LLM, through transparency, fairness, and data safety [16][17][19].”
InfluentialThe Epistemic Engine: A Deterministic Structural Auditor for Institutional Discourse
Concepcion, Y., & Fortino, A. (2026) · doi:10.1109/icetm68138.2026.11648113
Artificial intelligence and the automation of looping effects
Shim, J. (2026) · Philosophical Psychology · doi:10.1080/09515089.2026.2717350
Pulido, C., Gómez, F. A., Tewarie, P. K. B., Hoyer, R. S., & Laureys, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7315140
How should we think about ‘AI’ in educational research?
Tan, M. (2026) · Learning Research and Practice · doi:10.1080/23735082.2026.2715161
“On the other hand, critics have dismissed LLMs as not much more than stochastic parrots (Bender et al., 2021) and, by the nature of their designs, ultimately systems that produce bullshit (Hicks et al., 2024), in that these systems have no model of truth.”
Alvarado, J. E. G., Lagos, J. C. E., & Oyarvide, W. R. V. (2026) · Revista Tribunal · doi:10.59659/revistatribunal.v6i16.521
“Let Me Take That Back”: Designing and Testing Deletion Interfaces for Human-AI Interaction
Szczepaniak, J., Zimmermann, V., & Marky, K. (2026) · Mensch und Computer (MuC) · doi:10.1145/3820253.3820277
Alvario, E. Y. P., Vargas, O. J. H., & Araujo, H. M. R. (2026) · Revista Retos para la Investigación. · doi:10.62465/rri.v5n2.2026.257
Building and Deploying AI Agents and Workflows Using DeepSeek with n8n and Make.com
Rakesh, & Narwal, R. (2026) · International Conference on NextGen Data Science and Analytics (ICNDSA) · doi:10.1109/icndsa68777.2026.11652216
“Challenge: LLMs occasionally generate plausible but factually incorrect content (hallucinations), which can propagate through automated systems and undermine trust [20].”
De‐la‐Rosa‐Martinez, D., & López, S. M. (2026) · Revista Latina de Comunicación Social · doi:10.4185/rlcs-2027-2723
Zhang, Z., Zhang, Y., Lu, X., & Zhang, M. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1910408 · Cited by 2
Nexus: A Multifunctional AI-based Virtual Assistant for Smart System Interaction
Bhardwaj, R., Singh, N., Jain, M., Singhal, G., & Dwivedi, M. (2026) · International Conference on NextGen Data Science and Analytics (ICNDSA) · doi:10.1109/icndsa68777.2026.11652286
Diogo, J. E., & Andrade, C. S. (2026) · AI & Society · doi:10.1007/s00146-026-03332-y
Conscientization, Dialogue, and Praxis: A Critical Pedagogy Framework for AI in K-12 Classrooms
Warr, M., Yalnaty, M. E., Chatterjee, S., Hour, N., Oster, N. J., & Peterson, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7902-9.ch001
Costello, C., Iliescu, M., Pendras, G., Liu, Y., & Ahmed, S. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00492
“When relying on human subjectivity, there is a chance that an individual’s personal bias impacts the final dataset [16].”
Explicit Cognitive Allocation: A Principle for Governed and Reviewable LLM-Assisted Inquiry
Manzanilla-Granados, H. M., Cazales, Z. N., Pescador‐Rojas, M., & Ramírez-Romero, T. A. (2026) · IEEE Access · doi:10.1109/access.2026.3725913
“At the same time, critical work has emphasized that large language models raise concerns related to reliability, accountability, control, social risk, and responsible deployment [4], [5], [6].”
AI-driven Acceleration and the Evaluation Bottleneck in Science: A Conceptual FrameworkPreprint
Rana, P., Varshney, L. R., & Varshney, K. R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7318643
Dai, C., & Eichelberger, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7902-9.ch003
Susan, Ş.-C., Arusoaie, A., & Lucanu, D. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00134 · Cited by 1
Arthur, F., Opoku, E., Gyedu, F. O., Quaye, S. A., Quayson, E., Boateng, E., Nortey, S. A., & Frempong, D. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7902-9.ch004
Begum, F., & Valan, J. A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-0408-1.ch003
Torello, D., & Fennell, J. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--59625
Artificial Intelligence in Christian Religious Education: A Scoping Review
Chrostowski, M. (2026) · Religions · doi:10.3390/rel17080991 · Cited by 3
“…the CRE debate to broader discussions concerning algorithmic bias, sociotechnical fairness, and decolonial approaches to AI (Selbst et al. 2019; Mohamed et al. 2020; Bender et al. 2021) but gives them a specifically theological and catechetical inflexion that deserves dedicated research attention.”
Ali, N. A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7323940
Adaptation machines/machine adaptation: adaptation studies and generative AI
Winckler, R. (2026) · Adaptation · doi:10.1093/adaptation/apag025 · Cited by 1
Morris, C., Chandra, K., Tripathy, S., Arias, O., & Often, E. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--59142
Burns, E. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--59343
Bailey, D. S. (2026) · Human Affairs · doi:10.1515/humaff-2026-0006
“Bender et al. (2021) warn that such systems produce convincing language without grounding, reference, or understanding, i.e., outputs that can easily be mistaken for knowledge.”
Yeung, S., & Gray, J. (2026) · TESOL Quarterly · doi:10.1002/tesq.70208 · Cited by 1
Teaching with (and About) AI: A Convergence–Divergence Framework for Engineering Education
Brown, C. H., Bhada, S. V., McCauley, S. M., Agupusi, P. C., Pavlov, O., Treku, D. N., & Moraffah, R. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--60336
Hila, A. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01168-4 · Cited by 3
“…density of the source material, the distributional representativeness of the corpus across specialized epistemic domains, and the rigor of the curation heuristics used to mitigate the propagation of noise and internal contradictions (Bender et al., 2021; Gunasekar et al., 2023; Rogers, 2023).”
Algorithmic Fairness Audit of an AI Tool for Student Assessment in Industrial Engineering
Carú, R., & Calderón, J. F. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--58675
Ahmed, R. A., Merzougui, L., Silva, M., & Bouzenoun, A. (2026) · Language Awareness · doi:10.1080/09658416.2026.2725956
AI, Writing, and Managerial Judgement: A Case-Based Approach to Communication Pedagogy
Sharma, D., Agrawal, A., & Ahuja, Y. (2026) · Business and Professional Communication Quarterly · doi:10.1177/23294906261478247
Spatola, N., & Cohen, L. (2026) · AI & Society · doi:10.1007/s00146-026-03314-0
Systematic Design of Competency-Based HPC and AI Education for Transport Systems
Somers, C., & González–Vélez, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37218-5_20
Srikusuma, M. K., Noorfriska, S., Nurhikmah, U. O., & Kusumaningtyas, D. (2026) · Jurnal Genesis Indonesia · doi:10.56741/iistr.jgi.002305
“Because generative AI relies on probabilistic language models rather than true understanding, it may occasionally generate information that appears plausible but is factually incorrect or contextually inappropriate [7].”
GRACE: Gradient-Regulated Approach for Consistent Explanations
Basu, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36039-7_33
Perez‐de‐Arriluzea‐Madariaga, A., & Morales-i-Gras, J. (2026) · Journalism and Media · doi:10.3390/journalmedia7030172
“…explainability, and the epistemic risks of automated or semi-automated analysis, especially when language models are used to classify, summarize, or evaluate media content (Bender & Koller, 2020; Bender et al., 2021; Diakopoulos & Koliska, 2017; Cools & Koliska, 2024; Roberts et al., 2024).”
The Migration of Bias in Law: From Human Cognition to Predictive AI System and Large Language Models
Zhong, H. (2026) · Springer eBooks · doi:10.1007/978-3-031-87993-7_185-1 · Cited by 1
Language Activism and Advocacy
Hudley, A. H. C., Mendoza, D. C., Muwwakkil, J., & Harris, M. A. (2026) · Oxford University Press eBooks · doi:10.1093/9780197851463.003.0994
Renda, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01310-0
AI Hallucinations in Academic Writing and Addresses
Liu, Y. (2026) · SHS Web of Conferences · doi:10.1051/shsconf/202623602006
“LLMs provide claims that are confidently made, although the underlying logic is not strong [2, 4].”
Semenova, O. V. (2026) · Исторический журнал научные исследования · doi:10.7256/2454-0609.2026.4.81413
Por uma ética de assemblagem nas conversas com e sobre IA
Buzato, M. (2026) · Trabalhos em Lingüística Aplicada · doi:10.1590/01031813v65020268684209
Ethical Considerations and Transparency in Intelligent Agent Operations
Beshiri, A., Bytyqi, D., & Misini, S. (2026) · International Conference on Circuit, Systems and Communication (ICCSC) · doi:10.1109/iccsc71566.2026.11650040
“Researchers warn of environmental harm, raise concerns about discrimination, highlight the spread of misinformation, and point to the challenge of assigning responsibility when systems are highly autonomous or opaque [4], [22].”
Morton, J. L., & Pocaterra, M. M. (2026) · Research Square · doi:10.21203/rs.3.rs-10657303/v1
Gatekeeping in science reporting: a zetetic account
Subotić, V., & Umeljic, I. (2026) · Synthese · doi:10.1007/s11229-026-05700-z
“Its successful performance depends on vast amounts of (often con - troversially sourced) data and intensive training, which, in turn, demand significant computational resources and electricity (Bender et al., 2021 ).”
Cicatiello, C., & Fusco, P. (2026) · Encyclopedia · doi:10.3390/encyclopedia6090182 · Cited by 1
Is Silicon-Based Life Superior to Carbon-Based Life
Li, K., & Qing, L. (2025) · International Journal of Responsible Artificial Intelligence Research · doi:10.67298/paper/30003
Urgese, S. N., & Darbellay, F. (2026) · World Futures · doi:10.1080/02604027.2026.2722618
Quantifying Semantic Stability in AI-Mediated Emotional Support Environments
Ferrari, D., Iuliano, A., & Felicetti, F. (2026) · IEEE International Workshop on Metrology for Living Environment (MetroLivEnv) · doi:10.1109/metrolivenv70468.2026.11659862
“Embedding-based approaches are increasingly used in natural language processing, sentiment analysis, conversational systems, inter-pretable AI applications, and measurement-oriented studies of semantic representation quality [11]–[13].”
Academic erasure: the disappearance of complexity under AI-supported writing
Nwagboso, C. O., & Atuba, S. (2026) · Teaching in Higher Education · doi:10.1080/13562517.2026.2707601 · Cited by 1
Data security in large language models: risks, defense, and directions
Chen, K., Zhou, X., Yu, Y., Lin, Y., Chen, H., Cai, C., & Shen, L. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01200-9 · Cited by 2
“…based on large-scale uncorrected Internet data, inherited stereotypes, false statements, derogatory and exclusive language, and other defamation behavior, which have a disproportionate impact on vulnerable and marginalized communities (Bender et al. 2021; Dodge et al. 2021; Sheng et al. 2021).”
AI and the Human Brain Highly Consistent Working Principles
Sterling, A. Y. J. (2025) · International Journal of Responsible Artificial Intelligence Research · doi:10.67298/paper/30001
Cicero, F. (2026) · AI-Linguistica Linguistic Studies on AI-Generated Texts and Discourses · doi:10.62408/ai-ling.v6i1.84
Extração de Esquemas em Documentos Legais Não Estruturados Utilizando LLMs
Krzyzaniak, L. A., Duarte, D., Schreiner, G. A., et al. (2026) · doi:10.5753/erbd.2026.21041
Uneven by Design: How Generative AI Interfaces Reinforce Digital Divides Across Modalities
Jung, S., Han, S., Yoo, G. Y., Pasch, S., Ji, Y. G., Kim, H. C., & Cha, M. C. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2719091 · Cited by 2
Kapizov, D., & Kumar, P. (2026) · Scientific Journal of Astana IT University · doi:10.37943/xsaj1029
Colleague Skill: an attempt at distillation and mind uploading
Wang, Y. S. (2026) · AI and Ethics · doi:10.1007/s43681-026-01334-6
Alhalawany, R. M., Khatatbeh, Y. M., & Jawkhab, A. A. (2026) · Healthcare · doi:10.3390/healthcare14172721
Avara, H. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-3840-6.ch009
SARIKAYA, A., & ALPTEKİN, A. (2026) · Work · doi:10.1177/10519815261477742
VectorSec: A Web-Based AI Security Scanner for Systematic Evaluation of LLM Vulnerabilities
Yamin, M. M. (2026) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest70988.2026.00022
Metadata
- Authors
- Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S.
- Affiliations
- University of Washington (US)
- Black in AI, Palo Alto, CA, USA
- The Aether
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 610-623
- OpenAlex
- W3133702157
- Cited by
- 6,988
- References
- 117
- Citations by year
- 2026: 2484 · 2025: 1887 · 2024: 1153 · 2023: 842 · 2022: 384 · 2021: 229
- FWCI
- 300.72
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- Creighton Digital Repository (CDR) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- large language models, model size, AI risks, financial costs, data curation, dataset documentation, stakeholder value, BERT, GPT, fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.