On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Open accessThe DOI matches its Crossref record; 156 of the 159 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
The past 3 years of work in NLP have been characterized by the development and deployment of ever larger language models, especially for English. BERT, its variants, GPT-2/3, and others, most recently Switch-C, have pushed the boundaries of the possible both through architectural innovations and through sheer size. Using these pretrained models and the methodology of fine-tuning them for specific tasks, researchers have extended the state of the art on a wide array of tasks as measured by leaderboards on specific benchmarks for English. In this paper, we take a step back and ask: How big is too big? What are the possible risks associated with this technology and what paths are available for mitigating those risks? We provide recommendations including weighing the environmental and financial costs first, investing resources into curating and carefully documenting datasets rather than ingesting everything on the web, carrying out pre-development exercises evaluating how the planned approach fits into research and development goals and supports stakeholder values, and encouraging research directions beyond ever larger language models.
Checked 2026-11-22 · 3 references not checked yet
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 5×
“[39] in particular noted that training on a large dataset and fine-tuning for specific tasks leads to strictly increasing results on the GLUE tasks [138] for English as the hyperparameters of the model were increased.”
BackgroundMethodResultInfluentialGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 4×
“documents linked to from Reddit [25], plus Wikipedia and a collection”
BackgroundMethodInfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 1×
“[26, 58], quantization [118, 153], factorized embedding parameterization and cross-layer parameter sharing [70], and progressive module replacing [146].”
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
The Mathematical Theory of Communication
Shannon, C. E., Weaver, W., & Wiener, N. (1950) · Physics Today · doi:10.1063/1.3067010 · Cited by 9,801
Research works printed but not linked: 48
- [4] American Psychological Association. 2019. Discrimination: What it is, and how to cope. https://www.apa.org/topics/discrimination (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [15] Ruha Benjamin. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. Polity Press, Cambridge, UK. Crossref Google Scholar
- [16] Elettra Bietti and Roxana Vatanparast. 2020. Data Waste. Harvard International Law Journal 61 (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.1016/0010-0277(86) · doi:10.1016/0010-0277(86
- [38] Terrance de Vries, Ishan Misra, Changhan Wang, and Laurens van der Maaten. 2019. Does object recognition work for everyone?. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 52--59. Google Scholar
- 10.18653/v1 · DOI
- [42] Ethan Fast, Tina Vachovsky, and Michael Bernstein. 2016. Shirtless and Dangerous: Quantifying Linguistic Signals of Gender Bias in an Online Fiction Writing Community. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 10. Google Scholar
- 10.18653/v1 · DOI
- [45] Darja Fišer, Ruihong Huang, Vinodkumar Prabhakaran, Rob Voigt, Zeerak Waseem, and Jacqueline Wernimont (Eds.). 2018. Proceedings of the 2nd Workshop on Abusive Language Online (ALW2). Association for Computational Linguistics, Brussels, Belgium. https://www.aclweb.org/anthology/W18-5100 Google Scholar
- [50] Batya Friedman, Peter H. Kahn, Jr., and Alan Borning. 2006. Value sensitive design and information systems. In Human-Computer Interaction in Management Information Systems: Foundations, P Zhang and D Galletta (Eds.). M. E. Sharpe, Armonk NY, 348--372. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [67] Brendan Kennedy, Drew Kogon, Kris Coombs, Joseph Hoover, Christina Park, Gwenyth Portillo-Wightman, Aida Mostafazadeh Davani, Mohammad Atari, and Morteza Dehghani. 2018. A typology and coding manual for the study of hate-based rhetoric. PsyArXiv. July 18 (2018). Google Scholar
- [77] Marianna Martindale and Marine Carpuat. 2018. Fluency Over Adequacy: A Pilot Study in Measuring User Trust in Imperfect MT. In Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track). Association for Machine Translation in the Americas, Boston, MA, 13--25. https://www.aclweb.org/anthology/W18-1803 Google Scholar
- [81] Douglas M McLeod. 2007. News coverage and social protest: How the media's protect paradigm exacerbates social conflict. Journal of Dispute Resolution (2007), 185. Google Scholar
- [87] Robert C. Moore and William Lewis. 2010. Intelligent Selection of Language Model Training Data. In Proceedings of the ACL 2010 Conference Short Papers. Association for Computational Linguistics, Uppsala, Sweden, 220--224. https://www.aclweb.org/anthology/P10-2041 Google Scholar
- 10.18653/v1 · DOI
- [92] Maggie Nelson. 2015. The Argonauts. Graywolf Press, Minneapolis. Google Scholar
- 10.18653/v1 · DOI
- [96] David Ortiz, Daniel Myers, Eugene Walls, and Maria-Elena Diaz. 2005. Where do we stand with newspaper data? Mobilization: An International Quarterly 10, 3 (2005), 397--419. Google Scholar
- 10.3115/v1 · doi:10.3115/v1
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [106] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9. Google Scholar
- 10.18653/v1 · DOI
- [109] Sarah T. Roberts, Joel Tetreault, Vinodkumar Prabhakaran, and Zeerak Waseem (Eds.). 2019. Proceedings of the Third Workshop on Abusive Language Online. Association for Computational Linguistics, Florence, Italy. https://www.aclweb.org/anthology/W19-3500 Google Scholar
- [112] Corby Rosset. 2020. Turing-NLG: A 17-billion-parameter language model by Microsoft. Microsoft Blog (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [121] Joonbo Shin, Yoonhyung Lee, and Kyomin Jung. 2019. Effective Sentence Scoring Method Using BERT for Speech Recognition. In Asian Conference on Machine Learning. 1081--1093. Google Scholar
- [124] Karen Spärck Jones. 2004. Language modelling's generative model: Is it rational? Technical Report. Computer Laboratory, University of Cambridge. Google Scholar
- [127] Katrina Srigley and Lorraine Sutherland. 2019. Decolonizing, Indigenizing, and Learning Biskaaybiiyang in the Field: Our Oral History Journey1. The Oral History Review (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [150] Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. In Advances in neural information processing systems. 5753--5763. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
Cited by
Items 5,501–5,600 of 6,931
Determining the Educational Neuroscience Literacy of Generative AI
Saygıner, Ş. (2026) · Erzincan Üniversitesi Eğitim Fakültesi Dergisi · doi:10.17556/erziefd.1777914
Between the artefact and the artificial: rethinking artificial intelligence through psychoanalysis
Rossi, C. (2026) · Psychoanalysis Culture & Society · doi:10.1057/s41282-026-00626-4
Kehl, M. S., & Caldas, H. (2026) · International Journal of Applied Psychoanalytic Studies · doi:10.1002/aps.70050
Bakhshi, A. D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6669973
BlogCraft-AI: Intelligent Blog Drafting and Publishing
Sirohi, P., Khalkar, R. G., Medhane, S. P., et al. (2026) · doi:10.1109/etfi68128.2026.11484790
Hu, C., Zhou, W., & Zhu, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-9070095/v1
From Fact Checking to Content Moderation: Inside a Newsroom Faced with Generative AI
Willcox, M. G., Rogers, R., & Koronska, K. (2026) · Springer eBooks · doi:10.1007/978-3-032-11782-3_3
Nikuradze, G. (2026) · The New Economist · doi:10.36962/nec21012026-106
Courting AI: How Brazilian Courts Are Using AI
Belli, L., Nunes, J. L., Curzi, Y., & Medon, F. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009744225.047 · Cited by 1
Fisher-Based Layer-Wise Adaptive Sparsification for Efficient Pruning of Large Language Models
Sun, C., Yu, H., & Li, X. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3689307
“Despite their capabilities, LLMs incur substantial computational overhead[3].”
Santhosh, V. N., Vas, R., Roychowdhury, B., Sakthi, K., & Rahaman, M. (2026) · Research Evaluation · doi:10.1093/reseval/rvag024 · Cited by 1
Triple Justice for Generative AI in Education: Distribution-Representation-Participation
Zhang, R., Hou, X., & Du, Y. (2026) · International Conference on Informatics Education and Computer Technology Applications (IECA) · doi:10.1145/3802133.3802258
Invasive Laboratories: A Critique of Induced Vulnerability in the Retail Atmospherics Literature
Leff, J. (2026) · Philosophy of engineering and technology · doi:10.1007/978-3-032-17371-3_9
Epistemic laundering: generative AI and the naturalization of misrecognition
Kalaitzidis, T. J. (2026) · AI & Society · doi:10.1007/s00146-026-03068-9 · Cited by 2
“Distillation concentrates dominant patterns, and concentration is reified as statistical representativeness (Bender et al. 2021).”
InfluentialCopyright, Privacy, and Ethical Issues of Generative AI
Thoker, Z. A., Marwaha, L., & Jan, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7852-7.ch003 · Cited by 2
Žalnieriūtė, M., & Limantė, A. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009744225.044
Exploring the Impact of Generative AI in Detecting Biases and Discrimination in Job Advertisements
Calabrese, A., Carrino, S., Costa, R. M. D. S., Roberti, E., & Tiburzi, L. (2026) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.70618 · Cited by 2
Trudelle, C., Claramunt, C., Libner, E., & Gonzalès, R. (2026) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi15050193 · Cited by 1
Metaphors in Chinese online news: How is AI represented
ZHANG, H. (2026) · Ampersand · doi:10.1016/j.amper.2026.100269
The Sociology of AI as an Emerging Field: Mapping Tensions and Boundaries
Liu, C. (2026) · Sociology Compass · doi:10.1111/soc4.70201 · Cited by 2
Wang, C.-C., & Tsai, M.-N. (2026) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-026-18272-6
“…quantifies output reliability: where , if a response is returned and contains unsupported or inconsistent content ; 0 , otherwise } Unlike previous NLP studies that assess unsupported content in free-form generation [21, 23], UOR in this work uses explicit rule identifiers and evidence statistics.”
KI und das Ende aller Bildung?
Wilder, N. (2023) · mediendiskurs · doi:10.65409/knnw3237105
Interpreting Omics Data Analysis with Large Language Models for Disease Target and Drug DiscoveryPreprint
XU, Z., Chen, W., Ren, W., Xu, T., Amaechin, S., Khan, R., Chen, Y., Province, M. A., Payne, P., & Li, F. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.04.30.721768 · Cited by 1
A layered strategy for integrating generative AI into practice-led computer programming education
Craig, P., Selig, T., & Wang, L. (2026) · Developing Academic Practice · doi:10.3828/dap.2026.5
Generative AI for Financial Translation: Opportunities and Challenges in Hong Kong
Siu, S. C. (2026) · New frontiers in translation studies · doi:10.1007/978-981-95-4374-8_6
The Operational Dimension: Uses and Applications
Biagini, G. (2026) · Digital education and learning · doi:10.1007/978-3-032-15919-9_3
Inala, R., Sheelam, G. K., Aitha, A. R., Lakshmi, A. U., Nagabhyru, K. C., & Segireddy, A. R. (2026) · IEEE International Conference on AI Engineering and Innovations (AIEI) · doi:10.1109/aiei69164.2026.11497971 · Cited by 3
Feroz, F., & Kunst, J. R. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101285
Do AI know what they know? Exploring metacognition in LLMs
Iqbal, S. (2026) · Intelligent Data Analysis · doi:10.1177/1088467x261436903 · Cited by 3
Comma: A multi-task and multi-lingual dataset of constitutional verdicts
Ragazzi, L., Frisoni, G., Moro, G., Italiani, P., Molfetta, L., & Folin, V. (2026) · Artificial Intelligence and Law · doi:10.1007/s10506-026-09520-x · Cited by 2
Sunitha, K., & Sharma, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-18346-0_23
Mesquita, L. A. D. P., & de Oliveira, S. A. F. (2026) · Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI) · doi:10.5753/sbsi.2026.248723 · Cited by 1
“…challenges persist, notably regarding robustness, fairness, and knowledge preservation [Rasheed et al. 2023, Hooker et al. 2020, Xu et al. 2024], as well as ethical concerns such as the environmental and social sustainability of AI systems [Strubell et al. 2019, Li et al. 2024, Bender et al. 2021].”
Refusal as silence: Gendered disparities in Vision-Language Model responses
Luo, S., Kim, S. J., Duan, Z., & Chen, K. (2026) · New Media & Society · doi:10.1177/14614448261441886 · Cited by 5
“Yet recent scholarship in explainable AI (Lipton, 2018; Doshi-Velez & Kim, 2017) and critical algorithm studies (Bender et al., 2021; Crawford, 2021) highlights that refusal is not merely a safety function but also a communicative act with social and political consequences.”
InfluentialCrespo, R. F. (2026) · Springer eBooks · doi:10.1007/978-3-032-18462-7_5
Automated Inference of Systems Capability from Natural Language Artifacts
Vyas, N., Falk, K., & Razbani, O. (2026) · Systems · doi:10.3390/systems14050508
Can Tech Speak? Agentic Interfaces, Proxy Speech, and the Post-Interface Condition
Lubin, K.-L. (2026) · Recalling the Founding of the ‘Journal of Black Studies’ a Half-Century Ago · doi:10.65724/fzap9014
Xiao, W. (2026) · Learning and analytics in intelligent systems · doi:10.1007/978-3-032-08195-7_2
Algorithmic Racism in AI Chatbots: Epistemic and Ethical Perspectives on Auditing
Molick, S. (2026) · Springer eBooks · doi:10.1007/978-3-032-15112-4_33
Improving Thematic Balance in Press Release Generation with GMMs and Dimensionality Reduction
Keraghel, I., & Nadif, M. (2026) · International Conference on Advances in Artificial Intelligence and Machine Learning (AAIML) · doi:10.1109/aaiml67890.2026.11498105
The Mirror Problem: Ai Bias As Reflected CognitionPreprint
Ziekenoppasser-Powell, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6638918
Wu, J. (2026) · Journal of Education Humanities and Social Sciences · doi:10.54097/b2mb8b80
Rashid, Y. K., Jundi, R., Hindy, T., et al. (2025) · International Conference on Decision Aid Sciences and Applications (DASA) · doi:10.1109/dasa68193.2025.11498740
“Cognitive problems such as impaired short-term memory, distraction, and reliance on inaccurate sources may lead to low academic achievement and a decline in the ability to think critically [9].”
Kim, J. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-4262-7.ch003
The mirror ethic: reflection, relation, and responsibility
Lee, C. (2026) · AI and Ethics · doi:10.1007/s43681-026-01160-w · Cited by 1
Harshberger, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6639918
Calibrating Stereotype Preference with Multi-Agent Graph Reasoning in Large Language Models
Amin, M. N., & Jesser, A. (2025) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit68739.2025.11491743
The Classroom and Beyond: Teacher Education in a GenAI World
Mishra, P., & Henriksen, D. (2026) · Springer international handbooks of education · doi:10.1007/978-3-031-88898-4_28-1
Das Dilemma der natürlichen Sprache
Murphy, J. W., & Largacha-Martínez, C. (2026) · Springer eBooks · doi:10.1007/978-3-031-89566-1_5
Ethics of Social Robotics: Co-evolution or the Extended Mind?
Damiano, L., & Dumouchel, P. (2026) · Springer eBooks · doi:10.1007/978-3-032-15112-4_52 · Cited by 1
Vonschallen, S., Häuser, R., Schmiedel, T., & Eyssel, F. (2026) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-36347
Generative AI-Based Framework for Vulnerability Detection and Cybersecurity Tutoring
Thakkar, Y., Goswami, N., Purohit, S., & Samdani, K. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-19672-9_49
A(I)nthropocene; from the Enframing to the Enveloping
Cera, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-15112-4_5
EduRAG: Improving AI Teaching Assistants with Retrieval-Augmented Generation
Vadlamudi, G., & Chun, R. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-22202-2_22
Kumar, V., & Ahuja, V. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6730184
The Mirage of Abundance: Why AI Cannot End Scarcity and Implications for AI Risk
Tyssedal, J. J. (2026) · Journal of Social Philosophy · doi:10.1111/josp.70059
Teacher-Led Innovations with Generative AI: A Case Study of Australian Teachers
Blundell, C. N., Mukherjee, M. M., & Nykvist, S. S. (2026) · Springer eBooks · doi:10.1007/978-3-032-12174-5_9
Mapping the Individual and Social Impacts of Foundation Models on Transportation RecommendationPreprint
Cullen, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6730118
Chekmarev, E. V., & Pereverzev, K. V. (2026) · Rossijskoe pravo onlajn · doi:10.17803/2542-2472.2026.37.1.079-089 · Cited by 1
Digital Literary Consciousness: Exploring AI as Author, Reader, and Critic
Shukla, R. (2026) · Creative Saplings · doi:10.56062/gtrs.2026.5.4.1218
Романенко, С. О. (2026) · Reporter of the Priazovskyi State Technical University Section Technical sciences · doi:10.31498/2225-6733.53.1.2026.359775
When AI Becomes Its Own Biggest Fan: Self-Preference Bias in AI-Assisted Peer Review
Shi, J., Lee, J., Xu, L. Z., Ow, T. T., & Wang, Y. (2026) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2026.3691360 · Cited by 1
“While they can generate fluent and plausible text, they do not possess a genuine understanding of the content they produce [37], [38].”
Artificial Intelligence: Modern Magic or Dangerous Future?
Moeding, A. (2026) · Critical AI · doi:10.1215/2834703x-12347690
Insuasti, D. S. O., Villacis, J. A. F., Chiluisa, E. A. O., & Burgos, S. A. T. (2026) · ASCE MAGAZINE · doi:10.70577/asce.v5i2.806
Wilkins, E. (2026) · Journal of Clinical Practice in Speech-Language Pathology · doi:10.1080/22000259.2026.2665861
Against Optimized Efficiency: Why Foreign Language Learning Still Matters
Pribble, K. (2026) · Critical AI · doi:10.1215/2834703x-12347645
Pataranutaporn, P., Albrecht, C., Archiwaranguprok, C., Karny, S., & Baez, A. (2026) · Augmented Humans International Conference (AHs) · doi:10.1145/3795011.3795070
Liu, J., & He, Y. (2026) · International Conference on AI in Education Technology and Applications (AIETA) · doi:10.1109/aieta69357.2026.11508902
Gamification for Inclusive Large Language Models
Samimi-Dehkordi, L., Kolahdouz-Rahimi, S., & Fatima, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6063-8.ch003
Mechanistic Interpretability of Socio-Political Frames in Language Models: An Exploration
Asghari, H., & Nenno, S. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-25305-7_4 · Cited by 1
Slaoui, S. C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6675800 · Cited by 3
Wang, P., & Taylor, J. (2026) · Journal of Cases in Educational Leadership · doi:10.1177/15554589261430684
No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language Models
Charaka, V. K., Urlana, A., Kanumolu, G., Garlapati, B. M., & Mishra, P. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-19096-3_14 · Cited by 31
Lost in Deliberation: Making Democracy Understandable
Astier, C., Khallaf, N., Varela, O. B., Mazzanti, C., Sayman, V., Bott, S., Sharoff, S., & Saggion, H. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-19108-3_32
Olajubu, B. J., Etuka, C. E., Hussaini, M. L., & Angama, L. J. (2026) · Human Arenas · doi:10.1007/s42087-026-00619-w
“If Nigerian adolescents are being socialised by models trained predominantly on Western data, the values shaping their developmental environment are being determined by institutions and priorities far removed from their own communities (Kwet, 2019; Bender et al., 2021 ).”
Challenges and Solutions in Implementation
Yeung, Y. Y. (2026) · Springer briefs in education · doi:10.1007/978-981-95-8259-4_5
Ismaili, Y. (2026) · Globalisation Societies and Education · doi:10.1080/14767724.2026.2669938
The Architecture of Awe: Navigating the Gap Between Algorithmic Logic and Human Imagination
Mu, J. (2026) · Future of business and finance · doi:10.1007/978-3-032-25134-3_4
AI-Powered learning platforms for employee upskilling and reskilling in organizations
Prabhakar, R., Singh, U., Husain, M., Rima, P., & Anil Kumar, K. (2026) · Journal of Progress in Artificial Intelligence · doi:10.68152/1726
Xu, Z., Zhou, P., Tang, W., Ai, J., Zhao, W., Wang, K. W., Shao, W., Peng, X., Zhao, S., Yao, H., et al. (2026) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2026.3692182
“W ITH the rapid development and widespread adoption of large language models (LLMs), ethical and safety concerns have become increasingly prominent due to the vast amounts of data scraped from the internet during training [1], [2].”
Análise do uso do ChatGPT como ferramenta de apoio à análise de software
Damacena, J. A. N., da Silva, D. F., da Silva, M. L., & de Oliveira, C. C. (2026) · Research Society and Development · doi:10.33448/rsd-v15i5.51066
Truth, Trust, and Technology: Political Communication in the Era of Synthetic MediaPreprint
Garajamirli, N. (2026) · Research Square · doi:10.21203/rs.3.rs-9473319/v1
James, C., & Cheng, L. (2026) · doi:10.14293/pr2199.003533.v1
Schonhardt, M., Geelhaar, T., Hodel, T., & Odstrčilík, J. (2026) · Bielefeld University Press eBooks · doi:10.64136/tmbx6948
Simulating Social Networks with LLM Agents
Torres, N. (2026) · International Conference on Computer Research and Development · doi:10.1145/3796263.3796296
“The biases inherent in LLMs are well-documented [25, 26], with several studies highlighting how these biases can manifest in outputs and potentially affect the dynamics within artificial social networks [4].”
Image thinking after artificial intelligence
Toister, Y., & Żylińska, J. (2025) · Journal of Visual Culture · doi:10.1177/14704129251405715
“…by cybersecurity discourses, as well as beyond the scepticism implied in statements describing AI as merely a ‘meaning-devoid stochastic parrot’ (Bender et al., 2021), we embrace Ted Underwood’s (2022) proposition to ‘approach neural models as machines for mapping and rewiring collective…”
Trust in Large Language Models: An Exploratory Validation Framework
Money, W. H., & Mew, L. (2026) · Journal of Information Systems Applied Research and Analytics · doi:10.62273/npbz2264
Schonhardt, M., Geelhaar, T., Hodel, T., & Odstrčilík, J. (2026) · Bielefeld University Press eBooks · doi:10.64136/vqtt9446
Schonhardt, M., Geelhaar, T., Hodel, T., & Odstrčilík, J. (2026) · Bielefeld University Press eBooks · doi:10.64136/ypmh8773
Assessing linguistic bias in LLM outputs: a multi-dimensional English–Hindi study in MBA education
Pabreja, K. (2026) · Discover Education · doi:10.1007/s44217-026-01609-4
Understanding Automated Text Recognition
Schonhardt, M., Geelhaar, T., Hodel, T., & Odstrčilík, J. (2026) · Bielefeld University Press eBooks · doi:10.64136/ftqk5914
Three-Dimensional Thinking in a Post-Human World
Andoniou, C. (2026) · International Conference on Computer Research and Development · doi:10.1145/3796263.3796294
Janani, S., & Das, A. (2026) · International Conference on Inventive Computation Technologies (ICICT) · doi:10.1109/icict68280.2026.11510860
Detecting AI-Generated News: A Comparative Study of Machine Learning and Large Language Models
Ding, X. (2026) · International Conference on Artificial Intelligence, Digital Media Technology and Social Computing (ICAIDS) · doi:10.1145/3806262.3806266
Schonhardt, M., Geelhaar, T., Hodel, T., & Odstrčilík, J. (2026) · Bielefeld University Press eBooks · doi:10.64136/iwvc5016
Conclusion and What's Next in the Field of Text Recognition
Schonhardt, M., Geelhaar, T., Hodel, T., & Odstrčilík, J. (2026) · Bielefeld University Press eBooks · doi:10.64136/bleu9105
Button-pushing explorers: How to grasp that AI agents can do amazing things while knowing nothing
Son, J. Y., & Xu, A. (2026) · The Conversation · doi:10.64628/aai.d4rek5sqp
How Gen AI Is Reshaping Software Design Work: A Qualitative Study Through an Activity Theory Lens
Mulgund, P., Singh, R., & Purao, S. (2026) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/3768310.3807796
“However, experts also warn that GenAI can be difficult to interpret, may produce outputs of uneven quality, and can reproduce biases embedded in training data (Bender et al., 2021).”
From Principles to Practices: Implementing AI Responsibly for Social and Sustainable Impact
Blasco‐Arcas, L., & Lee, H.-H. M. (2026) · Springer eBooks · doi:10.1007/978-3-031-75316-9_42-1
Metadata
- Authors
- Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S.
- Affiliations
- University of Washington (US)
- Black in AI, Palo Alto, CA, USA
- The Aether
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 610-623
- OpenAlex
- W3133702157
- Cited by
- 6,988
- References
- 117
- Citations by year
- 2026: 2484 · 2025: 1887 · 2024: 1153 · 2023: 842 · 2022: 384 · 2021: 229
- FWCI
- 300.72
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- Creighton Digital Repository (CDR) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- large language models, model size, AI risks, financial costs, data curation, dataset documentation, stakeholder value, BERT, GPT, fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.