On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Open accessThe DOI matches its Crossref record; 156 of the 159 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
The past 3 years of work in NLP have been characterized by the development and deployment of ever larger language models, especially for English. BERT, its variants, GPT-2/3, and others, most recently Switch-C, have pushed the boundaries of the possible both through architectural innovations and through sheer size. Using these pretrained models and the methodology of fine-tuning them for specific tasks, researchers have extended the state of the art on a wide array of tasks as measured by leaderboards on specific benchmarks for English. In this paper, we take a step back and ask: How big is too big? What are the possible risks associated with this technology and what paths are available for mitigating those risks? We provide recommendations including weighing the environmental and financial costs first, investing resources into curating and carefully documenting datasets rather than ingesting everything on the web, carrying out pre-development exercises evaluating how the planned approach fits into research and development goals and supports stakeholder values, and encouraging research directions beyond ever larger language models.
Checked 2026-11-22 · 3 references not checked yet
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 5×
“[39] in particular noted that training on a large dataset and fine-tuning for specific tasks leads to strictly increasing results on the GLUE tasks [138] for English as the hyperparameters of the model were increased.”
BackgroundMethodResultInfluentialGlove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 4×
“documents linked to from Reddit [25], plus Wikipedia and a collection”
BackgroundMethodInfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 1×
“[26, 58], quantization [118, 153], factorized embedding parameterization and cross-layer parameter sharing [70], and progressive module replacing [146].”
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
The Mathematical Theory of Communication
Shannon, C. E., Weaver, W., & Wiener, N. (1950) · Physics Today · doi:10.1063/1.3067010 · Cited by 9,801
Research works printed but not linked: 48
- [4] American Psychological Association. 2019. Discrimination: What it is, and how to cope. https://www.apa.org/topics/discrimination (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [15] Ruha Benjamin. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. Polity Press, Cambridge, UK. Crossref Google Scholar
- [16] Elettra Bietti and Roxana Vatanparast. 2020. Data Waste. Harvard International Law Journal 61 (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.1016/0010-0277(86) · doi:10.1016/0010-0277(86
- [38] Terrance de Vries, Ishan Misra, Changhan Wang, and Laurens van der Maaten. 2019. Does object recognition work for everyone?. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 52--59. Google Scholar
- 10.18653/v1 · DOI
- [42] Ethan Fast, Tina Vachovsky, and Michael Bernstein. 2016. Shirtless and Dangerous: Quantifying Linguistic Signals of Gender Bias in an Online Fiction Writing Community. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 10. Google Scholar
- 10.18653/v1 · DOI
- [45] Darja Fišer, Ruihong Huang, Vinodkumar Prabhakaran, Rob Voigt, Zeerak Waseem, and Jacqueline Wernimont (Eds.). 2018. Proceedings of the 2nd Workshop on Abusive Language Online (ALW2). Association for Computational Linguistics, Brussels, Belgium. https://www.aclweb.org/anthology/W18-5100 Google Scholar
- [50] Batya Friedman, Peter H. Kahn, Jr., and Alan Borning. 2006. Value sensitive design and information systems. In Human-Computer Interaction in Management Information Systems: Foundations, P Zhang and D Galletta (Eds.). M. E. Sharpe, Armonk NY, 348--372. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [67] Brendan Kennedy, Drew Kogon, Kris Coombs, Joseph Hoover, Christina Park, Gwenyth Portillo-Wightman, Aida Mostafazadeh Davani, Mohammad Atari, and Morteza Dehghani. 2018. A typology and coding manual for the study of hate-based rhetoric. PsyArXiv. July 18 (2018). Google Scholar
- [77] Marianna Martindale and Marine Carpuat. 2018. Fluency Over Adequacy: A Pilot Study in Measuring User Trust in Imperfect MT. In Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track). Association for Machine Translation in the Americas, Boston, MA, 13--25. https://www.aclweb.org/anthology/W18-1803 Google Scholar
- [81] Douglas M McLeod. 2007. News coverage and social protest: How the media's protect paradigm exacerbates social conflict. Journal of Dispute Resolution (2007), 185. Google Scholar
- [87] Robert C. Moore and William Lewis. 2010. Intelligent Selection of Language Model Training Data. In Proceedings of the ACL 2010 Conference Short Papers. Association for Computational Linguistics, Uppsala, Sweden, 220--224. https://www.aclweb.org/anthology/P10-2041 Google Scholar
- 10.18653/v1 · DOI
- [92] Maggie Nelson. 2015. The Argonauts. Graywolf Press, Minneapolis. Google Scholar
- 10.18653/v1 · DOI
- [96] David Ortiz, Daniel Myers, Eugene Walls, and Maria-Elena Diaz. 2005. Where do we stand with newspaper data? Mobilization: An International Quarterly 10, 3 (2005), 397--419. Google Scholar
- 10.3115/v1 · doi:10.3115/v1
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [106] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9. Google Scholar
- 10.18653/v1 · DOI
- [109] Sarah T. Roberts, Joel Tetreault, Vinodkumar Prabhakaran, and Zeerak Waseem (Eds.). 2019. Proceedings of the Third Workshop on Abusive Language Online. Association for Computational Linguistics, Florence, Italy. https://www.aclweb.org/anthology/W19-3500 Google Scholar
- [112] Corby Rosset. 2020. Turing-NLG: A 17-billion-parameter language model by Microsoft. Microsoft Blog (2020). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [121] Joonbo Shin, Yoonhyung Lee, and Kyomin Jung. 2019. Effective Sentence Scoring Method Using BERT for Speech Recognition. In Asian Conference on Machine Learning. 1081--1093. Google Scholar
- [124] Karen Spärck Jones. 2004. Language modelling's generative model: Is it rational? Technical Report. Computer Laboratory, University of Cambridge. Google Scholar
- [127] Katrina Srigley and Lorraine Sutherland. 2019. Decolonizing, Indigenizing, and Learning Biskaaybiiyang in the Field: Our Oral History Journey1. The Oral History Review (2019). Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [150] Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. In Advances in neural information processing systems. 5753--5763. Google Scholar
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
Cited by
Items 6,901–6,931 of 6,931
Ay, B. K., & Yıldır, C. Z. (2026) · Journal of Back and Musculoskeletal Rehabilitation · doi:10.1177/10538127261492778
Gula: consumir recursos y producir contenido sin medida
Navia, J. M. A., Zapata, E. M. J., & Castillo, V. S. (2026) · doi:10.62486/978-9915-9928-6-0.ch05
Decoding the marketing playbook of AI-powered language-learning platforms in Meta’s Ad Library
Selvi, A. F., & Uştuk, Ö. (2026) · Applied Linguistics · doi:10.1093/applin/amag098
Soberbia: creer que la inteligencia artificial lo sabe todo
de la Cruz, J. E. H., Polanía, L. R., & Castillo, V. S. (2026) · doi:10.62486/978-9915-9928-6-0.ch01
A duoethnography of recognition in AI-mediated academic writing
Le, T. L., & Thùy, P. T. (2026) · Educational Studies · doi:10.1080/03055698.2026.2746714
When AI Fails: Hallucination Exposure, Verification, and Critical AI LiteracyPreprint
Nowacki, L., & Wrochna, A. E. (2026) · Research Square · doi:10.2139/ssrn.7583923
Inherited dominance: why AI trained on human history may become humanity’s greatest threat
Sarukkai, R. (2026) · AI and Ethics · doi:10.1007/s43681-026-01425-4
ValuePEFT: an effective method for steerable multi-level human values in LLMs
Wang, J., & Wang, Y. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07486-6
The Epistemic Leader: Developing Epistemic Evaluation Capability in AI Leadership
Nguyen, V. M. H., Attanayake, C., & Le, Q. K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-1488-2.ch011
Empowering Educators in the Age of AI
Tyagi, M., & Dhaliwal, A. K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-4664-7.ch009
Pedagogies of Prompting: Teaching AI Interaction Across Disciplines
Sarkar, R., & Chakraborty, M. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8332-3.ch008
From Prompts to Publications: Rethinking Academic Writing and Research With Generative AI
Tyagi, V. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8332-3.ch013
Avaricia: concentrar el poder, los datos y los beneficios
Suárez, Y. S., Castillo, V. S., & Morales, C. E. B. (2026) · doi:10.62486/978-9915-9928-6-0.ch02
Generative AI as Support Infrastructure: A Design Theory of Inclusive Intelligence
Abhari, K., Aghamohammadi, C., Pour, M. S., & Segal, R. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10824-1
Nath, S. (2026) · Business and Society Review · doi:10.1111/basr.70071
Lujuria: la fascinación desbordada por lo artificial
Gamboa, A. J. P. (2026) · doi:10.62486/978-9915-9928-6-0.ch03
The Impact of Generative AI on Personalized Content Marketing in E-Commerce
Mohiuddin, D., Tariq, M. H., & Tahir, A. (2025) · Inverge Journal of Social Sciences · doi:10.63544/ijss.v4i1.288 · Cited by 4
“These risks have been classified by scholars as either technical, social, or regulatory (Ferrara, 2023; Weidinger et al., 2022; Bender et al., 2021).”
Peerify: Benchmarking Peer-Review Claim Verification
Daghighfarsoodeh, A., Ebrahimi, S., Ghorbanpour, A., Sadeghian, S., Cheraghi, R., Arabzadeh, N., & Bagheri, E. (2026) · arXiv · doi:10.48550/arxiv.2609.25046
“The growing adoption of Large Language Models (LLMs) within scholarly workflows further amplifies the importance of this problem (Bender et al., 2021; Arabzadeh et al., 2026b).”
Shepherd, N. J. (2025) · Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online) · doi:10.60087/jklst.vol4.n4.016
Generative AI Usage and Information Literacy Skills among University Students in North-West Nigeria
Dada, K. S. J., & Quadir, O. R. (2026) · Data Science: Journal of Computing and Applied Informatics · doi:10.32734/jocai.v10.i1-24709
Fotaris, P. (2026) · Cogent Arts & Humanities · doi:10.1080/23311983.2026.2722084
Wanner, M., Azzopardi, L., Thomas, P., Dan, S., Van Durme, B., & Craswell, N. (2025) · arXiv · doi:10.48550/arxiv.2510.07083
“These models are known to produce hallucinations, which can sometimes be harmful (Bender et al., 2021; Dev et al., 2022).”
Toward Enactive Artificial Intelligence
Rafiee, B., & Sutton, R. (2026) · arXiv · doi:10.48550/arxiv.2605.24238
Integrating AI Literacy and Critical Discourse Analysis into the 21st-Century University Curriculum
Siame, P. (2026) · International Journal of Multilingualism and Languages for Specific purposes · doi:10.52919/ijmlsp.v8i01.146
Reimagining Open Source and Openness in AI: Co-Creating Responsible Technological Futures
Smith, G., Patel, H., Luo, S., Bobra, M., Brewer, J., Carson, C., Cruxen, I., Doshi, S., Gahntz, M., Garcia, N., et al. (2026) · Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3805689.3806719
Prompt Persistence Attacks: Long-Term Memory Poisoning in LLM-Based Systems
Bhatnagar, P. (2026) · SSRN (preprint) · doi:10.2139/ssrn.6183548
Liu, J., Xiao, Q., Pang, L. Y., Zhu, H., Shen, H., & Taylor, J. (2026) · arXiv · doi:10.48550/arxiv.2609.18186
Self-Improvement of Large Language Models: A Technical Overview and Future Outlook
Yang, H., Xerri, M., Park, S., Zhang, H., Feng, Y., Kogilathota, S. A., & Zhou, J. (2026) · arXiv · doi:10.48550/arxiv.2603.25681
LLM Detectors Still Fall Short of Real World: Case of LLM-Generated Short News-Like Posts
Gameiro, H. D. S., Kucharavy, A., & Dolamic, L. (2024) · arXiv · doi:10.48550/arxiv.2409.03291
“The misuse of large language models (LLMs) for propaganda, inciting extremism, or spreading dis-information and misinformation has been a major concern from the early days of LLMs (Bender et al., 2021; McGuffie and Newhouse, 2020; Ip-polito et al., 2020).”
BackgroundLLM-Assisted Empirical Software Engineering: Systematic Literature Review and Research Agenda
Gomes, V., Selb, D., Palomba, F., Spinola, R., & Lo, D. (2026) · arXiv · doi:10.48550/arxiv.2604.26192
Caufield, J. H., Hegde, H., Emonet, V., Harris, N. L., Joachimiak, M. P., Matentzoglu, N., Kim, H., Moxon, S. A. T., Reese, J. T., Haendel, M. A., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.02711
Metadata
- Authors
- Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S.
- Affiliations
- University of Washington (US)
- Black in AI, Palo Alto, CA, USA
- The Aether
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 610-623
- OpenAlex
- W3133702157
- Cited by
- 6,988
- References
- 117
- Citations by year
- 2026: 2484 · 2025: 1887 · 2024: 1153 · 2023: 842 · 2022: 384 · 2021: 229
- FWCI
- 300.72
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- Creighton Digital Repository (CDR) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- large language models, model size, AI risks, financial costs, data curation, dataset documentation, stakeholder value, BERT, GPT, fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.