The DOI matches its DataCite record.
Thinking beyond the anthropomorphic paradigm benefits LLM research
Open accessAbstract
Anthropomorphism, or the attribution of human traits to technology, is an automatic and unconscious response that occurs even in those with advanced technical expertise. In this position paper, we analyze hundreds of thousands of research articles to present empirical evidence of the prevalence and growth of anthropomorphic terminology in research on large language models (LLMs). We argue for challenging the deeper assumptions reflected in this terminology -- which, though often useful, may inadvertently constrain LLM development -- and broadening beyond them to open new pathways for understanding and improving LLMs. Specifically, we identify and examine five anthropomorphic assumptions that shape research across the LLM development lifecycle. For each assumption (e.g., that LLMs must use natural language for reasoning, or that they should be evaluated on benchmarks originally meant for humans), we demonstrate empirical, non-anthropomorphic alternatives that remain under-explored yet offer promising directions for LLM research and development.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 77
- Orevaoghene Ahia, Sachin Kumar, Hila Gonen, Jungo Kasai, David R Mortensen, Noah A. Smith, and Yulia Tsvetkov. 2023. Do all languages cost the same? tok- enization in the era of commercial language models. In The 2023 Conference on Empirical Methods in Natural Language Processing.
- Canfer Akbulut, Laura Weidinger, Arianna Manzini, Iason Gabriel, and Verena Rieser. 2024. All Too Human? Mapping and Mitigating the Risk from An- thropomorphic AI. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, volume 7, pages 13-26.
- Jacob Andreas. 2022. Language models as agent mod- els. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 5769-5779, Abu Dhabi, United Arab Emirates. Association for Com- putational Linguistics. · DOI · Paper page
- Anthropic. 2024a. Claude's character. Anthropic. 2024b. External reviews of "alignment fak- ing in large language models". arXiv.org submitters. 2024. arxiv dataset. · DOI
- Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, and 1 others. 2022a. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862. · arXiv
- Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, and 1 others. 2022b. Constitutional AI: Harmlessness from AI feedback. arXiv preprint arXiv:2212.08073. · arXiv
- Mark Balas. 1978. Feedback control of flexible systems. IEEE Transactions on Automatic Control, 23(4):673- 679.
- Emily M Bender. 2024. Resisting dehumanization in the age of "AI". Curr. Dir. Psychol. Sci., 33(2):114-120.
- Leonard Bereska and Stratis Gavves. 2024. Mechanistic interpretability for AI safety -a review. Transactions on Machine Learning Research. Survey Certification, Expert Certification.
- Petter Bae Brandtzaeg, Marita Skjuve, and Asbjørn Føl- stad. 2022. My AI friend: How users of a social chatbot understand their human-AI friendship. Hu- man Communication Research, 48(3):404-429.
- Britta C Brugman, Christian Burgers, and Gerard J Steen. 2017. Recategorizing political frames: a sys- tematic review of metaphorical framing in experi- ments on political communication. Annals of the In- ternational Communication Association, 41(2):181- 197.
- Erik Brynjolfsson. 2023. The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence. In Augmented education in the global age, pages 103- 116. Routledge.
- Stephen Casper, Xander Davies, Claudia Shi, Thomas Krendl Gilbert, Jérémy Scheurer, Javier Rando, Rachel Freedman, Tomek Korbak, David Lindner, Pedro Freire, Tony Tong Wang, Samuel Marks, Charbel-Raphael Segerie, Micah Carroll, Andi Peng, Phillip J.K. Christoffersen, Mehul Damani, Stewart Slocum, Usman Anwar, and 13 others. 2023. Open problems and fundamental limita- tions of reinforcement learning from human feedback. Transactions on Machine Learning Research. Survey Certification, Featured Certification.
- Serina Chang, Ashton Anderson, and Jake M. Hof- man. 2025. ChatBench: From static benchmarks to human-AI evaluation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 26009- 26038, Vienna, Austria. Association for Computa- tional Linguistics. · DOI · Paper page
- Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, and 1 others. 2024. A survey on evaluation of large language models. ACM Transactions on Intelligent Systems and Tech- nology, 15(3):1-45.
- Myra Cheng, Kristina Gligoric, Tiziano Piccardi, and Dan Jurafsky. 2024. AnthroScore: A computational linguistic measure of anthropomorphism. In Proceed- ings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Vol- ume 1: Long Papers), pages 807-825, St. Julian's, Malta. Association for Computational Linguistics.
- Myra Cheng, Robert D Hawkins, and Dan Jurafsky. Ac- commodation and epistemic vigilance: A pragmatic account of why LLMs fail to challenge harmful be- liefs. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers), San Diego, USA. Association for Computational Linguistics.
- Myra Cheng, Sunny Yu, Cinoo Lee, Pranav Khadpe, Lu- jain Ibrahim, and Dan Jurafsky. 2026. ELEPHANT: Measuring and understanding social sycophancy in LLMs. In The Fourteenth International Conference on Learning Representations.
- Michelle Cohn, Mahima Pushkarna, Gbolahan O Olanubi, Joseph M Moran, Daniel Padgett, Zion Mengesha, and Courtney Heldreth. 2024. Believing anthropomorphism: Examining the role of anthropo- morphic cues on trust in large language models. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pages 1-15.
- Mike Dacey. 2017. Anthropomorphism as cognitive bias. Philosophy of Science, 84(5):1152-1164.
- Jessica Dai. 2024. Position: Beyond personhood: Agency, accountability, and the limits of anthropo- morphic ethical analysis. In Forty-first International Conference on Machine Learning.
- Adam Davies and Ashkan Khakzar. 2024. The cognitive revolution in interpretability: From explaining be- havior to interpreting representations and algorithms. arXiv preprint arXiv:2408.05859. · arXiv
- Eamon Duede and Richard Jean So. 2024. The human- istic case for AI optimism. Poetics Today, 45(2):215- 222.
- Nicholas Epley. 2018. A mind like mine: The exception- ally ordinary underpinnings of anthropomorphism. Journal of the Association for Consumer Research, 3(4):591-598.
- Oluwole Fagbohun, Rachel M Harrison, and An- ton Dereventsov. 2024. An empirical categoriza- tion of prompting techniques for large language models: A practitioner's guide. arXiv preprint arXiv:2402.14837. · arXiv
- K. J. Kevin Feng, Kevin Pu, Matt Latzke, Tal August, Pao Siangliulue, Jonathan Bragg, Daniel S Weld, Amy X. Zhang, and Joseph Chee Chang. 2026. Co- coa: Co-planning and co-execution with ai agents. In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, CHI '26, New York, NY, USA. Association for Computing Machinery. · DOI
- Luciano Floridi and Anna C Nobre. 2024. Anthropo- morphising machines and computerising minds: the crosswiring of languages between artificial intelli- gence and brain & cognitive sciences. Minds and Machines, 34(1):1-9.
- Kristel M Gallagher and John A Updegraff. 2012. Health message framing effects on attitudes, inten- tions, and behavior: a meta-analytic review. Annals of behavioral medicine, 43(1):101-116.
- Ryan Greenblatt, Carson Denison, Benjamin Wright, Fabien Roger, Monte MacDiarmid, Sam Marks, Jo- hannes Treutlein, Tim Belonax, Jack Chen, David Duvenaud, and 1 others. 2024. Alignment fak- ing in large language models. arXiv preprint arXiv:2412.14093. · arXiv
- David Gros, Yu Li, and Zhou Yu. 2021. The R-U-a- robot dataset: Helping avoid chatbot deception by detecting user questions about human or non-human identity. In Proceedings of the 59th Annual Meet- ing of the Association for Computational Linguistics and the 11th International Joint Conference on Natu- ral Language Processing (Volume 1: Long Papers), pages 6999-7013, Online. Association for Computa- tional Linguistics. · DOI
- Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, and 1 others. 2025. DeepSeek- R1 incentivizes reasoning in LLMs through reinforce- ment learning. Nature, 645(8081):633-638.
- Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason E Weston, and Yuandong Tian. 2025. Training large language models to reason in a continuous latent space. In Second Conference on Language Modeling.
- John Hewitt, Nelson F Liu, Percy Liang, and Christo- pher D Manning. 2024. Instruction following without instruction tuning. arXiv preprint arXiv:2409.14254. · arXiv
- Lujain Ibrahim, Franziska Sofia Hafner, and Luc Rocher. 2025. Training language models to be warm and empathetic makes them less reliable and more syco- phantic. arXiv preprint arXiv:2507.21919. · arXiv
- Theodore Jensen, Mary Theofanos, Kristen Greene, Olivia Williams, Kurtis Goad, and Janet Bih Fofang. 2024. Reflection of its creators: Qualitative analysis of general public and expert perceptions of artificial intelligence. In Proceedings of the AAAI/ACM Con- ference on AI, Ethics, and Society, volume 7, pages 647-658.
- Cameron Jones and Ben Bergen. 2024. Does gpt-4 pass the turing test? In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 5183-5210.
- Cameron Jones and Benjamin Bergen. 2026. Lies, damned lies, and language statistics: a comprehen- sive review of risks from manipulation, persuasion, and deception with large language models. Artificial Intelligence Review.
- Atoosa Kasirzadeh and Iason Gabriel. 2023. In conver- sation with artificial intelligence: aligning language models with human values. Philosophy & Technol- ogy, 36(2):27.
- Ayush Kaushal and Kyle Mahowald. 2022. What do tokens know about their characters and how do they know it? In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Tech- nologies, pages 2487-2507, Seattle, United States. Association for Computational Linguistics. · DOI
- Pranav Khadpe, Ranjay Krishna, Li Fei-Fei, Jeffrey T Hancock, and Michael S Bernstein. 2020. Con- ceptual metaphors impact perceptions of human-ai collaboration. Proceedings of the ACM on Human- Computer Interaction, 4(CSCW2):1-26.
- Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vard- hamanan A, Saiful Haq, Ashutosh Sharma, Thomas T. Joshi, Hanna Moazam, Heather Miller, Matei Za- haria, and Christopher Potts. 2024. DSPy: Com- piling declarative language model calls into state- of-the-art pipelines. In The Twelfth International Conference on Learning Representations.
- Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vid- gen, Grusha Prasad, Amanpreet Singh, Pratik Ring- shia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, and Adina Williams. 2021. Dynabench: Rethinking benchmarking in NLP. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies, pages 4110-4124, Online. Association for Computa- tional Linguistics. · DOI · Paper page
- Taku Kudo and John Richardson. 2018. SentencePiece: A simple and language independent subword tok- enizer and detokenizer for neural text processing. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 66-71, Brussels, Belgium. Association for Computational Linguistics. · DOI
- George Lakoff and Mark Johnson. 2008. Metaphors we live by. University of Chicago Press.
- Belinda Z. Li, Alex Tamkin, Noah Goodman, and Jacob Andreas. 2025. Eliciting human preferences with language models. In The Thirteenth International Conference on Learning Representations.
- Yugang Li, Baizhou Wu, Yuqi Huang, Jun Liu, Jun- hui Wu, and Shenghua Luan. 2024. Warmth, com- petence, and the determinants of trust in artificial intelligence: A cross-sectional survey from China. International Journal of Human-Computer Interac- tion, pages 1-15.
- Kristian Lum, Jacy Reese Anthis, Kevin Robinson, Chi- rag Nagpal, and Alexander Nicholas D'Amour. 2025. Bias in language models: Beyond trick tests and to- wards RUTEd evaluation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 137-161, Vienna, Austria. Association for Computational Lin- guistics. · DOI
- John McCarthy, Marvin L Minsky, Nathaniel Rochester, and Claude E Shannon. 2006. A proposal for the dartmouth summer research project on artificial intel- ligence, august 31, 1955. AI magazine, 27(4):12-12.
- John McCarthy, Nathaniel Rochester, and Claude Shan- non. 1956. Dartmouth workshop.
- R. Thomas McCoy, Shunyu Yao, Dan Friedman, Mathew D. Hardy, and Thomas L. Griffiths. 2024a. Embers of autoregression show how large language models are shaped by the problem they are trained to solve. Proceedings of the National Academy of Sciences, 121(41):e2322420121. · DOI · Paper page
- R Thomas McCoy, Shunyu Yao, Dan Friedman, Mathew D Hardy, and Thomas L Griffiths. 2024b. When a language model is optimized for reasoning, does it still show embers of autoregression? an anal- ysis of openai o1. arXiv preprint arXiv:2410.01792. · arXiv
- Douglas L Medin. 1989. Concepts and conceptual struc- ture. American psychologist, 44(12):1469.
- Moran Mizrahi, Guy Kaplan, Dan Malkin, Rotem Dror, Dafna Shahaf, and Gabriel Stanovsky. 2024. State of what art? a call for multi-prompt LLM evaluation. Transactions of the Association for Computational Linguistics, 12:933-949.
- Burt L Monroe, Michael P Colaresi, and Kevin M Quinn. 2008. Fightin'words: Lexical feature selection and evaluation for identifying the content of political con- flict. Political Analysis, 16(4):372-403.
- Meredith Ringel Morris. 2024. Prompting considered harmful. Communications of the ACM, 67(12):28- 30.
- Rajiv Movva, Sidhika Balachandar, Kenny Peng, Gabriel Agostini, Nikhil Garg, and Emma Pierson. 2024. Topics, authors, and institutions in large lan- guage model research: Trends from 17k arxiv papers. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 1223-1243.
- Nika Mozafari, Welf H Weiger, and Maik Hammer- schmidt. 2020. The chatbot disclosure dilemma: De- sirable and undesirable effects of disclosing the non- human identity of chatbots. In ICIS, pages 1-18.
- Gregory L. Murphy. 2002. The Big Book of Concepts. The MIT Press. · DOI
- Clifford Nass, Youngme Moon, and Paul Carney. 1999. Are people polite to computers? responses to computer-based interviewing systems. Journal of Applied Social Psychology, 29(5):1093-1109. · DOI · Paper page
- Simon Ott, Adriano Barbosa-Silva, Kathrin Blagec, Jan Brauner, and Matthias Samwald. 2022. Mapping global dynamics of benchmark creation and satura- tion in artificial intelligence. Nature Communica- tions, 13(1):6793.
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, and 1 others. 2022. Training language models to follow in- structions with human feedback. Advances in neural information processing systems, 35:27730-27744.
- Alexander Pan, Erik Jones, Meena Jagadeesan, and Ja- cob Steinhardt. 2024. Feedback loops with language models drive in-context reward hacking. In Proceed- ings of the 41st International Conference on Machine Learning, ICML'24. JMLR.org.
- Diane Proudfoot. 2011. Anthropomorphism and AI: Turing's much misunderstood imitation game. Artifi- cial Intelligence, 175(5-6):950-957.
- Deborah Raji, Emily Denton, Emily M. Bender, Alex Hanna, and Amandalynne Paullada. 2021. Ai and the everything in the whole wide world benchmark. In Proceedings of the Neural Information Process- ing Systems Track on Datasets and Benchmarks, vol- ume 1.
- Murray Shanahan. 2024. Talking about large language models. Communications of the ACM, 67(2):68-79.
- Murray Shanahan, Kyle McDonell, and Laria Reynolds. 2023. Role play with large language models. Nature, 623(7987):493-498.
- Jianna So, Connie Cheng, and Sonia Krishna Murthy. 2026. Beyond anthropomorphism: a spectrum of interface metaphors for LLMs. In Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems, pages 1-7.
- Yao Song and Yan Luximon. 2020. Trust in AI agent: A systematic review of facial anthropomor- phic trustworthiness for social robot design. Sensors, 20(18):5087.
- Hari Subramonyam, Roy Pea, Christopher Pondoc, Ma- neesh Agrawala, and Colleen Seifert. 2024. Bridg- ing the gulf of envisioning: Cognitive challenges in prompt based interactions with LLMs. In Proceed- ings of the CHI Conference on Human Factors in Computing Systems, pages 1-19.
- Peiqi Sui, Eamon Duede, Sophie Wu, and Richard So. 2024. Confabulation: The surprising value of large language model hallucinations. In Proceedings of the 62nd Annual Meeting of the Association for Compu- tational Linguistics (Volume 1: Long Papers), pages 14274-14284, Bangkok, Thailand. Association for Computational Linguistics. · DOI
- Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. Chain-of-thought prompting elic- its reasoning in large language models. Advances in neural information processing systems, 35:24824- 24837.
- Jia-Yu Yao, Kun-Peng Ning, Zhen-Hui Liu, Mu-Nan Ning, Yu-Yang Liu, and Li Yuan. 2023. LLM lies: Hallucinations are not bugs, but features as adversar- ial examples. arXiv preprint arXiv:2310.01469. · arXiv
- Hongxin Zhang, Yanzhe Zhang, Ruiyi Zhang, and Diyi Yang. 2022. Robustness of demonstration-based learning under limited data scenario. In Proceed- ings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 1769-1782, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics. · DOI
- Tan Zhi-Xuan, Micah Carroll, Matija Franklin, and Hal Ashton. 2024. Beyond preferences in AI alignment. Philosophical Studies, pages 1-51.
- Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc V Le, and Ed H. Chi. 2023. Least-to-most prompting enables com- plex reasoning in large language models. In The Eleventh International Conference on Learning Rep- resentations.
- Kaitlyn Zhou, Jena D. Hwang, Xiang Ren, Nouha Dziri, Dan Jurafsky, and Maarten Sap. 2025. REL-A.I.: An interaction-centered approach to measuring human- LM reliance. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Asso- ciation for Computational Linguistics: Human Lan- guage Technologies (Volume 1: Long Papers), pages 11148-11167, Albuquerque, New Mexico. Associa- tion for Computational Linguistics. · DOI
- Jingming Zhuo, Songyang Zhang, Xinyu Fang, Haodong Duan, Dahua Lin, and Kai Chen. 2024. Prosa: Assessing and understanding the prompt sen- sitivity of LLMs. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 1950-1976.
Cited by
Sorted by citations
Germani, F., & Spitale, G. (2026) · arXiv · doi:10.48550/arxiv.2605.14544 · Cited by 1
Metadata
- Authors
- Ibrahim, L., & Cheng, M.
- Affiliations
- University of Oxford (GB)
- Stanford University (US)
- ORCID
- Ibrahim, Lujain
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- Pages
- 2551-2563
- ISSN
- 0736-587X (ISSN-L)
- arXiv
- 2502.09192
- OpenAlex
- W4407571898
- Cited by
- 4
- References
- 0
- Citations by year
- 2026: 4
- FWCI
- 35.74
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- anthropomorphism, large language models, natural language reasoning, benchmark evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review