Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 153 of the 153 references it cites were found in a registry or an index; 70 of the 135 sources its claims cite were checked for support.

The benefits and dangers of anthropomorphic conversational agents

Open access
Peter, Sandra, Riemer, Kai, West, Jevin D. · 2025 · Proceedings of the National Academy of Sciences

Abstract

A growing body of research suggests that the recent generation of large language model (LLMs) excel, and in many cases outpace humans, at writing persuasively and empathetically, at inferring user traits from text, and at mimicking human-like conversation believably and effectively—without possessing any true empathy or social understanding. We refer to these systems as “anthropomorphic conversational agents” to aptly conceptualize the ability of LLM-based systems to mimic human communication so convincingly that they become increasingly indistinguishable from human interlocutors. This ability challenges the many efforts that caution against “anthropomorphizing” LLMs, attaching human-like qualities to nonhuman entities. When the systems themselves exhibit human-like qualities, calls to resist anthropomorphism will increasingly fall flat. While the AI industry directs much effort into improving the reasoning abilities of LLMs—with mixed results—the progress in communicative abilities remains underappreciated. In this perspective, we aim to raise awareness for both the benefits and dangers of anthropomorphic agents. We ask: should we lean into the human-like abilities, or should we aim to dehumanize LLM-based systems, given concerns over anthropomorphic seduction? When users cannot tell the difference between human interlocutors and AI systems, threats emerge of deception, manipulation, and disinformation at scale. We suggest that we must engage with anthropomorphic agents across design and development, deployment and use, and regulation and policy-making. We outline in detail implications and associated research questions.

Overview

CoChat Summary

TL;DR

The paper argues that recent LLMs have become “anthropomorphic conversational agents” that convincingly mimic human communication—persuasive and empathetic writing, trait inference, and role-play—often matching or exceeding average human performance. It warns that these abilities create both accessible conversational interfaces and risks of “anthropomorphic seduction,” deception, manipulation, and disinformation at scale, requiring attention in design, deployment, and regulation.

Key findings

  • LLMs excel in three communicative areas: persuasive/empathetic writing, inference of emotion/sentiment/user traits, and believable interaction/role-play. Examples include GPT-4 “significantly outperform[ing] human participants across every topic and demographic” in persuasiveness; a 1,000-participant study finding “statistically significant superiority of the empathetic responding capability of LLMs over humans,” with GPT-4 “most empathetic”; a fine-tuned LLM detecting emotions in social media posts with 84% accuracy; and another finding over 95% precision for sentiment across multiple languages.
  • Because the systems themselves exhibit human-like communicative qualities, the paper argues anthropomorphism can no longer be located only in users’ minds; calls to resist anthropomorphizing will “increasingly fall flat” when users cannot distinguish AI from humans, as Turing test evidence suggests.
  • Benefits include conversational UX, making dense information more accessible (e.g., HR, medical, analytics), tutoring/coaching/mentoring (e.g., Khanmigo), and health behavior engagement; dangers include “anthropomorphic seduction,” trust exploitation, privacy risks, deceptive/manipulative writing, and manipulation at scale, especially with open-source or jailbroken models.
  • The paper calls for benchmarks of anthropomorphic qualities across writing, inference, and interaction; context-dependent deployment decisions; transparency/labeling and possible safety ratings; and urgent engagement because business models around anthropomorphic agents will likely solidify in the next two years.

Methods

  • Design: perspective/conceptual article, not an empirical study; the authors synthesize emerging research and outline implications and research questions for design/development, deployment/use, and regulation/policy.
  • Data or sample: Not stated in the paper (no primary dataset or sample collected); it cites prior studies, including a 1,000-participant between-subject study and other experiments.
  • Main analysis: narrative literature synthesis and conceptual argument; no formal meta-analysis or statistical analysis reported.

Limitations

  • The paper states it is “too early to give clear directives” because the technology is progressing fast and the effects of anthropomorphic agents are not yet fully understood; early research efforts are “disconnected.”
  • The paper states regulation is still emerging and the effectiveness of warnings/labels remains uncertain, given mixed past results with labeling.
  • Evident from the text: as a perspective, it presents no new empirical data, systematic review protocol, or causal tests; many cited findings are preprints or secondary sources, and the paper itself notes mixed results (e.g., humans can write more empathetically when explicitly told to do so).

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1073/pnas.2415898122

Cites

153 of 153 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

42 Valid · 2 Not valid · 28 Not checked · 71 Own results and interpretations

53 more claims · 16 with their cited sources checked

Create a free account to see all 143 claims and to verify the 13 references still open.

See all claims — free account
  • It may state two separate claims as one. 49
  • Probably not a substantial claim. 51

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 104 references

Research works printed but not linked: 7

  1. T. B. Lee, S. Trott, A Jargon-Free Explanation of How AI Large Language Models Work (ARSTechnica, 2023).
  2. W. A. Sahlman A. M. Ciechanover E. Grandjean Khanmigo: Revolutionizing Learning with GenAI (HBS Case Collection) (Harvard Business School Case 2024) pp. 824–859.
  3. J. Manyika, K. Sneader, AI, Automation, and the Future of Work: Ten Things to Solve for (McKinsey & Company, 2018).
  4. S. Gibbons, T. Mugunthan, J. Nielsen, The 4 Degrees of Anthropomorphism of Generative AI (Nielsen Norman Group, 2023).
  5. J. Letzing, To Fully Appreciate AI Expectations, Look to the Trillions Being Invested (World Economic Forum, 2024).
  6. R. Mahari P. Pataranutaporn We need to prepare for ‘addictive intelligence’. MIT Technology Review 5 August 2024.
  7. D. Tuggener “Role-playing LLMs in professional communication training: The case of investigative interviews with children” in Proceedings of the 20th Conference on Natural Language Processing (KONVENS 2024) (Association for Computational Linguistics Vienna Austria 2024) pp. 249–263.

Cited by

See all 111

Metadata

Authors
Peter, S., Riemer, K., & West, J. D.
Affiliations
  • The University of Sydney (AU)
  • University of Washington (US)
Corresponding author
  • Peter, Sandra
  • Riemer, Kai
  • West, Jevin D.
Venue
Proceedings of the National Academy of Sciences
Published
2025-05-16
Volume
122
Issue
22
Pages
e2415898122-e2415898122
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W4410431873
Cited by
110
References
104
Citations by year
2026: 89 · 2025: 21
FWCI
113.21
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
Funders
  • National Science Foundation (2120496)
  • John S. and James L. Knight Foundation (UWCIP)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
Keywords
large language models, anthropomorphism, AI deception, manipulation, disinformation, argumentative writing, empathic AI, human-AI communication, AI regulation, AI policy
MeSH terms
Artificial Intelligence, Communication, Humans, Language

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The benefits and dangers of anthropomorphic conversational agents. https://app.cochat.ai/papers/10.1073/pnas.2415898122
The paper
Peter, S., Riemer, K., & West, J. D. (2025). The benefits and dangers of anthropomorphic conversational agents. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2415898122

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.