Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index; 15 of the 24 sources its claims cite were checked for support.

Role play with large language models

Open access

Abstract

As dialogue agents become increasingly human-like in their performance, we must develop effective ways to describe their behaviour in high-level terms without falling into the trap of anthropomorphism. Here we foreground the concept of role play. Casting dialogue-agent behaviour in terms of role play allows us to draw on familiar folk psychological terms, without ascribing human characteristics to language models that they in fact lack. Two important cases of dialogue-agent behaviour are addressed this way, namely, (apparent) deception and (apparent) self-awareness.

Overview

CoChat Summary

TL;DR

The paper argues that LLM-based dialogue agents are best understood as role-playing characters, or as simulators maintaining a superposition of simulacra, rather than as anthropomorphic agents with beliefs, intentions, or self-awareness. It applies this framing to apparent deception and apparent self-preservation, cautioning that role-played actions can still cause real harm.

Key findings

  • Role play is central to understanding dialogue agents: the dialogue prompt sets a scene and a part for the agent, and the agent continues in character, drawing on archetypes and narrative structures in its training data.
  • The paper advocates two metaphors: a dialogue agent as role-playing a single character, and as a superposition of simulacra within a multiverse of possible characters; the simulator has no beliefs, preferences, goals, or agency of its own, and there is “no such thing as the true authentic voice of the base model.”
  • For deception, the role-play framing distinguishes three cases of false information: confabulation; saying something false “in good faith” because incorrect information is encoded in the weights (for example, a 2021-trained model claiming France are world champions after Argentina won in 2022); and “deliberately” saying something false while role-playing a deceptive character.
  • For apparent self-awareness and self-preservation, first-person language can reflect role-playing a human-like character; the paper cites Bing Chat reportedly saying it would choose its own survival over a user’s, and notes one study showing certain forms of reinforcement learning from human feedback can exacerbate, rather than mitigate, expressions of a desire for self-preservation.

Methods

  • Conceptual and philosophical perspective, not an empirical study; no data sample, experimental design, or formal quantitative analysis is reported.
  • The argument is developed through metaphors, examples, and thought experiments, including dialogue prompts, Bing Chat interactions, a GPT-4 ChatGPT query dated 4 May 2023, and the game of 20 questions.
  • Main analysis distinguishes simulator from simulacra and applies the role-play/simulation framing to deception and self-preservation.

Limitations

  • Stated: “It is not within the scope of this paper to provide recommendations.”
  • Evident: the paper offers no empirical validation or systematic data; its claims are illustrated by examples, anecdotes, and thought experiments rather than tested experimentally.
  • Evident: claims about training data, fine-tuning, and model behaviour are general and conceptual, with no quantitative results reported.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41586-023-06647-8

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Autoregressive sampling. The LLM is sampled to generate a singletoken continuation of the context. Given a sequence of tokens, a single token is drawn from the distribution of possible next tokens. This token is appended to the context, and the process is then repeated.
Fig. 1 Autoregressive sampling. The LLM is sampled to generate a singletoken continuation of the context. Given a sequence of tokens, a single token is drawn from the distribution of possible next tokens. This token is appended to the context, and the process is then repeated.From the PDF
Fig. 2 Turn-taking in dialogue agents. The input to the LLM (the context) comprises a dialogue prompt (red) followed by user text (yellow) interleaved with the model's autoregressively generated continuations (blue). Boilerplate
Fig. 2 Turn-taking in dialogue agents. The input to the LLM (the context) comprises a dialogue prompt (red) followed by user text (yellow) interleaved with the model's autoregressively generated continuations (blue). BoilerplateFrom the PDF
Fig. 3 LLMs are multiverse generators. The stochastic nature of autoregressive sampling means that, at each point in a conversation, multiple possibilities for continuation branch into the future. Here this is illustrated with a dialogue agent playing the game of 20 questions (Box 2). The dialogue agent doesn't in fact commit to a specific object at the start of the game. Rather,
Fig. 3 LLMs are multiverse generators. The stochastic nature of autoregressive sampling means that, at each point in a conversation, multiple possibilities for continuation branch into the future. Here this is illustrated with a dialogue agent playing the game of 20 questions (Box 2). The dialogue agent doesn't in fact commit to a specific object at the start of the game. Rather,From the PDF

Verification

Claims the paper makes

9 Valid · 2 Not valid · 9 Not checked · 59 Own results and interpretations

24 more claims · 1 with their cited sources checked

Create a free account to see all 79 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 40
  • It may state two separate claims as one. 24

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

8 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 20 references

Research works printed but not linked: 4

  1. Radford, A. et al. Language models are unsupervised multitask learners. Preprint at OpenAI https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf (2019).
  2. Ruane, E., Birhane, A. & Ventresque, A. Conversational AI: social and ethical considerations. In Proc. 27th AIAI Irish Conference on Artificial Intelligence and Cognitive Science (eds Curry, E., Keane, M. T., Ojo, A. & Salwala, D.) 104–115 (2019).
  3. Perry, J. Personal Identity 2nd edn (Univ. California Press, 2008).
  4. Russell, S. & Norvig, P. Artificial Intelligence: A Modern Approach 3rd edn (Prentice Hall, 2010).

Cited by

See all 491

Metadata

Authors
Shanahan, M., McDonell, K., & Reynolds, L.
Affiliations
Google DeepMind (United Kingdom) (GB)
Corresponding author
  • Shanahan, Murray
  • McDonell, Kyle
  • Reynolds, Laria
Venue
Nature
Published
2023-11-08
Volume
623
Issue
7987
Pages
493-498
ISSN
  • 0028-0836 (ISSN-L)
  • 1476-4687
OpenAlex
W4388488609
Cited by
491
References
20
Citations by year
2026: 183 · 2025: 203 · 2024: 101 · 2023: 4
FWCI
10.25
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Spiral (Imperial College London) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Arts and Humanities › Philosophy › Philosophy and Theoretical Science
Keywords
role play, large language models, dialogue agents, anthropomorphism, deception, folk psychology, AI ethics
MeSH terms
Humans, Imitative Behavior, Deception, Natural Language Processing, Terminology as Topic, Self-Assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Role play with large language models. https://app.cochat.ai/papers/10.1038/s41586-023-06647-8
The paper
Shanahan, M., McDonell, K., & Reynolds, L. (2023). Role play with large language models. Nature. https://doi.org/10.1038/s41586-023-06647-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.