The DOI matches its DataCite record; the references it cites are not checked yet.
Role-Play with Large Language Models
Open accessAbstract
As dialogue agents become increasingly human-like in their performance, it is imperative that we develop effective ways to describe their behaviour in high-level terms without falling into the trap of anthropomorphism. In this paper, we foreground the concept of role-play. Casting dialogue agent behaviour in terms of role-play allows us to draw on familiar folk psychological terms, without ascribing human characteristics to language models they in fact lack. Two important cases of dialogue agent behaviour are addressed this way, namely (apparent) deception and (apparent) self-awareness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Modern LLMs can convincingly imitate human discourse, making it difficult to resist the impression that one is interacting with a conscious agent, especially if the model is prompted to play the role of a person in a conversation.
“Modern LLMs can convincingly imitate human discourse, making it difficult to resist the impression that one is interacting with a conscious agent, especially if the model is prompted to play the role of a person in a conversation (Shanahan et al. 2023).”
From Consciousness in Artificial Intelligence: Insights from the Science of Consciousness (2023) · cites this paper as Shanahan et al. 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
The citation lists haven’t been fetched yet
References 19 · Cited by 490
Research works printed but not linked: 25
- Shanahan, M. Talking about large language models. Preprint at https://arxiv.org/abs/2212. 03551 (2023). This paper cautions against the use of anthropomorphic terms to describe the behaviour of large language models.
- Andreas, J. Language models as agent models. In Findings of the Association for Computational Linguistics: EMNLP 2022 5769-5779 (Association for Computational Linguistics, 2022).
- Park, J. S. et al. Generative agents: interactive simulacra of human behavior. Preprint at https://arxiv.org/abs/2304.03442 (2023). · arXiv
- Wei, J. et al. Emergent abilities of large language models. Trans. Mach. Learn. Res. https:// openreview.net/forum?id=yzkSU5zdwD (2022).
- Vaswani, A. et al. Attention is all you need. Adv. Neural Inf. Process. Syst. 30, 5998-6008 (2017).
- Radford, A. et al. Language models are unsupervised multitask learners. Preprint at OpenAI https://cdn.openai.com/better-language-models/language_models_are_ unsupervised_multitask_learners.pdf (2019).
- Brown, T. et al. Language models are few-shot learners. Adv. Neural Inf. Process. Syst. 33, 1877-1901 (2020).
- Rae, J. W. et al. Scaling language models: methods, analysis & insights from training Gopher. Preprint at https://arxiv.org/abs/2112.11446 (2021). · arXiv
- Chowdhery, A. et al. PaLM: scaling language modeling with pathways. Preprint at https:// arxiv.org/abs/2204.02311 (2022). · arXiv
- Thoppilan, R. et al. LaMDA: language models for dialog applications. Preprint at https:// arxiv.org/abs/2201.08239 (2022). · arXiv
- OpenAI. GPT-4 technical report. Preprint at https://arxiv.org/abs/2303.08774 (2023). · arXiv
- Ruane, E., Birhane, A. & Ventresque, A. Conversational AI: social and ethical considerations. In Proc. 27th AIAI Irish Conference on Artificial Intelligence and Cognitive Science (eds Curry, E., Keane, M. T., Ojo, A. & Salwala, D.) 104-115 (2019).
- Reynolds, L. & McDonell, K. Multiversal views on language models. In Joint Proc. ACM IUI 2021 Workshops (eds Glowacka, D. & Krishnamurthy, V. R.) https://ceur-ws.org/Vol-2903/ IUI21WS-HAIGEN-11.pdf (2021).
- Glaese, A. et al. Improving alignment of dialogue agents via targeted human judgements. Preprint at https://arxiv.org/abs/2209.14375 (2022). · arXiv
- Bai, Y. et al. Constitutional AI: harmlessness from AI feedback. Preprint at https://arxiv.org/ abs/2212.08073 (2022). · arXiv
- Bender, E., Gebru, T., McMillan-Major, A. & Shmitchell, S. On the dangers of stochastic parrots: can language models be too big? In Proc. 2021 ACM Conference on Fairness, Accountability, and Transparency 610-623 (Association for Computing Machinery, 2021).
- Perez, E. et al. Discovering language model behaviors with model-written evaluations. In Findings of the Association for Computational Linguistics: ACL 2023 13387-13434 (Association for Computational Linguistics, 2023).
- Perry, J. Personal Identity 2nd edn (Univ. California Press, 2008).
- Schick, T. et al. Toolformer: language models can teach themselves to use tools. Preprint at https://arxiv.org/abs/2302.04761 (2023). · arXiv
- Yao, S. et al. ReAct: synergizing reasoning and acting in language models. In International Conference on Learning Representations (2023).
- Perkowitz, S. in Hollywood Science: Movies, Science, and the End of the World 142-164 (Columbia Univ. Press, 2007).
- Russell, S. & Norvig, P. Artificial Intelligence: A Modern Approach 3rd edn (Prentice Hall, 2010).
- Stiennon, N. et al. Learning to summarize from human feedback. Adv. Neural Inf. Process. Syst. 33, 3008-3021 (2020).
- Ouyang, L. et al. Training language models to follow instructions with human feedback. Adv. Neural Inf. Process. Syst. 35, 27730-27744. (2022).
- Casper, S. et al. Open problems and fundamental limitations of reinforcement learning from human feedback. Preprint at https://arxiv.org/abs/2307.15217 (2023). · arXiv
Metadata
- Authors
- Shanahan, M., McDonell, K., & Reynolds, L.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Corresponding author
- Shanahan, Murray
- McDonell, Kyle
- Reynolds, Laria
- ORCID
- Shanahan, Murray
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Volume
- 623
- Issue
- 7987
- Pages
- 493-498
- ISSN
- 0028-0836 (ISSN-L)
- arXiv
- 2305.16367
- OpenAlex
- W4388488609
- Cited by
- 490
- References
- 19
- Citations by year
- 2026: 182 · 2025: 203 · 2024: 101 · 2023: 4
- FWCI
- 10.24
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Arts and Humanities › Philosophy › Philosophy and Theoretical Science
- Keywords
- role play, large language models, dialogue agents, anthropomorphism, deception, folk psychology, AI ethics
- MeSH terms
- Humans, Imitative Behavior, Deception, Natural Language Processing, Terminology as Topic, Self-Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
