Exploring Large Language Models for Communication Games: An Empirical Study on Werewolf
Open accessAbstract
Communication games, which we refer to as incomplete information games that heavily depend on natural language communication, hold significant research value in fields such as economics, social science, and artificial intelligence. In this work, we explore the problem of how to engage large language models (LLMs) in communication games, and in response, propose a tuning-free framework. Our approach keeps LLMs frozen, and relies on the retrieval and reflection on past communications and experiences for improvement. An empirical study on the representative and widely-studied communication game, ``Werewolf'', demonstrates that our framework can effectively play Werewolf game without tuning the parameters of the LLMs. More importantly, strategic behaviors begin to emerge in our experiments, suggesting that it will be a fruitful journey to engage LLMs in communication games and associated domains.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Such frameworks are particularly well-suited for multi-agent execution scenarios with well-defined agent execution sequences, as exemplified by programming tasks and conversational games, as they can significantly simplify complex agent interaction processes.
“Such frameworks are particularly well-suited for multi-agent execution scenarios with well-defined agent execution sequences, as exemplified by programming tasks [50, 85] and conversational games [111], as they can significantly simplify complex agent interaction processes.”
From AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society (2025) · cites this paper as [111]
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredPrior multi-agent research has focused on highly constrained scenarios such as board games or narrowly defined collaborative tasks.
“Prior multi-agent research has focused on highly constrained scenarios such as board games or narrowly defined collaborative tasks [19, 45, 48, 64, 72].”
From Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents (2024) · cites this paper as [72]
The Related Work passage (indexed under §5.4 Leadership; page unavailable) describes prior game-playing AI in Go, chess, and poker, as well as Werewolf agents constrained by rules or talking templates. This supports the board-game and constrained-scenario portion, but the paper does not characterize prior multi-agent research as focused on narrowly defined collaborative tasks. (LLM, conf=0.83)
Experimental — accuracy not yet measuredTo ensure consistency, the authors augment each prompt with a comprehensive set of rules that outline the parameters of simulation and general dynamics.
“To ensure consistency, we augment each prompt with a comprehensive set of rules that outline the parameters of simulation and general dynamics, drawing inspiration from the methodology Xu et al. [72] explored.”
From Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents (2024) · cites this paper as Xu et al. [72]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
Cited by 32
Research works printed but not linked: 30
- Michael Bowling, Neil Burch, Michael Johanson, and Oskari Tammelin. 2015. Heads-up limit hold'em poker is solved. Science, 347(6218):145-149. · DOI
- Noam Brown and Tuomas Sandholm. 2018. Superhu- man AI for heads-up no-limit poker: Libratus beats top professionals. Science, 359(6374):418-424. · DOI
- Noam Brown and Tuomas Sandholm. 2019. Su- perhuman AI for multiplayer poker. Science, 365(6456):885-890. · DOI · Paper page
- Sébastien Bubeck, Varun Chandrasekaran, Ronen El- dan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lund- berg, et al. 2023. Sparks of artificial general intelli- gence: Early experiments with GPT-4. arXiv preprint arXiv:2303.12712. · arXiv
- Andrew M Dai and Quoc V Le. 2015. Semi-supervised sequence learning. Advances in NeurIPS 2015, 28.
- FAIR, Anton Bakhtin, Noam Brown, Emily Dinan, Gabriele Farina, Colin Flaherty, Daniel Fried, An- drew Goff, Jonathan Gray, Hengyuan Hu, et al. 2022. Human-level play in the game of diplomacy by com- bining language models with strategic reasoning. Sci- ence, 378(6624):1067-1074. · DOI · Paper page
- Yao Fu, Hao Peng, Tushar Khot, and Mirella Lapata. 2023. Improving language model negotiation with self-play and in-context learning from AI feedback. arXiv preprint arXiv:2305.10142. · arXiv
- Yuya Hirata, Michimasa Inaba, Kenichi Takahashi, Fu- jio Toriumi, Hirotaka Osawa, Daisuke Katagami, and Kousuke Shinoda. 2016. Werewolf game modeling using action probabilities based on play log analy- sis. In Computers and Games: 9th International Conference, pages 103-114. Springer. · DOI
- Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019. Parameter-efficient transfer learning for NLP. In ICML 2019, pages 2790-2799. PMLR.
- Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023. Survey of halluci- nation in natural language generation. ACM Comput- ing Surveys, 55(12):1-38. · DOI · Paper page
- Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yu- taka Matsuo, and Yusuke Iwasawa. 2022. Large lan- guage models are zero-shot reasoners. In Advances in NeurIPS 2022.
- Michal Kosinski. 2023. Theory of mind may have spon- taneously emerged in large language models. arXiv preprint arXiv:2302.02083. · arXiv
- János Kramár, Tom Eccles, Ian Gemp, Andrea Tac- chetti, Kevin R. McKee, Mateusz Malinowski, Thore Graepel, and Yoram Bachrach. 2022. Negotiation and honesty in artificial intelligence methods for the board game of Diplomacy. Nature Communications, 13(1):7214. · DOI
- Ruibo Liu, Ruixin Yang, Chenyan Jia, Ge Zhang, Denny Zhou, Andrew M Dai, Diyi Yang, and Soroush Vosoughi. 2023. Training socially aligned language models in simulated human society. arXiv preprint arXiv:2305.16960. · arXiv
- OpenAI. 2023. GPT-4 technical report. arXiv preprint arXiv:2303.08774. · arXiv
- Joon Sung Park, Joseph C O'Brien, Carrie J Cai, Mered- ith Ringel Morris, Percy Liang, and Michael S Bernstein. 2023. Generative agents: Interactive simulacra of human behavior. arXiv preprint arXiv:2304.03442. · arXiv
- Nils Reimers and Iryna Gurevych. 2019. Sentence- BERT: Sentence embeddings using Siamese BERT- networks. In Proceedings of EMNLP-IJCNLP 2019, pages 3982-3992, Hong Kong, China. Association for Computational Linguistics. · DOI · Paper page
- Hong Ri, Xiaohan Kang, Mohd Nor Akmal Khalid, and Hiroyuki Iida. 2022. The dynamics of minority versus majority behaviors: A case study of the mafia game. Information, 13(3). · DOI
- Natalie Shapira, Mosh Levy, Seyed Hossein Alavi, Xuhui Zhou, Yejin Choi, Yoav Goldberg, Maarten Sap, and Vered Shwartz. 2023. Clever hans or neural theory of mind? Stress testing social rea- soning in large language models. arXiv preprint arXiv:2305.14763. · arXiv
- Hisaichi Shibata, Soichiro Miki, and Yuta Nakamura. 2023. Playing the werewolf game with artificial intel- ligence for language understanding. arXiv preprint arXiv:2302.10646. · arXiv
- Noah Shinn, Beck Labash, and Ashwin Gopinath. 2023. Reflexion: an autonomous agent with dy- namic memory and self-reflection. arXiv preprint arXiv:2303.11366. · arXiv
- David Silver, Thomas Hubert, Julian Schrittwieser, Ioan- nis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, et al. 2018. A general reinforcement learn- ing algorithm that masters chess, shogi, and go through self-play. Science, 362(6419):1140-1144. · DOI · Paper page
- David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, et al. 2017. Mastering the game of go without human knowledge. Nature, 550(7676):354-359.
- Fujio Toriumi, Hirotaka Osawa, Michimasa Inaba, Daisuke Katagami, Kosuke Shinoda, and Hitoshi Matsubara. 2017. AI wolf contest-development of game ai using collective intelligence-. In Computer Games, pages 101-115. Springer. · DOI
- Danqing Wang and Lei Li. 2023. Learn from mistakes through cooperative interaction with study assistant. arXiv preprint arXiv:2305.13829. · arXiv
- Tianhe Wang and Tomoyuki Kaneko. 2018. Application of deep reinforcement learning in werewolf game agents. In TAAI 2018, pages 28-33. IEEE.
- Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed H Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-Thought prompting elicits rea- soning in large language models. In Advances in NeurIPS 2022.
- Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, and Nan Duan. 2023a. Visual ChatGPT: Talking, drawing and editing with visual foundation models. arXiv preprint arXiv:2303.04671. · arXiv
- Shunyu Yao, Jeffrey Zhao, Dian Yu, Izhak Shafran, Karthik R Narasimhan, and Yuan Cao. 2022. ReAct: Synergizing reasoning and acting in language models. In NeurIPS 2022 Foundation Models for Decision Making Workshop.
- Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc V Le, and Ed H. Chi. 2023. Least-to-most prompting enables com- plex reasoning in large language models. In ICLR 2023.
- Authors
- Xu, Y., Wang, S., Li, P., Luo, F., Wang, X., Liu, W., & Liu, Y.
- Affiliations
- Tsinghua University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2309.04658
- OpenAlex
- W4386644471
- Cited by
- 32
- References
- 0
- Citations by year
- 2026: 2 · 2025: 15 · 2024: 15
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Social Sciences › Decision Sciences › Management Science and Operations Research › Game Theory and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- large language models, communication games, werewolves, incomplete information games, strategic behavior, natural language communication, game-playing agents
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
