Human-level play in the game of Diplomacy by combining language models with strategic reasoning
The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Abstract
Despite much progress in training artificial intelligence (AI) systems to imitate human language, building agents that use language to communicate intentionally with humans in interactive environments remains a major challenge. We introduce Cicero, the first AI agent to achieve human-level performance in Diplomacy , a strategy game involving both cooperation and competition that emphasizes natural language negotiation and tactical coordination between seven players. Cicero integrates a language model with planning and reinforcement learning algorithms by inferring players' beliefs and intentions from its conversations and generating dialogue in pursuit of its plans. Across 40 games of an anonymous online Diplomacy league, Cicero achieved more than double the average score of the human players and ranked in the top 10% of participants who played more than one game.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Despite Meta’s efforts, CICERO turned out to be an expert liar.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“CICERO engages in premeditated deception, breaks the deals to which it had agreed, and tells outright falsehoods.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“We found numerous examples of deception that were not reported in the published paper.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“It not only betrayed other players but also engaged in premeditated deception, planning in advance to build a fake alliance with a human player in order to trick that player into leaving themselves undefended for an attack.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“The CICERO project picked Diplomacy in order to evaluate the abilities of AI systems to learn how to compete in games that involve human cooperation, where the AI cannot simply master the game through running simulations against itself.4”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Self-citationLewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816 · cited 1×
“7 billion–parameter Transformer-based (23) encoder-decoder model pretrained on text from the internet by using a BART denoising objective (24).”
MethodSelf-citationNash, J. (1951) · The Annals of Mathematics · doi:10.2307/1969529 · Cited by 7,002
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562
Research works printed but not linked: 16
- A. Bakhtin. Mastering the game of no-press Diplomacy via human-regularized reinforcement learning and planning. arXiv:2210.05492 [cs.GT] (2022). · arXiv
- A. Holtzman J. Buys L. Du M. Forbes Y. Choi The curious case of neural text degeneration 8th International Conference on Learning Representations ICLR 2020 Addis Ababa Ethiopia April 26-30 2020 (OpenReview.net 2020).
- A. Vaswani et al . Attention is all you need in Advances in Neural Information Processing Systems I. Guyon et al. eds. (Curran Associates Inc. 2017) vol. 30.
- A. P. Jacob et al . Modeling strong and human-like gameplay with KL-regularized search in International Conference on Machine Learning (PMLR 2022) pp. 9695–9728.
- Z. Ji. Survey of hallucination in natural language generation. arXiv:2202.03629 [cs.CL] (2022). · arXiv
- C. Berner. Dota 2 with large scale deep reinforcement learning. arXiv:1912.06680 (2019). · arXiv
- N. Carlini et al . Extracting training data from large language models in 30th USENIX Security Symposium (USENIX Security 21) (2021) pp. 2633–2650.
- R. Zellers et al . Defending against neural fake news in Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019 NeurIPS 2019 December 8–14 2019 Vancouver BC Canada H. M. Wallach et al. eds. (2019) pp. 9051–9062.
- J. Gray A. Lerer A. Bakhtin N. Brown Human-level performance in no-press Diplomacy via equilibrium search in International Conference on Learning Representations (2020).
- D. Yarats M. Lewis Hierarchical text generation and planning for strategic dialogue in International Conference on Machine Learning (PMLR 2018) pp. 5591–5599.
- S. Afantenos et al . Developing a corpus of strategic conversation in The Settlers of Catan Workshop on Games and NLP (GAMNLP-12) (2012).
- H. Cuayáhuitl S. Keizer O. Lemon Strategic dialogue management via deep reinforcement learning in NeurIPS Workshop on Deep Reinforcement Learning (2015).
- A. Radford, Language models are unsupervised multitask learners. OpenAI blog 1, 9 (2019).
- D. P. Kingma J. Ba Adam: A method for stochastic optimization in 3rd International Conference on Learning Representations ICLR 2015 San Diego CA USA May 7-9 2015 Conference Track Proceedings Y. Bengio Y. LeCun eds. (2015).
- E. M. Smith D. Gonzalez-Rico E. Dinan Y. Boureau Controlling style in generated dialogue. arXiv:2009.10855 [cs.CL] (2020). · arXiv
- J. Xu Recipes for safety in open-domain chatbots. arXiv:2010.07079 [cs.CL] (2020). · arXiv
Cited by
Items 101–200 of 404
Risk negotiation: a framework for One Health risk analysis
Ehling‐Schulz, M., Filter, M., Zinsstag, J., Koutsoumanis, K. P., Ellouze, M., Teichmann, J., Hilbeck, A., Tonolla, M., Etter, D., Stärk, K. D. C., et al. (2024) · Bulletin of the World Health Organization · doi:10.2471/blt.23.290672 · Cited by 14
AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making
Huang, Y., Wang, X., Liu, H., Kong, F., Qin, A., Tang, M., Zhu, S. C., Li, Y., Qi, S., & Xue, F. (2024) · neural information processing systems · doi:10.52202/079017-1115 · Cited by 26
PokéChamp: an Expert-level Minimax Language AgentPreprint
Karten, S., Nguyen, A. L., & Jin, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.04094 · Cited by 17
Wernli, D. (2023) · Journal of Computational Science · doi:10.1016/j.jocs.2023.102096 · Cited by 13
Nadizar, G., Medvet, E., Nichele, S., & Pontes-Filho, S. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110610 · Cited by 16
Strategic Tradeoffs Between Humans and AI in Multi-Agent Bargaining
Qian, C., Zhu, K., Horton, J. J., Manning, B. S., Tsai, V., Wexler, J., & Thain, N. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789078 · Cited by 21
Modeling Cross-Cultural Pragmatic Inference with Codenames Duet
Shaikh, O., Ziems, C., Held, W., Pariani, A., Morstatter, F., & Yang, D. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.410 · Cited by 29
Perspectives on the promise and perils of generative AI in academia
Yawson, R. M. (2024) · Human Resource Development International · doi:10.1080/13678868.2024.2334983 · Cited by 12
What Is It for a Machine Learning Model to Have a Capability?
Harding, J., & Sharadin, N. (2024) · The British Journal for the Philosophy of Science · doi:10.1086/732153 · Cited by 20
Dynamic Reinforcement Learning for Optimal Go AI Training: Adaptive Adjustment and Optimization
Zhang, C., Shan, G., Lim, J., & Roh, B. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3487141 · Cited by 12
Ma, Z., Mei, Y., Bruderlein, C., Gajos, K. Z., & Pan, W. (2025) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3729176.3729194 · Cited by 28
Demonstrating Large Language Models on Robots
DeepMind, G. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.024 · Cited by 13
Ruiz-Serra, J., & Harré, M. (2023) · Algorithms · doi:10.3390/a16020068 · Cited by 24
Evaluating & Reducing Deceptive Dialogue From Language Models with Multi-turn RLPreprint
Abdulhai, M., Cheng, R., Shrivastava, A., Jaques, N., Gal, Y., & Levine, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.14318 · Cited by 13
AppAgent: Multimodal Agents as Smartphone Users
Zhang, C., Yang, Z., Liu, J., Li, Y., Han, Y., Chen, X., Huang, Z., Fu, B., & Yu, G. (2023) · arXiv · doi:10.48550/arxiv.2312.13771 · Cited by 11
Effect of Private Deliberation: Deception of Large Language Models in Game Play
Poje, K., Brčić, M., Kovač, M., & Babac, M. B. (2024) · Entropy · doi:10.3390/e26060524 · Cited by 19
Assessing the risk of takeover catastrophe from large language models
Baum, S. D. (2024) · Risk Analysis · doi:10.1111/risa.14353 · Cited by 11
Hundred-layer photonic deep learning
Zhou, T., Jiang, Y., Xu, Z., Xue, Z., & Fang, L. (2025) · Nature Communications · doi:10.1038/s41467-025-65356-0 · Cited by 15
Alon, N., Schulz, L., Rosenschein, J. S., & Dayan, P. (2023) · Open Mind · doi:10.1162/opmi_a_00097 · Cited by 27
Lee, S., Lai, B., Ryan, F., Boote, B., & Rehg, J. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01382 · Cited by 25
Symbolic equation solving via reinforcement learning
Dabelow, L., & Ueda, M. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128732 · Cited by 16
Ten Hard Problems in Artificial Intelligence We Must Get RightPreprint
Leech, G., Garfinkel, S., Yagudin, M., Briand, A., & Zhuravlev, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.04464 · Cited by 14
CalBench: Evaluating Coordination-Privacy Trade-offs in Multi-Agent LLMsPreprint
Zou, C., Yao, Y., She, S., Goodman, N. D., & Hawkins, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.09823 · Cited by 11
A Mechanism-Based Approach to Mitigating Harms from Persuasive Generative AI
El-Sayed, S., Akbulut, C., McCroskery, A., Keeling, G., Kenton, Z., Jalan, Z., Marchal, N., Manzini, A., Shevlane, T., Vallor, S., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.15058 · Cited by 10
Zhang, M., Kuang, M., Shi, H. H., Zhu, J., Zhu, J., & Jiang, X. (2025) · Defence Technology · doi:10.1016/j.dt.2025.09.004 · Cited by 11
Scaling Opponent Shaping to High Dimensional Games
Khan, A., Willi, T., Kwan, N., Tacchetti, A., Lu, C., Grefenstette, E., Rocktäschel, T., & Foerster, J. (2024) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/tpmy7673 · Cited by 16
Machine Learning and Artificial Intelligence to Improve Interpretation of Urodynamics
Knorr, J. M., & Werneburg, G. T. (2024) · Current Bladder Dysfunction Reports · doi:10.1007/s11884-023-00734-2 · Cited by 10
When AI Joins the Negotiation Table: Evaluating AI as a Moderator
Kobiella, C., Isroilov, U., & Schmidt, A. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3736630 · Cited by 13
When control meets large language models: From words to dynamics
Nosrati, K., Tepljakov, A., Belikov, J., & Petlenkov, E. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115119 · Cited by 12
Unmasking the Shadows of AI: Investigating Deceptive Capabilities in Large Language ModelsPreprint
Guo, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.09676 · Cited by 9
Cognitive phantoms in large language models through the lens of latent variables
Peereboom, S., Schwabe, I., & Kleinberg, B. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100161 · Cited by 8
Diplomacy in the Age of AI: Challenges and Opportunities
Varela, D. T. (2024) · Journal of Artificial Intelligence General science (JAIGS) · doi:10.60087/jaigs.v2i1.101 · Cited by 8
Shaped-Charge Learning Architecture for the Human–Machine Teams
Galitsky, B. A., Ilvovsky, D., & Goldberg, S. I. (2023) · Entropy · doi:10.3390/e25060924 · Cited by 9
Scalable Interactive Machine Learning for Future Command and Control
Madison, A., Novoseller, E., Goecks, V. G., Files, B. T., Waytowich, N. R., Yu, A., Lawhern, V. J., Thurman, S. M., Kelshaw, C., & McDowell, K. (2024) · International Conference on Military Communications and Information Systems (ICMCIS) · doi:10.1109/icmcis61231.2024.10540933 · Cited by 11
On the Complexity of Multi-Agent Decision Making: From Learning in Games to Partial MonitoringPreprint
Foster, D. J., Foster, D. P., Golowich, N., & Rakhlin, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.00684 · Cited by 8
Cohesive Conversations: Enhancing Authenticity in Multi-Agent Simulated DialoguesPreprint
Chu, K., Chen, Y.-P., & Nakayama, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.09897 · Cited by 10
Simulating Multi-Stakeholder Decision-Making with Generative Agents in Urban Planning
Gao, J., Xu, H., & Dao, N.-L. (2025) · Advances in transdisciplinary engineering · doi:10.3233/atde251076 · Cited by 7
Neuroevolution for Autonomous Cyber Defense
Heckel, K. (2023) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3583133.3590596 · Cited by 10
Improved Instruction Ordering in Recipe-Grounded Conversation
Le, D., Guo, R., Xu, W. H., & Ritter, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.561 · Cited by 12
Learning to Move Like Professional Counter‐Strike Players
Durst, D., Xie, F., Sarukkai, V., Shacklett, B., Frosio, I., Tessler, C., Kim, J., Taylor, C., Bernstein, G., Choudhury, S., et al. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15173 · Cited by 7
Traffic Signal Control with Successor Feature-Based Deep Reinforcement Learning Agent
Szőke, L., Aradi, S., & Bécsi, T. (2023) · Electronics · doi:10.3390/electronics12061442 · Cited by 8
Do Deep Reinforcement Learning Agents Model Intentions?
Matiisen, T., Labash, A., Majoral, D., Aru, J., & Vicente, R. (2022) · Stats · doi:10.3390/stats6010004 · Cited by 7
Lanctot, M., Schultz, J., BURCH, N. R., Smith, M., Hennes, D., Anthony, T., & Pérolat, J. (2023) · Transactions on machine learning research · doi:10.48550/arxiv.2303.03196 · Cited by 16
Missed Connections: Lateral Thinking Puzzles for Large Language Models
Todd, G., Merino, T., Earle, S., & Togelius, J. (2024) · 2024 IEEE Conference on Games (CoG) · doi:10.1109/cog60054.2024.10645557 · Cited by 6
Cha, H., & Kim, J. (2025) · Clinical and Experimental Emergency Medicine · doi:10.15441/ceem.25.199 · Cited by 10
Diplomacy in the Age of AI: Challenges and Opportunities
Varela, D. T. (2024) · Journal of Artificial Intelligence General science (JAIGS) · doi:10.60087/jaigs.v2i1.p110 · Cited by 6
Artificial intelligence, digital social networks, and climate emotions
Galaz, V., Metzler, H., Schill, C., Lindahl, T., Daume, S., Marklund, A., Castro, A. A., Bard, J. S., McPhearson, T., Galafassi, D., et al. (2025) · npj Climate Action · doi:10.1038/s44168-025-00225-6 · Cited by 20
Gamification as an Innovative Approach for the Assessment of Procedural Knowledge
Chen, K., Yang, S., Luh, D.-B., Chen, Z., Ai, H., & An, Y. (2025) · Electronics · doi:10.3390/electronics14081573 · Cited by 6
Among Them: A Game-Based Framework for Assessing Persuasion Capabilities of LLMs
Idziejczak, M., Korzavatykh, V., Stawicki, M., Chmutov, A., Korcz, M., Błądek, I., & Brzeziński, D. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8186-0_15 · Cited by 11
Soft Condorcet Optimization for Ranking of General Agents
Lanctot, M., Larson, K. S., Kaisers, M., Berthet, Q., Gemp, I., Diaz, M., Maura-Rivero, R.-R., Bachrach, Y., Koop, A., & Precup, D. (2025) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/fkek1875 · Cited by 6
PyTAG: Tabletop Games for Multiagent Reinforcement Learning
Balla, M., Long, G. E. M., Goodman, J., Gaina, R. D., & Pérez-Liébana, D. (2024) · IEEE Transactions on Games · doi:10.1109/tg.2024.3404133 · Cited by 6
The decade of artificial intelligence in chemistry and materials
Aspuru‐Guzik, A. (2023) · Digital Discovery · doi:10.1039/d3dd90001k · Cited by 6
Lessons from the Trenches on Reproducible Evaluation of Language Models
Biderman, S., Schoelkopf, H., Sutawika, L., Gao, L., Tow, J., Abbasi, B., Aji, A. F., Ammanamanchi, P. S., Black, S., Clive, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.14782 · Cited by 9
Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · arXiv · doi:10.48550/arxiv.2505.22954 · Cited by 344
The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes
Ko, M., Kang, F., Shi, W., Jin, M., Yu, Z., & Jia, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02483 · Cited by 20
Self-citationBaba Is LLM: Reasoning in a Game with Dynamic Rules
van Wetten, F., Plaat, A., & van Duijn, M. J. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-15632-7_4 · Cited by 6
A Conversational Brain–Artificial Intelligence Interface
Meunier, A., Žák, M. R., Munz, L., Garkot, S., Eder, M., Xu, J., & Grosse‐Wentrup, M. (2026) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2026.3703091 · Cited by 5
Risk-Aware Continuous Control with Neural Contextual Bandits
Ayala-Romero, J., Garcia-Saavedra, A., & Pérez-Costa, X. (2023) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30083 · Cited by 9
Wang, H., Wang, W., Xie, Z., Yang, Y., Dai, H., Shi, F., Ma, L., Sui, Z., Xia, C., Kong, X., et al. (2024) · Planta · doi:10.1007/s00425-024-04408-z · Cited by 7
Understanding Iterative Combinatorial Auction Designs via Multi-Agent Reinforcement Learning
d'Eon, G., Newman, N., & Leyton‐Brown, K. (2024) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3670865.3673644 · Cited by 5
GraphChase: A Platform and Benchmark for Urban Network Security Games
Zhuang, S., Li, S., Yang, T., Li, M., Shi, X., An, B., & Zhang, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817540 · Cited by 5
Feel the Connection: Haptic Enhanced Interaction with an AI Agent
Kianzad, S., Li, Y., & Seifi, H. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3720173 · Cited by 5
Harnessing Language for Coordination: A Framework and Benchmark for LLM-Driven Multiagent Control
Anne, T., Syrkis, N., Elhosni, M., Turati, F., Legendre, F., Jaquier, A., & Risi, S. (2025) · IEEE Transactions on Games · doi:10.1109/tg.2025.3564042 · Cited by 12
Coronel, J. C., Sweitzer, M. D., Bonus, J. A., Dore, R. A., & Lerner, B. (2025) · Journal of Communication · doi:10.1093/joc/jqaf036 · Cited by 7
Unveiling the Enigma of Shadow: Ethical Difficulties in the Field of AI
Catherine, S., Suresh, N. V., Mangaiyarkarasi, T., & Jenefa, L. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83608-298-920251004 · Cited by 5
When neuro-robots go wrong: A review
Khan, M. S., & Olds, J. L. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1112839 · Cited by 5
Language Model Alignment with Elastic Reset
Noukhovitch, M., Lavoie, S., Strub, F., & Courville, A. C. (2023) · neural information processing systems · doi:10.52202/075280-0152 · Cited by 35
Personalization for web-based services using offline reinforcement learning
Apostolopoulos, P. A., Wang, Z., Wang, H., Xu, T., Zhou, C., Virochsiri, K., Zhou, N., & Markov, I. L. (2024) · Machine Learning · doi:10.1007/s10994-024-06525-y · Cited by 5
An Assessment of Model-On-Model DeceptionPreprint
Heitkoetter, J., Gerovitch, M., & Newhouse, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.12999 · Cited by 7
OpenSIR: Open-Ended Self-Improving ReasonerPreprint
Kwan, W.-C., Leang, J. O. J., Vougiouklis, P., Pan, J. Z., Valentino, M., & Minervini, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.00602 · Cited by 8
GameTalk: Training LLMs for Strategic ConversationPreprint
Vendrell, V. C., Luyten, M. R., & van der Schaar, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.16276 · Cited by 6
Towards Generalist Game Agents: A Survey of Foundation Models in Virtual Worlds
Zhang, K., Liu, D., Zhao, Q., Xin, T., Su, Y., Wang, H., Yin, H., Ma, H., Li, P., Gu, T., et al. (2026) · Transactions on machine learning research · doi:10.48550/arxiv.2605.09965 · Cited by 5
Distilling Game Code World Model Generation into Lightweight Large Language ModelsPreprint
Serapio, T., Prakash, A., Xu, H., Wang, K., & Greenwald, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.24375 · Cited by 5
Social Intelligence Enhancement Methods for LLM Agents Based on Retrieval-Augmented Generation
Zhang, Z., Yang, W., & Zheng, X. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865026 · Cited by 4
Stepputtis, S., Campbell, J., Xie, Y., Qi, Z., Zhang, W., Wang, R., Rangreji, S., Lewis, C., & Sycara, K. P. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.748 · Cited by 18
Response-conditioned Turn-taking Prediction
Jiang, B., Ekstedt, E., & Skantze, G. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.776 · Cited by 15
PyTAG: Challenges and Opportunities for Reinforcement Learning in Tabletop Games
Balla, M., Long, G. E. M., Jeurissen, D., Goodman, J., Gaina, R. D., & Pérez-Liébana, D. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333223 · Cited by 4
Smooth Nash Equilibria: Algorithms and ComplexityPreprint
Daskalakis, C., Golowich, N., Haghtalab, N., & Shetty, A. (2023) · arXiv (Cornell University) · doi:10.4230/lipics.itcs.2024.37 · Cited by 4
Humanity Amplified: The Fusion of Deep Learning and Human Insight to Shape the Future of InnovationPreprint
Bauschard, S., & Quidwai, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4621210 · Cited by 6
Lin, Z., Shen, S., Cheng, Z., Lai, C. L., & Chen, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.18145 · Cited by 6
The Prompt War: How AI Decides on a Military InterventionPreprint
Chupilkin, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.06277 · Cited by 4
AI Agents as Policymakers in Simulated EpidemicsPreprint
Aoki, G., & Ghaffarzadegan, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.04245 · Cited by 5
Teaching Large Language Models to Reason with Reinforcement Learning
Havrilla, A., Du, Y., Raparthy, S. C., Nalmpantis, C., Dwivedi-Yu, J., Zhuravinskyi, M., Hambro, E., Sukhbaatar, S., & Raileanu, R. (2024) · arXiv · doi:10.48550/arxiv.2403.04642 · Cited by 3
“Previous work in reinforcement learning (RL) such as Al-phaGo (Silver et al., 2017), AlphaStar (Vinyals et al., 2019), and OpenAI Dota 2 (Berner et al., 2019) demonstrate that RL techniques can be used to train neural networks capable of sophisticated planning and reasoning in game environments.”
Symbolic Planning and Code Generation for Grounded Dialogue
Chiu, J., Zhao, W., Chen, D., Vaduguru, S., Rush, A. M., & Fried, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.460 · Cited by 8
Self-citationReconceptualizing LLM-Induced Hallucinations as Game Features
Vi, K., Chen, M., Sun, Y., Ming, Y., & Wang, F. (2025) · doi:10.26503/dl.v2025i2.2426 · Cited by 4
Gratch, J. (2026) · Negotiation Journal · doi:10.1162/ngtn.a.65 · Cited by 4
BEDA: Belief Estimation as Probabilistic Constraints for Performing Strategic Dialogue Acts
Li, H., Yu, Z., Shen, Q., Li, C., Wang, M., Wu, T., Kang, Y., Wang, Y., Zhu, S. C., Jia, Z., et al. (2026) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/zjjg5330 · Cited by 3
Rethinking Scientific Practice in the Age of Artificial Intelligence
Eren, M. E., & Perez, D. M. (2026) · ACM AI Letters · doi:10.1145/3803866 · Cited by 3
Safe and Scalable Collaboration in Multiagent LLM Systems: A Comprehensive Review
Hossain, E., Nipu, M. M. H., Mahmood, M. S., Hossen, M. J., & Mridha, M. F. (2026) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2026.3704902 · Cited by 4
Define, Evaluate, and Improve Task-Oriented Cognitive Capabilities for Instruction Generation Models
Zhao, L., Nguyen, K., & Daumé, H. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.227 · Cited by 10
Bown, O., Grace, K. S., Ocampo, R., & Ibarrola, F. (2025) · Creativity Research Journal · doi:10.1080/10400419.2025.2501735 · Cited by 3
Dynamic Coalition Structure Detection in Natural-Language-based Interactions
Kulkarni, A. N., Liu, A. W., Gaglione, J.-R., Fried, D., & Topcu, U. (2025) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/axnw2538 · Cited by 3
Self-citationShi-jie, H., Li, S., An, B., Zhao, W., & Liu, P. (2023) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-023-09620-x · Cited by 4
Ockenfels, A. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23001139 · Cited by 5
Trust and Generative Artificial Intelligence: A Reply to Killoran, Park, and Kietzmann
Vanneste, B. S., & Puranam, P. (2024) · Academy of Management Review · doi:10.5465/amr.2024.0397 · Cited by 3
Towards automating Codenames spymasters with deep reinforcement learningPreprint
Siu, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.14104 · Cited by 3
Learning When to Quit in Sales ConversationsPreprint
Manzoor, E., Ascarza, E., & Netzer, O. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5692084 · Cited by 8
AI Finds A WayPreprint
Dharna, A., Lu, C., Sullivan, R., Lehman, J., Krakovna, V., & Clune, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23875 · Cited by 3
Rahman, A., Yu, A., & Cho, K. (2026) · Systems · doi:10.3390/systems14020175 · Cited by 2
Sabotage Evaluations for Frontier Models
Benton, J., Wagner, M., Christiansen, E., Anil, C., Perez, E., Srivastav, J., Durmus, E., Ganguli, D., Kravec, S., Shlegeris, B., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.21514 · Cited by 2
Metadata
- Authors
- Meta Fundamental AI Research Diplomacy Team (FAIR)†, Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., Jacob, A. P., Komeili, M., Konath, K., Kwon, M., Lerer, A., Lewis, M., Miller, A. H., Mitts, S., Renduchintala, A., Roller, S., Rowe, D., Shi, W., Spisak, J., Wei, A., Wu, D., Zhang, H., & Zijlstra, M.
- Affiliations
- Meta (United States) (US)
- Harvard University (US)
- Corresponding author
- Bakhtin, Anton
- Brown, Noam
- Dinan, Emily
- Flaherty, Colin
- Gray, Jonathan
- Hu, Hengyuan
- Jacob, Athul Paul
- Lerer, Adam
- Lewis, Mike
- Miller, Alexander H.
- Renduchintala, Adithya
- Shi, Weiyan
- Wu, David
- Zhang, Hugh
- ORCID
- Venue
- Science
- Published
- 2022-12-09
- Volume
- 378
- Issue
- 6624
- Pages
- 1067-1074
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4309663019
- Cited by
- 241
- References
- 65
- Citations by year
- 2026: 67 · 2025: 69 · 2024: 59 · 2023: 43 · 2022: 2
- FWCI
- 14.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Keywords
- diplomacy, AI agents, human-AI interaction, strategic reasoning, language models, belief inference, dialogue generation, planning, reinforcement learning, Cicero
- MeSH terms
- Diplomacy, Artificial Intelligence, Humans, Language, Software, Video Games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.