Human-level play in the game of Diplomacy by combining language models with strategic reasoning
The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Abstract
Despite much progress in training artificial intelligence (AI) systems to imitate human language, building agents that use language to communicate intentionally with humans in interactive environments remains a major challenge. We introduce Cicero, the first AI agent to achieve human-level performance in Diplomacy , a strategy game involving both cooperation and competition that emphasizes natural language negotiation and tactical coordination between seven players. Cicero integrates a language model with planning and reinforcement learning algorithms by inferring players' beliefs and intentions from its conversations and generating dialogue in pursuit of its plans. Across 40 games of an anonymous online Diplomacy league, Cicero achieved more than double the average score of the human players and ranked in the top 10% of participants who played more than one game.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Despite Meta’s efforts, CICERO turned out to be an expert liar.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“CICERO engages in premeditated deception, breaks the deals to which it had agreed, and tells outright falsehoods.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“We found numerous examples of deception that were not reported in the published paper.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“It not only betrayed other players but also engaged in premeditated deception, planning in advance to build a fake alliance with a human player in order to trick that player into leaving themselves undefended for an attack.”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
In the citing paper
“The CICERO project picked Diplomacy in order to evaluate the abilities of AI systems to learn how to compete in games that involve human cooperation, where the AI cannot simply master the game through running simulations against itself.4”
From AI deception: A survey of examples, risks, and potential solutions (2024) · cites this paper as [4]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Self-citationLewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
Self-citationNash, J. (1951) · The Annals of Mathematics · doi:10.2307/1969529 · Cited by 7,002
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562
Research works printed but not linked: 16
- A. Bakhtin. Mastering the game of no-press Diplomacy via human-regularized reinforcement learning and planning. arXiv:2210.05492 [cs.GT] (2022). · arXiv
- A. Holtzman J. Buys L. Du M. Forbes Y. Choi The curious case of neural text degeneration 8th International Conference on Learning Representations ICLR 2020 Addis Ababa Ethiopia April 26-30 2020 (OpenReview.net 2020).
- A. Vaswani et al . Attention is all you need in Advances in Neural Information Processing Systems I. Guyon et al. eds. (Curran Associates Inc. 2017) vol. 30.
- A. P. Jacob et al . Modeling strong and human-like gameplay with KL-regularized search in International Conference on Machine Learning (PMLR 2022) pp. 9695–9728.
- Z. Ji. Survey of hallucination in natural language generation. arXiv:2202.03629 [cs.CL] (2022). · arXiv
- C. Berner. Dota 2 with large scale deep reinforcement learning. arXiv:1912.06680 (2019). · arXiv
- N. Carlini et al . Extracting training data from large language models in 30th USENIX Security Symposium (USENIX Security 21) (2021) pp. 2633–2650.
- R. Zellers et al . Defending against neural fake news in Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019 NeurIPS 2019 December 8–14 2019 Vancouver BC Canada H. M. Wallach et al. eds. (2019) pp. 9051–9062.
- J. Gray A. Lerer A. Bakhtin N. Brown Human-level performance in no-press Diplomacy via equilibrium search in International Conference on Learning Representations (2020).
- D. Yarats M. Lewis Hierarchical text generation and planning for strategic dialogue in International Conference on Machine Learning (PMLR 2018) pp. 5591–5599.
- S. Afantenos et al . Developing a corpus of strategic conversation in The Settlers of Catan Workshop on Games and NLP (GAMNLP-12) (2012).
- H. Cuayáhuitl S. Keizer O. Lemon Strategic dialogue management via deep reinforcement learning in NeurIPS Workshop on Deep Reinforcement Learning (2015).
- A. Radford, Language models are unsupervised multitask learners. OpenAI blog 1, 9 (2019).
- D. P. Kingma J. Ba Adam: A method for stochastic optimization in 3rd International Conference on Learning Representations ICLR 2015 San Diego CA USA May 7-9 2015 Conference Track Proceedings Y. Bengio Y. LeCun eds. (2015).
- E. M. Smith D. Gonzalez-Rico E. Dinan Y. Boureau Controlling style in generated dialogue. arXiv:2009.10855 [cs.CL] (2020). · arXiv
- J. Xu Recipes for safety in open-domain chatbots. arXiv:2010.07079 [cs.CL] (2020). · arXiv
Cited by
The Rise and Potential of Large Language Model Based Agents: A Survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.07864 · Cited by 972
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970
AppAgent: Multimodal Agents as Smartphone Users
Zhang, C., Yang, Z., Liu, J., Li, Y., Han, Y., Chen, X., Huang, Z., Fu, B., & Yu, G. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713600 · Cited by 652
A survey on LLM-based multi-agent systems: Workflow, infrastructure, and challenges
Li, X., Wang, S., Zeng, S., Wu, Y., & Yang, Y. (2024) · Vicinagearth · doi:10.1007/s44336-024-00009-2 · Cited by 404
Can Generative AI improve social science?
Bail, C. A. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2314021121 · Cited by 369
Can Generative AI Improve Social Science?
Bail, C. A. (2023) · doi:10.31235/osf.io/rwtzs · Cited by 369
Large language models empowered agent-based modeling and simulation: a survey and perspectives
Gao, C., Lan, X., Li, N., Yuan, Y., Ding, J., Zhou, Z., Xu, F., & Li, Y. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03611-3 · Cited by 294
Artificial Intelligence and Democracy: A Conceptual Framework
Jungherr, A. (2023) · Social Media + Society · doi:10.1177/20563051231186353 · Cited by 180
AI deception: A survey of examples, risks, and potential solutions
Park, P. S., Goldstein, S., O’Gara, A., Chen, M., & Hendrycks, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100988 · Cited by 243
AI Deception: A Survey of Examples, Risks, and Potential Solutions
Park, P. S., Goldstein, S., O'Gara, A., Chen, M., & Hendrycks, D. (2023) · arXiv · doi:10.48550/arxiv.2308.14752 · Cited by 243
Human-AI agency in the age of generative AI
Krakowski, S. (2025) · Information and Organization · doi:10.1016/j.infoandorg.2025.100560 · Cited by 162
SOTOPIA: Interactive Evaluation for Social Intelligence in Language AgentsPreprint
Zhou, X., Zhu, H., Mathur, L., Zhang, R., Yu, H.-F., Qi, Z.-Y., Morency, L., Bisk, Y., Fried, D., Neubig, G., et al. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.11667 · Cited by 502
Self-citationMetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
Hong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S. K. S., Lin, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.00352 · Cited by 2,825
AI agents under threat: A survey of key security challenges and future pathways
Deng, Z., Guo, Y., Han, C., Ma, W., Xiong, J., Wen, S., & Xiang, Y. (2025) · ACM Computing Surveys · doi:10.1145/3716628 · Cited by 210
“Meta aimed to train Cicero to be "largely honest and helpful to its speaking partners" [41].”
Language models generalize beyond natural proteins
Verkuil, R., Kabeli, O., Du, Y., Wicky, B. I. M., Milles, L. F., Dauparas, J., Baker, D., Ovchinnikov, S., Sercu, T., & Rives, A. (2022) · doi:10.1101/2022.12.21.521521 · Cited by 181
Harms from Increasingly Agentic Algorithmic Systems
Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594033 · Cited by 149
Characterizing Manipulation from AI Systems
Carroll, M., Chan, A., Ashton, H., & Krueger, D. (2023) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3617694.3623226 · Cited by 60
Building machines that learn and think with people
Collins, K. M., Sucholutsky, I., Bhatt, U., Chandra, K., Wong, L., Lee, M., Zhang, C. E., Zhi-Xuan, T., Ho, M., Mansinghka, V., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01991-9 · Cited by 73
Mathematics, word problems, common sense, and artificial intelligence
Davis, E. (2024) · Bulletin of the American Mathematical Society · doi:10.1090/bull/1828 · Cited by 125
LLM-generated messages can persuade humans on policy issues
Bai, H., Voelkel, J. G., Muldowney, S., Eichstaedt, J. C., & Willer, R. (2025) · Nature Communications · doi:10.1038/s41467-025-61345-5 · Cited by 110
AI et al.: Machines Are About to Change Scientific Publishing Forever
Grimaldi, G., & Ehrler, B. (2023) · ACS Energy Letters · doi:10.1021/acsenergylett.2c02828 · Cited by 91
Deception abilities emerged in large language models
Hagendorff, T. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2317967121 · Cited by 100
Deep Reinforcement Learning: A Chronological Overview and Methods
Terven, J. R. (2025) · AI · doi:10.3390/ai6030046 · Cited by 122
Irfan, B., Kuoppamäki, S., Hosseini, A., & Skantze, G. (2025) · Autonomous Robots · doi:10.1007/s10514-025-10190-y · Cited by 108
Planning In Natural Language Improves LLM Search For Code Generation
Wang, E., Cassano, F., Wu, C., Bai, Y., Song, W., Nath, V., Han, Z., Hendryx, S., Yue, S., & Zhang, H. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2409.03733 · Cited by 113
Self-citationMoral consideration for AI systems by 2030
Sebo, J., & Long, R. (2025) · AI and Ethics · doi:10.1007/s43681-023-00379-1 · Cited by 80
Agentic profiles for effective AI governance
Kasirzadeh, A., & Gabriel, I. (2026) · Nature · doi:10.1038/s41586-026-10805-z · Cited by 89
Interactive Natural Language ProcessingPreprint
Wang, Z., Zhang, G., Yang, K., Shi, N., Zhou, W., Hao, S., Xiong, G., Li, Y., Sim, M. Y., Chen, X., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.13246 · Cited by 112
AgentAI: A comprehensive survey on autonomous agents in distributed AI for industry 4.0
Piccialli, F., Chiaro, D., Sarwar, S., Cerciello, D., Qi, P., & Mele, V. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128404 · Cited by 77
Escalation Risks from Language Models in Military and Diplomatic Decision-Making
Rivera, J.-P., Mukobi, G., Reuel, A., Lamparth, M., Smith, C., & Schneider, J. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3658942 · Cited by 77
Photonic Neural Networks Based on Integrated Silicon Microresonators
Biasi, S., Donati, G. P., Lugnan, A., Mancinelli, M., Staffoli, E., & Pavesi, L. (2023) · Intelligent Computing · doi:10.34133/icomputing.0067 · Cited by 79
Expertise increases planning depth in human gameplay
van Opheusden, B., Kuperwajs, I., Galbiati, G., Bnaya, Z., Li, Y., & Ma, W. J. (2023) · Nature · doi:10.1038/s41586-023-06124-2 · Cited by 74
Decision-Oriented Dialogue for Human-AI Collaboration
Lin, J., Tomlin, N., Andreas, J., & Eisner, J. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00679 · Cited by 34
LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language ModelsPreprint
Abdulhai, M., White, I., Snell, C., Sun, C., Hong, J., Zhai, Y., Xu, K., & Levine, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.18232 · Cited by 98
Reinforcement Learning: An OverviewPreprint
Murphy, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.05265 · Cited by 91
The alignment problem from a deep learning perspective
Ngo, R., Chan, L., & Mindermann, S. (2022) · arXiv · doi:10.48550/arxiv.2209.00626 · Cited by 68
“These networks have reached human-level performance in complex games like StarCraft 2 [Vinyals et al., 2019] and Diplomacy [Bakhtin et al., 2022], while also exhibiting growing generality [Bom-masani et al., 2021] through improvements in areas including sample efficiency [Brown et al., 2020, Dorner,…”
BackgroundLarge language models as tax attorneys: a case study in legal capabilities emergence
Nay, J. J., Karamardian, D., Lawsky, S. B., Tao, W., Bhat, M., Jain, R., Lee, A. T., Choi, J. H., & Kasai, J. (2024) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2023.0159 · Cited by 40
The defeat of the Winograd Schema Challenge
Kocijan, V., Davis, E., Lukasiewicz, T., Marcus, G., & Morgenstern, L. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103971 · Cited by 78
Hoodwinked: Deception and Cooperation in a Text-Based Game for Language ModelsPreprint
O’Gara, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.01404 · Cited by 89
Student of Games: A unified learning algorithm for both perfect and imperfect information games
Schmid, M., Moravčík, M., BURCH, N. R., Kadlec, R., Davidson, J., Waugh, K., Bard, N., Timbers, F., Lanctot, M., Holland, G. Z., et al. (2023) · Science Advances · doi:10.1126/sciadv.adg3256 · Cited by 94
Artificial Intelligence Can Persuade Humans on Political Issues
Bai, H., Voelkel, J. G., Eichstaedt, J. C., & Willer, R. (2023) · doi:10.31219/osf.io/stakv · Cited by 37
The Ethics of Advanced AI Assistants
Gabriel, I., Manzini, A., Keeling, G., Hendricks, L. A., Rieser, V., Iqbal, H., Tomašev, N., Ktena, I., Kenton, Z., Rodriguez, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.16244 · Cited by 57
Games for Artificial Intelligence Research: A Review and Perspectives
Hu, C., Zhao, Y., Wang, Z., Du, H., & Liu, J. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3410935 · Cited by 75
Can We Edit Factual Knowledge by In-Context Learning?
Zheng, C., Li, L., Dong, Q., Fan, Y., Wu, Z., Xu, J., & Chang, B. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.296 · Cited by 54
Urban planning in the era of large language models
Zheng, Y., Xu, F., Lin, Y., Santi, P., Ratti, C., Wang, Q., & Li, Y. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00846-1 · Cited by 88
AI Moral Enhancement: Upgrading the Socio-Technical System of Moral Engagement
Volkman, R., & Gabriels, K. (2023) · Science and Engineering Ethics · doi:10.1007/s11948-023-00428-2 · Cited by 55
Still no lie detector for language models: probing empirical and conceptual roadblocks
Levinstein, B. A., & Herrmann, D. A. (2025) · Philosophical Studies · doi:10.1007/s11098-023-02094-3 · Cited by 50
A social path to human-like artificial intelligence
Duéñez‐Guzmán, E. A., Sadedin, S., Wang, J. X., McKee, K. R., & Leibo, J. Z. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00754-x · Cited by 79
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
Capacity of ChatGPT to Identify Guideline-Based Treatments for Advanced Solid Tumors
Schulte, B. (2023) · Cureus · doi:10.7759/cureus.37938 · Cited by 50
Larooij, M., & Törnberg, P. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11412-6 · Cited by 88
Introduction to AI Safety, Ethics, and Society
Hendrycks, D. (2024) · CRC Press eBooks · doi:10.1201/9781003530336 · Cited by 111
Grand challenges in industrial and systems engineering
Karwowski, W., Salvendy, G., Albert, L. A., Kim, W. C., Denton, B. T., Dessouky, M. M., Dolgui, A. B., Duffy, V. G., Kumara, S. R. T., Li, J., et al. (2025) · International Journal of Production Research · doi:10.1080/00207543.2024.2432463 · Cited by 52
Challenges, evaluation and opportunities for open-world learning
Kejriwal, M., Kildebeck, E., Steininger, R. J., & Shrivastava, A. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00852-4 · Cited by 62
Toward Training Superintelligent Software Agents through Self-Play SWE-RLPreprint
Wei, Y., Sun, Z., McMilin, E., Gehring, J., Zhang, D., Synnaeve, G., Fried, D., Zhang, L., & Wang, S. I. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.18552 · Cited by 45
Self-citationA foundational architecture for AI agents in healthcare
Liu, F., Niu, Y., Zhang, Q., Wang, K., Dong, Z., Wong, I. N., Cheng, L., Li, T., Duan, L., Li, K., et al. (2025) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102374 · Cited by 41
“24,25 29 For example, in robotics, AI agents can combine visual input, physical movement, and environmental feedback to execute complex tasks such as navigation, object manipulation, and autonomous control in dynamic environments.”
Large language models can predict the results of social science experiments
Ashokkumar, A., Hewitt, L., Ghezae, I., & Willer, R. (2026) · Nature · doi:10.1038/s41586-026-10742-x · Cited by 89
Language Instructed Reinforcement Learning for Human-AI CoordinationPreprint
Hu, H., & Sadigh, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.07297 · Cited by 85
Self-citationEnvisioning Recommendations on an LLM-Based Agent Platform
Zhang, J., Bao, K., Wang, W., Zhang, Y., Shi, W., Xu, W., Feng, F., & Chua, T. (2025) · Communications of the ACM · doi:10.1145/3699952 · Cited by 42
Self-citationLarge Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence
Nay, J. J., Karamardian, D., Lawsky, S. B., Tao, W., Bhat, M., Jain, R., Lee, A. T., Choi, J. H., & Kasai, J. (2023) · arXiv · doi:10.48550/arxiv.2306.07075 · Cited by 38
Khan, N. A., Osmonaliev, K., & Sarwar, M. Z. (2023) · Nepal Journal of Epidemiology · doi:10.3126/nje.v13i1.53721 · Cited by 35
Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities EmergencePreprint
Nay, J. J., Karamardian, D., Lawsky, S. B., Tao, W., Bhat, M., Jain, R., Lee, A. T., Choi, J. H., & Kasai, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4476325 · Cited by 47
Exploring Large Language Models for Communication Games: An Empirical Study on Werewolf
Xu, Y., Wang, S., Li, P., Luo, F., Wang, X., Liu, W., & Liu, Y. (2023) · arXiv · doi:10.48550/arxiv.2309.04658 · Cited by 32
GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents
Ouyang, M., Hu, S., Lin, K. Q., Ng, H. T., & Shou, M. Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37255-0_3 · Cited by 37
LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative SimulacraPreprint
Karten, S., Li, W., Ding, Z., Kleiner, S., Bai, Y., & Jin, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.15815 · Cited by 38
Yim, Y., Chan, C., Shi, T., Deng, Z., Fan, W., Zheng, T., & Song, Y. (2024) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat62293.2024.00074 · Cited by 38
Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approaches
Fried, D., Tomlin, N., Hu, J. C. W., Patel, R., & Nematzadeh, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.840 · Cited by 63
Self-citationMinding Language Models’ (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker
Sclar, M., Kumar, S., West, P., Suhr, A., Choi, Y., & Tsvetkov, Y. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.780 · Cited by 27
Zhou, P., Zhu, A., Hu, J., Pujara, J., Ren, X., Callison-Burch, C., Choi, Y., & Ammanabrolu, P. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.624 · Cited by 52
Towards practical reinforcement learning for tokamak magnetic control
Tracey, B., Michi, A., Chervonyi, Y., Davies, I., Păduraru, C., Lazic, N., Felici, F., Ewalds, T., Donner, C., Galperti, C., et al. (2024) · Fusion Engineering and Design · doi:10.1016/j.fusengdes.2024.114161 · Cited by 43
Training Language Models for Social Deduction with Multi-Agent Reinforcement Learning
Sarkar, B., Xia, W., Liu, C. K., & Sadigh, D. (2025) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/phjj9903 · Cited by 27
Reinforcement learning in cold atom experiments
Reinschmidt, M., Fortágh, J., Günther, A., & Volchkov, V. (2024) · Nature Communications · doi:10.1038/s41467-024-52775-8 · Cited by 33
Socially intelligent machines that learn from humans and help humans learn
Gweon, H., Fan, J. E., & Kim, B. (2023) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2022.0048 · Cited by 43
It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful TopicsPreprint
Kowal, M., Timm, J., Godbout, J., Costello, T. H., Arechar, A. A., Pennycook, G., Rand, D. G., Gleave, A., & Pelrine, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.02873 · Cited by 23
Can AI with High Reasoning Ability Replicate Human-like Decision Making in Economic Experiments?
Kitadai, A., Lugo, S. D. R., Tsurusaki, Y., Fukasawa, Y., & Nishino, N. (2025) · Group Decision and Negotiation · doi:10.1007/s10726-025-09946-9 · Cited by 28
FIREBALL: A Dataset of Dungeons and Dragons Actual-Play with Structured Game State Information
Zhu, A., Aggarwal, K., Feng, A., Martin, L. J., & Callison-Burch, C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.229 · Cited by 22
From External to Swap Regret 2.0: An Efficient Reduction for Large Action Spaces
Dagan, Y., Daskalakis, C., Fishelson, M., & Golowich, N. (2024) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/3618260.3649681 · Cited by 25
Beware the Intention Economy: Collection and Commodification of Intent via Large Language Models
Chaudhary, Y., & Penn, J. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.21e6bbaa · Cited by 29
A Survey of Task Planning with Large Language Models
Zhai, W., Liao, J., Chen, Z., Su, B., & Zhao, X. (2025) · Intelligent Computing · doi:10.34133/icomputing.0124 · Cited by 34
Learning Vision-based Pursuit-Evasion Robot Policies
Bajcsy, A. V., Loquercio, A., Kumar, A., & Malik, J. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610498 · Cited by 36
Artificial Influence: An Analysis Of AI-Driven Persuasion
Burtell, M., & Woodside, T. (2023) · arXiv · doi:10.48550/arxiv.2303.08721 · Cited by 20
Generative Agents in Agent-Based Modeling: Overview, Validation, and Emerging Challenges
Adornetto, C., Mora, A., Hu, K., Garcia, L. I., Atchade-Adelomou, P., Greco, G., Alonso, L., & Larson, K. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3566362 · Cited by 38
Generative AI as Economic Agents
Immorlica, N., Lucier, B., & Slivkins, A. (2024) · ACM SIGecom Exchanges · doi:10.1145/3699824.3699832 · Cited by 38
Epifani, L., & Caruso, A. M. (2024) · Smart Agricultural Technology · doi:10.1016/j.atech.2024.100625 · Cited by 26
Towards the Scalable Evaluation of Cooperativeness in Language ModelsPreprint
Chan, A., Riché, M., & Clifton, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.13360 · Cited by 20
It Takes Two to Negotiate: Modeling Social Exchange in Online Multiplayer Games
Jaidka, K., Ahuja, H., & Ng, L. H. X. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637362 · Cited by 25
New parameters of power: On LLM-based manipulation and control and the spectre of strategic AI
Chaudhary, Y., & Penn, J. (2026) · Big Data & Society · doi:10.1177/20539517261426450 · Cited by 19
When Do Large Language Models Exhibit Unsolicited Deception?
Taylor, S. M., & Bergen, B. K. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.786 · Cited by 18
Competitive and cooperative games for probing the neural basis of social decision-making in animals
Wang, H., & Kwan, A. C. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105158 · Cited by 19
Biswas, S., Erlei, A., & Gadiraju, U. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713201 · Cited by 20
Efficacy of Language Model Self-Play in Non-Zero-Sum GamesPreprint
Liao, A., Tomlin, N., & Klein, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.18872 · Cited by 19
Algorithmic and Human Collusion
Werner, T. (2021) · The Economic Journal · doi:10.1093/ej/ueag013 · Cited by 20
Honesty Is the Best Policy: Defining and Mitigating AI Deception
Ward, F. R., Toni, F., Belardinelli, F., & Everitt, T. (2023) · neural information processing systems · doi:10.52202/075280-0108 · Cited by 68
SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF
Dong, Y., Wang, Z., Sreedhar, M., Wu, X., & Kuchaiev, O. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.754 · Cited by 15
From Persona to Personalization: A Survey on Role-Playing Language Agents
Chen, J., Wang, X., Xu, R., Yuan, S., Zhang, Y., Shi, W., Xie, J., Li, S., Yang, R., Zhu, T., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.18231 · Cited by 15
Self-citationZhang, C., Shan, G., Roh, B., & Jiang, J. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3603592 · Cited by 21
AI-Assisted Diplomatic Decision-Making During Crises: Challenges and Opportunities
Pokhriyal, N., & Koebe, T. (2023) · Springer eBooks · doi:10.1007/978-3-032-12201-8_36 · Cited by 17
Prospects and challenges of electrochemical random-access memory for deep-learning accelerators
Cui, J., Liu, H., & Cao, Q. (2024) · Current Opinion in Solid State and Materials Science · doi:10.1016/j.cossms.2024.101187 · Cited by 17
The group mind of hybrid teams with humans and intelligent agents in knowledge-intense work
Hopf, K., Nahr, N., Staake, T., & Lehner, F. (2024) · Journal of Information Technology · doi:10.1177/02683962241296883 · Cited by 20
Nonomura, R., & Mori, H. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1582287 · Cited by 20
Metadata
- Authors
- Meta Fundamental AI Research Diplomacy Team (FAIR)†, Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., Jacob, A. P., Komeili, M., Konath, K., Kwon, M., Lerer, A., Lewis, M., Miller, A. H., Mitts, S., Renduchintala, A., Roller, S., Rowe, D., Shi, W., Spisak, J., Wei, A., Wu, D., Zhang, H., & Zijlstra, M.
- Affiliations
- Meta (United States) (US)
- Harvard University (US)
- Corresponding author
- Bakhtin, Anton
- Brown, Noam
- Dinan, Emily
- Flaherty, Colin
- Gray, Jonathan
- Hu, Hengyuan
- Jacob, Athul Paul
- Lerer, Adam
- Lewis, Mike
- Miller, Alexander H.
- Renduchintala, Adithya
- Shi, Weiyan
- Wu, David
- Zhang, Hugh
- ORCID
- Venue
- Science
- Published
- 2022-12-09
- Volume
- 378
- Issue
- 6624
- Pages
- 1067-1074
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4309663019
- Cited by
- 241
- References
- 65
- Citations by year
- 2026: 67 · 2025: 69 · 2024: 59 · 2023: 43 · 2022: 2
- FWCI
- 14.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Keywords
- diplomacy, AI agents, human-AI interaction, strategic reasoning, language models, belief inference, dialogue generation, planning, reinforcement learning, Cicero
- MeSH terms
- Diplomacy, Artificial Intelligence, Humans, Language, Software, Video Games
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.