Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
PreprintCited by 165Artificial Intelligence in GamesArtificial Intelligence ApplicationsAI-based Problem Solving and Planning

The DOI matches its DataCite record; 54 of the 54 references it cites were found in a registry or an index; none of the 190 sources its claims cite is checked for support yet.

A Survey on Large Language Model-Based Game Agents

Open access
Hu, Sihao, Huang, Tiansheng, Liu, Gaowen, Kompella, Ramana Rao, Ilhan, Fatih, Tekin, Selim Furkan, Xu, Yichang, Yahn, Zachary, Liu, Ling·2024·arXiv
DOI 10.48550/arxiv.2404.02039arXiv 2404.02039
Open this paper in CoChat — free accountOpen PDF

Abstract

Game environments provide rich, controllable settings that stimulate many aspects of real-world complexity. As such, game agents offer a valuable testbed for exploring capabilities relevant to Artificial General Intelligence. Recently, the emergence of Large Language Models (LLMs) provides new opportunities to endow these agents with generalizable reasoning, memory, and adaptability in complex game environments. This survey offers an up-to-date review of LLM-based game agents (LLMGAs) through a unified reference architecture. At the single-agent level, we synthesize existing studies around three core components: memory, reasoning, and perception-action interfaces, which jointly characterize how language enables agents to perceive, think, and act. At the multi-agent level, we outline how communication protocols and organizational models support coordination, role differentiation, and large-scale social behaviors. To contextualize these designs, we introduce a challenge-centered taxonomy linking six major game genres to their dominant agent requirements, from low-latency control in action games to open-ended goal formation in sandbox worlds. A curated list of related papers is available at https://github.com/git-disl/awesome-LLM-game-agent-papers

Overview

CoChat Summary

TL;DR

This survey reviews LLM-based game agents (LLMGAs) through a unified reference architecture covering single-agent memory, reasoning, and perception-action interfaces, plus multi-agent communication and organization. It also proposes a challenge-centered taxonomy linking six game genres to dominant agent design requirements.

Key findings

  • The paper synthesizes LLMGA studies under a unified framework: single-agent components are memory (working and long-term), reasoning (instruction-guided and fine-tuning), and perception-action interfaces; multi-agent components are communication protocols and organizational structure (topology, task/role allocation, scalability/robustness).
  • It introduces a challenge-centered taxonomy mapping six genres to core challenges: action games (low-latency control), adventure games (stateful world modeling), role-playing games (role fidelity), strategy games (opponent-aware planning), simulation games (real-world fidelity), and sandbox games (open-ended goal progression).
  • It reports representative PokéLLMon battle numbers: GPT-4o win rate 0.4217, CoT 0.3713, SC-CoT 0.4065, LastThoughts 0.4667; consecutive switch rates are 0.2442, 0.2647, 0.0954, and 0.0861 respectively.
  • It highlights open challenges including moving memory beyond “storing more” toward world-model memory, using semantic/linguistic feedback for reasoning, co-designing perception-action loops, scaling multi-agent systems, and developing finer-grained benchmarks and metrics.

Methods

  • Survey design: searched ACM Digital Library, IEEE Xplore, Google Scholar, and arXiv for 1 Jan 2018 to 31 Jul 2025 using the Boolean string (“large language model” OR LLM) AND (game OR environment); removed duplicates and irrelevant studies; added works via citation snowballing; maintains a curated GitHub list.
  • Inclusion criteria: papers that employ an LLM or MLLM as a central decision-making component and involve interaction with a game or game-like environment; excludes traditional non-LLM game AI and LLM agents in non-game domains such as dialogue, web navigation, or API tool use.
  • Analysis: synthesizes existing studies into a unified reference architecture for single-agent and multi-agent LLMGAs and a challenge-centered taxonomy of six game genres; no meta-analysis or quantitative pooling is reported.

Limitations

  • Stated open challenges: current memory systems need to become true world-model memory; reasoning relies on narrow numeric rewards or coarse feedback; perception-action alignment remains open; multi-agent emergent phenomena are often tied to task initialization and rule design, with a lack of reproducible large-scale platforms; existing benchmarks are pre-LLM, templated, shallow, and evaluated with coarse metrics.
  • Evident from the text: as a survey, it does not report formal systematic-review details such as counts of screened/included papers, quality appraisal, or risk-of-bias assessment.
  • Evident from the text: the taxonomy merges narrower genres and adds sandbox as a category, which is a design choice, and the authors note the field’s rapid pace and a continuously updated literature list, making coverage time-sensitive.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2404.02039

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 11 Not valid · 127 Not checked · 70 Own results and interpretations

82 more claims

Create a free account to see all 208 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 63
  • It may state two separate claims as one. 75
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Create a free account to see these assumptions.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 48 references

Research works printed but not linked: 131

  1. ALFWorld: Aligning Text and Embodied Environments for Interactive Learning, author=Mohit Shridhar and Xingdi Yuan and Marc-Alexandre Cote and Yonatan Bisk and Adam Trischler and Matthew Hausknecht, booktitle=International Conference on Learning Representations, year=2021, url=https://openreview.net/forum?id=0IOX0YcCdTn.
  2. The arcade learning environment: An evaluation platform for general agents. Journal of artificial intelligence research, 47:253-279, 2013.
  3. Tree of thoughts: Deliberate problem solving with large language models. In Advances in Neural Information Processing Systems (NeurIPS), 2023.
  4. Octopus: Embodied vision-language programmer for daily tasks. In European Conference on Computer Vision (ECCV). Springer, 2024.
  5. S. Agashe, Y. Fan, A. Reyna, and X. E. Wang. LLM-coordination: Evaluating and analyzing multi-agent coordination abilities in large language models. In L. Chiruzzo, A. Ritter, and L. Wang, editors, Findings of the Association for Computational Linguistics: NAACL 2025, pages 8038-8057, Albuquerque, New Mexico, Apr. 2025. Association for Computational Linguistics.
  6. J. R. Anderson. Cognitive Psychology and Its Implications. Worth Publishers, New York, 7th edition, 2010.
  7. J. R. Anderson and L. J. Schooler. Reflections of the environment in memory. Psychological science, 2(6):396-408, 1991.
  8. A. Baddeley. Working memory: Theories, models, and controversies. Annual review of psychology, 63(1):1-29, 2012.
  9. A. D. Baddeley and G. Hitch. Working memory. In G. A. Bower, editor, Psychology of Learning and Motivation, volume 8, pages 47-89. Academic Press, 1974.
  10. L. W. Barsalou. Perceptual symbol systems. Behavioral and brain sciences, 22(4):577-660, 1999.
  11. M. J. Beran. Foundations of metacognition. Oxford University Press, 2012.
  12. M. Besta, N. Blach, A. Kubicek, R. Gerstenberger, M. Podstawski, L. Gianinazzi, J. Gajda, T. Lehmann, H. Niewiadomski, P. Nyczyk, et al. Graph of thoughts: Solving elaborate problems with large language models. In Proceedings of the AAAI conference on artificial intelligence, volume 38, pages 17682-17690, 2024.
  13. T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, et al. Language models are few-shot learners. Advances in neural information processing systems, 33:1877-1901, 2020.
  14. M. Carroll, R. Shah, M. K. Ho, T. Griffiths, S. Seshia, P. Abbeel, and A. Dragan. On the utility of learning about humans for human-ai coordination. Advances in neural information processing systems, 32, 2019.
  15. T. Carta, C. Romac, T. Wolf, S. Lamprier, O. Sigaud, and P.-Y. Oudeyer. Grounding large language models in interactive environments with online reinforcement learning. In International Conference on Machine Learning, pages 3676-3713. PMLR, 2023.
  16. J. Chen, Y. Jiang, J. Lu, and L. Zhang. S-agent: self-organizing agents in open-ended environment. In ICLR 2024 Workshop on Large Language Model (LLM) Agents, 2024.
  17. J. Chen, S. Saha, and M. Bansal. Reconcile: Round-table conference improves reasoning via consensus among diverse llms. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7066-7085, 2024.
  18. P. F. Christiano, J. Leike, T. Brown, M. Martic, S. Legg, and D. Amodei. Deep reinforcement learning from human preferences. Advances in neural information processing systems, 30, 2017.
  19. A. Clark. Being there: Putting brain, body, and world together again. MIT press, 1998.
  20. A. Clark. Whatever next? predictive brains, situated agents, and the future of cognitive science. Behavioral and brain sciences, 36(3):181-204, 2013.
  21. R. I. Clarke, J. H. Lee, and N. Clark. Why video game genres fail: A classificatory analysis. Games and Culture, 12(5):445-465, 2017.
  22. K. Cobbe, C. Hesse, J. Hilton, and J. Schulman. Leveraging procedural generation to benchmark reinforcement learning. In International conference on machine learning, pages 2048-2056. PMLR, 2020.
  23. M.-A. Côté, A. Kádár, X. Yuan, B. Kybartas, T. Barnes, E. Fine, J. Moore, M. Hausknecht, L. El Asri, M. Adada, et al. Textworld: A learning environment for text-based games. In Computer Games: 7th Workshop, CGW 2018, Held in Conjunction with the 27th International Conference on Artificial Intelligence, IJCAI 2018, Stockholm, Sweden, July 13, 2018, Revised Selected Papers 7, pages 41-75. Springer, 2019.
  24. N. Cowan. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and brain sciences, 24(1):87-114, 2001.
  25. A. de Wynter. Will gpt-4 run doom? IEEE Transactions on Games, 17(2):451-459, 2025.
  26. Y. Ding, L. L. Zhang, C. Zhang, Y. Xu, N. Shang, J. Xu, F. Yang, and M. Yang. Longrope: Extending llm context window beyond 2 million tokens. In International Conference on Machine Learning, pages 11091-11104. PMLR, 2024.
  27. Y. Du, O. Watkins, Z. Wang, C. Colas, T. Darrell, P. Abbeel, A. Gupta, and J. Andreas. Guiding pretraining in reinforcement learning with large language models. In International Conference on Machine Learning, pages 8657-8677. PMLR, 2023.
  28. J. S. B. Evans. Dual-processing accounts of reasoning, judgment, and social cognition. Annu. Rev. Psychol., 59(1):255- 278, 2008.
  29. M. F. A. R. D. T. (FAIR) †, A. Bakhtin, N. Brown, E. Dinan, G. Farina, C. Flaherty, D. Fried, A. Goff, J. Gray, H. Hu, et al. Human-level play in the game of diplomacy by combining language models with strategic reasoning. Science, 378(6624):1067-1074, 2022.
  30. L. Fan, G. Wang, Y. Jiang, A. Mandlekar, Y. Yang, H. Zhu, A. Tang, D.-A. Huang, Y. Zhu, and A. Anandkumar. Minedojo: Building open-ended embodied agents with internet-scale knowledge. Advances in Neural Information Processing Systems, 35:18343-18362, 2022.
  31. X. Feng, Y. Luo, Z. Wang, H. Tang, M. Yang, K. Shao, D. Mguni, Y. Du, and J. Wang. Chessgpt: Bridging policy learning and language modeling. Advances in Neural Information Processing Systems, 36, 2024.
  32. Y. Feng, Y. Wang, J. Liu, S. Zheng, and Z. Lu. Llama-rider: Spurring large language models to explore the open world. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 4705-4724, 2024.
  33. S. M. Fleming and R. J. Dolan. The neural basis of metacognitive ability. Philosophical Transactions of the Royal Society B: Biological Sciences, 367(1594):1338-1349, 2012.
  34. R. Gallotta, G. Todd, M. Zammit, S. Earle, A. Liapis, J. Togelius, and G. N. Yannakakis. Large language models and games: A survey and roadmap. IEEE Transactions on Games, 2024.
  35. C. Gao, X. Lan, N. Li, Y. Yuan, J. Ding, Z. Zhou, F. Xu, and Y. Li. Large language models empowered agent-based modeling and simulation: A survey and perspectives. Humanities and Social Sciences Communications, 11(1):1-24, 2024.
  36. T. Ge, H. Jing, L. Wang, X. Wang, S.-Q. Chen, and F. Wei. In-context autoencoder for context compression in a large language model. In The Twelfth International Conference on Learning Representations, 2024.
  37. D. Gong, X. Wan, and D. Wang. Working memory capacity of chatgpt: An empirical study. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 10048-10056, 2024.
  38. R. Gong, Q. Huang, X. Ma, Y. Noda, Z. Durante, Z. Zheng, D. Terzopoulos, L. Fei-Fei, J. Gao, and H. Vo. Mindagent: Emergent gaming interaction. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 3154-3183, 2024.
  39. J. Guo, B. Yang, P. Yoo, B. Y. Lin, Y. Iwasawa, and Y. Matsuo. Suspicion-agent: Playing imperfect information games with theory of mind aware gpt-4. In Proceedings of the 1st Conference on Language Modeling (COLM), 2024.
  40. M. Hausknecht, P. Ammanabrolu, M.-A. Côté, and X. Yuan. Interactive fiction games: A colossal adventure. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 7903-7910, 2020.
  41. E. J. Hu, yelong shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen. LoRA: Low-rank adaptation of large language models. In International Conference on Learning Representations, 2022.
  42. M. Hu, T. Chen, Q. Chen, Y. Mu, W. Shao, and P. Luo. Hiagent: Hierarchical working memory management for solving long-horizon agent tasks with large language model. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL 2025), 2025.
  43. S. Hu, T. Huang, G. Liu, R. Kompella, and L. Liu. Pokéllmon: A grounding and reasoning benchmark for large language models in pokémon battles. ACM Transactions on Internet Technology, 2025.
  44. W. Huang, P. Abbeel, D. Pathak, and I. Mordatch. Language models as zero-shot planners: Extracting actionable knowledge for embodied agents. In International Conference on Machine Learning, pages 9118-9147. PMLR, 2022.
  45. E. Hutchins. Cognition in the Wild. MIT press, 1995.
  46. P. N. Johnson-Laird. Mental models: Towards a cognitive science of language, inference, and consciousness. Num- ber 6. Harvard University Press, 1983.
  47. P. N. Johnson-Laird. Mental models and human reasoning. Proceedings of the National Academy of Sciences, 107(43):18243-18250, 2010.
  48. S. Karten, J. Grigsby, S. Milani, K. Vodrahalli, A. Zhang, F. Fang, Y. Zhu, and C. Jin. The pokeagent challenge: Competitive and long-context learning at scale. In NeurIPS Competition Track, Apr. 2025.
  49. M. Kempka, M. Wydmuch, G. Runc, J. Toczek, and W. Jaśkowski. Vizdoom: A doom-based ai research platform for visual reinforcement learning. In 2016 IEEE conference on computational intelligence and games (CIG), pages 1-8. IEEE, 2016.
  50. G. Kim, P. Baldi, and S. McAleer. Language models can solve computer tasks. Advances in Neural Information Processing Systems, 36, 2024.
  51. T. Kojima, S. S. Gu, M. Reid, Y. Matsuo, and Y. Iwasawa. Large language models are zero-shot reasoners. Advances in neural information processing systems, 35:22199-22213, 2022.
  52. I. Kotseruba and J. K. Tsotsos. 40 years of cognitive architectures: core cognitive abilities and practical applications. Artificial Intelligence Review, 53(1):17-94, 2020.
  53. J. H. Lee, N. Karlova, R. I. Clarke, K. Thornton, and A. Perti. Facet analysis of video game genres. IConference 2014 Proceedings, 2014.
  54. B. Lester, R. Al-Rfou, and N. Constant. The power of scale for parameter-efficient prompt tuning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3045-3059. Association for Computational Linguistics, 2021.
  55. H. Li, Y. Chong, S. Stepputtis, J. Campbell, D. Hughes, C. Lewis, and K. Sycara. Theory of mind for multi-agent collaboration via large language models. In H. Bouamor, J. Pino, and K. Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 180-192, Singapore, Dec. 2023. Association for Computational Linguistics.
  56. K. Li, A. K. Hopkins, D. Bau, F. Viégas, H. Pfister, and M. Wattenberg. Emergent world representations: Exploring a sequence model trained on a synthetic task. In The Eleventh International Conference on Learning Representations, 2023.
  57. S. Li, Y. He, H. Guo, X. Bu, G. Bai, J. Liu, J. Liu, X. Qu, Y. Li, W. Ouyang, et al. Graphreader: Building graph-based agent to enhance long-context abilities of large language models. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 12758-12786, 2024.
  58. X. L. Li and P. Liang. Prefix-tuning: Optimizing continuous prompts for generation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 4582-4597, Online, August 2021. Association for Computational Linguistics.
  59. Y. Li, S. Zhang, J. Sun, Y. Du, Y. Wen, X. Wang, and W. Pan. Cooperative open-ended learning framework for zero-shot coordination. In Proceedings of the 40th International Conference on Machine Learning, pages 20470-20484, 2023.
  60. J. Light, M. Cai, S. Shen, and Z. Hu. From text to tactic: Evaluating LLMs playing the game of avalon. In NeurIPS 2023 Foundation Models for Decision Making Workshop, 2023.
  61. H. Lightman, V. Kosaraju, Y. Burda, H. Edwards, B. Baker, T. Lee, J. Leike, J. Schulman, I. Sutskever, and K. Cobbe. Let's verify step by step. In The Twelfth International Conference on Learning Representations, 2023.
  62. B. Y. Lin, Y. Fu, K. Yang, F. Brahman, S. Huang, C. Bhagavatula, P. Ammanabrolu, Y. Choi, and X. Ren. Swiftsage: A generative agent with fast and slow thinking for complex interactive tasks. Advances in Neural Information Processing Systems, 36, 2024.
  63. J. Liu, C. Yu, J. Gao, Y. Xie, Q. Liao, Y. Wu, and Y. Wang. Llm-powered hierarchical language agent for real-time human-ai coordination. In Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems, pages 1219-1228, 2024.
  64. S. Liu, H. Yuan, M. Hu, Y. Li, Y. Chen, S. Liu, Z. Lu, and J. Jia. Rl-gpt: Integrating reinforcement learning and code-as-policy. In Advances in Neural Information Processing Systems (NeurIPS), 2024.
  65. W. Ma, Q. Mi, Y. Zeng, X. Yan, R. Lin, Y. Wu, J. Wang, and H. Zhang. Large language models play starcraft II:benchmarks and a chain of summarization approach. In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024.
  66. A. Madaan, N. Tandon, P. Gupta, S. Hallinan, L. Gao, S. Wiegreffe, U. Alon, N. Dziri, S. Prabhumoye, Y. Yang, et al. Self-refine: Iterative refinement with self-feedback. Advances in Neural Information Processing Systems, 36, 2024.
  67. G. A. Miller. The cognitive revolution: a historical perspective. Trends in cognitive sciences, 7(3):141-144, 2003.
  68. J. Mu, X. Li, and N. Goodman. Learning to compress prompts with gist tokens. Advances in Neural Information Processing Systems, 36:19327-19352, 2023.
  69. A. Newell. Unified theories of cognition. Harvard University Press, 1994.
  70. L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, et al. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730-27744, 2022.
  71. J. S. Park, J. O'Brien, C. J. Cai, M. R. Morris, P. Liang, and M. S. Bernstein. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, pages 1-22, 2023.
  72. B. Peng, J. Quesnelle, H. Fan, and E. Shippole. YaRN: Efficient context window extension of large language models. In The Twelfth International Conference on Learning Representations, 2024.
  73. A. Prasad, A. Koller, M. Hartmann, P. Clark, A. Sabharwal, M. Bansal, and T. Khot. Adapt: As-needed decomposition and planning with language models. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 4226-4252, 2024.
  74. X. Puig, K. Ra, M. Boben, J. Li, T. Wang, S. Fidler, and A. Torralba. Virtualhome: Simulating household activities via programs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 8494-8502, 2018.
  75. S. Qi, S. Chen, Y. Li, X. Kong, J. Wang, B. Yang, P. Wong, Y. Zhong, X. Zhang, Z. Zhang, N. Liu, Y. Yang, and S.-C. Zhu. Civrealm: A learning and reasoning odyssey in civilization for decision-making agents. In The Twelfth International Conference on Learning Representations, 2024.
  76. S. Qiao, R. Fang, N. Zhang, Y. Zhu, X. Chen, S. Deng, Y. Jiang, P. Xie, F. Huang, and H. Chen. Agent planning with world knowledge model. In Proceedings of the 38th International Conference on Neural Information Processing Systems, pages 114843-114871, 2024.
  77. G. Qin and B. Van Durme. Nugget: Neural agglomerative embeddings of text. In International Conference on Machine Learning, pages 28337-28350. PMLR, 2023.
  78. A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pages 8748-8763. PMLR, 2021.
  79. R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn. Direct preference optimization: Your language model is secretly a reward model. Advances in Neural Information Processing Systems, 36:53728-53741, 2023.
  80. S. Reed, K. Zolna, E. Parisotto, S. G. Colmenarejo, A. Novikov, G. Barth-maron, M. Giménez, Y. Sulsky, J. Kay, J. T. Springenberg, T. Eccles, J. Bruce, A. Razavi, A. Edwards, N. Heess, Y. Chen, R. Hadsell, O. Vinyals, M. Bordbar, and N. de Freitas. A generalist agent. Transactions on Machine Learning Research, 2022. Featured Certification, Outstanding Certification.
  81. A. Rezazadeh, Z. Li, W. Wei, and Y. Bao. From isolated conversations to hierarchical schemas: Dynamic tree memory representation for LLMs. In The Thirteenth International Conference on Learning Representations, 2025.
  82. Y. Shao, L. Li, J. Dai, and X. Qiu. Character-llm: A trainable agent for role-playing. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 13153-13187, 2023.
  83. N. Shinn, F. Cassano, E. Berman, A. Gopinath, K. Narasimhan, and S. Yao. Reflexion: Language agents with verbal reinforcement learning. In Advances in Neural Information Processing Systems (NeurIPS), 2023.
  84. M. Shridhar, J. Thomason, D. Gordon, Y. Bisk, W. Han, R. Mottaghi, L. Zettlemoyer, and D. Fox. Alfred: A benchmark for interpreting grounded instructions for everyday tasks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10740-10749, 2020.
  85. L. Smith and M. Gasser. The development of embodied cognition: Six lessons from babies. Artificial life, 11(1-2):13-29, 2005.
  86. C. H. Song, J. Wu, C. Washington, B. M. Sadler, W.-L. Chao, and Y. Su. Llm-planner: Few-shot grounded planning for embodied agents with large language models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 2998-3009, 2023.
  87. Y. Song, D. Yin, X. Yue, J. Huang, S. Li, and B. Y. Lin. Trial and error: Exploration-based trajectory optimization of llm agents. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7584-7600, 2024.
  88. L. R. Squire. Memory systems of the brain: a brief history and current perspective. Neurobiology of learning and memory, 82(3):171-177, 2004.
  89. R. S. Sutton, A. G. Barto, et al. Reinforcement learning: An introduction, volume 1. MIT press Cambridge, 1998.
  90. P. Sweetser. Large language models and video games: A preliminary scoping review. In Proceedings of the 6th ACM Conference on Conversational User Interfaces, pages 1-8, 2024.
  91. W. Tan, Z. Ding, W. Zhang, B. Li, B. Zhou, J. Yue, H. Xia, J. Jiang, L. Zheng, X. Xu, Y. Bi, P. Gu, X. Wang, B. F. Karlsson, B. An, and Z. Lu. Towards general computer control: A multimodal agent for red dead redemption II as a case study. In ICLR 2024 Workshop on Large Language Model (LLM) Agents, 2024.
  92. W. Tan, W. Zhang, S. Liu, L. Zheng, X. Wang, and B. An. True knowledge comes from practice: Aligning large language models with embodied environments via reinforcement learning. In The Twelfth International Conference on Learning Representations, 2024.
  93. X. Tang, J. Li, Y. Liang, S.-c. Zhu, M. Zhang, and Z. Zheng. Mars: Situated inductive reasoning in an open-world environment. Advances in Neural Information Processing Systems, 37:17830-17869, 2024.
  94. S. Toshniwal, S. Wiseman, K. Livescu, and K. Gimpel. Chess as a testbed for language model state tracking. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 11385-11393, 2022.
  95. L. Trung, X. Zhang, Z. Jie, P. Sun, X. Jin, and H. Li. Reft: Reasoning with reinforced fine-tuning. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7601-7614, 2024.
  96. E. Tulving. Episodic and semantic memory. In E. Tulving and W. Donaldson, editors, Organization of Memory, pages 381-403. Academic Press, 1972.
  97. E. Tulving et al. Episodic and semantic memory. Organization of memory, 1(381-403):1, 1972.
  98. F. J. Varela, E. Thompson, and E. Rosch. The embodied mind, revised edition: Cognitive science and human experience. MIT press, 2017.
  99. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  100. G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar. Voyager: An open-ended embodied agent with large language models. Transactions on Machine Learning Research, 2024.
  101. L. Wang, C. Ma, X. Feng, Z. Zhang, H. Yang, J. Zhang, Z. Chen, J. Tang, X. Chen, Y. Lin, et al. A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6):186345, 2024.
  102. N. Wang, Z. Peng, H. Que, J. Liu, W. Zhou, Y. Wu, H. Guo, R. Gan, Z. Ni, J. Yang, M. Zhang, Z. Zhang, W. Ouyang, K. Xu, W. Huang, J. Fu, and J. Peng. Rolellm: Benchmarking, eliciting, and enhancing role-playing abilities of large language models. In L.-W. Ku, A. Martins, and V. Srikumar, editors, Findings of the Association for Computational Linguistics: ACL 2024, pages 14743-14777, Bangkok, Thailand, Aug. 2024. Association for Computational Linguistics.
  103. R. Wang, P. Jansen, M.-A. Côté, and P. Ammanabrolu. Scienceworld: Is your agent smarter than a 5th grader? In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 11279-11298, Abu Dhabi, 2022. Association for Computational Linguistics.
  104. X. Wang, J. Wei, D. Schuurmans, Q. V. Le, E. H. Chi, S. Narang, A. Chowdhery, and D. Zhou. Self-consistency improves chain of thought reasoning in language models. In The Eleventh International Conference on Learning Representations, 2023.
  105. X. Wang, Y. Xiao, J.-t. Huang, S. Yuan, R. Xu, H. Guo, Q. Tu, Y. Fei, Z. Leng, W. Wang, et al. Incharacter: Evaluating personality fidelity in role-playing agents through psychological interviews. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1840-1873, 2024.
  106. Z. Wang, S. Cai, G. Chen, A. Liu, X. Ma, and Y. Liang. Describe, explain, plan and select: Interactive planning with LLMs enables open-world multi-task agents. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.
  107. Z. Wang, S. Cai, A. Liu, Y. Jin, J. Hou, B. Zhang, H. Lin, Z. He, Z. Zheng, Y. Yang, et al. Jarvis-1: Open-world multi-task agents with memory-augmented multimodal language models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(3):1894-1907, 2025.
  108. Z. Wang, Y. Y. Chiu, and Y. C. Chiu. Humanoid agents: Platform for simulating human-like generative agents. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2023.
  109. J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35:24824-24837, 2022.
  110. D. Wu, H. Shi, Z. Sun, and B. Liu. Deciphering digital detectives: Understanding llm behaviors and capabilities in multi-agent mystery games. In Findings of the Association for Computational Linguistics ACL 2024, pages 8225-8291, 2024.
  111. Y. Wu, S. Y. Min, S. Prabhumoye, Y. Bisk, R. R. Salakhutdinov, A. Azaria, T. M. Mitchell, and Y. Li. Spring: Studying papers and reasoning to play games. Advances in Neural Information Processing Systems, 36, 2024.
  112. J. Xiang, T. Tao, Y. Gu, T. Shu, Z. Wang, Z. Yang, and Z. Hu. Language models meet world models: Embodied experiences enhance language models. Advances in neural information processing systems, 36, 2024.
  113. W. Xiong, Y. Song, X. Zhao, W. Wu, X. Wang, K. Wang, C. Li, W. Peng, and S. Li. Watch every step! LLM agent learning via iterative step-level process refinement. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 1556-1572, 2024.
  114. Z. Xu, C. Yu, F. Fang, Y. Wang, and Y. Wu. Language agents with reinforcement learning for strategic play in the werewolf game. In Forty-first International Conference on Machine Learning, 2024.
  115. G. N. Yannakakis and J. Togelius. Artificial Intelligence and Games. Springer, 2018.
  116. S. Yao, R. Rao, M. Hausknecht, and K. Narasimhan. Keep calm and explore: Language models for action generation in text-based games. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 8736-8754, 2020.
  117. S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. R. Narasimhan, and Y. Cao. React: Synergizing reasoning and acting in language models. In The Eleventh International Conference on Learning Representations, 2023.
  118. N. Yeung and C. Summerfield. Metacognition in human decision-making: confidence and error monitoring. Philosophical Transactions of the Royal Society B: Biological Sciences, 367(1594):1310-1321, 2012.
  119. X. Yi, Z. Zhou, C. Cao, Q. Niu, T. Liu, and B. Han. From debate to equilibrium: Belief-driven multi-agent llm reasoning via bayesian nash equilibrium. In Forty-second International Conference on Machine Learning.
  120. H. Yuan, C. Zhang, H. Wang, F. Xie, P. Cai, H. Dong, and Z. Lu. Skill reinforcement learning and planning for open-world long-horizon tasks. In NeurIPS 2023 Foundation Models for Decision Making Workshop, 2023.
  121. A. Zeng, M. Liu, R. Lu, B. Wang, X. Liu, Y. Dong, and J. Tang. Agenttuning: Enabling generalized agent abilities for llms. In Findings of the Association for Computational Linguistics ACL 2024, pages 3053-3077, 2024.
  122. S. Zhai, H. Bai, Z. Lin, J. Pan, P. Tong, Y. Zhou, A. Suhr, S. Xie, Y. LeCun, Y. Ma, et al. Fine-tuning large vision-language models as decision-making agents via reinforcement learning. Advances in Neural Information Processing Systems, 37:110935-110971, 2025.
  123. C. Zhang, K. Yang, S. Hu, Z. Wang, G. Li, Y. Sun, C. Zhang, Z. Zhang, A. Liu, S.-C. Zhu, X. Chang, J. Zhang, F. Yin, Y. Liang, and Y. Yang. Proagent: Building proactive cooperative agents with large language models. Proceedings of the AAAI Conference on Artificial Intelligence, 38(16):17609-17617, 2024.
  124. D. Zhang, L. Chen, S. Zhang, H. Xu, Z. Zhao, and K. Yu. Large language models are semi-parametric reinforcement learning agents. Advances in Neural Information Processing Systems, 36, 2024.
  125. H. Zhang, W. Du, J. Shan, Q. Zhou, Y. Du, J. B. Tenenbaum, T. Shu, and C. Gan. Building cooperative embodied agents modularly with large language models. In The Twelfth International Conference on Learning Representations, 2024.
  126. J. Zhang, J. Lehman, K. Stanley, and J. Clune. OMNI: Open-endedness via models of human notions of interestingness. In The Twelfth International Conference on Learning Representations, 2024.
  127. A. Zhao, D. Huang, Q. Xu, M. Lin, Y.-J. Liu, and G. Huang. Expel: Llm agents are experiential learners. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19632-19642, 2024.
  128. S. Zheng, Y. Feng, Z. Lu, et al. Steve-eye: Equipping llm-based embodied agents with visual perception in open worlds. In The Twelfth International Conference on Learning Representations, 2023.
  129. W. Zhong, L. Guo, Q. Gao, H. Ye, and Y. Wang. Memorybank: Enhancing large language models with long-term memory. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19724-19731, 2024.
  130. D. Zhu, N. Yang, L. Wang, Y. Song, W. Wu, F. Wei, and S. Li. Pose: Efficient context window extension of llms via positional skip-wise training. In The Twelfth International Conference on Learning Representations (ICLR), 2024.
  131. R. A. Zwaan and G. A. Radvansky. Situation models in language comprehension and memory. Psychological bulletin, 123(2):162, 1998.

Cited by

Related

See all

Metadata

Authors
Hu, S., Huang, T., Liu, G., Kompella, R. R., Ilhan, F., Tekin, S. F., Xu, Y., Yahn, Z., & Liu, L.
Affiliations
Georgia Institute of Technology (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2404.02039
arXiv
2404.02039
OpenAlex
W4393942320
Cited by
165
References
48
Citations by year
2026: 57 · 2025: 79 · 2024: 29
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
Keywords
large language models, game-playing agents, artificial general intelligence, agent memory, agent reasoning, multi-agent systems, agent communication protocols, agent coordination, game genres, action video games, goal formation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-14, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-14 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.