CoChat
Sign Up
PreprintCited by 8Multi-Agent Systems and NegotiationArtificial Intelligence ApplicationsPsychiatry, Mental Health, Neuroscience

The DOI matches its DataCite record; 5 of the 5 references it cites were found in a registry or an index.

A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application

Open access
Chen, Shuaihang, Liu, Yuanxing, Han, Wei, Zhang, Weinan, Liu, Ting·2024·arXiv
DOI 10.48550/arxiv.2412.17481arXiv 2412.17481
Open this paper in CoChat — free accountOpen PDF

Abstract

LLM-based Multi-Agent Systems ( LLM-MAS ) have become a research hotspot since the rise of large language models (LLMs). However, with the continuous influx of new related works, the existing reviews struggle to capture them comprehensively. This paper presents a comprehensive survey of these studies. We first discuss the definition of LLM-MAS, a framework encompassing much of previous work. We provide an overview of the various applications of LLM-MAS in (i) solving complex tasks, (ii) simulating specific scenarios, and (iii) evaluating generative agents. Building on previous studies, we also highlight several challenges and propose future directions for research in this field.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2412.17481

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 73

  1. P. G. Balaji and D. Srinivasan. 2010. An Introduction to Multi-Agent Systems. In Dipti Srinivasan and Lakhmi C. Jain, editors, Innovations in Multi-Agent Systems and Applications -1, pages 1-27. Springer, Berlin, Heidelberg. · DOI
  2. Chaithanya Bandi and Abir Harrasse. 2024. Ad- versarial Multi-Agent Evaluation of Large Lan- guage Models through Iterative Debates. Preprint, arXiv:2410.04663. · DOI
  3. Chi-Min Chan, Weize Chen, Yusheng Su, Jianxuan Yu, Wei Xue, Shanghang Zhang, Jie Fu, and Zhiyuan Liu. 2023. ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate. Preprint, arXiv:2308.07201. · DOI · Paper page
  4. Guangyao Chen, Siwei Dong, Yu Shu, Ge Zhang, Jaward Sesay, Börje F. Karlsson, Jie Fu, and Yemin Shi. 2024a. AutoAgents: A Frame- work for Automatic Agent Generation. Preprint, arXiv:2309.17288. · DOI
  5. Guhong Chen, Liyang Fan, Zihan Gong, Nan Xie, Zix- uan Li, Ziqiang Liu, Chengming Li, Qiang Qu, Shi- wen Ni, and Min Yang. 2024b. AgentCourt: Simulat- ing Court with Adversarial Evolvable Lawyer Agents. Preprint, arXiv:2408.08089. · DOI
  6. Jiangjie Chen, Siyu Yuan, Rong Ye, Bodhisattwa Prasad Majumder, and Kyle Richardson. 2024c. Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auc- tion Arena. Preprint, arXiv:2310.05746. · DOI
  7. Junzhe Chen, Xuming Hu, Shuodi Liu, Shiyu Huang, Wei-Wei Tu, Zhaofeng He, and Lijie Wen. 2024d. LLMArena: Assessing Capabilities of Large Lan- guage Models in Dynamic Multi-Agent Environ- ments. In Proceedings of the 62nd Annual Meet- ing of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13055-13077. · DOI
  8. Justin Chen, Swarnadeep Saha, and Mohit Bansal. 2024e. ReConcile: Round-Table Conference Im- proves Reasoning via Consensus among Diverse LLMs. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers), pages 7066-7085, Bangkok, Thailand. Association for Computational Linguistics. · DOI · Paper page
  9. Weize Chen, Ziming You, Ran Li, Yitong Guan, Chen Qian, Chenyang Zhao, Cheng Yang, Ruobing Xie, Zhiyuan Liu, and Maosong Sun. 2024f. Inter- net of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence. Preprint, arXiv:2407.07061. · DOI
  10. Weize Chen, Jiarui Yuan, Chen Qian, Cheng Yang, Zhiyuan Liu, and Maosong Sun. 2024g. Optima: Op- timizing Effectiveness and Efficiency for LLM-Based Multi-Agent System. Preprint, arXiv:2410.08115. · DOI
  11. Yi Cheng, Wenge Liu, Jian Wang, Chak Tou Leong, Yi Ouyang, Wenjie Li, Xian Wu, and Yefeng Zheng. 2024. Cooper: Coordinating Specialized Agents towards a Complex Dialogue Goal. Proceedings of the AAAI Conference on Artificial Intelligence, 38(16):17853-17861. · DOI
  12. Yun-Shiuan Chuang, Agam Goyal, Nikunj Harlalka, Siddharth Suresh, Robert Hawkins, Sijia Yang, Dha- van Shah, Junjie Hu, and Timothy Rogers. 2024. Simulating Opinion Dynamics with Networks of LLM-based Agents. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 3326-3346, Mexico City, Mexico. Association for Computational Linguistics. · DOI · Paper page
  13. Yun-Shiuan Chuang and Timothy T. Rogers. 2023. Computational Agent-based Models in Opinion Dy- namics: A Survey on Social Simulations and Empiri- cal Studies. Preprint, arXiv:2306.03446. · DOI · Paper page
  14. Silin Du and Xiaowei Zhang. 2024. Helmsman of the Masses? Evaluate the Opinion Leadership of Large Language Models in the Werewolf Game. In First Conference on Language Modeling.
  15. Yilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum, and Igor Mordatch. 2023. Im- proving Factuality and Reasoning in Language Models through Multiagent Debate. Preprint, arXiv:2305.14325. · DOI · Paper page
  16. Zhuoyun Du, Chen Qian, Wei Liu, Zihao Xie, Yifei Wang, Yufan Dang, Weize Chen, and Cheng Yang. 2024. Multi-Agent Software Develop- ment through Cross-Team Collaboration. Preprint, arXiv:2406.08979. · DOI
  17. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, et al. 2024. The Llama 3 Herd of Models. Preprint, arXiv:2407.21783. · DOI · Paper page
  18. Chen Gao, Xiaochong Lan, Nian Li, Yuan Yuan, Jingtao Ding, Zhilun Zhou, Fengli Xu, and Yong Li. 2023a. Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspec- tives. Preprint, arXiv:2312.11970. · DOI
  19. Chen Gao, Xiaochong Lan, Zhihong Lu, Jinzhu Mao, Jinghua Piao, Huandong Wang, Depeng Jin, and Yong Li. 2023b. S3: Social-network Simulation Sys- tem with Large Language Model-Empowered Agents. Preprint, arXiv:2307.14984. · DOI · Paper page
  20. Dawei Gao, Zitao Li, Xuchen Pan, Weirui Kuang, Zhi- jian Ma, Bingchen Qian, Fei Wei, Wenhao Zhang, Yuexiang Xie, Daoyuan Chen, Liuyi Yao, Hongyi Peng, Zeyu Zhang, Lin Zhu, Chen Cheng, Hongzhu Shi, Yaliang Li, Bolin Ding, and Jingren Zhou. 2024. AgentScope: A Flexible yet Robust Multi-Agent Plat- form. Preprint, arXiv:2402.14034. · DOI · Paper page
  21. Ran Gong, Qiuyuan Huang, Xiaojian Ma, Yusuke Noda, Zane Durante, Zilong Zheng, Demetri Terzopoulos, Li Fei-Fei, Jianfeng Gao, and Hoi Vo. 2024. MindA- gent: Emergent Gaming Interaction. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 3154-3183, Mexico City, Mex- ico. Association for Computational Linguistics. · DOI
  22. Thore Graepel, Tom Minka, and R TrueSkill Herbrich. 2007. A bayesian skill rating system. Advances in Neural Information Processing Systems, 19(569- 576):7.
  23. Sven Gronauer and Klaus Diepold. 2022. Multi-agent deep reinforcement learning: A survey. Artificial Intelligence Review, 55(2):895-943. · DOI · Paper page
  24. Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V. Chawla, Olaf Wiest, and Xian- gliang Zhang. 2024. Large Language Model Based Multi-agents: A Survey of Progress and Challenges. In Thirty-Third International Joint Conference on Artificial Intelligence, volume 9, pages 8048-8057. · DOI · Paper page
  25. Shanshan Han, Qifan Zhang, Yuhang Yao, Weizhao Jin, Zhaozhuo Xu, and Chaoyang He. 2024. LLM Multi-Agent Systems: Challenges and Open Prob- lems. Preprint, arXiv:2402.03578. · DOI · Paper page
  26. Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2023. MetaGPT: Meta Pro- gramming for A Multi-Agent Collaborative Frame- work. Preprint, arXiv:2308.00352. · DOI · Paper page
  27. Qian Huang, Jian Vora, Percy Liang, and Jure Leskovec. 2024a. MLAgentBench: Evaluating Lan- guage Agents on Machine Learning Experimentation. Preprint, arXiv:2310.03302. · DOI · Paper page
  28. Yizhe Huang, Xingbo Wang, Hao Liu, Fanqi Kong, Aoyang Qin, Min Tang, Xiaoxi Wang, Song-Chun Zhu, Mingjie Bi, Siyuan Qi, and Xue Feng. 2024b. AdaSociety: An Adaptive Environment with So- cial Structures for Multi-Agent Decision-Making. Preprint, arXiv:2411.03865. · DOI
  29. Md. Ashraful Islam, Mohammed Eunus Ali, and Md Rizwan Parvez. 2024. MapCoder: Multi-Agent Code Generation for Competitive Problem Solving. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4912-4944, Bangkok, Thailand. Association for Computational Linguistics. · DOI · Paper page
  30. Yihuai Lan, Zhiqiang Hu, Lei Wang, Yang Wang, De- heng Ye, Peilin Zhao, Ee-Peng Lim, Hui Xiong, and Hao Wang. 2024. LLM-Based Agent Society Inves- tigation: Collaboration and Confrontation in Avalon Gameplay. Preprint, arXiv:2310.14985. · DOI
  31. Bin Lei, Yi Zhang, Shan Zuo, Ali Payani, and Caiwen Ding. 2024. MACM: Utilizing a Multi-Agent System for Condition Mining in Solving Complex Mathemat- ical Problems. Preprint, arXiv:2404.04735. · DOI
  32. Junkai Li, Siyu Wang, Meng Zhang, Weitao Li, Yungh- wei Lai, Xinhui Kang, Weizhi Ma, and Yang Liu. 2024a. Agent Hospital: A Simulacrum of Hos- pital with Evolvable Medical Agents. Preprint, arXiv:2405.02957. · DOI · Paper page
  33. Nian Li, Chen Gao, Mingyu Li, Yong Li, and Qingmin Liao. 2024b. EconAgent: Large Language Model- Empowered Agents for Simulating Macroeconomic Activities. In Proceedings of the 62nd Annual Meet- ing of the Association for Computational Linguis- tics (Volume 1: Long Papers), pages 15523-15536, Bangkok, Thailand. Association for Computational Linguistics. · DOI · Paper page
  34. Renhao Li, Minghuan Tan, Derek F. Wong, and Min Yang. 2024c. CoEvol: Constructing Better Re- sponses for Instruction Finetuning through Multi- Agent Cooperation. Preprint, arXiv:2406.07054. · DOI
  35. Xinyi Li, Sai Wang, Siqi Zeng, Yu Wu, and Yi Yang. 2024d. A survey on LLM-based multi-agent sys- tems: Workflow, infrastructure, and challenges. Vici- nagearth, 1(1):9. · DOI · Paper page
  36. Yuan Li, Yixuan Zhang, and Lichao Sun. 2023. MetaA- gents: Simulating Interactions of Human Behav- iors for LLM-based Task-oriented Coordination via Collaborative Generative Agents. Preprint, arXiv:2310.06500. · DOI · Paper page
  37. Jiaju Lin, Haoran Zhao, Aochi Zhang, Yiting Wu, Huqi- uyue Ping, and Qin Chen. 2023. AgentSims: An Open-Source Sandbox for Large Language Model Evaluation. Preprint, arXiv:2308.04026. · DOI · Paper page
  38. Leilei Lin, Yumeng Jin, Yingming Zhou, Wenlong Chen, and Chen Qian. 2024. MAO: A Framework for Pro- cess Model Generation with Multi-Agent Orchestra- tion. Preprint, arXiv:2408.01916. · DOI
  39. Ruibo Liu, Ruixin Yang, Chenyan Jia, Ge Zhang, Diyi Yang, and Soroush Vosoughi. 2023a. Training So- cially Aligned Language Models on Simulated Social Interactions. In The Twelfth International Conference on Learning Representations.
  40. Wei Liu, Chenxi Wang, Yifei Wang, Zihao Xie, Rennai Qiu, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, and Chen Qian. 2024a. Autonomous Agents for Collaborative Task under Information Asymme- try. Preprint, arXiv:2406.14928. · DOI
  41. Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, Shudan Zhang, Xiang Deng, Ao- han Zeng, Zhengxiao Du, Chenhui Zhang, Sheng Shen, Tianjun Zhang, Yu Su, Huan Sun, Minlie Huang, Yuxiao Dong, and Jie Tang. 2023b. Agent- Bench: Evaluating LLMs as Agents. Preprint, arXiv:2308.03688. · DOI · Paper page
  42. Zhiwei Liu, Weiran Yao, Jianguo Zhang, Le Xue, Shelby Heinecke, Rithesh Murthy, Yihao Feng, Zeyuan Chen, Juan Carlos Niebles, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, and Silvio Savarese. 2023c. BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents. Preprint, arXiv:2308.05960. · DOI · Paper page
  43. Xinyi Mou, Zhongyu Wei, and Xuanjing Huang. 2024. Unveiling the Truth and Facilitating Change: To- wards Agent-based Large-scale Social Movement Simulation. In Findings of the Association for Com- putational Linguistics ACL 2024, pages 4789-4809, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics. · DOI · Paper page
  44. OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Ale- man, Diogo Almeida, Janko Altenschmidt, Sam Alt- man, et al. 2024. GPT-4 Technical Report. Preprint, arXiv:2303.08774. · DOI · Paper page
  45. Afshin Oroojlooy and Davood Hajinezhad. 2023. A review of cooperative multi-agent deep reinforcement learning. Applied Intelligence, 53(11):13677-13722.
  46. Xuchen Pan, Dawei Gao, Yuexiang Xie, Yushuo Chen, Zhewei Wei, Yaliang Li, Bolin Ding, Ji-Rong Wen, and Jingren Zhou. 2024. Very Large-Scale Multi-Agent Simulation in AgentScope. Preprint, arXiv:2407.17789. · DOI
  47. Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022. Social Simulacra: Creating Pop- ulated Prototypes for Social Computing Systems. Preprint, arXiv:2208.04024. · DOI
  48. Chen Qian, Yufan Dang, Jiahao Li, Wei Liu, Zihao Xie, YiFei Wang, Weize Chen, Cheng Yang, Xin Cong, Xiaoyin Che, Zhiyuan Liu, and Maosong Sun. 2024a. Experiential Co-Learning of Software-Developing Agents. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers), pages 5628-5640, Bangkok, Thailand. Association for Computational Linguistics. · DOI
  49. Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, Juyuan Xu, Dahai Li, Zhiyuan Liu, and Maosong Sun. 2024b. ChatDev: Communicative Agents for Software Development. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 15174-15186, Bangkok, Thailand. Association for Computational Linguistics. · DOI · Paper page
  50. Chen Qian, Zihao Xie, Yifei Wang, Wei Liu, Yu- fan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Zhiyuan Liu, and Maosong Sun. 2024c. Scaling Large-Language-Model-based Multi-Agent Collabo- ration. Preprint, arXiv:2406.07155. · DOI · Paper page
  51. Weizhou Shen, Chenliang Li, Hongzhan Chen, Ming Yan, Xiaojun Quan, Hehong Chen, Ji Zhang, and Fei Huang. 2024. Small LLMs Are Weak Tool Learners: A Multi-LLM Agent. Preprint, arXiv:2401.07324. · DOI
  52. Haojun Shi, Suyu Ye, Xinyu Fang, Chuanyang Jin, Leyla Isik, Yen-Ling Kuo, and Tianmin Shu. 2024. MuMA-ToM: Multi-modal Multi-Agent Theory of Mind. Preprint, arXiv:2408.12574. · DOI
  53. Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023. Re- flexion: Language agents with verbal reinforcement learning. Advances in Neural Information Process- ing Systems, 36:8634-8652.
  54. Xunzhu Tang, Kisub Kim, Yewei Song, Cedric Lothritz, Bei Li, Saad Ezzini, Haoye Tian, Jacques Klein, and Tegawende F. Bissyande. 2024. CodeAgent: Au- tonomous Communicative Agents for Code Review. Preprint, arXiv:2402.02172. · DOI · Paper page
  55. Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, and Jirong Wen. 2024a. A survey on large language model based autonomous agents. Frontiers of Com- puter Science, 18(6):186345. · DOI · Paper page
  56. Lei Wang, Jingsen Zhang, Hao Yang, Zhiyuan Chen, Jiakai Tang, Zeyu Zhang, Xu Chen, Yankai Lin, Rui- hua Song, Wayne Xin Zhao, Jun Xu, Zhicheng Dou, Jun Wang, and Ji-Rong Wen. 2024b. User Behav- ior Simulation with Large Language Model based Agents. Preprint, arXiv:2306.02552. · DOI · Paper page
  57. Qineng Wang, Zihao Wang, Ying Su, Hanghang Tong, and Yangqiu Song. 2024c. Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key? In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers), pages 6106-6131, Bangkok, Thailand. Association for Computational Linguistics. · DOI
  58. Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, Tao Ge, Furu Wei, and Heng Ji. 2024d. Unleash- ing the Emergent Cognitive Synergy in Large Lan- guage Models: A Task-Solving Agent through Multi- Persona Self-Collaboration. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Hu- man Language Technologies (Volume 1: Long Pa- pers), pages 257-279, Mexico City, Mexico. Associ- ation for Computational Linguistics. · DOI · Paper page
  59. Fengli Xu, Jun Zhang, Chen Gao, Jie Feng, and Yong Li. 2023a. Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environment. Preprint, arXiv:2312.11813. · DOI
  60. Lin Xu, Zhiyuan Hu, Daquan Zhou, Hongyu Ren, Zhen Dong, Kurt Keutzer, See Kiong Ng, and Ji- ashi Feng. 2023b. MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration. Preprint, arXiv:2311.08562. · DOI
  61. Yuzhuang Xu, Shuo Wang, Peng Li, Fuwen Luo, Xiao- long Wang, Weidong Liu, and Yang Liu. 2024. Ex- ploring Large Language Models for Communication Games: An Empirical Study on Werewolf. Preprint, arXiv:2309.04658. · DOI · Paper page
  62. Xiangyu Yin, Chuqiao Shi, Yimo Han, and Yi Jiang. 2024. PEAR: A Robust and Flexible Automa- tion Framework for Ptychography Enabled by Mul- tiple Large Language Model Agents. Preprint, arXiv:2410.09034. · DOI
  63. Xiaoyan Yu, Tongxu Luo, Yifan Wei, Fangyu Lei, Yim- ing Huang, Hao Peng, and Liehuang Zhu. 2024. Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent. Preprint, arXiv:2402.13717. · DOI
  64. Haoqi Yuan, Chi Zhang, Hongcheng Wang, Feiyang Xie, Penglin Cai, Hao Dong, and Zongqing Lu. 2023. Skill Reinforcement Learning and Planning for Open-World Long-Horizon Tasks. Preprint, arXiv:2303.16563. · DOI
  65. Shengbin Yue, Siyuan Wang, Wei Chen, Xuanjing Huang, and Zhongyu Wei. 2024. Synergistic Multi-Agent Framework with Trajectory Learn- ing for Knowledge-Intensive Tasks. Preprint, arXiv:2407.09893. · DOI
  66. Ceyao Zhang, Kaijie Yang, Siyi Hu, Zihao Wang, Guanghe Li, Yihang Sun, Cheng Zhang, Zhaowei Zhang, Anji Liu, Song-Chun Zhu, Xiaojun Chang, Junge Zhang, Feng Yin, Yitao Liang, and Yaodong Yang. 2023a. ProAgent: Building Proactive Cooper- ative AI with Large Language Models. CoRR.
  67. Chi Zhang, Zhao Yang, Jiaxuan Liu, Yucheng Han, Xin Chen, Zebiao Huang, Bin Fu, and Gang Yu. 2023b. AppAgent: Multimodal Agents as Smartphone Users. Preprint, arXiv:2312.13771. · DOI · Paper page
  68. Jintian Zhang, Xin Xu, Ningyu Zhang, Ruibo Liu, Bryan Hooi, and Shumin Deng. 2024a. Exploring Collaboration Mechanisms for LLM Agents: A So- cial Psychology View. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14544- 14607, Bangkok, Thailand. Association for Compu- tational Linguistics. · DOI
  69. Zaibin Zhang, Yongting Zhang, Lijun Li, Jing Shao, Hongzhi Gao, Yu Qiao, Lijun Wang, Huchuan Lu, and Feng Zhao. 2024b. PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safety. In Proceedings of the 62nd Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers), pages 15202-15231, Bangkok, Thai- land. Association for Computational Linguistics. · DOI
  70. Jun Zhao, Can Zu, Hao Xu, Yi Lu, Wei He, Yiwen Ding, Tao Gui, Qi Zhang, and Xuanjing Huang. 2024a. LongAgent: Scaling Language Models to 128k Con- text through Multi-Agent Collaboration. Preprint, arXiv:2402.11550. · DOI · Paper page
  71. Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, and Xing Xie. 2024b. Com- peteAI: Understanding the Competition Dynamics in Large Language Model-based Agents. Preprint, arXiv:2310.17512. · DOI · Paper page
  72. Xiutian Zhao, Ke Wang, and Wei Peng. 2024c. An Electoral Approach to Diversify LLM-based Multi-Agent Collective Decision-Making. Preprint, arXiv:2410.15168. · DOI
  73. Hang Zou, Qiyang Zhao, Lina Bariah, Mehdi Bennis, and Merouane Debbah. 2023. Wireless Multi-Agent Generative AI: From Connected Intelligence to Col- lective Intelligence. Preprint, arXiv:2307.02757. · DOI

Cited by

Sorted by citations

See all 8

Metadata

Authors
Chen, S., Liu, Y., Han, W., Zhang, W., & Liu, T.
Affiliations
Harbin Institute of Technology (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2412.17481
arXiv
2412.17481
OpenAlex
W4405768156
Cited by
8
References
5
Citations by year
2026: 6 · 2025: 2
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Key Research and Development Program of China (2022YFF0902100)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
Keywords
multi-agent LLM systems, large language models, multi-agent systems, generative AI agents, agent evaluation, scenario simulation, agent frameworks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application. https://app.cochat.ai/papers/10.48550/arxiv.2412.17481
The paper
Chen, S., Liu, Y., Han, W., Zhang, W., & Liu, T. (2024). A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application. arXiv. https://doi.org/10.48550/arxiv.2412.17481