CoChat
Sign Up
PreprintCited by 23Reinforcement Learning in RoboticsRobot Manipulation and LearningRobotics and Automated Systems

Multi-agent Embodied AI: Advances and Future Directions

Open access
Feng, Zhaohan, Xue, Ruiqi, Yuan, Lei, Yu, Yang, Ding, Ning, Liu, Meiqin, Gao, Bingzhao, Sun, Jian +2 more·2025·arXiv
DOI 10.48550/arxiv.2505.05108arXiv 2505.05108
Open this paper in CoChat — free accountOpen PDF

Abstract

Embodied artificial intelligence (Embodied AI) plays a pivotal role in the application of advanced technologies in the intelligent era, where AI systems are integrated with physical bodies that enable them to perceive, reason, and interact with their environments. Through the use of sensors for input and actuators for action, these systems can learn and adapt based on real-world feedback, allowing them to perform tasks effectively in dynamic and unpredictable environments. As techniques such as deep learning (DL), reinforcement learning (RL), and large language models (LLMs) mature, embodied AI has become a leading field in both academia and industry, with applications spanning robotics, healthcare, transportation, and manufacturing. However, most research has focused on single-agent systems that often assume static, closed environments, whereas real-world embodied AI must navigate far more complex scenarios. In such settings, agents must not only interact with their surroundings but also collaborate with other agents, necessitating sophisticated mechanisms for adaptation, real-time learning, and collaborative problem-solving. Despite increasing interest in multi-agent systems, existing research remains narrow in scope, often relying on simplified models that fail to capture the full complexity of dynamic, open environments for multi-agent embodied AI. Moreover, no comprehensive survey has systematically reviewed the advancements in this area. As embodied AI rapidly evolves, it is crucial to deepen our understanding of multi-agent embodied AI to address the challenges presented by real-world applications. To fill this gap and foster further development in the field, this paper reviews the current state of research, analyzes key contributions, and identifies challenges and future directions, providing insights to guide innovation and progress in this field.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2505.05108

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • AI Agents have notable limitations that constrain their scalability in complex, dynamic, multi-step, and/or cooperative scenarios.

    “While AI Agents represent a significant leap in artificial intelligence capabilities, particularly in automating narrow tasks through tool-augmented reasoning, recent literature identifies notable limitations that constrain their scalability in complex, dynamic, multi-step, and/or cooperative scenarios [143]-[145].”

    From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [144]

    The Introduction and ‘General multi-agent Embodied AI framework’ describe limitations in collaboration, adaptation to dynamic environments, and scalability; ‘Multi-agent task allocation’ also notes difficulties with dependencies between subtasks. The paper addresses multi-agent embodied AI specifically, so it does not establish the claim for AI agents in general. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • Recent literature identifies notable limitations that constrain AI Agents' scalability in complex, dynamic, multi-step, and/or cooperative scenarios.

    “While AI Agents represent a significant leap in artificial intelligence capabilities, particularly in automating narrow tasks through tool-augmented reasoning, recent literature identifies notable limitations that constrain their scalability in complex, dynamic, multi-step, and/or cooperative scenarios [141-143].”

    From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [142]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Part of this paper’s reference list could not be split into single entries.

Flagged first, then by citations

Research works printed but not linked: 241

  1. Arash Ajoudani, Andrea Maria Zanchettin, Serena Ivaldi, Alin Albu-Schäffer, Kazuhiro Kosuge, and Oussama Khatib. 2018. Progress and prospects of the human-robot collaboration. Autonomous robots 42 (2018), 957- 975. 4.3
  2. Christopher Amato. 2024. An introduction to centralized training for decentralized execution in cooperative multi-agent reinforcement learning. arXiv preprint arXiv:2409.03052 (2024). · arXiv
  3. Federico Augugliaro, Angela P. Schoellig, and Raffaello D'Andrea. 2012. Generation of collision-free trajec- tories for a quadrocopter fleet: A sequential convex programming approach. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 1917-1922. 4.1
  4. Paul Barde, Jakob Foerster, Derek Nowrouzezahrai, and Amy Zhang. 2024. A Model-Based Solution to the Offline Multi-Agent Reinforcement Learning Coordination Problem. In Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems. 141--150. 4.3
  5. Suneel Belkhale, Tianli Ding, Ted Xiao, Pierre Sermanet, Quon Vuong, Jonathan Tompson, Yevgen Chebo- tar, Debidatta Dwibedi, and Dorsa Sadigh. 2024. Rt-h: Action hierarchies using language. arXiv preprint arXiv:2403.01823 (2024). · arXiv
  6. Christopher Berner, Greg Brockman, Brooke Chan, Vicki Cheung, Przemysław Dębiak, Christy Dennison, David Farhi, Quirin Fischer, Shariq Hashme, Chris Hesse, et al. 2019. Dota 2 with large scale deep reinforce- ment learning. arXiv preprint arXiv:1912.06680 (2019). · arXiv
  7. Johan Bjorck, Fernando Castañeda, Nikita Cherniadev, Xingye Da, Runyu Ding, Linxi Fan, Yu Fang, Dieter Fox, Fengyuan Hu, Spencer Huang, et al. 2025. GR00T N1: An Open Foundation Model for Generalist Humanoid Robots. arXiv preprint arXiv:2503.14734 (2025). 3.3 · arXiv
  8. Jan Blumenkamp, Ajay Shankar, Matteo Bettini, Joshua Bird, and Amanda Prorok. 2024. The cambridge robomaster: An agile multi-robot research platform. arXiv preprint arXiv:2405.02198 (2024). 4, 23o, 4.4 · arXiv
  9. Xiaohe Bo, Zeyu Zhang, Quanyu Dai, Xueyang Feng, Lei Wang, Rui Li, Xu Chen, and Ji-Rong Wen. 2024. Reflective Multi-Agent Collaboration based on Large Language Models. In Advances in Neural Information Processing Systems. 138595-138631. 4.3
  10. Nico Bohlinger, Grzegorz Czechmanowski, Maciej Piotr Krupka, Piotr Kicki, Krzysztof Walas, Jan Peters, and Davide Tateo. 2024. One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion. In Annual Conference on Robot Learning. 3.2
  11. Bruce Bridgeman and Philip Tseng. 2011. Embodied cognition and the perception-action link. Physics of life reviews 8, 1 (2011), 73-85. 2.1
  12. Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. OpenAI gym. arXiv preprint arXiv:1606.01540 (2016). 3.4 · arXiv
  13. Rodney Brooks. 1986. A robust layered control system for a mobile robot. IEEE journal on robotics and automation 2, 1 (1986), 14-23. 1
  14. Rodney A Brooks. 1991. New approaches to robotics. Science 253, 5025 (1991), 1227-1232. 1, 2.1
  15. Yuxin Cai, Xiangkun He, Hongliang Guo, Wei-Yun Yau, and Chen Lv. 2024. Transformer-based Multi-Agent Reinforcement Learning for Generalization of Heterogeneous Multi-Robot Cooperation. In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems. 13695-13702. 17, 4.2, 4.2
  16. Berk Calli, Arjun Singh, Aaron Walsman, Siddhartha Srinivasa, Pieter Abbeel, and Aaron M. Dollar. 2015. The YCB object and Model set: Towards common benchmarks for manipulation research. In 2015 International Conference on Advanced Robotics (ICAR). 510-517. 4.4
  17. Muqing Cao, Thien-Minh Nguyen, Shenghai Yuan, Andreas Anastasiou, Angelos Zacharia, Savvas Papaioan- nou, Panayiotis Kolios, Christos G Panayiotou, Marios M Polycarpou, Xinhang Xu, et al. 2025. Coopera- tive Aerial Robot Inspection Challenge: A Benchmark for Heterogeneous Multi-UAV Planning and Lessons Learned. arXiv preprint arXiv:2501.06566 (2025). 4, 23t, 4.4 · arXiv
  18. Yuji Cao, Huan Zhao, Yuheng Cheng, Ting Shu, Yue Chen, Guolong Liu, Gaoqi Liang, Junhua Zhao, Jinyue Yan, and Yun Li. 2024. Survey on large language model-enhanced reinforcement learning: Concept, taxonomy, and methods. IEEE Transactions on Neural Networks and Learning Systems (2024). 5
  19. Rohan Chandra, Zayne Sprague, and Joydeep Biswas. 2024. SOCIALGYM 2.0: Simulator for Multi-Robot Learning and Navigation in Shared Human Spaces. Proceedings of the AAAI Conference on Artificial Intelli- gence 38, 21 (2024), 23778-23780. 4, 23n, 4.4
  20. Prithvijit Chattopadhyay, Judy Hoffman, Roozbeh Mottaghi, and Aniruddha Kembhavi. 2021. RobustNav: Towards Benchmarking Robustness in Embodied Navigation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 15691-15700. 14c, 2, 3.4
  21. Huaben Chen, Wenkang Ji, Lufeng Xu, and Shiyu Zhao. 2023. Multi-agent consensus seeking via large lan- guage models. arXiv preprint arXiv:2310.20151 (2023). 4.3 · arXiv
  22. Junting Chen, Checheng Yu, Xunzhe Zhou, Tianqi Xu, Yao Mu, Mengkang Hu, Wenqi Shao, Yikai Wang, Guohao Li, and Lin Shao. 2025. EMOS: Embodiment-aware Heterogeneous Multi-robot Operating System with LLM Agents. In The Thirteenth International Conference on Learning Representations. 4.3
  23. Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Peiyi Wang, Tianyu Liu, and Baobao Chang. 2023. Towards end-to-end embodied decision making via multi-modal large language model: Explorations with GPT4-vision and beyond. arXiv preprint arXiv:2310.02071 (2023). 3.3 · arXiv
  24. Weizhe Chen, Sven Koenig, and Bistra Dilkina. 2024. Why solving multi-agent path finding with large language model has not succeeded yet. arXiv preprint arXiv:2401.03630 (2024). 4.3, 5 · arXiv
  25. Yuanpei Chen, Tianhao Wu, Shengjie Wang, Xidong Feng, Jiechuan Jiang, Zongqing Lu, Stephen McAleer, Hao Dong, Song-Chun Zhu, and Yaodong Yang. 2022. Towards Human-Level Bimanual Dexterous Manipula- tion with Reinforcement Learning. In Advances in Neural Information Processing Systems. 5150-5163. 4, 23f, 4.4
  26. Wei Chow, Jiageng Mao, Boyi Li, Daniel Seita, Vitor Guizilini, and Yue Wang. 2025. PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding. arXiv preprint arXiv:2501.16411 (2025). 14g, 2, 3.4 · arXiv
  27. Tianshu Chu, Sandeep Chinchali, and Sachin Katti. 2020. Multi-agent Reinforcement Learning for Networked System Control. In International Conference on Learning Representations. 5
  28. Neil T Dantam, Zachary K Kingston, Swarat Chaudhuri, and Lydia E Kavraki. 2018. An incremental constraint- based framework for task and motion planning. The International Journal of Robotics Research 37, 10 (2018), 1134-1151. 3.1
  29. Matt Deitke, Winson Han, Alvaro Herrasti, Aniruddha Kembhavi, Eric Kolve, Roozbeh Mottaghi, Jordi Sal- vador, Dustin Schwenk, Eli VanderBilt, Matthew Wallingford, Luca Weihs, Mark Yatskar, and Ali Farhadi. 2020. RoboTHOR: An Open Simulation-to-Real Embodied AI Platform. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 14b, 2, 3.4
  30. Zeyu Dong, Yimin Zhu, Yansong Li, Kevin Mahon, and Yu Sun. 2024. Generalizing End-To-End Autonomous Driving In Real-World Environments Using Zero-Shot LLMs. In 8th Annual Conference on Robot Learning. 3.3
  31. Ali Dorri, Salil S. Kanhere, and Raja Jurdak. 2018. Multi-Agent Systems: A Survey. IEEE Access 6 (2018), 28573-28593. 1, 2.2
  32. Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duck- worth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, and Pete Florence. 2023. PaLM-E: An Embodied Multimodal Language Model. In Proceedings of the 40th International Conference on Machine Learning. 8469-8488. 1, 3.3
  33. Weihua Du, Qiushi Lyu, Jiaming Shan, Zhenting Qi, Hongxin Zhang, Sunli Chen, Andi Peng, Tianmin Shu, Kwonjoon Lee, Behzad Dariush, and Chuang Gan. 2024. Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge. In Advances in neural information processing systems. 4, 23i, 4.4, 5
  34. Jiafei Duan, Samson Yu, Hui Li Tan, Hongyuan Zhu, and Cheston Tan. 2022. A survey of embodied ai: From simulators to research tasks. IEEE Transactions on Emerging Topics in Computational Intelligence 6, 2 (2022), 230-244. 1
  35. Jianguo Duan, Liwen Zhuang, Qinglei Zhang, Ying Zhou, and Jiyun Qin. 2024. Multimodal perception-fusion- control and human-robot collaboration in manufacturing: A review. The International Journal of Advanced Manufacturing Technology 132, 3 (2024), 1071-1093. 5
  36. Kunpeng Duan, Shanling Dong, Zhen Fan, Senlin Zhang, Yaqing Shu, and Meiqin Liu. 2025. Multimode trajectory tracking control of Unmanned Surface Vehicles based on LSTM assisted Model Predictive Control. Ocean Engineering 328 (2025), 121015. 2.5
  37. Manfred Eppe, Christian Gumbsch, Matthias Kerzel, Phuong DH Nguyen, Martin V Butz, and Stefan Wermter. 2020. Hierarchical principles of embodied reinforcement learning: A review. arXiv preprint arXiv:2012.10147 (2020). · arXiv
  38. Kevin Farias, Pablo Moraes, Igor Nunes, Juan Deniz, Sebastian Barcelona, Hiago Sodre, William Moraes, Monica Rodriguez, Ahilen Mazondo, Vincent Sandin, et al. 2025. RoboCup Rescue 2025 Team Description Paper UruBots. arXiv preprint arXiv:2504.09778 (2025). 5 · arXiv
  39. Dapeng Feng, Yuhua Qi, Shipeng Zhong, Zhiqiang Chen, Qiming Chen, Hongbo Chen, Jin Wu, and Jun Ma. 2024. S3E: A Multi-Robot Multimodal Dataset for Collaborative SLAM. IEEE Robotics and Automation Letters 9, 12 (2024), 11401-11408. 4, 23p, 4.4
  40. Xueyang Feng, Zhi-Yuan Chen, Yujia Qin, Yankai Lin, Xu Chen, Zhiyuan Liu, and Ji-Rong Wen. 2024. Large language model-based human-agent collaboration for complex task solving. arXiv preprint arXiv:2402.12914 (2024). 4.3 · arXiv
  41. Zhaohan Feng, Jie Chen, Wei Xiao, Jian Sun, Bin Xin, and Gang Wang. 2024. Learning Hybrid Policies for MPC with Application to Drone Flight in Unknown Dynamic Environments. Unmanned Systems 12, 02 (2024), 429-441. 2.5, 3.2
  42. Philipp Foehn, Angel Romero, and Davide Scaramuzza. 2021. Time-optimal planning for quadrotor waypoint flight. Science Robotics 6, 56 (2021), eabh1221. 3.1
  43. Jakob N Foerster, Gregory Farquhar, Triantafyllos Afouras, Nantas Nardelli, and Shimon Whiteson. 2018. Counterfactual multi-agent policy gradients. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence. 2974-2982. 5
  44. Thomas Fork and Francesco Borrelli. 2023. Euclidean and non-Euclidean trajectory optimization approaches for quadrotor racing. arXiv preprint arXiv:2309.07262 (2023). 3.1 · arXiv
  45. Taioli Francesco, Zorzi Edoardo, Franchi Gianni, Castellini Alberto, Farinelli Alessandro, Cristani Marco, and Wang Yiming. 2025. Collaborative Instance Object Navigation: Leveraging Uncertainty-Awareness to Minimize Human-Agent Dialogues. arXiv preprint arXiv:2412.01250 (2025). 4.3 · arXiv
  46. Jiawei Fu, Yunlong Song, Yan Wu, Fisher Yu, and Davide Scaramuzza. 2023. Learning Deep Sensorimotor Policies for Vision-Based Autonomous Drone Racing. In IEEE/RSJ International Conference on Intelligent Robots and Systems. 5243-5250. 1, 3.2
  47. Hao Gao, Shaoyu Chen, Bo Jiang, Bencheng Liao, Yiang Shi, Xiaoyang Guo, Yuechuan Pu, Haoran Yin, Xiangyu Li, Xinbang Zhang, et al. 2025. Rad: Training an end-to-end driving policy via large-scale 3dgs-based reinforcement learning. arXiv preprint arXiv:2502.13144 (2025). 3.2, 3.3 · arXiv
  48. Jiawei Gao, Ziqin Wang, Zeqi Xiao, Jingbo Wang, Tai Wang, Jinkun Cao, Xiaolin Hu, Si Liu, Jifeng Dai, and Jiangmiao Pang. 2024. CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics. In Advances in Neural Information Processing Systems. 79741-79763. 4.3
  49. Yuan Gao, Junfeng Chen, Xi Chen, Chongyang Wang, Junjie Hu, Fuqin Deng, and Tin Lun Lam. 2023. Asym- metric Self-Play-Enabled Intelligent Heterogeneous Multirobot Catching System Using Deep Multi-agent Re- inforcement Learning. IEEE Transactions on Robotics 39, 4 (2023), 2603-2622. 3, 4.2
  50. Yiran Geng, Boshi An, Haoran Geng, Yuanpei Chen, Yaodong Yang, and Hao Dong. 2023. RLAfford: End- to-End Affordance Learning for Robotic Manipulation. In IEEE International Conference on Robotics and Automation. 5880-5886. 3.2
  51. Atharva Ghotavadekar, František Nekovář, Martin Saska, and Jan Faigl. 2025. Variable Time-Step MPC for Agile Multi-Rotor UAV Interception of Dynamic Targets. IEEE Robotics and Automation Letters 10, 2 (2025), 1249-1256. 3.1
  52. Ran Gong, Xiaofeng Gao, Qiaozi Gao, Suhaila Shakiah, Govind Thattai, and Gaurav S. Sukhatme. 2023. LEMMA: Learning Language-Conditioned Multi-Robot Manipulation. IEEE Robotics and Automation Letters 8, 10 (2023), 6835-6842. 4, 23h, 4.4
  53. Ian J Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672-2680. 2.6
  54. Albert Gu and Tri Dao. 2024. Mamba: Linear-Time Sequence Modeling with Selective State Spaces. In First Conference on Language Modeling. 2.7
  55. Jiayuan Gu, Fanbo Xiang, Xuanlin Li, Zhan Ling, Xiqiang Liu, Tongzhou Mu, Yihe Tang, Stone Tao, Xinyue Wei, Yunchao Yao, Xiaodi Yuan, Pengwei Xie, Zhiao Huang, Rui Chen, and Hao Su. 2023. ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills. In The Eleventh International Conference on Learning Representations. 14e, 2, 3.4
  56. Cong Guan, Lichao Zhang, Chunpeng Fan, Yichen Li, Feng Chen, Lihe Li, Yunjia Tian, Lei Yuan, and Yang Yu. 2023. Efficient Human-AI Coordination via Preparatory Language-based Convention. arXiv preprint arXiv:2311.00416 (2023). 4.3 · arXiv
  57. Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V Chawla, Olaf Wiest, and Xi- angliang Zhang. 2024. Large language model based multi-agents: A survey of progress and challenges. arXiv preprint arXiv:2402.01680 (2024). 2.2 · arXiv
  58. Xudong Guo, Kaixuan Huang, Jiale Liu, Wenhui Fan, Natalia Vélez, Qingyun Wu, Huazheng Wang, Thomas L. Griffiths, and Mengdi Wang. 2024. Embodied LLM Agents Learn to Cooperate in Organized Teams. In Lan- guage Gamification -NeurIPS 2024 Workshop. 20, 4.3, 4.3
  59. Valentin N Hartmann, Tirza Heinle, and Stelian Coros. 2025. A Benchmark for Optimal Multi-Modal Multi- Robot Multi-Goal Path Planning with Given Robot Assignment. arXiv preprint arXiv:2503.03509 (2025). 4, 23s, 4.4 · arXiv
  60. Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, Christoforos Nalmpantis, Jane Dwivedi-Yu, Maksym Zhuravinskyi, Eric Hambro, Sainbayar Sukhbaatar, and Roberta Raileanu. 2024. Teaching large language models to reason with reinforcement learning. arXiv preprint arXiv:2403.04642 (2024). 2.4 · arXiv
  61. Tairan He, Chong Zhang, Wenli Xiao, Guanqi He, Changliu Liu, and Guanya Shi. 2024. Agile but safe: Learning collision-free high-speed legged locomotion. arXiv preprint arXiv:2401.17583 (2024). 3.2 · arXiv
  62. Lukas Heuer, Luigi Palmieri, Anna Mannucci, Sven Koenig, and Martin Magnusson. 2024. Benchmarking Multi-Robot Coordination in Realistic, Unstructured Human-Shared Environments. In 2024 IEEE International Conference on Robotics and Automation. 14541-14547. 4, 23l, 4.4
  63. Jonathan Ho and Stefano Ermon. 2016. Generative adversarial imitation learning. In Advances in neural infor- mation processing systems. 4572-4580. 2.6
  64. Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising Diffusion Probabilistic Models. In Advances in Neural Information Processing Systems. 6840-6851. 2.7
  65. Chuye Hong, Kangyao Huang, and Huaping Liu. 2024. Learning a Distributed Hierarchical Locomotion Con- troller for Embodied Cooperation. In Annual Conference on Robot Learning. 3.2
  66. Jialiang Hou, Xin Zhou, Zhongxue Gan, and Fei Gao. 2022. Enhanced Decentralized Autonomous Aerial Robot Teams With Group Planning. IEEE Robotics and Automation Letters 7, 4 (2022), 9240-9247. 15, 4.1
  67. Yingdong Hu, Fanqi Lin, Tong Zhang, Li Yi, and Yang Gao. 2023. Look before you leap: Unveiling the power of GPT-4v in robotic vision-language planning. arXiv preprint arXiv:2311.17842 (2023). 3.3 · arXiv
  68. Dawei Huang, Chuan Yan, Qing Li, and Xiaojiang Peng. 2024. From Large Language Models to Large Multi- modal Models: A Literature Review. Applied Sciences 14, 12 (2024). 5
  69. Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Tomas Jackson, Noah Brown, Linda Luu, Sergey Levine, Karol Hausman, and brian ichter. 2023. Inner Monologue: Embodied Reasoning through Planning with Lan- guage Models. In Proceedings of The 6th Conference on Robot Learning. 1769-1782. 1, 3.3
  70. Yidong Huang, Jacob Sansom, Ziqiao Ma, Felix Gervits, and Joyce Chai. 2024. DriVLMe: Enhancing LLM- based Autonomous Driving Agents with Embodied and Social Experiences. In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems. 3153-3160. 3.3
  71. brian ichter, Anthony Brohan, Yevgen Chebotar, Chelsea Finn, Karol Hausman, Alexander Herzog, Daniel Ho, Julian Ibarz, Alex Irpan, Eric Jang, Ryan Julian, Dmitry Kalashnikov, Sergey Levine, Yao Lu, Carolina Parada, Kanishka Rao, Pierre Sermanet, Alexander T Toshev, Vincent Vanhoucke, Fei Xia, Ted Xiao, Peng Xu, Mengyuan Yan, Noah Brown, Michael Ahn, Omar Cortes, Nicolas Sievers, Clayton Tan, Sichun Xu, Diego Reyes, Jarek Rettinghouse, Jornell Quiambao, Peter Pastor, Linda Luu, Kuang-Huei Lee, Yuheng Kuang, Sally Jesmonth, Nikhil J. Joshi, Kyle Jeffrey, Rosario Jauregui Ruano, Jasmine Hsu, Keerthana Gopalakrishnan, Byron David, Andy Zeng, and Chuyuan Kelly Fu. 2023. Do As I Can, Not As I Say: Grounding Language in Robotic Affordances. In Proceedings of The 6th Conference on Robot Learning. 287-318. 6, 2.5, 1, 3.3
  72. Physical Intelligence, Kevin Black, Noah Brown, James Darpinian, Karan Dhabalia, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, et al. 2025. pi_{0.5}: A Vision-Language-Action Model with Open-World Generalization. arXiv preprint arXiv:2504.16054 (2025). 1, 3.3 · arXiv
  73. Unnat Jain, Luca Weihs, Eric Kolve, Ali Farhadi, Svetlana Lazebnik, Aniruddha Kembhavi, and Alexander Schwing. 2020. A Cordial Sync: Going Beyond Marginal Policies for Multi-agent Embodied Tasks. In Com- puter Vision -ECCV 2020. 471-490. 4, 23b, 4.4
  74. Biao Jia and Dinesh Manocha. 2024. Sim-to-Real Robotic Sketching using Behavior Cloning and Reinforce- ment Learning. In 2024 IEEE International Conference on Robotics and Automation. 18272-18278. 12, 3.2
  75. Fan Jia, Weixin Mao, Yingfei Liu, Yucheng Zhao, Yuqing Wen, Chi Zhang, Xiangyu Zhang, and Tiancai Wang. 2023. Adriver-i: A general world model for autonomous driving. arXiv preprint arXiv:2311.13549 (2023). 3.3 · arXiv
  76. Kemou Jiang, Xuan Cai, Zhiyong Cui, Aoyong Li, Yilong Ren, Haiyang Yu, Hao Yang, Daocheng Fu, Licheng Wen, and Pinlong Cai. 2024. KoMA: Knowledge-Driven Multi-Agent Framework for Autonomous Driving With Large Language Models. IEEE Transactions on Intelligent Vehicles (2024), 1-15. 3.3
  77. Tao Jiang, Lei Yuan, Lihe Li, Cong Guan, Zongzhang Zhang, and Yang Yu. 2025. Multi-Agent Domain Calibration with a Handful of Offline Data. In The Thirty-eighth Annual Conference on Neural Information Processing Systems. 5
  78. Shyam Sundar Kannan, Vishnunandan L. N. Venkatesh, and Byung-Cheol Min. 2024. SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models. In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems. 12140-12147. 19, 4.3
  79. Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan P Foster, Pannag R Sanketi, Quan Vuong, Thomas Kollar, Benjamin Burchfiel, Russ Tedrake, Dorsa Sadigh, Sergey Levine, Percy Liang, and Chelsea Finn. 2024. OpenVLA: An Open-Source Vision-Language- Action Model. In 8th Annual Conference on Robot Learning. 1, 3.3
  80. Taewoong Kim, Cheolhong Min, Byeonghwi Kim, Jinyeon Kim, Wonje Jeung, and Jonghyun Choi. 2025. ReALFRED: An Embodied Instruction Following Benchmark in Photo-Realistic Environments. In Computer Vision -ECCV 2024. 346-364. 14l, 2, 3.4
  81. B Ravi Kiran, Ibrahim Sobh, Victor Talpaert, Patrick Mannion, Ahmad A. Al Sallab, Senthil Yogamani, and Patrick Pérez. 2022. Deep Reinforcement Learning for Autonomous Driving: A Survey. IEEE Transactions on Intelligent Transportation Systems 23, 6 (2022), 4909-4926. 2.4
  82. N. Koenig and A. Howard. 2004. Design and use paradigms for Gazebo, an open-source multi-robot simulator. In 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. 3. 2149-2154. 4.4
  83. Orr Krupnik, Igor Mordatch, and Aviv Tamar. 2020. Multi-Agent Reinforcement Learning with Multi-Step Generative Models. In Proceedings of the Conference on Robot Learning, Vol. 100. 776-790. 4.3
  84. Dana Kulic, Gentiane Venture, Kostas Bekris, and Enrique Coronado. 2024. MPCC++: Model Predictive Con- touring Control for Time-Optimal Flight with Safety Constraints. In Robotics: Science and Systems Conference. 3.1
  85. Minae Kwon, Sang Michael Xie, Kalesha Bullard, and Dorsa Sadigh. 2023. Reward Design with Language Models. In The Eleventh International Conference on Learning Representations. 3.3
  86. Guillaume Lample and Devendra Singh Chaplot. 2017. Playing FPS games with deep reinforcement learning. In Proceedings of the AAAI Conference on Artificial Intelligence. 2.4
  87. Yujeong Lee, Sangwoo Shin, Wei-Jin Park, and Honguk Woo. 2024. LLM-Based Offline Learning for Embod- ied Agents via Consistency-Guided Reward Ensemble. arXiv preprint arXiv:2411.17135 (2024). 3.3 · arXiv
  88. Jinlong Li, Xinyu Liu, Baolu Li, Runsheng Xu, Jiachen Li, Hongkai Yu, and Zhengzhong Tu. 2024. Comamba: Real-time cooperative perception unlocked with state space models. arXiv preprint arXiv:2409.10699 (2024). 3.3 · arXiv
  89. Jinning Li, Chen Tang, Masayoshi Tomizuka, and Wei Zhan. 2022. Hierarchical Planning Through Goal- Conditioned Offline Reinforcement Learning. IEEE Robotics and Automation Letters 7, 4 (2022), 10216- 10223. 2.5
  90. Lingyun Luke Li, Bin Yang, Ming Liang, Wenyuan Zeng, Mengye Ren, Sean Segal, and Raquel Urtasun. 2020. End-to-end Contextual Perception and Prediction with Interaction Transformer. In IEEE/RSJ International Con- ference on Intelligent Robots and Systems. 5784-5791. 3.3
  91. Manling Li, Shiyu Zhao, Qineng Wang, Kangrui Wang, Yu Zhou, Sanjana Srivastava, Cem Gokmen, Tony Lee, Li Erran Li, Ruohan Zhang, Weiyu Liu, Percy Liang, Li Fei-Fei, Jiayuan Mao, and Jiajun Wu. 2024. Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making. In Advances in Neural Information Processing Systems. 100428-100534. 14k, 2, 3.4
  92. Yiming Li, Dekun Ma, Ziyan An, Zixun Wang, Yiqi Zhong, Siheng Chen, and Chen Feng. 2022. V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Driving. IEEE Robotics and Automation Letters 7, 4 (2022), 10914-10921. 4, 23e, 4.4
  93. Yifei Li, Xin Wang, Jian Sun, Gang Wang, and Jie Chen. 2023. Data-driven consensus control of fully dis- tributed event-triggered multi-agent systems. Science China Information Sciences 66, 5 (2023), 152202. 3
  94. Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015). 2.4 · arXiv
  95. Bill Yuchen Lin, Yicheng Fu, Karina Yang, Faeze Brahman, Shiyu Huang, Chandra Bhagavatula, Prithviraj Ammanabrolu, Yejin Choi, and Xiang Ren. 2023. SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks. In Advances in Neural Information Processing Systems. 23813-23825. 3.3
  96. Jia Liu and Min Chen. 2024. FaGeL: Fabric LLMs Agent empowered Embodied Intelligence Evolution with Autonomous Human-Machine Collaboration. arXiv preprint arXiv:2412.20297 (2024). 3, 4.3 · arXiv
  97. Jiaqi Liu, Chengkai Xu, Peng Hang, Jian Sun, Mingyu Ding, Wei Zhan, and Masayoshi Tomizuka. 2025. Language-Driven Policy Distillation for Cooperative Driving in Multi-Agent Reinforcement Learning. IEEE Robotics and Automation Letters 10, 5 (2025), 4292-4299. 3, 4.3
  98. Jie Liu, Pan Zhou, Yingjun Du, Ah-Hwee Tan, Cees GM Snoek, Jan-Jakob Sonke, and Efstratios Gavves. 2024. CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperation. arXiv preprint arXiv:2411.04679 (2024). 4.3 · arXiv
  99. Kehui Liu, Zixin Tang, Dong Wang, Zhigang Wang, Xuelong Li, and Bin Zhao. 2024. Coherent: Collaboration of heterogeneous multi-robot system with large language models. arXiv preprint arXiv:2409.15146 (2024). 3, 4.3 · arXiv
  100. Wenjie Liu, Jian Sun, Gang Wang, Francesco Bullo, and Jie Chen. 2023. Data-Driven Resilient Predictive Control Under Denial-of-Service. IEEE Trans. Automat. Control 68, 8 (2023), 4722-4737. 3
  101. Yang Liu, Weixing Chen, Yongjie Bai, Xiaodan Liang, Guanbin Li, Wen Gao, and Liang Lin. 2024. Aligning cyber space with physical world: A comprehensive survey on embodied ai. arXiv preprint arXiv:2407.06886 (2024). 1, 1, 2.1 · arXiv
  102. Zeyang Liu, Xinrui Yang, Shiguang Sun, Long Qian, Lipeng Wan, Xingyu Chen, and Xuguang Lan. 2024. Grounded Answers for Multi-agent Decision-making Problem through Generative World Model. In Advances in Neural Information Processing Systems. 46622-46652. 4.3
  103. Zijun Liu, Yanzhe Zhang, Peng Li, Yang Liu, and Diyi Yang. 2023. Dynamic llm-agent network: An llm-agent collaboration framework with agent team optimization. arXiv preprint arXiv:2310.02170 (2023). 4.3 · arXiv
  104. Ryan Lowe, Yi Wu, Aviv Tamar, Jean Harb, Pieter Abbeel, and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. In Advances in neural information processing systems. 6382- 6393. 2.4
  105. Tomás Lozano-Pérez and Leslie Pack Kaelbling. 2014. A constraint-based method for solving sequential ma- nipulation planning problems. In IEEE/RSJ International Conference on Intelligent Robots and Systems. 3684- 3691. 3.1
  106. Fan-Ming Luo, Tian Xu, Hang Lai, Xiong-Hui Chen, Weinan Zhang, and Yang Yu. 2024. A survey on model- based reinforcement learning. Science China Information Sciences 67, 2 (2024), 121101. 5
  107. Yueen Ma, Zixing Song, Yuzheng Zhuang, Jianye Hao, and Irwin King. 2024. A survey on vision-language- action models for embodied ai. arXiv preprint arXiv:2405.14093 (2024). 1, 2.1, 5 · arXiv
  108. Yecheng Jason Ma, William Liang, Guanzhi Wang, De-An Huang, Osbert Bastani, Dinesh Jayaraman, Yuke Zhu, Linxi Fan, and Anima Anandkumar. 2023. Eureka: Human-level reward design via coding large language models. arXiv preprint arXiv:2310.12931 (2023). 3.3 · arXiv
  109. Steven Macenski, Tully Foote, Brian Gerkey, Chris Lalancette, and William Woodall. 2022. Robot Operating System 2: Design, architecture, and uses in the wild. Science Robotics 7, 66 (2022), eabm6074. 4.4
  110. Arjun Majumdar, Anurag Ajay, Xiaohan Zhang, Pranav Putta, Sriram Yenamandra, Mikael Henaff, Sneha Silwal, Paul Mcvay, Oleksandr Maksymets, Sergio Arnaud, Karmesh Yadav, Qiyang Li, Ben Newman, Mo- hit Sharma, Vincent Berges, Shiqi Zhang, Pulkit Agrawal, Yonatan Bisk, Dhruv Batra, Mrinal Kalakrishnan, Franziska Meier, Chris Paxton, Alexander Sax, and Aravind Rajeswaran. 2024. OpenEQA: Embodied Question Answering in the Era of Foundation Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 16488-16498. 14j, 2, 3.4
  111. Viktor Makoviychuk, Lukasz Wawrzyniak, Yunrong Guo, Michelle Lu, Kier Storey, Miles Macklin, David Hoeller, Nikita Rudin, Arthur Allshire, Ankur Handa, and Gavriel State. 2021. Isaac Gym: High Performance GPU Based Physics Simulation For Robot Learning. In Advances in neural information processing systems. 4.4
  112. Zhao Mandi, Shreeya Jain, and Shuran Song. 2024. RoCo: Dialectic Multi-Robot Collaboration with Large Language Models. In 2024 IEEE International Conference on Robotics and Automation. 286-299. 4, 23j, 4.4
  113. Pietro Mazzaglia, Tim Verbelen, Bart Dhoedt, A Courville, and S Rajeswar. 2024. GenRL: Multimodal- foundation world models for generalization in embodied agents. In Advances in neural information processing systems. 3.3
  114. Oier Mees, Dibya Ghosh, Karl Pertsch, Kevin Black, Homer Rich Walke, Sudeep Dasari, Joey Hejna, Tobias Kreiman, Charles Xu, Jianlan Luo, You Liang Tan, Dorsa Sadigh, Chelsea Finn, and Sergey Levine. 2024. Octo: An Open-Source Generalist Robot Policy. In First Workshop on Vision-Language Models for Navigation and Manipulation at ICRA 2024. 1, 3.3
  115. Yunpeng Mei, Jian Sun, Zhihong Peng, Fang Deng, Gang Wang, and Jie Chen. 2025. RoG-SAM: A Language- Driven Framework for Instance-Level Robotic Grasping Detection. IEEE Transactions on Multimedia (2025), 1-13. 3.3
  116. Daniel Mellinger and Vijay Kumar. 2011. Minimum snap trajectory generation and control for quadrotors. In IEEE International Conference on Robotics and Automation. 2520-2525. 3.1
  117. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing Atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013). 2.4 · arXiv
  118. Yao Mu, Qinglong Zhang, Mengkang Hu, Wenhai Wang, Mingyu Ding, Jun Jin, Bin Wang, Jifeng Dai, Yu Qiao, and Ping Luo. 2023. EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought. In Advances in Neural Information Processing Systems. 25081-25094. 14f, 2, 3.4
  119. Siddharth Nayak, Adelmo Morrison Orozco, Marina Ten Have, Vittal Thirumalai, Jackson Zhang, Darren Chen, Aditya Kapoor, Eric Robinson, Karthik Gopalakrishnan, James Harrison, Brian Ichter, Anuj Mahajan, and Hamsa Balakrishnan. 2024. Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environ- ments. In Advances in Neural Information Processing Systems. 67929-67967. 4, 23k, 4.4
  120. Kamal K Ndousse, Douglas Eck, Sergey Levine, and Natasha Jaques. 2021. Emergent social learning via multi-agent reinforcement learning. In International conference on machine learning. 7991-8004. 5
  121. Allen Newel and Herbert A Simon. 1976. Computer science as empirical inquiry: Symbols and search. Com- mun. ACM 19, 3 (1976), 113-126. 1
  122. Rui Nian, Jinfeng Liu, and Biao Huang. 2020. A review on reinforcement learning: Introduction and applica- tions in industrial process control. Computers & Chemical Engineering 139 (2020), 106886. 2.4
  123. Kolby Nottingham, Prithviraj Ammanabrolu, Alane Suhr, Yejin Choi, Hannaneh Hajishirzi, Sameer Singh, and Roy Fox. 2023. Do embodied agents dream of pixelated sheep: Embodied decision making using language guided world modelling. In International Conference on Machine Learning. 26311-26325. 3.3
  124. Kazuma Obata, Tatsuya Aoki, Takato Horii, Tadahiro Taniguchi, and Takayuki Nagai. 2025. LiP-LLM: In- tegrating Linear Programming and Dependency Graph With Large Language Models for Multi-Robot Task Planning. IEEE Robotics and Automation Letters 10 (2025), 1122-1129. 4.3
  125. Hanbit Oh and Takamitsu Matsubara. 2024. Leveraging Demonstrator-Perceived Precision for Safe Interactive Imitation Learning of Clearance-Limited Tasks. IEEE Robotics and Automation Letters 9, 4 (2024), 3387-3394. 3.2
  126. Linda Onnasch and Eileen Roesler. 2021. A taxonomy to structure and analyze human-robot interaction. International Journal of Social Robotics 13, 4 (2021), 833-849. 4.3
  127. Afshin Oroojlooy and Davood Hajinezhad. 2023. A review of cooperative multi-agent deep reinforcement learning. Applied Intelligence 53, 11 (2023), 13677-13722. 1
  128. Joaquim Ortiz-Haro, Wolfgang Hönig, Valentin N. Hartmann, Marc Toussaint, and Ludovic Righetti. 2024. iDb- RRT: Sampling-based Kinodynamic Motion Planning with Motion Primitives and Trajectory Optimization. In IEEE/RSJ International Conference on Intelligent Robots and Systems. 10702-10709. 3.1
  129. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Gray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022. Training language models to follow instructions with human feedback. In Advances in Neural Information Processing Systems. 2.4
  130. Shubham Pateria, Budhitama Subagdja, Ah-hwee Tan, and Chai Quek. 2021. Hierarchical reinforcement learn- ing: A comprehensive survey. Comput. Surveys 54, 5 (2021), 1-35. 2.5
  131. Aleksei Petrenko, Erik Wijmans, Brennan Shacklett, and Vladlen Koltun. 2021. Megaverse: Simulating Em- bodied Agents at One Million Experiences per Second. In Proceedings of the 38th International Conference on Machine Learning. 8556-8566. 4, 23d, 4.4
  132. Chen Qian, Zihao Xie, YiFei Wang, Wei Liu, Kunlun Zhu, Hanchen Xia, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Zhiyuan Liu, and Maosong Sun. 2025. Scaling Large Language Model-based Multi-Agent Collaboration. In The Thirteenth International Conference on Learning Representations. 3, 4.3
  133. Chao Qin, Maxime SJ Michet, Jingxiang Chen, and Hugh H-T Liu. 2024. Time-optimal gate-traversing planner for autonomous drone racing. In IEEE International Conference on Robotics and Automation. 8693-8699. 3.1
  134. Sabela Ramos, Sertan Girgin, Léonard Hussenot, Damien Vincent, Hanna Yakubovich, Daniel Toyama, Anita Gergely, Piotr Stanczyk, Raphael Marinier, Jeremiah Harmsen, et al. 2021. Rlds: An ecosystem to generate, share and use datasets in reinforcement learning. arXiv preprint arXiv:2111.02767 (2021). 3.4 · arXiv
  135. Tabish Rashid, Mikayel Samvelyan, Christian Schroeder De Witt, Gregory Farquhar, Jakob Foerster, and Shi- mon Whiteson. 2020. Monotonic value function factorisation for deep multi-agent reinforcement learning. Journal of Machine Learning Research 21, 178 (2020), 1-51. 2.4, 5, 5
  136. Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gómez Colmenarejo, Alexander Novikov, Gabriel Barth- maron, Mai Giménez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, and Nando de Freitas. 2022. A Generalist Agent. Transactions on Machine Learning Research (2022). 5
  137. Nicholas Roy, Ingmar Posner, Tim Barfoot, Philippe Beaudoin, Yoshua Bengio, Jeannette Bohg, Oliver Brock, Isabelle Depatie, Dieter Fox, Dan Koditschek, et al. 2021. From machine learning to robotics: Challenges and opportunities for embodied intelligence. arXiv preprint arXiv:2110.15245 (2021). 1 · arXiv
  138. Elayne Ruane, Abeba Birhane, and Anthony Ventresque. 2019. Conversational AI: Social and Ethical Consid- erations. AICS 2563 (2019), 104-115. 5
  139. Mikayel Samvelyan, Tabish Rashid, Christian Schroeder De Witt, Gregory Farquhar, Nantas Nardelli, Tim GJ Rudner, Chia-Man Hung, Philip HS Torr, Jakob Foerster, and Shimon Whiteson. 2019. The starcraft multi-agent challenge. arXiv preprint arXiv:1902.04043 (2019). 5 · arXiv
  140. Simon Schaefer, Luigi Palmieri, Lukas Heuer, Ruediger Dillmann, Sven Koenig, and Alexander Kleiner. 2023. A Benchmark for Multi-Robot Planning in Realistic, Complex and Cluttered Environments. In 2023 IEEE International Conference on Robotics and Automation. 9231-9237. 4, 23g, 4.4
  141. John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017). 2.4 · arXiv
  142. Carmelo Sferrazza, Dun-Ming Huang, Xingyu Lin, Youngwoon Lee, and Pieter Abbeel. 2024. Humanoid- bench: Simulated humanoid benchmark for whole-body locomotion and manipulation. arXiv preprint arXiv:2403.10506 (2024). 14h, 2, 3.4 · arXiv
  143. Hao Shao, Yuxuan Hu, Letian Wang, Guanglu Song, Steven L. Waslander, Yu Liu, and Hongsheng Li. 2024. LMDrive: Closed-Loop End-to-End Driving with Large Language Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 15120-15130. 3.3
  144. Lucy Xiaoyang Shi, Archit Sharma, Tony Z. Zhao, and Chelsea Finn. 2023. Waypoint-Based Imitation Learning for Robotic Manipulation. In 7th Annual Conference on Robot Learning. 3.2
  145. Zifeng Shi, Meiqin Liu, Senlin Zhang, Ronghao Zheng, Shanling Dong, and Ping Wei. 2025. GAWM: Global- Aware World Model for Multi-Agent Reinforcement Learning. arXiv preprint arXiv:2501.10116 (2025). 4.3 · arXiv
  146. Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettle- moyer, and Dieter Fox. 2020. ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 14a, 2, 3.4
  147. David Silver. 2021. Cooperative Pathfinding. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 1 (2021), 117-122. 4.1
  148. Bharat Singh, Rajesh Kumar, and Vinay Pratap Singh. 2022. Reinforcement learning in robotic applications: a comprehensive survey. Artificial Intelligence Review 55, 2 (2022), 945-990. 2.4
  149. Ishika Singh, David Traum, and Jesse Thomason. 2024. Twostep: Multi-agent task planning using classical planners and large language models. arXiv preprint arXiv:2403.17246 (2024). 3, 4.3 · arXiv
  150. Chan Hee Song, Jiaman Wu, Clayton Washington, Brian M Sadler, Wei-Lun Chao, and Yu Su. 2023. LLM- planner: Few-shot grounded planning for embodied agents with large language models. In Proceedings of the IEEE/CVF international conference on computer vision. 2998-3009. 3.3
  151. Yunlong Song and Davide Scaramuzza. 2022. Policy Search for Model Predictive Control With Application to Agile Drone Flight. IEEE Transactions on Robotics 38, 4 (2022), 2114-2130. 2.5, 1, 3.2
  152. Konstantinos Souchleris, George K Sidiropoulos, and George A Papakostas. 2023. Reinforcement learning in game industry-Review, prospects and challenges. Applied Sciences 13, 4 (2023), 2443. 2.4
  153. Sanjana Srivastava, Chengshu Li, Michael Lingelbach, Roberto Martín-Martín, Fei Xia, Kent Elliott Vainio, Zheng Lian, Cem Gokmen, Shyamal Buch, Karen Liu, Silvio Savarese, Hyowon Gweon, Jiajun Wu, and Li Fei- Fei. 2022. BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments. In Proceedings of the 5th Conference on Robot Learning. 477-490. 14d, 2, 3.4
  154. Roni Stern, Nathan Sturtevant, Ariel Felner, Sven Koenig, Hang Ma, Thayne Walker, Jiaoyang Li, Dor Atzmon, Liron Cohen, TK Kumar, et al. 2019. Multi-agent pathfinding: Definitions, variants, and benchmarks. In Proceedings of the International Symposium on Combinatorial Search. 151-158. 4, 23a, 4.4
  155. James WA Strachan, Dalila Albergo, Giulia Borghini, Oriana Pansardi, Eugenio Scaliti, Saurabh Gupta, Krati Saxena, Alessandro Rufo, Stefano Panzeri, Guido Manzi, et al. 2024. Testing theory of mind in large language models and humans. Nature Human Behaviour 8, 7 (2024), 1285-1295. 5
  156. Shengjie Sun, Runze Liu, Jiafei Lyu, Jing-Wen Yang, Liangpeng Zhang, and Xiu Li. 2024. A Large Language Model-Driven Reward Design Framework via Dynamic Feedback for Reinforcement Learning. arXiv preprint arXiv:2410.14660 (2024). 3.3 · arXiv
  157. Peter Sunehag, Guy Lever, Audrunas Gruslys, Wojciech Marian Czarnecki, Vinicius Zambaldi, Max Jaderberg, Marc Lanctot, Nicolas Sonnerat, Joel Z Leibo, Karl Tuyls, et al. 2017. Value-decomposition networks for cooperative multi-agent learning. arXiv preprint arXiv:1706.05296 (2017). 5 · arXiv
  158. Sinan Tan, Weilai Xiang, Huaping Liu, Di Guo, and Fuchun Sun. 2020. Multi-agent Embodied Question Answering in Interactive Environments. In Computer Vision -ECCV 2020. 663-678. 4.3
  159. Rajarshi Tarafdar. 2025. Embodied and Multi-Agent Reinforcement Learning: Advances, Challenges and Op- portunities. International Journal of Innovative Science and Research Technology 10, 3 (2025), 3183-3187. 1
  160. Krystof Teissing, Matej Novosad, Robert Penicka, and Martin Saska. 2024. Real-Time Planning of Minimum- Time Trajectories for Agile UAV Flight. IEEE Robotics and Automation Letters 9, 11 (2024), 10351-10358. 3.1
  161. J Terry, Benjamin Black, Nathaniel Grammel, Mario Jayakumar, Ananth Hari, Ryan Sullivan, Luis S Santos, Clemens Dieffendahl, Caroline Horsch, Rodrigo Perez-Vicente, Niall Williams, Yashas Lokesh, and Praveen Ravi. 2021. PettingZoo: Gym for Multi-Agent Reinforcement Learning. In Advances in Neural Information Processing Systems. 15032-15043. 4.4
  162. Tongxuan Tian, Haoyang Li, Bo Ai, Xiaodi Yuan, Zhiao Huang, and Hao Su. 2025. Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulation. arXiv preprint arXiv:2503.11999 (2025). 3.3 · arXiv
  163. Emanuel Todorov, Tom Erez, and Yuval Tassa. 2012. Mujoco: A physics engine for model-based control. In IEEE/RSJ international conference on intelligent robots and systems. 5026-5033. 3.4
  164. Jesus Tordesillas and Jonathan P. How. 2022. MADER: Trajectory Planner in Multiagent and Dynamic Envi- ronments. IEEE Transactions on Robotics 38, 1 (2022), 463-476. 4.1
  165. Niels Van Berkel, Mikael B Skov, and Jesper Kjeldskov. 2021. Human-AI interaction: Intermittent, continuous, and proactive. Interactions 28, 6 (2021), 67-71. 4.3
  166. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems. 2.7
  167. Sai H. Vemprala, Rogerio Bonatti, Arthur Bucker, and Ashish Kapoor. 2024. ChatGPT for Robotics: Design Principles and Model Abilities. IEEE Access 12 (2024), 55682-55696. 3.3
  168. Vishnunandan LN Venkatesh and Byung-Cheol Min. 2024. ZeroCAP: Zero-Shot Multi-Robot Context Aware Pattern Formation via Large Language Models. arXiv preprint arXiv:2404.02318 (2024). 3, 4.3 · arXiv
  169. Aravind Venugopal, Stephanie Milani, Fei Fang, and Balaraman Ravindran. 2024. MABL: Bi-Level Latent- Variable World Model for Sample-Efficient Multi-Agent Reinforcement Learning. In Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems. 1865--1873. 4.3
  170. Federico Vicentini. 2021. Collaborative robotics: A survey. Journal of Mechanical Design 143, 4 (2021), 040802. 4.3
  171. Oriol Vinyals, Igor Babuschkin, Wojciech M Czarnecki, Michaël Mathieu, Andrew Dudzik, Junyoung Chung, David H Choi, Richard Powell, Timo Ewalds, Petko Georgiev, et al. 2019. Grandmaster level in StarCraft II using multi-agent reinforcement learning. nature 575, 7782 (2019), 350-354. 5
  172. Hanwen Wan, Yifei Chen, Zeyu Wei, Dongrui Li, Zexin Lin, Donghao Wu, Jiu Cheng, Yuxiang Zhang, and Xiaoqiang Ji. 2025. EmbodiedAgent: A Scalable Hierarchical Approach to Overcome Practical Challenge in Multi-Robot Control. arXiv preprint arXiv:2504.10030 (2025). 4.3 · arXiv
  173. Yanming Wan, Yue Wu, Yiping Wang, Jiayuan Mao, and Natasha Jaques. 2025. Infer Human's Intentions Before Following Natural Language Instructions. Proceedings of the AAAI Conference on Artificial Intelligence 39, 24 (2025), 25309-25317. 3, 4.3
  174. Jun Wang, Guocheng He, and Yiannis Kantaros. 2024. Safe task planning for language-instructed multi-robot systems using conformal prediction. arXiv preprint arXiv:2402.15368 (2024). 4.3 · arXiv
  175. Lirui Wang, Xinlei Chen, Jialiang Zhao, and Kaiming He. 2024. Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers. In Advances in Neural Information Processing Systems. 124420- 124450. 3.3
  176. Lirui Wang, Yiyang Ling, Zhecheng Yuan, Mohit Shridhar, Chen Bao, Yuzhe Qin, Bailin Wang, Huazhe Xu, and Xiaolong Wang. 2023. Gensim: Generating robotic simulation tasks via large language models. arXiv preprint arXiv:2310.01361 (2023). 3.3 · arXiv
  177. Pengyu Wang, Jiawei Tang, Hin Wang Lin, Fan Zhang, Chaoqun Wang, Jiankun Wang, Ling Shi, and Max Q.-H. Meng. 2025. MINER-RRT*: A Hierarchical and Fast Trajectory Planning Framework in 3D Cluttered Environments. IEEE Transactions on Automation Science and Engineering 22 (2025), 10973-10985. 3.1
  178. Siyin Wang, Zhaoye Fei, Qinyuan Cheng, Shiduo Zhang, Panpan Cai, Jinlan Fu, and Xipeng Qiu. 2025. World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning. arXiv preprint arXiv:2503.10480 (2025). 3.3 · arXiv
  179. Weizheng Wang, Ike Obi, and Byung-Cheol Min. 2025. Multi-Agent LLM Actor-Critic Framework for Social Robot Navigation. arXiv preprint arXiv:2503.09758 (2025). 4.3 · arXiv
  180. Xiao Wang, Guangyao Chen, Guangwu Qian, Pengcheng Gao, Xiao-Yong Wei, Yaowei Wang, Yonghong Tian, and Wen Gao. 2023. Large-scale multi-modal pre-trained models: A comprehensive survey. Machine Intelli- gence Research 20, 4 (2023), 447-482. 1
  181. Xin Wang, Jian Sun, Fang Deng, Gang Wang, and Jie Chen. 2023. Event-triggered consensus control of heterogeneous multi-agent systems: Model-and data-based approaches. Science China Information Sciences 66, 9 (2023), 192201. 3
  182. Yujin Wang, Quanfeng Liu, Zhengxin Jiang, Tianyi Wang, Junfeng Jiao, Hongqing Chu, Bingzhao Gao, and Hong Chen. 2025. RAD: Retrieval-Augmented Decision-Making of Meta-Actions with Vision-Language Mod- els in Autonomous Driving. arXiv preprint arXiv:2503.13861 (2025). 3.3 · arXiv
  183. Yufei Wang, Zhou Xian, Feng Chen, Tsun-Hsuan Wang, Yian Wang, Katerina Fragkiadaki, Zackory Erickson, David Held, and Chuang Gan. 2023. Robogen: Towards unleashing infinite data for automated robot learning via generative simulation. arXiv preprint arXiv:2311.01455 (2023). 3.3 · arXiv
  184. Yongdong Wang, Runze Xiao, Jun Younes Louhi Kasahara, Ryosuke Yajima, Keiji Nagatani, Atsushi Ya- mashita, and Hajime Asama. 2024. Dart-llm: Dependency-aware multi-robot task decomposition and execution using large language models. arXiv preprint arXiv:2411.09022 (2024). 4.3 · arXiv
  185. Zhepei Wang, Xin Zhou, Chao Xu, and Fei Gao. 2022. Geometrically Constrained Trajectory Optimization for Multicopters. IEEE Transactions on Robotics 38, 5 (2022), 3259-3278. 1
  186. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed Chi, Quoc V Le, and Denny Zhou. 2022. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. In Advances in Neural Information Processing Systems, Vol. 35. 24824-24837. 3.3
  187. Muning Wen, Jakub Kuba, Runji Lin, Weinan Zhang, Ying Wen, Jun Wang, and Yaodong Yang. 2022. Multi- agent reinforcement learning is a sequence modeling problem. In Advances in Neural Information Processing Systems. 16509-16521. 5
  188. Di Wu, Xian Wei, Guang Chen, Hao Shen, Xiangfeng Wang, Wenhao Li, and Bo Jin. 2025. Generative Multi- Agent Collaboration in Embodied AI: A Systematic Review. arXiv preprint arXiv:2502.11518 (2025). 1 · arXiv
  189. Feiyang Wu, Zhaoyuan Gu, Hanran Wu, Anqi Wu, and Ye Zhao. 2024. Infer and Adapt: Bipedal Locomo- tion Reward Learning from Demonstrations via Inverse Reinforcement Learning. In 2024 IEEE International Conference on Robotics and Automation. 16243-16250. 1
  190. Jianlong Wu, Wei Sun, Tian Gan, Ning Ding, Feijun Jiang, Jialie Shen, and Liqiang Nie. 2023. Neighbor- Guided Consistent and Contrastive Learning for Semi-Supervised Action Recognition. IEEE Transactions on Image Processing 32 (2023), 2215-2227. 3
  191. Jianlong Wu, Haozhe Yang, Tian Gan, Ning Ding, Feijun Jiang, and Liqiang Nie. 2023. CHMATCH: Con- trastive Hierarchical Matching and Robust Adaptive Threshold Boosted Semi-Supervised Learning. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 15762-15772. 3
  192. Yuwei Wu, Yuezhan Tao, Peihan Li, Guangyao Shi, Gaurav S Sukhatmem, Vijay Kumar, and Lifeng Zhou. 2024. Hierarchical LLMs In-the-loop Optimization for Real-time Multi-Robot Target Tracking under Unknown Hazards. arXiv preprint arXiv:2409.12274 (2024). 4.3 · arXiv
  193. Fanbo Xiang, Yuzhe Qin, Kaichun Mo, Yikuan Xia, Hao Zhu, Fangchen Liu, Minghua Liu, Hanxiao Jiang, Yifu Yuan, He Wang, Li Yi, Angel X. Chang, Leonidas J. Guibas, and Hao Su. 2020. SAPIEN: A SimulAted Part-Based Interactive ENvironment. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3.4
  194. Wei Xiao, Zhaohan Feng, Ziyu Zhou, Jian Sun, Gang Wang, and Jie Chen. 2025. Time-Optimal Flight in Cluttered Environments via Safe Reinforcement Learning. Unmanned Systems 0, 0 (2025), 1-10. 10, 3.2
  195. Yuchen Xiao, Weihao Tan, and Christopher Amato. 2022. Asynchronous Actor-Critic for Multi-Agent Rein- forcement Learning. In Advances in Neural Information Processing Systems. 4385-4400. 4.2
  196. Yuchen Xiao, Weihao Tan, Joshua Hoffman, Tian Xia, and Christopher Amato. 2025. Asynchronous multi- agent deep reinforcement learning under partial observability. The International Journal of Robotics Research (2025). 4.2
  197. Tianbao Xie, Siheng Zhao, Chen Henry Wu, Yitao Liu, Qian Luo, Victor Zhong, Yanchao Yang, and Tao Yu. 2023. Text2reward: Reward shaping with language models for reinforcement learning. arXiv preprint arXiv:2309.11489 (2023). 3.3 · arXiv
  198. Yuxi Xie, Kenji Kawaguchi, Yiran Zhao, James Xu Zhao, Min-Yen Kan, Junxian He, and Michael Xie. 2023. Self-Evaluation Guided Beam Search for Reasoning. In Advances in Neural Information Processing Systems. 41618-41650. 3.3
  199. Guangkai Xu, Yongtao Ge, Mingyu Liu, Chengxiang Fan, Kangyang Xie, Zhiyue Zhao, Hao Chen, and Chun- hua Shen. 2024. What Matters When Repurposing Diffusion Models for General Dense Perception Tasks? arXiv preprint arXiv:2403.06090 (2024). 3.3 · arXiv
  200. Zhiyuan Xu, Kun Wu, Junjie Wen, Jinming Li, Ning Liu, Zhengping Che, and Jian Tang. 2024. A survey on robotics with foundation models: Toward embodied ai. arXiv preprint arXiv:2402.02385 (2024). 1 · arXiv

200 of 241 shown

Cited by

Sorted by citations

Authors
Feng, Z., Xue, R., Yuan, L., Yu, Y., Ding, N., Liu, M., Gao, B., Sun, J., Zheng, X., & Wang, G.
Affiliations
  • Beijing Institute of Technology (CN)
  • Nanjing University (CN)
  • Xi'an Jiaotong University (CN)
  • Zhejiang University (CN)
  • Tongji University (CN)
  • The Hong Kong University of Science and Technology (Guangzhou) (CN)
Corresponding author
Wang, Gang
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
Volume
69
Issue
5
ISSN
1869-1919 (ISSN-L)
DOI
10.48550/arxiv.2505.05108
arXiv
2505.05108
OpenAlex
W4416098348
Cited by
23
References
2
Citations by year
2026: 23
FWCI
79.68
Type
journal article
Language
en
Open access
Licence
Locations
  • Science China Information Sciences (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Engineering › Control and Systems Engineering › Robotics and Automated Systems
Keywords
embodied AI, multi-agent systems, agent cooperation, real-time learning, reinforcement learning, large language models, robotics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review