The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning
Open accessAbstract
Finding feasible, collision-free paths for multiagent systems can be challenging, particularly in non-communicating scenarios where each agent's intent (e.g. goal) is unobservable to the others. In particular, finding time efficient paths often requires anticipating interaction with neighboring agents, the process of which can be computationally prohibitive. This work presents a decentralized multiagent collision avoidance algorithm based on a novel application of deep reinforcement learning, which effectively offloads the online computation (for predicting interaction patterns) to an offline learning procedure. Specifically, the proposed approach develops a value network that encodes the estimated time to the goal given an agent's joint configuration (positions and velocities) with its neighbors. Use of the value network not only admits efficient (i.e., real-time implementable) queries for finding a collision-free velocity vector, but also considers the uncertainty in the other agents' motion. Simulation results show more than 26% improvement in paths quality (i.e., time to reach the goal) when compared with optimal reciprocal collision avoidance (ORCA), a state-of-the-art collision avoidance strategy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Reciprocal n-Body Collision Avoidance
van den Berg, J., Guy, S. J., Lin, M., & Manocha, D. (2011) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-19457-3_1 · Cited by 1,858
Reciprocal Velocity Obstacles for real-time multi-agent navigation
van den Berg, J., Lin, M., & Manocha, D. (2008) · 2008 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2008.4543489 · Cited by 1,722
Unfreezing the robot: Navigation in dense, interacting crowds
Trautman, P., & Krause, A. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5654369 · Cited by 618
Learning deep control policies for autonomous aerial vehicles with MPC-guided policy search
Zhang, T., Kahn, G., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487175 · Cited by 452 · cited 1×
“While applications of RL are typically limited to discrete, low-dimensional domains, recent advances in Deep RL [20]– [23] have demonstrated human-level performance in complex, high-dimensional spaces.”
BackgroundSocially compliant mobile robot navigation via inverse reinforcement learning
Kretzschmar, H., Spies, M., Sprunk, C., & Burgard, W. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915619772 · Cited by 452
The Hybrid Reciprocal Velocity Obstacle
Snape, J., Berg, J. V. D., Guy, S. J., & Manocha, D. (2011) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2120810 · Cited by 448
SIPP: Safe interval path planning for dynamic environments
Phillips, M., & Likhachev, M. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980306 · Cited by 350
Augugliaro, F., Schoellig, A. P., & D'Andrea, R. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385823 · Cited by 320
Cited by
Multi-agent deep reinforcement learning: a survey
Gronauer, S., & Diepold, K. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09996-w · Cited by 957
Socially aware motion planning with deep reinforcement learning
Chen, Y. F., Everett, M., Liu, M., & How, J. P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202312 · Cited by 719
Self-citationHuman motion trajectory prediction: a survey
Rudenko, A., Palmieri, L., Herman, M., Kitani, K. M., Gavrila, D. M., & Arras, K. O. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920917446 · Cited by 658
CAD2RL: Real Single-Image Flight Without a Single Real Image
Sadeghi, F., & Levine, S. (2017) · Robotics: Science and Systems XIII · doi:10.15607/rss.2017.xiii.034 · Cited by 618
Chen, C., Liu, Y., Kreiss, S., & Alahi, A. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794134 · Cited by 615
Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning
Everett, M., Chen, Y. F., & How, J. P. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593871 · Cited by 614
Self-citationTowards Optimally Decentralized Multi-Robot Collision Avoidance via Deep Reinforcement Learning
Long, P., Fanl, T., Liao, X., Liu, W., Zhang, H., & Pan, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461113 · Cited by 538
Deep reinforcement learning based mobile robot navigation: A review
Zhu, K., & Zhang, T. (2021) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010012 · Cited by 499
PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learning
Sartoretti, G., Kerr, J., Shi, Y., Wagner, G., Kumar, T. K. S., Koenig, S., & Choset, H. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2903261 · Cited by 417
Automated guided vehicle systems, state-of-the-art control algorithms and techniques
De Ryck, M., Versteyhe, M., & Debrouwere, F. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2019.12.002 · Cited by 380
Fan, T., Long, P., Liu, W., & Pan, J. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920916531 · Cited by 332
Core Challenges of Social Robot Navigation: A Survey
Mavrogiannis, C., Baldini, F., Wang, A., Zhao, D., Trautman, P., Steinfeld, A., & Oh, J. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3583741 · Cited by 306
Ganesh, A. H., & Xu, B. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111833 · Cited by 285
Deep Reinforcement Learning-Based Automatic Exploration for Navigation in Unknown Environment
Li, H., Zhang, Q., & Zhao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2927869 · Cited by 261
A review of motion planning algorithms for intelligent robots
Zhou, C., Huang, B., & Fränti, P. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-021-01867-z · Cited by 255
Motion planning and control for mobile robot navigation using machine learning: a survey
Xiao, X., Liu, B., Warnell, G., & Stone, P. (2022) · Autonomous Robots · doi:10.1007/s10514-022-10039-8 · Cited by 254
Elallid, B. B., Benamar, N., Hafid, A. S., Rachidi, T., & Mrani, N. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.03.013 · Cited by 179
“Their results outperformed existing works (Van den Berg et al., 2008; Chen et al., 2017b; Everett et al., 2018; Gupta et al., 2018) in terms of prediction accuracy.”
Motion Planning for Mobile Robots—Focusing on Deep Reinforcement Learning: A Systematic Review
Sun, H., Zhang, W., Yu, R., & Zhang, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3076530 · Cited by 143
Federated Transfer Reinforcement Learning for Autonomous Driving
Liang, X., Liu, Y., Chen, T., Liu, M., & Yang, Q. (2019) · arXiv · doi:10.48550/arxiv.1910.06001 · Cited by 131
“[1] studied the problem of reducing the computationally prohibitive process of anticipating interaction with neighboring agents in a decentralized multi-agent collision avoidance scenario.”
BackgroundSelf-citationPrinciples and Guidelines for Evaluating Social Robot Navigation Algorithms
Francis, A., Pérez-D’Arpino, C., Li, C., Xia, F., Alahi, A., Alami, R., Bera, A., Biswas, A., Biswas, J., Chandra, R., et al. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3700599 · Cited by 107
“Indoor Intersection Pedestrian Interaction Any Navigate A to B Cross Navigate Both pass no collision [6, 10, 89, 106] INTERSECTION (GEST.”
Self-citationBio-Inspired Collision Avoidance in Swarm Systems via Deep Reinforcement Learning
Na, S., Niu, H., Lennox, B., & Arvin, F. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3145346 · Cited by 64
A Deep Reinforcement Learning Method for Mobile Robot Collision Avoidance based on Double DQN
Xue, X., Li, Z., Zhang, D., & Yan, Y. (2019) · 2019 IEEE 28th International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2019.8781522 · Cited by 48
“6b, the vertical axis represents the training time of these three methods, since no pre-training(compared with CADRL method) is required and proper action space was designed, we can see that DDQN method greatly saves training time, which only needs 11.5 minutes(compared with CADRL 2.5 hours and DDPG 20 hours).”
BackgroundMethodInfluentialTowards closing the sim-to-real gap in collaborative multi-robot deep reinforcement learning
Zhao, W., Queralta, J. P., Qingqing, L., & Westerlund, T. (2020) · 2020 5th International Conference on Robotics and Automation Engineering (ICRAE) · doi:10.1109/icrae50850.2020.9310796 · Cited by 36
Lyapunov-Based Reinforcement Learning for Decentralized Multi-agent Control
Zhang, Q., Dong, H., & Pan, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-64096-5_5 · Cited by 18
Multi-robot Path Planning Based on Spatio-Temporal Information in Large-scale Unknown Environment
Ding, J., Zhang, L., & Cheng, J. (2021) · 2021 27th International Conference on Mechatronics and Machine Vision in Practice (M2VIP) · doi:10.1109/m2vip49856.2021.9665033 · Cited by 3
“Selvaggio et al. [11] proposed a non-communicative multi-robot obstacle avoidance algo-rithm based on the method of deep reinforcement learning.”
Method
Metadata
- Authors
- Chen, Y. F., Liu, M., Everett, M., & How, J. P.
- Venue
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2017-05
- Pages
- 285-292
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2524264252
- Cited by
- 645
- References
- 22
- FWCI
- 12.78
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.