The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Crowd-Robot Interaction: Crowd-Aware Robot Navigation With Attention-Based Deep Reinforcement Learning
Open accessAbstract
Mobility in an effective and socially-compliant manner is an essential yet challenging task for robots operating in crowded spaces. Recent works have shown the power of deep reinforcement learning techniques to learn socially cooperative policies. However, their cooperation ability deteriorates as the crowd grows since they typically relax the problem as a one-way Human-Robot interaction problem. In this work, we want to go beyond first-order Human-Robot interaction and more explicitly model Crowd-Robot Interaction (CRI). We propose to (i) rethink pairwise interactions with a self-attention mechanism, and (ii) jointly model Human-Robot as well as Human-Human interactions in the deep reinforcement learning framework. Our model captures the Human-Human interactions occurring in dense crowds that indirectly affects the robot's anticipation capability. Our proposed attentive pooling mechanism learns the collective importance of neighboring humans with respect to their future states. Various experiments demonstrate that our model can anticipate human dynamics and navigate in crowds with time efficiency, outperforming state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 11×
“However, LSTM-RL still suffers from some occasional collisions and timeouts, whereas the SARL accomplishes all the test cases.”
BackgroundInfluentialAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
(2017) · Cited by 11,625
Social force model for pedestrian dynamics
Helbing, D., & Molnár, P. (1995) · Physical Review E · doi:10.1103/physreve.51.4282 · Cited by 6,845
The dynamic window approach to collision avoidance
Fox, D., Burgard, W., & Thrun, S. (1997) · IEEE Robotics & Automation Magazine · doi:10.1109/100.580977 · Cited by 3,771
Social LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
Self-citationSelf-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162 · cited 1×
“In order to navigate through a dense crowd in a socially compliant manner, robots need to understand human behavior and comply with their cooperative rules [8]–[11].”
BackgroundSocial GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., & Alahi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00240 · Cited by 2,466
Self-citationThe vector field histogram-fast obstacle avoidance for mobile robots
Borenstein, J., & Koren, Y. (1991) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.88137 · Cited by 2,301
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
Conneau, A., Kiela, D., Schwenk, H., Barrault, L., & Bordes, A. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1070 · Cited by 2,049 · cited 1×
“Leveraging the recent progress in the self-attention mechanism, where the attention of an item in a sequence is gained by looking at other items in the sequence [44], [46], [50], we propose a social attentive pooling module to learn the relative importance of each neighbor and the collective impact of the crowd in a d…”
BackgroundReciprocal n-Body Collision Avoidance
van den Berg, J., Guy, S. J., Lin, M., & Manocha, D. (2011) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-19457-3_1 · Cited by 1,858
A Structured Self-attentive Sentence Embedding
Lin, Z., Feng, M., Santos, C. N. D., Yu, M., Xiang, B., Zhou, B., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.03130 · Cited by 1,743 · cited 1×
“Leveraging the recent progress in the self-attention mechanism, where the attention of an item in a sequence is gained by looking at other items in the sequence [44], [46], [50], we propose a social attentive pooling module to learn the relative importance of each neighbor and the collective impact of the crowd in a d…”
BackgroundReciprocal Velocity Obstacles for real-time multi-agent navigation
van den Berg, J., Lin, M., & Manocha, D. (2008) · 2008 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2008.4543489 · Cited by 1,722
Real-time obstacle avoidance for fast mobile robots
Borenstein, J., & Koren, Y. (1989) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.44033 · Cited by 1,258
SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints
Sadeghian, A., Kosaraju, V., Sadeghian, A., Hirose, N., Rezatofighi, H., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00144 · Cited by 1,065
Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes
Robicquet, A., Sadeghian, A., Alahi, A., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_33 · Cited by 927
Self-citationTai, L., Paolo, G., & Liu, M. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202134 · Cited by 834
Human-aware robot navigation: A survey
Kruse, T., Pandey, A. K., Alami, R., & Kirsch, A. (2013) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2013.05.007 · Cited by 742
Socially aware motion planning with deep reinforcement learning
Chen, Y. F., Everett, M., Liu, M., & How, J. P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202312 · Cited by 719
Social Attention: Modeling Attention in Human Crowds
Vemula, A., Muelling, K., & Oh, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460504 · Cited by 675
Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning
Chen, Y. F., Liu, M., Everett, M., & How, J. P. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989037 · Cited by 645
Unfreezing the robot: Navigation in dense, interacting crowds
Trautman, P., & Krause, A. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5654369 · Cited by 618
Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning
Everett, M., Chen, Y. F., & How, J. P. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593871 · Cited by 614
Discrete choice models of pedestrian walking behavior
Antonini, G., Bierlaire, M., & Weber, M. (2006) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2005.09.006 · Cited by 596
Towards Optimally Decentralized Multi-Robot Collision Avoidance via Deep Reinforcement Learning
Long, P., Fanl, T., Liao, X., Liu, W., Zhang, H., & Pan, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461113 · Cited by 538
Socially compliant mobile robot navigation via inverse reinforcement learning
Kretzschmar, H., Spies, M., Sprunk, C., & Burgard, W. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915619772 · Cited by 452
The Hybrid Reciprocal Velocity Obstacle
Snape, J., Berg, J. V. D., Guy, S. J., & Manocha, D. (2011) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2120810 · Cited by 448
Learning Motion Patterns of People for Compliant Robot Motion
Bennewitz, M., Burgard, W., Cielniak, G., & Thrun, S. (2005) · The International Journal of Robotics Research · doi:10.1177/0278364904048962 · Cited by 399
Fernando, T., Denman, S., Sridharan, S., & Fookes, C. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.09.002 · Cited by 371
Real-time obstacle avoidance for fast mobile robots in cluttered environments
Borenstein, J., & Koren, Y. (2002) · Proceedings., IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1990.126042 · Cited by 297
Probabilistically safe motion planning to avoid dynamic obstacles with uncertain motion patterns
Aoude, G. S., Luders, B. D., Joseph, J. M., Roy, N., & How, J. P. (2013) · Autonomous Robots · doi:10.1007/s10514-013-9334-3 · Cited by 271
(2017) · Interval Analysis · doi:10.1515/9783110499469-009 · Cited by 235
Ferrer, G., Garrell, A., & Sanfeliu, A. (2013) · 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2013.6696576 · Cited by 227
Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attention
Liu, Y., Sun, C., Lin, L., & Wang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09090 · Cited by 207
Self-citationTai, L., Zhang, J., Liu, M., & Burgard, W. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460968 · Cited by 192
Robot navigation in dense human crowds: the case for cooperation
Trautman, P., Ma, J., Murray, R. M., & Krause, A. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630866 · Cited by 164
Deep-Learned Collision Avoidance Policy for Distributed Multiagent Navigation
Long, P., Liu, W., & Pan, J. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2651371 · Cited by 159
CAR-Net: Clairvoyant Attentive Recurrent Network
Sadeghian, A., Legros, F., Voisin, M., Vesel, R., Alahi, A., & Savarese, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_10 · Cited by 153
Self-citationReal-time navigation of independent agents using adaptive roadmaps
Sud, A., Gayle, R., Andersen, E., Guy, S. J., Lin, M. C., & Manocha, D. (2007) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/1315184.1315201 · Cited by 129
Robot social-aware navigation framework to accompany people walking side-by-side
Ferrer, G., Garrell, A., Herrero, F., & Sanfeliu, A. (2016) · Autonomous Robots · doi:10.1007/s10514-016-9584-y · Cited by 120
Pfeiffer, M., Schwesinger, U., Sommer, H., Galceran, E., & Siegwart, R. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759329 · Cited by 96
Learning to Predict Human Behavior in Crowded Scenes
Alahi, A., Ramanathan, V., Goel, K., Robicquet, A., Sadeghian, A., Fei-Fei, L., & Savarese, S. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809276-7.00011-4 · Cited by 57
Self-citationMap-based Deep Imitation Learning for Obstacle Avoidance
Liu, Y., Xu, A. P., & Chen, Z. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593683 · Cited by 49
Self-citationFeature-Based Prediction of Trajectories for Socially Compliant Navigation
Kuderer, M., Kretzschmar, H., Sprunk, C., & Burgard, W. (2013) · The MIT Press eBooks · doi:10.7551/mitpress/9816.003.0030 · Cited by 42
Trautman, P. (2017) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2017.8263686 · Cited by 28
Cited by
Core Challenges of Social Robot Navigation: A Survey
Mavrogiannis, C., Baldini, F., Wang, A., Zhao, D., Trautman, P., Steinfeld, A., & Oh, J. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3583741 · Cited by 306
Attention, please! A survey of neural attention models in deep learning
de Santana Correia, A., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 298
Human Trajectory Forecasting in Crowds: A Deep Learning Perspective
Kothari, P., Kreiss, S., & Alahi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3069362 · Cited by 267
Self-citationA review of motion planning algorithms for intelligent robots
Zhou, C., Huang, B., & Fränti, P. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-021-01867-z · Cited by 255
Motion planning and control for mobile robot navigation using machine learning: a survey
Xiao, X., Liu, B., Warnell, G., & Stone, P. (2022) · Autonomous Robots · doi:10.1007/s10514-022-10039-8 · Cited by 254
Metadata
- Authors
- Chen, C., Liu, Y., Kreiss, S., & Alahi, A.
- Venue
- 2019 International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 6015-6022
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2890001928
- Cited by
- 615
- References
- 49
- FWCI
- 23.44
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.