The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Socially compliant mobile robot navigation via inverse reinforcement learning
Abstract
Mobile robots are increasingly populating our human environments. To interact with humans in a socially compliant way, these robots need to understand and comply with mutually accepted rules. In this paper, we present a novel approach to model the cooperative navigation behavior of humans. We model their behavior in terms of a mixture distribution that captures both the discrete navigation decisions, such as going left or going right, as well as the natural variance of human trajectories. Our approach learns the model parameters of this distribution that match, in expectation, the observed behavior in terms of user-defined features. To compute the feature expectations over the resulting high-dimensional continuous distributions, we use Hamiltonian Markov chain Monte Carlo sampling. Furthermore, we rely on a Voronoi graph of the environment to efficiently explore the space of trajectories from the robot’s current position to its target position. Using the proposed model, our method is able to imitate the behavior of pedestrians or, alternatively, to replicate a specific behavior that was taught by tele-operation in the target environment of the robot. We implemented our approach on a real mobile robot and demonstrated that it is able to successfully navigate in an office environment in the presence of humans. An extensive set of experiments suggests that our technique outperforms state-of-the-art methods to model the behavior of pedestrians, which also makes it applicable to fields such as behavioral science or computer graphics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A note on two problems in connexion with graphs
Dijkstra, E. W. (1959) · Numerische Mathematik · doi:10.1007/bf01386390 · Cited by 29,065
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195 · cited 4×
“(2012), the social forces algorithm by Helbing and Molnar (1995), and the RVO introduced by van den Berg et al. (2009). Figure 7 shows example trajectories of the different methods.”
MethodInfluential(2006) · Springer eBooks · Cited by 8,123
Social force model for pedestrian dynamics
Helbing, D., & Molnár, P. (1995) · Physical Review E · doi:10.1103/physreve.51.4282 · Cited by 6,845
Hall, E. T. (1973) · Leonardo · doi:10.2307/1572461 · Cited by 4,859
Voronoi diagrams—a survey of a fundamental geometric data structure
Aurenhammer, F. (1991) · ACM Computing Surveys · doi:10.1145/116873.116880 · Cited by 4,340
A direct adaptive method for faster backpropagation learning: the RPROP algorithm
Riedmiller, M., & Braun, H. (2002) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1993.298623 · Cited by 3,917
Duane, S., Kennedy, A. D., Pendleton, B. J., & Roweth, D. (1987) · Physics Letters B · doi:10.1016/0370-2693(87)91197-x · Cited by 3,872
The dynamic window approach to collision avoidance
Fox, D., Burgard, W., & Thrun, S. (1997) · IEEE Robotics & Automation Magazine · doi:10.1109/100.580977 · Cited by 3,771
Self-citationA survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Apprenticeship learning via inverse reinforcement learning
Abbeel, P., & Ng, A. Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015430 · Cited by 2,769
Motion Planning in Dynamic Environments Using Velocity Obstacles
Fiorini, P., & Shiller, Z. (1998) · The International Journal of Robotics Research · doi:10.1177/027836499801700706 · Cited by 2,008
Maximum Entropy Inverse Reinforcement Learning
Ziebart, B. D., Maas, A. L., Bagnell, J. A., & Dey, A. K. (2018) · doi:10.1184/r1/6555512 · Cited by 1,869
Reciprocal n-Body Collision Avoidance
van den Berg, J., Guy, S. J., Lin, M., & Manocha, D. (2011) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-19457-3_1 · Cited by 1,858
Robust Monte Carlo localization for mobile robots
Thrun, S., Fox, D., Burgard, W., & Dellaert, F. (2001) · Artificial Intelligence · doi:10.1016/s0004-3702(01)00069-8 · Cited by 1,809
Self-citationYou'll never walk alone: Modeling social behavior for multi-target tracking
Pellegrini, S., Ess, A., Schindler, K., & van Gool, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459260 · Cited by 1,683 · cited 2×
“The second dataset (Pellegrini et al., 2009) comprises 12 minutes of trajectories of pedestrians interacting in a hotel entrance, leading to 71 composite trajectories with three to five pedestrians each.”
Background(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621
Lerner, A., Chrysanthou, Y., & Lischinski, D. (2007) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2007.01089.x · Cited by 1,171
CHOMP: Gradient optimization techniques for efficient motion planning
Ratliff, N., Zucker, M., Bagnell, J. A., & Srinivasa, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152817 · Cited by 992
STOMP: Stochastic trajectory optimization for motion planning
Kalakrishnan, M., Chitta, S., Theodorou, E., Pastor, P., & Schaal, S. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980280 · Cited by 876
The dynamics of perception and action.
Warren, W. H. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.358 · Cited by 858
Where do we Stand on Maximum Entropy
Jaynes, E. T. (1979) · Medical Entomology and Zoology · Cited by 706
Kitani, K. M., Ziebart, B. D., Bagnell, J. A., & Hebert, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33765-9_15 · Cited by 701
Unfreezing the robot: Navigation in dense, interacting crowds
Trautman, P., & Krause, A. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5654369 · Cited by 618
Ratliff, N. D., Bagnell, J. A., & Zinkevich, M. A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143936 · Cited by 606
Robot Learning from Demonstration
(2012) · SpringerReference · doi:10.1007/springerreference_302487 · Cited by 532
SPECIFICATION OF THE SOCIAL FORCE PEDESTRIAN MODEL BY EVOLUTIONARY ADJUSTMENT TO VIDEO TRACKING DATA
JOHANSSON, A., HELBING, D., & SHUKLA, P. K. (2007) · Advances in Complex Systems · doi:10.1142/s0219525907001355 · Cited by 508
Planning-based prediction for pedestrians
Ziebart, B. D., Ratliff, N., Gallagher, G., Mertz, C., Peterson, K., Bagnell, J. A., Hebert, M., Dey, A. K., & Srinivasa, S. (2009) · 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2009.5354147 · Cited by 456
From human to humanoid locomotion—an inverse optimal control approach
Mombaur, K., Truong, A., & Laumond, J.-P. (2010) · Autonomous Robots · doi:10.1007/s10514-009-9170-7 · Cited by 442
Brain-Controlled Wheelchairs: A Robotic Architecture
Carlson, T., & del R. Millan, J. (2013) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2229936 · Cited by 432
Advances in Neural Information Processing Systems 26 (NIPS 2013)
Cseke, B., Opper, M., & Sanguinetti, G. (2013) · Cited by 424
Relative Entropy Inverse Reinforcement Learning
Boularias, A., Kober, J., & Peters, J. (2011) · Max Planck Institute for Plasma Physics · Cited by 404
Pedestrian, Crowd and Evacuation Dynamics
Helbing, D., & Johansson, A. (2009) · Encyclopedia of Complexity and Systems Science · doi:10.1007/978-0-387-30440-3_382 · Cited by 386
Simulation of pedestrian flows by optimal control and differential games
Hoogendoorn, S., & H.L. Bovy, P. (2003) · Optimal Control Applications and Methods · doi:10.1002/oca.727 · Cited by 294
Sensor-Based Exploration: The Hierarchical Generalized Voronoi Graph
Choset, H., & Burdick, J. (2000) · The International Journal of Robotics Research · doi:10.1177/02783640022066770 · Cited by 288
Socially Adaptive Path Planning in Human Environments Using Inverse Reinforcement Learning
Kim, B., & Pineau, J. (2016) · International Journal of Social Robotics · doi:10.1007/s12369-015-0310-2 · Cited by 228
An Optimality Principle Governing Human Walking
Arechavaleta, G., Laumond, J.-P., Hicheur, H., & Berthoz, A. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.915449 · Cited by 219
Feature-Based Prediction of Trajectories for Socially Compliant Navigation
Kuderer, M., Kretzschmar, H., Sprunk, C., & Burgard, W. (2012) · Robotics: Science and Systems VIII · doi:10.15607/rss.2012.viii.025 · Cited by 214 · cited 10×
“Kuderer et al. (2012) approximated the feature expectations using Dirac delta functions at the modes of the distribution.”
BackgroundMethodInfluentialSelf-citationAn introduction to the calculus of variations
Fox, C. M. (1950) · Cited by 209
COMPANION: A Constraint-Optimizing Method for Person-Acceptable Navigation
Kirby, R., Simmons, R., & Forlizzi, J. (2009) · RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2009.5326271 · Cited by 178
Topological constraints in search-based robot path planning
Bhattacharya, S., Likhachev, M., & Kumar, V. (2012) · Autonomous Robots · doi:10.1007/s10514-012-9304-1 · Cited by 172
Robot navigation in dense human crowds: the case for cooperation
Trautman, P., Ma, J., Murray, R. M., & Krause, A. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630866 · Cited by 164
2015 International Conference on Advanced Robotics (ICAR)
(2015) · doi:10.1109/icar36978.2015 · Cited by 153
Learning objective functions for manipulation
Kalakrishnan, M., Pástor, P., Righetti, L., & Schaal, S. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630743 · Cited by 134
A statistical similarity measure for aggregate crowd dynamics
Guy, S. J., van den Berg, J., Liu, W., Lau, R. W. H., Lin, M. C., & Manocha, D. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366209 · Cited by 129
Pham, Q., Hicheur, H., Arechavaleta, G., Laumond, J., & Berthoz, A. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05835.x · Cited by 107
Probabilistic pointing target prediction via inverse optimal control
Ziebart, B., Dey, A., & Bagnell, J. A. (2012) · Proceedings of the 2012 ACM international conference on Intelligent User Interfaces · doi:10.1145/2166966.2166968 · Cited by 90
Not Another Step! Economy of Movement and Pedestrian Choice Point Behavior in Shopping Malls
Bitgood, S. C., & Dukes, S. (2006) · Environment and Behavior · doi:10.1177/0013916505280081 · Cited by 83
Learning to predict trajectories of cooperatively navigating agents
Kretzschmar, H., Kuderer, M., & Burgard, W. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907442 · Cited by 76
Self-citationModeling collision avoidance behavior for virtual humans
Guy, S. J., Lin, M. C., & Manocha, D. (2010) · doi:10.5555/1838178.1838182 · Cited by 63
Socially Inspired Motion Planning for Mobile Robots in Populated Environments
Müller, J., Stachniss, C., Arras, K. O., & Burgard, W. (2008) · Cited by 56
Self-citationOnline generation of kinodynamic trajectories for non-circular omnidirectional robots
Sprunk, C., Lau, B., Pfaffz, P., & Burgard, W. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980146 · Cited by 53
Self-citationTeaching mobile robots to cooperatively navigate in populated environments
Kuderer, M., Kretzschmar, H., & Burgard, W. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696802 · Cited by 52
Self-citationOnline generation of homotopically distinct navigation paths
Kuderer, M., Sprunk, C., Kretzschmar, H., & Burgard, W. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907813 · Cited by 49
Self-citationA framework for planning comfortable and customizable motion of an assistive mobile robot
Gulati, S., Jhurani, C., Kuipers, B. J., & Longoria, R. G. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354172 · Cited by 40
Embodied social interaction for robots
Christensen, H. I., & Pacchierotti, E. (2005) · Cited by 35
Cited by
Planning and Decision-Making for Autonomous Vehicles
Schwarting, W., Alonso-Mora, J., & Rus, D. (2018) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105157 · Cited by 972
Tai, L., Paolo, G., & Liu, M. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202134 · Cited by 834
Socially aware motion planning with deep reinforcement learning
Chen, Y. F., Everett, M., Liu, M., & How, J. P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202312 · Cited by 719
Social Attention: Modeling Attention in Human Crowds
Vemula, A., Muelling, K., & Oh, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460504 · Cited by 675
Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning
Chen, Y. F., Liu, M., Everett, M., & How, J. P. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989037 · Cited by 645
Metadata
- Authors
- Kretzschmar, H., Spies, M., Sprunk, C., & Burgard, W.
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2016-07-11
- Volume
- 35
- Issue
- 11
- Pages
- 1289-1307
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2227909145
- Cited by
- 452
- References
- 56
- FWCI
- 35.41
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.