Learning Motion Patterns of People for Compliant Robot Motion
Open accessThe DOI matches its Crossref record; 74 of the 77 references it cites were found in a registry or an index.
Abstract
Whenever people move through their environments they do not move randomly. Instead, they usually follow specific trajectories or motion patterns corresponding to their intentions. Knowledge about such patterns enables a mobile robot to robustly keep track of persons in its environment and to improve its behavior. In this paper we propose a technique for learning collections of trajectories that characterize typical motion patterns of persons. Data recorded with laser-range finders are clustered using the expectation maximization algorithm. Based on the result of the clustering process, we derive a hidden Markov model that is applied to estimate the current and future positions of persons based on sensory input. We also describe how to incorporate the probabilistic belief about the potential trajectories of persons into the path planning process of a mobile robot. We present several experiments carried out in different environments with a mobile robot equipped with a laser-range scanner and a camera system. The results demonstrate that our approach can reliably learn motion patterns of persons, can robustly estimate and predict positions of persons, and can be used to improve the navigation behavior of a mobile robot.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, forecasting human navigation trajectories has enabled robots to plan sociable trajectories around humans [20, 6, 24].”
From Recurrent Neural Networks for driver activity anticipation via sensory-fusion architecture (2016) · cites this paper as [6]
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
(1967) · Cited by 23,719
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Swain, M. J., & Ballard, D. H. (1991) · International Journal of Computer Vision · doi:10.1007/bf00130487 · Cited by 5,623
The EM Algorithm and Extensions
Kushary, D. (1998) · Technometrics · doi:10.1080/00401706.1998.10485534 · Cited by 5,417
An introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775
Principles of Artificial Intelligence
Nilsson, N. J. (1982) · doi:10.1007/978-3-662-09438-9 · Cited by 3,457 · cited 1×
“In our current system we apply the A∗ algorithm [46] to determine the minimum-cost path in the three dimensional configuration time-space of the robot.”
MethodLearning patterns of activity using real-time tracking
Stauffer, C., & Grimson, W. E. L. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868677 · Cited by 3,248
Cluster analysis of multivariate data : efficiency versus interpretability of classifications
Forgy, E. W. (1965) · Biometrics · Cited by 2,093
High resolution maps from wide angle sonar
Moravec, H., & Elfes, A. (2005) · Proceedings. 1985 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1985.1087316 · Cited by 1,772
Numerical potential field techniques for robot path planning
Barraquand, J., Langlois, B., & Latombe, J.-C. (1992) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.148426 · Cited by 889
Experiences with an interactive museum tour-guide robot
Burgard, W., Cremers, A. B., Fox, D., Hähnel, D., Lakemeyer, G., Schulz, D., Steiner, W., & Thrun, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00070-3 · Cited by 818
Self-citationLearning and inferring transportation routines
Liao, L., Patterson, D. J., Fox, D., & Kautz, H. (2007) · Artificial Intelligence · doi:10.1016/j.artint.2007.01.006 · Cited by 791
Multi-camera multi-person tracking for EasyLiving
Krumm, J., Harris, S., Meyers, B., Brumitt, B., Hale, M., & Shafer, S. (2002) · Proceedings Third IEEE International Workshop on Visual Surveillance · doi:10.1109/vs.2000.856852 · Cited by 680
Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva
Thrun, S., Beetz, M., Bennewitz, M., Burgard, W., Cremers, A. B., Dellaert, F., Fox, D., Hähnel, D., Rosenberg, C., Roy, N., et al. (2000) · The International Journal of Robotics Research · doi:10.1177/02783640022067922 · Cited by 516
Self-citationLearning the distribution of object trajectories for event recognition
Johnson, N., & Hogg, D. (1996) · Image and Vision Computing · doi:10.1016/0262-8856(96)01101-8 · Cited by 499
Kautz, H., & Allen, J. F. (1986) · National Conference on Artificial Intelligence · Cited by 468
People Tracking with Mobile Robots Using Sample-Based Joint Probabilistic Data Association Filters
Schulz, D., Burgard, W., Fox, D., & Cremers, A. B. (2003) · The International Journal of Robotics Research · doi:10.1177/0278364903022002002 · Cited by 435
Self-citationA probabilistic exclusion principle for tracking multiple objects
MacCormick, J., & Blake, A. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791275 · Cited by 357
A review of statistical data association techniques for motion correspondence
Cox, I. J. (1993) · International Journal of Computer Vision · doi:10.1007/bf01440847 · Cited by 346
Layered representations for learning and inferring office activity from multiple sensory channels
Oliver, N., Garg, A., & Horvitz, E. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.02.004 · Cited by 316
Conditional particle filters for simultaneous mobile robot localization and people-tracking
Montemerlo, M., Thrun, S., & Whittaker, W. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1013439 · Cited by 314
Self-citationExperiences with a mobile robotic guide for the elderly
Montemerlo, M., Pineau, J., Roy, N., Thrun, S., & Verma, V. (2002) · doi:10.5555/777092.777183 · Cited by 288
Self-citationLearning Variable-Length Markov Models of Behavior
Galata, A., Johnson, N., & Hogg, D. (2001) · Computer Vision and Image Understanding · doi:10.1006/cviu.2000.0894 · Cited by 265
DERVISH An Office-Navigating Robot
Nourbakhsh, I., Powers, R., & Birchfield, S. T. (1995) · AI Magazine · doi:10.1609/aimag.v16i2.1133 · Cited by 244
Motion strategies for maintaining visibility of a moving target
LaValle, S. M., Gonzalez-Banos, H. H., Becker, C., & Latombe, J.-C. (2002) · Proceedings of International Conference on Robotics and Automation · doi:10.1109/robot.1997.620122 · Cited by 209
Polly: A Visisn- ased Artificial Agent
Horswill, I. D. (1993) · National Conference on Artificial Intelligence · Cited by 204
A layered architecture for office delivery robots
Simmons, R., Goodwin, R., Haigh, K. Z., Koenig, S., & O'Sullivan, J. (1997) · Proceedings of the first international conference on Autonomous agents - AGENTS '97 · doi:10.1145/267658.267723 · Cited by 194
ROTEX-the first remotely controlled robot in space
Hirzinger, G., Brunner, B., Dietrich, J., & Heindl, J. (2002) · Proceedings of the 1994 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1994.351121 · Cited by 189
Fod, A., Howard, A., & Mataric, M. A. J. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1013691 · Cited by 178
Hidden Markov model for dynamic obstacle avoidance of mobile robot navigation
Zhu, Q. (1991) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.88149 · Cited by 167
The application of robotics to a mobility aid for the elderly blind
Lacey, G., & Dawson‐Howe, K. (1998) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(98)00011-6 · Cited by 148
Stachniss, C., & Burgard, W. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1041441 · Cited by 137
Self-citationFast and robust tracking of multiple moving objects with a laser range finder
Kluge, B., Köhler, C., & Prassler, E. A. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2001.932853 · Cited by 131
CS Freiburg: coordinating robots for successful soccer playing
Weigel, T., Gutmann, J.-S., Dietl, M., Kleiner, A., & Nebel, B. (2002) · IEEE Transactions on Robotics and Automation · doi:10.1109/tra.2002.804041 · Cited by 130
Web interfaces for mobile robots in public places
Schulz, D., Burgard, W., Fox, D., Thrun, S., & Cremers, A. B. (2000) · IEEE Robotics & Automation Magazine · doi:10.1109/100.833575 · Cited by 128
Self-citationA New Model of Plan RecognitionPreprint
Goldman, R. P., Geib, C., & Miller, C. A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6700 · Cited by 120
Detecting and tracking moving objects from a mobile platform using a laser range scanner
Lindstrom, M., & Eklundh, J. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2001.977171 · Cited by 114
Schraft, R. D., & Schmierer, G. (2000) · A K Peters/CRC Press eBooks · doi:10.1201/9781439864043 · Cited by 114
Recognizing and monitoring high-level behaviors in complex spatial environments
Nguyen, N., Bui, H., Venkatsh, S., & WEST, G. A. W. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211524 · Cited by 101
Improved Tracking of Multiple Humans with Trajectory Predcition and Occlusion Modeling
Rosales, R., & Sclaroff, S. (1998) · Cited by 91
Field test of a navigation system: autonomous cleaning in supermarkets
Endres, H., Feiten, W., & Lawitzky, G. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1998.677424 · Cited by 91
Socially embedded learning of the office-conversant mobile robot Jijo-2
Asoh, H., Hayamizu, S., Hara, I., Motomura, Y., Akaho, S., & Matsui, T. (1997) · Cited by 83
Dynamic decentralized area partitioning for cooperating cleaning robots
Jager, M., & Nebel, B. (2003) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2002.1014264 · Cited by 83
Predictive autonomous robot navigation
Foka, A. F. (2005) · doi:10.12681/eadd/15018 · Cited by 82
Learning the Distribution of Object Trajectories for Event Recognition.
Johnson, N. J., & Hogg, D. (1995) · British Machine Vision Conference (BMVC) · doi:10.5244/c.9.58 · Cited by 78
Real-time combinatorial tracking of a target moving unpredictably among obstacles
González-Baños, H. H., Lee, C.-Y., & Latombe, J.-C. (2003) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2002.1014784 · Cited by 75
HelpMate autonomous mobile robot navigation system
King, S. J., & Weiman, C. F. R. (1991) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.48088 · Cited by 71
Health-care robotics goes commercial: the ‘HelpMate’ experience
Engelberger, J. F. (1993) · Robotica · doi:10.1017/s0263574700019354 · Cited by 69
Learning Models of Human Behaviour with Sequential Patterns
Guralnik, V., & Haigh, K. Z. (2002) · Cited by 66
Predictive autonomous robot navigation
Foka, A. F., & Trahanias, P. E. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1041438 · Cited by 63
A reactive motion planner to maintain visibility of unpredictable targets
Murrieta-Cid, R., González-Baños, H. H., & Tovar, B. (2003) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2002.1014421 · Cited by 61
Recognizing Probabilistic Opponent Movement Models
Riley, P. F., & Veloso, M. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45603-1_59 · Cited by 57
Assistive technology on the threshold of the new millennium
Bühler, C., & Knops, H. (1999) · IOS Press , Ohmsha eBooks · Cited by 53
On motion planning of mobile robots which coexist and cooperate with human
Tadokoro, S., Hayashi, M., Manabe, Y., NAKAMI, Y., & TAKAMORI, T. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1995.526265 · Cited by 50
Locating moving entities in indoor environments with teams of mobile robots
Rosencrantz, M., Gordon, G. J., & Thrun, S. (2003) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/860575.860613 · Cited by 48
Self-citationCamera-based monitoring system for mobile robot guidance
Kruse, E., & Wahl, F. M. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1998.727470 · Cited by 43
Hybrid, high-precision localisation for the mail distributing mobile robot system MOPS
Arras, K. O., & Vestli, S. J. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1998.680906 · Cited by 43
A behavior-based mobile robot architecture for Learning from Demonstration
Kasper, M. E., Fricke, G., Steuernagel, K., & von Puttkamer, E. (2001) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(00)00119-6 · Cited by 42
Schraft, R. D., & Schmierer, G. (1998) · Springer eBooks · doi:10.1007/978-3-642-88176-3 · Cited by 41
Cooperative motion control for multi-target observation
Parker, L. E. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1997.656570 · Cited by 37
Improved Tracking of Multiple Humans with Trajectory Prediction and Occlusion Modeling
Rosales, R., & Sclaroff, S. (1998) · Cited by 36
A region-based approach for cooperative multi-target tracking in a structured environment
Jung, B., & Sukhatme, G. S. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1041688 · Cited by 35
Smart Wheelchairs - State of the Art in an Emerging Market
Lankenau, A., & Röfer, T. (2000) · Künstliche Intell. · Cited by 31
PERSES-a vision-based interactive mobile shopping assistant
Gross, H.-M., & Boehme, H.-J. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2000.884968 · Cited by 30
Care-O-bot - A System for Assisting Elderly or Disabled Persons in Home Environments
Schaeffer, C., & May, T. (1999) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 28
Li, C., Biswas, G., Dale, M. B., & Dale, P. E. R. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44816-0_6 · Cited by 21
A framework for heading-guided recognition of human activity
Rosales, R., & Sclaroff, S. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00096-1 · Cited by 20
Dynamic gestures as an input device for directing a mobile platform
Ehreumann, M., Lütticke, T., & Dillmann, R. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2001.933014 · Cited by 18
Rhône-Alpes, I. (1997) · Institute of Electrical and Electronics Engineers eBooks · Cited by 17
(1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165368 · Cited by 11
Design, Implementation and Exploitation of a New Fully Autonomous Tour Guide Robot
Siegwart, R., Arras, K. O., Jensen, B., Philippsen, R., & Tomatis, N. (2003) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.3929/ethz-a-010090686 · Cited by 8
Locating moving entities in indoor environments with teams of mobile robots
Rosencrantz, M., Gordon, G. J., & Thrun, S. (2003) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/860611.860613 · Cited by 4
Self-citationStatistical recognition of motion patterns
Illmann, J., Kluge, B., & Prassler, E. A. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1043917 · Cited by 4
Research works printed but not linked: 6
- Feyrer, S., and Zell, A. 2000. Robust real-time pursuit of persons with a mobile robot using multisensor fusion . Proceedings of the 6th International Conference on Intelligent Autonomous Systems (IAS-6), Venice, Italy, July.
- Goldberg, K., and Siegwart, R. 2001. Robots on the Web: Physical Interaction through the Internet, MIT Press, Cambridge, MA .
- Horswill, I. 1993. Polly: a vision-based artificial agent . Proceedings of the 11th National Conference on Artificial Intelligence (AAAI-93), Washington, DC, July.
- Jung, B., and Sukhatme, G. S. 2002.A region-based approach for cooperative multitarget tracking in a structural environment . Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Washington, DC, May 11-15.
- Mitchell, T. M. 1997. Machine Learning, McGraw-Hill, New York .
- Pirjanian, P., and Mataríc, M. 2000. Multirobot target acquisition using multiple objective behaviour coordination . Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), San Francisco, CA, April 24-28.
Cited by
Human motion trajectory prediction: a survey
Rudenko, A., Palmieri, L., Herman, M., Kitani, K. M., Gavrila, D. M., & Arras, K. O. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920917446 · Cited by 658
Human-aware robot navigation: A survey
Kruse, T., Pandey, A. K., Alami, R., & Kirsch, A. (2013) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2013.05.007 · Cited by 742
Social Attention: Modeling Attention in Human Crowds
Vemula, A., Muelling, K., & Oh, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460504 · Cited by 675
Chen, C., Liu, Y., Kreiss, S., & Alahi, A. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794134 · Cited by 615
Unfreezing the robot: Navigation in dense, interacting crowds
Trautman, P., & Krause, A. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5654369 · Cited by 618
Metadata
- Authors
- Bennewitz, M., Burgard, W., Cielniak, G., & Thrun, S.
- Affiliations
- University of Freiburg (DE)
- Örebro University (SE)
- Stanford University (US)
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2005-01
- Volume
- 24
- Issue
- 1
- Pages
- 31-48
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2088604406
- Cited by
- 399
- References
- 77
- Citations by year
- 2026: 1 · 2025: 13 · 2024: 13 · 2023: 10 · 2022: 15 · 2021: 17 · 2020: 17 · 2019: 21 · 2018: 23 · 2017: 22 · 2016: 17 · 2015: 41 · 2014: 29 · 2013: 24 · 2012: 25
- FWCI
- 27.03
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The International Journal of Robotics Research (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Keywords
- human motion patterns, trajectory learning, mobile robot navigation, human tracking, hidden Markov models, expectation-maximization clustering, laser rangefinder, probabilistic path planning, human-robot interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.