Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models
Open accessThe DOI matches its Crossref record; 41 of the 43 references it cites were found in a registry or an index.
Abstract
Abstract—This paper presents a method for learning discrete robot motions from a set of demonstrations. We model a motion as a nonlinear autonomous (i.e. time-invariant) Dynamical System (DS), and define sufficient conditions to ensure global asymptotic stability at the target. We propose a learning method, called Stable Estimator of Dynamical Systems (SEDS), to learn the parameters of the DS to ensure that all motions follow closely the demonstrations while ultimately reaching in and stopping at the target. Time-invariance and global asymptotic stability at the target ensures that the system can respond immediately and appropriately to perturbations encountered during the motion. The method is evaluated through a set of robot experiments and on a library of human handwriting motions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In this model the convergence of all trajectories to the target is guaranteed, but the final velocity at the target is always zero (i.e. the target is an asymptotically stable point).”
From Learning to Play Minigolf: A Dynamical System-Based Approach (2012) · cites this paper as [2]
In the citing paper
“The resulting model from SEDS is globally asymptotically stable, i.e. starting from any point in the space, all trajectories converge to the origin.”
From Learning to Play Minigolf: A Dynamical System-Based Approach (2012) · cites this paper as [2]
In the citing paper
“The optimization constraints given by Eq. (10) ensure the global asymptotic stability of the function f̂(x;θ) (see [2]).”
From Learning to Play Minigolf: A Dynamical System-Based Approach (2012) · cites this paper as [2]
In the citing paper
“Gaussian distributions are used in PoMPs [114] and SEDs [115] for better generalisation behaviour.”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [115]
In the citing paper
“We use the dynamical systems approach to encode motion from several demonstrations. This enables a rapid and reactive adaptation of the arm motion in the presence of sensor uncertainty.”
From Catching Objects in Flight (2014) · cites this paper as [20]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Slotine, J.-J. E., & Li, W. (1991) · CERN Document Server (European Organization for Nuclear Research) · Cited by 18,975
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
Nonlinear programming: theory and algorithms
(1993) · Computers & Operations Research · doi:10.1016/0305-0548(93)90042-h · Cited by 5,779
ANew Look at the Statistical Model Identification
AKAlKE, H. (2011) · Cited by 4,177
Nonlinear Programming: Theory and Algorithms
Bazaraa, M. S., Sherali, H. D., & Shetty, C. M. (2006) · Wiley eBooks · doi:10.1002/0471787779 · Cited by 2,369
Sparse Gaussian Processes using Pseudo-inputs
Snelson, E., & Ghahramani, Z. (2005) · Cited by 1,415
Active Learning with Statistical Models
Cohn, D. A., Ghahramani, Z., & Jordan, M. I. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.295 · Cited by 1,317
Is imitation learning the route to humanoid robots?
Schaal, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01327-3 · Cited by 1,314
Input to State Stability: Basic Concepts and Results
Sontag, E. D. (2008) · Lecture Notes in Mathematics · doi:10.1007/978-3-540-77653-6_3 · Cited by 1,181
On Learning, Representing, and Generalizing a Task in a Humanoid Robot
Calinon, S., Guenter, F., & Billard, A. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2006.886952 · Cited by 1,090 · cited 16×
“To ensure fairer comparison across techniques, GMR was trained with the same number of Gaussians as that found with BIC on SEDS.”
MethodInfluentialSelf-citationRobot Programming by Demonstration
Billard, A., Calinon, S., Dillmann, R., & Schaal, S. (2008) · Springer Handbook of Robotics · doi:10.1007/978-3-540-30301-5_60 · Cited by 1,002
Self-citationMovement imitation with nonlinear dynamical systems in humanoid robots
Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1014739 · Cited by 840
Learning and generalization of motor skills by learning from demonstration
Pastor, P., Hoffmann, H., Asfour, T., & Schaal, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152385 · Cited by 702
Computational approaches to motor learning by imitation
Schaal, S., Ijspeert, A., & Billard, A. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1258 · Cited by 587
Self-citationLearning and Reproduction of Gestures by Imitation
Calinon, S., D'halluin, F., Sauser, E., Caldwell, D., & Billard, A. (2010) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2010.936947 · Cited by 463
Self-citationFast Forward Selection to Speed Up Sparse Gaussian Process Regression
Seeger, M., Williams, C. K. I., & Lawrence, N. D. (2003) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 386
(2000) · Cited by 296
Dynamical System Modulation for Robot Learning via Kinesthetic Demonstrations
Hersch, M., Guenter, F., Calinon, S., & Billard, A. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2006703 · Cited by 241
Self-citationScalable Techniques from Nonparametric Statistics for Real Time Robot Learning
Schaal, S., Atkeson, C. G., & Vijayakumar, S. (2002) · Applied Intelligence · doi:10.1023/a:1015727715131 · Cited by 236
Learning for control from multiple demonstrations
Coates, A., Abbeel, P., & Ng, A. Y. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390175 · Cited by 228
Synthesizing animations of human manipulation tasks
Yamane, K., Kuffner, J. J., & Hodgins, J. K. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015756 · Cited by 218
Kulić, D., Takano, W., & Nakamura, Y. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908091153 · Cited by 213
Discovering optimal imitation strategies
Billard, A., Epars, Y., Calinon, S., Schaal, S., & Cheng, G. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.03.002 · Cited by 173
Self-citationBayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Robust trajectory learning and approximation for robot programming by demonstration
Aleotti, J., & Caselli, S. (2006) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2006.01.003 · Cited by 119
Learning Non-linear Multivariate Dynamics of Motion in Robotic Manipulators
Gribovskaya, E., Khansari-Zadeh, S. M., & Billard, A. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910376251 · Cited by 118
Self-citationMobile robots at your fingertip: Bezier curve on-line trajectory generation for supervisory control
Hwang, J.-H., Arkin, R. C., & Kwon, D.-S. (2004) · Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453) · doi:10.1109/iros.2003.1248847 · Cited by 103
Local Gaussian process regression for real time online model learning and control
Nguyen-Tuong, D., Peters, J., & Seeger, M. (2008) · TUbilio (Technical University of Darmstadt) · Cited by 87
Task-level imitation learning using variance-based movement optimization
Muhlig, M., Gienger, M., Hellbach, S., Steil, J. J., & Goerick, C. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152439 · Cited by 84
BM: An iterative algorithm to learn stable non-linear dynamical systems with Gaussian mixture models
Khansari-Zadeh, S. M., & Billard, A. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5510001 · Cited by 83
Self-citationTrajectory generation from noisy positions of object features for teaching robot paths
Ude, A. (1993) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(93)90015-5 · Cited by 80
Robot programming by Demonstration (RPD): Supporting the induction by human interaction
Friedrich, H., M�nch, S., Dillmann, R., Bocionek, S., & Sassin, M. (1996) · Machine Learning · doi:10.1007/bf00117443 · Cited by 77
Aggressive trajectory generator for a robot ping-pong player
Andersson, R. L. (1989) · IEEE Control Systems Magazine · doi:10.1109/37.16766 · Cited by 76
The Agent-Based Perspective on Imitation
Dautenhahn, K., & Nehaniv, C. L. (2002) · Imitation in Animals and Artifacts · doi:10.7551/mitpress/3676.003.0002 · Cited by 74
Khansari-Zadeh, S. M., & Billard, A. (2010) · 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2010.5651259 · Cited by 72
Self-citationTactile guidance for policy refinement and reuse
Argall, B., Sauser, E. L., & Billard, A. (2010) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2010.5578872 · Cited by 30
Self-citationGribovskaya, E., & Billard, A. (2009) · 2009 9th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/ichr.2009.5379536 · Cited by 30
Self-citation
Research works printed but not linked: 1
- schaal, 2002, Scalable locally weighted statistical techniques for real time robot learning, Appl Intell Spec Issue Scalable Robot Appl Neural Netw, 17, 49
Cited by
Imitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
“Statistical models can deal with sensor error or inaccurate demonstrations; however, incomplete demonstrations can result in suboptimal behavior [Khansari-Zadeh and Billard 2011].”
BackgroundNeural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuning
Nagabandi, A., Kahn, G., Fearing, R. S., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8463189 · Cited by 848
Progress and prospects of the human–robot collaboration
Ajoudani, A., Zanchettin, A. M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., & Khatib, O. (2018) · Autonomous Robots · doi:10.1007/s10514-017-9677-2 · Cited by 832
Recent Advances in Robot Learning from Demonstration
Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-100819-063206 · Cited by 752
“Existing literature in LfD has explored a wide variety of choices for what is considered to be the state, such as end-effector position (81), velocity (70), orientation (82), force (66, 76), joint angles (75), and torques (79).”
BackgroundMethodInfluentialSelf-citationModel-based Reinforcement Learning: A Survey
M. Moerland, T., Broekens, J., Plaat, A., & M. Jonker, C. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000086 · Cited by 524
Metadata
- Authors
- Khansari-Zadeh, S. M., & Billard, A.
- Affiliations
- École Polytechnique Fédérale de Lausanne (CH)
- ORCID
- Billard, Aude
- Venue
- IEEE Transactions on Robotics
- Published
- 2011-10
- Volume
- 27
- Issue
- 5
- Pages
- 943-957
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2129202194
- Cited by
- 771
- References
- 43
- Citations by year
- 2026: 41 · 2025: 71 · 2024: 73 · 2023: 74 · 2022: 47 · 2021: 67 · 2020: 65 · 2019: 69 · 2018: 52 · 2017: 43 · 2016: 31 · 2015: 42 · 2014: 41 · 2013: 28 · 2012: 22
- FWCI
- 27.98
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Funders
- European Commission (FP7 ICT, 248311)
- FP7 Information and Communication Technologies
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- learning dynamical systems, global asymptotic stability, Gaussian mixture model, time-invariant systems, robustness to disturbances
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.