Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models
Open accessThe DOI matches its Crossref record; 41 of the 43 references it cites were found in a registry or an index.
Abstract
Abstract—This paper presents a method for learning discrete robot motions from a set of demonstrations. We model a motion as a nonlinear autonomous (i.e. time-invariant) Dynamical System (DS), and define sufficient conditions to ensure global asymptotic stability at the target. We propose a learning method, called Stable Estimator of Dynamical Systems (SEDS), to learn the parameters of the DS to ensure that all motions follow closely the demonstrations while ultimately reaching in and stopping at the target. Time-invariance and global asymptotic stability at the target ensures that the system can respond immediately and appropriately to perturbations encountered during the motion. The method is evaluated through a set of robot experiments and on a library of human handwriting motions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In this model the convergence of all trajectories to the target is guaranteed, but the final velocity at the target is always zero (i.e. the target is an asymptotically stable point).”
From Learning to Play Minigolf: A Dynamical System-Based Approach (2012) · cites this paper as [2]
In the citing paper
“The resulting model from SEDS is globally asymptotically stable, i.e. starting from any point in the space, all trajectories converge to the origin.”
From Learning to Play Minigolf: A Dynamical System-Based Approach (2012) · cites this paper as [2]
In the citing paper
“The optimization constraints given by Eq. (10) ensure the global asymptotic stability of the function f̂(x;θ) (see [2]).”
From Learning to Play Minigolf: A Dynamical System-Based Approach (2012) · cites this paper as [2]
In the citing paper
“Gaussian distributions are used in PoMPs [114] and SEDs [115] for better generalisation behaviour.”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [115]
In the citing paper
“We use the dynamical systems approach to encode motion from several demonstrations. This enables a rapid and reactive adaptation of the arm motion in the presence of sensor uncertainty.”
From Catching Objects in Flight (2014) · cites this paper as [20]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Slotine, J.-J. E., & Li, W. (1991) · CERN Document Server (European Organization for Nuclear Research) · Cited by 18,975
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
Nonlinear programming: theory and algorithms
(1993) · Computers & Operations Research · doi:10.1016/0305-0548(93)90042-h · Cited by 5,779
ANew Look at the Statistical Model Identification
AKAlKE, H. (2011) · Cited by 4,177
Nonlinear Programming: Theory and Algorithms
Bazaraa, M. S., Sherali, H. D., & Shetty, C. M. (2006) · Wiley eBooks · doi:10.1002/0471787779 · Cited by 2,369
Sparse Gaussian Processes using Pseudo-inputs
Snelson, E., & Ghahramani, Z. (2005) · Cited by 1,415
Research works printed but not linked: 1
- schaal, 2002, Scalable locally weighted statistical techniques for real time robot learning, Appl Intell Spec Issue Scalable Robot Appl Neural Netw, 17, 49
Cited by
Imitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
“Statistical models can deal with sensor error or inaccurate demonstrations; however, incomplete demonstrations can result in suboptimal behavior [Khansari-Zadeh and Billard 2011].”
BackgroundNeural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuning
Nagabandi, A., Kahn, G., Fearing, R. S., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8463189 · Cited by 848
Progress and prospects of the human–robot collaboration
Ajoudani, A., Zanchettin, A. M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., & Khatib, O. (2018) · Autonomous Robots · doi:10.1007/s10514-017-9677-2 · Cited by 832
Recent Advances in Robot Learning from Demonstration
Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-100819-063206 · Cited by 752
“Existing literature in LfD has explored a wide variety of choices for what is considered to be the state, such as end-effector position (81), velocity (70), orientation (82), force (66, 76), joint angles (75), and torques (79).”
BackgroundMethodInfluentialSelf-citationModel-based Reinforcement Learning: A Survey
M. Moerland, T., Broekens, J., Plaat, A., & M. Jonker, C. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000086 · Cited by 524
Metadata
- Authors
- Khansari-Zadeh, S. M., & Billard, A.
- Affiliations
- École Polytechnique Fédérale de Lausanne (CH)
- ORCID
- Billard, Aude
- Venue
- IEEE Transactions on Robotics
- Published
- 2011-10
- Volume
- 27
- Issue
- 5
- Pages
- 943-957
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W2129202194
- Cited by
- 771
- References
- 43
- Citations by year
- 2026: 41 · 2025: 71 · 2024: 73 · 2023: 74 · 2022: 47 · 2021: 67 · 2020: 65 · 2019: 69 · 2018: 52 · 2017: 43 · 2016: 31 · 2015: 42 · 2014: 41 · 2013: 28 · 2012: 22
- FWCI
- 27.98
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- IEEE Transactions on Robotics (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Funders
- European Commission (FP7 ICT, 248311)
- FP7 Information and Communication Technologies
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- learning dynamical systems, global asymptotic stability, Gaussian mixture model, time-invariant systems, robustness to disturbances
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.