The DOI matches its Crossref record; 122 of the 122 references it cites were found in a registry or an index.
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Open accessAbstract
Nonlinear dynamical systems have been used in many disciplines to model complex behaviors, including biological motor control, robotics, perception, economics, traffic prediction, and neuroscience. While often the unexpected emergent behavior of nonlinear systems is the focus of investigations, it is of equal importance to create goal-directed behavior (e.g., stable locomotion from a system of coupled oscillators under perceptual guidance). Modeling goal-directed behavior with nonlinear systems is, however, rather difficult due to the parameter sensitivity of these systems, their complex phase transitions in response to subtle parameter changes, and the difficulty of analyzing and predicting their long-term behavior; intuition and time-consuming parameter tuning play a major role. This letter presents and reviews dynamical movement primitives, a line of research for modeling attractor behaviors of autonomous nonlinear dynamical systems with the help of statistical learning techniques. The essence of our approach is to start with a simple dynamical system, such as a set of linear differential equations, and transform those into a weakly nonlinear system with prescribed attractor dynamics by means of a learnable autonomous forcing term. Both point attractors and limit cycle attractors of almost arbitrary complexity can be generated. We explain the design principle of our approach and evaluate its properties in several example applications in motor control and robotics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Slotine, J.-J. E., & Li, W. (1991) · CERN Document Server (European Organization for Nuclear Research) · Cited by 18,975
Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields
Guckenheimer, J., & Holmes, P. (1983) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-1140-2 · Cited by 16,144
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
(2006) · Springer eBooks · Cited by 8,123
Real-Time Obstacle Avoidance for Manipulators and Mobile Robots
Khatib, O. (1986) · The International Journal of Robotics Research · doi:10.1177/027836498600500106 · Cited by 7,894 · cited 2×
“A typical example from the domain of motor control is obstacle avoidance with the help of potential fields (Khatib, 1986; Koditschek, 1987; Rimon & Koditschek, 1992).”
BackgroundDynamic Programming Algorithm Optimization for Spoken Word Recognition
Sakoe, H., & Chiba, S. (1978) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1978.1163055 · Cited by 6,727
Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering
Strogatz, S., Friedman, M., Mallinckrodt, A. J., & McKay, S. (1994) · Computers in Physics · doi:10.1063/1.4823332 · Cited by 4,648
(1998) · doi:10.1142/3481 · Cited by 4,436
Cited by
Imitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
Recent Advances in Robot Learning from Demonstration
Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-100819-063206 · Cited by 752
A tutorial on task-parameterized movement learning and retrieval
Calinon, S. (2016) · Intelligent Service Robotics · doi:10.1007/s11370-015-0187-9 · Cited by 422
An algorithmic perspective on imitation learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405
“Dynamic movement primitives (DMPs) [Schaal et al., 2004, Ijspeert et al., 2013] and the stable estimator of dynamical systems (SEDS) approach [Khansari-Zadeh and Billard, 2011] are representations that explicitly satisfy the condition of smooth convergence to the goal state.”
BackgroundMethodInfluentialApplication of artificial intelligence in wearable devices: Opportunities and challenges
Nahavandi, D., Alizadehsani, R., Khosravi, A., & Acharya, U. R. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106541 · Cited by 372
An Algorithmic Perspective on Imitation Learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · now publishers, Inc. eBooks · doi:10.1561/9781680834116 · Cited by 368
Robot Learning System Based on Adaptive Neural Control and Dynamic Movement Primitives
Yang, C., Chen, C., He, W., Cui, R., & Li, Z. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2852711 · Cited by 350
Learning Physical Collaborative Robot Behaviors From Human Demonstrations
Rozo, L., Calinon, S., Caldwell, D. G., Jimenez, P., & Torras, C. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2540623 · Cited by 311
A Survey on CPG-Inspired Control Models and System Implementation
Yu, J., Tan, M., Chen, J., & Zhang, J. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2280596 · Cited by 304
Dynamic movement primitives in robotics: A tutorial survey
Saveriano, M., Abu-Dakka, F. J., Kramberger, A., & Peternel, L. (2023) · The International Journal of Robotics Research · doi:10.1177/02783649231201196 · Cited by 267
Kernelized movement primitives
Huang, Y., Rozo, L., Silvério, J., & Caldwell, D. G. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919846363 · Cited by 261
Biological underpinnings for lifelong learning machines
Kudithipudi, D., Aguilar-Simon, M., Babb, J., Bazhenov, M., Blackiston, D., Bongard, J., Brna, A. P., Chakravarthi Raja, S., Cheney, N., Clune, J., et al. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00452-0 · Cited by 236
A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials
Chatzilygeroudis, K., Vassiliades, V., Stulp, F., Calinon, S., & Mouret, J.-B. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2958211 · Cited by 160
The neuromechanics of animal locomotion: From biology to robotics and back
Ramdya, P., & Ijspeert, A. J. (2023) · Science Robotics · doi:10.1126/scirobotics.adg0279 · Cited by 92
Self-citationAugmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks
Nasiriany, S., Liu, H., & Zhu, Y. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9812140 · Cited by 91
Learning Via-Point Movement Primitives with Inter- and Extrapolation Capabilities
Zhou, Y., Gao, J., & Asfour, T. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968586 · Cited by 61
A framework for robotic clothing assistance by imitation learning
Joshi, R. P., Koganti, N., & Shibata, T. (2019) · Advanced Robotics · doi:10.1080/01691864.2019.1636715 · Cited by 50
Generalized Task-Parameterized Skill Learning
Huang, Y., Silvério, J., Rozo, L., & Caldwell, D. G. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461079 · Cited by 49
Active Incremental Learning of Robot Movement Primitives
(2017) · HAL · Cited by 42
LazyDAgger: Reducing Context Switching in Interactive Imitation Learning
Hoque, R., Balakrishna, A., Putterman, C., Luo, M., Brown, D. S., Seita, D., Thananjeyan, B., Novoseller, E., & Goldberg, K. (2021) · 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case49439.2021.9551469 · Cited by 31
ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learning
Hoque, R., Balakrishna, A., Novoseller, E., Wilcox, A., Brown, D. S., & Goldberg, K. (2021) · arXiv · doi:10.48550/arxiv.2109.08273 · Cited by 31
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
“Colome et al. (2015) [247] use Dynamic Movement Primitive (DMP) [111,112] to initialise the robot trajectory to wrap a scarf around a human’s neck using a single arm; they use PI2 [320] to refine its policy.”
MethodLearning Periodic Tasks from Human Demonstrations
Yang, J., Zhang, J., Settle, C., Rai, A., Antonova, R., & Bohg, J. (2022) · 2022 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra46639.2022.9812402 · Cited by 21
Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation
Schmalstieg, F., Honerkamp, D., Welschehold, T., & Valada, A. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3329619 · Cited by 21
Hierarchical control using networks trained with higher-level forward models
Wayne, G., & Abbott, L. F. (2014) · Neural Computation · doi:10.1162/neco_a_00639 · Cited by 14
Metadata
- Authors
- Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2013-02
- Volume
- 25
- Issue
- 2
- Pages
- 328-373
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2136719407
- Cited by
- 1,598
- References
- 122
- FWCI
- 26.71
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.