The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Movement imitation with nonlinear dynamical systems in humanoid robots
Open accessAbstract
Presents an approach to movement planning, on-line trajectory modification, and imitation learning by representing movement plans based on a set of nonlinear differential equations with well-defined attractor dynamics. The resultant movement plan remains an autonomous set of nonlinear differential equations that forms a control policy (CP) which is robust to strong external perturbations and that can be modified on-line by additional perceptual variables. We evaluate the system with a humanoid robot simulation and an actual humanoid robot. Experiments are presented for the imitation of three types of movements: reaching movements with one arm, drawing movements of 2-D patterns, and tennis swings. Our results demonstrate (a) that multi-joint human movements can be encoded successfully by the CPs, (b) that a learned movement policy can readily be reused to produce robust trajectories towards different targets, (c) that a policy fitted for one particular target provides a good predictor of human reaching movements towards neighboring targets, and (d) that the parameter space which encodes a policy is suitable for measuring to which extent two trajectories are qualitatively similar.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
Model-based control of a robot manipulator
(1988) · Choice Reviews Online · doi:10.5860/choice.26-1542 · Cited by 553
Convergent force fields organized in the frog's spinal cord
Giszter, S., Mussa-Ivaldi, F., & Bizzi, E. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-02-00467.1993 · Cited by 544
Constructive Incremental Learning from Only Local Information
Schaal, S., & Atkeson, C. G. (1998) · Neural Computation · doi:10.1162/089976698300016963 · Cited by 517
Self-citationUsing humanoid robots to study human behavior
Atkeson, C. G., Hale, J. G., Pollick, F., Riley, M., Kotosaka, S., Schaul, S., Shibata, T., Tevatia, G., Ude, A., Vijayakumar, S., et al. (2000) · IEEE Intelligent Systems · doi:10.1109/5254.867912 · Cited by 268
Trajectory formation for imitation with nonlinear dynamical systems
Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2002) · Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180) · doi:10.1109/iros.2001.976259 · Cited by 175
Self-citationA Kendama Learning Robot Based on Bi-directional Theory
Miyamoto, H., Schaal, S., Gandolfo, F., Gomi, H., Koike, Y., Osu, R., Nakano, E., Wada, Y., & Kawato, M. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00043-3 · Cited by 171
Mussa-Ivaldi, F. A. (2002) · IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) · doi:10.1109/cira.1997.613842 · Cited by 68
Nonlinear dynamical systems for imitation with humanoid robots
Ijspeert, A. J., Nakanishi, J., Shibata, T., & Stefan Schaal, A. (2001) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 33
Self-citation
Cited by
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
A survey of advances in vision-based human motion capture and analysis
Moeslund, T. B., Hilton, A., & Krüger, V. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.08.002 · Cited by 2,541
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013) · Neural Computation · doi:10.1162/neco_a_00393 · Cited by 1,598
Self-citationVillani, V., Pini, F., Leali, F., & Secchi, C. (2018) · Mechatronics · doi:10.1016/j.mechatronics.2018.02.009 · Cited by 1,237
Reinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
Self-citationLearning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrations
Rajeswaran, A., Kumar, V., Gupta, A., Vezzani, G., Schulman, J., Todorov, E., & Levine, S. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.049 · Cited by 847
Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models
Khansari-Zadeh, S. M., & Billard, A. (2011) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2159412 · Cited by 771
Learning and generalization of motor skills by learning from demonstration
Pastor, P., Hoffmann, H., Asfour, T., & Schaal, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152385 · Cited by 702
Self-citationAction understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
Computational approaches to motor learning by imitation
Schaal, S., Ijspeert, A., & Billard, A. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1258 · Cited by 587
Self-citationHow to train your robot with deep reinforcement learning: Lessons we have learned
Ibarz, J., Tan, J., Finn, C., Kalakrishnan, M., Pastor, P., & Levine, S. (2021) · The International Journal of Robotics Research · doi:10.1177/0278364920987859 · Cited by 570
Time-Contrastive Networks: Self-Supervised Learning from Video
Sermanet, P., Lynch, C., Chebotar, Y., Hsu, J., Jang, E., Schaal, S., Levine, S., & Brain, G. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462891 · Cited by 546
Self-citationSmith, M. A., & Shadmehr, R. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00943.2004 · Cited by 497
Policy search for motor primitives in robotics
Kober, J., & Peters, J. (2011) · Machine Learning · doi:10.1007/s10994-010-5223-6 · Cited by 427
An algorithmic perspective on imitation learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405
“In current imitation learning, there are performance guarantees, e.g., stability of DMPs [Ijspeert et al., 2002a, Schaal et al., 2004] and a proof of low error in DAGGER [Ross et al., 2011].”
BackgroundInfluentialLearning to select and generalize striking movements in robot table tennis
Mülling, K., Kober, J., Kroemer, O., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364912472380 · Cited by 396
Application of artificial intelligence in wearable devices: Opportunities and challenges
Nahavandi, D., Alizadehsani, R., Khosravi, A., & Acharya, U. R. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106541 · Cited by 372
An Algorithmic Perspective on Imitation Learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · now publishers, Inc. eBooks · doi:10.1561/9781680834116 · Cited by 368
Task-Specific Generalization of Discrete and Periodic Dynamic Movement Primitives
Ude, A., Gams, A., Asfour, T., & Morimoto, J. (2010) · IEEE Transactions on Robotics · doi:10.1109/tro.2010.2065430 · Cited by 355
Schaal, S., Peters, J., Nakanishi, J., & Ijspeert, A. (2005) · Springer Tracts in Advanced Robotics · doi:10.1007/11008941_60 · Cited by 343
Self-citationLearning variable impedance control
Buchli, J., Stulp, F., Theodorou, E., & Schaal, S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911402527 · Cited by 337
Self-citationInteractive Technologies for Autistic Children: A Review
Boucenna, S., Narzisi, A., Tilmont, E., Muratori, F., Pioggia, G., Cohen, D., & Chetouani, M. (2014) · Cognitive Computation · doi:10.1007/s12559-014-9276-x · Cited by 310
WHOLE-BODY DYNAMIC BEHAVIOR AND CONTROL OF HUMAN-LIKE ROBOTS
KHATIB, O., SENTIS, L., PARK, J., & WARREN, J. (2004) · International Journal of Humanoid Robotics · doi:10.1142/s0219843604000058 · Cited by 293
Advancements in Humanoid Robots: A Comprehensive Review and Future Prospects
Tong, Y., Liu, H., & Zhang, Z. (2024) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.124140 · Cited by 288
Hoffmann, H., Pastor, P., Park, D.-H., & Schaal, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152423 · Cited by 283
Self-citationDynamic movement primitives in robotics: A tutorial survey
Saveriano, M., Abu-Dakka, F. J., Kramberger, A., & Peternel, L. (2023) · The International Journal of Robotics Research · doi:10.1177/02783649231201196 · Cited by 267
Dynamics systems vs. optimal control — a unifying view
Schaal, S., Mohajerian, P., & Ijspeert, A. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)65027-9 · Cited by 260
Self-citationRobot Learning from Demonstration in Robotic Assembly: A Survey
Zhu, Z., & Hu, H. (2018) · Robotics · doi:10.3390/robotics7020017 · Cited by 255
Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields
Park, D.-H., Hoffmann, H., Pastor, P., & Schaal, S. (2008) · Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/ichr.2008.4755937 · Cited by 254
Self-citationProbabilistic movement modeling for intention inference in human–robot interaction
Wang, Z., Mülling, K., Deisenroth, M. P., Ben Amor, H., Vogt, D., Schölkopf, B., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913478447 · Cited by 171
A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials
Chatzilygeroudis, K., Vassiliades, V., Stulp, F., Calinon, S., & Mouret, J.-B. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2958211 · Cited by 160
Movement templates for learning of hitting and batting
Kober, J., Mülling, K., Krömer, O., Lampert, C. H., Schölkopf, B., & Peters, J. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509672 · Cited by 152
GTI: Learning to Generalize across Long-Horizon Tasks from Human Demonstrations
Mandlekar, A., Xu, D., Martín-Martín, R., Savarese, S., & Fei-Fei, L. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.061 · Cited by 90
What Matters in Learning from Offline Human Demonstrations for Robot Manipulation
Mandlekar, A., Xu, D., Wong, J., Nasiriany, S., Wang, C., Kulkarni, R., Fei-Fei, L., Savarese, S., Zhu, Y., & Martín-Martín, R. (2021) · arXiv · doi:10.48550/arxiv.2108.03298 · Cited by 66
Coupled dynamical system based arm–hand grasping model for learning fast adaptation strategies
Shukla, A., & Billard, A. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.07.023 · Cited by 55
MimicPlay: Long-horizon imitation learning by watching human play
Wang, C., Fan, L., Sun, J., Zhang, R., Fei-Fei, L., Xu, D., Zhu, Y., & Anandkumar, A. (2023) · arXiv · doi:10.48550/arxiv.2302.12422 · Cited by 43
Learning motion dynamics to catch a moving object
Kim, S., Gribovskaya, E., & Billard, A. (2010) · 2010 10th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/ichr.2010.5686332 · Cited by 39
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
“Colome et al. (2015) [247] use Dynamic Movement Primitive (DMP) [111,112] to initialise the robot trajectory to wrap a scarf around a human’s neck using a single arm; they use PI2 [320] to refine its policy.”
MethodLearning to Play Minigolf: A Dynamical System-Based Approach
Khansari-Zadeh, S. M., Kronander, K., & Billard, A. (2012) · Advanced Robotics · doi:10.1080/01691864.2012.728692 · Cited by 28
DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning
Jiang, Z., Xie, Y., Lin, K., Xu, Z., Wan, W., Mandlekar, A., Fan, L. J., & Zhu, Y. (2025) · 2025 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra55743.2025.11127809 · Cited by 24
SkillMaN — A skill-based robotic manipulation framework based on perception and reasoning
Diab, M., Pomarlan, M., Beßler, D., Akbari, A., Rosell, J., Bateman, J., & Beetz, M. (2020) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2020.103653 · Cited by 23
Learning to Generalize Across Long-Horizon Tasks from Human Demonstrations
Mandlekar, A., Xu, D., Martín-Martín, R., Savarese, S., & Fei-Fei, L. (2020) · arXiv · doi:10.48550/arxiv.2003.06085 · Cited by 17
Human-Machine Interface for Remote Training of Robot Tasks
Spranger, J., Buzatoiu, R., Polydoros, A., Nalpantidis, L., & Boukas, E. (2018) · 2018 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2018.8577081 · Cited by 10
MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations
Mandlekar, A., Nasiriany, S., Wen, B., Akinola, I., Narang, Y., Fan, L., Zhu, Y., & Fox, D. (2023) · arXiv · doi:10.48550/arxiv.2310.17596 · Cited by 226
“It has been used extensively in prior work for robot manipulation [1,19,25,29–34] — in this work, we use BC to train single-task policies from datasets generated by MimicGen.”
Method
Metadata
- Authors
- Ijspeert, A. J., Nakanishi, J., & Schaal, S.
- Venue
- Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292)
- Publisher
- IEEE
- Published
- 2003-06-25
- Volume
- 2
- Pages
- 1398-1403
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2110304639
- Cited by
- 840
- References
- 11
- FWCI
- 49.93
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.