The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Computational approaches to motor learning by imitation
Open accessAbstract
Movement imitation requires a complex set of mechanisms that map an observed movement of a teacher onto one's own movement apparatus. Relevant problems include movement recognition, pose estimation, pose tracking, body correspondence, coordinate transformation from external to egocentric space, matching of observed against previously learned movement, resolution of redundant degrees–of–freedom that are unconstrained by the observation, suitable movement representations for imitation, modularization of motor control, etc. All of these topics by themselves are active research problems in computational and neurobiological sciences, such that their combination into a complete imitation system remains a daunting undertaking—indeed, one could argue that we need to understand the complete perception–action loop. As a strategy to untangle the complexity of imitation, this paper will examine imitation purely from a computational point of view, i.e. we will review statistical and mathematical approaches that have been suggested for tackling parts of the imitation problem, and discuss their merits, disadvantages and underlying principles. Given the focus on action recognition of other contributions in this special issue, this paper will primarily emphasize the motor side of imitation, assuming that a perceptual system has already identified important features of a demonstrated movement and created their corresponding spatial information. Based on the formalization of motor control in terms of control policies and their associated performance criteria, useful taxonomies of imitation learning can be generated that clarify different approaches and future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking
Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp, T. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/78.978374 · Cited by 11,502
Philosophical transactions of the Royal Society of London. B
Press, H. (1886) · Cited by 10,080
Play, Dreams And Imitation In Childhood
Piaget, J. (2013) · Routledge eBooks · doi:10.4324/9781315009698 · Cited by 5,360
Premotor cortex and the recognition of motor actions
Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996) · Cognitive Brain Research · doi:10.1016/0926-6410(95)00038-0 · Cited by 4,870
Mirror neurons and the simulation theory of mind-reading
Gallese, V (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01262-5 · Cited by 3,201
Rizzolatti, G., & Arbib, M. A. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01260-0 · Cited by 2,858
Internal models for motor control and trajectory planning.
Kawato, M. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00028-8 · Cited by 2,685
Internal models in the cerebellum
Wolpert, D. M., Miall, R. C., & Kawato, M. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01221-2 · Cited by 2,469
Forward Models for Physiological Motor Control
Miall, R. C., & Wolpert, D. M. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00035-4 · Cited by 2,260
Multiple paired forward and inverse models for motor control
Wolpert, D. M., & Kawato, M. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00066-5 · Cited by 2,151
McKerrow, P. J. (1991) · Medical Entomology and Zoology · Cited by 1,731
Adaptive Computation and Machine Learning
(2012) · Boosting · doi:10.7551/mitpress/8291.003.0026 · Cited by 1,402
Is imitation learning the route to humanoid robots?
Schaal, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01327-3 · Cited by 1,314
Self-citationA unifying computational framework for motor control and social interaction
Wolpert, D. M., Doya, K., & Kawato, M. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1238 · Cited by 1,228
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Hierarchical organization and functional streams in the visual cortex
Van Essen, D. C., & Maunsell, J. H. R. (1983) · Trends in Neurosciences · doi:10.1016/0166-2236(83)90167-4 · Cited by 962
Learning by imitation: A hierarchical approach
Byrne, R. W., & Russon, A. E. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98001745 · Cited by 884
Articulated body motion capture by annealed particle filtering
Deutscher, J., Blake, A., & Reid, I. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854758 · Cited by 868
Computational approaches to motor control
Wolpert, D. M. (1997) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(97)01070-x · Cited by 855
Movement imitation with nonlinear dynamical systems in humanoid robots
Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1014739 · Cited by 840
Self-citationSkilled actions: A task-dynamic approach.
Saltzman, E. L., & Kelso, J. A. S. (1987) · Psychological Review · doi:10.1037//0033-295x.94.1.84 · Cited by 776
Imitation in Animals and Artifacts
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/3676.001.0001 · Cited by 708
Kuniyoshi, Y., Inaba, M., & Inoue, H. (1994) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.338535 · Cited by 676
Perceptual Structures and Distributed Motor Control
Arbib, M. A. (1981) · Comprehensive Physiology · doi:10.1002/cphy.cp010233 · Cited by 568
Imitation, memory, and the representation of persons
Meltzoff, A. N., & Keith Moore, M. (1994) · Infant Behavior and Development · doi:10.1016/0163-6383(94)90024-8 · Cited by 561
Robot Learning from Demonstration
(2012) · SpringerReference · doi:10.1007/springerreference_302487 · Cited by 532
Modeling parietal–premotor interactions in primate control of grasping
Fagg, A. H., & Arbib, M. A. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00047-1 · Cited by 422
Imitative Learning of Actions on Objects by Children, Chimpanzees, and Enculturated Chimpanzees
Tomasello, M., Savage‐Rumbaugh, S., & Kruger, A. C. (1993) · Child Development · doi:10.1111/j.1467-8624.1993.tb04207.x · Cited by 420
(2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_447 · Cited by 400
Imitative Learning of Actions on Objects by Children, Chimpanzees, and Enculturated Chimpanzees
Tomasello, M., Savage-Rumbaugh, S., & Kruger, A. C. (1993) · Child Development · doi:10.2307/1131463 · Cited by 338
A Self-Organizing Neural Model of Motor Equivalent Reaching and Tool Use by a Multijoint Arm
Bullock, D., Grossberg, S., & Guenther, F. H. (1993) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1993.5.4.408 · Cited by 313
Schema design and implementation of the grasp-related mirror neuron system
Oztop, E., & Arbib, M. A. (2002) · Biological Cybernetics · doi:10.1007/s00422-002-0318-1 · Cited by 307
A tutorial on particle filters for on-line nonlinear/non-Gaussian Bayesian tracking
Maskell, S. (2001) · IEE International Seminar Target Tracking: Algorithms and Applications · doi:10.1049/ic:20010246 · Cited by 283
D'Souza, A., Vijayakumar, S., & Schaal, S. (2002) · Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180) · doi:10.1109/iros.2001.973374 · Cited by 282
Self-citationSammut, C., Hurst, S., Kedzier, D., & Michie, D. (1992) · Machine Learning Proceedings 1992 · doi:10.1016/b978-1-55860-247-2.50055-3 · Cited by 275
NONLINEAR GATED EXPERTS FOR TIME SERIES: DISCOVERING REGIMES AND AVOIDING OVERFITTING
WEIGEND, A. S., MANGEAS, M., & SRIVASTAVA, A. N. (1995) · International Journal of Neural Systems · doi:10.1142/s0129065795000251 · Cited by 253
Getting to know each other—Artificial social intelligence for autonomous robots
Dautenhahn, K. (1995) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(95)00054-2 · Cited by 241
Demiris, J., & Hayes, G. (2002) · Imitation in Animals and Artifacts · doi:10.7551/mitpress/3676.003.0014 · Cited by 233
Learning human arm movements by imitation:
Billard, A., & Matarić, M. J. (2001) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(01)00155-5 · Cited by 207
Self-citationSynthetic brain imaging: grasping, mirror neurons and imitation
Arbib, M. A., Billard, A., Iacoboni, M., & Oztop, E. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00070-8 · Cited by 192
Self-citationImitation as behaviour parsing
Byrne, R. W. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1219 · Cited by 191
Learning rhythmic movements by demonstration using nonlinear oscillators
Ijspeort, A. J., Nakanishi, J., & Schaal, S. (2003) · IEEE/RSJ International Conference on Intelligent Robots and System · doi:10.1109/irds.2002.1041514 · Cited by 183
Self-citationA Kendama Learning Robot Based on Bi-directional Theory
Miyamoto, H., Schaal, S., Gandolfo, F., Gomi, H., Koike, Y., Osu, R., Nakano, E., Wada, Y., & Kawato, M. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00043-3 · Cited by 171
Skill acquisition from human demonstration using a hidden Markov model
Hovland, G. E., Sikka, P., & McCarragher, B. J. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1996.506571 · Cited by 153
The Computation and Theory of Optimal Control
Dyer, P., McReynolds, S. R., & Eggleston, D. M. (1972) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.3426573 · Cited by 152
Programming robots using reinforcement learning and teaching
Lin, L.-J. (1991) · National Conference on Artificial Intelligence · Cited by 142
Imitation with ALICE: learning to imitate corresponding actions across dissimilar embodiments
Alissandrakis, A., Nehaniv, C. L., & Dautenhahn, K. (2002) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2002.804820 · Cited by 131
Learning tasks from a single demonstration
Atkeson, C. G., & Stefan Schaal, A. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1997.614389 · Cited by 128
Segmentation of endpoint trajectories does not imply segmented control
Sternad, D., & Schaal, S. (1999) · Experimental Brain Research · doi:10.1007/s002210050606 · Cited by 117
Self-citationFixation behavior in observation and imitation of human movement
Matarić, M. J., & Pomplun, M. (1998) · Cognitive Brain Research · doi:10.1016/s0926-6410(98)00025-1 · Cited by 108
Recognizing teleoperated manipulations
Pook, P. K., & Ballard, D. H. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1993.291896 · Cited by 108
LEARNING MOTOR SKILLS BY IMITATION: A BIOLOGICALLY INSPIRED ROBOTIC MODEL
Billard, A. (2001) · Cybernetics & Systems · doi:10.1080/019697201300001849 · Cited by 101
Self-citationNehaniv, C. L., & Dautenhahn, K. (2000) · World Scientific series in robotics and intelligent systems · doi:10.1142/9789812792747_0007 · Cited by 101
Coupling the Neural and Physical Dynamics in Rhythmic Movements
Hatsopoulos, N. G. (1996) · Neural Computation · doi:10.1162/neco.1996.8.3.567 · Cited by 95
Annealed Competition of Experts for a Segmentation and Classification of Switching Dynamics
Pawelzik, K. R., Kohlmorgen, J., & Müller, K. (1996) · Neural Computation · doi:10.1162/neco.1996.8.2.340 · Cited by 93
A theory for cursive handwriting based on the minimization principle
Wada, Y., & Kawato, M. (1995) · Biological Cybernetics · doi:10.1007/bf00199051 · Cited by 90
Iterative retrieval of sparsely coded associative memory patterns
Schwenker, F., Sommer, F. T., & Palm, G. (1996) · Neural Networks · doi:10.1016/0893-6080(95)00112-3 · Cited by 89
A tennis serve and upswing learning robot based on bi-directional theory
Miyamoto, H., & Kawato, M. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00062-8 · Cited by 71
Mixtures of Controllers for Jump Linear and Non-Linear Plants
Cacciatore, T. W., & Nowlan, S. J. (1993) · Cited by 62
Neural Models for Flexible Control of Redundant Systems
Guenther, F. H., & Barreca, D. M. (1997) · Advances in psychology · doi:10.1016/s0166-4115(97)80014-3 · Cited by 53
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/7011.003.0017 · Cited by 49
Human skill transfer: neural networks as learners and teachers
Nechyba, M. C., & Xu, Y. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1995.525902 · Cited by 46
Improved Switching among Temporally Abstract Actions
Sutton, R. S., Singh, S. P., Precup, D., & Ravindran, B. (1998) · Cited by 33
Mathematical modelling of animate and intentional motion
Rittscher, J., Blake, A., Hoogs, A. J., & Stein, G. C. (2003) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2002.1259 · Cited by 31
Human-to-robot skill transfer using the SPORE approximation
Grudić, G. Z., & Lawrence, P. D. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1996.509162 · Cited by 29
Bidirectional Theory Approach to Integration
Kawato, M. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/1479.003.0024 · Cited by 29
Reciprocal excitation between biological and robotic research
Schaal, S., Sternad, D., Dean, W. J., Kotosaka, S., Osu, R., & Kawato, M. (2000) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.403706 · Cited by 3
Self-citationExplaining facial imitation: a theoretical model
(1997) · doi:10.1002/(sici)1099-0917(199709/12)6:3/4
Cited by
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013) · Neural Computation · doi:10.1162/neco_a_00393 · Cited by 1,598
Self-citationA unifying computational framework for motor control and social interaction
Wolpert, D. M., Doya, K., & Kawato, M. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1238 · Cited by 1,228
Imitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrations
Rajeswaran, A., Kumar, V., Gupta, A., Vezzani, G., Schulman, J., Todorov, E., & Levine, S. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.049 · Cited by 847
Metadata
- Authors
- Schaal, S., Ijspeert, A., & Billard, A.
- Venue
- Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2003-02-17
- Volume
- 358
- Issue
- 1431
- Pages
- 537-547
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2130726249
- Cited by
- 587
- References
- 68
- FWCI
- 10.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.