The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Learning to select and generalize striking movements in robot table tennis
Open accessAbstract
Learning new motor tasks from physical interactions is an important goal for both robotics and machine learning. However, when moving beyond basic skills, most monolithic machine learning approaches fail to scale. For more complex skills, methods that are tailored for the domain of skill learning are needed. In this paper, we take the task of learning table tennis as an example and present a new framework that allows a robot to learn cooperative table tennis from physical interaction with a human. The robot first learns a set of elementary table tennis hitting movements from a human table tennis teacher by kinesthetic teach-in, which is compiled into a set of motor primitives represented by dynamical systems. The robot subsequently generalizes these movements to a wider range of situations using our mixture of motor primitives approach. The resulting policy enables the robot to select appropriate motor primitives as well as to generalize between them. Finally, the robot plays with a human table tennis partner and learns online to improve its behavior. We show that the resulting setup is capable of playing table tennis using an anthropomorphic robot arm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
(2006) · Springer eBooks · Cited by 8,123
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
The coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395 · cited 4×
“These subtasks can be solved using a small number of generalizable movement pattern generators, also called movement primitives (Flash and Hogan 1985; Giszter et al. 2000; Billard et al. 2008).”
BackgroundInfluentialA survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Is imitation learning the route to humanoid robots?
Schaal, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01327-3 · Cited by 1,314
On Learning, Representing, and Generalizing a Task in a Humanoid Robot
Calinon, S., Guenter, F., & Billard, A. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2006.886952 · Cited by 1,090
Robot Programming by Demonstration
Billard, A., Calinon, S., Dillmann, R., & Schaal, S. (2008) · Springer Handbook of Robotics · doi:10.1007/978-3-540-30301-5_60 · Cited by 1,002
Movement imitation with nonlinear dynamical systems in humanoid robots
Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1014739 · Cited by 840
Reinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
Self-citationPeters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
Self-citationComputational approaches to motor learning by imitation
Schaal, S., Ijspeert, A., & Billard, A. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1258 · Cited by 587
Policy Gradient Methods for Robotics
Peters, J., & Schaal, S. (2006) · 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2006.282564 · Cited by 498
Self-citationPolicy search for motor primitives in robotics
Kober, J., & Peters, J. (2011) · Machine Learning · doi:10.1007/s10994-010-5223-6 · Cited by 427
Self-citationLearning from demonstration and adaptation of biped locomotion
Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Schaal, S., & Kawato, M. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.03.003 · Cited by 399
Task-Specific Generalization of Discrete and Periodic Dynamic Movement Primitives
Ude, A., Gams, A., Asfour, T., & Morimoto, J. (2010) · IEEE Transactions on Robotics · doi:10.1109/tro.2010.2065430 · Cited by 355
Schaal, S., Peters, J., Nakanishi, J., & Ijspeert, A. (2005) · Springer Tracts in Advanced Robotics · doi:10.1007/11008941_60 · Cited by 343
Self-citationDynamics systems vs. optimal control — a unifying view
Schaal, S., Mohajerian, P., & Ijspeert, A. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)65027-9 · Cited by 260
Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields
Park, D.-H., Hoffmann, H., Pastor, P., & Schaal, S. (2008) · Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/ichr.2008.4755937 · Cited by 254
Scalable Techniques from Nonparametric Statistics for Real Time Robot Learning
Schaal, S., Atkeson, C. G., & Vijayakumar, S. (2002) · Applied Intelligence · doi:10.1023/a:1015727715131 · Cited by 236
Advances in Neural Information Processing Systems 19 (NIPS 2006)
Girolami, M., & Zhong, M. (2007) · The MIT Press eBooks · Cited by 219
Advances in Neural Information Processing Systems 21 (NIPS 2008)
Schweikert, G., Rätsch, G., Widmer, C., & Schölkopf, B. (2008) · Cited by 212
A Kendama Learning Robot Based on Bi-directional Theory
Miyamoto, H., Schaal, S., Gandolfo, F., Gomi, H., Koike, Y., Osu, R., Nakano, E., Wada, Y., & Kawato, M. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00043-3 · Cited by 171
Reinforcement learning for imitating constrained reaching movements
Guenter, F., Hersch, M., Calinon, S., & Billard, A. (2007) · Advanced Robotics · doi:10.1163/156855307782148550 · Cited by 166
Reinforcement learning to adjust parametrized motor primitives to new situations
Kober, J., Wilhelm, A., Oztop, E., & Peters, J. (2012) · Autonomous Robots · doi:10.1007/s10514-012-9290-3 · Cited by 163
Self-citationA Robot Ping-Pong Player: Experiments in Real-Time Intelligent Control
Anderson, R. L. (1988) · Medical Entomology and Zoology · Cited by 162
Movement templates for learning of hitting and batting
Kober, J., Mülling, K., Krömer, O., Lampert, C. H., Schölkopf, B., & Peters, J. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509672 · Cited by 152
Self-citationA robot ping-pong player: experiment in real-time intelligent control
(1988) · Choice Reviews Online · doi:10.5860/choice.26-0322 · Cited by 124
Learning table tennis with a Mixture of Motor Primitives
Muelling, K., Kober, J., & Peters, J. (2010) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2010.5686298 · Cited by 110
Self-citationA biomimetic approach to robot table tennis
Mülling, K., Kober, J., & Peters, J. (2011) · Adaptive Behavior · doi:10.1177/1059712311419378 · Cited by 88
Self-citationLearning perceptual coupling for motor primitives
Kober, J., Mohler, B. J., & Peters, J. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4650953 · Cited by 85
Self-citationFaessler, H., Beyer, H. A., & Wen, J. T.-Y. (1990) · Robotersysteme · Cited by 53
Probabilistic Modeling of Human Movements for Intention Inference
Wang, Z., Deisenroth, M. P., Amor, H. B., Vogt, D., Schölkopf, B., & Peters, J. (2012) · Robotics: Science and Systems · doi:10.15607/rss.2012.viii.055 · Cited by 52
Self-citationModelling motion primitives and their timing in biologically executed movements
Williams, B. H., Toussaint, M., & Storkey, A. (2007) · neural information processing systems · Cited by 48
Rapid synchronization and accurate phase-locking of rhythmic motor primitives
Pongas, D., Billard, A., & Schaal, S. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1545257 · Cited by 45
Using dimensionality reduction to exploit constraints in reinforcement learning
Bitzer, S., Howard, M., & Vijayakumar, S. (2010) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2010.5650243 · Cited by 43
Lampert, C. H., & Peters, J. (2010) · Journal of Real-Time Image Processing · doi:10.1007/s11554-010-0168-3 · Cited by 42
Self-citationNeurobiological and neurorobotic approaches to control architectures for a humanoid motor system
Giszter, S. F., Moxon, K. A., Rybak, I. A., & Chapin, J. K. (2001) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(01)00159-2 · Cited by 38
Using Bayesian Dynamical Systems for Motion Template Libraries
Chiappa, S., Kober, J., & Peters, J. (2008) · Max Planck Institute for Plasma Physics · Cited by 24
Self-citationGräve, K., Stückler, J., & Behnke, S. (2013) · Cited by 21
Self-Learning for a Humanoid Robotic Ping-Pong Player
Lai, C. H., & Tsay, T. I. J. (2011) · Advanced Robotics · doi:10.1163/016918611x574678 · Cited by 20
Learning to Select and Generalize Striking Movements in Robot Table Tennis
Muelling, K., Kober, J., Kroemer, O., & Peters, J. (2012) · Cited by 13
Self-citationAccurate position and velocity control for trajectories based on dynamic movement primitives
Ning, K., Kulvičius, T., Tamošiūnaitė, M., & Wörgötter, F. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979668 · Cited by 8
Grasping with Vision Descriptors and Motor Primitives
Kroemer, O., Detry, R. J., Piater, J., & Peters, J. (2011) · Lecture notes in electrical engineering · doi:10.1007/978-3-642-19539-6_14 · Cited by 6
Self-citation
Cited by
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Self-citationNguyen, T. T., Nguyen, N. D., & Nahavandi, S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2977374 · Cited by 1,306
Imitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
“M¨ulling et al. [2013] use Linear Bayesian Regression to teach a robot arm to play a continuous game of table tennis.”
BackgroundMethodTime-Contrastive Networks: Self-Supervised Learning from Video
Sermanet, P., Lynch, C., Chebotar, Y., Hsu, J., Jang, E., Schaal, S., Levine, S., & Brain, G. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462891 · Cited by 546
Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning
Yu, T., Quillen, D., He, Z., Julian, R., Narayan, A., Shively, H., Bellathur, A., Hausman, K., Finn, C., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1910.10897 · Cited by 450
Metadata
- Authors
- Mülling, K., Kober, J., Kroemer, O., & Peters, J.
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2013-01-30
- Volume
- 32
- Issue
- 3
- Pages
- 263-279
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W2012204020
- Cited by
- 396
- References
- 47
- FWCI
- 45.16
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.