Movement templates for learning of hitting and batting
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Hitting and batting tasks, such as tennis forehands, ping-pong strokes, or baseball batting, depend on predictions where the ball can be intercepted and how it can properly be returned to the opponent. These predictions get more accurate over time, hence the behaviors need to be continuously modified. As a result, movement templates with a learned global shape need to be adapted during the execution so that the racket reaches a target position and velocity that will return the ball over to the other side of the net or court. It requires altering learned movements to hit a varying target with the necessary velocity at a specific instant in time. Such a task cannot be incorporated straightforwardly in most movement representations suitable for learning. For example, the standard formulation of the dynamical system based motor primitives (introduced by Ijspeert et al. [1]) does not satisfy this property despite their flexibility which has allowed learning tasks ranging from locomotion to kendama. In order to fulfill this requirement, we reformulate the Ijspeert framework to incorporate the possibility of specifying a desired hitting point and a desired hitting velocity while maintaining all advantages of the original formulation. We show that the proposed movement template formulation works well in two scenarios, i.e., for hitting a ball on a string with a table tennis racket at a specified velocity and for returning balls launched by a ball gun successfully over the net using forehand movements. All experiments were carried out on a Barrett WAM using a four camera vision system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Movement imitation with nonlinear dynamical systems in humanoid robots
Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1014739 · Cited by 840 · cited 6×
“While the original formulation in [1], [2] for discrete dynamical systems motor primitives used a second-order system to represent the phase z of the movement, this formulation has proven to be unnecessarily complicated in practice.”
BackgroundMethodInfluentialMotor Learning and Performance
Schmidt, R. A., & Wrisberg, C. A. (1991) · Cited by 664
Timing an attacking forehand drive in table tennis.
Bootsma, R. J., & Van Wieringen, P. C. (1990) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.16.1.21 · Cited by 546
Policy Gradient Methods for Robotics
Peters, J., & Schaal, S. (2006) · 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2006.282564 · Cited by 498 · cited 2×
“Although some of the presented examples, e.g., the tennis swing [1] or the T-ball batting [8], are striking movements, these standard motor primitives cannot properly encode a hitting movement.”
BackgroundSelf-citationLearning from demonstration and adaptation of biped locomotion
Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Schaal, S., & Kawato, M. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.03.003 · Cited by 399 · cited 1×
“Resulting successes have shown that it is possible to rapidly learn motor primitives for complex behaviors such as tennis swings [1] with only a final target, constrained reaching [4], drumming [5], biped locomotion [2], [6] and even in tasks with potential industrial application [7].”
BackgroundSchaal, S., Peters, J., Nakanishi, J., & Ijspeert, A. (2005) · Springer Tracts in Advanced Robotics · doi:10.1007/11008941_60 · Cited by 343
Self-citationDynamics systems vs. optimal control — a unifying view
Schaal, S., Mohajerian, P., & Ijspeert, A. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)65027-9 · Cited by 260 · cited 7×
“Since then, it has been simplified and in [3] it was shown that a single first order system suffices ˙ z = − τα z z. (1) This canonical system has the time constant τ = 1 /T where T is the duration of the motor primitive, a parameter α z which is chosen such that z ≈ 0 at T to ensure that the influence…”
BackgroundMethodInfluentialMovement reproduction and obstacle avoidance with dynamic movement primitives and potential fields
Park, D.-H., Hoffmann, H., Pastor, P., & Schaal, S. (2008) · Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/ichr.2008.4755937 · Cited by 254 · cited 1×
“The transformation function f ( z ) alters the output of the first system, in Eq.”
BackgroundA Robot Ping-Pong Player: Experiments in Real-Time Intelligent Control
Anderson, R. L. (1988) · Medical Entomology and Zoology · Cited by 162
A learning approach to robotic table tennis
Matsushima, M., Hashimoto, T., Takeuchi, M., & Miyazaki, F. (2005) · IEEE Transactions on Robotics · doi:10.1109/tro.2005.844689 · Cited by 129 · cited 1×
“[19] who used a 4 DoF WAM arm in a manually coded high speed setting), and previous work in table tennis (which had only low-inertia, was overpowered and had mostly prismatic joints [20]–[22]), we use a full seven degrees of freedom revolutionary joint robot and, thus, have to deal with larger inertia as the wrist add…”
MethodA robot ping-pong player: experiment in real-time intelligent control
(1988) · Choice Reviews Online · doi:10.5860/choice.26-0322 · Cited by 124
Hubbard, A. W., & Seng, C. N. (1954) · Research Quarterly. American Association for Health, Physical Education and Recreation · doi:10.1080/10671188.1954.10624942 · Cited by 120
Learning perceptual coupling for motor primitives
Kober, J., Mohler, B., & Peters, J. (2008) · 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2008.4650953 · Cited by 83 · cited 1×
“Additional feedback terms can be added as shown in [3], [16], [17].”
BackgroundSelf-citationBall control in high-speed batting motion using hybrid trajectory generator
Senoo, T., Namiki, A., & Ishikawa, M. (2006) · Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006. · doi:10.1109/robot.2006.1641961 · Cited by 77 · cited 2×
“[19] who used a 4 DoF WAM arm in a manually coded high speed setting), and previous work in table tennis (which had only low-inertia, was overpowered and had mostly prismatic joints [20]–[22]), we use a full seven degrees of freedom revolutionary joint robot and, thus, have to deal with larger inertia as the wrist add…”
MethodResultFaessler, H., Beyer, H. A., & Wen, J. T.-Y. (1990) · Robotersysteme · Cited by 53
Rapid synchronization and accurate phase-locking of rhythmic motor primitives
Pongas, D., Billard, A., & Schaal, S. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1545257 · Cited by 45 · cited 1×
“Resulting successes have shown that it is possible to rapidly learn motor primitives for complex behaviors such as tennis swings [1] with only a final target, constrained reaching [4], drumming [5], biped locomotion [2], [6] and even in tasks with potential industrial application [7].”
BackgroundTowards Motor Skill Learning for Robotics
Peters, J., Mülling, K., Kober, J., Nguyen-Tuong, D., & Krömer, O. (2011) · Springer tracts in advanced robotics · doi:10.1007/978-3-642-19457-3_28 · Cited by 40 · cited 2×
“Previous work needed to make simplistic assumptions such as having a static goal [8], a learned complex goal function [9] or a stationary goal that could only be lightly touched at the movement’s end [1].”
BackgroundMethodSelf-citationLearning from demonstration: repetitive movements for autonomous service robotics
Urbanek, H., Albu‐Schäffer, A., & van der Smagt, P. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2004.1389957 · Cited by 34 · cited 1×
“Resulting successes have shown that it is possible to rapidly learn motor primitives for complex behaviors such as tennis swings [1] with only a final target, constrained reaching [4], drumming [5], biped locomotion [2], [6] and even in tasks with potential industrial application [7].”
BackgroundGeneralization of example movements with dynamic systems
Gams, A., & Ude, A. (2009) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2009.5379607 · Cited by 27 · cited 1×
“Resulting successes have shown that it is possible to rapidly learn motor primitives for complex behaviors such as tennis swings [1] with only a final target, constrained reaching [4], drumming [5], biped locomotion [2], [6] and even in tasks with potential industrial application [7].”
BackgroundA Computational Model of Human Table Tennis for Robot Application
Mülling, K., & Peters, J. (2009) · Informatik aktuell · doi:10.1007/978-3-642-10284-4_8 · Cited by 12 · cited 2×
“Sports sciences literature [10], [11] indicates that most striking movements are composed of similar phases that only appear to be modified by location and velocity at the interception point for the ball [12]–[15].”
BackgroundSelf-citation
Research works printed but not linked: 3
- ramanantsoa, 1994, Towards a stroke construction model, Int J Table Tennis Sci, 2, 97
- tyldesley, 1975, Operational timing, Journal of Human Movement Studies, 1, 172
- schaal, 2003, Learning Motor Primitives, Proceedings of the International Symposium on Robotics Research
Cited by
End-to-End Training of Deep Visuomotor Policies
Levine, S., Finn, C., Darrell, T. J., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 1,344
“Several recent papers provide surveys of policy search in robotics [3, 14].”
BackgroundImitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
“This led to a series of work that utilizes the dynamic system in Ijspeert et al. [2002b] to learn from demonstrations and subsequently use reinforcement learning for self-improvement [Kober and Peters 2010, 2014; Buchli et al. 2011; Pastor et al. 2011].”
MethodA Survey on Policy Search for Robotics
Deisenroth, M. P. (2011) · Foundations and Trends in Robotics · doi:10.1561/2300000021 · Cited by 798
“In contrast to exploration in action space, exploration in parameter space is able to use more structured noise and can adapt the variance of the exploration noise in dependence of the state features φt(x).”
Background(2013) · Lincoln Repository (University of Lincoln) · Cited by 503
Self-citationLearning to select and generalize striking movements in robot table tennis
Mülling, K., Kober, J., Kroemer, O., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364912472380 · Cited by 396
“Modified hitting primitives The formulation of Kober et al. (2010) with a linear velocity allows us to directly incorporate the desired velocity such that the desired final velocity can be adapted (in addition to the desired initial and final position in Ijspeert’s formulation).”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Kober, J., Mülling, K., Krömer, O., Lampert, C. H., Schölkopf, B., & Peters, J.
- Affiliations
- Max Planck Institute for Biological Cybernetics (DE)
- Venue
- 2010 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2010-05
- Pages
- 853-858
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W1982803779
- Cited by
- 152
- References
- 21
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 2 · 2023: 6 · 2022: 8 · 2021: 11 · 2020: 9 · 2019: 13 · 2018: 9 · 2017: 12 · 2016: 9 · 2015: 13 · 2014: 17 · 2013: 14 · 2012: 8
- FWCI
- 21.97
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- TUbilio (Technical University of Darmstadt) (submittedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- motor learning, dynamical systems, motor primitives, visual servoing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.