Cited by 26Robot Manipulation and LearningReinforcement Learning in RoboticsMotor Control and Adaptation

Improving Task-Parameterised Movement Learning Generalisation with Frame-Weighted Trajectory Generation

Open access
Sena, Aran, Michael, Brendan, Howard, Matthew·2019·2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Abstract

Learning from Demonstration depends on a robot learner generalising its learned model to unseen conditions. Generally, it is not feasible for a person to provide demonstrations that account for all possible variations in non-trivial tasks. While there are many learning methods that can handle interpolation of observed data effectively, extrapolation from observed data offers a much greater challenge. To address this problem, this paper proposes a modified Task-Parameterised Gaussian Mixture Regression method that considers the relevance of task parameters during trajectory generation, as determined by variance in the data. The benefits of the proposed method are first explored using a simulated reaching task data set. Here it is shown that the proposed method offers far-reaching, low-error extrapolation abilities that are different in nature to existing learning methods. Data collected from novice users for a real-world manipulation task is then considered, where it is shown that the proposed method is able to effectively reduce grasping performance errors by $\sim $40% and extrapolate to unseen grasp targets under real-world conditions. These results indicate the proposed method can benefit novice users by placing less reliance on the user to provide high quality demonstration data sets.

Integrity signals

Registry

Crossref · 10.1109/iros40897.2019.8967688

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

4 of 16 cited sources checked · 0 supported · 0 flagged · accuracy not yet measured

  • Interpretationcitation

    The paper builds on confidence weighting and frame importance sampling to present an autonomous method for weighting task frames during regression to improve extrapolation while retaining local structure.

    “To address these issues, this paper builds on the confidence weighting scheme presented in [7] and the frame importance sampling in [8], and presents an autonomous method for weighting task frames during regression to improve model extrapolation, while retaining local structure observed in demonstration data.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [7] source
    • cites [8] source

      The citing sentence presents the autonomous regression method as the citing authors’ own contribution, not necessarily as a contribution of this source. In Task Learning and Trajectory Generation (pages unavailable), our copy describes TP-GMM/GMR and distance-weighted estimates of initiation-frame transformations, but does not describe a confidence-weighting scheme or frame-importance sampling. Searches for those terms and for weighting task frames during regression found no supporting passage. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Findingown data

    The proposed method extrapolates to unseen grasp targets under real-world conditions.

    “where it is shown that the proposed method is able to effectively reduce grasping performance errors by ∼ 30% and extrapolate to unseen grasp targets under realworld conditions.”
    Quote in the paperSubstantial claim
  • Findingown data

    TP-GMR's end-point error worsened in a regular pattern as trajectories moved farther from the original demonstration set.

    “Looking at row (ii), end-point error, it can be seen that the performance of (a) TP-GMR degrades in a regular pattern as trajectories move further away from the original demonstration set.”
    Quote in the paperSubstantial claim
  • Findingown data

    An Anderson-Darling test found the distribution of data residuals to be non-normal.

    “Analysing the collected data revealed the distribution of data residuals was found to be non-normal by an Anderson-Darling test on the data.”
    Quote in the paperSubstantial claim
  • Findingown data

    αTP-GMR showed a low, constant level of task constraint error across the grid.

    “Finally in (b), it can be seen that again there is a low, constant level of error across the grid.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 20
  • May combine two claims. 24
  • The quote only partly states this claim. 2
  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    People often struggle to provide adequate demonstration sets.

    “Given that people often struggle to provide adequate demonstration sets [1], [3]”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [1] source

      The Introduction (p. 2) says human demonstrations might not be optimal for the robot because demonstrators may focus on completing the task rather than exploiting the robot’s capabilities. That supports a concern about demonstration quality, but it does not establish that people often struggle to provide adequate demonstration sets. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
    • cites [3] source

      The Introduction (p. 1) discusses statistical goodness-of-fit tests and samples of observations, not people assembling demonstration sets. Searches for “adequate demonstration sets” and for difficulty providing examples or demonstrations found no passage addressing the claim. (LLM, conf=0.77)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The magnitude of the covariance matrix, evaluated by its determinant, is considered an indicator for whether a defined task parameter is required to learn a task.

    “Here, the magnitude of the covariance matrix, evaluated using a matrix determinant, is considered an indicator for this.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [8] source

      The Task Learning section describes task-parameterised Gaussian mixture modelling and its reference frames, but does not describe using a covariance-matrix determinant to decide whether a task parameter is required. Searches for covariance-matrix magnitude and determinant returned no passage addressing that criterion; the supplied passages have no page numbers. (LLM, conf=0.74)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingown data

    The first frame initially takes priority, then control transitions to the second frame as the trajectory nears the goal.

    “Initially, the first frame takes priority followed by a transition to the second frame as the trajectory approaches the goal.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    αTP-GMR's end-point error was very low and constant across the grid.

    “Plot (b) presents the first unusual result, where it can be seen that the error for αTP-GMR is very low and constant across the grid.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    mPGMM improved on TP-GMR's end-point error, but its trajectory generation became erratic in the upper and lower left corners.

    “It can be seen that mPGMM provides improved performance over TP-GMR; however in the upper and lower left corners the trajectory generation becomes erratic in a manner similar to the first row.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Findingown data

    In the extrapolation grid search, αTP-GMR produced much lower task and constraint errors than the other methods.

    “Here, it can be seen that αTP-GMR achieves much lower task and constraint error values.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    TP-GMR and αTP-GMR produced broadly similar path lengths, while mPGMM trajectories became erratic at the grid extremes.

    “It can be seen that for (a) TP-GMR and (b) αTP-GMR that the generated path lengths are largely similar; however for (b) mPGMM, the trajectories begin to become erratic in the extremes of the grid.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The demonstration set contained two sub-groups in the top and bottom tray portions, causing redundant demonstrations in demonstrated regions and undemonstrated states elsewhere.

    “There are two sub-groups of demonstrations in the top and bottom portion of the tray, which results in redundant demonstrations in the demonstrated regions, and undemonstrated states elsewhere.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    mPGMM's end-point error increased in a regular pattern similar to TP-GMR's, though less severely.

    “In addition to erratic end-point error, it can be seen that the error in (c) does increase with a regular pattern like (a), albeit to a lesser degree.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    At γ=0 both frames receive equal weighting αj=0.5; with larger γ the transition between frames becomes steeper.

    “At γ = 0, each frame is given equal weighting α j = 0.5; however as γ increases, the transition from one frame to another becomes increasingly steep.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingnone given

    Increasing a frame weighting value reduces the corresponding covariance, as defined in equation (4).

    “As a frame weighting value increases, it decreases the corresponding covariance as defined in (4), as expected.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In the Figure 4 cases, αTP-GMR generated smooth trajectories that satisfied the task constraints.

    “It can be seen that in each case, αTP-GMR is able to generate a smooth trajectory which satisfies the task constraints.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    A Wilcoxon signed-rank test showed αTP-GMR's median error was significantly smaller than TP-GMR's, with reported medians 5.0541 and 3.4763, Z=8.6621, p<10^-17.

    “This indicated that the median error αTP-GMR (˜ = 5.0541) was statistically significantly lower than under conventional TP-GMR (˜ = 3.4763), Z = 8.6621, p < 10 -17 .”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Findingown data

    In a reaching task test data set, the proposed method shows significant improvement over original TP-GMR and mPGMM.

    “Significant improvement using the proposed method is shown in a test data set for a reaching task, versus the original TP-GMR method described in [4] and a modified TP method described in [5], specifically designed to improve extrapolation of learned skills.”
    • Also stated in: § Abstract · boosted
      “Here it is shown that the proposed method offers far-reaching, low-error extrapolation abilities that are different in nature to existing learning methods.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [4] source
    • cites [5] source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Generated trajectories contain the same number of data points as the original demonstrations, so extra processing may be needed to keep within robot limits.

    “Generated trajectories have the same number of data points as original demonstrations, so additional processing may be required to ensure robot limits are not exceeded.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Model performance was evaluated using an exhaustive leave-one-out cross-validation procedure.

    “Evaluation of a model's ability to learn the task performance is achieved through an exhaustive leave-one-out cross-validation procedure.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    αTP-GMR was the most accurate method for generating trajectories under unseen conditions, though only over a small range.

    “This indicates that αTP-GMR was the most accurate in generating trajectories for unseen conditions, albeit over a small range.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Improving a robot learner's extrapolation ability would help it learn tasks from limited demonstrations and reduce teaching effort for human users.

    “Improving a robot learner's ability to extrapolate would help them to effectively learn tasks from limited demonstrations, and reduce teaching effort for their human users.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Confidence-weighted Task-Parameterised movement learning can generate different trajectories from the same task parameters by weighting learned local models.

    “The authors show how different trajectories can be generated from the same set of task parameters through weighting of the learned local models.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [7] source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Under Task-Parameterised Gaussian Mixture Model-based methods, variability in recorded data is encoded in the local models' covariance matrices.

    “Under Task-Parameterised Gaussian Mixture Model-based methods, variability in the recorded data is encoded in the local models' covariance matrices.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    mPGMM performed only slightly better than TP-GMR, leading to similar conclusions.

    “In (c), mPGMM does not fare much better than TP-GMR and similar conclusions can be drawn.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Trajectories near the grasp targets closely matched the demonstration set, indicating that local structure had been learned and used.

    “In particular, it can be seen that in Figure 6, the trajectories near the grasp targets closely match the trajectories in the demonstration set, indicating that the local structure has been learned and is being used.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    In standard TP-GMM, the contribution of the start position frame offsets the trajectory slightly.

    “This is an important modification, as in a standard Task-Parameterised Gaussian Mixture Model the contribution of the start position frame in (3) will offset the trajectory slightly.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Considering task parameter relevance before combining local models preserves local structure more effectively and improves task performance.

    “By doing so, local structure can be more effectively preserved, resulting in improved task performance.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    With TP-GMM, using the same task parameters in the product as were used to learn the local models produces a trajectory that attempts to replicate a demonstration.

    “With (3), if the same task parameters are used in the product as were used to learn the local models, the resulting mixture model will produce a trajectory that attempts to replicate a demonstration.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationown data

    This result confirmed the findings from the previous two experiments.

    “This result confirms the findings observed in the previous two experiments.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    mPGMM improves the extrapolation abilities of Task-Parameterised models while reducing computation time compared with TP-GMR.

    “The authors show the proposed method improves the extrapolation abilities of TP models while reducing the computation time required compared to TP-GMR.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [5] source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    mPGMM uses an altered Expectation Maximisation procedure to improve the extrapolation abilities of Task-Parameterised models.

    “In an attempt to improve extrapolation abilities of TP, [5] propose a modified Parameteric Gaussian Mixture Model (mPGMM) that uses an altered Expectation Maximisation (EM) procedure to improve the extrapolation abilities of the learnt model.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [5] source
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    TP-GMM generalisation emerges from the product of Gaussians: given new task parameter values, local models can generate global models for different task parameters.

    “Generalisation with Task-Parameterised Gaussian Mixture Model also emerges from (3).That is, given new values for {A j , b j }, the local models can be used to generate global models for different task parameters.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The confidence-weighting scheme was proposed as a way to incorporate human prior knowledge about the importance of different task parameters.

    “The authors propose this is a useful mechanism for providing human prior knowledge about the importance of different task parameters to the model.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [7] source
  • May combine two claims.

    Interpretationown data

    Under αTP-GMR, the model generated trajectories that accurately followed the requested path and respected local structure constraints from the original demonstrations.

    “This indicates that under αTP-GMR, the model is able to generate trajectories that accurately produce the requested path, and importantly this path follows local structure constraints, as provided in the original demonstrates.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    Tighter groupings of data in local models result in smaller covariance matrices and smaller matrix determinants.

    “Tighter groupings of data in the local models will result in “smaller” covariance matrices, hence the matrix determinant.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Across all experiments, the learning methods were assessed with task-specific criteria, but learning used the task-independent cost function (8).

    “Note that in all experiments, while the learning methods were assessed using task-specific criteria, the learning process used the task-independent cost function (8) described in §IV-B.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    mPGMM can fail to preserve local structure, resulting in failure to execute the desired task effectively.

    “While the proposed method helps in extrapolation of the demonstrated task, this method can fail to preserve local structure, resulting in failure to execute the desired task effectively.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [5] source
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Task-Parameterised learning defines task-relevant parameters, such as object positions and orientations, and uses them to construct frames of reference.

    “In TP learning, specific task relevant parameters are defined, such as object positions and orientations in an environment, and these are used to construct frames of reference.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [4] source
    • The authors state this as an assumption: Task parameters can be treated as coordinate frames of reference in this work.
  • Classified as probably not a substantial claim.

    Premisecitation

    Generalisation of demonstrated trajectories is a central problem in learning from demonstration.

    “Generalisation of demonstrated trajectories is identified as a central problem in LfD in [6].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [6]
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    It is non-trivial for a person, especially a novice, to determine the relative importance of a task frame and manually assign weightings.

    “While this is a possible use for the method, it seems non-trivial for a person to determine the relative importance of a task frame and manually assign weightings, particularly if that person is a novice user of the technology.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The non-constant error was due to noisy data making learning harder and leaving less information for the robot to judge frame importance at each step.

    “This is due to the noisy nature of the data making learning more challenging, and resulting in less information being available to the robot learner to gauge which frames are important at each step.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The high extrapolation possible with αTP-GMR might make a novice user overconfident in an unsuitable generated trajectory.

    “the high degree of extrapolation possible with αTP-GMR might mislead a novice user to be confident in a generated trajectory that is unsuitable.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    These improvements would benefit novice LfD users by helping robot learners extrapolate from limited data and reducing reliance on high-quality demonstration sets.

    “These improvements will serve to benefit novice users of LfD systems, by enhancing the ability of robot learners to extrapolate from limited data and places less reliance on the user providing a high-quality demonstration data sets.”
    Quote in the paperSubstantial claim
40 of 40
  • The authors state this as an assumption.

    The learned model is time-driven.

    “Assuming the model is time-driven, the GMM will encode the joint probability of states and time, p(t, ξ t ), from which states can be sampled through GMR that computes the conditional distribution p( ξt |t).”
  • The authors state this as an assumption.

    Task parameters can be treated as coordinate frames of reference in this work.

    “In their most general form, these task parameters are represented by sets of affine transformations, but in the context of this work they can be simply considered as coordinate frames of reference,”
  • The authors state this as an assumption.

    If ten data points are counted in each bounding box, the trajectory is taken to satisfy the task constraint.

    “If 10 data points are counted in each bounding box, it is assumed that the trajectory satisfied the task constraint.”
  • The authors state this as an assumption.

    The demonstration data correctly shows how to pick plants from the tray.

    “it is assumed that the demonstration data provides correct information on how to pick the plants from the tray”
  • The authors state this as an assumption.

    If the generated trajectory's local structure, such as the grabbing location relative to the plant, does not closely match the demonstration data, the robot will fail to grasp the plant.

    “and that if the local structure of the generated trajectory (i.e., the grabbing location relative to the plant) does not closely match the demonstration data, then the robot will fail to grasp the plant.”
5 of 5

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Cost weights increase with variability despite the stated objective

    Major

    Equation (10) normalises each covariance by a sum of covariances, so higher-variability points receive larger weights in the quadratic cost. The text says the cost instead gives greater weight to low-variability regions.

  • Reported medians reverse the claimed error reduction

    Minor

    The reported median error for αTP-GMR is 5.0541, which is greater than TP-GMR's 3.4763, not lower. This also conflicts with the paper's claim that the proposed method reduces task error.

  • Figure 3 assigns two methods to panel (b)

    Minor

    The results discussion calls panel (b) mPGMM, whereas the figure caption identifies panel (b) as αTP-GMR and panel (c) as mPGMM.

3 of 3

Cites

Flagged first, then by citations

1 of the 17 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Sena, A., Michael, B., & Howard, M.
Affiliations
King's College London (GB)
Venue
2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Publisher
IEEE
Published
2019-11
Pages
4281-4287
OpenAlex
W2919041517
Cited by
26
References
17
Citations by year
2026: 3 · 2025: 2 · 2024: 7 · 2023: 3 · 2022: 3 · 2021: 6 · 2020: 1
FWCI
4.32
Type
conference paper
Language
en
Open access
Locations
  • IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Research Portal (King's College London) (submittedVersion, cc-by)
  • Research Portal (King's College London) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
Keywords
imitation learning, trajectory generation, Gaussian mixture regression, extrapolation, grasping, manipulation tasks, reaching task, novice users

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review