Cited by 139Robot Manipulation and LearningReinforcement Learning in RoboticsSoft Robotics and Applications

The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index; none of the 4 sources its claims cite is checked for support yet.

Learning from Demonstrations Through the Use of Non-rigid Registration

Schulman, John, Ho, Jonathan, Lee, Cameron, Abbeel, Pieter·2016·Springer Tracts in Advanced Robotics

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

The paper presents trajectory transfer, a method that adapts a demonstrated end-effector trajectory to a new scene by non-rigidly registering the training point cloud to the test point cloud and warping the trajectory accordingly. It validates the approach mainly by enabling a PR2 robot to tie five knot types from demonstrations, and also shows qualitative results on other manipulation tasks.

Key findings

  • With one demonstration per knot, success under random rope perturbations depended on perturbation size: at \(d_{pert}=3\) cm, success was 5/5 for overhand, figure-eight, and square, 3/5 for double-overhand, and 1/5 for clove hitch; at \(d_{pert}=10\) cm, success was 4/5, 1/5, 3/5, 3/5, and 0/5 respectively.
  • The PR2 autonomously tied five knot types: overhand, figure-eight, double-overhand, square knot, and clove hitch around a pole.
  • For the overhand knot, the authors collected 148 trajectory segments, including 36 demonstrations of the standard 3-step sequence and 40 additional segments starting from failure states; the nearest-neighbor policy was qualitatively able to tie knots from a larger set of initial configurations and recover from failure states.
  • The same algorithm and code were applied to folding a T-shirt, picking up a plate with a two-arm motion, and opening a bottle, with qualitative success reported.

Methods

  • Trajectory transfer: register the training scene point cloud to the test scene point cloud using a modified TPS-RPM non-rigid registration algorithm, then apply the resulting transformation \(f\) to demonstrated end-effector positions and use the Jacobian \(Jf(p)\) to transform orientations.
  • Convert the transferred end-effector trajectory into a joint trajectory by solving an optimization problem that trades off smoothness, end-effector pose error, collision avoidance, and joint limits, using the trajectory optimization method from Schulman et al. and initializing from the demonstration.
  • For multi-step tasks, repeatedly choose the nearest demonstration by registration cost, apply trajectory transfer, and execute the resulting trajectory; experiments used a PR2 with kinesthetic teaching and RGBD point clouds, with rope points extracted by color filtering.

Limitations

  • The paper states that the cost-function invariance assumption in Equation (7) is strong and can fail even for rigid transformations, for example when absolute end-effector orientation matters.
  • The paper states that dynamics covariance holds only approximately in knot tying and was checked qualitatively by comparing final rope states at training and test time.
  • The paper reports only qualitative results for the many-demonstration overhand knot policy and for the other manipulation tasks; no quantitative success rates are given for those settings. The single-demonstration results also show low success for clove hitch and for larger perturbations.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/978-3-319-28872-7_20

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

13 Own result · 12 Own interpretation · 3 No full text of the sources · 1 No basis given

Show all 19 claims

  • It may state two separate claims as one. 5
  • The quote only partly states this claim. 1
  • Probably not a substantial claim. 4
10 of 10
  • The authors state this as an assumption.

    The demonstrator has provided examples of the failure states along with the corrective motions that get out of them.

    “This policy recovers from failures, assuming that the demonstrator has provided examples of the failure states along with the corrective motions that get out of them.”
  • The authors state this as an assumption.

    There exists a class of smooth transformations f such that L(STATE, TRAJ) = L(f(STATE), f(TRAJ)).

    “Our trajectory transfer procedure can be justified by assuming that there is a class of smooth transformations f with the following property:”
  • The authors state this as an assumption.

    The dynamics of the system are covariant under the transformation f (Equation 10 holds).

    “4. Equation (10) holds, i.e., the dynamics are covariant under f .”
  • The authors state this as an assumption.

    The goal set is preserved by f (f(G)=G).

    “3. f ( G ) = G , i.e., the goal set is preserved by f”
  • The authors state this as an assumption.

    f transforms STATE_train into STATE_test (f(STATE_train)=STATE_test).

    “1. f ( STATE t train ) = STATE t test , i.e., f transforms STATE train into STATEtest.”
  • The authors state this as an assumption.

    The demonstration ends up in the goal state (STATE_{t+1}^{train} ∈ G).

    “2. STATE t + 1 train ∈ G , i.e., the demonstration ends up in the goal state.”
  • The paper relies on this without support.

    For each segment, the end-effector trajectory depends on the geometry of the rope in some way that must be inferred by the algorithm.

    “For each of these segments, the end-effector trajectory ought to depend on the geometry of the rope in some way that must be inferred by the algorithm.”
  • The paper relies on this without support.

    The procedure for tying a given type of knot can be broken into several segments based on grab and release events.

    “The procedure for tying a given type of knot can be broken into several segments based on grab and release events.”
8 of 8

Citations

Cites

Show all 31 references

Cited by

Sorted by citations

Items 101–139 of 139

Metadata

Authors
Schulman, J., Ho, J., Lee, C., & Abbeel, P.
Affiliations
University of California, Berkeley (US)
Corresponding author
Schulman, John
Venue
Springer Tracts in Advanced Robotics
Published
2016
Pages
339-354
ISSN
  • 1610-742X (ISSN-L)
  • 1610-7438
OpenAlex
W2472053385
Cited by
133
References
31
Citations by year
2026: 1 · 2025: 4 · 2024: 4 · 2023: 9 · 2022: 14 · 2021: 15 · 2020: 18 · 2019: 12 · 2018: 18 · 2017: 13 · 2016: 6
FWCI
38.92
Type
book chapter
Language
en
Open access
closed
Locations
Springer tracts in advanced robotics (publishedVersion)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
Keywords
imitation learning, non-rigid registration, robotic manipulation, multi-step tasks, PR2 robot, knot tying, rope manipulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review