CoChat
Sign Up
PreprintCited by 2Robot Manipulation and LearningSoft Robotics and ApplicationsReinforcement Learning in Robotics

Untangling Dense Non-Planar Knots by Learning Manipulation Features and Recovery Policies

Open access
Sundaresan, Priya, Grannen, Jennifer, Thananjeyan, Brijen, Balakrishna, Ashwin, Ichnowski, Jeffrey, Novoseller, Ellen, Hwang, Minho, Laskey, Michael +2 more·2021·arXiv
DOI 10.48550/arxiv.2107.08942arXiv 2107.08942
Open this paper in CoChat — free accountOpen PDF

Abstract

Robot manipulation for untangling 1D deformable structures such as ropes, cables, and wires is challenging due to their infinite dimensional configuration space, complex dynamics, and tendency to self-occlude. Analytical controllers often fail in the presence of dense configurations, due to the difficulty of grasping between adjacent cable segments. We present two algorithms that enhance robust cable untangling, LOKI and SPiDERMan, which operate alongside HULK, a high-level planner from prior work. LOKI uses a learned model of manipulation features to refine a coarse grasp keypoint prediction to a precise, optimized location and orientation, while SPiDERMan uses a learned model to sense task progress and apply recovery actions. We evaluate these algorithms in physical cable untangling experiments with 336 knots and over 1500 actions on real cables using the da Vinci surgical robot. We find that the combination of HULK, LOKI, and SPiDERMan is able to untangle dense overhand, figure-eight, double-overhand, square, bowline, granny, stevedore, and triple-overhand knots. The composition of these methods successfully untangles a cable from a dense initial configuration in 68.3% of 60 physical experiments and achieves 50% higher success rates than baselines from prior work. Supplementary material, code, and videos can be found at https://tinyurl.com/rssuntangling.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2107.08942

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Existing systems for fine manipulation use expensive robots and high-end sensors for precise state estimation.

    “Existing systems for fine manipulation use expensive robots and high-end sensors for precise state estimation [30, 64, 33, 43].”

    From Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware (2023) · cites this paper as [64]

    The Experimental Setup (p. 7) describes fine cable manipulation using a bilateral dVRK robot and a high-resolution Zivid RGBD camera. The paper does not characterize the equipment as expensive or say that high-end sensors provide precise state estimation; Deformable Object Manipulation (p. 2) instead says robust state estimation remains challenging for densely knotted cables. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 33

  1. [1][1] Gary Bradski and Adrian Kaehler. Learning OpenCV: Computer vision with the OpenCV library . O'Reilly Media, Inc., 2008. -
  2. [2][2] Mitchell S Cappell. Injury to endoscopic personnel from tripping over exposed cords, wires, and tubing in the endoscopy suite: a preventable cause of potentially severe workplace injury. Digestive diseases and sciences , 55(4):947-951, 2010. -
  3. [3][3] Cheng Chi and Dmitry Berenson. Occlusion-robust deformable object tracking without physics simulation. In 2019 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , pages 6443-6450. IEEE, 2019. -
  4. [4][4] Bruce R Donald. Error detection and recovery in robotics , volume 336. Springer, 1989. -
  5. [5][5] Peter R Florence, Lucas Manuelli, and Russ Tedrake. Dense object nets: Learning dense visual object descriptors by and for robotic manipulation. In Conf. on Robot Learning (CoRL) , 2018. -
  6. [6][6] Aditya Ganapathi, Priya Sundaresan, Brijen Thananjeyan, Ashwin Balakrishna, Daniel Seita, Jennifer Grannen, Minho Hwang, Ryan Hoque, Joseph E Gonzalez, Nawid Jamali, et al. Learning to smooth and fold real fabric using dense object descriptors trained on synthetic color images. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA) , 2021. -
  7. [7][7] Jennifer Grannen, Priya Sundaresan, Brijen Thananjeyan, Jeffrey Ichnowski, Ashwin Balakrishna, Minho Hwang, Vainavi Viswanath, Michael Laskey, Joseph E Gonzalez, and Ken Goldberg. Untangling dense knots by learning task-relevant keypoints. In Conf. on Robot Learning (CoRL) , 2020. -
  8. [8][8] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Identity mappings in deep residual networks. In European conference on computer vision , pages 630-645. Springer, 2016. -
  9. [9][9] Dominik Henrich and Heinz W¨ orn. Robot manipulation of deformable objects . Springer Science & Business Media, 2012. -
  10. [10][10] Ryan Hoque, Daniel Seita, Ashwin Balakrishna, Aditya Ganapathi, Ajay Kumar Tanwani, Nawid Jamali, Katsu Yamane, Soshi Iba, and Ken Goldberg. Visuospatial foresight for multi-step, multi-task fabric manipulation. In Proc. Robotics: Science and Systems (RSS) , 2020. -
  11. [11][11] Minho Hwang, Brijen Thananjeyan, Samuel Paradis, Daniel Seita, Jeffrey Ichnowski, Danyal Fer, Thomas Low, and Ken Goldberg. Efficiently calibrating cable-driven surgical robots with rgbd fiducial sensing and recurrent neural networks. IEEE Robotics and Automation Letters , 5(4): 5937-5944, 2020. -
  12. [12][12] Xin Jiang, Kyong-mo Koo, Kohei Kikuchi, Atsushi Konno, and Masaru Uchiyama. Robotized assembly of a wire harness in a car production line. Advanced Robotics , 25(3-4):473-489, 2011. -
  13. [13][13] Tobias Johannink, Shikhar Bahl, Ashvin Nair, Jianlan Luo, Avinash Kumar, Matthias Loskyll, Juan Aparicio Ojea, Eugen Solowjow, and Sergey Levine. Residual reinforcement learning for robot control. In 2019 International Conference on Robotics and Automation (ICRA) , pages 6023-6029. IEEE, 2019. -
  14. [14][14] Peter Kazanzides, Zihan Chen, Anton Deguet, Gregory S. Fischer, Russell H. Taylor, and Simon P. DiMaio. An open-source research kit for the da Vinci surgical system. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA) , 2014. -
  15. [17][17] sample-efficient policy learning. In 2020 IEEE International Conference on Robotics and Automation (ICRA) , pages 7505-7512. IEEE, 2020. - Robert Lee, Daniel Ward, Akansel Cosgun, Vibhavari Dasagi, Peter Corke, and Jurgen Leitner. Learning arbitrary-goal fabric folding with one hour of real robot experience. In Conf. on Robot Learning (CoRL) , 2020. -
  16. [18][18] Xingyu Lin, Yufei Wang, Jake Olkin, and David Held. SoftGym: Benchmarking deep reinforcement learning for deformable object manipulation. In Conf. on Robot Learning (CoRL) , 2020. -
  17. [19][19] Wen Hao Lui and Ashutosh Saxena. Tangled: Learning to untangle ropes with RGB-D perception. In 2013 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems , pages 837-844. IEEE, 2013. -
  18. [20][20] Jan Matas, Stephen James, and Andrew J Davison. Sim-to-real reinforcement learning for deformable object manipulation. In Conf. on Robot Learning (CoRL) , 2018. -
  19. [21][21] Ashvin Nair, Dian Chen, Pulkit Agrawal, Phillip Isola, Pieter Abbeel, Jitendra Malik, and Sergey Levine. Combining self-supervised learning and imitation for vision-based rope manipulation. In 2017 IEEE Int. Conf. on Robotics and Automation (ICRA) , pages 2146-2153. IEEE, 2017. -
  20. [22][22] Samuel Paradis, Minho Hwang, Brijen Thananjeyan, Jeffrey Ichnowski, Daniel Seita, Danyal Fer, Thomas Low, Joseph E Gonzalez, and Ken Goldberg. Intermittent visual servoing: Efficiently learning policies robust to instrument changes for high-precision surgical manipulation. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA) , 2021. -
  21. [23][23] Daniel S´ anchez, Weiwei Wan, and Kensuke Harada. Tethered tool manipulation planning with cable maneuvering. IEEE Robotics and Automation Letters , 5(2):2777-2784, 2020. -
  22. [24][24] Tanner Schmidt, Richard Newcombe, and Dieter Fox. Self-supervised visual descriptor learning for dense correspondence. IEEE Robotics and Automation Letters , 2(2):420-427, 2016. -
  23. [25][25] Daniel Seita, Aditya Ganapathi, Ryan Hoque, Minho Hwang, Edward Cen, Ajay Kumar Tanwani, Ashwin Balakrishna, Brijen Thananjeyan, Jeffrey Ichnowski, Nawid Jamali, et al. Deep imitation learning of sequential fabric smoothing from an algorithmic supervisor. In Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) , 2020. -
  24. [26][26] Daniel Seita, Pete Florence, Jonathan Tompson, Erwin Coumans, Vikas Sindhwani, Ken Goldberg, and Andy Zeng. Learning to rearrange deformable cables, fabrics, and bags with goal-conditioned transporter networks. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA) , 2021. -
  25. [27][27] Yu She, Shaoxiong Wang, Siyuan Dong, Neha Sunil, Alberto Rodriguez, and Edward Adelson. Cable manipulation with a tactile-reactive gripper. In Proc. Robotics: Science and Systems (RSS) , 2020. -
  26. [28][28] Priya Sundaresan, Jennifer Grannen, Brijen Thananjeyan, Ashwin Balakrishna, Michael Laskey, Kevin Stone, Joseph E Gonzalez, and Ken Goldberg. Learning rope manipulation policies using dense object descriptors trained on synthetic depth data. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA) , 2020. -
  27. [29][29] Satoshi Suzuki et al. Topological structural analysis of digitized binary images by border following. Computer vision, graphics, and image processing , 30(1):32-46, 1985. -
  28. [30][30] Brijen Thananjeyan, Ashwin Balakrishna, Suraj Nair, Michael Luo, Krishnan Srinivasan, Minho Hwang, Joseph E. Gonzalez, Julian Ibarz, Chelsea Finn, and Ken Goldberg. Recovery RL: Safe reinforcement learning with learned recovery zones. Robotics and Automation Letters , 2021. -
  29. [31][31] Jur Van Den Berg, Stephen Miller, Daniel Duckworth, Humphrey Hu, Andrew Wan, Xiao-Yu Fu, Ken Goldberg, and Pieter Abbeel. Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations. In 2010 IEEE International Conference on Robotics and Automation , pages 2074-2081. IEEE, 2010. -
  30. [32][32] Austin S Wang and Oliver Kroemer. Learning robust manipulation strategies with multimodal state transition models and recovery heuristics. In 2019 International Conference on Robotics and Automation (ICRA) , pages 1309-1315. IEEE, 2019. -
  31. [33][33] Mengyuan Yan, Yilin Zhu, Ning Jin, and Jeannette Bohg. Selfsupervised learning of state estimation for manipulating deformable linear objects. IEEE Robotics and Automation Letters , 5(2):2372-2379, 2020. -
  32. [34][34] Wilson Yan, Ashwin Vangipuram, Pieter Abbeel, and Lerrel Pinto. Learning predictive representations for deformable objects using contrastive estimation. In Conf. on Robot Learning (CoRL) , 2020. -
  33. [35][35] Harry Zhang, Jeffrey Ichnowski, Daniel Seita, Jonathan Wang, and Ken Goldberg. Robots of the lost arc: Learning to dynamically manipulate fixed-endpoint ropes and cables. In Proc. IEEE Int. Conf. Robotics and Automation (ICRA) , 2021.

Cited by

Sorted by citations

Authors
Sundaresan, P., Grannen, J., Thananjeyan, B., Balakrishna, A., Ichnowski, J., Novoseller, E., Hwang, M., Laskey, M., Gonzalez, J. E., & Goldberg, K.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2107.08942
arXiv
2107.08942
OpenAlex
W3185401493
Cited by
0
References
0
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords
deformable structures, robotic manipulation, recovery policy, da Vinci surgical robot, figure-eight knot, self-occlusion

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review