CoChat
Sign Up
PreprintCited by 49Robot Manipulation and LearningReinforcement Learning in RoboticsSoft Robotics and Applications

Learning Arbitrary-Goal Fabric Folding with One Hour of Real Robot Experience

Open access
Lee, Robert, Ward, Daniel, Cosgun, Akansel, Dasagi, Vibhavari, Corke, Peter, Leitner, Jurgen·2020·arXiv
DOI 10.48550/arxiv.2010.03209arXiv 2010.03209
Open this paper in CoChat — free accountOpen PDF

Abstract

Manipulating deformable objects, such as fabric, is a long standing problem in robotics, with state estimation and control posing a significant challenge for traditional methods. In this paper, we show that it is possible to learn fabric folding skills in only an hour of self-supervised real robot experience, without human supervision or simulation. Our approach relies on fully convolutional networks and the manipulation of visual inputs to exploit learned features, allowing us to create an expressive goal-conditioned pick and place policy that can be trained efficiently with real world robot data only. Folding skills are learned with only a sparse reward function and thus do not require reward function engineering, merely an image of the goal configuration. We demonstrate our method on a set of towel-folding tasks, and show that our approach is able to discover sequential folding strategies, purely from trial-and-error. We achieve state-of-the-art results without the need for demonstrations or simulation, used in prior approaches. Videos available at: https://sites.google.com/view/learningtofold

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2010.03209

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Cloth flattening and cloth folding can be trained jointly using a uniform goal-conditioned data-driven approach owing to their identical underlying dynamics and similar state, action, goal and policy representations.

    “Cloth flattening and cloth folding can be trained jointly using a uniform goal-conditioned data-driven approach [38,226,229] owing to their identical underlying dynamics as well as the similar state, action, goal and policy representations.”

    From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [229]

    The Introduction (p. 1) describes a goal-conditioned folding policy trained on real-robot data. The Folding Tasks section (p. 6) says the fabric starts each trial already flattened; it does not report jointly training flattening and folding or assert that the tasks have identical dynamics and similar representations. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • Discretising the drag strategy by putting different orientations and pulling distances into bins simplifies the problem and leads to better training, but is less flexible during run time and harder to generalise to other tasks.

    “For example, Lee et al. (2021) [229] discretise the drag strategy by putting different orientations and pulling distances into bins; even though such action space simplifies the problem and leads to better training, it is less flexible during run time and harder to generalise to other tasks.”

    From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [229]

    Section 4.4 (p. 5) says discretising the action space reduces offline-training difficulties, and Section 5.6 (p. 8) says it reduces learning complexity. But Section 5.6 contradicts the claimed loss of runtime flexibility: the method uses finer angle and distance bins at test time without retraining. The paper does not establish that it is harder to generalise to other tasks. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • Only Lee et al. (2021) collect real-world data; most learning-based methods operate in simulated environments, where some apply domain randomisation to achieve Sim2Real.

    “Whilst only Lee et al. (2021) [229] collect real-world data, most learning-based methods operate in simulated environments, where some apply domain randomisation [81] to achieve Sim2Real [38,227,233,237].”

    From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [229]

    Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 32 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. [27][27] M. Andrychowicz, F. Wolski, A. Ray, J. Schneider, R. Fong, P. Welinder, B. McGrew, J. Tobin, O. P. Abbeel, and W. Zaremba. Hindsight experience replay. In Advances in neural information processing systems , pages 5048-5058, 2017. -

Cited by

Sorted by citations

Related

Authors
Lee, R., Ward, D., Cosgun, A., Dasagi, V., Corke, P., & Leitner, J.
Affiliations
  • Queensland University of Technology (AU)
  • Monash University (AU)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Pages
2317-2327
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2010.03209
arXiv
2010.03209
OpenAlex
W3092247831
Cited by
47
References
32
Citations by year
2025: 3 · 2024: 14 · 2023: 11 · 2022: 9 · 2021: 10
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • Monash University Research Portal (Monash University) (submittedVersion, other-oa)
  • QUT ePrints (Queensland University of Technology) (submittedVersion)
  • Figshare (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
Keywords
fabric folding, deformable object manipulation, self-supervised learning, sparse rewards, fully convolutional network, robot skill learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review