Using depth and appearance features for informed robot grasping of highly wrinkled clothes
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Detecting grasping points is a key problem in cloth manipulation. Most current approaches follow a multiple re-grasp strategy for this purpose, in which clothes are sequentially grasped from different points until one of them yields to a desired configuration. In this paper, by contrast, we circumvent the need for multiple re-graspings by building a robust detector that identifies the grasping points, generally in one single step, even when clothes are highly wrinkled. In order to handle the large variability a deformed cloth may have, we build a Bag of Features based detector that combines appearance and 3D geometry features. An image is scanned using a sliding window with a linear classifier, and the candidate windows are refined using a non-linear SVM and a “grasp goodness” criterion to select the best grasping point. We demonstrate our approach detecting collars in deformed polo shirts, using a Kinect camera. Experimental results show a good performance of the proposed method not only in identifying the same trained textile object part under severe deformations and occlusions, but also the corresponding part in other clothes, exhibiting a degree of generalization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Maitin-Shepard, J., Cusumano-Towner, M., Lei, J., & Abbeel, P. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509439 · Cited by 418 · cited 1×
“In [3] the authors designed a cloth grasping-point selection system to autonomously take elements from a pile of washed towels and fold and stack them using a Willow Garage PR2 robot.”
Method
Cited by
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Data-Driven Grasp Synthesis—A Survey
Bohg, J., Morales, A., Asfour, T., & Kragic, D. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2289018 · Cited by 929
Sanchez, J., Corrales, J.-A., Bouzgarrou, B.-C., & Mezouar, Y. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918779698 · Cited by 457
Doumanoglou, A., Kargakos, A., Kim, T.-K., & Malassiotis, S. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6906974 · Cited by 123
“Later, research has been made in garment modelling and feature extraction [2] [3], while only recently scientists were able to completely fold an article of clothing starting from a crumpled initial configuration [4] [5] [2].”
BackgroundFolding clothes autonomously: A complete pipeline
Doumanoglou, A., Stria, J., Peleka, G., Mariolis, I., Petrik, V., Kargakos, A., Wagner, L., Hlavac, V., Kim, T.-K., & Malassiotis, S. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2602376 · Cited by 122
“They fit a predefined polygonal model to the contour of the observed spread garment to recognize its pose and category (by fitting multiple models for various types of clothes).”
BackgroundMethodA Heuristic-Based Approach for Flattening Wrinkled Clothes
Sun, L., Aragon-Camarasa, G., Cockshott, P., Rogers, S., & Siebert, J. P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-662-43645-5_16 · Cited by 43
“Wrinkledness, as defined in [5], shows conic and pyramidal structures and these properties can be detected in a range image to allow a robot to disambiguate the current state of the cloth when several wrinkles are observed simultaneously.”
BackgroundKoganti, N., Tamei, T., Matsubara, T., & Shibata, T. (2014) · The 23rd IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2014.6926241 · Cited by 24
Cloth dynamics modeling in latent spaces and its application to robotic clothing assistance
Koganti, N., Ngeo, J. G., Tomoya, T., Ikeda, K., & Shibata, T. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353860 · Cited by 23
“[17] detected the best grasping point in clothes lying on a horizontal surface to avoid multiple regraspings by using Bag of Features based detector to handle large variations in the shape of clothing material.”
MethodKadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
Metadata
- Authors
- Ramisa, A., Alenya, G., Moreno-Noguer, F., & Torras, C.
- Venue
- 2012 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2012-05
- Pages
- 1703-1708
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2133353747
- Cited by
- 124
- References
- 3
- FWCI
- 18.02
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.