Modeling, learning, perception, and control methods for deformable object manipulation
Open accessThe DOI matches its Crossref record; 124 of the 124 references it cites were found in a registry or an index.
Abstract
Enabling robots to handle deformable objects requires careful integration of data-driven and analytic approaches.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the long-term impact of these materials on the human body remains an uncertainty limiting the actual long-term commercial application of the devices in HMI.”
From Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics (2022) · cites this paper as [608]
In the citing paper
“IP in the context of deformable objects has mainly been considered using a static camera [7].”
From Interactive Perception for Deformable Object Manipulation (2024) · cites this paper as [7]
Citations
Cites
Trends and challenges in robot manipulation
Billard, A., & Kragic, D. (2019) · Science · doi:10.1126/science.aat8414 · Cited by 993
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Newcombe, R. A., Fox, D., & Seitz, S. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298631 · Cited by 951 · cited 2×
“If a canonical template is not available, it can be iteratively updated (55).”
BackgroundControl Strategies for Soft Robotic Manipulators: A Survey
George Thuruthel, T., Ansari, Y., Falotico, E., & Laschi, C. (2018) · Soft Robotics · doi:10.1089/soro.2017.0007 · Cited by 645
Dual arm manipulation—A survey
Smith, C., Karayiannidis, Y., Nalpantidis, L., Gratal, X., Qi, P., Dimarogonas, D. V., & Kragic, D. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.07.005 · Cited by 560 · cited 1×
“Still, problems remain open on how to account for the coordination and cooperation, for instance, of a bimanual system ( 127 ).”
BackgroundSOFA: A Multi-Model Framework for Interactive Physical Simulation
Faure, F., Duriez, C., Delingette, H., Allard, J., Gilles, B., Marchesseau, S., Talbot, H., Courtecuisse, H., Bousquet, G., Peterlik, I., et al. (2012) · Studies in Mechanobiology, Tissue Engineering and Biomaterials · doi:10.1007/8415_2012_125 · Cited by 460
Sanchez, J., Corrales, J.-A., Bouzgarrou, B.-C., & Mezouar, Y. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918779698 · Cited by 457
Discovery of complex behaviors through contact-invariant optimization
Mordatch, I., Todorov, E., & Popović, Z. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185539 · Cited by 451 · cited 1×
“MuJoCo is a proprietary engine that has been used for modeling rigid-linked characters ( 30 ) or as the environment backend of re-inforcement learning (RL) benchmarks ( 31 ).”
MethodUnified particle physics for real-time applications
Macklin, M., Müller, M., Chentanez, N., & Kim, T.-Y. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601152 · Cited by 447 · cited 3×
“Ropes (13, 14, 15) Fabrics (16, 17) Simple to implement Lacking physical interpretability Sponges (17, 18) Rubber spheres (18 where k j denotes the stiffness of the j th constraint C j ( x 1 , x 2 , …, x n ) = 0, j = 1,2, ….”
BackgroundMaitin-Shepard, J., Cusumano-Towner, M., Lei, J., & Abbeel, P. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509439 · Cited by 418 · cited 1×
“Early works on folding detects corners for grasping (74).”
BackgroundReal-time non-rigid reconstruction using an RGB-D camera
Zollhöfer, M., Nießner, M., Izadi, S., Rehmann, C., Zach, C., Fisher, M., Wu, C., Fitzgibbon, A., Loop, C., Theobalt, C., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601165 · Cited by 405
Research works printed but not linked: 6
- Y. Li J. Wu R. Tedrake J. B. Tenenbaum A. Torralba Learning particle dynamics for manipulating rigid bodies deformable objects and fluids in Proceedings of the International Conference on Learning Representations (ICLR) (ICLR 2019).
- P. Giiler K. Pauwels A. Pieropan H. Kjellström D. Kragic Estimating the deformability of elastic materials using optical flow and position-based dynamics in Proceedings of IEEE International Conference on Humanoid Robots (Humanoids) (IEEE 2015) pp. 965–971.
- G. Brockman V. Cheung L. Pettersson J. Schneider J. Schulman J. Tang W. Zaremba OpenAI Gym. arXiv:1606.01540 [cs.LG] (5 June 2016). · arXiv
- J. Grannen P. Sundaresan B. Thananjeyan J. Ichnowski A. Balakrishna M. Hwang V. Viswanath M. Laskey J. E. Gonzalez K. Goldberg Untangling dense knots by learning task relevant keypoints in Proceedings of the Conference on Robot Learning (CoRL) (PMLR 2020).
- D. Seita N. Jamali M. Laskey A. K. Tanwani R. Berenstein P. Baskaran S. Iba J. Canny K. Goldberg Deep transfer learning of pick points on fabric for robot bed-making in International Symposium on Robotics Research (ISRR) (2019).
- J. Liang M. Lin V. Koltun Differentiable cloth simulation for inverse problems in Advances in Neural Information Processing Systems 32 (Curran Associates Inc. 2019) pp. 771–780.
Cited by
Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics
Heng, W., Solomon, S., & Gao, W. (2022) · Advanced Materials · doi:10.1002/adma.202107902 · Cited by 609
Challenges and Outlook in Robotic Manipulation of Deformable Objects
Zhu, J., Cherubini, A., Dune, C., Navarro-Alarcon, D., Alambeigi, F., Berenson, D., Ficuciello, F., Harada, K., Kober, J., Li, X., et al. (2022) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2022.3147415 · Cited by 265
“Lately, [11] reports most recent advances in modeling, learning, perception, and control in DOM.”
BackgroundVisualization in virtual reality: a systematic review
Korkut, E. H., & Surer, E. (2023) · Virtual Reality · doi:10.1007/s10055-023-00753-8 · Cited by 178
“To this end, researchers are still working to improve accuracy, robustness, and processing efficiency while keeping high-fidelity renderings (Yin et al. 2021).”
BackgroundData-Driven Control of Hydraulic Manipulators by Reinforcement Learning
Yao, Z., Xu, F., Jiang, G., & Yao, J. (2023) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2023.3336070 · Cited by 99
“R obotic manipulators have garnered substantial attention in both industrial and academic circles, largely driven by the pressing need to replace human labor in critical work environments [1], [2].”
BackgroundYu, M., Lv, K., Zhong, H., Song, S., & Li, X. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3200546 · Cited by 116
“Some analytical modeling methods can be used to model DLOs, such as mass–spring systems, position-based dynamics, and finite-element methods [2], [15].”
BackgroundMethod
Metadata
- Authors
- Yin, H., Varava, A., & Kragic, D.
- Affiliations
- KTH Royal Institute of Technology (SE)
- Robotics, Perception, and Learning (RPL), School of Electrical Engineering and Computer Science, Royal Institute for Technology (KTH), Stockholm, Sweden.
- Corresponding author
- Yin, Hang
- Venue
- Science Robotics
- Published
- 2021-05-12
- Volume
- 6
- Issue
- 54
- ISSN
- 2470-9476 (ISSN-L)
- OpenAlex
- W3164946289
- Cited by
- 299
- References
- 124
- Citations by year
- 2026: 56 · 2025: 73 · 2024: 70 · 2023: 55 · 2022: 39 · 2021: 6
- FWCI
- 5.76
- Type
- journal article
- Language
- en
- Open access
- green
- urn.kb.se
- Licence
- other-oa
- Locations
- Science Robotics (publishedVersion)
- PubMed (publishedVersion)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- Funders
- H2020 European Research Council
- Swedish Foundation for Strategic Research
- Knut och Alice Wallenbergs Stiftelse
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- deformable object manipulation, robotic manipulation, data-driven learning, model priors, simulation environment, benchmarking, food handling, planning, control
- MeSH terms
- Computer Simulation, Humans, Learning, Perception, Robotics, Physical Phenomena, Mechanical Phenomena
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.