Modeling, learning, perception, and control methods for deformable object manipulation
Open accessThe DOI matches its Crossref record; 124 of the 124 references it cites were found in a registry or an index.
Abstract
Enabling robots to handle deformable objects requires careful integration of data-driven and analytic approaches.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the long-term impact of these materials on the human body remains an uncertainty limiting the actual long-term commercial application of the devices in HMI.”
From Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics (2022) · cites this paper as [608]
In the citing paper
“IP in the context of deformable objects has mainly been considered using a static camera [7].”
From Interactive Perception for Deformable Object Manipulation (2024) · cites this paper as [7]
Citations
Cites
Trends and challenges in robot manipulation
Billard, A., & Kragic, D. (2019) · Science · doi:10.1126/science.aat8414 · Cited by 993
DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time
Newcombe, R. A., Fox, D., & Seitz, S. M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298631 · Cited by 951 · cited 2×
“If a canonical template is not available, it can be iteratively updated (55).”
BackgroundControl Strategies for Soft Robotic Manipulators: A Survey
George Thuruthel, T., Ansari, Y., Falotico, E., & Laschi, C. (2018) · Soft Robotics · doi:10.1089/soro.2017.0007 · Cited by 645
Dual arm manipulation—A survey
Smith, C., Karayiannidis, Y., Nalpantidis, L., Gratal, X., Qi, P., Dimarogonas, D. V., & Kragic, D. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.07.005 · Cited by 560 · cited 1×
“Still, problems remain open on how to account for the coordination and cooperation, for instance, of a bimanual system ( 127 ).”
BackgroundSOFA: A Multi-Model Framework for Interactive Physical Simulation
Faure, F., Duriez, C., Delingette, H., Allard, J., Gilles, B., Marchesseau, S., Talbot, H., Courtecuisse, H., Bousquet, G., Peterlik, I., et al. (2012) · Studies in Mechanobiology, Tissue Engineering and Biomaterials · doi:10.1007/8415_2012_125 · Cited by 460
Sanchez, J., Corrales, J.-A., Bouzgarrou, B.-C., & Mezouar, Y. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918779698 · Cited by 457
Discovery of complex behaviors through contact-invariant optimization
Mordatch, I., Todorov, E., & Popović, Z. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185539 · Cited by 451 · cited 1×
“MuJoCo is a proprietary engine that has been used for modeling rigid-linked characters ( 30 ) or as the environment backend of re-inforcement learning (RL) benchmarks ( 31 ).”
MethodUnified particle physics for real-time applications
Macklin, M., Müller, M., Chentanez, N., & Kim, T.-Y. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601152 · Cited by 447 · cited 3×
“Ropes (13, 14, 15) Fabrics (16, 17) Simple to implement Lacking physical interpretability Sponges (17, 18) Rubber spheres (18 where k j denotes the stiffness of the j th constraint C j ( x 1 , x 2 , …, x n ) = 0, j = 1,2, ….”
BackgroundMaitin-Shepard, J., Cusumano-Towner, M., Lei, J., & Abbeel, P. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509439 · Cited by 418 · cited 1×
“Early works on folding detects corners for grasping (74).”
BackgroundReal-time non-rigid reconstruction using an RGB-D camera
Zollhöfer, M., Nießner, M., Izadi, S., Rehmann, C., Zach, C., Fisher, M., Wu, C., Fitzgibbon, A., Loop, C., Theobalt, C., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601165 · Cited by 405
Research works printed but not linked: 6
- Y. Li J. Wu R. Tedrake J. B. Tenenbaum A. Torralba Learning particle dynamics for manipulating rigid bodies deformable objects and fluids in Proceedings of the International Conference on Learning Representations (ICLR) (ICLR 2019).
- P. Giiler K. Pauwels A. Pieropan H. Kjellström D. Kragic Estimating the deformability of elastic materials using optical flow and position-based dynamics in Proceedings of IEEE International Conference on Humanoid Robots (Humanoids) (IEEE 2015) pp. 965–971.
- G. Brockman V. Cheung L. Pettersson J. Schneider J. Schulman J. Tang W. Zaremba OpenAI Gym. arXiv:1606.01540 [cs.LG] (5 June 2016). · arXiv
- J. Grannen P. Sundaresan B. Thananjeyan J. Ichnowski A. Balakrishna M. Hwang V. Viswanath M. Laskey J. E. Gonzalez K. Goldberg Untangling dense knots by learning task relevant keypoints in Proceedings of the Conference on Robot Learning (CoRL) (PMLR 2020).
- D. Seita N. Jamali M. Laskey A. K. Tanwani R. Berenstein P. Baskaran S. Iba J. Canny K. Goldberg Deep transfer learning of pick points on fabric for robot bed-making in International Symposium on Robotics Research (ISRR) (2019).
- J. Liang M. Lin V. Koltun Differentiable cloth simulation for inverse problems in Advances in Neural Information Processing Systems 32 (Curran Associates Inc. 2019) pp. 771–780.
Cited by
Items 301–326 of 326
Tao, Y., Gao, H., Ren, F., Chen, Y., Feng, Y., Fu, W., Zheng, P., Leng, J., & Wei, H. (2026) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2026.103377
Domestic robots: recent trends and innovations
Kumar, C. S., Thomas, M. J., Thomas, N. P., & Kotwani, V. S. (2026) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2026.2702778
Multi-Arm Collaborative On-Orbit Manipulation of Multi-Layer Insulation Materials
Qingsheng, W. E. I., Li, J., Yuejian, W. A. N. G., Yueyang, W. A. N. G., Zhao, Y., Sun, S., & Wei, C. (2026) · Aerospace Science and Technology · doi:10.1016/j.ast.2026.113310
Bao, N., Wang, K., Simeone, A., Fan, Y., Xiang, Q., Liang, Y., & Bao, R. (2026) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-026-02941-0
ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects
Hwang, D., Song, M., & Park, D. (2026) · International Conference on Ubiquitous Robots (UR) · doi:10.1109/ur69537.2026.11626678
“Deformable object manipulation (DOM) is a fundamental yet challenging problem in robotics [1], [2], [3].”
Zhang, Z., Mao, J., Tan, H., Wang, Y., & Wei, J. (2026) · Youth Academic Annual Conference of Chinese Association of Automation (YAC) · doi:10.1109/yac71005.2026.11615469
“Recent advances in deformable-object manipulation have highlighted the importance of modeling, perception, and con-trol for flexible objects [12].”
Wang, Z., Wang, L., Yin, X., Weng, Z., Duan, Y., Xie, J., Xue, C., & Dai, Z. (2026) · Soft Science · doi:10.20517/ss.2026.69
Constrained Actor-Critic Reinforcement Learning for Deformable Object Visual Shape Servoing
Guthikonda, V. R., Bhattacharya, R., & Dani, A. P. (2026) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2026.3721045
“Many contributions in the literature have focused on the VSS problem [1], [2], [3], [4]; however, few have designed optimal controllers on reduced-dimensional state representation while satisfying physical constraints.”
SOPCC: Deformation-Aware Point Cloud Completion for Flexible Sheet-Like Objects
Li, X., Zhao, Z., Shen, C., Ju, C., & Namiki, A. (2026) · IEEE International Conference on Mechatronics and Automation (ICMA) · doi:10.1109/icma69663.2026.11647606
“Perception of deformable objects remains challenging in robotics [10].”
Yu, P., Chen, A., Li, H., & Zhang, X. (2026) · International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS) · doi:10.1109/marss70227.2026.11655750
“This strong geometric nonlinearity can induce configuration drift and assembly errors, making accurate full-field deformation sensing critical for reliable manipulation [2]–[4].”
Wu, W., Chen, J., Ouyang, H., Xiao, Z., Huang, Q., & Tan, J. (2026) · Measurement Science and Technology · doi:10.1088/1361-6501/ae9da5
“Normal, curvature, RANSAC, clustering, convex-hull, and polynomial operators are established [13, 30, 31].”
Mirto, M., Caporali, A., Gosar, Ž., Pirozzi, S., & Palli, G. (2026) · IEEE/ASME International Conference on Advanced Intelligent Mechatronics · doi:10.1109/aim65483.2026.11658157
Haoyu, Z. H. A. O., Funabashi, S., Wang, Y., Miyake, T., Guo, Z., Chien, P.-C., Ikeda, Y., Matsumoto, O., Ogata, T., & Sugano, S. (2026) · IEEE/ASME International Conference on Advanced Intelligent Mechatronics · doi:10.1109/aim65483.2026.11658387
“Deep learning has broadened the study of deformable object manipulation from ropes to cables and cloth [19], [20].”
Fast and interactive inverse simulation supporting human-robot deformable object manipulation *
Koessler, A., Raharijaona, T., & Courtecuisse, H. (2026) · IEEE/ASME International Conference on Advanced Intelligent Mechatronics · doi:10.1109/aim65483.2026.11658102
“As shown by several review articles, deformable object manipulation (DOM) is a topical, yet challenging subject in the field [1]–[3].”
Zhu, X., Zhang, Z., & Meng, F. (2026) · Cogent Engineering · doi:10.1080/23311916.2026.2720090
From Physics to Execution: A Dual-Arm Framework for Rigid–Flexible Medical-Device Assembly
Bin, Y., Patsavellas, J., & Salonitis, K. (2026) · Procedia CIRP · doi:10.1016/j.procir.2026.03.184
Liu, X., & Han, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37335-9_24
“Understanding the intrinsic dynamics of objects is crucial for spatial intelligence, enabling accurate digital modeling, interaction, and manipulation that follows physical laws [3,26,40,53].”
Hussain, S., Tavakoli, M., Siciliano, B., & Ficuciello, F. (2026) · IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob) · doi:10.1109/biorob66782.2026.11681321
“Despite their practicality, MSD models often rely on manually tuned stiffness and damping parameters, which limits their physical fidelity under large deformations, nonlinear stress-strain responses, and contact-rich interactions [13].”
Hybrid Geometric and Latent Shape Servoing for Autonomous Gallbladder Exposure
Hu, J., Jones, D., & Valdastri, P. (2026) · IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob) · doi:10.1109/biorob66782.2026.11681351
“[1] Physics-based approaches, such as those relying on the Finite Element Method (FEM) [2] or Mass-Spring Systems, offer theoretical rigour by simulating tissue mechanics.”
RGB-based line segment detection and processing for fabric corner recognition and robotic grasping
郝子悦, Liu, Z., Yang, S., Pan, F., & Wang, X. (2026) · Robotica · doi:10.1017/s0263574726103889
Adaptive In-Hand Manipulation: Design of a Contact-Aware Modular Robot Finger with Active Surfaces
Ling, T., Li, W., Xi, Z., Yang, M., Bai, P., Xue, L., & Li, G. (2026) · International Conference on Mechanical, Electronics and Electrical and Automation Control (METMS) · doi:10.1109/metms70800.2026.11706060
“…experiments focus on representative objects that directly correspond to the proposed manipulation sequence, robotic manipulation of soft, irregular, multi-faceted, and thin deformable objects remains a challenging topic involving coupled issues of modeling, perception, and control [27], [28].”
Jeong, C., Hwang, M.-H., & Kim, E. (2026) · Asian Control Conference (ASCC) · doi:10.1109/ascc70886.2026.11702438
“Historically, autonomous cleaning has been studied primarily in domestic and service contexts, ranging from early floor-cleaning prototypes [1] to coverage-planning approaches for non-trivial 3D surfaces [2] and, more recently, learning-based wiping policies [3], [4].”
Jeong, C., Hwang, M.-H., & Kim, E. (2026) · Asian Control Conference (ASCC) · doi:10.1109/ascc70886.2026.11702409
“Historically, autonomous cleaning has been studied primarily in domestic and service contexts, ranging from early floor-cleaning prototypes [1] to coverage-planning approaches for non-trivial 3D surfaces [2] and, more recently, learning-based wiping policies [3], [4].”
Segmentation of multiple deformable linear objects for robot manipulation
Wang, J., Yang, H., Sheng, Z., Lai, X., & Zhang, T. (2026) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2026.109144
Wang, J., Yang, H., Lai, X., Sheng, Z., & Song, P. (2026) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2026.105819
Multi-agent path planning and reinforcement learning for wire harness handling
Streloke, L., Peyerl, M., Franke, J., & Bründl, P. (2026) · Frontiers in Mechanical Engineering · doi:10.3389/fmech.2026.1910151
Metadata
- Authors
- Yin, H., Varava, A., & Kragic, D.
- Affiliations
- KTH Royal Institute of Technology (SE)
- Robotics, Perception, and Learning (RPL), School of Electrical Engineering and Computer Science, Royal Institute for Technology (KTH), Stockholm, Sweden.
- Corresponding author
- Yin, Hang
- Venue
- Science Robotics
- Published
- 2021-05-12
- Volume
- 6
- Issue
- 54
- ISSN
- 2470-9476 (ISSN-L)
- OpenAlex
- W3164946289
- Cited by
- 299
- References
- 124
- Citations by year
- 2026: 56 · 2025: 73 · 2024: 70 · 2023: 55 · 2022: 39 · 2021: 6
- FWCI
- 5.76
- Type
- journal article
- Language
- en
- Open access
- green
- urn.kb.se
- Licence
- other-oa
- Locations
- Science Robotics (publishedVersion)
- PubMed (publishedVersion)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- Funders
- H2020 European Research Council
- Swedish Foundation for Strategic Research
- Knut och Alice Wallenbergs Stiftelse
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- deformable object manipulation, robotic manipulation, data-driven learning, model priors, simulation environment, benchmarking, food handling, planning, control
- MeSH terms
- Computer Simulation, Humans, Learning, Perception, Robotics, Physical Phenomena, Mechanical Phenomena
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.