The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Challenges and Outlook in Robotic Manipulation of Deformable Objects
Open accessAbstract
Deformable object manipulation (DOM) is an emerging research problem in robotics. The ability to manipulate deformable objects endows robots with higher autonomy and promises new applications in the industrial, services, and health-care sectors. However, compared to rigid object manipulation, the manipulation of deformable objects is considerably more complex and is still an open research problem. Addressing DOM challenges demands breakthroughs in almost all aspects of robotics: hardware design, sensing, (deformation) modeling, planning, and control. In this article, we review recent advances and highlight the main challenges when considering deformation in each subfield. A particular focus of our article lies in the discussions of these challenges and proposing future directions of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force
Yuan, W., Dong, S., & Adelson, E. (2017) · Sensors · doi:10.3390/s17122762 · Cited by 1,166
Self-citationOptoelectronically innervated soft prosthetic hand via stretchable optical waveguides
Zhao, H., O’Brien, K., Li, S., & Shepherd, R. F. (2016) · Science Robotics · doi:10.1126/scirobotics.aai7529 · Cited by 982
Interaction Networks for Learning about Objects, Relations and Physics
Battaglia, P. W., Pascanu, R., Lai, M., Rezende, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1612.00222 · Cited by 969 · cited 1×
“Moreover, they can incorporate physics models and reason about object interaction [48].”
BackgroundSanchez, J., Corrales, J.-A., Bouzgarrou, B.-C., & Mezouar, Y. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918779698 · Cited by 457
Ultragentle manipulation of delicate structures using a soft robotic gripper
Sinatra, N. R., Teeple, C. B., Vogt, D. M., Parker, K. K., Gruber, D. F., & Wood, R. J. (2019) · Science Robotics · doi:10.1126/scirobotics.aax5425 · Cited by 356
Bajcsy, R., Aloimonos, Y., & Tsotsos, J. K. (2018) · Autonomous Robots · doi:10.1007/s10514-017-9615-3 · Cited by 328
Modeling, learning, perception, and control methods for deformable object manipulation
Yin, H., Varava, A., & Kragic, D. (2021) · Science Robotics · doi:10.1126/scirobotics.abd8803 · Cited by 299 · cited 1×
“Lately, [11] reports most recent advances in modeling, learning, perception, and control in DOM.”
BackgroundCombining self-supervised learning and imitation for vision-based rope manipulation
Nair, A., Chen, D., Agrawal, P., Isola, P., Abbeel, P., Malik, J., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989247 · Cited by 255
A Dexterous Soft Robotic Hand for Delicate In-Hand Manipulation
Abondance, S., Teeple, C. B., & Wood, R. J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3007411 · Cited by 253
Software toolkit for modeling, simulation, and control of soft robots
Coevoet, E., Morales-Bieze, T., Largilliere, F., Zhang, Z., Thieffry, M., Sanz-Lopez, M., Carrez, B., Marchal, D., Goury, O., Dequidt, J., et al. (2017) · Advanced Robotics · doi:10.1080/01691864.2017.1395362 · Cited by 244
Interactive Perception: Leveraging Action in Perception and Perception in Action
Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragić, D., Schaal, S., & Sukhatme, G. (2017) · MPG.PuRe (Max Planck Society) · Cited by 242
Cable manipulation with a tactile-reactive gripper
She, Y., Wang, S., Dong, S., Sunil, N., Rodriguez, A., & Adelson, E. (2021) · The International Journal of Robotics Research · doi:10.1177/02783649211027233 · Cited by 242
A geometric approach to robotic laundry folding
Miller, S., van den Berg, J., Fritz, M., Darrell, T., Goldberg, K., & Abbeel, P. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911430417 · Cited by 241
Interactive perception: Leveraging action in perception and perception in action
Bohg, J., Hausman, K., Sankaran, B., Brock, O., Kragic, D., Schaal, S., & Sukhatme, G. S. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2721939 · Cited by 227 · cited 1×
“A promising direction to deal with occlusion and noise is using active/interactive perception [38], [39].”
BackgroundChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics
Hu, Y., Liu, J., Spielberg, A., Tenenbaum, J. B., Freeman, W. T., Wu, J., Rus, D., & Matusik, W. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794333 · Cited by 226
Repeatable Folding Task by Humanoid Robot Worker Using Deep Learning
Yang, P.-C., Sasaki, K., Suzuki, K., Kase, K., Sugano, S., & Ogata, T. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2633383 · Cited by 221
Learning to Manipulate Deformable Objects without Demonstrations
Wu, Y., Yan, W., Kurutach, T., Pinto, L., & Abbeel, P. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.065 · Cited by 173
Deep reinforcement learning with smooth policy update: Application to robotic cloth manipulation
Tsurumine, Y., Cui, Y., Uchibe, E., & Matsubara, T. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.11.004 · Cited by 168
Self-Supervised Learning of State Estimation for Manipulating Deformable Linear Objects
Yan, M., Zhu, Y., Jin, N., & Bohg, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2969931 · Cited by 165
Active Clothing Material Perception Using Tactile Sensing and Deep Learning
Yuan, W., Mo, Y., Wang, S., & Adelson, E. H. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461164 · Cited by 154
Self-citationSurvey on model-based manipulation planning of deformable objects
Jiménez, P. (2011) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2011.08.002 · Cited by 151
Navarro-Alarcón, D., & Liu, Y. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2765333 · Cited by 147
Learning force-based manipulation of deformable objects from multiple demonstrations
Lee, A. X., Lu, H., Gupta, A., Levine, S., & Abbeel, P. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7138997 · Cited by 140
SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulation
Lin, X., Wang, Y., Olkin, J., & Held, D. (2020) · arXiv · doi:10.48550/arxiv.2011.07215 · Cited by 140
Deep Reinforcement Learning for Robotic Assembly of Mixed Deformable and Rigid Objects
Luo, J., Solowjow, E., Wen, C., Ojea, J. A., & Agogino, A. M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594353 · Cited by 137
Modeling of deformable objects for robotic manipulation: A tutorial and review
Arriola-Rios, V. E., Guler, P., Ficuciello, F., Kragic, D., Siciliano, B., & Wyatt, J. L. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00082 · Cited by 126
Self-citation3-D Deformable Object Manipulation Using Deep Neural Networks
Hu, Z., Han, T., Sun, P., Pan, J., & Manocha, D. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2930476 · Cited by 118
Self-citationOptimization-Based Inverse Model of Soft Robots With Contact Handling
Coevoet, E., Escande, A., & Christian Duriez, A. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2669367 · Cited by 109
A Grasping-Centered Analysis for Cloth Manipulation
Borràs, J., Alenyà, G., & Carme Torras, A. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.2986921 · Cited by 108
Reinforcement learning of clothing assistance with a dual-arm robot
Tamei, T., Matsubara, T., Rai, A., & Shibata, T. (2011) · 2011 11th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/humanoids.2011.6100915 · Cited by 103
Robotic Manipulation Planning for Shaping Deformable Linear Objects WithEnvironmental Contacts
Zhu, J., Navarro, B., Passama, R., Fraisse, P., Crosnier, A., & Cherubini, A. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2944304 · Cited by 97
Self-citationVogt, D. M., Becker, K. P., Phillips, B., Graule, M. A., Rotjan, R., Shank, T. M., Cordes, E. E., Wood, R. J., & Gruber, D. F. (2018) · PLoS ONE · doi:10.1371/journal.pone.0200386 · Cited by 95
Sun, L., Aragón-Camarasa, G., Rogers, S., & Siebert, J. P. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7138998 · Cited by 94
Learning to dress: Synthesizing human dressing motion via deep reinforcement learning
Clegg, A., Yu, W., Tan, J., Liu, C. K., & Turk, G. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275048 · Cited by 89
Survey on multi-robot manipulation of deformable objects
Herguedas, R., Nicolás, G. L., Aragüés, R., & Sagüés, C. (2019) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa.2019.8868987 · Cited by 85
Multi-Modal Sensing and Robotic Manipulation of Non-Rigid Objects: A Survey
Nadon, F., Valencia, A. J., & Payeur, P. (2018) · Robotics · doi:10.3390/robotics7040074 · Cited by 80
Mitrano, P. P., McConachie, D., & Berenson, D. (2021) · Science Robotics · doi:10.1126/scirobotics.abd8170 · Cited by 79
Self-citationGravity-Based Robotic Cloth Folding
van den Berg, J., Miller, S., Goldberg, K., & Abbeel, P. (2010) · Springer tracts in advanced robotics · doi:10.1007/978-3-642-17452-0_24 · Cited by 75
Manipulating deformable objects by interleaving prediction, planning, and control
McConachie, D., Dobson, A., Ruan, M., & Berenson, D. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920918299 · Cited by 73
Self-citationProbabilistic real-time user posture tracking for personalized robot-assisted dressing
Zhang, F., Cully, A., & Demiris, Y. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2904461 · Cited by 70
Alambeigi, F., Wang, Z., Hegeman, R. A., Liu, Y., & Armand, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2888896 · Cited by 70
Self-citationVision-based manipulation of deformable and rigid objects using subspace projections of 2D contours
Zhu, J., Navarro-Alarcón, D., Passama, R., & Cherubini, A. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103798 · Cited by 69
Self-citationTracking elastic deformable objects with an RGB-D sensor for a pizza chef robot
Petit, A., Lippiello, V., Fontanelli, G. A., & Siciliano, B. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.08.023 · Cited by 68
FEM-Based Deformation Control for Dexterous Manipulation of 3D Soft Objects
Ficuciello, F., Migliozzi, A., Coevoet, E., Petit, A., & Christian Duriez, A. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593512 · Cited by 68
Self-citationTactile Behaviors with the Vision-Based Tactile Sensor FingerVision
Yamaguchi, A., & Atkeson, C. G. (2019) · International Journal of Humanoid Robotics · doi:10.1142/s0219843619400024 · Cited by 66
Learning to collaborate from simulation for robot-assisted dressing
Clegg, A., Erickson, Z., Grady, P., Turk, G., Kemp, C. C., & Liu, C. K. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2972852 · Cited by 62
Regrasping and unfolding of garments using predictive thin shell modeling
Li, Y., Xu, D., Yue, Y., Wang, Y., Chang, S., Grinspun, E., & Allen, P. K. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139370 · Cited by 62
Alambeigi, F., Wang, Z., Hegeman, R. A., Liu, Y., & Armand, M. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2863376 · Cited by 62
Self-citationEMD Net: An Encode–Manipulate–Decode Network for Cloth Manipulation
Tanaka, D., Arnold, S., & Yamazaki, K. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800122 · Cited by 60
Dexterity augmentation on a synergistic hand: The Pisa/IIT SoftHand+
Santina, C. D., Grioli, G., Catalano, M. G., Brando, A., & Bicchi, A. (2015) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2015.7363595 · Cited by 59
Occlusion-robust Deformable Object Tracking without Physics Simulation
Chi, C., & Berenson, D. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967827 · Cited by 58
Self-citationWhat's in the container? Classifying object contents from vision and touch
Güler, P., Bekiroglu, Y., Gratal, X., Pauwels, K., & Kragić, D. (2014) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2014.6943119 · Cited by 54
Model-free vision-based shaping of deformable plastic materials
Cherubini, A., Ortenzi, V., Cosgun, A., Lee, R., & Corke, P. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920907684 · Cited by 54
Self-citationLaSeSOM: A Latent and Semantic Representation Framework for Soft Object Manipulation
Zhou, P., Zhu, J., Huo, S., et al. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3074872 · Cited by 51
Self-citationA framework for robotic clothing assistance by imitation learning
Joshi, R. P., Koganti, N., & Shibata, T. (2019) · Advanced Robotics · doi:10.1080/01691864.2019.1636715 · Cited by 50
Adapting robot task planning to user preferences: an assistive shoe dressing example
Canal, G., Alenyà, G., & Carme Torras, A. (2018) · Autonomous Robots · doi:10.1007/s10514-018-9737-2 · Cited by 47
Cable Manipulation with a Tactile-Reactive Gripper
Dong, S., Wang, S., She, Y., Sunil, N., Rodríguez, A., & Adelson, E. H. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.029 · Cited by 46
Learning Hierarchical Control for Robust In-Hand Manipulation
Li, T., Srinivasan, K., Meng, M. Q. ‐., Yuan, W., & Bohg, J. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197343 · Cited by 41
Self-citationVision-Based Robotic Manipulation of Flexible PCBs
Li, X., Su, X., & Liu, Y.-H. (2018) · IEEE/ASME transactions on mechatronics · doi:10.1109/tmech.2018.2869147 · Cited by 40
Self-citationSimulation-based optimal motion planning for deformable object
Yoshida, E., Ayusawa, K., Ramírez-Alpizar, I. G., Harada, K., Christian Duriez, A., & Kheddar, A. (2015) · IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso.2015.7428219 · Cited by 37
Self-citationLearning Task-Parameterized Skills From Few Demonstrations
Zhu, J., Gienger, M., & Kober, J. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3150013 · Cited by 36
Self-citationLearning When to Trust a Dynamics Model for Planning in Reduced State Spaces
McConachie, D., Power, T., Mitrano, P., & Berenson, D. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2972858 · Cited by 35
Self-citationProvably Safe and Efficient Motion Planning with Uncertain Human Dynamics
Li, S., Figueroa, N., Shah, A., & Shah, J. (2021) · Robotics: Science and Systems · doi:10.15607/rss.2021.xvii.050 · Cited by 31
Ruan, M., McConachie, D., & Berenson, D. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594520 · Cited by 29
Self-citationBeyond Soft Hands: Efficient Grasping With Non-Anthropomorphic Soft Grippers
Hao, Y., & Visell, Y. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.632006 · Cited by 28
Rouhafzay, G., Creţu, A.-M., & Payeur, P. (2020) · Sensors · doi:10.3390/s21010113 · Cited by 26
Bandit-Based Model Selection for Deformable Object Manipulation
McConachie, D., & Berenson, D. (2020) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-43089-4_45 · Cited by 25
Self-citationVideo dataset of human demonstrations of folding clothing for robotic folding
Verleysen, A., Biondina, M., & wyffels, F. (2020) · The International Journal of Robotics Research · doi:10.1177/0278364920940408 · Cited by 25
Motion planning for dual-arm assembly of ring-shaped elastic objects
Ramírez-Alpizar, I. G., Harada, K., & Yoshida, E. (2014) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2014.7041423 · Cited by 21
Self-citationData-Driven Model Predictive Control for the Contact-Rich Task of Food Cutting
Mitsioni, I., Karayiannidis, Y., Stork, J. A., & Kragić, D. (2019) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids43949.2019.9035011 · Cited by 21
Keep It Simple: Data-Efficient Learning for Controlling Complex Systems With Simple Models
Power, T. J., & Berenson, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3056368 · Cited by 12
Self-citationToward Real-Time 3D Shape Tracking of Deformable Objects for Robotic Manipulation and Shape Control
Valencia, A. J., Nadon, F., & Payeur, P. (2019) · Proceedings of IEEE Sensors/Proceedings of IEEE Sensors ... · doi:10.1109/sensors43011.2019.8956623 · Cited by 7
Valencia, A. J., & Payeur, P. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.600584 · Cited by 7
Cited by
SpeedFolding: Learning Efficient Bimanual Folding of Garments
Avigal, Y., Berscheid, L., Asfour, T., Kröger, T., & Goldberg, K. (2022) · 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981402 · Cited by 95
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
“Zhu et al. (2022) [17] discuss the challenges posed by different types of DO manipulation in terms of perception, modelling and manipulation.”
BackgroundInteractive Perception for Deformable Object Manipulation
Weng, Z., Zhou, P., Yin, H., Kravberg, A., Varava, A., Navarro-Alarcon, D., & Kragic, D. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3431943 · Cited by 7
“Interactive Perception and manipulation of deformable objects [7], [8], [9], [10] are commonly studied as two separate problems in the robotics community.”
BackgroundGoal-Conditioned Model Simplification for 1-D and 2-D Deformable Object Manipulation
Wang, S., Leonetti, M., & Dogar, M. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3577052 · Cited by 4
“14 and 15.”
A Perspective on Open Challenges in Deformable Object Manipulation
McKennaa, R. P., & Oyekan, J. (2026) · arXiv · doi:10.48550/arxiv.2602.22998 · Cited by 1
“While previous reviews [2], [17] provided broad coverage of the subject, their emphasis was primarily on analytical methods.”
Metadata
- Authors
- Zhu, J., Cherubini, A., Dune, C., Navarro-Alarcon, D., Alambeigi, F., Berenson, D., Ficuciello, F., Harada, K., Kober, J., Li, X., Pan, J., Yuan, W., & Gienger, M.
- Venue
- IEEE Robotics & Automation Magazine
- Published
- 2022-09
- Volume
- 29
- Issue
- 3
- Pages
- 67-77
- ISSN
- 1070-9932 (ISSN-L)
- 1558-223X
- OpenAlex
- W3159812989
- Cited by
- 265
- References
- 73
- FWCI
- 22.83
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.