Cited by 66Soft Robotics and ApplicationsRobot Manipulation and LearningReinforcement Learning in Robotics

DiSECt: A Differentiable Simulation Engine for Autonomous Robotic Cutting

Open access
Heiden, Eric, Macklin, Miles, Narang, Yashraj, Fox, Dieter, Garg, Animesh, Ramos, Fabio·2021·Robotics: Science and Systems XVII

Abstract

Robotic cutting of soft materials is critical for applications such as food processing, household automation, and surgical manipulation. As in other areas of robotics, simulators can facilitate controller verification, policy learning, and dataset generation. Moreover, differentiable simulators can enable gradient-based optimization, which is invaluable for calibrating simulation parameters and optimizing controllers. In this work, we present DiSECt: the first differentiable simulator for cutting soft materials. The simulator augments the finite element method (FEM) with a continuous contact model based on signed distance fields (SDF), as well as a continuous damage model that inserts springs on opposite sides of the cutting plane and allows them to weaken until zero stiffness, enabling crack formation. Through various experiments, we evaluate the performance of the simulator. We first show that the simulator can be calibrated to match resultant forces and deformation fields from a state-of-the-art commercial solver and real-world cutting datasets, with generality across cutting velocities and object instances. We then show that Bayesian inference can be performed efficiently by leveraging the differentiability of the simulator, estimating posteriors over hundreds of parameters in a fraction of the time of derivative-free methods. Finally, we illustrate that control parameters in the simulation can be optimized to minimize cutting forces via lateral slicing motions. We publish videos and additional results on our project website at https://diff-cutting-sim.github.io.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.15607/rss.2021.xvii.067

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Achieving realism for a diverse set of activities remains a tremendous challenge due to the effort required to provide realistic models and simulation features.

    “While significant progress in realism has been made in specific domains [43-45], achieving realism for a diverse set of activities remains a tremendous challenge, due to the effort required to provide realistic models and simulation features.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 75

  1. [2][2] A.G. Atkins and T. Atkins. The Science and Engineering of Cutting: The Mechanics and Processes of Separating, Scratching and Puncturing Biomaterials, Metals and Non-metals . Elsevier Science, 2009. -
  2. [3][3] AG Atkins, X Xu, and G Jeronimidis. Cutting by 'pressing and slicing' of thin floppy slices of materials illustrated by experiments on cheddar cheese and salami. Journal of Materials Science , 39:2761-2766, 2004. -
  3. [4][4] T Belytschko, YY Lu, and L Gu. Element-free galerkin methods. International Journal for Numerical Methods in Engineering , 37:229-256, 1994. -
  4. [5][5] Ted Belytschko, Wing Kam Liu, Brian Moran, and Khalil Elkhodary. Nonlinear finite elements for continua and structures . John Wiley & Sons, 2013. -
  5. [6][6] I. Berndt, R. Torchelsen, and A. Maciel. Efficient surgical cutting with position-based dynamics. IEEE Computer Graphics and Applications , 37(3):24-31, 2017. -
  6. [7][7] Daniel Bielser, Pascal Glardon, Matthias Teschner, and Markus Gross. A state machine for real-time cutting of tetrahedral meshes. In 11th Pacific Conference on Computer Graphics and Applications , pages 377-386, 2003. -
  7. [8][8] Peter Brown. Contact modelling for forward dynamics of human motion. Master's thesis, University of Waterloo, 2017. -
  8. [9][9] Daniel Burkhart, Bernd Hamann, and Georg Umlauf. Adaptive and feature-preserving subdivision for high-quality tetrahedral meshes. Computer Graphics Forum , 29(1):117-127, 2010. -
  9. [11][11] Yevgen Chebotar, Ankur Handa, Viktor Makoviychuk, Miles Macklin, Jan Issac, Nathan Ratliff, and Dieter Fox. Closing the sim-to-real loop: Adapting simulation randomization with real world experience. In 2019 International Conference on Robotics and Automation (ICRA) , pages 8973-8979. IEEE, 2019. -
  10. [12][12] Kyle Cranmer, Johann Brehmer, and Gilles Louppe. The frontier of simulation-based inference. Proceedings of the National Academy of Sciences , 117(48):30055-30062, 2020. -
  11. [14][14] Filipe de Avila Belbute-Peres, Kevin Smith, Kelsey Allen, Josh Tenenbaum, and J. Zico Kolter. End-to-end differentiable physics for learning and control. In Advances in Neural Information Processing Systems 31 , pages 7178-7189. 2018. -
  12. [15][15] Debao Zhou, M. R. Claffee, Kok-Meng Lee, and G. V. McMurray. Cutting, 'by pressing and slicing', applied to robotic cutting bio-materials. i. modeling of stress distribution. In Proceedings 2006 IEEE International Conference on Robotics and Automation , pages 2896-2901, 2006. -
  13. [16][16] Debao Zhou, M. R. Claffee, Kok-Meng Lee, and G. V. McMurray. Cutting, 'by pressing and slicing', applied to the robotic cut of bio-materials. ii. force during slicing and pressing cuts. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006. , pages 2256-2261, 2006. -
  14. [17][17] IY El Said, Mervat M Atallah, KS Khalil, and AM El-Lithy. Physical and mechanical properties of cucumber applied to seed extractor. Journal of Soil Sciences and Agricultural Engineering , 2(8):871-880, 2011. -
  15. [19][19] Moritz Geilinger, David Hahn, Jonas Zehnder, Moritz B¨ acher, Bernhard Thomaszewski, and Stelian Coros. Add: Analytically differentiable dynamics for multi-body systems with frictional contact. In arXiv , 2020. -
  16. [20][20] Markus Giftthaler, Michael Neunert, Markus St¨ auble, Marco Frigerio, Claudio Semini, and Jonas Buchli. Automatic differentiation of rigid body dynamics for optimal control and estimation. Advanced Robotics , 31(22):1225-1237, 2017. -
  17. [21][21] R. A. Gingold and J. J. Monaghan. Smoothed particle hydrodynamics: theory and application to non-spherical stars. Monthly Notices of the Royal Astronomical Society , 181(3):375-389, 12 1977. -
  18. [22][22] Andreas Griewank and Andrea Walther. Introduction to automatic differentiation. PAMM , 2(1):45-49, 2003. -
  19. [23][23] Alan Arnold Griffith. The phenomena of rupture and flow in solids. Philosophical transactions of the royal society of London. Series A, containing papers of a mathematical or physical character , 221(582-593):163-198, 1921. -
  20. [24][24] David Hahn, Pol Banzet, James M Bern, and Stelian Coros. Real2sim: Visco-elastic parameter estimation from dynamic motion. ACM Transactions on Graphics (TOG) , 38(6):1-13, 2019. -
  21. [26][26] Eric Heiden, David Millard, Erwin Coumans, Yizhou Sheng, and Gaurav S Sukhatme. NeuralSim: Augmenting differentiable simulators with neural networks. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) , 2021. URL https://github.com/google-research/ tiny-differentiable-simulator. -
  22. [27][27] Kelvin Hsu and Fabio Ramos. Bayesian learning of conditional kernel mean embeddings for automatic likelihood-free inference. In Kamalika Chaudhuri and Masashi Sugiyama, editors, Proceedings of Machine Learning Research , volume 89 of Proceedings of Machine Learning Research , pages 26312640, 16-18 Apr 2019. -
  23. [28][28] Yixin Hu, Qingnan Zhou, Xifeng Gao, Alec Jacobson, Denis Zorin, and Daniele Panozzo. Tetrahedral meshing in the wild. ACM Trans. Graph. , 37(4):60:1-60:14, July 2018. ISSN 07300301. -
  24. [29][29] Yuanming Hu, Yu Fang, Ziheng Ge, Ziyin Qu, Yixin Zhu, Andre Pradhana, and Chenfanfu Jiang. A moving least squares material point method with displacement discontinuity and two-way rigid body coupling. ACM Transactions on Graphics (TOG) , 37(4): 150, 2018. -
  25. [30][30] Yuanming Hu, Jiancheng Liu, Andrew Spielberg, Joshua B Tenenbaum, William T Freeman, Jiajun Wu, Daniela Rus, and Wojciech Matusik. ChainQueen: A real-time differentiable physical simulator for soft robotics. Proceedings of IEEE International Conference on Robotics and Automation (ICRA) , 2019. -
  26. [31][31] Yuanming Hu, Luke Anderson, Tzu-Mao Li, Qi Sun, Nathan Carr, Jonathan Ragan-Kelley, and Fr´ edo Durand. DiffTaichi: Differentiable programming for physical simulation. ICLR , 2020. -
  27. [34][34] Prajjwal Jamdagni and Yan-Bin Jia. Robotic cutting of solids based on fracture mechanics and fem. In IEEE International Conference on Intelligent Robots and Systems (IROS) , pages 8246-8251, 2019. -
  28. [35][35] L. Jeˇ r´ abkov´ a and T. Kuhlen. Stable cutting of deformable objects in virtual environments using XFEM. IEEE Computer Graphics and Applications , 29(2):61-71, 2009. -
  29. [36][36] Amir R Khoei. Extended finite element method: theory and applications . John Wiley & Sons, 2014. -
  30. [37][37] Diederik P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In 3rd International Conference for Learning Representations (ICLR) , 2015. -
  31. [38][38] Twan Koolen and Robin Deits. Julia for robotics: simulation and real-time control in a high-level programming language. In International Conference on Robotics and Automation , 05 2019. -
  32. [39][39] Dan Koschier, Sebastian Lipponer, and Jan Bender. Adaptive tetrahedral meshes for brittle fracture simulation. Symposium on Computer Animation , 2014. -
  33. [40][40] Dan Koschier, Jan Bender, and Nils Thuerey. Robust extended finite elements for complex cutting of deformables. ACM Trans. Graph. , 36(4), July 2017. -
  34. [41][41] Sanjay Krishnan, Animesh Garg, Richard Liaw, Brijen Thananjeyan, Lauren Miller, Florian T Pokorny, and Ken Goldberg. SWIRL: A Sequential Windowed Inverse Reinforcement Learning Algorithm for Robot Tasks With Delayed Rewards. International Journal of Robotics Research (IJRR) , jul 2018. -
  35. [43][43] Chunyuan Li, Changyou Chen, David Carlson, and Lawrence 44. Carin. Preconditioned stochastic gradient langevin dynamics for deep neural networks. In AAAI , 2016. -
  36. [44][44] Yancong Li, Xiaoyong Du, Jinhai Wang, and Chai Lei. Study on mechanical properties of apple picking damage. In Proceedings of the 2017 3rd International Forum on Energy, Environment Science and Materials (IFEESM 2017) , pages 1666-1670. Atlantis Press, 2018/02. -
  37. [46][46] Lennart Ljung. System Identification (2nd Ed.): Theory for the User . Prentice Hall PTR, USA, 1999. ISBN 0136566952. -
  38. [47][47] Philip Long, Amine Moughlbay, Wisama Khalil, and Philippe Martinet. Robotic meat cutting. In ICT-PAMM Workshop , 2013. -
  39. [48][48] Rosa M. S´ anchez-Banderas and Miguel A. Otaduy. Strain rate dissipation for elastic deformations. Computer Graphics Forum , 37(8):161-170, 2018. -
  40. [49][49] Miles Macklin, Kenny Erleben, Matthias M¨ uller, Nuttapong Chentanez, Stefan Jeschke, and Zach Corse. Local optimization for robust signed distance field collision. Proc. ACM Comput. Graph. Interact. Tech. , 3(1), April 2020. -
  41. [50][50] Rolf Mahnken. Identification of material parameters for constitutive equations. Encyclopedia of Computational Mechanics Second Edition , pages 1-21, 2017. -
  42. [51][51] Charles C. Margossian. A review of automatic differentiation and its efficient implementation. WIREs Data Mining and Knowledge Discovery , 9(4), Mar 2019. -
  43. [52][52] C. Matl, Y. Narang, R. Bajcsy, F. Ramos, and D. Fox. Inferring the material properties of granular media for robotic tasks. In 2020 IEEE International Conference on Robotics and Automation (ICRA) , pages 2770-2777, 2020. -
  44. [53][53] Carolyn Matl, Yashraj S. Narang, Dieter Fox, Ruzena Bajcsy, and Fabio Ramos. STReSSD: Sim-to-real from sound for stochastic dynamics. Conference on Robot Learning , 2020. -
  45. [54][54] Bhairav Mehta, Manfred Diaz, Florian Golemo, Christopher Pal, and Liam Paull. Active domain randomization. Conference on Robot Learning , 2019. -
  46. [55][55] Bhairav Mehta, Ankur Handa, Dieter Fox, and Fabio Ramos. A user's guide to calibrating robotics simulators. Conference on Robot Learning , 2020. -
  47. [56][56] M Eugene Merchant. Mechanics of the metal cutting process. i. orthogonal cutting and a type 2 chip. Journal of applied physics , 16(5):267-275, 1945. -
  48. [57][57] I. Mitsioni, Y. Karayiannidis, J. A. Stork, and D. Kragic. Datadriven model predictive control for the contact-rich task of food cutting. In IEEE-RAS International Conference on Humanoid Robots (Humanoids) , pages 244-250, 2019. -
  49. [58][58] Nicolas Mo¨ es, John Dolbow, and Ted Belytschko. A finite element method for crack growth without remeshing. International journal for numerical methods in engineering , 46(1):131-150, 1999. -
  50. [59][59] Neil Molino, Zhaosheng Bao, and Ron Fedkiw. A virtual node algorithm for changing mesh topology during simulation. ACM Trans. Graph. , 23(3):385-392, August 2004. -
  51. [60][60] JJ Monaghan. Smoothed particle hydrodynamics. Annual Review of Astronomy and Astrophysics , 30:543-574, 1992. -
  52. [61][61] Seyyed Javad Mousavizadeh, Ali N. Mashayekhi, Amir Daraei Garmakhany, Ab Ehtesham Nia, and Jafari M. Evaluation of some physical properties of cucumber (cucumis sativus l.). Journal of Agricultural Science and Technology , 4:107-115, 01 2010. -
  53. [62][62] Melissa Mozifian, Juan Camilo Gamboa Higuera, David Meger, and Gregory Dudek. Learning domain randomization distributions for training robust locomotion policies. arXiv preprint arXiv:1906.00410 , 2019. - · arXiv
  54. [63][63] Xiaoqian Mu, Yuechuan Xue, and Yan-Bin Jia. Robotic cutting: Mechanics and control of knife motion. In IEEE International 65. Conference on Robotics and Automation (ICRA) , pages 30663072, 2019. -
  55. [64][64] Matthias M¨ uller, Bruno Heidelberger, Marcus Hennix, and John Ratcliff. Position based dynamics. Journal of Visual Communication and Image Representation , 18(2):109-118, 2007. -
  56. [65][65] J. Krishna Murthy, Miles Macklin, Florian Golemo, Vikram Voleti, Linda Petrini, Martin Weiss, Breandan Considine, J´ erˆ ome Parent-L´ evesque, Kevin Xie, Kenny Erleben, Liam Paull, Florian Shkurti, Derek Nowrouzezahrai, and Sanja Fidler. gradSim: Differentiable simulation for system identification and visuomotor control. In International Conference on Learning Representations , 2021. -
  57. [66][66] Yashraj Narang, Balakumar Sundaralingam, Miles Macklin, Arsalan Mousavian, and Dieter Fox. Sim-to-real for robotic tactile sensing via physics-based simulation and learned latent projections. International Conference on Robotics and Automation , 2021. -
  58. [67][67] Junjun Pan, Junxuan Bai, Xin Zhao, Aimin Hao, and Hong Qin. Real-time haptic manipulation and cutting of hybrid soft tissue models by extended position-based dynamics. Computer Animation and Virtual Worlds , 26(3-4):321-335, 2015. -
  59. [68][68] George Papamakarios and Iain Murray. Fast e -free inference of simulation models with Bayesian conditional density estimation. In D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett, editors, Advances in Neural Information Processing Systems , volume 29. Curran Associates, Inc., 2016. -
  60. [69][69] Christoph J Paulus, Lionel Untereiner, Hadrien Courtecuisse, St´ ephane Cotin, and David Cazier. Virtual cutting of deformable objects based on efficient topological operations. The Visual Computer , 31(6):831-841, 2015. -
  61. [71][71] John C Platt and Alan H Barr. Constrained differential optimization for neural networks. Advances in Neural Information Processing Systems , 1988. -
  62. [72][72] Yi-Ling Qiao, Junbang Liang, Vladlen Koltun, and Ming C. Lin. Scalable differentiable physics for learning and control. In ICML , 2020. -
  63. [74][74] Yossi Rubner, Carlo Tomasi, and Leonidas J. Guibas. The earth mover's distance as a metric for image retrieval. International Journal of Computer Vision , 40(2):99-121, 2000. -
  64. [75][75] Eftychios Sifakis, Kevin G Der, and Ronald Fedkiw. Arbitrary cutting of deformable tetrahedralized objects. In Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation , pages 73-80, 2007. -
  65. [76][76] Eftychios Sifakis, Tamar Shinar, Geoffrey Irving, and Ronald Fedkiw. Hybrid simulation of deformable solids. In Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation , pages 81-90, 2007. -
  66. [77][77] Breannan Smith, Fernando De Goes, and Theodore Kim. Stable neo-hookean flesh simulation. ACM Trans. Graph. , 37(2), March 2018. -
  67. [82][82] Stephanie Wang, Mengyuan Ding, Theodore F. Gast, Leyi Zhu, Steven Gagniere, Chenfanfu Jiang, and Joseph M. Teran. Simulation and visualization of ductile fracture with the material point method. Proc. ACM Comput. Graph. Interact. Tech. , 2(2), July 2019. -
  68. [83][83] Yuting Wang. Virtual Node Algorithms for Simulating and Cutting Deformable Solids . PhD thesis, UCLA, 2014. -
  69. [84][84] Max Welling and Yee Whye Teh. Bayesian learning via stochastic gradient langevin dynamics. In International Conference on Machine Learning (ICML) , pages 681-688, 2011. -
  70. [85][85] L. Wijayarathne, Q. Sima, Z. Zhou, Y. Zhao, and F. L. Hammond. Simultaneous trajectory optimization and force control with soft contact mechanics. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages 3164-3171, 2020. -
  71. [86][86] Joshuah Wolper, Yu Fang, Minchen Li, Jiecong Lu, Ming Gao, and Chenfanfu Jiang. Cd-mpm: Continuum damage material point methods for dynamic fracture animation. ACM Trans. Graph. , 38(4), 2019. -
  72. [87][87] Joshuah Wolper, Yunuo Chen, Minchen Li, Yu Fang, Ziyin Qu, Jiecong Lu, Meggie Cheng, and Chenfanfu Jiang. Anisompm: Animating anisotropic damage mechanics. ACM Trans. Graph. , 39(4), 2020. -
  73. [88][88] CT Wu, Y Guo, and W Hu. An introduction to the ls-dyna smoothed particle galerkin method for severe deformation and failure analyses in solids. In International LS-DYNA Users Conference , pages 1-20, 2014. -
  74. [89][89] C.T. Wu, Youcai Wu, John E. Crawford, and Joseph M. Magallanes. Three-dimensional concrete impact and penetration simulations using the smoothed particle Galerkin method. International Journal of Impact Engineering , 106:1-17, 2017. -
  75. [90][90] Jun Wu, R¨ udiger Westermann, and Christian Dick. A survey of physically based simulation of cuts in deformable bodies. Computer Graphics Forum , 34(6):161-187, 2015.

Cited by

Sorted by citations

Authors
Heiden, E., Macklin, M., Narang, Y., Fox, D., Garg, A., & Ramos, F.
Affiliations
  • University of Southern California (US)
  • Nvidia (United Kingdom) (GB)
  • University of Toronto (CA)
  • The University of Sydney (AU)
Venue
Robotics: Science and Systems XVII
Published
2021-07-12
OpenAlex
W3164136237
Cited by
66
References
2
Citations by year
2026: 2 · 2025: 13 · 2024: 18 · 2023: 18 · 2022: 15
FWCI
24.15
Type
conference paper
Language
en
Open access
Locations
  • Robotics: Science and Systems (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords
differentiable simulation, robotic cutting, soft materials, finite element analysis, signed distance function, damage model, crack formation, simulation calibration, Bayesian inference, autonomous robots

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review