The DOI matches its Crossref record; 36 of the 38 references it cites were found in a registry or an index.
Multilateral surgical pattern cutting in 2D orthotropic gauze with deep reinforcement learning policies for tensioning
Abstract
In the Fundamentals of Laparoscopic Surgery (FLS) standard medical training regimen, the Pattern Cutting task requires residents to demonstrate proficiency by maneuvering two tools, surgical scissors and tissue gripper, to accurately cut a circular pattern on surgical gauze suspended at the corners. Accuracy of cutting depends on tensioning, wherein the gripper pinches a point on the gauze in R3and pulls to induce and maintain tension in the material as cutting proceeds. An automated tensioning policy maps the current state of the gauze to output a direction of pulling as an action. The optimal tensioning policy depends on both the choice of pinch point and cutting trajectory. We explore the problem of learning a tensioning policy conditioned on specific cutting trajectories. Every timestep, we allow the gripper to react to the deformation of the gauze and progress of the cutting trajectory with a translation unit vector along an allowable set of directions. As deformation is difficult to analytically model and explicitly observe, we leverage deep reinforcement learning with direct policy search methods to learn tensioning policies using a finite-element simulator and then transfer them to a physical system. We compare the Deep RL tensioning policies with fixed and analytic (opposing the error vector with a fixed pinch point) policies on a set of 17 open and closed curved contours in simulation and 4 patterns in physical experiments with the da Vinci Research Kit (dVRK). Our simulation results suggest that learning to tension with Deep RL can significantly improve performance and robustness to noise and external forces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recently, deep reinforcement learning has been used for autonomous robot control, e.g., self-driving vehicle [203], [199], medical robot [213], mobile service robot.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [213]
In the citing paper
“Recently, deep reinforcement learning has been used to control the surgical robot [213] for multilateral cutting in 2d orthotropic gauze.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [213]
Citations
Cites
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
End-to-End Training of Deep Visuomotor PoliciesPreprint
Levine, S., Finn, C., Darrell, T., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 2,641
Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial
Veldkamp, R. (2005) · The Lancet Oncology · doi:10.1016/s1470-2045(05)70221-7 · Cited by 2,339
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,683
Benchmarking Deep Reinforcement Learning for Continuous Control
Duan, Y., Chen, X., Houthooft, R., Schulman, J., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1604.06778 · Cited by 1,114
An open-source research kit for the da Vinci® Surgical System
Kazanzides, P., Chen, Z., Deguet, A., Fischer, G. S., Taylor, R. H., & DiMaio, S. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907809 · Cited by 509
Ritter, E. M., & Scott, D. J. (2007) · Surgical Innovation · doi:10.1177/1553350607302329 · Cited by 332
Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature
Moustris, G. P., Hiridis, S., Deliparaschos, K. M., & Konstantinidis, M. K. (2011) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.408 · Cited by 323
Flagged first, then by citations
2 of the 38 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- 2016, EndoWrist Instruments Catalogue in Intuitive Surgical, 3
- brooks, 2016, A tearable cloth simulation using vertlet integration
Cited by
Sorted by citations
Items 101–144 of 144
Transferring optimal contact skills to flexible manipulators by reinforcement learning
Xu, W., Pan, A., & Ren, H. (2019) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-019-00101-7 · Cited by 6
Value-Informed Skill Chaining for Policy Learning of Long-Horizon Tasks with Surgical Robot
Huang, T., Chen, K., Wei, W., Li, J., Long, Y., & Dou, Q. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10342180 · Cited by 5
Strohmeyer, N. A., Park, J. H., Murphy, B. P., & Alambeigi, F. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610931 · Cited by 5
MEDiC: Autonomous Surgical Robotic Assistance to Maximizing Exposure for Dissection and Cautery
Liang, X., Wang, C.-P., Shinde, N., Liu, F., Richter, F., & Yip, M. C. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128739 · Cited by 5
Dharmarajan, K., Panitch, W., Shi, B., Huang, H., Chen, L. Y., Low, T., Fer, D., & Goldberg, K. (2023) · International Symposium on Medical Robotics · doi:10.1109/ismr57123.2023.10130195 · Cited by 5
Self-citationA Visual Communication Map for Multi-Agent Deep Reinforcement LearningPreprint
Nguyen, N. D., Nguyen, T. T., Creighton, D., & Nahavandi, S. (2020) · arXiv (Cornell University) · doi:10.13140/rg.2.2.13433.62563 · Cited by 7
Jamdagni, P., & Jia, Y.-B. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3462943 · Cited by 4
Baweja, P. S., Gondokaryono, R., & Kahrs, L. A. (2023) · International Symposium on Medical Robotics · doi:10.1109/ismr57123.2023.10130201 · Cited by 4
Advances in Transanal Quasi-Single-Port Surgery Robotic Systems: A Comprehensive Review
Shi, Y., Li, J., Song, D., Zhang, B., Zhang, Z., Fukuda, T., & Shi, C. (2025) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2025.3598580 · Cited by 4
Murphy, B. P., & Alambeigi, F. (2023) · Journal of Medical Robotics Research · doi:10.1142/s2424905x23400019 · Cited by 5
Raven: Open Surgical Robotic PlatformsPreprint
Li, Y., Hannaford, B., & Rosén, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.11747 · Cited by 4
Artificial Intelligence Surgery
(2021) · Artificial Intelligence Surgery · doi:10.20517/ais · Cited by 4
Artificial Intelligence in the Context of Digital Marketing
Juddoo, S. (2023) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/978-1-6684-8958-1.ch006 · Cited by 4
Chakravarty, S. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-85955-4.00011-9 · Cited by 3
Model-Free Large-Scale Cloth Spreading With Mobile Manipulation: Initial Feasibility Study
Chu, X., Wang, S., Feng, M., Zheng, J., Zhao, Y., Huang, J., & Au, K. W. S. (2023) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case56687.2023.10260538 · Cited by 3
Robot-Assisted Vascular Shunt Insertion with the dVRK Surgical Robot
Dharmarajan, K., Panitch, W., Shi, B., Huang, H., Chen, L. Y., Moghani, M., Yu, Q., Hari, K., Low, T., Fer, D., et al. (2023) · Journal of Medical Robotics Research · doi:10.1142/s2424905x23400068 · Cited by 3
Self-citationNieto, N., Sánchez, J. A., Aguirre, M. G., Félix, F., & Muñoz, L. A. (2024) · IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR) · doi:10.1109/aixvr59861.2024.00064 · Cited by 3
Constraint Estimation and Derivative-Free Recovery for Robot Learning from Demonstrations
Lee, J., Laskey, M., Fox, R., & Goldberg, K. Y. (2018) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/coase.2018.8560342 · Cited by 3
Self-citationDifferentiable Rendering-based Pose Estimation for Surgical Robotic Instruments
Liang, Z., Chiu, Z.-Y., Richter, F., & Yip, M. C. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11245870 · Cited by 2
The Role of Artificial Intelligence and Machine Learning in Surgery
Ma, R., Collins, J. W., & Hung, A. J. (2022) · Springer eBooks · doi:10.1007/978-3-031-00363-9_9 · Cited by 2
DefGoalNet: Contextual Goal Learning from Demonstrations for Deformable Object Manipulation
Thach, B., Watts, T. M., Ho, S.-H., Hermans, T., & Kuntz, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610109 · Cited by 2
RCM Constrained Task Space Trajectory Generation for Autonomous Robotic Surgeries
Andal Amirthavarshini, G., & Thondiyath, A. (2024) · IEEE International Conference on Cyborg and Bionic Systems (CBS) · doi:10.1109/cbs61689.2024.10860403 · Cited by 2
Derivative-Free Failure Avoidance Control for Manipulation using Learned Support Constraints.
Lee, J., Laskey, M., Fox, R., & Goldberg, K. Y. (2018) · Cited by 2
Self-citationRobust Surgical Tool Tracking with Pixel-based Probabilities for Projected Geometric Primitives
D’Ambrosia, C., Richter, F., Chiu, Z.-Y., Shinde, N. R., Liu, F., Christensen, H. I., & Yip, M. C. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610378 · Cited by 2
Robotic autonomy in endocrine surgery
Funk, E. K., Richter, F., Park, W. S., Yip, M. C., & Orosco, R. K. (2020) · Annals of Thyroid · doi:10.21037/aot-19-53 · Cited by 2
Huang, J.-B., Liu, F., Richter, F., & Yip, M. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.01436 · Cited by 2
Enhancing the Autonomy of Soft Robots in Minimally Invasive Surgeries Through Computer Vision
Alsirhani, H., & Elhag, S. (2025) · International Conference on Advanced Innovations in Smart Cities (ICAISC) · doi:10.1109/icaisc64594.2025.10959475 · Cited by 1
Liu, J., Yang, S., Wang, Y., Zhao, H., & Ding, H. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127676 · Cited by 2
Reinforcement Learning in Virtual Environments for Education: Trends and Future Applications
Sypsas, A., Zafeiropoulos, V., & Kalles, D. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.02.354 · Cited by 1
Lens Capsule Tearing in Cataract Surgery using Reinforcement Learning
Peter, R. C., Peikert, S., Haide, L., Pham, D. X. V., Chettaoui, T., Tagliabue, E., Scheikl, P. M., Fauser, J., Hillenbrand, M., Neumann, G. M., et al. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611714 · Cited by 1
Ganapathi, A., Sundaresan, P., Thananjeyan, B., Balakrishna, A., Seita, D., Hoque, R., Gonzalez, J. E., & Goldberg, K. Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04339 · Cited by 1
Self-citationLiu, F., Li, Z., Han, Y., Lu, J., Richter, F., & Yip, M. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.00800 · Cited by 1
Deformable Object Manipulation Using Human Demonstration Enhanced Deep Deterministic Policy Gradient
Dong, Z., Huang, J., Wang, H., Yang, B. S., Wu, D., Zhu, Y., & Hasegawa, Y. (2023) · International Symposium on Micro-NanoMechatronics and Human Science · doi:10.1109/mhs59931.2023.10510085
Dense-Descriptor Transporter Networks for Multidimensional Deformable Object Manipulation
Cao, Y., Gong, D., & Yu, J. (2024) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls61622.2024.10606669
Lingelbach, K., Rips, J., Karstensen, L., Mathis-Ullrich, F., & Vukelić, M. (2025) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2025.1535799
Deep reinforcement learning in healthcare and biomedical application
Thakre, B. P., Yadav, U., & Bondre, S. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-30146-9.00008-3 · Cited by 2
Panteleev, V. I., Kriger, A. G., & Шимановский, Н. Л. (2025) · Pirogov Russian Journal of Surgery · doi:10.17116/hirurgia202507159
Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm
Wang, J., & Zhao, W. (2025) · International Journal of Advanced Robotic Systems · doi:10.1177/17298806251348118
Contact-Aware Prediction for Reliable Autonomous Deformable Tissue Retraction in Robotic Surgery
Chen, J., Zhu, Y., Ning, G., & Liao, H. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3598639
Shi, Y., Mo, H., Xiao, X., Duan, R., Li, L., & Li, X. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246838
The Role of Artificial Intelligence in Cardiothoracic Surgery
Copeland, J., Farooq, T., Kuang, X., Fayazi, S., Asham, F., & Blehm, T. (2026) · Artificial intelligence · doi:10.5772/intechopen.1010693
Tagliabue, E. (2026) · Springer tracts in advanced robotics · doi:10.1007/978-3-032-04247-7_6
Renedo-Alonso, I., Sánchez-Margallo, J. A., Arana-Arexolaleiba, N., & Elguea-Aguinaco, Í. (2026) · Sensors · doi:10.3390/s26092881
Energy-Elastic Proximal Policy Optimization for Autonomous Soft Tissue Cutting in Robotic Surgery
Pazhouh, S. M. M., Eslami, A., Abin, A. A., Ahmadi, H. A., & Salimi-Badr, A. (2026) · International Interdisciplinary Conference on Artificial Intelligence: Engineering, Health, Finance and Humanities (IICAI) · doi:10.1109/iicai70155.2026.11620861
Metadata
- Authors
- Thananjeyan, B., Garg, A., Krishnan, S., Chen, C., Miller, L., & Goldberg, K.
- Affiliations
- University of California, Berkeley (US)
- Venue
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2017-05
- Pages
- 2371-2378
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2736750746
- Cited by
- 144
- References
- 38
- Citations by year
- 2026: 5 · 2025: 13 · 2024: 22 · 2023: 20 · 2022: 18 · 2021: 25 · 2020: 21 · 2019: 10 · 2018: 7 · 2017: 3
- FWCI
- 142.47
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Keywords
- pattern cutting, deep reinforcement learning, surgical training, Fundamentals of Laparoscopic Surgery, surgical scissors, finite element analysis, da Vinci Research Kit, policy transfer, cutting trajectory, surgical skill assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review