The DOI matches its Crossref record; 36 of the 38 references it cites were found in a registry or an index.
Multilateral surgical pattern cutting in 2D orthotropic gauze with deep reinforcement learning policies for tensioning
Abstract
In the Fundamentals of Laparoscopic Surgery (FLS) standard medical training regimen, the Pattern Cutting task requires residents to demonstrate proficiency by maneuvering two tools, surgical scissors and tissue gripper, to accurately cut a circular pattern on surgical gauze suspended at the corners. Accuracy of cutting depends on tensioning, wherein the gripper pinches a point on the gauze in R3and pulls to induce and maintain tension in the material as cutting proceeds. An automated tensioning policy maps the current state of the gauze to output a direction of pulling as an action. The optimal tensioning policy depends on both the choice of pinch point and cutting trajectory. We explore the problem of learning a tensioning policy conditioned on specific cutting trajectories. Every timestep, we allow the gripper to react to the deformation of the gauze and progress of the cutting trajectory with a translation unit vector along an allowable set of directions. As deformation is difficult to analytically model and explicitly observe, we leverage deep reinforcement learning with direct policy search methods to learn tensioning policies using a finite-element simulator and then transfer them to a physical system. We compare the Deep RL tensioning policies with fixed and analytic (opposing the error vector with a fixed pinch point) policies on a set of 17 open and closed curved contours in simulation and 4 patterns in physical experiments with the da Vinci Research Kit (dVRK). Our simulation results suggest that learning to tension with Deep RL can significantly improve performance and robustness to noise and external forces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recently, deep reinforcement learning has been used for autonomous robot control, e.g., self-driving vehicle [203], [199], medical robot [213], mobile service robot.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [213]
In the citing paper
“Recently, deep reinforcement learning has been used to control the surgical robot [213] for multilateral cutting in 2d orthotropic gauze.”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [213]
Citations
Cites
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
End-to-End Training of Deep Visuomotor PoliciesPreprint
Levine, S., Finn, C., Darrell, T., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 2,641
Laparoscopic surgery versus open surgery for colon cancer: short-term outcomes of a randomised trial
Veldkamp, R. (2005) · The Lancet Oncology · doi:10.1016/s1470-2045(05)70221-7 · Cited by 2,339
Deep learning for detecting robotic grasps
Lenz, I., Lee, H., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914549607 · Cited by 1,683
Benchmarking Deep Reinforcement Learning for Continuous Control
Duan, Y., Chen, X., Houthooft, R., Schulman, J., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1604.06778 · Cited by 1,114
An open-source research kit for the da Vinci® Surgical System
Kazanzides, P., Chen, Z., Deguet, A., Fischer, G. S., Taylor, R. H., & DiMaio, S. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907809 · Cited by 509
Ritter, E. M., & Scott, D. J. (2007) · Surgical Innovation · doi:10.1177/1553350607302329 · Cited by 332
Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature
Moustris, G. P., Hiridis, S., Deliparaschos, K. M., & Konstantinidis, M. K. (2011) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.408 · Cited by 323
Research works printed but not linked: 2
- 2016, EndoWrist Instruments Catalogue in Intuitive Surgical, 3
- brooks, 2016, A tearable cloth simulation using vertlet integration
Cited by
Sorted by citations
Deep Learning Applications in Medical Image Analysis
Ker, J., Wang, L., Rao, J. P., & Lim, C. C. T. (2017) · IEEE Access · doi:10.1109/access.2017.2788044 · Cited by 1,574
Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774
Reinforcement Learning in Healthcare: A Survey
Yu, C., Liu, J., Nemati, S., & Yin, G. (2021) · ACM Computing Surveys · doi:10.1145/3477600 · Cited by 783
Reinforcement learning for intelligent healthcare applications: A survey
Coronato, A., Naeem, M., De Pietro, G., & Paragliola, G. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101964 · Cited by 320
Sim-to-real reinforcement learning for deformable object manipulation
Matas, J., James, S., & Davison, A. J. (2018) · arXiv · doi:10.48550/arxiv.1806.07851 · Cited by 241
Metadata
- Authors
- Thananjeyan, B., Garg, A., Krishnan, S., Chen, C., Miller, L., & Goldberg, K.
- Affiliations
- University of California, Berkeley (US)
- Venue
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2017-05
- Pages
- 2371-2378
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2736750746
- Cited by
- 144
- References
- 38
- Citations by year
- 2026: 5 · 2025: 13 · 2024: 22 · 2023: 20 · 2022: 18 · 2021: 25 · 2020: 21 · 2019: 10 · 2018: 7 · 2017: 3
- FWCI
- 142.47
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications
- Keywords
- pattern cutting, deep reinforcement learning, surgical training, Fundamentals of Laparoscopic Surgery, surgical scissors, finite element analysis, da Vinci Research Kit, policy transfer, cutting trajectory, surgical skill assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
