The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations
Abstract
In the future, robotic surgical assistants may assist surgeons by performing specific subtasks such as retraction and suturing to reduce surgeon tedium and reduce the duration of some operations. We propose an apprenticeship learning approach that has potential to allow robotic surgical assistants to autonomously execute specific trajectories with superhuman performance in terms of speed and smoothness. In the first step, we record a set of trajectories using human-guided backdriven motions of the robot. These are then analyzed to extract a smooth reference trajectory, which we execute at gradually increasing speeds using a variant of iterative learning control. We evaluate this approach on two representative tasks using the Berkeley Surgical Robots: a figure eight trajectory and a two handed knot-tie, a tedious suturing sub-task required in many surgical procedures. Results suggest that the approach enables (i) rapid learning of trajectories, (ii) smoother trajectories than the human-guided trajectories, and (iii) trajectories that are 7 to 10 times faster than the best human-guided trajectories.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Needleman, S. B., & Wunsch, C. D. (1970) · Journal of Molecular Biology · doi:10.1016/0022-2836(70)90057-4 · Cited by 11,288
Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions
Lin, H. C., Shafran, I., Yuh, D., & Hager, G. D. (2006) · Computer Aided Surgery · doi:10.3109/10929080600989189 · Cited by 254 · cited 1×
“Also, there has been some foundational work on the modeling of surgical skill [21], [29], [22].”
Background
Cited by
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124
“Iterative learning control has been applied to a variety of robotic control problems, from model car control (e.g., [1] and [8]) to surgical robotics (e.g., [48]).”
BackgroundSelf-citationRecent Advances in Robot Learning from Demonstration
Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-100819-063206 · Cited by 752
Survey of Model-Based Reinforcement Learning: Applications on Robotics
Polydoros, A. S., & Nalpantidis, L. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-017-0468-y · Cited by 534
An algorithmic perspective on imitation learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405
“In the M-step, the time mapping τ and the covariance matrices R are updated by maximizing the likelihood with respect to the estimated z. DTW is used to update the time mapping τ in [Abbeel et al., 2010, van den Berg et al., 2010].”
BackgroundMethodInfluentialSelf-citationAn Algorithmic Perspective on Imitation Learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · now publishers, Inc. eBooks · doi:10.1561/9781680834116 · Cited by 368
Self-citationLarson, L., & DeChurch, L. A. (2020) · The Leadership Quarterly · doi:10.1016/j.leaqua.2019.101377 · Cited by 358
Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature
Moustris, G. P., Hiridis, S. C., Deliparaschos, K. M., & Konstantinidis, K. M. (2011) · The International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.408 · Cited by 321
Kassahun, Y., Yu, B., Tibebu, A. T., Stoyanov, D., Giannarou, S., Metzen, J. H., & Vander Poorten, E. (2016) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-015-1305-z · Cited by 238
“[9] developed an algorithm that learns a task from multiple human demonstrations.”
BackgroundApplication of artificial intelligence in surgery
Zhou, X.-Y., Guo, Y., Shen, M., & Yang, G.-Z. (2020) · Frontiers of Medicine · doi:10.1007/s11684-020-0770-0 · Cited by 181
Thananjeyan, B., Garg, A., Krishnan, S., Chen, C., Miller, L., & Goldberg, K. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989275 · Cited by 144
“[34] proposed an iterative technique to learn a reference trajectory and execute it at higher than demonstration speeds for suture knot tying.”
MethodSelf-citationLearning Rope Manipulation Policies Using Dense Object Descriptors Trained on Synthetic Depth Data
Sundaresan, P., Grannen, J., Thananjeyan, B., Balakrishna, A., Laskey, M., Stone, K., Gonzalez, J. E., & Goldberg, K. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197121 · Cited by 107
Self-citationAutonomy in surgical robots and its meaningful human control
Ficuciello, F., Tamburrini, G., Arezzo, A., Villani, L., & Siciliano, B. (2019) · Paladyn, Journal of Behavioral Robotics · doi:10.1515/pjbr-2019-0002 · Cited by 92
“Learning-by-demonstration approaches are used in [11] to automate surgical subtasks such as suturing, with an increased performance in terms of speed and smoothness, and in [12] to define a Finite State Machine (FSM) that models discrete components of some surgical subtasks.”
MethodOpen-Sourced Reinforcement Learning Environments for Surgical Robotics
Richter, F., Orosco, R. K., & Yip, M. C. (2019) · arXiv · doi:10.48550/arxiv.1903.02090 · Cited by 92
“Automation efforts includes automating subtasks includes knot tying [9], [10], compliant object manipulation [11], endoscopic motions [12], surgical cutting [13], [14], suture needle manipulation [15], [16] and debris removal [17], [18].”
Thananjeyan, B., Balakrishna, A., Rosolia, U., Li, F., McAllister, R., Gonzalez, J. E., Levine, S., Borrelli, F., & Goldberg, K. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2976272 · Cited by 83
Self-citationHuang, S. H., Pan, J., Mulcaire, G., & Abbeel, P. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353475 · Cited by 39
Self-citationUntangling Dense Non-Planar Knots by Learning Manipulation Features and Recovery Policies
Sundaresan*, P., Grannen*, J., Thananjeyan, B., Balakrishna, A., Ichnowski, J., Novoseller, E., Hwang, M., Laskey, M., Gonzalez, J., & Goldberg, K. (2021) · Robotics: Science and Systems XVII · doi:10.15607/rss.2021.xvii.013 · Cited by 26
Self-citationDisentangling Dense Multi-Cable Knots
Viswanath, V., Grannen, J., Sundaresan, P., Thananjeyan, B., Balakrishna, A., Novoseller, E., Ichnowski, J., Laskey, M., Gonzalez, J. E., & Goldberg, K. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636397 · Cited by 21
Self-citation
Metadata
- Authors
- van den Berg, J., Miller, S., Duckworth, D., Hu, H., Wan, A., Fu, X.-Y., Goldberg, K., & Abbeel, P.
- Venue
- 2010 IEEE International Conference on Robotics and Automation
- Publisher
- IEEE
- Published
- 2010-05
- Pages
- 2074-2081
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2018346149
- Cited by
- 233
- References
- 2
- FWCI
- 11.96
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.