Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions
Open accessThe DOI matches its Crossref record; 17 of the 29 references it cites were found in a registry or an index.
Abstract
This paper reports our progress in developing techniques for "parsing" raw motion data from a simple surgical task into a labeled sequence of surgical gestures. The ability to automatically detect and segment surgical motion can be useful in evaluating surgical skill, providing surgical training feedback, or documenting essential aspects of a procedure. If processed online, the information can be used to provide context-specific information or motion enhancements to the surgeon. However, in every case, the key step is to relate recorded motion data to a model of the procedure being performed. Robotic surgical systems such as the da Vinci system from Intuitive Surgical provide a rich source of motion and video data from surgical procedures. The application programming interface (API) of the da Vinci outputs 192 kinematics values at 10 Hz. Through a series of feature-processing steps, tailored to this task, the highly redundant features are projected to a compact and discriminative space. The resulting classifier is simple and effective.Cross-validation experiments show that the proposed approach can achieve accuracies higher than 90% when segmenting gestures in a 4-throw suturing task, for both expert and intermediate surgeons. These preliminary results suggest that gesture-specific features can be extracted to provide highly accurate surgical skill evaluation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some studies analyze tool movement or other cues to assess surgeon skill 119,121,123,124 , through established ratings such as the Global Operative Assessment of Laparoscopic Skills (GOALS) criteria for laparoscopic surgery 125 .”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [123]
Citations
Cites
Zhan, C. (2003) · JAMA · doi:10.1001/jama.290.14.1868 · Cited by 1,035
Objective assessment of technical skills in surgery
Moorthy, K., Munz, Y., Sarker, S. K., & Darzi, A. (2003) · BMJ · doi:10.1136/bmj.327.7422.1032 · Cited by 651
Datta, V., Mackay, S., Mandalia, M., & Darzi, A. (2001) · Journal of the American College of Surgeons · doi:10.1016/s1072-7515(01)01041-9 · Cited by 415
Darzi, A., Smith, S., & Taffinder, N. (1999) · BMJ · doi:10.1136/bmj.318.7188.887 · Cited by 347
Rosen, J., Hannaford, B., Richards, C. G., & Sinanan, M. N. (2001) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.918597 · Cited by 263
What do master surgeons think of surgical competence and revalidation?
Cuschieri, A., Francis, N. K., Crosby, J., & Hanna, G. B. (2001) · The American Journal of Surgery · doi:10.1016/s0002-9610(01)00667-5 · Cited by 185
Skills evaluation in minimally invasive surgery using force/torque signatures
Richards, C., Rosén, J., Hannaford, B., Pellegrini, C. A., & D, M. N. S. M. (2000) · Surgical Endoscopy · doi:10.1007/s004640000230 · Cited by 162
Relationship between skill and outcome in the laboratory-based model
Datta, V. K., Mandalia, M., Mackay, S., Chang, A., Cheshire, N. J. W., & Darzi, A. W. (2002) · Surgery · doi:10.1067/msy.2002.120235 · Cited by 136 · cited 1×
“, uses electromagnetic markers to track a subject’s hands during a standardized task [17,18].”
BackgroundRosen, J., Solazzo, M., Hannaford, B., & Sinanan, M. (2002) · Computer Aided Surgery · doi:10.1002/igs.10026 · Cited by 135
Scott, D. J., Valentine, R. J., Bergen, P. C., Rege, R. V., Laycock, R., Tesfay, S. T., & Jones, D. B. (2000) · Surgery · doi:10.1067/msy.2000.108115 · Cited by 134
Research works printed but not linked: 8
- King R. T, 1999, Wall Street Journal
- Haddad M., 1987, Int Surg, 72, 230
- Barnes R. W, 1994, Current Surgery, 51, 256
- Cowan C., 1998, Health Care Finance Rev 1999, 21, 165
- Acosta E., 2005, Stud Health Technology Inform, 111, 1
- 10.3109/10929080209146016 · doi:10.3109/10929080209146016
- Verner L., Oleynikov D., Holtman S., Haider H., Zhukov L. Measurements of the level of expertise using flight path analysis from da Vinci robotic surgical system. R. Phillips, J. D. Westwood, R. A. Robb, D. Stredney, H. M. Hoffman, G. T. Mogel. IOS Press, Amsterdam 2003; 94, Medicine Meets Virtual Reality 11. Studies in Health Technology and Informatics
- Murphy T. Towards objective surgical skill evaluation with Hidden Markov Model-based motion recognition. Department of Mechanical Engineering, The Johns Hopkins University. August, 2004, M.S. Thesis
Cited by
Deep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406
Adverse Events in Robotic Surgery: A Retrospective Study of 14 Years of FDA Data
Alemzadeh, H., Raman, J., Leveson, N., Kalbarczyk, Z., & Iyer, R. K. (2016) · PLOS ONE · doi:10.1371/journal.pone.0151470 · Cited by 441
“Common Surgery Types Hysterectomy (2,331) Prostatectomy (1,291) Thoracic (110) Thyroidectomy (19) Cholecystectomy (118) Hernia repair (37) Myomectomy (328) Nephrectomy (138) Lobectomy (67) Tongue base resection (19) Colectomy (61) Nissen fundoplication (34) Sacrocolpopexy (170) Pyeloplasty (31) Mitral valve repair (54…”
Technical review of the da Vinci surgical telemanipulator
Freschi, C., Ferrari, V., Melfi, F., Ferrari, M., Mosca, F., & Cuschieri, A. (2013) · The International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.1468 · Cited by 324
Jin, A., Yeung, S., Jopling, J., Krause, J., Azagury, D., Milstein, A., & Fei-Fei, L. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00081 · Cited by 323
A Dataset and Benchmarks for Segmentation and Recognition of Gestures in Robotic Surgery
Ahmidi, N., Tao, L., Sefati, S., Gao, Y., Lea, C., Haro, B. B., Zappella, L., Khudanpur, S., Vidal, R., & Hager, G. D. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2647680 · Cited by 289
Self-citation
Metadata
- Authors
- Lin, H. C., Shafran, I., Yuh, D., & Hager, G. D.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Lin, Henry C.
- Venue
- Computer Aided Surgery
- Publisher
- Informa UK Limited
- Published
- 2006-01
- Volume
- 11
- Issue
- 5
- Pages
- 220-230
- ISSN
- 1092-9088 (ISSN-L)
- 1097-0150
- OpenAlex
- W2097540174
- Cited by
- 254
- References
- 29
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 5 · 2023: 7 · 2022: 7 · 2021: 23 · 2020: 20 · 2019: 23 · 2018: 19 · 2017: 27 · 2016: 16 · 2015: 13 · 2014: 17 · 2013: 16 · 2012: 11
- FWCI
- 3.73
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Computer Aided Surgery (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation
- Johns Hopkins University
- Intuitive Surgical
- Imperial College London
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- robotic surgery, surgical skill assessment, surgical gesture recognition, motion segmentation, da Vinci surgical system, suturing, feature extraction, kinematic data
- MeSH terms
- Algorithms, Clinical Competence, Humans, Man-Machine Systems, Models, Theoretical, Motion, Psychomotor Performance, Robotics, Software, Time Factors, User-Computer Interface, Surgery, Computer-Assisted
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions. https://app.cochat.ai/papers/10.3109/10929080600989189
- The paper
- Lin, H. C., Shafran, I., Yuh, D., & Hager, G. D. (2006). Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions. Computer Aided Surgery. https://doi.org/10.3109/10929080600989189
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.